2024-09-17T05:20:38.376 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T05:20:38.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:20:38.500 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub} email: pdonnell@redhat.com first_in_suite: false job_id: '7908621' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected - object missing on disk - Invalid tag char sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPCnYQtJRKHUvY6bn9A0pfgkb9cpmhU/wpRCum4EV8eH9U4ZH06cnaAZZL3s+9qfCbs1tyzxg7Ui0ma290zWb7M= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJ6erp4TdrNzj+AbbQe8ShGTM9uMKoySuZjq+AwXi4DQ7/OrHJXDahNdxC6gxNCe+sc2Lbej+jsaoxdQM6vgco= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T05:20:38.500 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T05:20:38.501 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T05:20:38.501 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T05:20:38.502 INFO:teuthology.task.internal:Checking packages... 2024-09-17T05:20:38.523 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T05:20:38.523 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T05:20:38.524 INFO:teuthology.packaging:ref: None 2024-09-17T05:20:38.524 INFO:teuthology.packaging:tag: None 2024-09-17T05:20:38.524 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T05:20:38.524 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:20:38.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T05:20:38.663 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:20:38.664 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T05:20:38.672 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T05:20:38.673 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T05:20:38.702 INFO:teuthology.task.internal:Saving configuration 2024-09-17T05:20:38.721 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T05:20:38.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T05:20:38.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:15:05.982022', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGoWk1QTCPII+VZLNB+pKUcD4UyyoIA/aNrLXhz94D/k'} 2024-09-17T05:20:38.772 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:15:05.980475', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINSzD/nLxz1+SylICBzOM5MfqOzTf63Y7xPOaOLjEMev'} 2024-09-17T05:20:38.772 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T05:20:38.781 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T05:20:38.781 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T05:20:38.781 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T05:20:38.857 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f35b3c0bc70>, signals=[15]) 2024-09-17T05:20:38.857 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T05:20:38.862 INFO:teuthology.task.internal:Opening connections... 2024-09-17T05:20:38.863 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:20:38.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:20:38.973 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:20:38.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:20:39.061 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T05:20:39.068 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-09-17T05:20:39.073 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-09-17T05:20:39.074 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-09-17T05:20:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T05:20:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Ubuntu" 2024-09-17T05:20:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="22.04" 2024-09-17T05:20:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T05:20:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_CODENAME=jammy 2024-09-17T05:20:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:ID=ubuntu 2024-09-17T05:20:39.122 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE=debian 2024-09-17T05:20:39.123 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T05:20:39.123 INFO:teuthology.orchestra.run.smithi044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T05:20:39.123 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T05:20:39.123 INFO:teuthology.orchestra.run.smithi044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T05:20:39.123 INFO:teuthology.orchestra.run.smithi044.stdout:UBUNTU_CODENAME=jammy 2024-09-17T05:20:39.124 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-09-17T05:20:39.162 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-17T05:20:39.167 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-17T05:20:39.167 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-17T05:20:39.214 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T05:20:39.215 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2024-09-17T05:20:39.216 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-17T05:20:39.245 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T05:20:39.255 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T05:20:39.321 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T05:20:39.321 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:20:39.325 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:20:39.329 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T05:20:39.360 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T05:20:39.360 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:20:39.371 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:20:39.387 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T05:20:39.443 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T05:20:39.459 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T05:20:39.459 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-17T05:20:39.459 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-17T05:20:39.459 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:20:39.460 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:20:39.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:20:39.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-17T05:20:39.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:20:39.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-17T05:20:39.637 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:20:39.637 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T05:20:39.637 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-17T05:20:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:5.15.0-56-generic 2024-09-17T05:20:39.643 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:20:39.643 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T05:20:39.643 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-17T05:20:39.643 DEBUG:teuthology.orchestra.run.smithi044:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-17T05:20:39.645 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:20:39.645 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T05:20:39.645 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-17T05:20:39.651 INFO:teuthology.orchestra.run.smithi086.stdout:5.15.0-56-generic 2024-09-17T05:20:39.651 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:20:39.651 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T05:20:39.651 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-17T05:20:39.651 DEBUG:teuthology.orchestra.run.smithi086:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-17T05:20:39.702 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-17T05:20:39.709 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: git config --global init.defaultBranch 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: 2024-09-17T05:20:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:hint: git branch -m 2024-09-17T05:20:39.847 INFO:teuthology.orchestra.run.smithi044.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-17T05:20:39.849 DEBUG:teuthology.orchestra.run.smithi044:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-17T05:20:39.851 INFO:teuthology.orchestra.run.smithi086.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-17T05:20:39.851 INFO:teuthology.orchestra.run.smithi086.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-17T05:20:39.851 INFO:teuthology.orchestra.run.smithi086.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-17T05:20:39.851 INFO:teuthology.orchestra.run.smithi086.stderr:hint: 2024-09-17T05:20:39.851 INFO:teuthology.orchestra.run.smithi086.stderr:hint: git config --global init.defaultBranch 2024-09-17T05:20:39.852 INFO:teuthology.orchestra.run.smithi086.stderr:hint: 2024-09-17T05:20:39.852 INFO:teuthology.orchestra.run.smithi086.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-17T05:20:39.852 INFO:teuthology.orchestra.run.smithi086.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-17T05:20:39.852 INFO:teuthology.orchestra.run.smithi086.stderr:hint: 2024-09-17T05:20:39.852 INFO:teuthology.orchestra.run.smithi086.stderr:hint: git branch -m 2024-09-17T05:20:39.852 INFO:teuthology.orchestra.run.smithi086.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-17T05:20:39.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-17T05:20:39.912 DEBUG:teuthology.orchestra.run.smithi044:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-17T05:20:39.923 DEBUG:teuthology.orchestra.run.smithi086:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-17T05:20:39.966 DEBUG:teuthology.orchestra.run.smithi044:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-17T05:20:39.979 DEBUG:teuthology.orchestra.run.smithi086:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-17T05:21:07.674 INFO:teuthology.orchestra.run.smithi044.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-17T05:21:07.674 INFO:teuthology.orchestra.run.smithi044.stderr: * [new branch] main -> origin/main 2024-09-17T05:21:07.712 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190312 -> 20190312 2024-09-17T05:21:07.712 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190416 -> 20190416 2024-09-17T05:21:07.712 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190514 -> 20190514 2024-09-17T05:21:07.712 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190618 -> 20190618 2024-09-17T05:21:07.712 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190717 -> 20190717 2024-09-17T05:21:07.713 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190815 -> 20190815 2024-09-17T05:21:07.713 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20190923 -> 20190923 2024-09-17T05:21:07.713 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20191022 -> 20191022 2024-09-17T05:21:07.713 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20191215 -> 20191215 2024-09-17T05:21:07.713 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200122 -> 20200122 2024-09-17T05:21:07.713 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200316 -> 20200316 2024-09-17T05:21:07.714 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200421 -> 20200421 2024-09-17T05:21:07.714 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200519 -> 20200519 2024-09-17T05:21:07.714 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200619 -> 20200619 2024-09-17T05:21:07.715 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200721 -> 20200721 2024-09-17T05:21:07.715 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200817 -> 20200817 2024-09-17T05:21:07.715 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20200918 -> 20200918 2024-09-17T05:21:07.715 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20201022 -> 20201022 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20201118 -> 20201118 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20201218 -> 20201218 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210208 -> 20210208 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210315 -> 20210315 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210511 -> 20210511 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210716 -> 20210716 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210818 -> 20210818 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20210919 -> 20210919 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20211027 -> 20211027 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20211216 -> 20211216 2024-09-17T05:21:07.716 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220209 -> 20220209 2024-09-17T05:21:07.718 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220310 -> 20220310 2024-09-17T05:21:07.718 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220411 -> 20220411 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220509 -> 20220509 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220610 -> 20220610 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220708 -> 20220708 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220815 -> 20220815 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20220913 -> 20220913 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20221012 -> 20221012 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20221109 -> 20221109 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20221214 -> 20221214 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230117 -> 20230117 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230210 -> 20230210 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230310 -> 20230310 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230404 -> 20230404 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230515 -> 20230515 2024-09-17T05:21:07.719 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230625 -> 20230625 2024-09-17T05:21:07.720 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230804 -> 20230804 2024-09-17T05:21:07.720 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20230919 -> 20230919 2024-09-17T05:21:07.720 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20231030 -> 20231030 2024-09-17T05:21:07.720 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20231111 -> 20231111 2024-09-17T05:21:07.720 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20231211 -> 20231211 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240115 -> 20240115 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240220 -> 20240220 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240312 -> 20240312 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240410 -> 20240410 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240513 -> 20240513 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240610 -> 20240610 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240709 -> 20240709 2024-09-17T05:21:07.721 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240811 -> 20240811 2024-09-17T05:21:07.722 INFO:teuthology.orchestra.run.smithi044.stderr: * [new tag] 20240909 -> 20240909 2024-09-17T05:21:07.832 INFO:teuthology.orchestra.run.smithi086.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-17T05:21:07.833 INFO:teuthology.orchestra.run.smithi086.stderr: * [new branch] main -> origin/main 2024-09-17T05:21:07.868 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20190312 -> 20190312 2024-09-17T05:21:07.869 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20190416 -> 20190416 2024-09-17T05:21:07.869 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20190514 -> 20190514 2024-09-17T05:21:07.869 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20190618 -> 20190618 2024-09-17T05:21:07.869 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20190717 -> 20190717 2024-09-17T05:21:07.869 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20190815 -> 20190815 2024-09-17T05:21:07.869 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20190923 -> 20190923 2024-09-17T05:21:07.871 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20191022 -> 20191022 2024-09-17T05:21:07.871 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20191215 -> 20191215 2024-09-17T05:21:07.871 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200122 -> 20200122 2024-09-17T05:21:07.871 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200316 -> 20200316 2024-09-17T05:21:07.871 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200421 -> 20200421 2024-09-17T05:21:07.871 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200519 -> 20200519 2024-09-17T05:21:07.871 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200619 -> 20200619 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200721 -> 20200721 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200817 -> 20200817 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20200918 -> 20200918 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20201022 -> 20201022 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20201118 -> 20201118 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20201218 -> 20201218 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20210208 -> 20210208 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20210315 -> 20210315 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20210511 -> 20210511 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20210716 -> 20210716 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20210818 -> 20210818 2024-09-17T05:21:07.872 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20210919 -> 20210919 2024-09-17T05:21:07.875 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20211027 -> 20211027 2024-09-17T05:21:07.875 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20211216 -> 20211216 2024-09-17T05:21:07.875 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220209 -> 20220209 2024-09-17T05:21:07.875 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220310 -> 20220310 2024-09-17T05:21:07.875 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220411 -> 20220411 2024-09-17T05:21:07.875 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220509 -> 20220509 2024-09-17T05:21:07.875 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220610 -> 20220610 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220708 -> 20220708 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220815 -> 20220815 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20220913 -> 20220913 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20221012 -> 20221012 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20221109 -> 20221109 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20221214 -> 20221214 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230117 -> 20230117 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230210 -> 20230210 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230310 -> 20230310 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230404 -> 20230404 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230515 -> 20230515 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230625 -> 20230625 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230804 -> 20230804 2024-09-17T05:21:07.876 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20230919 -> 20230919 2024-09-17T05:21:07.877 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20231030 -> 20231030 2024-09-17T05:21:07.877 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20231111 -> 20231111 2024-09-17T05:21:07.877 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20231211 -> 20231211 2024-09-17T05:21:07.877 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240115 -> 20240115 2024-09-17T05:21:07.877 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240220 -> 20240220 2024-09-17T05:21:07.877 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240312 -> 20240312 2024-09-17T05:21:07.878 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240410 -> 20240410 2024-09-17T05:21:07.878 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240513 -> 20240513 2024-09-17T05:21:07.878 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240610 -> 20240610 2024-09-17T05:21:07.878 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240709 -> 20240709 2024-09-17T05:21:07.878 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240811 -> 20240811 2024-09-17T05:21:07.878 INFO:teuthology.orchestra.run.smithi086.stderr: * [new tag] 20240909 -> 20240909 2024-09-17T05:21:12.485 INFO:teuthology.orchestra.run.smithi086.stderr:Updating files: 39% (1405/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2075/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2434/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2902/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-17T05:21:12.490 INFO:teuthology.orchestra.run.smithi086.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-17T05:21:12.512 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T05:21:12.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:21:12.584 INFO:teuthology.orchestra.run.smithi044.stderr:Updating files: 28% (1004/3520) Updating files: 29% (1021/3520) Updating files: 30% (1056/3520) Updating files: 31% (1092/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2055/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 68% (2426/3520) Updating files: 69% (2429/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 81% (2884/3520) Updating files: 82% (2887/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-17T05:21:12.590 INFO:teuthology.orchestra.run.smithi044.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-17T05:21:12.614 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T05:21:12.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:21:12.672 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:21:12.673 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-17T05:21:12.675 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi086.front.sepia.ceph.com to complete... 2024-09-17T05:21:12.763 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:21:12.763 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-17T05:21:12.765 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi044.front.sepia.ceph.com to complete... 2024-09-17T05:21:13.833 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17 05:21:14 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-17T05:21:13.833 INFO:teuthology.orchestra.run.smithi086.stderr:FINISHED --2024-09-17 05:21:14-- 2024-09-17T05:21:13.833 INFO:teuthology.orchestra.run.smithi086.stderr:Total wall clock time: 1.1s 2024-09-17T05:21:13.833 INFO:teuthology.orchestra.run.smithi086.stderr:Downloaded: 1 files, 43M in 1.0s (42.4 MB/s) 2024-09-17T05:21:13.838 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T05:21:13.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo dpkg -i /tmp/linux-image.deb 2024-09-17T05:21:14.110 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-17T05:21:14.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17 05:21:15 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-17T05:21:14.437 INFO:teuthology.orchestra.run.smithi044.stderr:FINISHED --2024-09-17 05:21:15-- 2024-09-17T05:21:14.437 INFO:teuthology.orchestra.run.smithi044.stderr:Total wall clock time: 1.7s 2024-09-17T05:21:14.437 INFO:teuthology.orchestra.run.smithi044.stderr:Downloaded: 1 files, 43M in 1.5s (28.2 MB/s) 2024-09-17T05:21:14.441 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T05:21:14.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo dpkg -i /tmp/linux-image.deb 2024-09-17T05:21:14.684 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-17T05:21:16.102 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-17T05:21:16.106 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-17T05:21:16.262 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:21:16.643 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-17T05:21:16.648 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-17T05:21:16.766 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:21:20.287 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:21:20.380 INFO:teuthology.orchestra.run.smithi086.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:20.717 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:21:20.814 INFO:teuthology.orchestra.run.smithi044.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:42.723 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:21:42.741 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:21:42.767 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-17T05:21:43.121 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:43.137 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:43.401 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:21:43.411 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:21:43.436 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-09-17T05:21:43.466 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:21:43.480 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:21:43.545 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:21:43.551 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:21:43.710 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:21:43.710 INFO:teuthology.orchestra.run.smithi086.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:21:43.710 INFO:teuthology.orchestra.run.smithi086.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:21:43.752 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-17T05:21:43.790 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:43.804 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:43.953 DEBUG:teuthology.orchestra.run.smithi086:> dpkg-deb -c /tmp/linux-image.deb 2024-09-17T05:21:43.961 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-17T05:21:43.961 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-17T05:21:43.961 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:43.980 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:43.980 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.002 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-17T05:21:44.002 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-17T05:21:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T05:21:44.004 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T05:21:44.005 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-17T05:21:44.006 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-17T05:21:44.006 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-17T05:21:44.006 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T05:21:44.006 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T05:21:44.006 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T05:21:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-17T05:21:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-17T05:21:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-17T05:21:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-17T05:21:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T05:21:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T05:21:44.026 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T05:21:44.027 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-17T05:21:44.028 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T05:21:44.029 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T05:21:44.030 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T05:21:44.031 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T05:21:44.032 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-17T05:21:44.033 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T05:21:44.034 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T05:21:44.035 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T05:21:44.036 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T05:21:44.037 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T05:21:44.038 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-17T05:21:44.039 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-17T05:21:44.040 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T05:21:44.041 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T05:21:44.042 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-17T05:21:44.042 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-17T05:21:44.042 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-17T05:21:44.042 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T05:21:44.049 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:21:44.056 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:21:44.097 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-17T05:21:44.097 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T05:21:44.097 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T05:21:44.097 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T05:21:44.098 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-17T05:21:44.099 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-17T05:21:44.100 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-17T05:21:44.101 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-17T05:21:44.102 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-17T05:21:44.103 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T05:21:44.104 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-17T05:21:44.105 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T05:21:44.106 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T05:21:44.107 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T05:21:44.108 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T05:21:44.109 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T05:21:44.110 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T05:21:44.111 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T05:21:44.112 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T05:21:44.113 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T05:21:44.114 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T05:21:44.115 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T05:21:44.116 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T05:21:44.117 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T05:21:44.118 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T05:21:44.119 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T05:21:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T05:21:44.121 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T05:21:44.122 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T05:21:44.123 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-17T05:21:44.124 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-17T05:21:44.125 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-17T05:21:44.126 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-17T05:21:44.127 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-17T05:21:44.128 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-17T05:21:44.129 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-17T05:21:44.130 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-17T05:21:44.131 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-17T05:21:44.132 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T05:21:44.133 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-17T05:21:44.134 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-17T05:21:44.135 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-17T05:21:44.136 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T05:21:44.137 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-17T05:21:44.138 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-17T05:21:44.139 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-17T05:21:44.140 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-17T05:21:44.141 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-17T05:21:44.142 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-17T05:21:44.143 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T05:21:44.144 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T05:21:44.145 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T05:21:44.146 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T05:21:44.147 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T05:21:44.148 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-17T05:21:44.149 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-17T05:21:44.150 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-17T05:21:44.151 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T05:21:44.152 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:21:44.153 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-17T05:21:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-17T05:21:44.213 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-17T05:21:44.214 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T05:21:44.215 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-17T05:21:44.216 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T05:21:44.217 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-17T05:21:44.218 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-17T05:21:44.219 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T05:21:44.220 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T05:21:44.221 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T05:21:44.222 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T05:21:44.223 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-17T05:21:44.224 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-17T05:21:44.225 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T05:21:44.226 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-17T05:21:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T05:21:44.228 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T05:21:44.229 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T05:21:44.230 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-17T05:21:44.231 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-17T05:21:44.232 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-17T05:21:44.233 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-17T05:21:44.234 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-17T05:21:44.235 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T05:21:44.236 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T05:21:44.237 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T05:21:44.238 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T05:21:44.239 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T05:21:44.240 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-17T05:21:44.241 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T05:21:44.242 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T05:21:44.243 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T05:21:44.244 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-17T05:21:44.245 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T05:21:44.246 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T05:21:44.247 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T05:21:44.248 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T05:21:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-17T05:21:44.250 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-17T05:21:44.251 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-17T05:21:44.252 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-17T05:21:44.253 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-17T05:21:44.254 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-17T05:21:44.255 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-17T05:21:44.256 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-17T05:21:44.257 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-17T05:21:44.258 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T05:21:44.259 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T05:21:44.260 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-17T05:21:44.261 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T05:21:44.262 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T05:21:44.263 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T05:21:44.264 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T05:21:44.265 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T05:21:44.266 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-17T05:21:44.267 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-17T05:21:44.268 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-17T05:21:44.269 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-17T05:21:44.269 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-17T05:21:44.269 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-17T05:21:44.269 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T05:21:44.272 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-17T05:21:44.272 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-17T05:21:44.272 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-17T05:21:44.272 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T05:21:44.273 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T05:21:44.274 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-17T05:21:44.275 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T05:21:44.276 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-17T05:21:44.277 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-17T05:21:44.278 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T05:21:44.279 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-17T05:21:44.280 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-17T05:21:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-17T05:21:44.282 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T05:21:44.283 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:21:44.283 INFO:teuthology.orchestra.run.smithi044.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:21:44.283 INFO:teuthology.orchestra.run.smithi044.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:21:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-17T05:21:44.333 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-17T05:21:44.334 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-17T05:21:44.335 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T05:21:44.336 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-17T05:21:44.337 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T05:21:44.338 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T05:21:44.339 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T05:21:44.340 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T05:21:44.341 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T05:21:44.342 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T05:21:44.343 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-17T05:21:44.344 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-17T05:21:44.345 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-17T05:21:44.346 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T05:21:44.347 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-17T05:21:44.348 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T05:21:44.349 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-17T05:21:44.350 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T05:21:44.351 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T05:21:44.352 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T05:21:44.353 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T05:21:44.354 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-17T05:21:44.355 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-17T05:21:44.356 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T05:21:44.357 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T05:21:44.358 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T05:21:44.359 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T05:21:44.360 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T05:21:44.361 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-17T05:21:44.362 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-17T05:21:44.363 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T05:21:44.364 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T05:21:44.365 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T05:21:44.366 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T05:21:44.367 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T05:21:44.368 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T05:21:44.369 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T05:21:44.370 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T05:21:44.371 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T05:21:44.372 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T05:21:44.373 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T05:21:44.374 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T05:21:44.375 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T05:21:44.376 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T05:21:44.377 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T05:21:44.378 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T05:21:44.379 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T05:21:44.380 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T05:21:44.381 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T05:21:44.382 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-17T05:21:44.383 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T05:21:44.384 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T05:21:44.385 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T05:21:44.386 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T05:21:44.387 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-17T05:21:44.388 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-17T05:21:44.389 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T05:21:44.390 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-17T05:21:44.391 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-17T05:21:44.396 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.397 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.397 DEBUG:teuthology.orchestra.run.smithi086:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-17T05:21:44.404 INFO:teuthology.orchestra.run.smithi086.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:21:44.404 INFO:teuthology.orchestra.run.smithi086.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:21:44.404 INFO:teuthology.orchestra.run.smithi086.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:21:44.405 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-17T05:21:44.405 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.405 DEBUG:teuthology.orchestra.run.smithi086:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-17T05:21:44.447 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi086.front.sepia.ceph.com to complete... 2024-09-17T05:21:44.499 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-deb -c /tmp/linux-image.deb 2024-09-17T05:21:44.507 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-17T05:21:44.508 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-17T05:21:44.508 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.527 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.527 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.549 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-17T05:21:44.550 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-17T05:21:44.551 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-17T05:21:44.551 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-17T05:21:44.551 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T05:21:44.551 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T05:21:44.551 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T05:21:44.552 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T05:21:44.552 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T05:21:44.552 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T05:21:44.552 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T05:21:44.552 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T05:21:44.552 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T05:21:44.553 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T05:21:44.555 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T05:21:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T05:21:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T05:21:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T05:21:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T05:21:44.556 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T05:21:44.557 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T05:21:44.557 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T05:21:44.557 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T05:21:44.557 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-17T05:21:44.557 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-17T05:21:44.557 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-17T05:21:44.558 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T05:21:44.558 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-17T05:21:44.558 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-17T05:21:44.558 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-17T05:21:44.558 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T05:21:44.558 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T05:21:44.558 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T05:21:44.580 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-17T05:21:44.580 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-17T05:21:44.581 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-17T05:21:44.581 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-17T05:21:44.581 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T05:21:44.581 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T05:21:44.581 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T05:21:44.582 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-17T05:21:44.582 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-17T05:21:44.582 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-17T05:21:44.582 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T05:21:44.582 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T05:21:44.583 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T05:21:44.583 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T05:21:44.583 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T05:21:44.583 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T05:21:44.583 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T05:21:44.583 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T05:21:44.584 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T05:21:44.584 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T05:21:44.584 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T05:21:44.584 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T05:21:44.584 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T05:21:44.584 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T05:21:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T05:21:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T05:21:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T05:21:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T05:21:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-17T05:21:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T05:21:44.586 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-17T05:21:44.586 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T05:21:44.586 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T05:21:44.586 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T05:21:44.586 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T05:21:44.586 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T05:21:44.587 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T05:21:44.587 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T05:21:44.587 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T05:21:44.587 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-17T05:21:44.587 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T05:21:44.587 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T05:21:44.588 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T05:21:44.588 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T05:21:44.588 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T05:21:44.588 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T05:21:44.588 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T05:21:44.588 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T05:21:44.589 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T05:21:44.589 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T05:21:44.589 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T05:21:44.589 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T05:21:44.589 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T05:21:44.589 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T05:21:44.590 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T05:21:44.590 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T05:21:44.590 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T05:21:44.590 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-17T05:21:44.591 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T05:21:44.591 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-17T05:21:44.591 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-17T05:21:44.591 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-17T05:21:44.591 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T05:21:44.592 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T05:21:44.592 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-17T05:21:44.592 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-17T05:21:44.592 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T05:21:44.592 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T05:21:44.592 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T05:21:44.593 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T05:21:44.593 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T05:21:44.593 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-17T05:21:44.593 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T05:21:44.593 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-17T05:21:44.593 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T05:21:44.594 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-17T05:21:44.594 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T05:21:44.594 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T05:21:44.594 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T05:21:44.594 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T05:21:44.594 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T05:21:44.595 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T05:21:44.596 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T05:21:44.597 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T05:21:44.598 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T05:21:44.599 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T05:21:44.600 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T05:21:44.601 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T05:21:44.602 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-17T05:21:44.603 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T05:21:44.604 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T05:21:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-17T05:21:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-17T05:21:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-17T05:21:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T05:21:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-17T05:21:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T05:21:44.648 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-17T05:21:44.649 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T05:21:44.650 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-17T05:21:44.651 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-17T05:21:44.652 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-17T05:21:44.653 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-17T05:21:44.654 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T05:21:44.655 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T05:21:44.656 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T05:21:44.657 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T05:21:44.658 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T05:21:44.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-17T05:21:44.660 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T05:21:44.661 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T05:21:44.662 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T05:21:44.663 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T05:21:44.664 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T05:21:44.665 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T05:21:44.666 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T05:21:44.667 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T05:21:44.668 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T05:21:44.669 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T05:21:44.670 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T05:21:44.671 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T05:21:44.672 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T05:21:44.673 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-17T05:21:44.674 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-17T05:21:44.675 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T05:21:44.676 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-17T05:21:44.677 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T05:21:44.677 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-17T05:21:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T05:21:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-17T05:21:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T05:21:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-17T05:21:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-17T05:21:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-17T05:21:44.680 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T05:21:44.681 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-17T05:21:44.682 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-17T05:21:44.683 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T05:21:44.684 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T05:21:44.685 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T05:21:44.686 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-17T05:21:44.687 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T05:21:44.688 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T05:21:44.689 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T05:21:44.690 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T05:21:44.691 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-17T05:21:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T05:21:44.693 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-17T05:21:44.694 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-17T05:21:44.695 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-17T05:21:44.696 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T05:21:44.715 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T05:21:44.715 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T05:21:44.715 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T05:21:44.715 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-17T05:21:44.715 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-17T05:21:44.716 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-17T05:21:44.717 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-17T05:21:44.718 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-17T05:21:44.719 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-17T05:21:44.720 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T05:21:44.721 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T05:21:44.722 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T05:21:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-17T05:21:44.724 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-17T05:21:44.725 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-17T05:21:44.726 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T05:21:44.727 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T05:21:44.728 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-17T05:21:44.729 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-17T05:21:44.730 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T05:21:44.731 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-17T05:21:44.732 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T05:21:44.733 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T05:21:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T05:21:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T05:21:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T05:21:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T05:21:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T05:21:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T05:21:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T05:21:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T05:21:44.755 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T05:21:44.756 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-17T05:21:44.757 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-17T05:21:44.758 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-17T05:21:44.759 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-17T05:21:44.760 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T05:21:44.761 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T05:21:44.762 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-17T05:21:44.763 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-17T05:21:44.764 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T05:21:44.765 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-17T05:21:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T05:21:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-17T05:21:44.768 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T05:21:44.769 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T05:21:44.770 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-17T05:21:44.771 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T05:21:44.772 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-17T05:21:44.773 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-17T05:21:44.774 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T05:21:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T05:21:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T05:21:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-17T05:21:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T05:21:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-17T05:21:44.775 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T05:21:44.779 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T05:21:44.780 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T05:21:44.781 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T05:21:44.782 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T05:21:44.783 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T05:21:44.792 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T05:21:44.793 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T05:21:44.794 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T05:21:44.795 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-17T05:21:44.796 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-17T05:21:44.797 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-17T05:21:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-17T05:21:44.799 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-17T05:21:44.800 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-17T05:21:44.801 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-17T05:21:44.802 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-17T05:21:44.803 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-17T05:21:44.803 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-17T05:21:44.821 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-17T05:21:44.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-17T05:21:44.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-17T05:21:44.821 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T05:21:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-17T05:21:44.823 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-17T05:21:44.824 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T05:21:44.825 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T05:21:44.826 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T05:21:44.827 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T05:21:44.828 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T05:21:44.829 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T05:21:44.830 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-17T05:21:44.831 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-17T05:21:44.832 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T05:21:44.833 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-17T05:21:44.834 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T05:21:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T05:21:44.836 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T05:21:44.837 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-17T05:21:44.838 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-17T05:21:44.839 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-17T05:21:44.840 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T05:21:44.843 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-17T05:21:44.843 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T05:21:44.843 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-17T05:21:44.843 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T05:21:44.843 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-17T05:21:44.843 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T05:21:44.844 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T05:21:44.845 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T05:21:44.846 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T05:21:44.847 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T05:21:44.848 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-17T05:21:44.848 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T05:21:44.851 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-17T05:21:44.851 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T05:21:44.855 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T05:21:44.856 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T05:21:44.857 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T05:21:44.858 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T05:21:44.859 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T05:21:44.859 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T05:21:44.859 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-17T05:21:44.859 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-17T05:21:44.859 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-17T05:21:44.859 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-17T05:21:44.860 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T05:21:44.860 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-17T05:21:44.860 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T05:21:44.860 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-17T05:21:44.860 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T05:21:44.860 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T05:21:44.862 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:21:44.862 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T05:21:44.863 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T05:21:44.863 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T05:21:44.863 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-17T05:21:44.863 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-17T05:21:44.863 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-17T05:21:44.863 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T05:21:44.863 INFO:teuthology.orchestra.run.smithi086.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:21:44.864 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-17T05:21:44.864 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-17T05:21:44.865 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T05:21:44.866 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-17T05:21:44.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T05:21:44.866 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-17T05:21:44.866 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-17T05:21:44.866 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T05:21:44.871 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-17T05:21:44.871 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T05:21:44.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T05:21:44.872 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-17T05:21:44.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T05:21:44.872 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-17T05:21:44.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T05:21:44.872 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-17T05:21:44.872 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T05:21:44.873 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-17T05:21:44.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T05:21:44.873 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-17T05:21:44.873 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T05:21:44.883 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-17T05:21:44.883 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-17T05:21:44.883 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T05:21:44.884 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T05:21:44.885 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-17T05:21:44.886 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-17T05:21:44.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T05:21:44.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-17T05:21:44.886 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-17T05:21:44.891 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T05:21:44.892 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T05:21:44.893 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T05:21:44.894 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-17T05:21:44.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T05:21:44.894 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-17T05:21:44.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T05:21:44.894 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T05:21:44.895 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-17T05:21:44.909 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T05:21:44.910 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T05:21:44.911 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T05:21:44.912 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T05:21:44.913 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-17T05:21:44.914 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T05:21:44.915 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T05:21:44.916 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T05:21:44.917 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T05:21:44.918 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T05:21:44.919 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-17T05:21:44.920 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-17T05:21:44.921 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T05:21:44.922 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T05:21:44.923 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T05:21:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T05:21:44.925 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T05:21:44.926 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T05:21:44.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T05:21:44.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T05:21:44.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-17T05:21:44.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T05:21:44.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T05:21:44.941 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T05:21:44.942 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T05:21:44.943 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T05:21:44.944 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T05:21:44.945 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T05:21:44.946 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T05:21:44.947 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T05:21:44.948 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T05:21:44.949 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T05:21:44.950 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T05:21:44.951 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T05:21:44.952 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T05:21:44.953 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T05:21:44.954 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-17T05:21:44.955 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T05:21:44.956 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-17T05:21:44.957 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-17T05:21:44.962 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.962 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.962 DEBUG:teuthology.orchestra.run.smithi044:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-17T05:21:44.990 INFO:teuthology.orchestra.run.smithi044.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:21:44.990 INFO:teuthology.orchestra.run.smithi044.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:21:44.991 INFO:teuthology.orchestra.run.smithi044.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:21:44.991 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-17T05:21:44.991 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:44.991 DEBUG:teuthology.orchestra.run.smithi044:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-17T05:21:45.034 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi044.front.sepia.ceph.com to complete... 2024-09-17T05:21:45.123 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:45.129 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:45.382 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:21:45.388 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:21:45.429 INFO:teuthology.orchestra.run.smithi086.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:21:45.434 INFO:teuthology.orchestra.run.smithi086.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:21:45.481 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:21:45.482 INFO:teuthology.orchestra.run.smithi044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:21:45.495 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-09-17T05:21:45.597 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:21:45.597 INFO:teuthology.orchestra.run.smithi086.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:21:45.597 INFO:teuthology.orchestra.run.smithi086.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:21:45.631 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-17T05:21:45.658 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:45.664 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:21:45.898 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:21:45.903 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:21:45.948 INFO:teuthology.orchestra.run.smithi044.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:21:45.953 INFO:teuthology.orchestra.run.smithi044.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:21:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:21:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:21:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:21:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-09-17T05:22:16.752 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T05:22:16.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-17T05:22:16.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:22:17.235 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T05:22:17.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-17T05:22:17.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:22:35.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-17T05:22:35.713 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-09-17T05:22:44.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-17T05:22:44.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:22:44.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-17T05:22:44.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:22:47.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-17T05:22:59.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-17T05:22:59.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:23:17.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-09-17T05:23:32.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-17T05:23:32.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:23:33.145 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-17T05:23:33.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-17T05:23:33.998 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T05:23:33.998 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-17T05:23:34.046 INFO:teuthology.orchestra.run.smithi086.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:23:34.046 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:23:34.046 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:23:34.046 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T05:23:35.047 DEBUG:teuthology.parallel:result is None 2024-09-17T05:23:44.716 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T05:23:56.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-17T05:23:56.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:23:56.992 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-17T05:23:57.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-17T05:23:57.641 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T05:23:57.641 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-09-17T05:23:57.688 INFO:teuthology.orchestra.run.smithi044.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:23:57.688 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:23:57.689 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:23:57.689 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T05:23:58.692 DEBUG:teuthology.parallel:result is None 2024-09-17T05:23:58.692 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T05:23:58.698 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T05:23:58.698 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:23:58.702 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:23:58.711 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T05:23:58.739 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T05:23:58.777 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T05:23:58.777 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:23:58.780 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:23:58.896 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T05:23:58.903 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T05:23:58.904 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:23:58.907 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:23:58.994 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:23:59.029 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:23:59.044 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:23:59.067 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:23:59.069 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T05:23:59.076 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T05:23:59.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:23:59.080 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:23:59.101 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T05:23:59.110 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T05:23:59.110 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:23:59.144 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:23:59.155 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:23:59.203 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:23:59.253 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:23:59.254 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:23:59.318 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:23:59.327 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:23:59.380 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:23:59.380 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:23:59.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-09-17T05:23:59.460 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-17T05:23:59.581 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T05:23:59.588 INFO:teuthology.task.internal:Starting timer... 2024-09-17T05:23:59.588 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T05:23:59.643 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T05:23:59.693 DEBUG:teuthology.task.selinux:Excluding smithi044: OS 'ubuntu' does not support SELinux 2024-09-17T05:23:59.694 DEBUG:teuthology.task.selinux:Excluding smithi086: OS 'ubuntu' does not support SELinux 2024-09-17T05:23:59.694 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T05:23:59.694 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T05:23:59.694 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T05:23:59.694 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T05:23:59.725 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-17T05:23:59.728 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-17T05:23:59.849 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T05:23:59.860 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T05:23:59.861 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T05:32:16.236 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2024-09-17T05:32:16.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-17T05:32:16.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:32:16.324 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-09-17T05:32:16.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-09-17T05:32:16.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-17T05:32:16.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:32:16.528 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-17T05:32:16.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-17T05:32:16.656 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T05:32:16.666 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T05:32:16.666 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:32:16.667 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:32:16.670 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:32:16.670 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:32:16.706 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T05:32:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Command line: ntpd -gq 2024-09-17T05:32:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: ---------------------------------------------------- 2024-09-17T05:32:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T05:32:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T05:32:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: corporation. Support and training for ntp-4 are 2024-09-17T05:32:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: available at https://www.nwtime.org/support 2024-09-17T05:32:16.707 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: ---------------------------------------------------- 2024-09-17T05:32:16.708 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: proto: precision = 0.042 usec (-24) 2024-09-17T05:32:16.708 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: basedate set to 2022-02-04 2024-09-17T05:32:16.708 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: gps base set to 2022-02-06 (week 2196) 2024-09-17T05:32:16.708 INFO:teuthology.orchestra.run.smithi044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:32:16.709 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:32:16.709 INFO:teuthology.orchestra.run.smithi044.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Listen normally on 3 ens1f0 172.21.15.44:123 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Listen normally on 4 lo [::1]:123 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1572%4]:123 2024-09-17T05:32:16.710 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:16 ntpd[18366]: Listening on routing socket on fd #22 for interface updates 2024-09-17T05:32:16.738 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T05:32:16.738 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Command line: ntpd -gq 2024-09-17T05:32:16.738 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: ---------------------------------------------------- 2024-09-17T05:32:16.738 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T05:32:16.738 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T05:32:16.739 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: corporation. Support and training for ntp-4 are 2024-09-17T05:32:16.739 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: available at https://www.nwtime.org/support 2024-09-17T05:32:16.739 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: ---------------------------------------------------- 2024-09-17T05:32:16.739 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: proto: precision = 0.042 usec (-24) 2024-09-17T05:32:16.739 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: basedate set to 2022-02-04 2024-09-17T05:32:16.739 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: gps base set to 2022-02-06 (week 2196) 2024-09-17T05:32:16.740 INFO:teuthology.orchestra.run.smithi086.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:32:16.740 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:32:16.740 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:32:16.740 INFO:teuthology.orchestra.run.smithi086.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:32:16.741 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T05:32:16.742 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T05:32:16.742 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T05:32:16.742 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Listen normally on 3 enp3s0f1 172.21.15.86:123 2024-09-17T05:32:16.742 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Listen normally on 4 lo [::1]:123 2024-09-17T05:32:16.742 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d809%5]:123 2024-09-17T05:32:16.742 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:16 ntpd[18480]: Listening on routing socket on fd #22 for interface updates 2024-09-17T05:32:17.707 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:17 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:17.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:17 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:17.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:17 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:17.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:17 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:17.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:17 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:17.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:17 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:17.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:17.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:17 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:18.707 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:18 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:18.707 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:18 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:18.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:18 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:18.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:18 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:18.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:18 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:18.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:18 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:19.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:19 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:19.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:19.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:19 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:20.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:20 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:21.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:21.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:21.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:21.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:21 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:21.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:21.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:21.742 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:21.742 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:21.742 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:21 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:22.707 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:22 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:22.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:22 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:22.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:22 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:22.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:22 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:22.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:22 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:22.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:22 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:23.709 INFO:teuthology.orchestra.run.smithi044.stdout:17 Sep 05:32:23 ntpd[18366]: ntpd: time slew -0.001442 s 2024-09-17T05:32:23.710 INFO:teuthology.orchestra.run.smithi044.stdout:ntpd: time slew -0.001442s 2024-09-17T05:32:23.710 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T05:32:23.710 INFO:teuthology.orchestra.run.smithi044.stderr:17 Sep 05:32:23 ntpd[18366]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:32:23.740 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:32:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:32:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:32:23.741 INFO:teuthology.orchestra.run.smithi086.stdout:17 Sep 05:32:23 ntpd[18480]: ntpd: time slew +0.000809 s 2024-09-17T05:32:23.741 INFO:teuthology.orchestra.run.smithi086.stdout:ntpd: time slew +0.000809s 2024-09-17T05:32:23.741 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T05:32:23.742 INFO:teuthology.orchestra.run.smithi086.stderr:17 Sep 05:32:23 ntpd[18480]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T05:32:23.808 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:32:23.808 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-09-17T05:32:23.808 INFO:teuthology.orchestra.run.smithi044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.808 INFO:teuthology.orchestra.run.smithi044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.808 INFO:teuthology.orchestra.run.smithi044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.808 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:32:23.821 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-09-17T05:32:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.821 INFO:teuthology.orchestra.run.smithi086.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.822 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:32:23.823 INFO:teuthology.run_tasks:Running task install... 2024-09-17T05:32:23.832 DEBUG:teuthology.task.install:project ceph 2024-09-17T05:32:23.832 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T05:32:23.832 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T05:32:23.832 INFO:teuthology.task.install:Using flavor: default 2024-09-17T05:32:23.838 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T05:32:23.838 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T05:32:23.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-key list | grep Ceph 2024-09-17T05:32:23.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-key list | grep Ceph 2024-09-17T05:32:23.958 INFO:teuthology.orchestra.run.smithi044.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T05:32:23.964 INFO:teuthology.orchestra.run.smithi086.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T05:32:24.010 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T05:32:24.010 INFO:teuthology.orchestra.run.smithi044.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T05:32:24.011 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-17T05:32:24.012 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-17T05:32:24.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:32:24.017 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T05:32:24.017 INFO:teuthology.orchestra.run.smithi086.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T05:32:24.017 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-17T05:32:24.017 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-17T05:32:24.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:32:24.158 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default/ 2024-09-17T05:32:24.158 INFO:teuthology.task.install.deb:Package version is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:32:24.170 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default/ 2024-09-17T05:32:24.170 INFO:teuthology.task.install.deb:Package version is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:32:24.270 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:32:24.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T05:32:24.279 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:32:24.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T05:32:24.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo apt-get update 2024-09-17T05:32:24.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo apt-get update 2024-09-17T05:32:24.478 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:32:24.478 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T05:32:24.485 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T05:32:24.503 INFO:teuthology.orchestra.run.smithi044.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T05:32:24.529 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T05:32:24.535 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T05:32:24.550 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-17T05:32:24.556 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-17T05:32:24.572 INFO:teuthology.orchestra.run.smithi044.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T05:32:24.578 INFO:teuthology.orchestra.run.smithi086.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T05:32:24.594 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-17T05:32:24.600 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-17T05:32:24.621 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:32:24.621 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T05:32:24.626 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,420 B] 2024-09-17T05:32:24.642 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-17T05:32:24.683 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T05:32:24.765 INFO:teuthology.orchestra.run.smithi086.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T05:32:25.096 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 29.2 kB in 1s (51.2 kB/s) 2024-09-17T05:32:25.217 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 29.2 kB in 1s (42.5 kB/s) 2024-09-17T05:32:26.183 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-17T05:32:26.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4989-gce1b342b-1jammy cephadm=19.3.0-4989-gce1b342b-1jammy ceph-mds=19.3.0-4989-gce1b342b-1jammy ceph-mgr=19.3.0-4989-gce1b342b-1jammy ceph-common=19.3.0-4989-gce1b342b-1jammy ceph-fuse=19.3.0-4989-gce1b342b-1jammy ceph-test=19.3.0-4989-gce1b342b-1jammy ceph-volume=19.3.0-4989-gce1b342b-1jammy radosgw=19.3.0-4989-gce1b342b-1jammy python3-rados=19.3.0-4989-gce1b342b-1jammy python3-rgw=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy python3-rbd=19.3.0-4989-gce1b342b-1jammy libcephfs2=19.3.0-4989-gce1b342b-1jammy libcephfs-dev=19.3.0-4989-gce1b342b-1jammy librados2=19.3.0-4989-gce1b342b-1jammy librbd1=19.3.0-4989-gce1b342b-1jammy rbd-fuse=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy cephfs-shell=19.3.0-4989-gce1b342b-1jammy cephfs-top=19.3.0-4989-gce1b342b-1jammy cephfs-mirror=19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:32:26.258 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-17T05:32:26.273 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4989-gce1b342b-1jammy cephadm=19.3.0-4989-gce1b342b-1jammy ceph-mds=19.3.0-4989-gce1b342b-1jammy ceph-mgr=19.3.0-4989-gce1b342b-1jammy ceph-common=19.3.0-4989-gce1b342b-1jammy ceph-fuse=19.3.0-4989-gce1b342b-1jammy ceph-test=19.3.0-4989-gce1b342b-1jammy ceph-volume=19.3.0-4989-gce1b342b-1jammy radosgw=19.3.0-4989-gce1b342b-1jammy python3-rados=19.3.0-4989-gce1b342b-1jammy python3-rgw=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy python3-rbd=19.3.0-4989-gce1b342b-1jammy libcephfs2=19.3.0-4989-gce1b342b-1jammy libcephfs-dev=19.3.0-4989-gce1b342b-1jammy librados2=19.3.0-4989-gce1b342b-1jammy librbd1=19.3.0-4989-gce1b342b-1jammy rbd-fuse=19.3.0-4989-gce1b342b-1jammy python3-cephfs=19.3.0-4989-gce1b342b-1jammy cephfs-shell=19.3.0-4989-gce1b342b-1jammy cephfs-top=19.3.0-4989-gce1b342b-1jammy cephfs-mirror=19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:32:26.278 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-17T05:32:26.350 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-17T05:32:26.471 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-17T05:32:26.472 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-17T05:32:26.534 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-17T05:32:26.535 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-17T05:32:26.670 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:32:26.670 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:32:26.670 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:32:26.670 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:32:26.671 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:32:26.671 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:32:26.671 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:32:26.672 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-09-17T05:32:26.672 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T05:32:26.672 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T05:32:26.674 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-17T05:32:26.675 INFO:teuthology.orchestra.run.smithi044.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T05:32:26.676 INFO:teuthology.orchestra.run.smithi044.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T05:32:26.677 INFO:teuthology.orchestra.run.smithi044.stdout:Recommended packages: 2024-09-17T05:32:26.677 INFO:teuthology.orchestra.run.smithi044.stdout: btrfs-tools 2024-09-17T05:32:26.719 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:32:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:32:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:32:26.719 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:32:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:32:26.720 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:32:26.720 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:32:26.721 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-17T05:32:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T05:32:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T05:32:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:32:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T05:32:26.721 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T05:32:26.722 INFO:teuthology.orchestra.run.smithi086.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T05:32:26.722 INFO:teuthology.orchestra.run.smithi086.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-17T05:32:26.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T05:32:26.724 INFO:teuthology.orchestra.run.smithi086.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T05:32:26.725 INFO:teuthology.orchestra.run.smithi086.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T05:32:26.725 INFO:teuthology.orchestra.run.smithi086.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T05:32:26.725 INFO:teuthology.orchestra.run.smithi086.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T05:32:26.725 INFO:teuthology.orchestra.run.smithi086.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T05:32:26.725 INFO:teuthology.orchestra.run.smithi086.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T05:32:26.725 INFO:teuthology.orchestra.run.smithi086.stdout:Recommended packages: 2024-09-17T05:32:26.725 INFO:teuthology.orchestra.run.smithi086.stdout: btrfs-tools 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-17T05:32:26.837 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T05:32:26.838 INFO:teuthology.orchestra.run.smithi044.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T05:32:26.839 INFO:teuthology.orchestra.run.smithi044.stdout: socat unzip xmlstarlet zip 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-17T05:32:26.878 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T05:32:26.880 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T05:32:26.881 INFO:teuthology.orchestra.run.smithi086.stdout: socat unzip xmlstarlet zip 2024-09-17T05:32:26.989 INFO:teuthology.orchestra.run.smithi044.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-17T05:32:26.989 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 239 MB of archives. 2024-09-17T05:32:26.989 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 986 MB of additional disk space will be used. 2024-09-17T05:32:26.989 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4989-gce1b342b-1jammy [3,591 kB] 2024-09-17T05:32:27.028 INFO:teuthology.orchestra.run.smithi086.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-17T05:32:27.028 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 239 MB of archives. 2024-09-17T05:32:27.028 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 986 MB of additional disk space will be used. 2024-09-17T05:32:27.029 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4989-gce1b342b-1jammy [3,591 kB] 2024-09-17T05:32:27.035 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-17T05:32:27.075 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-17T05:32:27.118 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T05:32:27.157 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T05:32:27.164 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-17T05:32:27.186 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4989-gce1b342b-1jammy [3,368 kB] 2024-09-17T05:32:27.203 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-17T05:32:27.248 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4989-gce1b342b-1jammy [733 kB] 2024-09-17T05:32:27.251 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4989-gce1b342b-1jammy [3,368 kB] 2024-09-17T05:32:27.288 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4989-gce1b342b-1jammy [356 kB] 2024-09-17T05:32:27.293 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4989-gce1b342b-1jammy [32.8 kB] 2024-09-17T05:32:27.294 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4989-gce1b342b-1jammy [180 kB] 2024-09-17T05:32:27.297 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4989-gce1b342b-1jammy [71.3 kB] 2024-09-17T05:32:27.298 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4989-gce1b342b-1jammy [337 kB] 2024-09-17T05:32:27.304 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4989-gce1b342b-1jammy [8,847 kB] 2024-09-17T05:32:27.343 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4989-gce1b342b-1jammy [733 kB] 2024-09-17T05:32:27.361 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T05:32:27.383 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4989-gce1b342b-1jammy [356 kB] 2024-09-17T05:32:27.392 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4989-gce1b342b-1jammy [32.8 kB] 2024-09-17T05:32:27.392 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4989-gce1b342b-1jammy [180 kB] 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4989-gce1b342b-1jammy [71.3 kB] 2024-09-17T05:32:27.396 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4989-gce1b342b-1jammy [337 kB] 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T05:32:27.402 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4989-gce1b342b-1jammy [8,847 kB] 2024-09-17T05:32:27.453 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T05:32:27.466 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T05:32:27.490 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T05:32:27.504 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T05:32:27.516 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T05:32:27.553 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T05:32:27.578 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4989-gce1b342b-1jammy [112 kB] 2024-09-17T05:32:27.579 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4989-gce1b342b-1jammy [478 kB] 2024-09-17T05:32:27.621 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4989-gce1b342b-1jammy [29.1 MB] 2024-09-17T05:32:27.689 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T05:32:27.698 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T05:32:27.724 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T05:32:27.726 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T05:32:27.730 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4989-gce1b342b-1jammy [112 kB] 2024-09-17T05:32:27.733 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T05:32:27.734 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T05:32:27.735 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T05:32:27.736 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T05:32:27.737 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4989-gce1b342b-1jammy [478 kB] 2024-09-17T05:32:27.744 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4989-gce1b342b-1jammy [29.1 MB] 2024-09-17T05:32:27.755 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T05:32:27.760 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T05:32:27.761 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T05:32:27.763 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T05:32:27.770 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T05:32:27.771 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T05:32:27.773 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T05:32:27.774 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T05:32:27.792 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T05:32:27.795 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T05:32:27.800 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T05:32:27.807 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T05:32:27.847 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T05:32:27.849 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T05:32:27.851 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T05:32:27.852 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T05:32:27.853 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T05:32:27.853 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T05:32:27.854 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T05:32:27.855 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T05:32:27.855 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T05:32:27.884 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T05:32:27.886 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T05:32:27.888 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T05:32:27.889 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T05:32:27.890 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T05:32:27.890 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T05:32:27.891 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T05:32:27.892 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T05:32:27.892 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T05:32:27.934 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T05:32:27.935 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T05:32:27.935 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T05:32:27.970 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T05:32:27.971 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T05:32:28.016 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T05:32:28.018 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T05:32:28.018 INFO:teuthology.orchestra.run.smithi044.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T05:32:28.019 INFO:teuthology.orchestra.run.smithi044.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T05:32:28.019 INFO:teuthology.orchestra.run.smithi044.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T05:32:28.020 INFO:teuthology.orchestra.run.smithi044.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T05:32:28.021 INFO:teuthology.orchestra.run.smithi044.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T05:32:28.051 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T05:32:28.052 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T05:32:28.054 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T05:32:28.055 INFO:teuthology.orchestra.run.smithi086.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T05:32:28.056 INFO:teuthology.orchestra.run.smithi086.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T05:32:28.056 INFO:teuthology.orchestra.run.smithi086.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T05:32:28.057 INFO:teuthology.orchestra.run.smithi086.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T05:32:28.057 INFO:teuthology.orchestra.run.smithi086.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T05:32:28.097 INFO:teuthology.orchestra.run.smithi044.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T05:32:28.099 INFO:teuthology.orchestra.run.smithi044.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T05:32:28.099 INFO:teuthology.orchestra.run.smithi044.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T05:32:28.133 INFO:teuthology.orchestra.run.smithi086.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T05:32:28.134 INFO:teuthology.orchestra.run.smithi086.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T05:32:28.179 INFO:teuthology.orchestra.run.smithi044.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T05:32:28.184 INFO:teuthology.orchestra.run.smithi044.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T05:32:28.185 INFO:teuthology.orchestra.run.smithi044.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T05:32:28.185 INFO:teuthology.orchestra.run.smithi044.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T05:32:28.186 INFO:teuthology.orchestra.run.smithi044.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T05:32:28.187 INFO:teuthology.orchestra.run.smithi044.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T05:32:28.189 INFO:teuthology.orchestra.run.smithi044.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T05:32:28.215 INFO:teuthology.orchestra.run.smithi086.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T05:32:28.215 INFO:teuthology.orchestra.run.smithi086.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T05:32:28.220 INFO:teuthology.orchestra.run.smithi086.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T05:32:28.220 INFO:teuthology.orchestra.run.smithi086.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T05:32:28.221 INFO:teuthology.orchestra.run.smithi086.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T05:32:28.222 INFO:teuthology.orchestra.run.smithi086.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T05:32:28.223 INFO:teuthology.orchestra.run.smithi086.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T05:32:28.224 INFO:teuthology.orchestra.run.smithi086.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T05:32:28.261 INFO:teuthology.orchestra.run.smithi044.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T05:32:28.262 INFO:teuthology.orchestra.run.smithi044.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T05:32:28.262 INFO:teuthology.orchestra.run.smithi044.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T05:32:28.296 INFO:teuthology.orchestra.run.smithi086.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T05:32:28.297 INFO:teuthology.orchestra.run.smithi086.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T05:32:28.307 INFO:teuthology.orchestra.run.smithi086.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T05:32:28.309 INFO:teuthology.orchestra.run.smithi086.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T05:32:28.310 INFO:teuthology.orchestra.run.smithi086.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T05:32:28.311 INFO:teuthology.orchestra.run.smithi086.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T05:32:28.342 INFO:teuthology.orchestra.run.smithi044.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T05:32:28.343 INFO:teuthology.orchestra.run.smithi044.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T05:32:28.343 INFO:teuthology.orchestra.run.smithi044.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T05:32:28.345 INFO:teuthology.orchestra.run.smithi044.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T05:32:28.379 INFO:teuthology.orchestra.run.smithi086.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T05:32:28.454 INFO:teuthology.orchestra.run.smithi044.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T05:32:28.454 INFO:teuthology.orchestra.run.smithi044.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T05:32:28.456 INFO:teuthology.orchestra.run.smithi044.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T05:32:28.456 INFO:teuthology.orchestra.run.smithi044.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T05:32:28.457 INFO:teuthology.orchestra.run.smithi044.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T05:32:28.487 INFO:teuthology.orchestra.run.smithi086.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T05:32:28.488 INFO:teuthology.orchestra.run.smithi086.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T05:32:28.489 INFO:teuthology.orchestra.run.smithi086.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T05:32:28.489 INFO:teuthology.orchestra.run.smithi086.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T05:32:28.491 INFO:teuthology.orchestra.run.smithi086.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T05:32:28.529 INFO:teuthology.orchestra.run.smithi044.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T05:32:28.531 INFO:teuthology.orchestra.run.smithi044.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T05:32:28.531 INFO:teuthology.orchestra.run.smithi044.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T05:32:28.557 INFO:teuthology.orchestra.run.smithi044.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4989-gce1b342b-1jammy [5,020 kB] 2024-09-17T05:32:28.562 INFO:teuthology.orchestra.run.smithi086.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T05:32:28.565 INFO:teuthology.orchestra.run.smithi086.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T05:32:28.565 INFO:teuthology.orchestra.run.smithi086.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T05:32:28.602 INFO:teuthology.orchestra.run.smithi044.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T05:32:28.602 INFO:teuthology.orchestra.run.smithi044.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T05:32:28.603 INFO:teuthology.orchestra.run.smithi044.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T05:32:28.603 INFO:teuthology.orchestra.run.smithi044.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T05:32:28.604 INFO:teuthology.orchestra.run.smithi044.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T05:32:28.605 INFO:teuthology.orchestra.run.smithi044.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T05:32:28.635 INFO:teuthology.orchestra.run.smithi086.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T05:32:28.635 INFO:teuthology.orchestra.run.smithi086.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T05:32:28.636 INFO:teuthology.orchestra.run.smithi086.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T05:32:28.636 INFO:teuthology.orchestra.run.smithi086.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T05:32:28.637 INFO:teuthology.orchestra.run.smithi086.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T05:32:28.637 INFO:teuthology.orchestra.run.smithi086.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T05:32:28.669 INFO:teuthology.orchestra.run.smithi044.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T05:32:28.669 INFO:teuthology.orchestra.run.smithi044.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T05:32:28.673 INFO:teuthology.orchestra.run.smithi044.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T05:32:28.704 INFO:teuthology.orchestra.run.smithi086.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T05:32:28.705 INFO:teuthology.orchestra.run.smithi086.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T05:32:28.709 INFO:teuthology.orchestra.run.smithi086.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T05:32:28.709 INFO:teuthology.orchestra.run.smithi086.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4989-gce1b342b-1jammy [5,020 kB] 2024-09-17T05:32:28.721 INFO:teuthology.orchestra.run.smithi044.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4989-gce1b342b-1jammy [251 kB] 2024-09-17T05:32:28.723 INFO:teuthology.orchestra.run.smithi044.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4989-gce1b342b-1jammy [126 kB] 2024-09-17T05:32:28.725 INFO:teuthology.orchestra.run.smithi044.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4989-gce1b342b-1jammy [1,551 kB] 2024-09-17T05:32:28.751 INFO:teuthology.orchestra.run.smithi044.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T05:32:28.752 INFO:teuthology.orchestra.run.smithi044.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T05:32:28.752 INFO:teuthology.orchestra.run.smithi044.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T05:32:28.756 INFO:teuthology.orchestra.run.smithi044.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T05:32:28.759 INFO:teuthology.orchestra.run.smithi044.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-17T05:32:28.759 INFO:teuthology.orchestra.run.smithi044.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T05:32:28.760 INFO:teuthology.orchestra.run.smithi044.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T05:32:28.774 INFO:teuthology.orchestra.run.smithi044.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4989-gce1b342b-1jammy [6,200 kB] 2024-09-17T05:32:28.785 INFO:teuthology.orchestra.run.smithi086.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T05:32:28.791 INFO:teuthology.orchestra.run.smithi086.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T05:32:28.792 INFO:teuthology.orchestra.run.smithi086.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T05:32:28.797 INFO:teuthology.orchestra.run.smithi086.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T05:32:28.804 INFO:teuthology.orchestra.run.smithi086.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-17T05:32:28.804 INFO:teuthology.orchestra.run.smithi086.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T05:32:28.820 INFO:teuthology.orchestra.run.smithi086.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T05:32:28.832 INFO:teuthology.orchestra.run.smithi044.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T05:32:28.837 INFO:teuthology.orchestra.run.smithi044.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T05:32:28.837 INFO:teuthology.orchestra.run.smithi044.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T05:32:28.867 INFO:teuthology.orchestra.run.smithi086.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T05:32:28.872 INFO:teuthology.orchestra.run.smithi086.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T05:32:28.875 INFO:teuthology.orchestra.run.smithi086.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T05:32:28.880 INFO:teuthology.orchestra.run.smithi086.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4989-gce1b342b-1jammy [251 kB] 2024-09-17T05:32:28.883 INFO:teuthology.orchestra.run.smithi086.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4989-gce1b342b-1jammy [126 kB] 2024-09-17T05:32:28.888 INFO:teuthology.orchestra.run.smithi086.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4989-gce1b342b-1jammy [1,551 kB] 2024-09-17T05:32:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T05:32:28.914 INFO:teuthology.orchestra.run.smithi044.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T05:32:28.915 INFO:teuthology.orchestra.run.smithi044.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T05:32:28.916 INFO:teuthology.orchestra.run.smithi044.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T05:32:28.917 INFO:teuthology.orchestra.run.smithi044.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T05:32:28.918 INFO:teuthology.orchestra.run.smithi044.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T05:32:28.925 INFO:teuthology.orchestra.run.smithi044.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T05:32:28.935 INFO:teuthology.orchestra.run.smithi086.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4989-gce1b342b-1jammy [6,200 kB] 2024-09-17T05:32:28.949 INFO:teuthology.orchestra.run.smithi086.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T05:32:28.949 INFO:teuthology.orchestra.run.smithi086.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T05:32:28.949 INFO:teuthology.orchestra.run.smithi086.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T05:32:28.950 INFO:teuthology.orchestra.run.smithi086.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T05:32:28.951 INFO:teuthology.orchestra.run.smithi086.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T05:32:28.952 INFO:teuthology.orchestra.run.smithi086.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T05:32:28.959 INFO:teuthology.orchestra.run.smithi086.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T05:32:28.983 INFO:teuthology.orchestra.run.smithi044.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4989-gce1b342b-1jammy [22.9 MB] 2024-09-17T05:32:28.995 INFO:teuthology.orchestra.run.smithi044.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T05:32:28.996 INFO:teuthology.orchestra.run.smithi044.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T05:32:28.998 INFO:teuthology.orchestra.run.smithi044.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi086.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi086.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T05:32:29.032 INFO:teuthology.orchestra.run.smithi086.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T05:32:29.077 INFO:teuthology.orchestra.run.smithi044.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T05:32:29.111 INFO:teuthology.orchestra.run.smithi086.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T05:32:29.137 INFO:teuthology.orchestra.run.smithi086.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4989-gce1b342b-1jammy [22.9 MB] 2024-09-17T05:32:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4989-gce1b342b-1jammy [14.0 kB] 2024-09-17T05:32:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4989-gce1b342b-1jammy [865 kB] 2024-09-17T05:32:29.741 INFO:teuthology.orchestra.run.smithi044.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4989-gce1b342b-1jammy [2,386 kB] 2024-09-17T05:32:29.827 INFO:teuthology.orchestra.run.smithi044.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4989-gce1b342b-1jammy [814 kB] 2024-09-17T05:32:29.840 INFO:teuthology.orchestra.run.smithi044.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4989-gce1b342b-1jammy [160 kB] 2024-09-17T05:32:29.849 INFO:teuthology.orchestra.run.smithi044.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4989-gce1b342b-1jammy [61.5 MB] 2024-09-17T05:32:29.915 INFO:teuthology.orchestra.run.smithi086.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4989-gce1b342b-1jammy [14.0 kB] 2024-09-17T05:32:29.916 INFO:teuthology.orchestra.run.smithi086.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4989-gce1b342b-1jammy [865 kB] 2024-09-17T05:32:29.926 INFO:teuthology.orchestra.run.smithi086.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4989-gce1b342b-1jammy [2,386 kB] 2024-09-17T05:32:30.020 INFO:teuthology.orchestra.run.smithi086.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4989-gce1b342b-1jammy [814 kB] 2024-09-17T05:32:30.036 INFO:teuthology.orchestra.run.smithi086.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4989-gce1b342b-1jammy [160 kB] 2024-09-17T05:32:30.038 INFO:teuthology.orchestra.run.smithi086.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4989-gce1b342b-1jammy [61.5 MB] 2024-09-17T05:32:31.834 INFO:teuthology.orchestra.run.smithi044.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4989-gce1b342b-1jammy [8,625 kB] 2024-09-17T05:32:32.107 INFO:teuthology.orchestra.run.smithi044.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4989-gce1b342b-1jammy [14.2 kB] 2024-09-17T05:32:32.107 INFO:teuthology.orchestra.run.smithi044.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4989-gce1b342b-1jammy [40.9 MB] 2024-09-17T05:32:32.127 INFO:teuthology.orchestra.run.smithi086.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4989-gce1b342b-1jammy [8,625 kB] 2024-09-17T05:32:32.404 INFO:teuthology.orchestra.run.smithi086.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4989-gce1b342b-1jammy [14.2 kB] 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi086.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4989-gce1b342b-1jammy [40.9 MB] 2024-09-17T05:32:33.415 INFO:teuthology.orchestra.run.smithi044.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4989-gce1b342b-1jammy [130 kB] 2024-09-17T05:32:33.416 INFO:teuthology.orchestra.run.smithi044.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4989-gce1b342b-1jammy [237 kB] 2024-09-17T05:32:33.419 INFO:teuthology.orchestra.run.smithi044.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4989-gce1b342b-1jammy [33.9 kB] 2024-09-17T05:32:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4989-gce1b342b-1jammy [23.4 kB] 2024-09-17T05:32:33.420 INFO:teuthology.orchestra.run.smithi044.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4989-gce1b342b-1jammy [39.0 kB] 2024-09-17T05:32:33.421 INFO:teuthology.orchestra.run.smithi044.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4989-gce1b342b-1jammy [17.6 MB] 2024-09-17T05:32:33.797 INFO:teuthology.orchestra.run.smithi086.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4989-gce1b342b-1jammy [130 kB] 2024-09-17T05:32:33.797 INFO:teuthology.orchestra.run.smithi086.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4989-gce1b342b-1jammy [237 kB] 2024-09-17T05:32:33.816 INFO:teuthology.orchestra.run.smithi086.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4989-gce1b342b-1jammy [33.9 kB] 2024-09-17T05:32:33.817 INFO:teuthology.orchestra.run.smithi086.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4989-gce1b342b-1jammy [23.4 kB] 2024-09-17T05:32:33.817 INFO:teuthology.orchestra.run.smithi086.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4989-gce1b342b-1jammy [39.0 kB] 2024-09-17T05:32:33.818 INFO:teuthology.orchestra.run.smithi086.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4989-gce1b342b-1jammy [17.6 MB] 2024-09-17T05:32:33.969 INFO:teuthology.orchestra.run.smithi044.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4989-gce1b342b-1jammy [93.1 kB] 2024-09-17T05:32:34.188 INFO:teuthology.orchestra.run.smithi086.stdout:Get:125 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4989-gce1b342b-1jammy [93.1 kB] 2024-09-17T05:32:34.649 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 239 MB in 7s (33.6 MB/s) 2024-09-17T05:32:34.777 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-17T05:32:34.840 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 239 MB in 7s (32.8 MB/s) 2024-09-17T05:32:34.845 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-17T05:32:34.849 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-17T05:32:34.892 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-17T05:32:34.993 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-17T05:32:35.058 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-17T05:32:35.061 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-17T05:32:35.100 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-17T05:32:35.170 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T05:32:35.184 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T05:32:35.220 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:32:35.361 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T05:32:35.375 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T05:32:35.403 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:32:35.565 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cmd2. 2024-09-17T05:32:35.579 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-17T05:32:35.623 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-17T05:32:35.714 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cmd2. 2024-09-17T05:32:35.727 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-17T05:32:35.772 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-17T05:32:35.968 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T05:32:35.983 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T05:32:36.101 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:32:36.133 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T05:32:36.146 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T05:32:36.234 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:32:36.430 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T05:32:36.445 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T05:32:36.488 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:32:36.595 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T05:32:36.608 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T05:32:36.653 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:32:36.800 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T05:32:36.815 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T05:32:36.849 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:32:36.948 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T05:32:36.962 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T05:32:36.998 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:32:37.320 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T05:32:37.335 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:32:37.386 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:32:37.401 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T05:32:37.415 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:32:37.467 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:32:37.790 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T05:32:37.805 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:32:37.848 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:32:37.913 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T05:32:37.927 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:32:37.970 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:32:38.176 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T05:32:38.191 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:32:38.234 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:32:38.274 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T05:32:38.289 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:32:38.324 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:32:38.587 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T05:32:38.603 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T05:32:38.635 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T05:32:38.646 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:32:38.650 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T05:32:38.693 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:32:38.974 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librados2. 2024-09-17T05:32:38.989 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../010-librados2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:39.032 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:39.229 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librados2. 2024-09-17T05:32:39.244 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../010-librados2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:39.287 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libnbd0. 2024-09-17T05:32:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T05:32:39.740 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libnbd0. 2024-09-17T05:32:39.751 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T05:32:39.754 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T05:32:39.807 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T05:32:40.068 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librbd1. 2024-09-17T05:32:40.082 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../012-librbd1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:40.088 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librbd1. 2024-09-17T05:32:40.103 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../012-librbd1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:40.146 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:40.151 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:40.553 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T05:32:40.567 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:40.582 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T05:32:40.598 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:40.612 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:40.641 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:40.889 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rados. 2024-09-17T05:32:40.903 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:40.947 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:40.960 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rados. 2024-09-17T05:32:40.975 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:41.010 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:42.399 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T05:32:42.415 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T05:32:42.449 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T05:32:42.487 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T05:32:42.502 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T05:32:42.546 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T05:32:42.727 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T05:32:42.742 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:42.785 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:42.857 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T05:32:42.873 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:42.915 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:43.129 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T05:32:43.144 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T05:32:43.187 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:32:43.327 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T05:32:43.342 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T05:32:43.393 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:32:43.465 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T05:32:43.479 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T05:32:43.523 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:32:43.746 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T05:32:43.761 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T05:32:43.812 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:32:43.834 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T05:32:43.849 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T05:32:43.884 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:32:44.157 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T05:32:44.173 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T05:32:44.212 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua5.1. 2024-09-17T05:32:44.223 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:32:44.227 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T05:32:44.271 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:32:44.569 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua5.1. 2024-09-17T05:32:44.581 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-any. 2024-09-17T05:32:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T05:32:44.596 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-17T05:32:44.635 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:32:44.640 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T05:32:44.893 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package zip. 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-17T05:32:44.942 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T05:32:44.972 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-any. 2024-09-17T05:32:44.987 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-17T05:32:45.038 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T05:32:45.229 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package unzip. 2024-09-17T05:32:45.241 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package zip. 2024-09-17T05:32:45.244 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T05:32:45.256 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-17T05:32:45.279 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:32:45.299 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T05:32:45.627 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package unzip. 2024-09-17T05:32:45.643 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T05:32:45.682 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package luarocks. 2024-09-17T05:32:45.686 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:32:45.697 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T05:32:45.749 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:32:46.082 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package luarocks. 2024-09-17T05:32:46.095 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T05:32:46.139 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package librgw2. 2024-09-17T05:32:46.139 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:32:46.153 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../028-librgw2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:46.222 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:46.558 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package librgw2. 2024-09-17T05:32:46.574 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../028-librgw2_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:46.632 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:46.842 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T05:32:46.857 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:46.891 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:47.161 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T05:32:47.176 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T05:32:47.219 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:32:47.277 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T05:32:47.292 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:47.335 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:47.547 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T05:32:47.562 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:47.605 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:47.655 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T05:32:47.670 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T05:32:47.704 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:32:48.008 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T05:32:48.022 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:48.033 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-common. 2024-09-17T05:32:48.048 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:48.074 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:48.091 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:48.536 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-common. 2024-09-17T05:32:48.550 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:48.594 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:49.530 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-base. 2024-09-17T05:32:49.543 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:49.589 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:50.142 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T05:32:50.154 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T05:32:50.192 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:32:50.224 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-base. 2024-09-17T05:32:50.238 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:32:50.292 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:32:50.469 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T05:32:50.480 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T05:32:50.519 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:32:50.789 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T05:32:50.802 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T05:32:50.839 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:32:50.945 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T05:32:50.962 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T05:32:51.012 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:32:51.167 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T05:32:51.178 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T05:32:51.216 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:32:51.406 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T05:32:51.422 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T05:32:51.482 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:32:51.502 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T05:32:51.514 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T05:32:51.552 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:32:51.855 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T05:32:51.867 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T05:32:51.876 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T05:32:51.892 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T05:32:51.905 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T05:32:51.943 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:32:52.191 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-portend. 2024-09-17T05:32:52.203 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-17T05:32:52.233 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T05:32:52.271 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T05:32:52.286 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T05:32:52.361 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:32:52.569 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T05:32:52.584 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T05:32:52.627 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T05:32:52.724 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T05:32:52.739 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T05:32:52.790 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:32:52.913 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T05:32:52.927 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T05:32:52.971 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:32:53.160 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T05:32:53.175 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T05:32:53.227 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T05:32:53.282 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T05:32:53.296 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T05:32:53.341 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T05:32:53.621 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-portend. 2024-09-17T05:32:53.637 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-17T05:32:53.669 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T05:32:53.679 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T05:32:53.686 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T05:32:53.727 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T05:32:54.016 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T05:32:54.031 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T05:32:54.038 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T05:32:54.053 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T05:32:54.082 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T05:32:54.096 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:32:54.399 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-mako. 2024-09-17T05:32:54.414 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T05:32:54.457 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:32:54.469 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T05:32:54.484 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T05:32:54.543 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:32:54.827 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T05:32:54.842 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T05:32:54.855 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T05:32:54.871 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T05:32:54.885 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:32:54.914 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T05:32:55.178 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T05:32:55.213 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:32:55.251 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T05:32:55.266 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T05:32:55.325 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T05:32:55.499 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webob. 2024-09-17T05:32:55.513 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T05:32:55.548 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:32:55.645 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T05:32:55.660 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T05:32:55.703 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:32:55.860 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T05:32:55.875 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T05:32:55.912 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:32:55.981 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-mako. 2024-09-17T05:32:55.997 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T05:32:56.031 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:32:56.246 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T05:32:56.260 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T05:32:56.304 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:32:56.351 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T05:32:56.361 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T05:32:56.393 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:32:56.573 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-paste. 2024-09-17T05:32:56.588 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T05:32:56.623 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:32:56.696 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T05:32:56.711 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T05:32:56.753 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:32:56.927 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T05:32:56.941 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T05:32:56.984 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:32:57.048 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webob. 2024-09-17T05:32:57.060 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T05:32:57.097 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:32:57.279 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T05:32:57.293 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T05:32:57.329 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:32:57.476 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T05:32:57.488 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T05:32:57.529 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:32:57.632 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T05:32:57.646 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T05:32:57.690 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T05:32:57.787 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T05:32:57.803 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T05:32:57.862 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:32:58.001 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T05:32:58.016 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T05:32:58.059 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:32:58.174 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-paste. 2024-09-17T05:32:58.187 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T05:32:58.223 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:32:58.447 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T05:32:58.462 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T05:32:58.505 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T05:32:58.510 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T05:32:58.526 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T05:32:58.560 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:32:58.825 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-idna. 2024-09-17T05:32:58.838 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T05:32:58.839 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T05:32:58.852 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T05:32:58.882 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:32:58.896 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:32:59.135 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T05:32:59.150 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T05:32:59.185 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:32:59.216 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T05:32:59.230 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T05:32:59.282 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T05:32:59.505 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests. 2024-09-17T05:32:59.515 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T05:32:59.555 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:32:59.577 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T05:32:59.591 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T05:32:59.936 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:33:00.724 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T05:33:00.738 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T05:33:00.782 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T05:33:00.820 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T05:33:00.833 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T05:33:00.874 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:33:01.110 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-idna. 2024-09-17T05:33:01.124 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T05:33:01.127 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T05:33:01.139 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:01.168 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:33:01.177 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:01.513 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T05:33:01.527 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T05:33:01.556 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T05:33:01.567 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:01.571 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:33:01.606 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:01.899 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests. 2024-09-17T05:33:01.901 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T05:33:01.912 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T05:33:01.913 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T05:33:01.950 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:33:01.990 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:33:02.270 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T05:33:02.282 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T05:33:02.294 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T05:33:02.308 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T05:33:02.320 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T05:33:02.343 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:33:02.639 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T05:33:02.653 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:02.664 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T05:33:02.676 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:02.696 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:02.714 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:03.077 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T05:33:03.091 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:03.117 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T05:33:03.129 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:03.135 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:03.167 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:03.488 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T05:33:03.501 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T05:33:03.546 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:33:03.762 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T05:33:03.776 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T05:33:03.820 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T05:33:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T05:33:04.227 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T05:33:04.241 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:04.285 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:04.590 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph. 2024-09-17T05:33:04.603 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../069-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:04.631 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:04.797 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T05:33:04.811 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:04.855 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:04.917 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T05:33:04.930 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:04.976 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:05.345 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T05:33:05.358 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:05.395 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:05.625 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T05:33:05.642 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:05.675 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:05.789 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephadm. 2024-09-17T05:33:05.802 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../072-cephadm_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:05.839 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:06.100 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T05:33:06.112 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T05:33:06.141 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T05:33:06.444 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T05:33:06.458 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:33:06.502 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:06.503 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph. 2024-09-17T05:33:06.518 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../069-ceph_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:06.562 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:06.881 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T05:33:06.895 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:06.939 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:07.326 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T05:33:07.340 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:07.384 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:07.432 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-babel. 2024-09-17T05:33:07.443 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:33:07.482 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:07.737 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephadm. 2024-09-17T05:33:07.751 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../072-cephadm_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:07.786 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:07.794 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T05:33:07.807 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T05:33:07.845 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:33:08.106 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T05:33:08.120 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T05:33:08.181 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T05:33:08.193 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:08.197 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T05:33:08.230 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:08.500 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T05:33:08.514 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:33:08.559 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T05:33:08.588 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T05:33:08.625 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T05:33:08.920 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-routes. 2024-09-17T05:33:08.932 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T05:33:08.961 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:33:09.281 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T05:33:09.294 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:09.364 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:09.555 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-babel. 2024-09-17T05:33:09.568 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:33:09.605 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:09.908 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T05:33:09.921 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T05:33:09.949 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:33:10.286 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T05:33:10.299 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:10.336 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:10.639 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T05:33:10.653 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T05:33:10.697 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T05:33:10.959 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-routes. 2024-09-17T05:33:10.973 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T05:33:11.017 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:33:11.345 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T05:33:11.359 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:11.395 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:11.726 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T05:33:11.740 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T05:33:11.784 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:33:12.205 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T05:33:12.217 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T05:33:12.331 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:33:12.718 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T05:33:12.730 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T05:33:12.768 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:33:13.079 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T05:33:13.092 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T05:33:13.129 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:33:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T05:33:13.748 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T05:33:13.779 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T05:33:13.791 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:13.800 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:33:13.829 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:14.287 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T05:33:14.300 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T05:33:14.431 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:33:14.740 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T05:33:14.754 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T05:33:14.760 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T05:33:14.776 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T05:33:14.798 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T05:33:14.810 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:33:15.101 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T05:33:15.115 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T05:33:15.129 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T05:33:15.145 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T05:33:15.159 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:33:15.187 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:33:15.496 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T05:33:15.510 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T05:33:15.554 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:33:15.915 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T05:33:15.929 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-17T05:33:15.973 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T05:33:16.138 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T05:33:16.152 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:16.188 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:16.277 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T05:33:16.290 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T05:33:16.335 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T05:33:16.655 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T05:33:16.669 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T05:33:16.713 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:33:17.033 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T05:33:17.046 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T05:33:17.082 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T05:33:17.258 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T05:33:17.274 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T05:33:17.316 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T05:33:17.335 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T05:33:17.349 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T05:33:17.385 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:33:17.570 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T05:33:17.588 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T05:33:17.619 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:33:17.956 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T05:33:17.973 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T05:33:18.014 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:33:18.023 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T05:33:18.036 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:18.073 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:18.359 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T05:33:18.376 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-17T05:33:18.384 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T05:33:18.397 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T05:33:18.425 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T05:33:18.434 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:33:18.779 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T05:33:18.792 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:33:18.837 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:33:18.913 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T05:33:18.929 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T05:33:18.979 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T05:33:19.098 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package jq. 2024-09-17T05:33:19.112 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:33:19.156 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T05:33:19.358 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T05:33:19.374 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T05:33:19.417 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package socat. 2024-09-17T05:33:19.424 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:33:19.431 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T05:33:19.467 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:33:19.720 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T05:33:19.734 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T05:33:19.770 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:33:19.811 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T05:33:19.828 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T05:33:19.894 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T05:33:20.107 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-test. 2024-09-17T05:33:20.120 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:20.165 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:20.272 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T05:33:20.289 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T05:33:20.339 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:33:21.053 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T05:33:21.068 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:21.111 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:21.431 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T05:33:21.446 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T05:33:21.489 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:33:21.858 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T05:33:21.875 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:33:21.917 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:33:22.145 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package jq. 2024-09-17T05:33:22.161 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:33:22.194 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T05:33:22.453 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T05:33:22.455 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package socat. 2024-09-17T05:33:22.467 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:22.472 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T05:33:22.511 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:22.513 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:33:22.867 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T05:33:22.884 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T05:33:22.890 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-17T05:33:22.904 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:22.925 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:33:22.948 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:23.276 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-colorama. 2024-09-17T05:33:23.279 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-test. 2024-09-17T05:33:23.290 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-17T05:33:23.295 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:23.334 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-17T05:33:23.337 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:23.578 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-shell. 2024-09-17T05:33:23.593 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:23.637 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:23.856 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package cephfs-top. 2024-09-17T05:33:23.870 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:23.914 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:24.166 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T05:33:24.180 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:24.224 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:24.561 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T05:33:24.575 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T05:33:24.618 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:33:24.956 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T05:33:24.970 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T05:33:25.014 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:33:25.350 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T05:33:25.360 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T05:33:25.367 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:25.374 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T05:33:25.408 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:25.409 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:33:25.796 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-17T05:33:25.813 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:25.854 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:25.864 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package pkg-config. 2024-09-17T05:33:25.878 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T05:33:25.931 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:33:26.159 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T05:33:26.173 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T05:33:26.191 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-colorama. 2024-09-17T05:33:26.207 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-17T05:33:26.217 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:33:26.249 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-17T05:33:26.493 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-shell. 2024-09-17T05:33:26.509 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:26.553 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:26.578 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T05:33:26.592 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T05:33:26.628 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T05:33:26.797 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package cephfs-top. 2024-09-17T05:33:26.814 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4989-gce1b342b-1jammy_all.deb ... 2024-09-17T05:33:26.856 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:26.964 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T05:33:26.978 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T05:33:27.022 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T05:33:27.133 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T05:33:27.150 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:27.200 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:27.342 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T05:33:27.356 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T05:33:27.400 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:33:27.520 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T05:33:27.536 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T05:33:27.577 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:33:27.719 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T05:33:27.734 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T05:33:27.777 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T05:33:27.882 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T05:33:27.899 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T05:33:27.957 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:33:28.139 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-py. 2024-09-17T05:33:28.153 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-17T05:33:28.197 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T05:33:28.336 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T05:33:28.353 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T05:33:28.394 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:33:28.525 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T05:33:28.540 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T05:33:28.583 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:33:28.817 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pkg-config. 2024-09-17T05:33:28.833 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T05:33:28.909 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:33:28.987 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T05:33:29.000 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T05:33:29.028 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:33:29.161 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T05:33:29.178 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T05:33:29.219 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:33:29.364 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-toml. 2024-09-17T05:33:29.378 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-17T05:33:29.423 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T05:33:29.698 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T05:33:29.713 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T05:33:29.725 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T05:33:29.739 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T05:33:29.756 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T05:33:29.783 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:33:30.092 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T05:33:30.103 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T05:33:30.108 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T05:33:30.117 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T05:33:30.150 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T05:33:30.161 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:33:30.431 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T05:33:30.444 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T05:33:30.470 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T05:33:30.487 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T05:33:30.489 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:33:30.537 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:33:30.857 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T05:33:30.873 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T05:33:30.915 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T05:33:31.193 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package radosgw. 2024-09-17T05:33:31.205 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../123-radosgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:31.242 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:31.559 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-py. 2024-09-17T05:33:31.576 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-17T05:33:31.617 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T05:33:31.955 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T05:33:31.971 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T05:33:32.012 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:33:32.104 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T05:33:32.118 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:32.162 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:32.458 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T05:33:32.464 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T05:33:32.474 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T05:33:32.516 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:33:32.742 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:33:32.851 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:33:32.878 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-toml. 2024-09-17T05:33:32.895 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-17T05:33:32.936 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T05:33:33.087 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T05:33:33.214 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T05:33:33.231 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T05:33:33.272 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:33:33.461 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T05:33:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T05:33:33.625 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T05:33:33.667 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:33:33.962 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T05:33:33.978 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T05:33:34.004 INFO:teuthology.orchestra.run.smithi086.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T05:33:34.020 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:33:34.056 INFO:teuthology.orchestra.run.smithi086.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-17T05:33:34.103 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:34.671 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user cephadm....done 2024-09-17T05:33:34.732 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package radosgw. 2024-09-17T05:33:34.748 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../123-radosgw_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:34.782 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:34.825 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:33:35.085 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:33:35.353 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:33:35.512 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:33:35.677 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T05:33:35.694 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4989-gce1b342b-1jammy_amd64.deb ... 2024-09-17T05:33:35.735 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:35.771 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T05:33:36.058 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T05:33:36.065 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:33:36.207 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T05:33:36.333 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:33:36.442 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:33:36.584 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:33:36.935 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T05:33:36.944 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T05:33:37.203 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-17T05:33:37.352 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T05:33:37.471 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T05:33:37.755 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:33:38.040 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:33:38.060 INFO:teuthology.orchestra.run.smithi044.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T05:33:38.074 INFO:teuthology.orchestra.run.smithi044.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-17T05:33:38.136 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:38.300 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:33:38.567 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:33:38.814 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user cephadm....done 2024-09-17T05:33:38.835 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:38.959 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:33:39.102 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:33:39.235 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:33:39.253 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T05:33:39.388 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:33:39.495 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:33:39.514 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-17T05:33:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:33:39.781 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:33:39.907 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:33:39.939 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T05:33:40.166 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:33:40.215 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:33:40.341 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T05:33:40.562 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T05:33:40.613 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T05:33:40.660 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:33:40.678 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:33:40.787 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T05:33:41.020 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T05:33:41.163 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:41.288 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-17T05:33:41.289 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T05:33:41.582 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:33:41.648 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T05:33:41.858 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:33:41.941 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:33:42.167 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T05:33:42.184 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:33:42.276 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:33:42.477 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:33:42.745 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:33:42.953 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:33:43.021 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-argparse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:43.230 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:33:43.289 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:33:43.355 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:33:43.416 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T05:33:43.481 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:33:43.541 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:33:43.667 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-17T05:33:43.799 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T05:33:43.943 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:33:44.044 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:33:44.200 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T05:33:44.303 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:33:44.451 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:33:44.692 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T05:33:44.734 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T05:33:44.798 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:33:44.828 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:33:44.924 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T05:33:45.113 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-17T05:33:45.301 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:45.435 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T05:33:45.463 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:33:45.719 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:33:45.814 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:33:46.004 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:33:46.074 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:33:46.200 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:46.355 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T05:33:46.509 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:33:46.515 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:33:47.052 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:33:47.275 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:33:47.543 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:33:47.652 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:33:47.787 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:33:48.113 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T05:33:48.249 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:33:48.492 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:33:48.556 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T05:33:48.626 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:33:48.886 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:33:49.012 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:33:49.146 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:33:49.234 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:33:49.448 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:33:49.535 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-17T05:33:49.715 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T05:33:49.853 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:33:49.975 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:33:50.125 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:33:50.230 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:33:50.435 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:33:50.522 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:33:50.673 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:50.703 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T05:33:50.970 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T05:33:51.008 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:33:51.238 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:33:51.401 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:33:51.522 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T05:33:51.807 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T05:33:52.217 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:33:52.343 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:33:52.636 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:33:52.682 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:33:52.929 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:33:52.942 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:33:53.102 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T05:33:53.190 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:33:53.316 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:33:53.394 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:33:53.442 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:53.520 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:33:53.530 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T05:33:53.647 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:33:53.777 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:33:53.894 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:33:53.998 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:33:54.283 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T05:33:54.296 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:33:54.567 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:33:54.572 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T05:33:54.685 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:33:54.706 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T05:33:54.974 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:33:54.986 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:33:55.100 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:33:55.271 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T05:33:55.426 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:33:55.572 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T05:33:55.728 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:33:55.865 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:33:56.072 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T05:33:56.166 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T05:33:56.232 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T05:33:56.442 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:33:56.508 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T05:33:56.543 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T05:33:56.784 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:33:56.870 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:33:57.020 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:33:57.069 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:33:57.355 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:33:57.429 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T05:33:57.681 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:33:57.713 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:33:57.983 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:33:58.074 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:33:58.100 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:33:58.200 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:58.201 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:33:58.273 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T05:33:58.326 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:58.453 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:33:58.520 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:33:58.645 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:33:58.780 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:58.915 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:59.041 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T05:33:59.064 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:59.357 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T05:33:59.460 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:59.483 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T05:33:59.561 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:33:59.769 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:33:59.769 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:33:59.775 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:33:59.902 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:34:00.253 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:34:00.371 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:00.530 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:00.579 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:34:00.681 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:00.816 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:00.942 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:34:00.983 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T05:34:01.117 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T05:34:01.402 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T05:34:01.703 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:34:02.038 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:34:02.457 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T05:34:02.735 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:02.775 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:34:02.845 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:02.971 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:03.097 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:03.127 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:34:03.223 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:03.244 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librados2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:03.349 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:03.370 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:03.497 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:34:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:03.927 INFO:teuthology.orchestra.run.smithi086.stdout:Adding group ceph....done 2024-09-17T05:34:03.959 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libradosstriper1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:04.060 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T05:34:04.278 INFO:teuthology.orchestra.run.smithi086.stdout:Adding system user ceph....done 2024-09-17T05:34:04.354 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librbd1 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:04.455 INFO:teuthology.orchestra.run.smithi086.stdout:Setting system user ceph properties....done 2024-09-17T05:34:04.474 INFO:teuthology.orchestra.run.smithi086.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T05:34:04.505 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-modules-core (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:04.614 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T05:34:04.681 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:04.920 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:34:04.920 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:34:04.984 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T05:34:05.574 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libcephfs-dev (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:05.650 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:05.709 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rados (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:05.834 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up librgw2 (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:05.859 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:34:05.859 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:34:05.977 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-top (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:06.129 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:34:06.434 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:06.560 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:07.068 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:34:07.068 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:34:07.499 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rbd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:07.617 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up rbd-fuse (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:07.662 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:07.718 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-rgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:07.819 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up python3-cephfs (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:07.936 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-shell (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:08.018 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T05:34:08.271 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-common (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:08.664 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:08.850 INFO:teuthology.orchestra.run.smithi044.stdout:Adding group ceph....done 2024-09-17T05:34:08.906 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:34:08.906 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi044.stdout:Adding system user ceph....done 2024-09-17T05:34:09.445 INFO:teuthology.orchestra.run.smithi044.stdout:Setting system user ceph properties....done 2024-09-17T05:34:09.465 INFO:teuthology.orchestra.run.smithi044.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T05:34:09.482 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:09.618 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T05:34:09.720 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:34:09.720 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:34:10.030 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T05:34:10.267 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:10.578 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:34:10.578 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:34:10.698 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up cephfs-mirror (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:10.929 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:34:10.930 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:34:11.168 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:11.286 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:11.412 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:11.582 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-test (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:11.603 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:34:11.603 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:34:11.708 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up radosgw (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:12.155 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:12.258 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:34:12.258 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:34:12.306 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:12.432 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:12.575 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:12.894 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-base (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:12.944 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:34:13.045 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:34:13.213 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:34:13.257 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T05:34:13.913 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mds (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:14.168 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:34:14.168 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:34:14.331 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:34:14.823 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:15.030 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:34:15.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-17T05:34:15.043 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:34:15.043 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:34:15.112 INFO:teuthology.orchestra.run.smithi086.stdout:Reading package lists... 2024-09-17T05:34:15.294 INFO:teuthology.orchestra.run.smithi086.stdout:Building dependency tree... 2024-09-17T05:34:15.295 INFO:teuthology.orchestra.run.smithi086.stdout:Reading state information... 2024-09-17T05:34:15.484 INFO:teuthology.orchestra.run.smithi086.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-17T05:34:15.484 INFO:teuthology.orchestra.run.smithi086.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T05:34:15.484 INFO:teuthology.orchestra.run.smithi086.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T05:34:15.485 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:34:15.485 INFO:teuthology.orchestra.run.smithi086.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:34:15.485 INFO:teuthology.orchestra.run.smithi086.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:34:15.485 INFO:teuthology.orchestra.run.smithi086.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:34:15.485 INFO:teuthology.orchestra.run.smithi086.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:34:15.486 INFO:teuthology.orchestra.run.smithi086.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:34:15.486 INFO:teuthology.orchestra.run.smithi086.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:34:15.487 INFO:teuthology.orchestra.run.smithi086.stdout:The following additional packages will be installed: 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout:Suggested packages: 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-17T05:34:15.488 INFO:teuthology.orchestra.run.smithi086.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-17T05:34:15.542 INFO:teuthology.orchestra.run.smithi086.stdout:The following NEW packages will be installed: 2024-09-17T05:34:15.542 INFO:teuthology.orchestra.run.smithi086.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-17T05:34:15.542 INFO:teuthology.orchestra.run.smithi086.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-17T05:34:15.543 INFO:teuthology.orchestra.run.smithi086.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-17T05:34:15.543 INFO:teuthology.orchestra.run.smithi086.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-17T05:34:15.543 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-17T05:34:15.543 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-17T05:34:15.543 INFO:teuthology.orchestra.run.smithi086.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:34:15.544 INFO:teuthology.orchestra.run.smithi086.stdout:The following packages will be upgraded: 2024-09-17T05:34:15.545 INFO:teuthology.orchestra.run.smithi086.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-17T05:34:15.691 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-osd (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:15.729 INFO:teuthology.orchestra.run.smithi086.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-17T05:34:15.729 INFO:teuthology.orchestra.run.smithi086.stdout:Need to get 55.8 MB of archives. 2024-09-17T05:34:15.729 INFO:teuthology.orchestra.run.smithi086.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-17T05:34:15.729 INFO:teuthology.orchestra.run.smithi086.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-17T05:34:15.986 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:34:15.986 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:34:16.350 INFO:teuthology.orchestra.run.smithi086.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T05:34:16.367 INFO:teuthology.orchestra.run.smithi086.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T05:34:16.492 INFO:teuthology.orchestra.run.smithi086.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T05:34:16.492 INFO:teuthology.orchestra.run.smithi086.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T05:34:16.493 INFO:teuthology.orchestra.run.smithi086.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T05:34:16.522 INFO:teuthology.orchestra.run.smithi086.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-17T05:34:16.523 INFO:teuthology.orchestra.run.smithi086.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-17T05:34:16.527 INFO:teuthology.orchestra.run.smithi086.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-17T05:34:16.529 INFO:teuthology.orchestra.run.smithi086.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T05:34:16.529 INFO:teuthology.orchestra.run.smithi086.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-17T05:34:16.531 INFO:teuthology.orchestra.run.smithi086.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T05:34:16.594 INFO:teuthology.orchestra.run.smithi086.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T05:34:16.594 INFO:teuthology.orchestra.run.smithi086.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T05:34:16.595 INFO:teuthology.orchestra.run.smithi086.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-17T05:34:16.634 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:16.675 INFO:teuthology.orchestra.run.smithi086.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-17T05:34:16.785 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:16.945 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mon (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:17.215 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:34:17.216 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:34:17.357 INFO:teuthology.orchestra.run.smithi086.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-17T05:34:17.359 INFO:teuthology.orchestra.run.smithi086.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-17T05:34:17.359 INFO:teuthology.orchestra.run.smithi086.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-17T05:34:17.362 INFO:teuthology.orchestra.run.smithi086.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-17T05:34:17.362 INFO:teuthology.orchestra.run.smithi086.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-17T05:34:17.366 INFO:teuthology.orchestra.run.smithi086.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-17T05:34:17.368 INFO:teuthology.orchestra.run.smithi086.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-17T05:34:17.418 INFO:teuthology.orchestra.run.smithi086.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-17T05:34:17.418 INFO:teuthology.orchestra.run.smithi086.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T05:34:17.453 INFO:teuthology.orchestra.run.smithi086.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-17T05:34:17.502 INFO:teuthology.orchestra.run.smithi086.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-17T05:34:17.512 INFO:teuthology.orchestra.run.smithi086.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-17T05:34:17.588 INFO:teuthology.orchestra.run.smithi086.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-17T05:34:17.591 INFO:teuthology.orchestra.run.smithi086.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-17T05:34:17.592 INFO:teuthology.orchestra.run.smithi086.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-17T05:34:17.593 INFO:teuthology.orchestra.run.smithi086.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-17T05:34:17.593 INFO:teuthology.orchestra.run.smithi086.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-17T05:34:17.611 INFO:teuthology.orchestra.run.smithi086.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-17T05:34:17.613 INFO:teuthology.orchestra.run.smithi086.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-17T05:34:17.863 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-cephadm (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:18.039 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:18.097 INFO:teuthology.orchestra.run.smithi086.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-17T05:34:18.097 INFO:teuthology.orchestra.run.smithi086.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-17T05:34:18.097 INFO:teuthology.orchestra.run.smithi086.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-17T05:34:18.098 INFO:teuthology.orchestra.run.smithi086.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-17T05:34:18.098 INFO:teuthology.orchestra.run.smithi086.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-17T05:34:18.098 INFO:teuthology.orchestra.run.smithi086.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-17T05:34:18.112 INFO:teuthology.orchestra.run.smithi086.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-17T05:34:18.158 INFO:teuthology.orchestra.run.smithi086.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-17T05:34:18.165 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-mgr-dashboard (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:18.316 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ceph-volume (19.3.0-4989-gce1b342b-1jammy) ... 2024-09-17T05:34:18.543 INFO:teuthology.orchestra.run.smithi086.stdout:Preconfiguring packages ... 2024-09-17T05:34:18.688 INFO:teuthology.orchestra.run.smithi086.stdout:Fetched 55.8 MB in 3s (21.4 MB/s) 2024-09-17T05:34:18.695 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:34:18.820 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:34:18.974 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143291 files and directories currently installed.) 2024-09-17T05:34:18.978 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:34:19.006 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:34:19.104 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:34:19.745 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-17T05:34:20.224 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:34:20.781 INFO:teuthology.orchestra.run.smithi086.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-17T05:34:21.010 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:34:21.014 DEBUG:teuthology.orchestra.run.smithi044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-17T05:34:21.034 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package flex. 2024-09-17T05:34:21.093 INFO:teuthology.orchestra.run.smithi044.stdout:Reading package lists... 2024-09-17T05:34:21.104 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143291 files and directories currently installed.) 2024-09-17T05:34:21.108 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T05:34:21.149 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T05:34:21.286 INFO:teuthology.orchestra.run.smithi044.stdout:Building dependency tree... 2024-09-17T05:34:21.287 INFO:teuthology.orchestra.run.smithi044.stdout:Reading state information... 2024-09-17T05:34:21.484 INFO:teuthology.orchestra.run.smithi044.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-17T05:34:21.484 INFO:teuthology.orchestra.run.smithi044.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T05:34:21.484 INFO:teuthology.orchestra.run.smithi044.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T05:34:21.484 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:34:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:34:21.484 INFO:teuthology.orchestra.run.smithi044.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:34:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:34:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:34:21.485 INFO:teuthology.orchestra.run.smithi044.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:34:21.485 INFO:teuthology.orchestra.run.smithi044.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:34:21.486 INFO:teuthology.orchestra.run.smithi044.stdout:The following additional packages will be installed: 2024-09-17T05:34:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-17T05:34:21.486 INFO:teuthology.orchestra.run.smithi044.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-17T05:34:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-17T05:34:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-17T05:34:21.487 INFO:teuthology.orchestra.run.smithi044.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:34:21.489 INFO:teuthology.orchestra.run.smithi044.stdout:Suggested packages: 2024-09-17T05:34:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-17T05:34:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-17T05:34:21.489 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-17T05:34:21.546 INFO:teuthology.orchestra.run.smithi044.stdout:The following NEW packages will be installed: 2024-09-17T05:34:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-17T05:34:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-17T05:34:21.547 INFO:teuthology.orchestra.run.smithi044.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-17T05:34:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-17T05:34:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-17T05:34:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-17T05:34:21.548 INFO:teuthology.orchestra.run.smithi044.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:34:21.549 INFO:teuthology.orchestra.run.smithi044.stdout:The following packages will be upgraded: 2024-09-17T05:34:21.550 INFO:teuthology.orchestra.run.smithi044.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-17T05:34:21.635 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:34:21.754 INFO:teuthology.orchestra.run.smithi044.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-17T05:34:21.755 INFO:teuthology.orchestra.run.smithi044.stdout:Need to get 55.8 MB of archives. 2024-09-17T05:34:21.755 INFO:teuthology.orchestra.run.smithi044.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-17T05:34:21.755 INFO:teuthology.orchestra.run.smithi044.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-17T05:34:21.822 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T05:34:22.194 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:34:22.378 INFO:teuthology.orchestra.run.smithi044.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T05:34:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T05:34:22.518 INFO:teuthology.orchestra.run.smithi044.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T05:34:22.518 INFO:teuthology.orchestra.run.smithi044.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T05:34:22.520 INFO:teuthology.orchestra.run.smithi044.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T05:34:22.548 INFO:teuthology.orchestra.run.smithi044.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-17T05:34:22.549 INFO:teuthology.orchestra.run.smithi044.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-17T05:34:22.552 INFO:teuthology.orchestra.run.smithi044.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-17T05:34:22.555 INFO:teuthology.orchestra.run.smithi044.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T05:34:22.555 INFO:teuthology.orchestra.run.smithi044.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-17T05:34:22.557 INFO:teuthology.orchestra.run.smithi044.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T05:34:22.621 INFO:teuthology.orchestra.run.smithi044.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T05:34:22.622 INFO:teuthology.orchestra.run.smithi044.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T05:34:22.622 INFO:teuthology.orchestra.run.smithi044.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-17T05:34:22.703 INFO:teuthology.orchestra.run.smithi044.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-17T05:34:22.741 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143364 files and directories currently installed.) 2024-09-17T05:34:22.745 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:34:22.871 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:34:23.300 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:34:23.384 INFO:teuthology.orchestra.run.smithi044.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-17T05:34:23.386 INFO:teuthology.orchestra.run.smithi044.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-17T05:34:23.386 INFO:teuthology.orchestra.run.smithi044.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-17T05:34:23.389 INFO:teuthology.orchestra.run.smithi044.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-17T05:34:23.389 INFO:teuthology.orchestra.run.smithi044.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-17T05:34:23.394 INFO:teuthology.orchestra.run.smithi044.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-17T05:34:23.395 INFO:teuthology.orchestra.run.smithi044.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-17T05:34:23.435 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:34:23.444 INFO:teuthology.orchestra.run.smithi044.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-17T05:34:23.444 INFO:teuthology.orchestra.run.smithi044.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T05:34:23.519 INFO:teuthology.orchestra.run.smithi044.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-17T05:34:23.526 INFO:teuthology.orchestra.run.smithi044.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-17T05:34:23.537 INFO:teuthology.orchestra.run.smithi044.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-17T05:34:23.613 INFO:teuthology.orchestra.run.smithi044.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-17T05:34:23.616 INFO:teuthology.orchestra.run.smithi044.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-17T05:34:23.617 INFO:teuthology.orchestra.run.smithi044.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-17T05:34:23.618 INFO:teuthology.orchestra.run.smithi044.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-17T05:34:23.618 INFO:teuthology.orchestra.run.smithi044.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-17T05:34:23.636 INFO:teuthology.orchestra.run.smithi044.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-17T05:34:23.637 INFO:teuthology.orchestra.run.smithi044.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-17T05:34:23.740 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:34:24.118 INFO:teuthology.orchestra.run.smithi044.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-17T05:34:24.118 INFO:teuthology.orchestra.run.smithi044.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-17T05:34:24.118 INFO:teuthology.orchestra.run.smithi044.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-17T05:34:24.118 INFO:teuthology.orchestra.run.smithi044.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-17T05:34:24.119 INFO:teuthology.orchestra.run.smithi044.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-17T05:34:24.119 INFO:teuthology.orchestra.run.smithi044.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-17T05:34:24.153 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package bison. 2024-09-17T05:34:24.181 INFO:teuthology.orchestra.run.smithi044.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-17T05:34:24.181 INFO:teuthology.orchestra.run.smithi044.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-17T05:34:24.220 INFO:teuthology.orchestra.run.smithi086.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143364 files and directories currently installed.) 2024-09-17T05:34:24.224 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T05:34:24.271 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:34:24.586 INFO:teuthology.orchestra.run.smithi044.stdout:Preconfiguring packages ... 2024-09-17T05:34:24.622 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-17T05:34:24.637 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-17T05:34:24.681 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:34:24.776 INFO:teuthology.orchestra.run.smithi044.stdout:Fetched 55.8 MB in 3s (21.3 MB/s) 2024-09-17T05:34:25.008 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143291 files and directories currently installed.) 2024-09-17T05:34:25.012 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:34:25.017 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package dump. 2024-09-17T05:34:25.031 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-17T05:34:25.075 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking dump (0.4b47-3) ... 2024-09-17T05:34:25.142 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:34:25.379 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package indent. 2024-09-17T05:34:25.393 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:25.437 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:34:25.682 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T05:34:25.696 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T05:34:25.731 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:34:25.768 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-17T05:34:26.060 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-17T05:34:26.075 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-17T05:34:26.119 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:34:26.380 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T05:34:26.394 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T05:34:26.438 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:34:26.742 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T05:34:26.756 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T05:34:26.792 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:26.877 INFO:teuthology.orchestra.run.smithi044.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-17T05:34:27.020 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T05:34:27.034 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T05:34:27.078 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:27.147 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package flex. 2024-09-17T05:34:27.220 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143291 files and directories currently installed.) 2024-09-17T05:34:27.224 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T05:34:27.271 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T05:34:27.330 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libjson-perl. 2024-09-17T05:34:27.345 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-17T05:34:27.388 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-17T05:34:27.708 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-17T05:34:27.723 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-17T05:34:27.758 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:34:27.833 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:34:28.010 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T05:34:28.410 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:34:29.018 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143364 files and directories currently installed.) 2024-09-17T05:34:29.022 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:34:29.063 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-17T05:34:29.079 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:34:29.119 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:29.143 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:34:29.380 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-17T05:34:29.396 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:34:29.438 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:29.573 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:34:29.708 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:34:29.741 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-17T05:34:29.757 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:34:29.800 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:34:30.094 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-17T05:34:30.101 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:34:30.110 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-17T05:34:30.144 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:34:30.489 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-17T05:34:30.505 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:34:30.547 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:34:30.550 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package bison. 2024-09-17T05:34:30.631 INFO:teuthology.orchestra.run.smithi044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143364 files and directories currently installed.) 2024-09-17T05:34:30.635 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T05:34:30.678 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:34:31.017 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-17T05:34:31.032 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:31.075 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:31.095 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-17T05:34:31.110 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-17T05:34:31.153 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:34:31.453 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-17T05:34:31.468 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:31.511 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:34:31.548 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package dump. 2024-09-17T05:34:31.564 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-17T05:34:31.606 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking dump (0.4b47-3) ... 2024-09-17T05:34:31.806 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-17T05:34:31.820 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:31.855 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:34:31.894 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package indent. 2024-09-17T05:34:31.910 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:31.952 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:34:32.050 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T05:34:32.064 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:34:32.108 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:34:32.204 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T05:34:32.221 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T05:34:32.254 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:34:32.570 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-17T05:34:32.583 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-17T05:34:32.592 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-17T05:34:32.608 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-17T05:34:32.628 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:34:32.650 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:34:32.911 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T05:34:32.928 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T05:34:32.969 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:34:32.998 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package modemmanager. 2024-09-17T05:34:33.015 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:34:33.056 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:34:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T05:34:33.298 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T05:34:33.331 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:33.592 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T05:34:33.609 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T05:34:33.650 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:33.946 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libjson-perl. 2024-09-17T05:34:33.962 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-17T05:34:34.004 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-17T05:34:34.038 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package network-manager. 2024-09-17T05:34:34.054 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:34:34.104 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:34:34.299 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-17T05:34:34.315 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-17T05:34:34.365 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:34:34.729 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package ppp. 2024-09-17T05:34:34.744 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-17T05:34:35.081 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:34:35.392 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package pptp-linux. 2024-09-17T05:34:35.406 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-17T05:34:35.450 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-17T05:34:35.703 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-17T05:34:35.717 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-17T05:34:35.752 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-17T05:34:35.761 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-17T05:34:35.769 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:34:35.810 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-17T05:34:36.078 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-17T05:34:36.080 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-17T05:34:36.096 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:34:36.122 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client-common (238) ... 2024-09-17T05:34:36.137 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:36.409 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-17T05:34:36.424 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:36.468 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:36.474 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-17T05:34:36.491 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:34:36.532 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:34:36.819 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-17T05:34:36.836 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-17T05:34:36.877 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:34:37.039 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-common. 2024-09-17T05:34:37.054 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-17T05:34:37.114 INFO:teuthology.orchestra.run.smithi086.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-17T05:34:37.146 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-common (238) ... 2024-09-17T05:34:37.213 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-17T05:34:37.235 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:34:37.280 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:34:37.605 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-14. 2024-09-17T05:34:37.619 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:37.632 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-17T05:34:37.649 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:37.665 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:37.699 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:37.994 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-17T05:34:38.010 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:38.043 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:34:38.346 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-17T05:34:38.363 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:38.404 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:34:38.649 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T05:34:38.665 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:34:38.707 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:34:38.866 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql. 2024-09-17T05:34:38.881 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-17T05:34:38.924 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql (14+238) ... 2024-09-17T05:34:39.145 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-client. 2024-09-17T05:34:39.159 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-17T05:34:39.195 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-client (14+238) ... 2024-09-17T05:34:39.439 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-17T05:34:39.454 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-17T05:34:39.497 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-17T05:34:39.816 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package tcl8.6. 2024-09-17T05:34:39.829 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-17T05:34:39.831 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-17T05:34:39.846 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-17T05:34:39.886 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:34:39.891 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:34:40.181 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package modemmanager. 2024-09-17T05:34:40.185 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package tcl. 2024-09-17T05:34:40.198 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:34:40.200 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-17T05:34:40.231 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:34:40.247 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-17T05:34:40.538 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package wpasupplicant. 2024-09-17T05:34:40.553 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-17T05:34:40.596 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:34:40.938 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package network-manager. 2024-09-17T05:34:40.941 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-17T05:34:40.955 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:34:40.956 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-17T05:34:41.000 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-17T05:34:41.005 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:34:41.403 INFO:teuthology.orchestra.run.smithi086.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-17T05:34:41.418 INFO:teuthology.orchestra.run.smithi086.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-17T05:34:41.469 INFO:teuthology.orchestra.run.smithi086.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:34:41.604 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package ppp. 2024-09-17T05:34:41.620 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-17T05:34:41.741 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client-common (238) ... 2024-09-17T05:34:41.950 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T05:34:41.969 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:34:42.076 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:34:42.211 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:42.308 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package pptp-linux. 2024-09-17T05:34:42.320 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:34:42.324 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-17T05:34:42.400 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-17T05:34:42.455 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:34:42.581 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:42.653 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-17T05:34:42.668 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-17T05:34:42.711 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-17T05:34:42.972 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-17T05:34:42.988 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-17T05:34:43.022 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client-common (238) ... 2024-09-17T05:34:43.326 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-17T05:34:43.342 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:43.384 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:43.530 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-17T05:34:43.653 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:34:43.922 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-common. 2024-09-17T05:34:43.939 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-17T05:34:44.000 INFO:teuthology.orchestra.run.smithi044.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-17T05:34:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:34:44.003 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:34:44.029 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-common (238) ... 2024-09-17T05:34:44.471 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-14. 2024-09-17T05:34:44.488 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:34:44.532 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:44.630 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:34:44.756 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:34:44.899 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:34:45.000 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-17T05:34:45.117 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:34:45.243 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:45.378 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:34:45.504 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:34:45.682 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql. 2024-09-17T05:34:45.698 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-17T05:34:45.732 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql (14+238) ... 2024-09-17T05:34:45.959 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-client. 2024-09-17T05:34:45.975 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-17T05:34:46.017 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-client (14+238) ... 2024-09-17T05:34:46.217 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:34:46.286 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-17T05:34:46.302 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-17T05:34:46.343 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up dump (0.4b47-3) ... 2024-09-17T05:34:46.344 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-17T05:34:46.438 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-17T05:34:46.512 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:34:46.638 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:34:46.664 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package tcl8.6. 2024-09-17T05:34:46.681 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-17T05:34:46.722 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:34:46.764 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-17T05:34:46.890 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-17T05:34:46.950 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package tcl. 2024-09-17T05:34:46.967 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-17T05:34:47.004 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-17T05:34:47.015 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:34:47.105 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T05:34:47.167 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:34:47.309 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:34:47.379 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package wpasupplicant. 2024-09-17T05:34:47.395 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-17T05:34:47.436 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:34:47.509 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:34:47.604 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:47.713 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-17T05:34:47.783 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-17T05:34:47.799 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-17T05:34:47.840 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-17T05:34:47.881 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-client (14+238) ... 2024-09-17T05:34:48.007 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:34:48.252 INFO:teuthology.orchestra.run.smithi044.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-17T05:34:48.269 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-17T05:34:48.318 INFO:teuthology.orchestra.run.smithi044.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:34:48.573 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:34:48.573 INFO:teuthology.orchestra.run.smithi086.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-17T05:34:48.573 INFO:teuthology.orchestra.run.smithi086.stdout:which means they are currently configured by ifupdown: 2024-09-17T05:34:48.573 INFO:teuthology.orchestra.run.smithi086.stdout:- enp3s0f1 2024-09-17T05:34:48.573 INFO:teuthology.orchestra.run.smithi086.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-17T05:34:48.573 INFO:teuthology.orchestra.run.smithi086.stdout:remove their configuration from /etc/network/interfaces. 2024-09-17T05:34:48.573 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:34:48.614 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client-common (238) ... 2024-09-17T05:34:48.704 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-17T05:34:48.824 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T05:34:48.950 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:34:49.101 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:49.107 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-17T05:34:49.227 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:34:49.345 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:34:49.446 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:49.513 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-17T05:34:50.184 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:50.327 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:50.407 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-17T05:34:50.470 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-17T05:34:50.510 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:34:50.571 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-common (238) ... 2024-09-17T05:34:50.898 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:34:50.898 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:34:51.509 INFO:teuthology.orchestra.run.smithi086.stdout:Adding user postgres to group ssl-cert 2024-09-17T05:34:51.621 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:34:51.730 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:34:51.763 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:34:51.763 INFO:teuthology.orchestra.run.smithi086.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-17T05:34:51.873 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:34:52.001 INFO:teuthology.orchestra.run.smithi086.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-17T05:34:52.001 INFO:teuthology.orchestra.run.smithi086.stdout:Removing obsolete dictionary files: 2024-09-17T05:34:52.032 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-17T05:34:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:34:52.293 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:52.419 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:34:52.603 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:34:52.678 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-17T05:34:53.131 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:34:53.233 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:34:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up dump (0.4b47-3) ... 2024-09-17T05:34:53.463 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-17T05:34:53.519 INFO:teuthology.orchestra.run.smithi086.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-17T05:34:53.536 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:34:53.542 INFO:teuthology.orchestra.run.smithi086.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-17T05:34:53.583 INFO:teuthology.orchestra.run.smithi086.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-17T05:34:53.583 INFO:teuthology.orchestra.run.smithi086.stdout:This user must also own the server process. 2024-09-17T05:34:53.583 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:34:53.584 INFO:teuthology.orchestra.run.smithi086.stdout:The database cluster will be initialized with locale "en_US". 2024-09-17T05:34:53.584 INFO:teuthology.orchestra.run.smithi086.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-17T05:34:53.584 INFO:teuthology.orchestra.run.smithi086.stdout:The default text search configuration will be set to "english". 2024-09-17T05:34:53.584 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:34:53.584 INFO:teuthology.orchestra.run.smithi086.stdout:Data page checksums are disabled. 2024-09-17T05:34:53.584 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:34:53.584 INFO:teuthology.orchestra.run.smithi086.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-17T05:34:53.585 INFO:teuthology.orchestra.run.smithi086.stdout:creating subdirectories ... ok 2024-09-17T05:34:53.585 INFO:teuthology.orchestra.run.smithi086.stdout:selecting dynamic shared memory implementation ... posix 2024-09-17T05:34:53.608 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default max_connections ... 100 2024-09-17T05:34:53.642 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default shared_buffers ... 128MB 2024-09-17T05:34:53.656 INFO:teuthology.orchestra.run.smithi086.stdout:selecting default time zone ... Etc/UTC 2024-09-17T05:34:53.657 INFO:teuthology.orchestra.run.smithi086.stdout:creating configuration files ... ok 2024-09-17T05:34:53.662 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:34:53.780 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-17T05:34:53.822 INFO:teuthology.orchestra.run.smithi086.stdout:running bootstrap script ... ok 2024-09-17T05:34:53.922 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-17T05:34:54.023 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:34:54.113 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T05:34:54.183 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:34:54.317 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:34:54.494 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:34:54.501 INFO:teuthology.orchestra.run.smithi086.stdout:performing post-bootstrap initialization ... ok 2024-09-17T05:34:54.620 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:54.748 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-17T05:34:54.930 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-client (14+238) ... 2024-09-17T05:34:55.031 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:34:55.546 INFO:teuthology.orchestra.run.smithi086.stdout:syncing data to disk ... ok 2024-09-17T05:34:55.649 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:34:55.649 INFO:teuthology.orchestra.run.smithi044.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-17T05:34:55.649 INFO:teuthology.orchestra.run.smithi044.stdout:which means they are currently configured by ifupdown: 2024-09-17T05:34:55.649 INFO:teuthology.orchestra.run.smithi044.stdout:- ens1f0 2024-09-17T05:34:55.649 INFO:teuthology.orchestra.run.smithi044.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-17T05:34:55.649 INFO:teuthology.orchestra.run.smithi044.stdout:remove their configuration from /etc/network/interfaces. 2024-09-17T05:34:55.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:34:55.789 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-17T05:34:56.031 INFO:teuthology.orchestra.run.smithi086.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-17T05:34:56.205 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-17T05:34:56.611 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-17T05:34:57.326 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:34:57.478 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:34:57.603 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-17T05:34:57.748 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-common (238) ... 2024-09-17T05:34:58.633 INFO:teuthology.orchestra.run.smithi044.stdout:Adding user postgres to group ssl-cert 2024-09-17T05:34:58.901 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:34:58.901 INFO:teuthology.orchestra.run.smithi044.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-17T05:34:59.067 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:34:59.163 INFO:teuthology.orchestra.run.smithi044.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-17T05:34:59.163 INFO:teuthology.orchestra.run.smithi044.stdout:Removing obsolete dictionary files: 2024-09-17T05:34:59.193 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-17T05:34:59.319 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up postgresql (14+238) ... 2024-09-17T05:34:59.445 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:34:59.571 INFO:teuthology.orchestra.run.smithi086.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:34:59.856 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:34:59.856 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:34:59.908 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-17T05:35:00.364 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:35:00.548 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:35:00.624 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-17T05:35:00.697 INFO:teuthology.orchestra.run.smithi044.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-17T05:35:00.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:This user must also own the server process. 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:The database cluster will be initialized with locale "en_US". 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:The default text search configuration will be set to "english". 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:Data page checksums are disabled. 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-17T05:35:00.764 INFO:teuthology.orchestra.run.smithi044.stdout:creating subdirectories ... ok 2024-09-17T05:35:00.764 INFO:teuthology.orchestra.run.smithi044.stdout:selecting dynamic shared memory implementation ... posix 2024-09-17T05:35:00.788 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default max_connections ... 100 2024-09-17T05:35:00.824 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default shared_buffers ... 128MB 2024-09-17T05:35:00.839 INFO:teuthology.orchestra.run.smithi044.stdout:selecting default time zone ... Etc/UTC 2024-09-17T05:35:00.839 INFO:teuthology.orchestra.run.smithi044.stdout:creating configuration files ... ok 2024-09-17T05:35:00.959 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:35:01.009 INFO:teuthology.orchestra.run.smithi044.stdout:running bootstrap script ... ok 2024-09-17T05:35:01.119 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:35:01.642 INFO:teuthology.orchestra.run.smithi044.stdout:performing post-bootstrap initialization ... ok 2024-09-17T05:35:02.248 INFO:teuthology.orchestra.run.smithi044.stdout:syncing data to disk ... ok 2024-09-17T05:35:02.337 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-17T05:35:02.454 INFO:teuthology.orchestra.run.smithi086.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:35:02.766 INFO:teuthology.orchestra.run.smithi044.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-17T05:35:03.018 INFO:teuthology.orchestra.run.smithi086.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:35:03.025 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:05.830 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:35:05.931 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-17T05:35:06.049 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up postgresql (14+238) ... 2024-09-17T05:35:06.175 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:35:06.303 INFO:teuthology.orchestra.run.smithi044.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:35:06.614 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:35:06.614 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:35:07.389 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:35:07.481 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-17T05:35:07.809 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:35:07.985 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:35:09.471 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-17T05:35:09.571 INFO:teuthology.orchestra.run.smithi044.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:35:10.142 INFO:teuthology.orchestra.run.smithi044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:35:10.149 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:10.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:35:10.289 DEBUG:teuthology.orchestra.run.smithi044:> dpkg-query -W -f '${Version}' ceph 2024-09-17T05:35:10.313 INFO:teuthology.orchestra.run.smithi044.stdout:19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:35:10.313 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:35:10.313 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989-gce1b342b-1jammy is installed. 2024-09-17T05:35:10.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T05:35:10.458 DEBUG:teuthology.orchestra.run.smithi086:> dpkg-query -W -f '${Version}' ceph 2024-09-17T05:35:10.482 INFO:teuthology.orchestra.run.smithi086.stdout:19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:35:10.483 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989-gce1b342b-1jammy 2024-09-17T05:35:10.483 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989-gce1b342b-1jammy is installed. 2024-09-17T05:35:10.485 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T05:35:10.485 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:10.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:35:10.505 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:10.505 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:35:10.545 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T05:35:10.545 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:10.545 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:35:10.564 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:35:10.625 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:10.625 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:35:10.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:35:10.708 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T05:35:10.709 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:10.709 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:35:10.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:35:10.793 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:10.793 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:35:10.812 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:35:10.872 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T05:35:10.872 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:10.872 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:35:10.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:35:10.953 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:10.953 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:35:10.973 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:35:11.036 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T05:35:11.119 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T05:35:11.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-09-17T05:35:11.122 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-09-17T05:35:11.141 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T05:35:11.141 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:35:11.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:35:11.204 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T05:35:11.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:35:11.244 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:35:11.270 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T05:35:11.270 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T05:35:11.270 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T05:35:11.271 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:11.271 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:35:11.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:11.413 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:11.414 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:35:11.422 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:11.518 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T05:35:11.518 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T05:35:11.518 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908621', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPCnYQtJRKHUvY6bn9A0pfgkb9cpmhU/wpRCum4EV8eH9U4ZH06cnaAZZL3s+9qfCbs1tyzxg7Ui0ma290zWb7M=', 'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOJ6erp4TdrNzj+AbbQe8ShGTM9uMKoySuZjq+AwXi4DQ7/OrHJXDahNdxC6gxNCe+sc2Lbej+jsaoxdQM6vgco='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected', 'object missing on disk', 'Invalid tag char'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T05:35:11.519 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:35:11.522 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:35:11.530 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:35:11.573 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:35:11.596 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:11.596 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:35:11.646 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:35:11.646 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-09-17T05:35:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:35:11.698 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:11.699 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-09-17T05:35:11.699 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:11.699 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-17 05:28:28.728318465 +0000 2024-09-17T05:35:11.699 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-17 05:28:28.464320825 +0000 2024-09-17T05:35:11.699 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-17 05:28:28.464320825 +0000 2024-09-17T05:35:11.699 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-17 05:28:28.464320825 +0000 2024-09-17T05:35:11.699 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:35:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-17T05:35:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-17T05:35:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000377859 s, 1.4 MB/s 2024-09-17T05:35:11.762 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:35:11.816 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-17 05:28:29.320313174 +0000 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-17 05:28:29.048315605 +0000 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-17 05:28:29.048315605 +0000 2024-09-17T05:35:11.871 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-17 05:28:29.048315605 +0000 2024-09-17T05:35:11.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:35:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-17T05:35:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-17T05:35:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000405637 s, 1.3 MB/s 2024-09-17T05:35:11.938 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:35:11.996 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-09-17T05:35:12.050 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:35:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:12.051 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 933 Links: 1 2024-09-17T05:35:12.051 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:12.051 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-17 05:28:29.908307918 +0000 2024-09-17T05:35:12.051 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-17 05:28:29.648310242 +0000 2024-09-17T05:35:12.051 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-17 05:28:29.648310242 +0000 2024-09-17T05:35:12.051 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-17 05:28:29.648310242 +0000 2024-09-17T05:35:12.051 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:35:12.113 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-17T05:35:12.113 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-17T05:35:12.113 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000371585 s, 1.4 MB/s 2024-09-17T05:35:12.115 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:35:12.169 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-09-17T05:35:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:35:12.218 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:12.218 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 947 Links: 1 2024-09-17T05:35:12.219 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:12.219 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-09-17 05:28:30.492302699 +0000 2024-09-17T05:35:12.219 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-09-17 05:28:30.208305237 +0000 2024-09-17T05:35:12.219 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-09-17 05:28:30.208305237 +0000 2024-09-17T05:35:12.219 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-09-17 05:28:30.208305237 +0000 2024-09-17T05:35:12.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:35:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-09-17T05:35:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-09-17T05:35:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000385396 s, 1.3 MB/s 2024-09-17T05:35:12.283 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:35:12.336 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:12.336 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:12.336 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:35:12.346 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:35:12.346 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-17T05:35:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:35:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:12.397 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 895 Links: 1 2024-09-17T05:35:12.397 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:12.397 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-17 05:28:24.966617335 +0000 2024-09-17T05:35:12.397 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-17 05:28:24.714619586 +0000 2024-09-17T05:35:12.398 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-17 05:28:24.714619586 +0000 2024-09-17T05:35:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-17 05:28:24.714619586 +0000 2024-09-17T05:35:12.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:35:12.459 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-17T05:35:12.459 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-17T05:35:12.459 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000416107 s, 1.2 MB/s 2024-09-17T05:35:12.461 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:35:12.515 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-17T05:35:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:35:12.565 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:12.566 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 912 Links: 1 2024-09-17T05:35:12.566 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:12.566 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-17 05:28:25.546612154 +0000 2024-09-17T05:35:12.566 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-17 05:28:25.270614619 +0000 2024-09-17T05:35:12.566 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-17 05:28:25.270614619 +0000 2024-09-17T05:35:12.566 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-17 05:28:25.270614619 +0000 2024-09-17T05:35:12.566 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:35:12.628 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-17T05:35:12.628 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-17T05:35:12.628 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000375778 s, 1.4 MB/s 2024-09-17T05:35:12.630 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:35:12.683 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-17T05:35:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:35:12.733 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:12.733 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 929 Links: 1 2024-09-17T05:35:12.733 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:12.733 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-17 05:28:26.050607651 +0000 2024-09-17T05:35:12.733 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-17 05:28:25.790609975 +0000 2024-09-17T05:35:12.733 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-17 05:28:25.790609975 +0000 2024-09-17T05:35:12.734 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-17 05:28:25.790609975 +0000 2024-09-17T05:35:12.734 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:35:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-17T05:35:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-17T05:35:12.795 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00063535 s, 806 kB/s 2024-09-17T05:35:12.797 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:35:12.851 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 6h/6d Inode: 946 Links: 1 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-17 05:28:26.334605115 +0000 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-17 05:28:26.330605151 +0000 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-17 05:28:26.330605151 +0000 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-17 05:28:26.330605151 +0000 2024-09-17T05:35:12.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:35:12.962 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-17T05:35:12.962 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-17T05:35:12.963 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000382883 s, 1.3 MB/s 2024-09-17T05:35:12.964 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:35:13.015 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:13.015 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:35:13.015 INFO:tasks.ceph:Generating config... 2024-09-17T05:35:13.016 INFO:tasks.ceph:[client] pid file = 2024-09-17T05:35:13.016 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T05:35:13.016 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T05:35:13.017 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T05:35:13.017 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T05:35:13.017 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T05:35:13.017 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T05:35:13.017 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T05:35:13.017 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T05:35:13.018 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T05:35:13.018 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T05:35:13.018 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T05:35:13.018 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T05:35:13.018 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T05:35:13.018 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T05:35:13.019 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T05:35:13.019 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T05:35:13.019 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T05:35:13.019 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T05:35:13.019 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T05:35:13.020 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T05:35:13.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T05:35:13.080 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T05:35:13.174 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T05:35:13.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:35:13.261 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.b', '172.21.15.86'), ('mon.c', '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]')] 2024-09-17T05:35:13.262 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T05:35:13.263 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:13.263 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:35:13.367 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --add b 172.21.15.86 --addv c '[v2:172.21.15.86:3301,v1:172.21.15.86:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:13.472 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-09-17T05:35:13.472616+0000 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-09-17T05:35:13.472616+0000 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] mon.c 2024-09-17T05:35:13.473 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T05:35:13.476 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:35:13.485 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 416ea1ed-afce-4e18-8956-62d00ca75710... 2024-09-17T05:35:13.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:35:13.532 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:35:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-17T05:35:13.573 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.575 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:35:13.576 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-17T05:35:13.577 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-17T05:35:13.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2024-09-17T05:35:13.579 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-17T05:35:13.580 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-17T05:35:13.581 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:35:13.582 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:13.583 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-09-17T05:35:13.584 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-17T05:35:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-17T05:35:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-17T05:35:13.585 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-17T05:35:13.586 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-17T05:35:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-17T05:35:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:35:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-17T05:35:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-17T05:35:13.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:35:13.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:35:13.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-17T05:35:13.589 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-17T05:35:13.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.591 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-09-17T05:35:13.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:35:13.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:35:13.594 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.595 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: mon down mkfs grace = 300 2024-09-17T05:35:13.596 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = "" 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-17T05:35:13.597 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-17T05:35:13.598 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-17T05:35:13.599 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T05:35:13.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T05:35:13.710 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T05:35:13.710 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:13.710 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T05:35:13.719 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:13.719 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T05:35:13.773 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:35:13.774 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:13.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:35:13.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:35:13.854 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:13.854 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:13.910 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:35:13.910 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:13.910 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:35:13.911 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:35:13.948 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:13.948 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:14.002 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T05:35:14.003 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T05:35:14.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:35:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:35:14.076 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:35:14.147 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:35:14.166 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T05:35:14.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:35:14.233 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:35:14.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T05:35:14.258 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:35:14.366 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:35:14.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T05:35:14.390 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:35:14.461 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:35:14.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T05:35:14.486 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:35:14.593 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:35:14.599 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T05:35:14.618 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T05:35:14.618 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T05:35:14.672 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T05:35:14.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T05:35:14.742 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T05:35:14.759 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T05:35:14.810 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T05:35:14.827 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T05:35:14.878 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T05:35:14.895 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T05:35:14.895 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:35:14.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T05:35:14.914 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:14.915 INFO:tasks.ceph:role: osd.0 2024-09-17T05:35:14.915 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:35:14.915 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:35:14.984 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:14.984 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:14.985 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:14.985 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:15.368 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-17T05:35:15.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-17T05:35:15.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T05:35:15.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T05:35:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:15.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:15.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T05:35:15.541 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:15.541 INFO:tasks.ceph:role: osd.1 2024-09-17T05:35:15.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:35:15.542 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:15.610 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:16.005 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-17T05:35:16.008 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-17T05:35:16.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T05:35:16.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T05:35:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:16.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:16.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T05:35:16.186 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:16.186 INFO:tasks.ceph:role: osd.2 2024-09-17T05:35:16.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:35:16.187 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:35:16.261 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:16.261 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:16.262 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:16.262 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:16.668 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-17T05:35:16.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-17T05:35:16.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T05:35:16.813 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T05:35:16.831 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:16.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:16.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T05:35:16.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:16.895 INFO:tasks.ceph:role: osd.3 2024-09-17T05:35:16.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:35:16.895 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:35:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:16.971 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:17.329 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-09-17T05:35:17.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-09-17T05:35:17.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T05:35:17.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T05:35:17.467 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:17.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:17.468 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:17.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:17.619+0000 7f0f737557c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T05:35:17.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:17.623+0000 7f0f737557c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T05:35:17.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:17.623+0000 7f0f737557c0 -1 bdev(0x557c9ece2a00 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:17.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:17.623+0000 7f0f737557c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T05:35:20.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T05:35:20.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:20.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:20.987+0000 7f25ecbfd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T05:35:20.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:20.987+0000 7f25ecbfd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T05:35:20.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:20.987+0000 7f25ecbfd7c0 -1 bdev(0x55cecff2ca00 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:20.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:20.987+0000 7f25ecbfd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T05:35:24.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T05:35:24.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:24.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:24.603+0000 7f5791cff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T05:35:24.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:24.603+0000 7f5791cff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T05:35:24.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:24.603+0000 7f5791cff7c0 -1 bdev(0x558e8117aa00 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:24.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:24.603+0000 7f5791cff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T05:35:27.814 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T05:35:27.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:27.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:27.939+0000 7f862636c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T05:35:27.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:27.939+0000 7f862636c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T05:35:27.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:27.939+0000 7f862636c7c0 -1 bdev(0x562ccb326a00 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:27.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:27.939+0000 7f862636c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T05:35:31.211 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T05:35:31.232 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T05:35:31.255 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:31.255 INFO:tasks.ceph:role: osd.4 2024-09-17T05:35:31.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:35:31.255 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:35:31.325 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:31.325 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:31.325 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:31.325 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:31.326 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:31.326 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:31.326 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:31.326 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:31.326 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:31.326 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:31.725 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-17T05:35:31.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-17T05:35:31.728 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T05:35:31.838 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T05:35:31.854 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:31.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:31.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T05:35:31.916 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:31.916 INFO:tasks.ceph:role: osd.5 2024-09-17T05:35:31.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:35:31.916 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:31.984 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:31.985 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:31.985 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:32.388 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-17T05:35:32.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-17T05:35:32.391 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T05:35:32.518 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T05:35:32.534 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:32.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:32.535 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T05:35:32.596 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:32.596 INFO:tasks.ceph:role: osd.6 2024-09-17T05:35:32.596 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:35:32.596 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:32.664 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:32.665 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:33.078 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-17T05:35:33.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-17T05:35:33.082 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T05:35:33.202 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T05:35:33.218 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:33.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:33.219 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T05:35:33.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:35:33.284 INFO:tasks.ceph:role: osd.7 2024-09-17T05:35:33.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:35:33.285 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:35:33.360 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:35:33.361 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:35:33.361 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:35:33.726 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-17T05:35:33.729 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-17T05:35:33.729 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T05:35:33.803 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T05:35:33.864 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:35:33.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:35:33.868 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:34.003 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:34.004+0000 7f160f5677c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T05:35:34.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:34.004+0000 7f160f5677c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T05:35:34.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:34.004+0000 7f160f5677c0 -1 bdev(0x563dcc10ea00 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:34.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:34.008+0000 7f160f5677c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T05:35:37.285 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T05:35:37.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:37.414 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:37.416+0000 7f760b2727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T05:35:37.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:37.416+0000 7f760b2727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T05:35:37.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:37.416+0000 7f760b2727c0 -1 bdev(0x55bcd1aa0a00 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:37.415 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:37.416+0000 7f760b2727c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T05:35:40.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T05:35:40.921 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:41.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:41.032+0000 7f39740577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T05:35:41.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:41.032+0000 7f39740577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T05:35:41.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:41.032+0000 7f39740577c0 -1 bdev(0x55952a68ca00 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:41.030 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:41.032+0000 7f39740577c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T05:35:41.520 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:41.524 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:44.309 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T05:35:44.330 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:44.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:44.439+0000 7f67bf16e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T05:35:44.439 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:44.439+0000 7f67bf16e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T05:35:44.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:44.439+0000 7f67bf16e7c0 -1 bdev(0x556876f04a00 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T05:35:44.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:44.439+0000 7f67bf16e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T05:35:47.677 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T05:35:47.699 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T05:35:47.699 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:47.699 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T05:35:47.722 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:47.723 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T05:35:47.791 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:47.792 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T05:35:47.859 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:47.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T05:35:47.923 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:47.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T05:35:47.990 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:47.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T05:35:48.059 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:48.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T05:35:48.129 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T05:35:48.152 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.152 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T05:35:48.214 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T05:35:48.277 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.277 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T05:35:48.341 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T05:35:48.401 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.401 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T05:35:48.461 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.461 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T05:35:48.525 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:48.525 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T05:35:48.535 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:48.535 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T05:35:48.585 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.586 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T05:35:48.594 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:48.594 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T05:35:48.645 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T05:35:48.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:35:48.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:35:48.693 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-09-17T05:35:48.693 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw== 2024-09-17T05:35:48.693 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-17T05:35:48.693 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw== 2024-09-17T05:35:48.693 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-17T05:35:48.693 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ== 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw== 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA== 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg== 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q== 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA== 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow== 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-17T05:35:48.694 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA== 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg== 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew== 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA== 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw== 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:[client.2] 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw== 2024-09-17T05:35:48.695 INFO:teuthology.orchestra.run.smithi044.stdout:[client.1] 2024-09-17T05:35:48.696 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ== 2024-09-17T05:35:48.696 INFO:teuthology.orchestra.run.smithi044.stdout:[client.3] 2024-09-17T05:35:48.696 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A== 2024-09-17T05:35:48.707 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw== 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw== 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ== 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw== 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA== 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg== 2024-09-17T05:35:48.708 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q== 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA== 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow== 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA== 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg== 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew== 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA== 2024-09-17T05:35:48.709 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw== 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout:[client.2] 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw== 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ== 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout:[client.3] 2024-09-17T05:35:48.710 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A== 2024-09-17T05:35:48.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:35:48.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:35:48.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:48.828 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:48.897 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:48.901 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:48.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:48.971 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.035 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.038 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.102 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.106 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.173 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:35:49.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:35:49.306 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:49.309 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:49.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:49.380 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:35:49.446 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.450 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.518 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.585 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.649 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.652 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:35:49.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.788 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.855 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.928 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:35:49.995 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T05:35:49.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T05:35:50.015 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:35:50.139 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T05:35:50.159 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T05:35:50.178 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:35:50.318 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T05:35:50.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T05:35:50.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:35:50.521 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T05:35:50.541 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:50.544 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:35:50.589 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T05:35:50.589 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T05:35:50.590 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T05:35:50.596 INFO:tasks.ceph.mon.a:Started 2024-09-17T05:35:50.596 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T05:35:50.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T05:35:50.632 INFO:tasks.ceph.mon.b:Started 2024-09-17T05:35:50.633 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T05:35:50.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T05:35:50.635 INFO:tasks.ceph.mon.c:Started 2024-09-17T05:35:50.636 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T05:35:50.636 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T05:35:50.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T05:35:50.639 INFO:tasks.ceph.mgr.y:Started 2024-09-17T05:35:50.639 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T05:35:50.639 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T05:35:50.642 INFO:tasks.ceph.mgr.x:Started 2024-09-17T05:35:50.642 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T05:35:50.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T05:35:50.650 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T05:35:50.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T05:35:50.699 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T05:35:50.699 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T05:35:50.743 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T05:35:50.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T05:35:50.789 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T05:35:50.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T05:35:50.837 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T05:35:50.837 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T05:35:50.885 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T05:35:50.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T05:35:50.932 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T05:35:50.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T05:35:50.985 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T05:35:50.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T05:35:51.039 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T05:35:51.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T05:35:51.097 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T05:35:51.097 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T05:35:51.152 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T05:35:51.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T05:35:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7f2814c00640 1 -- 172.21.15.44:0/2837410460 <== mon.1 v2:172.21.15.86:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f280401db90 con 0x7f28181577c0 2024-09-17T05:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c80b4270 con 0x7f89c80ce130 2024-09-17T05:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c8157d40 con 0x7f89c80ce130 2024-09-17T05:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7f89bf400640 1 -- 172.21.15.44:0/2900104832 <== mon.1 v2:172.21.15.86:3300/0 4 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f89c00097e0 con 0x7f89c80ce130 2024-09-17T05:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7f89bf400640 1 -- 172.21.15.44:0/2900104832 <== mon.1 v2:172.21.15.86:3300/0 5 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f89c00c1030 con 0x7f89c80ce130 2024-09-17T05:35:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7f89bf400640 1 -- 172.21.15.44:0/2900104832 <== mon.1 v2:172.21.15.86:3300/0 6 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f89c0004730 con 0x7f89c80ce130 2024-09-17T05:35:51.183 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T05:35:51.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T05:35:51.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7f91a8c00640 1 -- 172.21.15.44:0/1766405869 <== mon.2 v2:172.21.15.86:3301/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f91a400ca30 con 0x7f91ac13db00 2024-09-17T05:35:51.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.174+0000 7fdbdd600640 1 -- 172.21.15.44:0/2792700218 <== mon.0 v2:172.21.15.44:3300/0 10 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7fdbd40af410 con 0x7fdbc8003a10 2024-09-17T05:35:51.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.178+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c0052a0 con 0x7f89c80ce130 2024-09-17T05:35:51.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.182+0000 7fb06f400640 1 -- 172.21.15.44:0/3474948574 <== mon.2 v2:172.21.15.86:3301/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7fb06801bc10 con 0x7fb05c005280 2024-09-17T05:35:51.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.182+0000 7fb06f400640 1 -- 172.21.15.44:0/3474948574 <== mon.2 v2:172.21.15.86:3301/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7fb068020060 con 0x7fb05c005280 2024-09-17T05:35:51.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.182+0000 7f89bf400640 1 -- 172.21.15.44:0/2900104832 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f89c0016790 con 0x7f89c80ce130 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.182+0000 7fdbe6e00640 1 -- 172.21.15.44:0/2792700218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8003a10 msgr2=0x7fdbe01fa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.182+0000 7fdbe6e00640 1 --2- 172.21.15.44:0/2792700218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8003a10 0x7fdbe01fa0b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdbd401cbf0 tx=0x7fdbc8005840 comp rx=0 tx=0).stop 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fdbe6e00640 1 -- 172.21.15.44:0/2792700218 shutdown_connections 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fdbe6e00640 1 --2- 172.21.15.44:0/2792700218 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdbe0073c20 0x7fdbe0074030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fdbe6e00640 1 --2- 172.21.15.44:0/2792700218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe014f8b0 0x7fdbe014fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fdbe6e00640 1 --2- 172.21.15.44:0/2792700218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdbc8003a10 0x7fdbe01fa0b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fdbe6e00640 1 -- 172.21.15.44:0/2792700218 >> 172.21.15.44:0/2792700218 conn(0x7fdbe006fb90 msgr2=0x7fdbe00b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb06f400640 1 -- 172.21.15.44:0/3474948574 <== mon.2 v2:172.21.15.86:3301/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb068011440 con 0x7fb05c005280 2024-09-17T05:35:51.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7f91a8c00640 1 -- 172.21.15.44:0/1766405869 <== mon.2 v2:172.21.15.86:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f91a4023420 con 0x7f91ac13db00 2024-09-17T05:35:51.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7f2814c00640 1 -- 172.21.15.44:0/2837410460 <== mon.1 v2:172.21.15.86:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f280401de30 con 0x7f28181577c0 2024-09-17T05:35:51.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7f91a8c00640 1 -- 172.21.15.44:0/1766405869 <== mon.2 v2:172.21.15.86:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v5)=0 v5) ==== 114+0+0 (secure 0 0 0) 0x7f91a4023660 con 0x7f91ac13db00 2024-09-17T05:35:51.194 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T05:35:51.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T05:35:51.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb07cc00640 1 -- 172.21.15.44:0/3474948574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c005280 msgr2=0x7fb0781f34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb07cc00640 1 --2- 172.21.15.44:0/3474948574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c005280 0x7fb0781f34c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb06800f980 tx=0x7fb06800fe40 comp rx=0 tx=0).stop 2024-09-17T05:35:51.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb07cc00640 1 -- 172.21.15.44:0/3474948574 shutdown_connections 2024-09-17T05:35:51.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb07cc00640 1 --2- 172.21.15.44:0/3474948574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb078143010 0x7fb0781f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb07cc00640 1 --2- 172.21.15.44:0/3474948574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0780b2710 0x7fb078142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb07cc00640 1 --2- 172.21.15.44:0/3474948574 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb05c005280 0x7fb0781f34c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fb07cc00640 1 -- 172.21.15.44:0/3474948574 >> 172.21.15.44:0/3474948574 conn(0x7fb07806fb90 msgr2=0x7fb0780d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.190+0000 7fb07cc00640 1 -- 172.21.15.44:0/3474948574 shutdown_connections 2024-09-17T05:35:51.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.190+0000 7fb07cc00640 1 -- 172.21.15.44:0/3474948574 wait complete. 2024-09-17T05:35:51.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fdbe6e00640 1 -- 172.21.15.44:0/2792700218 shutdown_connections 2024-09-17T05:35:51.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7fdbe6e00640 1 -- 172.21.15.44:0/2792700218 wait complete. 2024-09-17T05:35:51.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.186+0000 7f89bf400640 1 -- 172.21.15.44:0/2900104832 <== mon.1 v2:172.21.15.86:3300/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f89c00a58c0 con 0x7f89c80ce130 2024-09-17T05:35:51.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.210+0000 7f91b2000640 1 -- 172.21.15.44:0/1766405869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91ac13db00 msgr2=0x7f91ac13df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.210+0000 7f91b2000640 1 --2- 172.21.15.44:0/1766405869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91ac13db00 0x7f91ac13df10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0cfd20 tx=0x7f91a400fe30 comp rx=0 tx=0).stop 2024-09-17T05:35:51.220 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T05:35:51.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T05:35:51.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.210+0000 7f91b2000640 1 -- 172.21.15.44:0/1766405869 shutdown_connections 2024-09-17T05:35:51.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.210+0000 7f91b2000640 1 --2- 172.21.15.44:0/1766405869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91ac13db00 0x7f91ac13df10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.210+0000 7f91b2000640 1 --2- 172.21.15.44:0/1766405869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91ac14aef0 0x7f91ac14b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.210+0000 7f91b2000640 1 --2- 172.21.15.44:0/1766405869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9194003a60 0x7f91ac13aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.210+0000 7f91b2000640 1 -- 172.21.15.44:0/1766405869 >> 172.21.15.44:0/1766405869 conn(0x7f91ac06fb90 msgr2=0x7f91ac152820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.230+0000 7f91b2000640 1 -- 172.21.15.44:0/1766405869 shutdown_connections 2024-09-17T05:35:51.237 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T05:35:51.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T05:35:51.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.234+0000 7f91b2000640 1 -- 172.21.15.44:0/1766405869 wait complete. 2024-09-17T05:35:51.260 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T05:35:51.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T05:35:51.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.258+0000 7f8df5000640 1 -- 172.21.15.44:0/2052010974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd4005360 msgr2=0x7f8dd400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.258+0000 7f8df5000640 1 --2- 172.21.15.44:0/2052010974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd4005360 0x7f8dd400b9d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8df00ce850 tx=0x7f8de001c6c0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.272 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T05:35:51.272 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T05:35:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.266+0000 7f8df5000640 1 -- 172.21.15.44:0/2052010974 shutdown_connections 2024-09-17T05:35:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.266+0000 7f8df5000640 1 --2- 172.21.15.44:0/2052010974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd4005360 0x7f8dd400b9d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.266+0000 7f8df5000640 1 -- 172.21.15.44:0/2052010974 >> 172.21.15.44:0/2052010974 conn(0x7f8df00ccaa0 msgr2=0x7f8df00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.278+0000 7f8df5000640 1 -- 172.21.15.44:0/2052010974 shutdown_connections 2024-09-17T05:35:51.285 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T05:35:51.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T05:35:51.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.286+0000 7f281e400640 1 -- 172.21.15.44:0/2837410460 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f27ec005320 con 0x7f28181577c0 2024-09-17T05:35:51.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.286+0000 7f8df5000640 1 -- 172.21.15.44:0/2052010974 wait complete. 2024-09-17T05:35:51.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 Processor -- start 2024-09-17T05:35:51.305 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T05:35:51.305 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T05:35:51.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 -- start start 2024-09-17T05:35:51.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dd4005360 0x7f8df01f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df015caa0 0x7f8df009d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df00cb5a0 0x7f8df00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8df006de50 con 0x7f8df015caa0 2024-09-17T05:35:51.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8df0074bc0 con 0x7f8df00cb5a0 2024-09-17T05:35:51.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8df5000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8df006dfd0 con 0x7f8dd4005360 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8dede00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dd4005360 0x7f8df01f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8dede00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dd4005360 0x7f8df01f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40670/0 (socket says 172.21.15.44:40670) 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8dede00640 1 -- 172.21.15.44:0/862018478 learned_addr learned my addr 172.21.15.44:0/862018478 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.298+0000 7f8ded400640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df015caa0 0x7f8df009d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dee800640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df00cb5a0 0x7f8df00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dede00640 1 -- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df00cb5a0 msgr2=0x7f8df00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dede00640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df00cb5a0 0x7f8df00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dede00640 1 -- 172.21.15.44:0/862018478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df015caa0 msgr2=0x7f8df009d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dede00640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df015caa0 0x7f8df009d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dede00640 1 -- 172.21.15.44:0/862018478 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df00c3600 con 0x7f8dd4005360 2024-09-17T05:35:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dee800640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df00cb5a0 0x7f8df00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8dede00640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dd4005360 0x7f8df01f3630 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00d5c0 tx=0x7f8ddc00da80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc017070 con 0x7f8dd4005360 2024-09-17T05:35:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f8ddc0052f0 con 0x7f8dd4005360 2024-09-17T05:35:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.302+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0047b0 con 0x7f8dd4005360 2024-09-17T05:35:51.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.314+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df01f3b70 con 0x7f8dd4005360 2024-09-17T05:35:51.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.314+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df00c3320 con 0x7f8dd4005360 2024-09-17T05:35:51.322 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T05:35:51.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T05:35:51.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.314+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ddc004950 con 0x7f8dd4005360 2024-09-17T05:35:51.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.314+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8ddc0104f0 con 0x7f8dd4005360 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.318+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df006e470 con 0x7f8dd4005360 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.322+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 6 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ddc004e20 con 0x7f8dd4005360 2024-09-17T05:35:51.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.322+0000 7f2814c00640 1 -- 172.21.15.44:0/2837410460 <== mon.1 v2:172.21.15.86:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2804013560 con 0x7f28181577c0 2024-09-17T05:35:51.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.322+0000 7f2814c00640 1 -- 172.21.15.44:0/2837410460 <== mon.1 v2:172.21.15.86:3300/0 12 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f2804013850 con 0x7f28181577c0 2024-09-17T05:35:51.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.322+0000 7f89bf400640 1 -- 172.21.15.44:0/2900104832 <== mon.1 v2:172.21.15.86:3300/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89c00a5b80 con 0x7f89c80ce130 2024-09-17T05:35:51.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.322+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8df01f3b70 con 0x7f8dd4005360 2024-09-17T05:35:51.336 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T05:35:51.336 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T05:35:51.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.350+0000 7f281e400640 1 -- 172.21.15.44:0/2837410460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28181577c0 msgr2=0x7f2818157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.350+0000 7f281e400640 1 --2- 172.21.15.44:0/2837410460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28181577c0 0x7f2818157bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f280400e520 tx=0x7f280400e9e0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.357 DEBUG:tasks.ceph:set 22 configs 2024-09-17T05:35:51.357 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.357 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.366 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.366 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.367 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.362+0000 7f281e400640 1 -- 172.21.15.44:0/2837410460 shutdown_connections 2024-09-17T05:35:51.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.362+0000 7f281e400640 1 --2- 172.21.15.44:0/2837410460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28181f0440 0x7f28181f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.362+0000 7f281e400640 1 --2- 172.21.15.44:0/2837410460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28181577c0 0x7f2818157bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.362+0000 7f281e400640 1 --2- 172.21.15.44:0/2837410460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27fc003ab0 0x7f28180a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.362+0000 7f281e400640 1 -- 172.21.15.44:0/2837410460 >> 172.21.15.44:0/2837410460 conn(0x7f281806ce40 msgr2=0x7f2818158d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.370+0000 7f281e400640 1 -- 172.21.15.44:0/2837410460 shutdown_connections 2024-09-17T05:35:51.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.370+0000 7f281e400640 1 -- 172.21.15.44:0/2837410460 wait complete. 2024-09-17T05:35:51.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.450+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f899c005590 con 0x7f89c80ce130 2024-09-17T05:35:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.462+0000 7f36b9200640 1 -- 172.21.15.44:0/3587481817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b4162540 msgr2=0x7f36b415eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.462+0000 7f36b9200640 1 --2- 172.21.15.44:0/3587481817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b4162540 0x7f36b415eb30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009c80 tx=0x7f36ac01cd70 comp rx=0 tx=0).stop 2024-09-17T05:35:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.466+0000 7f36b9200640 1 -- 172.21.15.44:0/3587481817 shutdown_connections 2024-09-17T05:35:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.466+0000 7f36b9200640 1 --2- 172.21.15.44:0/3587481817 >> v2:172.21.15.44:3300/0 conn(0x7f36b40b3210 0x7f36b40b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.466+0000 7f36b9200640 1 --2- 172.21.15.44:0/3587481817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b4162540 0x7f36b415eb30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.466+0000 7f36b9200640 1 -- 172.21.15.44:0/3587481817 >> 172.21.15.44:0/3587481817 conn(0x7f36b406ce40 msgr2=0x7f36b406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.470+0000 7f36b9200640 1 -- 172.21.15.44:0/3587481817 shutdown_connections 2024-09-17T05:35:51.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.470+0000 7f36b9200640 1 -- 172.21.15.44:0/3587481817 wait complete. 2024-09-17T05:35:51.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.474+0000 7f89bf400640 1 -- 172.21.15.44:0/2900104832 <== mon.1 v2:172.21.15.86:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f89c00a6000 con 0x7f89c80ce130 2024-09-17T05:35:51.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.478+0000 7f36b9200640 1 Processor -- start 2024-09-17T05:35:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.478+0000 7f36b9200640 1 -- start start 2024-09-17T05:35:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.478+0000 7f36b9200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b40b3210 0x7f36b4153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.478+0000 7f36b9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36b415f070 0x7f36b414c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.478+0000 7f36b3400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b40b3210 0x7f36b4153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.478+0000 7f36b3400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b40b3210 0x7f36b4153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40692/0 (socket says 172.21.15.44:40692) 2024-09-17T05:35:51.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.482+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c80ce130 msgr2=0x7f89c8156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.482+0000 7f89cde00640 1 --2- 172.21.15.44:0/2900104832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c80ce130 0x7f89c8156ae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f89c00ac000 tx=0x7f89c00195c0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3400640 1 -- 172.21.15.44:0/1866224282 learned_addr learned my addr 172.21.15.44:0/1866224282 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.490+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 shutdown_connections 2024-09-17T05:35:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.490+0000 7f89cde00640 1 --2- 172.21.15.44:0/2900104832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89c80ce130 0x7f89c8156ae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.490+0000 7f89cde00640 1 --2- 172.21.15.44:0/2900104832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89c80cc5a0 0x7f89c80b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.490+0000 7f89cde00640 1 --2- 172.21.15.44:0/2900104832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89c80cc190 0x7f89c809c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.490+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 >> 172.21.15.44:0/2900104832 conn(0x7f89c80ccaa0 msgr2=0x7f89c816f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.490+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 shutdown_connections 2024-09-17T05:35:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.490+0000 7f89cde00640 1 -- 172.21.15.44:0/2900104832 wait complete. 2024-09-17T05:35:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b9200640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36b4162540 0x7f36b414c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36b4154090 con 0x7f36b415f070 2024-09-17T05:35:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f36b40b4580 con 0x7f36b4162540 2024-09-17T05:35:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f36b4154210 con 0x7f36b40b3210 2024-09-17T05:35:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b2a00640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36b415f070 0x7f36b414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3e00640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36b4162540 0x7f36b414c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3e00640 1 -- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b40b3210 msgr2=0x7f36b4153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3e00640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b40b3210 0x7f36b4153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3e00640 1 -- 172.21.15.44:0/1866224282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36b415f070 msgr2=0x7f36b414c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3e00640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36b415f070 0x7f36b414c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3e00640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b414aff0 con 0x7f36b4162540 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b3e00640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36b4162540 0x7f36b414c8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c6f0 tx=0x7f36a000cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36ab400640 1 -- 172.21.15.44:0/1866224282 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a00079b0 con 0x7f36b4162540 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36ab400640 1 -- 172.21.15.44:0/1866224282 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36a0007c60 con 0x7f36b4162540 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36ab400640 1 -- 172.21.15.44:0/1866224282 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a00206c0 con 0x7f36b4162540 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b414b2d0 con 0x7f36b4162540 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b414b890 con 0x7f36b4162540 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36ab400640 1 -- 172.21.15.44:0/1866224282 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f36a0020860 con 0x7f36b4162540 2024-09-17T05:35:51.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.486+0000 7f36ab400640 1 -- 172.21.15.44:0/1866224282 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f36a001f3c0 con 0x7f36b4162540 2024-09-17T05:35:51.499 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.494+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f368c0052a0 con 0x7f36b4162540 2024-09-17T05:35:51.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.498+0000 7f36ab400640 1 -- 172.21.15.44:0/1866224282 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f36a0025030 con 0x7f36b4162540 2024-09-17T05:35:51.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.506+0000 7f3089200640 1 -- 172.21.15.44:0/652676932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0db5c0 msgr2=0x7f307c0e2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.506+0000 7f3089200640 1 --2- 172.21.15.44:0/652676932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0db5c0 0x7f307c0e2740 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3070009920 tx=0x7f307001c870 comp rx=0 tx=0).stop 2024-09-17T05:35:51.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.514+0000 7f3089200640 1 -- 172.21.15.44:0/652676932 shutdown_connections 2024-09-17T05:35:51.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.514+0000 7f3089200640 1 --2- 172.21.15.44:0/652676932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0db5c0 0x7f307c0e2740 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.514+0000 7f3089200640 1 -- 172.21.15.44:0/652676932 >> 172.21.15.44:0/652676932 conn(0x7f307c01d9e0 msgr2=0x7f307c0396a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.518+0000 7f3089200640 1 -- 172.21.15.44:0/652676932 shutdown_connections 2024-09-17T05:35:51.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.518+0000 7f3089200640 1 -- 172.21.15.44:0/652676932 wait complete. 2024-09-17T05:35:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.522+0000 7f3089200640 1 Processor -- start 2024-09-17T05:35:51.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.522+0000 7f3089200640 1 -- start start 2024-09-17T05:35:51.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.522+0000 7f3089200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0332f0 0x7f307c0da7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.522+0000 7f3089200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f307c0db5c0 0x7f307c0dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.522+0000 7f3089200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f307c0e1920 0x7f307c0f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.522+0000 7f3081e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0332f0 0x7f307c0da7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.522+0000 7f3081e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0332f0 0x7f307c0da7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40718/0 (socket says 172.21.15.44:40718) 2024-09-17T05:35:51.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3082800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f307c0e1920 0x7f307c0f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3082800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f307c0e1920 0x7f307c0f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45856/0 (socket says 172.21.15.44:45856) 2024-09-17T05:35:51.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f307c052730 con 0x7f307c0e1920 2024-09-17T05:35:51.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3081e00640 1 -- 172.21.15.44:0/3731296803 learned_addr learned my addr 172.21.15.44:0/3731296803 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f307c0525b0 con 0x7f307c0db5c0 2024-09-17T05:35:51.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f307c0528b0 con 0x7f307c0332f0 2024-09-17T05:35:51.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3081e00640 1 -- 172.21.15.44:0/3731296803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f307c0db5c0 msgr2=0x7f307c0dbc40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:35:51.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3081e00640 1 --2- 172.21.15.44:0/3731296803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f307c0db5c0 0x7f307c0dbc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3081e00640 1 -- 172.21.15.44:0/3731296803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f307c0e1920 msgr2=0x7f307c0f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3081e00640 1 --2- 172.21.15.44:0/3731296803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f307c0e1920 0x7f307c0f2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3081e00640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c0f0f80 con 0x7f307c0332f0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3081e00640 1 --2- 172.21.15.44:0/3731296803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0332f0 0x7f307c0da7e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f307001a4a0 tx=0x7f3070004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f307a000640 1 -- 172.21.15.44:0/3731296803 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30700b2070 con 0x7f307c0332f0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f307a000640 1 -- 172.21.15.44:0/3731296803 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30700bc070 con 0x7f307c0332f0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f307a000640 1 -- 172.21.15.44:0/3731296803 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070004490 con 0x7f307c0332f0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c0f1260 con 0x7f307c0332f0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.526+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c0f1820 con 0x7f307c0332f0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.530+0000 7f307a000640 1 -- 172.21.15.44:0/3731296803 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3070003600 con 0x7f307c0332f0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.530+0000 7f307a000640 1 -- 172.21.15.44:0/3731296803 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f30700c17c0 con 0x7f307c0332f0 2024-09-17T05:35:51.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.534+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305c0052a0 con 0x7f307c0332f0 2024-09-17T05:35:51.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.534+0000 7f346a600640 1 -- 172.21.15.44:0/1542932180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3448004810 msgr2=0x7f3448004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.534+0000 7f346a600640 1 --2- 172.21.15.44:0/1542932180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3448004810 0x7f3448004c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f345c002190 tx=0x7f345c02e2c0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.542+0000 7f346a600640 1 -- 172.21.15.44:0/1542932180 shutdown_connections 2024-09-17T05:35:51.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.542+0000 7f346a600640 1 --2- 172.21.15.44:0/1542932180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3448004810 0x7f3448004c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.542+0000 7f346a600640 1 -- 172.21.15.44:0/1542932180 >> 172.21.15.44:0/1542932180 conn(0x7f346406ce40 msgr2=0x7f346406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.538+0000 7f307a000640 1 -- 172.21.15.44:0/3731296803 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f30700164f0 con 0x7f307c0332f0 2024-09-17T05:35:51.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.546+0000 7f346a600640 1 -- 172.21.15.44:0/1542932180 shutdown_connections 2024-09-17T05:35:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.546+0000 7f346a600640 1 -- 172.21.15.44:0/1542932180 wait complete. 2024-09-17T05:35:51.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.558+0000 7f346a600640 1 Processor -- start 2024-09-17T05:35:51.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.558+0000 7f346a600640 1 -- start start 2024-09-17T05:35:51.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3448004810 0x7f34641f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34641587d0 0x7f3464148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34641494e0 0x7f346414f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34640b42b0 con 0x7f3448004810 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f34640b4130 con 0x7f34641587d0 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f34640b4430 con 0x7f34641494e0 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34641494e0 0x7f346414f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3463e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34641587d0 0x7f3464148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3448004810 0x7f34641f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3463e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34641587d0 0x7f3464148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55422/0 (socket says 172.21.15.44:55422) 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34641494e0 0x7f346414f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40728/0 (socket says 172.21.15.44:40728) 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3463e00640 1 -- 172.21.15.44:0/3986443466 learned_addr learned my addr 172.21.15.44:0/3986443466 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 -- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34641587d0 msgr2=0x7f3464148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34641587d0 0x7f3464148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 -- 172.21.15.44:0/3986443466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3448004810 msgr2=0x7f34641f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3448004810 0x7f34641f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 -- 172.21.15.44:0/3986443466 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3464157e90 con 0x7f34641494e0 2024-09-17T05:35:51.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3463e00640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34641587d0 0x7f3464148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:51.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3469c00640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34641494e0 0x7f346414f0f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3464071b40 tx=0x7f345400b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3460c00640 1 -- 172.21.15.44:0/3986443466 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454011830 con 0x7f34641494e0 2024-09-17T05:35:51.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3460c00640 1 -- 172.21.15.44:0/3986443466 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3454017070 con 0x7f34641494e0 2024-09-17T05:35:51.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3460c00640 1 -- 172.21.15.44:0/3986443466 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454011d80 con 0x7f34641494e0 2024-09-17T05:35:51.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3464158170 con 0x7f34641494e0 2024-09-17T05:35:51.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3464155c60 con 0x7f34641494e0 2024-09-17T05:35:51.589 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3460c00640 1 -- 172.21.15.44:0/3986443466 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f345401c460 con 0x7f34641494e0 2024-09-17T05:35:51.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.574+0000 7f3460c00640 1 -- 172.21.15.44:0/3986443466 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f345401b780 con 0x7f34641494e0 2024-09-17T05:35:51.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.582+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34640b3380 con 0x7f34641494e0 2024-09-17T05:35:51.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.582+0000 7f3460c00640 1 -- 172.21.15.44:0/3986443466 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f345401b980 con 0x7f34641494e0 2024-09-17T05:35:51.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f8df00ca230 con 0x7f8dd4005360 2024-09-17T05:35:51.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 -- 172.21.15.44:0/3817242867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c06e490 msgr2=0x7f733c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 --2- 172.21.15.44:0/3817242867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c06e490 0x7f733c06fa90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7330009900 tx=0x7f733001c660 comp rx=0 tx=0).stop 2024-09-17T05:35:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 -- 172.21.15.44:0/3817242867 shutdown_connections 2024-09-17T05:35:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 --2- 172.21.15.44:0/3817242867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c06e490 0x7f733c06fa90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 --2- 172.21.15.44:0/3817242867 >> v2:172.21.15.86:3300/0 conn(0x7f733c15b480 0x7f733c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 -- 172.21.15.44:0/3817242867 >> 172.21.15.44:0/3817242867 conn(0x7f733c0d0190 msgr2=0x7f733c0d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 -- 172.21.15.44:0/3817242867 shutdown_connections 2024-09-17T05:35:51.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.722+0000 7f7342000640 1 -- 172.21.15.44:0/3817242867 wait complete. 2024-09-17T05:35:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.730+0000 7f7342000640 1 Processor -- start 2024-09-17T05:35:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f8de6000640 1 -- 172.21.15.44:0/862018478 <== mon.2 v2:172.21.15.86:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f8df01f3b70 con 0x7f8dd4005360 2024-09-17T05:35:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.730+0000 7f7342000640 1 -- start start 2024-09-17T05:35:51.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dd4005360 msgr2=0x7f8df01f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f8df5000640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dd4005360 0x7f8df01f3630 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00d5c0 tx=0x7f8ddc00da80 comp rx=0 tx=0).stop 2024-09-17T05:35:51.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f7342000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f733c06e490 0x7f733c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 shutdown_connections 2024-09-17T05:35:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f8df5000640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8df00cb5a0 0x7f8df00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f8df5000640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df015caa0 0x7f8df009d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f8df5000640 1 --2- 172.21.15.44:0/862018478 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dd4005360 0x7f8df01f3630 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 >> 172.21.15.44:0/862018478 conn(0x7f8df00ccaa0 msgr2=0x7f8df00a07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.734+0000 7f733aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f733c06e490 0x7f733c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f733c06e490 0x7f733c153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45870/0 (socket says 172.21.15.44:45870) 2024-09-17T05:35:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f7342000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f733c06f110 0x7f733c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733aa00640 1 -- 172.21.15.44:0/272709202 learned_addr learned my addr 172.21.15.44:0/272709202 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 shutdown_connections 2024-09-17T05:35:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f8df5000640 1 -- 172.21.15.44:0/862018478 wait complete. 2024-09-17T05:35:51.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f7342000640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c15b480 0x7f733c09b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f733c06d5a0 con 0x7f733c06e490 2024-09-17T05:35:51.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f733c06d420 con 0x7f733c06f110 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f733c06d720 con 0x7f733c15b480 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733b400640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c15b480 0x7f733c09b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733aa00640 1 -- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c15b480 msgr2=0x7f733c09b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733aa00640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c15b480 0x7f733c09b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733aa00640 1 -- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f733c06f110 msgr2=0x7f733c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733a000640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f733c06f110 0x7f733c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733aa00640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f733c06f110 0x7f733c157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733aa00640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c0c4b50 con 0x7f733c06e490 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.738+0000 7f733a000640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f733c06f110 0x7f733c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.742+0000 7f733aa00640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f733c06e490 0x7f733c153400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f733400c950 tx=0x7f733400ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.742+0000 7f732f400640 1 -- 172.21.15.44:0/272709202 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733400b040 con 0x7f733c06e490 2024-09-17T05:35:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.742+0000 7f732f400640 1 -- 172.21.15.44:0/272709202 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7334007ce0 con 0x7f733c06e490 2024-09-17T05:35:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.742+0000 7f732f400640 1 -- 172.21.15.44:0/272709202 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334018650 con 0x7f733c06e490 2024-09-17T05:35:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.742+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f733c0c4e30 con 0x7f733c06e490 2024-09-17T05:35:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.742+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f733c0c53f0 con 0x7f733c06e490 2024-09-17T05:35:51.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.746+0000 7f732f400640 1 -- 172.21.15.44:0/272709202 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7334018b80 con 0x7f733c06e490 2024-09-17T05:35:51.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.746+0000 7f732f400640 1 -- 172.21.15.44:0/272709202 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f73340177d0 con 0x7f733c06e490 2024-09-17T05:35:51.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.758+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f733c0cd4f0 con 0x7f733c06e490 2024-09-17T05:35:51.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.774+0000 7f732f400640 1 -- 172.21.15.44:0/272709202 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f733401d020 con 0x7f733c06e490 2024-09-17T05:35:51.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f368c005860 con 0x7f36b4162540 2024-09-17T05:35:51.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 -- 172.21.15.44:0/628004037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e81604b0 msgr2=0x7fb9e8142230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 --2- 172.21.15.44:0/628004037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e81604b0 0x7fb9e8142230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009900 tx=0x7fb9d801c6d0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 -- 172.21.15.44:0/628004037 shutdown_connections 2024-09-17T05:35:51.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 --2- 172.21.15.44:0/628004037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e81604b0 0x7fb9e8142230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 --2- 172.21.15.44:0/628004037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e8071390 0x7fb9e815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 -- 172.21.15.44:0/628004037 >> 172.21.15.44:0/628004037 conn(0x7fb9e80cda70 msgr2=0x7fb9e80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 -- 172.21.15.44:0/628004037 shutdown_connections 2024-09-17T05:35:51.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.806+0000 7fb9e7200640 1 -- 172.21.15.44:0/628004037 wait complete. 2024-09-17T05:35:51.814 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.814+0000 7fb9e7200640 1 Processor -- start 2024-09-17T05:35:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.814+0000 7fb9e7200640 1 -- start start 2024-09-17T05:35:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.818+0000 7fb9e7200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e8071390 0x7fb9e81fa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.818+0000 7fb9e7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e80717a0 0x7fb9e813e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.818+0000 7fb9e7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e81604b0 0x7fb9e813ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.818+0000 7fb9e7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e80706f0 con 0x7fb9e81604b0 2024-09-17T05:35:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.818+0000 7fb9e7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb9e8142980 con 0x7fb9e80717a0 2024-09-17T05:35:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.818+0000 7fb9e7200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb9e8070870 con 0x7fb9e8071390 2024-09-17T05:35:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e5e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e8071390 0x7fb9e81fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e5400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e80717a0 0x7fb9e813e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e5400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e80717a0 0x7fb9e813e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55460/0 (socket says 172.21.15.44:55460) 2024-09-17T05:35:51.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e5400640 1 -- 172.21.15.44:0/4212420713 learned_addr learned my addr 172.21.15.44:0/4212420713 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e6800640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e81604b0 0x7fb9e813ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7f69f7e00640 1 -- 172.21.15.44:0/1062363206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 msgr2=0x7f69f81554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7f69f7e00640 1 --2- 172.21.15.44:0/1062363206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 0x7f69f81554a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009900 tx=0x7f69e801c920 comp rx=0 tx=0).stop 2024-09-17T05:35:51.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e6800640 1 -- 172.21.15.44:0/4212420713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e8071390 msgr2=0x7fb9e81fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e6800640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e8071390 0x7fb9e81fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e6800640 1 -- 172.21.15.44:0/4212420713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e80717a0 msgr2=0x7fb9e813e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e6800640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e80717a0 0x7fb9e813e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e6800640 1 -- 172.21.15.44:0/4212420713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9e81f74b0 con 0x7fb9e81604b0 2024-09-17T05:35:51.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fb9e5400640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e80717a0 0x7fb9e813e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:51.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7f69f7e00640 1 -- 172.21.15.44:0/1062363206 shutdown_connections 2024-09-17T05:35:51.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7f69f7e00640 1 --2- 172.21.15.44:0/1062363206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 0x7f69f81554a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fe7ece00640 1 -- 172.21.15.44:0/1337782082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e81554b0 msgr2=0x7fe7e8162120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7f69f7e00640 1 --2- 172.21.15.44:0/1062363206 >> v2:172.21.15.44:3300/0 conn(0x7f69f806de50 0x7f69f806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.822+0000 7fe7ece00640 1 --2- 172.21.15.44:0/1337782082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e81554b0 0x7fe7e8162120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40097f0 tx=0x7fe7d401c690 comp rx=0 tx=0).stop 2024-09-17T05:35:51.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7fb9e6800640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e81604b0 0x7fb9e813ed90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80ac000 tx=0x7fb9d80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7f69f7e00640 1 -- 172.21.15.44:0/1062363206 >> 172.21.15.44:0/1062363206 conn(0x7f69f80700b0 msgr2=0x7f69f80704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7fe7ece00640 1 -- 172.21.15.44:0/1337782082 shutdown_connections 2024-09-17T05:35:51.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7fe7ece00640 1 --2- 172.21.15.44:0/1337782082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e81554b0 0x7fe7e8162120 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7fe7ece00640 1 -- 172.21.15.44:0/1337782082 >> 172.21.15.44:0/1337782082 conn(0x7fe7e806ce40 msgr2=0x7fe7e806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7f69f7e00640 1 -- 172.21.15.44:0/1062363206 shutdown_connections 2024-09-17T05:35:51.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7f69f7e00640 1 -- 172.21.15.44:0/1062363206 wait complete. 2024-09-17T05:35:51.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7fe7ece00640 1 -- 172.21.15.44:0/1337782082 shutdown_connections 2024-09-17T05:35:51.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.826+0000 7fe7ece00640 1 -- 172.21.15.44:0/1337782082 wait complete. 2024-09-17T05:35:51.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.830+0000 7fe7ece00640 1 Processor -- start 2024-09-17T05:35:51.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.830+0000 7f36ab400640 1 -- 172.21.15.44:0/1866224282 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f36a0020d30 con 0x7f36b4162540 2024-09-17T05:35:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.830+0000 7fe7ece00640 1 -- start start 2024-09-17T05:35:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.830+0000 7f69f7e00640 1 Processor -- start 2024-09-17T05:35:51.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.830+0000 7f69f7e00640 1 -- start start 2024-09-17T05:35:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36b4162540 msgr2=0x7f36b414c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36b4162540 0x7f36b414c8a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c6f0 tx=0x7f36a000cbb0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 shutdown_connections 2024-09-17T05:35:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36b4162540 0x7f36b414c8a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36b415f070 0x7f36b414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 --2- 172.21.15.44:0/1866224282 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f36b40b3210 0x7f36b4153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 >> 172.21.15.44:0/1866224282 conn(0x7f36b406ce40 msgr2=0x7f36b415f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 shutdown_connections 2024-09-17T05:35:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f36b9200640 1 -- 172.21.15.44:0/1866224282 wait complete. 2024-09-17T05:35:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f4180e00640 1 -- 172.21.15.44:0/3748607204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c15b7f0 msgr2=0x7f417c0cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.834+0000 7f4180e00640 1 --2- 172.21.15.44:0/3748607204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c15b7f0 0x7f417c0cc200 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f417c06a1e0 tx=0x7f416c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7f1891e00640 1 -- 172.21.15.44:0/4084738814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1870004810 msgr2=0x7f1870004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7f1891e00640 1 --2- 172.21.15.44:0/4084738814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1870004810 0x7f1870004c20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f188c0b4f60 tx=0x7f187c01d270 comp rx=0 tx=0).stop 2024-09-17T05:35:51.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7ece00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7e81554b0 0x7fe7e815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7ece00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7e8162660 0x7fe7e8141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7f1891400640 1 -- 172.21.15.44:0/4084738814 reap_dead start 2024-09-17T05:35:51.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7f1891e00640 1 -- 172.21.15.44:0/4084738814 shutdown_connections 2024-09-17T05:35:51.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7f1891e00640 1 -- 172.21.15.44:0/4084738814 >> 172.21.15.44:0/4084738814 conn(0x7f188c06ce40 msgr2=0x7f188c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7e81554b0 0x7fe7e815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7e81554b0 0x7fe7e815b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45922/0 (socket says 172.21.15.44:45922) 2024-09-17T05:35:51.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7ece00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e813fd80 0x7fe7e815fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7ece00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80b44b0 con 0x7fe7e81554b0 2024-09-17T05:35:51.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7ece00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80b4330 con 0x7fe7e8162660 2024-09-17T05:35:51.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7ece00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e80b4630 con 0x7fe7e813fd80 2024-09-17T05:35:51.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fe7e7400640 1 -- 172.21.15.44:0/1348402214 learned_addr learned my addr 172.21.15.44:0/1348402214 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f4180e00640 1 -- 172.21.15.44:0/3748607204 shutdown_connections 2024-09-17T05:35:51.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f4180e00640 1 --2- 172.21.15.44:0/3748607204 >> v2:172.21.15.86:3300/0 conn(0x7f417c072c10 0x7f417c0b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f4180e00640 1 --2- 172.21.15.44:0/3748607204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c15b7f0 0x7f417c0cc200 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f4180e00640 1 -- 172.21.15.44:0/3748607204 >> 172.21.15.44:0/3748607204 conn(0x7f417c06ce40 msgr2=0x7f417c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fe7e6a00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7e8162660 0x7fe7e8141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fe7e7e00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e813fd80 0x7fe7e815fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f34640adfc0 con 0x7f34641494e0 2024-09-17T05:35:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69f806de50 0x7f69f814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f7e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 0x7f69f814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69f815f560 0x7f69f81612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f69f81700f0 con 0x7f69f815f560 2024-09-17T05:35:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69f816ff70 con 0x7f69f806de50 2024-09-17T05:35:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f7e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f69f8170270 con 0x7f69f8155090 2024-09-17T05:35:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7f1891e00640 1 -- 172.21.15.44:0/4084738814 shutdown_connections 2024-09-17T05:35:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7f1891e00640 1 -- 172.21.15.44:0/4084738814 wait complete. 2024-09-17T05:35:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fb9de000640 1 -- 172.21.15.44:0/4212420713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8004230 con 0x7fb9e81604b0 2024-09-17T05:35:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fb9de000640 1 -- 172.21.15.44:0/4212420713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9d80044c0 con 0x7fb9e81604b0 2024-09-17T05:35:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.838+0000 7fb9de000640 1 -- 172.21.15.44:0/4212420713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8003860 con 0x7fb9e81604b0 2024-09-17T05:35:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9e81f68a0 con 0x7fb9e81604b0 2024-09-17T05:35:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9e81f6e60 con 0x7fb9e81604b0 2024-09-17T05:35:51.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69f806de50 0x7f69f814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69f806de50 0x7f69f814b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55494/0 (socket says 172.21.15.44:55494) 2024-09-17T05:35:51.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f6a00640 1 -- 172.21.15.44:0/480389150 learned_addr learned my addr 172.21.15.44:0/480389150 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f6000640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 0x7f69f814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fe7e7400640 1 -- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e813fd80 msgr2=0x7fe7e815fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fe7e7400640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e813fd80 0x7fe7e815fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fe7e7400640 1 -- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7e8162660 msgr2=0x7fe7e8141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7fe7e7400640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7e8162660 0x7fe7e8141b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f4180e00640 1 -- 172.21.15.44:0/3748607204 shutdown_connections 2024-09-17T05:35:51.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f4180e00640 1 -- 172.21.15.44:0/3748607204 wait complete. 2024-09-17T05:35:51.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f1891e00640 1 Processor -- start 2024-09-17T05:35:51.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f1891e00640 1 -- start start 2024-09-17T05:35:51.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f305c005590 con 0x7f307c0332f0 2024-09-17T05:35:51.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9e815ff70 con 0x7fb9e81604b0 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7fb9de000640 1 -- 172.21.15.44:0/4212420713 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9d80b5580 con 0x7fb9e81604b0 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7fb9de000640 1 -- 172.21.15.44:0/4212420713 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb9d80be840 con 0x7fb9e81604b0 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f4180e00640 1 Processor -- start 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f4180e00640 1 -- start start 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f4180e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f417c072c10 0x7f417c14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f4180e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c073020 0x7f417c1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f417b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f417c072c10 0x7f417c14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f417c072c10 0x7f417c14c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55506/0 (socket says 172.21.15.44:55506) 2024-09-17T05:35:51.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c073020 0x7f417c1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c073020 0x7f417c1428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45950/0 (socket says 172.21.15.44:45950) 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417b400640 1 -- 172.21.15.44:0/249537753 learned_addr learned my addr 172.21.15.44:0/249537753 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4180e00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f417c15b7f0 0x7f417c1452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4180e00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f417c0b3830 con 0x7f417c073020 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4180e00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f417c0b36b0 con 0x7f417c072c10 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4180e00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f417c0b39b0 con 0x7f417c15b7f0 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417be00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f417c15b7f0 0x7f417c1452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417be00640 1 -- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f417c072c10 msgr2=0x7f417c14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417be00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f417c072c10 0x7f417c14c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417be00640 1 -- 172.21.15.44:0/249537753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c073020 msgr2=0x7f417c1428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417be00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c073020 0x7f417c1428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417be00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c143c30 con 0x7f417c15b7f0 2024-09-17T05:35:51.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f417be00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f417c15b7f0 0x7f417c1452d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f417400bdf0 tx=0x7f4174009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4173400640 1 -- 172.21.15.44:0/249537753 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174019070 con 0x7f417c15b7f0 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4173400640 1 -- 172.21.15.44:0/249537753 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4174014440 con 0x7f417c15b7f0 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4180e00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c15ae60 con 0x7f417c15b7f0 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.842+0000 7f69f7400640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69f815f560 0x7f69f81612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f69f7400640 1 -- 172.21.15.44:0/480389150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 msgr2=0x7f69f814e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f69f7400640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 0x7f69f814e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f69f7400640 1 -- 172.21.15.44:0/480389150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69f806de50 msgr2=0x7f69f814b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f69f7400640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69f806de50 0x7f69f814b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.846+0000 7f69f7400640 1 -- 172.21.15.44:0/480389150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f81ffdc0 con 0x7f69f815f560 2024-09-17T05:35:51.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f69f7400640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69f815f560 0x7f69f81612b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f69e80ac000 tx=0x7f69e8005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4180e00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c159f10 con 0x7f417c15b7f0 2024-09-17T05:35:51.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7f4173400640 1 -- 172.21.15.44:0/249537753 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174014890 con 0x7f417c15b7f0 2024-09-17T05:35:51.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7fe7e7400640 1 -- 172.21.15.44:0/1348402214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e813ece0 con 0x7fe7e81554b0 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7fe7e6a00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7e8162660 0x7fe7e8141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.850+0000 7fe7e7e00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e813fd80 0x7fe7e815fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7fe7e7400640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7e81554b0 0x7fe7e815b7d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7d401a2c0 tx=0x7fe7d40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c159a00 0x7f188c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f188c151ff0 0x7f188c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c152940 0x7f188c0afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f188c1629b0 con 0x7f188c159a00 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f188c162830 con 0x7f188c152940 2024-09-17T05:35:51.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f188c0b4330 con 0x7f188c151ff0 2024-09-17T05:35:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7fb9de000640 1 -- 172.21.15.44:0/4212420713 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb9e81608c0 con 0x7fb9e81604b0 2024-09-17T05:35:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c152940 0x7f188c0afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c152940 0x7f188c0afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55514/0 (socket says 172.21.15.44:55514) 2024-09-17T05:35:51.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 -- 172.21.15.44:0/1267413337 learned_addr learned my addr 172.21.15.44:0/1267413337 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f4170c00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41500052a0 con 0x7f417c15b7f0 2024-09-17T05:35:51.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f188be00640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f188c151ff0 0x7f188c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 -- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f188c151ff0 msgr2=0x7f188c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f188c151ff0 0x7f188c152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 -- 172.21.15.44:0/1267413337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c159a00 msgr2=0x7f188c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c159a00 0x7f188c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.854+0000 7f1891400640 1 -- 172.21.15.44:0/1267413337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c14f450 con 0x7f188c152940 2024-09-17T05:35:51.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f4173400640 1 -- 172.21.15.44:0/249537753 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f417401c070 con 0x7f417c15b7f0 2024-09-17T05:35:51.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f4173400640 1 -- 172.21.15.44:0/249537753 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f417401e780 con 0x7f417c15b7f0 2024-09-17T05:35:51.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f1891400640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c152940 0x7f188c0afe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1878001980 tx=0x7f1878012740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f1888c00640 1 -- 172.21.15.44:0/1267413337 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878014860 con 0x7f188c152940 2024-09-17T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f1888c00640 1 -- 172.21.15.44:0/1267413337 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1878014a00 con 0x7f188c152940 2024-09-17T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f1888c00640 1 -- 172.21.15.44:0/1267413337 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878014e10 con 0x7f188c152940 2024-09-17T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c14f170 con 0x7f188c152940 2024-09-17T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c1517f0 con 0x7f188c152940 2024-09-17T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.858+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18640052a0 con 0x7f188c152940 2024-09-17T05:35:51.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.862+0000 7f4173400640 1 -- 172.21.15.44:0/249537753 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f417401dd80 con 0x7f417c15b7f0 2024-09-17T05:35:51.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.862+0000 7f69eea00640 1 -- 172.21.15.44:0/480389150 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80b2040 con 0x7f69f815f560 2024-09-17T05:35:51.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.862+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f82000a0 con 0x7f69f815f560 2024-09-17T05:35:51.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.862+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f8160d60 con 0x7f69f815f560 2024-09-17T05:35:51.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7f1888c00640 1 -- 172.21.15.44:0/1267413337 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1878020800 con 0x7f188c152940 2024-09-17T05:35:51.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7f1888c00640 1 -- 172.21.15.44:0/1267413337 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f187801f3d0 con 0x7f188c152940 2024-09-17T05:35:51.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7fe7df400640 1 -- 172.21.15.44:0/1348402214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d40b2040 con 0x7fe7e81554b0 2024-09-17T05:35:51.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7f3460c00640 1 -- 172.21.15.44:0/3986443466 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f345401bb60 con 0x7f34641494e0 2024-09-17T05:35:51.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f8160fc0 con 0x7f69f815f560 2024-09-17T05:35:51.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7f69eea00640 1 -- 172.21.15.44:0/480389150 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e8000e50 con 0x7f69f815f560 2024-09-17T05:35:51.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7f69eea00640 1 -- 172.21.15.44:0/480389150 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8009510 con 0x7f69f815f560 2024-09-17T05:35:51.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7fe7ece00640 1 -- 172.21.15.44:0/1348402214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e813efc0 con 0x7fe7e81554b0 2024-09-17T05:35:51.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7fe7ece00640 1 -- 172.21.15.44:0/1348402214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e813f580 con 0x7fe7e81554b0 2024-09-17T05:35:51.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7f1888c00640 1 -- 172.21.15.44:0/1267413337 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1878020af0 con 0x7f188c152940 2024-09-17T05:35:51.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.866+0000 7fe7dcc00640 1 -- 172.21.15.44:0/1348402214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e8162120 con 0x7fe7e81554b0 2024-09-17T05:35:51.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.870+0000 7fe7df400640 1 -- 172.21.15.44:0/1348402214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7d40a5860 con 0x7fe7e81554b0 2024-09-17T05:35:51.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.870+0000 7fe7df400640 1 -- 172.21.15.44:0/1348402214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4003860 con 0x7fe7e81554b0 2024-09-17T05:35:51.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.870+0000 7f307a000640 1 -- 172.21.15.44:0/3731296803 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f3070003a80 con 0x7f307c0332f0 2024-09-17T05:35:51.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.870+0000 7fe7df400640 1 -- 172.21.15.44:0/1348402214 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe7d40bd020 con 0x7fe7e81554b0 2024-09-17T05:35:51.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.870+0000 7fe7df400640 1 -- 172.21.15.44:0/1348402214 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe7d40ada20 con 0x7fe7e81554b0 2024-09-17T05:35:51.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.878+0000 7f69eea00640 1 -- 172.21.15.44:0/480389150 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f69e80bd020 con 0x7f69f815f560 2024-09-17T05:35:51.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.878+0000 7f69eea00640 1 -- 172.21.15.44:0/480389150 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f69e8003890 con 0x7f69f815f560 2024-09-17T05:35:51.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.878+0000 7f69eea00640 1 -- 172.21.15.44:0/480389150 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f69e80c4020 con 0x7f69f815f560 2024-09-17T05:35:51.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.878+0000 7f59b4a00640 1 -- 172.21.15.44:0/3753545479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a8006370 msgr2=0x7f59a80edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.878+0000 7f59b4a00640 1 --2- 172.21.15.44:0/3753545479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a8006370 0x7f59a80edbd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f59a800ca80 tx=0x7f599c01c820 comp rx=0 tx=0).stop 2024-09-17T05:35:51.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.882+0000 7fe7df400640 1 -- 172.21.15.44:0/1348402214 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe7d4016310 con 0x7fe7e81554b0 2024-09-17T05:35:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.886+0000 7f513ca00640 1 -- 172.21.15.44:0/1047222479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 msgr2=0x7f5130051800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.886+0000 7f513ca00640 1 --2- 172.21.15.44:0/1047222479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 0x7f5130051800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5124009900 tx=0x7f512401c850 comp rx=0 tx=0).stop 2024-09-17T05:35:51.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.886+0000 7f59b4a00640 1 -- 172.21.15.44:0/3753545479 shutdown_connections 2024-09-17T05:35:51.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.886+0000 7f59b4a00640 1 --2- 172.21.15.44:0/3753545479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a8006370 0x7f59a80edbd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.886+0000 7f59b4a00640 1 --2- 172.21.15.44:0/3753545479 >> v2:172.21.15.86:3300/0 conn(0x7f59a8033bc0 0x7f59a80511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.886+0000 7f59b4a00640 1 -- 172.21.15.44:0/3753545479 >> 172.21.15.44:0/3753545479 conn(0x7f59a801d9b0 msgr2=0x7f59a8039670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f59b4a00640 1 -- 172.21.15.44:0/3753545479 shutdown_connections 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34641494e0 msgr2=0x7f346414f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34641494e0 0x7f346414f0f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3464071b40 tx=0x7f345400b820 comp rx=0 tx=0).stop 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 shutdown_connections 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f34641494e0 0x7f346414f0f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34641587d0 0x7f3464148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 --2- 172.21.15.44:0/3986443466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3448004810 0x7f34641f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 >> 172.21.15.44:0/3986443466 conn(0x7f346406ce40 msgr2=0x7f34641547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 shutdown_connections 2024-09-17T05:35:51.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f346a600640 1 -- 172.21.15.44:0/3986443466 wait complete. 2024-09-17T05:35:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7fe924a00640 1 -- 172.21.15.44:0/5508952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 msgr2=0x7fe92015eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0332f0 msgr2=0x7f307c0da7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 --2- 172.21.15.44:0/3731296803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0332f0 0x7f307c0da7e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f307001a4a0 tx=0x7f3070004040 comp rx=0 tx=0).stop 2024-09-17T05:35:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 shutdown_connections 2024-09-17T05:35:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 --2- 172.21.15.44:0/3731296803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f307c0e1920 0x7f307c0f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 --2- 172.21.15.44:0/3731296803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f307c0db5c0 0x7f307c0dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 --2- 172.21.15.44:0/3731296803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f307c0332f0 0x7f307c0da7e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 >> 172.21.15.44:0/3731296803 conn(0x7f307c01d9e0 msgr2=0x7f307c053c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f59b4a00640 1 -- 172.21.15.44:0/3753545479 wait complete. 2024-09-17T05:35:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f513ca00640 1 -- 172.21.15.44:0/1047222479 shutdown_connections 2024-09-17T05:35:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f513ca00640 1 --2- 172.21.15.44:0/1047222479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 0x7f5130051800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f513ca00640 1 --2- 172.21.15.44:0/1047222479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5130050420 0x7f5130050830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f513ca00640 1 -- 172.21.15.44:0/1047222479 >> 172.21.15.44:0/1047222479 conn(0x7f513001db80 msgr2=0x7f5130039840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 shutdown_connections 2024-09-17T05:35:51.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f59b4a00640 1 Processor -- start 2024-09-17T05:35:51.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.894+0000 7f59b4a00640 1 -- start start 2024-09-17T05:35:51.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59b4a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59a8006370 0x7f59a818a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7fe924a00640 1 --2- 172.21.15.44:0/5508952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015eec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe9200af970 tx=0x7fe90c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59b4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59a8033bc0 0x7f59a8054b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59b4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a80516f0 0x7f59a8180560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59a8006370 0x7f59a818a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59a8006370 0x7f59a818a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40868/0 (socket says 172.21.15.44:40868) 2024-09-17T05:35:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ade00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59a8033bc0 0x7f59a8054b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59b4a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59a80f0930 con 0x7f59a80516f0 2024-09-17T05:35:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59b4a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f59a80f0ab0 con 0x7f59a8033bc0 2024-09-17T05:35:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59b4a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f59a80f0c30 con 0x7f59a8006370 2024-09-17T05:35:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ade00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59a8033bc0 0x7f59a8054b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55548/0 (socket says 172.21.15.44:55548) 2024-09-17T05:35:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ade00640 1 -- 172.21.15.44:0/4222471397 learned_addr learned my addr 172.21.15.44:0/4222471397 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59af200640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a80516f0 0x7f59a8180560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 -- 172.21.15.44:0/4222471397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59a8033bc0 msgr2=0x7f59a8054b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59a8033bc0 0x7f59a8054b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 -- 172.21.15.44:0/4222471397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a80516f0 msgr2=0x7f59a8180560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a80516f0 0x7f59a8180560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 -- 172.21.15.44:0/4222471397 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8053ac0 con 0x7f59a8006370 2024-09-17T05:35:51.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59ae800640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59a8006370 0x7f59a818a7c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59b00668e0 tx=0x7f59b006a190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f3089200640 1 -- 172.21.15.44:0/3731296803 wait complete. 2024-09-17T05:35:51.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59a6a00640 1 -- 172.21.15.44:0/4222471397 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b006ade0 con 0x7f59a8006370 2024-09-17T05:35:51.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59a6a00640 1 -- 172.21.15.44:0/4222471397 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59b008f070 con 0x7f59a8006370 2024-09-17T05:35:51.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f59a6a00640 1 -- 172.21.15.44:0/4222471397 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0094470 con 0x7f59a8006370 2024-09-17T05:35:51.906 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a8053da0 con 0x7f59a8006370 2024-09-17T05:35:51.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.898+0000 7f513ca00640 1 -- 172.21.15.44:0/1047222479 shutdown_connections 2024-09-17T05:35:51.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a8054360 con 0x7f59a8006370 2024-09-17T05:35:51.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7f59a6a00640 1 -- 172.21.15.44:0/4222471397 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59b0074050 con 0x7f59a8006370 2024-09-17T05:35:51.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7f59a6a00640 1 -- 172.21.15.44:0/4222471397 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f59b009d8c0 con 0x7f59a8006370 2024-09-17T05:35:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7f513ca00640 1 -- 172.21.15.44:0/1047222479 wait complete. 2024-09-17T05:35:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7fe924a00640 1 -- 172.21.15.44:0/5508952 shutdown_connections 2024-09-17T05:35:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7fe924a00640 1 --2- 172.21.15.44:0/5508952 >> v2:172.21.15.86:3300/0 conn(0x7fe920160910 0x7fe920160d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7fe924a00640 1 --2- 172.21.15.44:0/5508952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015eec0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.902+0000 7fe924a00640 1 -- 172.21.15.44:0/5508952 >> 172.21.15.44:0/5508952 conn(0x7fe9200733f0 msgr2=0x7fe920073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.906+0000 7fe924a00640 1 -- 172.21.15.44:0/5508952 shutdown_connections 2024-09-17T05:35:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.906+0000 7fe924a00640 1 -- 172.21.15.44:0/5508952 wait complete. 2024-09-17T05:35:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f513ca00640 1 Processor -- start 2024-09-17T05:35:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a8032580 con 0x7f59a8006370 2024-09-17T05:35:51.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7fe924a00640 1 Processor -- start 2024-09-17T05:35:51.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f513ca00640 1 -- start start 2024-09-17T05:35:51.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f513ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5130034870 0x7f51300de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f513ca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5130050420 0x7f51300d6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f513ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 0x7f51300db870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f59a6a00640 1 -- 172.21.15.44:0/4222471397 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f59b00a2020 con 0x7f59a8006370 2024-09-17T05:35:51.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f5136a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5130050420 0x7f51300d6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.910+0000 7f5136a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5130050420 0x7f51300d6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40880/0 (socket says 172.21.15.44:40880) 2024-09-17T05:35:51.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.914+0000 7f5137400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5130034870 0x7f51300de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.914+0000 7f5137400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5130034870 0x7f51300de3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46000/0 (socket says 172.21.15.44:46000) 2024-09-17T05:35:51.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe924a00640 1 -- start start 2024-09-17T05:35:51.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f5136a00640 1 -- 172.21.15.44:0/2455574056 learned_addr learned my addr 172.21.15.44:0/2455574056 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f513004fb60 con 0x7f5130034870 2024-09-17T05:35:51.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f513004f9e0 con 0x7f51300513f0 2024-09-17T05:35:51.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f513004fce0 con 0x7f5130050420 2024-09-17T05:35:51.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513e000640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 0x7f51300db870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513e000640 1 -- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5130050420 msgr2=0x7f51300d6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513e000640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5130050420 0x7f51300d6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513e000640 1 -- 172.21.15.44:0/2455574056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5130034870 msgr2=0x7f51300de3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513e000640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5130034870 0x7f51300de3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513e000640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51300d7440 con 0x7f51300513f0 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513e000640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 0x7f51300db870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f51240ac000 tx=0x7f5124005df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f512b400640 1 -- 172.21.15.44:0/2455574056 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51240b2040 con 0x7f51300513f0 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f512b400640 1 -- 172.21.15.44:0/2455574056 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5124004250 con 0x7f51300513f0 2024-09-17T05:35:51.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f512b400640 1 -- 172.21.15.44:0/2455574056 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124005020 con 0x7f51300513f0 2024-09-17T05:35:51.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51300330e0 con 0x7f51300513f0 2024-09-17T05:35:51.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51300dea30 con 0x7f51300513f0 2024-09-17T05:35:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe924a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92006de50 0x7fe9201f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe924a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe924a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe920160910 0x7fe920208a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe91e800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92006de50 0x7fe9201f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe91e800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92006de50 0x7fe9201f8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40884/0 (socket says 172.21.15.44:40884) 2024-09-17T05:35:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f512b400640 1 -- 172.21.15.44:0/2455574056 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f51240a5800 con 0x7f51300513f0 2024-09-17T05:35:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7f512b400640 1 -- 172.21.15.44:0/2455574056 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5124004df0 con 0x7f51300513f0 2024-09-17T05:35:51.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe91de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.918+0000 7fe91de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46004/0 (socket says 172.21.15.44:46004) 2024-09-17T05:35:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51300d77a0 con 0x7f51300513f0 2024-09-17T05:35:51.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7f512b400640 1 -- 172.21.15.44:0/2455574056 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f51240164d0 con 0x7f51300513f0 2024-09-17T05:35:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe924a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe92016bc30 con 0x7fe92015eab0 2024-09-17T05:35:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe924a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe92016bab0 con 0x7fe920160910 2024-09-17T05:35:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe924a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe92016bdb0 con 0x7fe92006de50 2024-09-17T05:35:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91e800640 1 -- 172.21.15.44:0/2018003987 learned_addr learned my addr 172.21.15.44:0/2018003987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91f200640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe920160910 0x7fe920208a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91de00640 1 -- 172.21.15.44:0/2018003987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92006de50 msgr2=0x7fe9201f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91de00640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92006de50 0x7fe9201f8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91de00640 1 -- 172.21.15.44:0/2018003987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe920160910 msgr2=0x7fe920208a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91de00640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe920160910 0x7fe920208a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91de00640 1 -- 172.21.15.44:0/2018003987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9201588a0 con 0x7fe92015eab0 2024-09-17T05:35:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe91de00640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015ada0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0ac000 tx=0x7fe90c005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe916a00640 1 -- 172.21.15.44:0/2018003987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0b2040 con 0x7fe92015eab0 2024-09-17T05:35:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe916a00640 1 -- 172.21.15.44:0/2018003987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe90c005120 con 0x7fe92015eab0 2024-09-17T05:35:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.926+0000 7fe916a00640 1 -- 172.21.15.44:0/2018003987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0a5d70 con 0x7fe92015eab0 2024-09-17T05:35:51.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.938+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe920158b80 con 0x7fe92015eab0 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.938+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe920144370 con 0x7fe92015eab0 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92015eec0 con 0x7fe92015eab0 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 -- 172.21.15.44:0/292610764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b4200 msgr2=0x7fd49c073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd49b400640 1 -- 172.21.15.44:0/292610764 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4940b2070 con 0x7fd49c0b4200 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 --2- 172.21.15.44:0/292610764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b4200 0x7fd49c073270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd49c1631a0 tx=0x7fd49401c8a0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 -- 172.21.15.44:0/292610764 shutdown_connections 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 --2- 172.21.15.44:0/292610764 >> v2:172.21.15.86:3300/0 conn(0x7fd49c0b49f0 0x7fd49c0b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 --2- 172.21.15.44:0/292610764 >> v2:172.21.15.44:3300/0 conn(0x7fd49c0737b0 0x7fd49c155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 --2- 172.21.15.44:0/292610764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b4200 0x7fd49c073270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 -- 172.21.15.44:0/292610764 >> 172.21.15.44:0/292610764 conn(0x7fd49c0d0300 msgr2=0x7fd49c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 -- 172.21.15.44:0/292610764 shutdown_connections 2024-09-17T05:35:51.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.942+0000 7fd4a3800640 1 -- 172.21.15.44:0/292610764 wait complete. 2024-09-17T05:35:51.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.946+0000 7fe916a00640 1 -- 172.21.15.44:0/2018003987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe90c004a60 con 0x7fe92015eab0 2024-09-17T05:35:51.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.946+0000 7fe916a00640 1 -- 172.21.15.44:0/2018003987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe90c0ad440 con 0x7fe92015eab0 2024-09-17T05:35:51.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.946+0000 7fd4a3800640 1 Processor -- start 2024-09-17T05:35:51.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.946+0000 7fd4a3800640 1 -- start start 2024-09-17T05:35:51.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd4a3800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd49c0737b0 0x7fd49c14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd4a3800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c0b4200 0x7fd49c15a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd4a3800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b49f0 0x7fd49c15a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd4a3800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c162280 con 0x7fd49c0737b0 2024-09-17T05:35:51.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd4a3800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c162100 con 0x7fd49c0b4200 2024-09-17T05:35:51.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd4a3800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd49c162400 con 0x7fd49c0b49f0 2024-09-17T05:35:51.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd49be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c0b4200 0x7fd49c15a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd49be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c0b4200 0x7fd49c15a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55600/0 (socket says 172.21.15.44:55600) 2024-09-17T05:35:51.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd49be00640 1 -- 172.21.15.44:0/3885886549 learned_addr learned my addr 172.21.15.44:0/3885886549 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.950+0000 7fd4a1800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b49f0 0x7fd49c15a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.954+0000 7fd4a0e00640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd49c0737b0 0x7fd49c14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.954+0000 7fd4a1800640 1 -- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c0b4200 msgr2=0x7fd49c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.954+0000 7fd4a1800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c0b4200 0x7fd49c15a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.954+0000 7fd4a1800640 1 -- 172.21.15.44:0/3885886549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd49c0737b0 msgr2=0x7fd49c14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.954+0000 7fd4a1800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd49c0737b0 0x7fd49c14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.954+0000 7fd4a1800640 1 -- 172.21.15.44:0/3885886549 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c15d4b0 con 0x7fd49c0b49f0 2024-09-17T05:35:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.954+0000 7fd4a0e00640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd49c0737b0 0x7fd49c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:51.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.958+0000 7fd4a1800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b49f0 0x7fd49c15a9f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd48400e670 tx=0x7fd48400ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.958+0000 7fe916a00640 1 -- 172.21.15.44:0/2018003987 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe90c0164d0 con 0x7fe92015eab0 2024-09-17T05:35:51.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.958+0000 7fd498c00640 1 -- 172.21.15.44:0/3885886549 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484004220 con 0x7fd49c0b49f0 2024-09-17T05:35:51.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.958+0000 7fd498c00640 1 -- 172.21.15.44:0/3885886549 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd484005020 con 0x7fd49c0b49f0 2024-09-17T05:35:51.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.958+0000 7fd498c00640 1 -- 172.21.15.44:0/3885886549 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484005470 con 0x7fd49c0b49f0 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.966+0000 7f0960e00640 1 -- 172.21.15.44:0/663780051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 msgr2=0x7f09540e4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.966+0000 7f0960e00640 1 --2- 172.21.15.44:0/663780051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e4ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f095c06b4e0 tx=0x7f095c098950 comp rx=0 tx=0).stop 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.966+0000 7f0960e00640 1 -- 172.21.15.44:0/663780051 shutdown_connections 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.966+0000 7f0960e00640 1 --2- 172.21.15.44:0/663780051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e4ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.966+0000 7f0960e00640 1 --2- 172.21.15.44:0/663780051 >> v2:172.21.15.86:3300/0 conn(0x7f0954033ce0 0x7f0954035e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.966+0000 7f0960e00640 1 -- 172.21.15.44:0/663780051 >> 172.21.15.44:0/663780051 conn(0x7f095401db80 msgr2=0x7f0954039840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.962+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c15d790 con 0x7fd49c0b49f0 2024-09-17T05:35:51.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.962+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49c15dd50 con 0x7fd49c0b49f0 2024-09-17T05:35:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.962+0000 7fd498c00640 1 -- 172.21.15.44:0/3885886549 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd484004b40 con 0x7fd49c0b49f0 2024-09-17T05:35:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.962+0000 7fd498c00640 1 -- 172.21.15.44:0/3885886549 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd484003980 con 0x7fd49c0b49f0 2024-09-17T05:35:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.962+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd49c15d220 con 0x7fd49c0b49f0 2024-09-17T05:35:51.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.966+0000 7fd498c00640 1 -- 172.21.15.44:0/3885886549 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd484003b80 con 0x7fd49c0b49f0 2024-09-17T05:35:51.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.974+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f733c157860 con 0x7f733c06e490 2024-09-17T05:35:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.978+0000 7f0960e00640 1 -- 172.21.15.44:0/663780051 shutdown_connections 2024-09-17T05:35:51.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.978+0000 7f0960e00640 1 -- 172.21.15.44:0/663780051 wait complete. 2024-09-17T05:35:51.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.982+0000 7f0960e00640 1 Processor -- start 2024-09-17T05:35:51.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.982+0000 7f0960e00640 1 -- start start 2024-09-17T05:35:51.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f3f4ea00640 1 -- 172.21.15.44:0/617056604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 msgr2=0x7f3f4815a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f3f4ea00640 1 --2- 172.21.15.44:0/617056604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 0x7f3f4815a330 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3f340093a0 tx=0x7f3f34024c30 comp rx=0 tx=0).stop 2024-09-17T05:35:51.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0960e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0954005e30 0x7f0954047940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0960e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0954033ce0 0x7f09540d5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0960e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0959400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0954033ce0 0x7f09540d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40916/0 (socket says 172.21.15.44:40916) 2024-09-17T05:35:51.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0959400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0954033ce0 0x7f09540d5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:55632/0 (socket says 172.21.15.44:55632) 2024-09-17T05:35:51.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f3f4ea00640 1 -- 172.21.15.44:0/617056604 shutdown_connections 2024-09-17T05:35:51.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f3f4ea00640 1 --2- 172.21.15.44:0/617056604 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4806f050 0x7f3f4806f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f3f4ea00640 1 --2- 172.21.15.44:0/617056604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 0x7f3f4815a330 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f3f4ea00640 1 -- 172.21.15.44:0/617056604 >> 172.21.15.44:0/617056604 conn(0x7f3f4806ce40 msgr2=0x7f3f4806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0959e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0954005e30 0x7f0954047940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0959e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0954005e30 0x7f0954047940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46050/0 (socket says 172.21.15.44:46050) 2024-09-17T05:35:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0959e00640 1 -- 172.21.15.44:0/1651111389 learned_addr learned my addr 172.21.15.44:0/1651111389 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09540f0990 con 0x7f0954005e30 2024-09-17T05:35:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f09540f0810 con 0x7f0954033ce0 2024-09-17T05:35:51.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f09540f0b10 con 0x7f09540e4ac0 2024-09-17T05:35:51.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f3f4ea00640 1 -- 172.21.15.44:0/617056604 shutdown_connections 2024-09-17T05:35:51.995 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi044') 2024-09-17T05:35:51.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 -- 172.21.15.44:0/1651111389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0954033ce0 msgr2=0x7f09540d5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 --2- 172.21.15.44:0/1651111389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0954033ce0 0x7f09540d5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 -- 172.21.15.44:0/1651111389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0954005e30 msgr2=0x7f0954047940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 --2- 172.21.15.44:0/1651111389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0954005e30 0x7f0954047940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09541853a0 con 0x7f09540e4ac0 2024-09-17T05:35:51.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.986+0000 7f095b200640 1 --2- 172.21.15.44:0/1651111389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e1310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f095c052910 tx=0x7f095c121350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f3f4ea00640 1 -- 172.21.15.44:0/617056604 wait complete. 2024-09-17T05:35:51.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f732f400640 1 -- 172.21.15.44:0/272709202 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v12)=0 v12) ==== 106+0+0 (secure 0 0 0) 0x7f7334014070 con 0x7f733c06e490 2024-09-17T05:35:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0952000640 1 -- 172.21.15.44:0/1651111389 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c12e040 con 0x7f09540e4ac0 2024-09-17T05:35:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0952000640 1 -- 172.21.15.44:0/1651111389 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f095c129530 con 0x7f09540e4ac0 2024-09-17T05:35:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0952000640 1 -- 172.21.15.44:0/1651111389 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c12e040 con 0x7f09540e4ac0 2024-09-17T05:35:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0954185640 con 0x7f09540e4ac0 2024-09-17T05:35:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0954185c00 con 0x7f09540e4ac0 2024-09-17T05:35:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0952000640 1 -- 172.21.15.44:0/1651111389 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f095c139030 con 0x7f09540e4ac0 2024-09-17T05:35:51.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0952000640 1 -- 172.21.15.44:0/1651111389 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f095c132cb0 con 0x7f09540e4ac0 2024-09-17T05:35:51.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.990+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0954035e40 con 0x7f09540e4ac0 2024-09-17T05:35:52.000 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:51.994+0000 7f0952000640 1 -- 172.21.15.44:0/1651111389 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f095c140020 con 0x7f09540e4ac0 2024-09-17T05:35:52.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f733c06e490 msgr2=0x7f733c153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f733c06e490 0x7f733c153400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f733400c950 tx=0x7f733400ce10 comp rx=0 tx=0).stop 2024-09-17T05:35:52.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 Processor -- start 2024-09-17T05:35:52.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 -- start start 2024-09-17T05:35:52.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 shutdown_connections 2024-09-17T05:35:52.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f733c15b480 0x7f733c09b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f733c06f110 0x7f733c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 --2- 172.21.15.44:0/272709202 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f733c06e490 0x7f733c153400 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 >> 172.21.15.44:0/272709202 conn(0x7f733c0d0190 msgr2=0x7f733c0b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f4806f050 0x7f3f48151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 0x7f3f48151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 shutdown_connections 2024-09-17T05:35:52.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4815e930 0x7f3f480a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48167a80 con 0x7f3f4815d140 2024-09-17T05:35:52.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3f48167900 con 0x7f3f4806f050 2024-09-17T05:35:52.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f3f4ea00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3f48167c00 con 0x7f3f4815e930 2024-09-17T05:35:52.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.006+0000 7f7342000640 1 -- 172.21.15.44:0/272709202 wait complete. 2024-09-17T05:35:52.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4815e930 0x7f3f480a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4815e930 0x7f3f480a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:40930/0 (socket says 172.21.15.44:40930) 2024-09-17T05:35:52.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 -- 172.21.15.44:0/3316490213 learned_addr learned my addr 172.21.15.44:0/3316490213 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:52.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4cc00640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 0x7f3f48151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4d600640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f4806f050 0x7f3f48151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 -- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f4806f050 msgr2=0x7f3f48151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f4806f050 0x7f3f48151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 -- 172.21.15.44:0/3316490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 msgr2=0x7f3f48151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 0x7f3f48151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 -- 172.21.15.44:0/3316490213 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f48152b50 con 0x7f3f4815e930 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4e000640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4815e930 0x7f3f480a94a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a920 tx=0x7f3f3c00ade0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f45600640 1 -- 172.21.15.44:0/3316490213 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c019020 con 0x7f3f4815e930 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f45600640 1 -- 172.21.15.44:0/3316490213 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f3c007ca0 con 0x7f3f4815e930 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f45600640 1 -- 172.21.15.44:0/3316490213 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c005280 con 0x7f3f4815e930 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f48152e30 con 0x7f3f4815e930 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f480afb10 con 0x7f3f4815e930 2024-09-17T05:35:52.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f45600640 1 -- 172.21.15.44:0/3316490213 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f3c00c030 con 0x7f3f4815e930 2024-09-17T05:35:52.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.010+0000 7f3f45600640 1 -- 172.21.15.44:0/3316490213 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f3c01e990 con 0x7f3f4815e930 2024-09-17T05:35:52.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.018+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f480af120 con 0x7f3f4815e930 2024-09-17T05:35:52.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.018+0000 7f3f45600640 1 -- 172.21.15.44:0/3316490213 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3f3c023020 con 0x7f3f4815e930 2024-09-17T05:35:52.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.062+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f1864005860 con 0x7f188c152940 2024-09-17T05:35:52.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.074+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f69f80ce300 con 0x7f69f815f560 2024-09-17T05:35:52.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.074+0000 7fe7dcc00640 1 -- 172.21.15.44:0/1348402214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fe7e80adfc0 con 0x7fe7e81554b0 2024-09-17T05:35:52.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.074+0000 7f1888c00640 1 -- 172.21.15.44:0/1267413337 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v13)=0 v13) ==== 111+0+0 (secure 0 0 0) 0x7f1878020cd0 con 0x7f188c152940 2024-09-17T05:35:52.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.078+0000 7f4170c00640 1 -- 172.21.15.44:0/249537753 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4150005860 con 0x7f417c15b7f0 2024-09-17T05:35:52.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c152940 msgr2=0x7f188c0afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c152940 0x7f188c0afe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1878001980 tx=0x7f1878012740 comp rx=0 tx=0).stop 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 shutdown_connections 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188c152940 0x7f188c0afe90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f188c151ff0 0x7f188c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 --2- 172.21.15.44:0/1267413337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188c159a00 0x7f188c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 >> 172.21.15.44:0/1267413337 conn(0x7f188c06ce40 msgr2=0x7f188c073120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 shutdown_connections 2024-09-17T05:35:52.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f1891e00640 1 -- 172.21.15.44:0/1267413337 wait complete. 2024-09-17T05:35:52.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f69eea00640 1 -- 172.21.15.44:0/480389150 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f69e8016510 con 0x7f69f815f560 2024-09-17T05:35:52.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.082+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f59a8008b30 con 0x7f59a8006370 2024-09-17T05:35:52.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69f815f560 msgr2=0x7f69f81612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69f815f560 0x7f69f81612b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f69e80ac000 tx=0x7f69e8005770 comp rx=0 tx=0).stop 2024-09-17T05:35:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 shutdown_connections 2024-09-17T05:35:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69f815f560 0x7f69f81612b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69f8155090 0x7f69f814e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 --2- 172.21.15.44:0/480389150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69f806de50 0x7f69f814b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 >> 172.21.15.44:0/480389150 conn(0x7f69f80700b0 msgr2=0x7f69f8068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 shutdown_connections 2024-09-17T05:35:52.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.090+0000 7f69f7e00640 1 -- 172.21.15.44:0/480389150 wait complete. 2024-09-17T05:35:52.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.094+0000 7fe7df400640 1 -- 172.21.15.44:0/1348402214 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fe7d40ad440 con 0x7fe7e81554b0 2024-09-17T05:35:52.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fb9e80b42b0 con 0x7fb9e81604b0 2024-09-17T05:35:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 -- 172.21.15.44:0/1348402214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7e81554b0 msgr2=0x7fe7e815b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7e81554b0 0x7fe7e815b7d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7d401a2c0 tx=0x7fe7d40056e0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 -- 172.21.15.44:0/1348402214 shutdown_connections 2024-09-17T05:35:52.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7e813fd80 0x7fe7e815fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7e8162660 0x7fe7e8141b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 --2- 172.21.15.44:0/1348402214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7e81554b0 0x7fe7e815b7d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 -- 172.21.15.44:0/1348402214 >> 172.21.15.44:0/1348402214 conn(0x7fe7e806ce40 msgr2=0x7fe7e815f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 -- 172.21.15.44:0/1348402214 shutdown_connections 2024-09-17T05:35:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.098+0000 7fe7dcc00640 1 -- 172.21.15.44:0/1348402214 wait complete. 2024-09-17T05:35:52.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.110+0000 7f4173400640 1 -- 172.21.15.44:0/249537753 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f4174014a30 con 0x7f417c15b7f0 2024-09-17T05:35:52.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.118+0000 7f4170c00640 1 -- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f417c15b7f0 msgr2=0x7f417c1452d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.118+0000 7f4170c00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f417c15b7f0 0x7f417c1452d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f417400bdf0 tx=0x7f4174009ef0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.122+0000 7f4170c00640 1 -- 172.21.15.44:0/249537753 shutdown_connections 2024-09-17T05:35:52.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.122+0000 7f4170c00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f417c15b7f0 0x7f417c1452d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.122+0000 7f4170c00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f417c073020 0x7f417c1428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.122+0000 7f4170c00640 1 --2- 172.21.15.44:0/249537753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f417c072c10 0x7f417c14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.122+0000 7f4170c00640 1 -- 172.21.15.44:0/249537753 >> 172.21.15.44:0/249537753 conn(0x7f417c06ce40 msgr2=0x7f417c0ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59a6a00640 1 -- 172.21.15.44:0/4222471397 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7f59b009db10 con 0x7f59a8006370 2024-09-17T05:35:52.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f4170c00640 1 -- 172.21.15.44:0/249537753 shutdown_connections 2024-09-17T05:35:52.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f4170c00640 1 -- 172.21.15.44:0/249537753 wait complete. 2024-09-17T05:35:52.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7fb9de000640 1 -- 172.21.15.44:0/4212420713 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v18)=0 v18) ==== 119+0+0 (secure 0 0 0) 0x7fb9d80bea40 con 0x7fb9e81604b0 2024-09-17T05:35:52.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59a8006370 msgr2=0x7f59a818a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59a8006370 0x7f59a818a7c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f59b00668e0 tx=0x7f59b006a190 comp rx=0 tx=0).stop 2024-09-17T05:35:52.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 shutdown_connections 2024-09-17T05:35:52.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59a80516f0 0x7f59a8180560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59a8033bc0 0x7f59a8054b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 --2- 172.21.15.44:0/4222471397 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59a8006370 0x7f59a818a7c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 >> 172.21.15.44:0/4222471397 conn(0x7f59a801d9b0 msgr2=0x7f59a8032f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 shutdown_connections 2024-09-17T05:35:52.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.126+0000 7f59b4a00640 1 -- 172.21.15.44:0/4222471397 wait complete. 2024-09-17T05:35:52.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.130+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e81604b0 msgr2=0x7fb9e813ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.130+0000 7fb9e7200640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e81604b0 0x7fb9e813ed90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb9d80ac000 tx=0x7fb9d80056e0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.130+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 shutdown_connections 2024-09-17T05:35:52.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.130+0000 7fb9e7200640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9e81604b0 0x7fb9e813ed90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.130+0000 7fb9e7200640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e80717a0 0x7fb9e813e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.130+0000 7fb9e7200640 1 --2- 172.21.15.44:0/4212420713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9e8071390 0x7fb9e81fa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.130+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 >> 172.21.15.44:0/4212420713 conn(0x7fb9e80cda70 msgr2=0x7fb9e80b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.134+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 shutdown_connections 2024-09-17T05:35:52.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.134+0000 7fb9e7200640 1 -- 172.21.15.44:0/4212420713 wait complete. 2024-09-17T05:35:52.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.150+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5130033600 con 0x7f51300513f0 2024-09-17T05:35:52.161 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.162+0000 7f512b400640 1 -- 172.21.15.44:0/2455574056 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f5130033600 con 0x7f51300513f0 2024-09-17T05:35:52.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 msgr2=0x7f51300db870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 0x7f51300db870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f51240ac000 tx=0x7f5124005df0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 shutdown_connections 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51300513f0 0x7f51300db870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5130050420 0x7f51300d6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 --2- 172.21.15.44:0/2455574056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5130034870 0x7f51300de3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 >> 172.21.15.44:0/2455574056 conn(0x7f513001db80 msgr2=0x7f51300dd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 shutdown_connections 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7f513ca00640 1 -- 172.21.15.44:0/2455574056 wait complete. 2024-09-17T05:35:52.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.166+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe920074160 con 0x7fe92015eab0 2024-09-17T05:35:52.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.170+0000 7fe916a00640 1 -- 172.21.15.44:0/2018003987 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v20)=0 v20) ==== 120+0+0 (secure 0 0 0) 0x7fe90c003600 con 0x7fe92015eab0 2024-09-17T05:35:52.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 msgr2=0x7fe92015ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015ada0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0ac000 tx=0x7fe90c005e90 comp rx=0 tx=0).stop 2024-09-17T05:35:52.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fd49c155bf0 con 0x7fd49c0b49f0 2024-09-17T05:35:52.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 shutdown_connections 2024-09-17T05:35:52.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe920160910 0x7fe920208a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe92015eab0 0x7fe92015ada0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 --2- 172.21.15.44:0/2018003987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe92006de50 0x7fe9201f8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 >> 172.21.15.44:0/2018003987 conn(0x7fe9200733f0 msgr2=0x7fe920068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 shutdown_connections 2024-09-17T05:35:52.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.178+0000 7fe924a00640 1 -- 172.21.15.44:0/2018003987 wait complete. 2024-09-17T05:35:52.189 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.189 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f3f4806f460 con 0x7f3f4815e930 2024-09-17T05:35:52.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd498c00640 1 -- 172.21.15.44:0/3885886549 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fd484003d60 con 0x7fd49c0b49f0 2024-09-17T05:35:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b49f0 msgr2=0x7fd49c15a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b49f0 0x7fd49c15a9f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd48400e670 tx=0x7fd48400ea70 comp rx=0 tx=0).stop 2024-09-17T05:35:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 shutdown_connections 2024-09-17T05:35:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd49c0b49f0 0x7fd49c15a9f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c0b4200 0x7fd49c15a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 --2- 172.21.15.44:0/3885886549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd49c0737b0 0x7fd49c14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 >> 172.21.15.44:0/3885886549 conn(0x7fd49c0d0300 msgr2=0x7fd49c15fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.186+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 shutdown_connections 2024-09-17T05:35:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.190+0000 7fd4a3800640 1 -- 172.21.15.44:0/3885886549 wait complete. 2024-09-17T05:35:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.190+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f095403a830 con 0x7f09540e4ac0 2024-09-17T05:35:52.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.190+0000 7f3f45600640 1 -- 172.21.15.44:0/3316490213 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v22)=0 v22) ==== 125+0+0 (secure 0 0 0) 0x7f3f3c01eb90 con 0x7f3f4815e930 2024-09-17T05:35:52.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4815e930 msgr2=0x7f3f480a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4815e930 0x7f3f480a94a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a920 tx=0x7f3f3c00ade0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 shutdown_connections 2024-09-17T05:35:52.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f4815e930 0x7f3f480a94a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f4815d140 0x7f3f48151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 --2- 172.21.15.44:0/3316490213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f4806f050 0x7f3f48151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 >> 172.21.15.44:0/3316490213 conn(0x7f3f4806ce40 msgr2=0x7f3f48154660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 shutdown_connections 2024-09-17T05:35:52.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.194+0000 7f3f4ea00640 1 -- 172.21.15.44:0/3316490213 wait complete. 2024-09-17T05:35:52.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.198+0000 7f0952000640 1 -- 172.21.15.44:0/1651111389 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v23)=0 v23) ==== 108+0+0 (secure 0 0 0) 0x7f095c092670 con 0x7f09540e4ac0 2024-09-17T05:35:52.206 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.198+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 msgr2=0x7f09540e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.198+0000 7f0960e00640 1 --2- 172.21.15.44:0/1651111389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e1310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f095c052910 tx=0x7f095c121350 comp rx=0 tx=0).stop 2024-09-17T05:35:52.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.202+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 shutdown_connections 2024-09-17T05:35:52.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.202+0000 7f0960e00640 1 --2- 172.21.15.44:0/1651111389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f09540e4ac0 0x7f09540e1310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.202+0000 7f0960e00640 1 --2- 172.21.15.44:0/1651111389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0954033ce0 0x7f09540d5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.202+0000 7f0960e00640 1 --2- 172.21.15.44:0/1651111389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0954005e30 0x7f0954047940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.202+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 >> 172.21.15.44:0/1651111389 conn(0x7f095401db80 msgr2=0x7f09540d9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.202+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 shutdown_connections 2024-09-17T05:35:52.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.202+0000 7f0960e00640 1 -- 172.21.15.44:0/1651111389 wait complete. 2024-09-17T05:35:52.215 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.215 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.215 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.233 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.233 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.233 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.233 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi044') 2024-09-17T05:35:52.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config dump 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 -- 172.21.15.44:0/3559557165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40d1d00 msgr2=0x7ff0d40cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 --2- 172.21.15.44:0/3559557165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40d1d00 0x7ff0d40cf070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009930 tx=0x7ff0bc01c820 comp rx=0 tx=0).stop 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 -- 172.21.15.44:0/3559557165 shutdown_connections 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 --2- 172.21.15.44:0/3559557165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0d40cf5b0 0x7ff0d415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 --2- 172.21.15.44:0/3559557165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40d1d00 0x7ff0d40cf070 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 -- 172.21.15.44:0/3559557165 >> 172.21.15.44:0/3559557165 conn(0x7ff0d40b4240 msgr2=0x7ff0d40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 -- 172.21.15.44:0/3559557165 shutdown_connections 2024-09-17T05:35:52.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.430+0000 7ff0db200640 1 -- 172.21.15.44:0/3559557165 wait complete. 2024-09-17T05:35:52.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 Processor -- start 2024-09-17T05:35:52.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 -- start start 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40cf5b0 0x7ff0d41f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d40d18f0 0x7ff0d4159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0d40d1d00 0x7ff0d415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d4169e80 con 0x7ff0d40d18f0 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d4169d00 con 0x7ff0d40cf5b0 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0db200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d416a000 con 0x7ff0d40d1d00 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d40d18f0 0x7ff0d4159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d40d18f0 0x7ff0d4159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46068/0 (socket says 172.21.15.44:46068) 2024-09-17T05:35:52.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 -- 172.21.15.44:0/2190977514 learned_addr learned my addr 172.21.15.44:0/2190977514 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0d9200640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0d40d1d00 0x7ff0d415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0d3e00640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40cf5b0 0x7ff0d41f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 -- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0d40d1d00 msgr2=0x7ff0d415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0d40d1d00 0x7ff0d415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 -- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40cf5b0 msgr2=0x7ff0d41f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40cf5b0 0x7ff0d41f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 -- 172.21.15.44:0/2190977514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40b7ef0 con 0x7ff0d40d18f0 2024-09-17T05:35:52.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0cbe00640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d40d18f0 0x7ff0d4159420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0b0040 tx=0x7ff0bc0a5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:52.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0d0c00640 1 -- 172.21.15.44:0/2190977514 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0b2040 con 0x7ff0d40d18f0 2024-09-17T05:35:52.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.434+0000 7ff0d0c00640 1 -- 172.21.15.44:0/2190977514 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0bc0043d0 con 0x7ff0d40d18f0 2024-09-17T05:35:52.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.438+0000 7ff0d0c00640 1 -- 172.21.15.44:0/2190977514 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc003860 con 0x7ff0d40d18f0 2024-09-17T05:35:52.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.438+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d40b7650 con 0x7ff0d40d18f0 2024-09-17T05:35:52.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.438+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d40b7c10 con 0x7ff0d40d18f0 2024-09-17T05:35:52.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.438+0000 7ff0d0c00640 1 -- 172.21.15.44:0/2190977514 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff0bc0bf060 con 0x7ff0d40d18f0 2024-09-17T05:35:52.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.438+0000 7ff0d0c00640 1 -- 172.21.15.44:0/2190977514 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff0bc0b8430 con 0x7ff0d40d18f0 2024-09-17T05:35:52.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.438+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d415d060 con 0x7ff0d40d18f0 2024-09-17T05:35:52.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.438+0000 7ff0d0c00640 1 -- 172.21.15.44:0/2190977514 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff0bc0164d0 con 0x7ff0d40d18f0 2024-09-17T05:35:52.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff0d414fd50 con 0x7ff0d40d18f0 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0d0c00640 1 -- 172.21.15.44:0/2190977514 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7ff0bc0ad440 con 0x7ff0d40d18f0 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:35:52.507 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:35:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:35:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:35:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:35:52.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d40d18f0 msgr2=0x7ff0d4159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d40d18f0 0x7ff0d4159420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0b0040 tx=0x7ff0bc0a5760 comp rx=0 tx=0).stop 2024-09-17T05:35:52.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 shutdown_connections 2024-09-17T05:35:52.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0d40d1d00 0x7ff0d415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d40d18f0 0x7ff0d4159420 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 --2- 172.21.15.44:0/2190977514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d40cf5b0 0x7ff0d41f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 >> 172.21.15.44:0/2190977514 conn(0x7ff0d40b4240 msgr2=0x7ff0d41527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 shutdown_connections 2024-09-17T05:35:52.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.502+0000 7ff0db200640 1 -- 172.21.15.44:0/2190977514 wait complete. 2024-09-17T05:35:52.527 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T05:35:52.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 -- 172.21.15.44:0/2223126622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac073050 msgr2=0x7f18ac160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 --2- 172.21.15.44:0/2223126622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac073050 0x7f18ac160160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18ac1444a0 tx=0x7f18a401cb50 comp rx=0 tx=0).stop 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 -- 172.21.15.44:0/2223126622 shutdown_connections 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 --2- 172.21.15.44:0/2223126622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac073050 0x7f18ac160160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 --2- 172.21.15.44:0/2223126622 >> v2:172.21.15.86:3300/0 conn(0x7f18ac0ccf00 0x7f18ac072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 -- 172.21.15.44:0/2223126622 >> 172.21.15.44:0/2223126622 conn(0x7f18ac0d2450 msgr2=0x7f18ac0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 -- 172.21.15.44:0/2223126622 shutdown_connections 2024-09-17T05:35:52.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 -- 172.21.15.44:0/2223126622 wait complete. 2024-09-17T05:35:52.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 Processor -- start 2024-09-17T05:35:52.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.682+0000 7f18b2200640 1 -- start start 2024-09-17T05:35:52.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18ac073050 0x7f18ac0b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac156b90 0x7f18ac0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18ac0c5490 0x7f18ac1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac0d0940 con 0x7f18ac156b90 2024-09-17T05:35:52.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac0d07c0 con 0x7f18ac0c5490 2024-09-17T05:35:52.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac0d0ac0 con 0x7f18ac073050 2024-09-17T05:35:52.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac156b90 0x7f18ac0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b0e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18ac073050 0x7f18ac0b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac156b90 0x7f18ac0b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46084/0 (socket says 172.21.15.44:46084) 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18abe00640 1 -- 172.21.15.44:0/2019950233 learned_addr learned my addr 172.21.15.44:0/2019950233 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b1800640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18ac0c5490 0x7f18ac1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b0e00640 1 -- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18ac0c5490 msgr2=0x7f18ac1445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b0e00640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18ac0c5490 0x7f18ac1445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b0e00640 1 -- 172.21.15.44:0/2019950233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac156b90 msgr2=0x7f18ac0b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b0e00640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac156b90 0x7f18ac0b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b0e00640 1 -- 172.21.15.44:0/2019950233 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac0b7090 con 0x7f18ac073050 2024-09-17T05:35:52.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b0e00640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18ac073050 0x7f18ac0b51f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c3c0 tx=0x7f18a000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:52.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18a8c00640 1 -- 172.21.15.44:0/2019950233 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0017070 con 0x7f18ac073050 2024-09-17T05:35:52.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18a8c00640 1 -- 172.21.15.44:0/2019950233 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18a0003600 con 0x7f18ac073050 2024-09-17T05:35:52.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ac0b7360 con 0x7f18ac073050 2024-09-17T05:35:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18a8c00640 1 -- 172.21.15.44:0/2019950233 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0003a90 con 0x7f18ac073050 2024-09-17T05:35:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ac0b7920 con 0x7f18ac073050 2024-09-17T05:35:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18a8c00640 1 -- 172.21.15.44:0/2019950233 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f18a001a070 con 0x7f18ac073050 2024-09-17T05:35:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18a8c00640 1 -- 172.21.15.44:0/2019950233 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f18a0012740 con 0x7f18ac073050 2024-09-17T05:35:52.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.686+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ac160160 con 0x7f18ac073050 2024-09-17T05:35:52.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.690+0000 7f18a8c00640 1 -- 172.21.15.44:0/2019950233 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f18a0021020 con 0x7f18ac073050 2024-09-17T05:35:52.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.754+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f18ac0b1840 con 0x7f18ac073050 2024-09-17T05:35:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18a8c00640 1 -- 172.21.15.44:0/2019950233 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f18ac073460 con 0x7f18ac073050 2024-09-17T05:35:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18ac073050 msgr2=0x7f18ac0b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18ac073050 0x7f18ac0b51f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c3c0 tx=0x7f18a000c880 comp rx=0 tx=0).stop 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 shutdown_connections 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18ac0c5490 0x7f18ac1445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18ac156b90 0x7f18ac0b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 --2- 172.21.15.44:0/2019950233 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18ac073050 0x7f18ac0b51f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 >> 172.21.15.44:0/2019950233 conn(0x7f18ac0d2450 msgr2=0x7f18ac0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 shutdown_connections 2024-09-17T05:35:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:52.762+0000 7f18b2200640 1 -- 172.21.15.44:0/2019950233 wait complete. 2024-09-17T05:35:52.786 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T05:35:52.786 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T05:35:52.786 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:52.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T05:35:52.806 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:52.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T05:35:52.868 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:52.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T05:35:52.928 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:35:52.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T05:35:52.993 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:52.993 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T05:35:53.013 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:53.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T05:35:53.077 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:53.077 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T05:35:53.137 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:35:53.137 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T05:35:53.196 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 1a54c4a7-e50f-40b6-bd16-d382f349afe1 0 2024-09-17T05:35:53.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 -- 172.21.15.86:0/2643099035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080cf5b0 msgr2=0x7fac0815d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.389 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 --2- 172.21.15.86:0/2643099035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080cf5b0 0x7fac0815d060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac080d2110 tx=0x7fac0001cae0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 -- 172.21.15.86:0/2643099035 shutdown_connections 2024-09-17T05:35:53.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 --2- 172.21.15.86:0/2643099035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080cf5b0 0x7fac0815d060 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 --2- 172.21.15.86:0/2643099035 >> v2:172.21.15.44:3300/0 conn(0x7fac080d1d00 0x7fac080cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 -- 172.21.15.86:0/2643099035 >> 172.21.15.86:0/2643099035 conn(0x7fac080b4240 msgr2=0x7fac080b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:53.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 -- 172.21.15.86:0/2643099035 shutdown_connections 2024-09-17T05:35:53.390 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.386+0000 7fac0f400640 1 -- 172.21.15.86:0/2643099035 wait complete. 2024-09-17T05:35:53.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 Processor -- start 2024-09-17T05:35:53.391 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 -- start start 2024-09-17T05:35:53.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac080cf5b0 0x7fac0806f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080d18f0 0x7fac080cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.396 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac080d1d00 0x7fac08151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fac08169e80 con 0x7fac080cf5b0 2024-09-17T05:35:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fac08169d00 con 0x7fac080d18f0 2024-09-17T05:35:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0f400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fac0816a000 con 0x7fac080d1d00 2024-09-17T05:35:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac07e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080d18f0 0x7fac080cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0d400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac080d1d00 0x7fac08151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.397 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac07e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080d18f0 0x7fac080cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35344/0 (socket says 172.21.15.86:35344) 2024-09-17T05:35:53.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac080cf5b0 0x7fac0806f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac07e00640 1 -- 172.21.15.86:0/764680057 learned_addr learned my addr 172.21.15.86:0/764680057 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:53.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0d400640 1 -- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080d18f0 msgr2=0x7fac080cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0d400640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080d18f0 0x7fac080cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0d400640 1 -- 172.21.15.86:0/764680057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac080cf5b0 msgr2=0x7fac0806f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.398 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0d400640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac080cf5b0 0x7fac0806f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac0d400640 1 -- 172.21.15.86:0/764680057 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0806fcc0 con 0x7fac080d1d00 2024-09-17T05:35:53.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.390+0000 7fac07e00640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080d18f0 0x7fac080cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:53.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac0d400640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac080d1d00 0x7fac08151d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac0815cce0 tx=0x7fac00009350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:53.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac04c00640 1 -- 172.21.15.86:0/764680057 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac000b2040 con 0x7fac080d1d00 2024-09-17T05:35:53.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac04c00640 1 -- 172.21.15.86:0/764680057 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac00004d40 con 0x7fac080d1d00 2024-09-17T05:35:53.399 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac080cc140 con 0x7fac080d1d00 2024-09-17T05:35:53.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac04c00640 1 -- 172.21.15.86:0/764680057 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00004220 con 0x7fac080d1d00 2024-09-17T05:35:53.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac08165990 con 0x7fac080d1d00 2024-09-17T05:35:53.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac04c00640 1 -- 172.21.15.86:0/764680057 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac000043c0 con 0x7fac080d1d00 2024-09-17T05:35:53.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac04c00640 1 -- 172.21.15.86:0/764680057 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fac00005410 con 0x7fac080d1d00 2024-09-17T05:35:53.400 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0815d060 con 0x7fac080d1d00 2024-09-17T05:35:53.401 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.394+0000 7fac04c00640 1 -- 172.21.15.86:0/764680057 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fac080cf9c0 con 0x7fac080d1d00 2024-09-17T05:35:53.467 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.466+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1a54c4a7-e50f-40b6-bd16-d382f349afe1", "id": 0} v 0) -- 0x7fac0806fef0 con 0x7fac080d1d00 2024-09-17T05:35:53.474 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac04c00640 1 -- 172.21.15.86:0/764680057 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a54c4a7-e50f-40b6-bd16-d382f349afe1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fac00004f30 con 0x7fac080d1d00 2024-09-17T05:35:53.474 INFO:teuthology.orchestra.run.smithi086.stdout:0 2024-09-17T05:35:53.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac080d1d00 msgr2=0x7fac08151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac080d1d00 0x7fac08151d90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac0815cce0 tx=0x7fac00009350 comp rx=0 tx=0).stop 2024-09-17T05:35:53.475 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 shutdown_connections 2024-09-17T05:35:53.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fac080d1d00 0x7fac08151d90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac080d18f0 0x7fac080cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 --2- 172.21.15.86:0/764680057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fac080cf5b0 0x7fac0806f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 >> 172.21.15.86:0/764680057 conn(0x7fac080b4240 msgr2=0x7fac0815a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:53.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 shutdown_connections 2024-09-17T05:35:53.476 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.474+0000 7fac0f400640 1 -- 172.21.15.86:0/764680057 wait complete. 2024-09-17T05:35:53.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 611ed68f-3dbd-4357-a544-abeab82adcc4 1 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 -- 172.21.15.86:0/3682021855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c0ce300 msgr2=0x7ff29c167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 --2- 172.21.15.86:0/3682021855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c0ce300 0x7ff29c167120 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff29c09e100 tx=0x7ff29401cd80 comp rx=0 tx=0).stop 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 -- 172.21.15.86:0/3682021855 shutdown_connections 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 --2- 172.21.15.86:0/3682021855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c0ce300 0x7ff29c167120 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 --2- 172.21.15.86:0/3682021855 >> v2:172.21.15.44:3300/0 conn(0x7ff29c0b5880 0x7ff29c06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 -- 172.21.15.86:0/3682021855 >> 172.21.15.86:0/3682021855 conn(0x7ff29c0ccaa0 msgr2=0x7ff29c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 -- 172.21.15.86:0/3682021855 shutdown_connections 2024-09-17T05:35:53.646 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.642+0000 7ff2a1200640 1 -- 172.21.15.86:0/3682021855 wait complete. 2024-09-17T05:35:53.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 Processor -- start 2024-09-17T05:35:53.648 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 -- start start 2024-09-17T05:35:53.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c06e390 0x7ff29c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29c0b5880 0x7ff29c09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.650 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff29c0ce300 0x7ff29c0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c16a000 con 0x7ff29c0b5880 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c169e80 con 0x7ff29c06e390 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff2a1200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff29c16a180 con 0x7ff29c0ce300 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff299e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c06e390 0x7ff29c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff299e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c06e390 0x7ff29c155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35364/0 (socket says 172.21.15.86:35364) 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff299e00640 1 -- 172.21.15.86:0/1165647656 learned_addr learned my addr 172.21.15.86:0/1165647656 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff29a800640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff29c0ce300 0x7ff29c0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.646+0000 7ff291400640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29c0b5880 0x7ff29c09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff299e00640 1 -- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff29c0ce300 msgr2=0x7ff29c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff299e00640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff29c0ce300 0x7ff29c0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff299e00640 1 -- 172.21.15.86:0/1165647656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29c0b5880 msgr2=0x7ff29c09c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff299e00640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29c0b5880 0x7ff29c09c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff299e00640 1 -- 172.21.15.86:0/1165647656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c09e300 con 0x7ff29c06e390 2024-09-17T05:35:53.651 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff29a800640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff29c0ce300 0x7ff29c0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:53.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff299e00640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c06e390 0x7ff29c155cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e7d0 tx=0x7ff28c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:53.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff292a00640 1 -- 172.21.15.86:0/1165647656 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00ccc0 con 0x7ff29c06e390 2024-09-17T05:35:53.652 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff292a00640 1 -- 172.21.15.86:0/1165647656 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff28c010430 con 0x7ff29c06e390 2024-09-17T05:35:53.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c09e5e0 con 0x7ff29c06e390 2024-09-17T05:35:53.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff292a00640 1 -- 172.21.15.86:0/1165647656 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c010860 con 0x7ff29c06e390 2024-09-17T05:35:53.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29c156df0 con 0x7ff29c06e390 2024-09-17T05:35:53.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff292a00640 1 -- 172.21.15.86:0/1165647656 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff28c010a00 con 0x7ff29c06e390 2024-09-17T05:35:53.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff292a00640 1 -- 172.21.15.86:0/1165647656 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff28c0213f0 con 0x7ff29c06e390 2024-09-17T05:35:53.653 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.650+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29c09cf30 con 0x7ff29c06e390 2024-09-17T05:35:53.654 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.654+0000 7ff292a00640 1 -- 172.21.15.86:0/1165647656 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff28c018420 con 0x7ff29c06e390 2024-09-17T05:35:53.725 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.722+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "611ed68f-3dbd-4357-a544-abeab82adcc4", "id": 1} v 0) -- 0x7ff29c06de50 con 0x7ff29c06e390 2024-09-17T05:35:53.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.726+0000 7ff292a00640 1 -- 172.21.15.86:0/1165647656 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "611ed68f-3dbd-4357-a544-abeab82adcc4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff28c010de0 con 0x7ff29c06e390 2024-09-17T05:35:53.730 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-17T05:35:53.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c06e390 msgr2=0x7ff29c155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c06e390 0x7ff29c155cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e7d0 tx=0x7ff28c00ec90 comp rx=0 tx=0).stop 2024-09-17T05:35:53.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 shutdown_connections 2024-09-17T05:35:53.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff29c0ce300 0x7ff29c0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff29c0b5880 0x7ff29c09c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 --2- 172.21.15.86:0/1165647656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff29c06e390 0x7ff29c155cb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 >> 172.21.15.86:0/1165647656 conn(0x7ff29c0ccaa0 msgr2=0x7ff29c15bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:53.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 shutdown_connections 2024-09-17T05:35:53.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.730+0000 7ff2a1200640 1 -- 172.21.15.86:0/1165647656 wait complete. 2024-09-17T05:35:53.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new cceafb1a-8d0e-469f-81a6-33930e8c3821 2 2024-09-17T05:35:53.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 -- 172.21.15.86:0/2165640915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0d1d00 msgr2=0x7fd91c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 --2- 172.21.15.86:0/2165640915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0d1d00 0x7fd91c0cf070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0744e0 tx=0x7fd90c01c800 comp rx=0 tx=0).stop 2024-09-17T05:35:53.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 -- 172.21.15.86:0/2165640915 shutdown_connections 2024-09-17T05:35:53.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 --2- 172.21.15.86:0/2165640915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0d1d00 0x7fd91c0cf070 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 --2- 172.21.15.86:0/2165640915 >> v2:172.21.15.44:3300/0 conn(0x7fd91c0d18f0 0x7fd91c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.936 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 -- 172.21.15.86:0/2165640915 >> 172.21.15.86:0/2165640915 conn(0x7fd91c0b4240 msgr2=0x7fd91c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:53.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 -- 172.21.15.86:0/2165640915 shutdown_connections 2024-09-17T05:35:53.937 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 -- 172.21.15.86:0/2165640915 wait complete. 2024-09-17T05:35:53.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.934+0000 7fd924800640 1 Processor -- start 2024-09-17T05:35:53.938 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 -- start start 2024-09-17T05:35:53.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0cf5b0 0x7fd91c0b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91c0d18f0 0x7fd91c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd91c0d1d00 0x7fd91c1fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c169e80 con 0x7fd91c0d18f0 2024-09-17T05:35:53.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c169d00 con 0x7fd91c0cf5b0 2024-09-17T05:35:53.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd91c16a000 con 0x7fd91c0d1d00 2024-09-17T05:35:53.941 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd921e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0cf5b0 0x7fd91c0b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd922800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd91c0d1d00 0x7fd91c1fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd921e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0cf5b0 0x7fd91c0b76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35388/0 (socket says 172.21.15.86:35388) 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd921e00640 1 -- 172.21.15.86:0/2298893273 learned_addr learned my addr 172.21.15.86:0/2298893273 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd921400640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91c0d18f0 0x7fd91c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd922800640 1 -- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0cf5b0 msgr2=0x7fd91c0b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd922800640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0cf5b0 0x7fd91c0b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd922800640 1 -- 172.21.15.86:0/2298893273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91c0d18f0 msgr2=0x7fd91c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd922800640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91c0d18f0 0x7fd91c15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd922800640 1 -- 172.21.15.86:0/2298893273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c13f2c0 con 0x7fd91c0d1d00 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd921e00640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0cf5b0 0x7fd91c0b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd922800640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd91c0d1d00 0x7fd91c1fc9d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c700 tx=0x7fd91800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd916000640 1 -- 172.21.15.86:0/2298893273 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918003b80 con 0x7fd91c0d1d00 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd916000640 1 -- 172.21.15.86:0/2298893273 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd918003d20 con 0x7fd91c0d1d00 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91c13f5a0 con 0x7fd91c0d1d00 2024-09-17T05:35:53.942 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd916000640 1 -- 172.21.15.86:0/2298893273 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918005330 con 0x7fd91c0d1d00 2024-09-17T05:35:53.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91c13fb60 con 0x7fd91c0d1d00 2024-09-17T05:35:53.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd916000640 1 -- 172.21.15.86:0/2298893273 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd9180054d0 con 0x7fd91c0d1d00 2024-09-17T05:35:53.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd916000640 1 -- 172.21.15.86:0/2298893273 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fd9180057c0 con 0x7fd91c0d1d00 2024-09-17T05:35:53.943 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.938+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91c0b1be0 con 0x7fd91c0d1d00 2024-09-17T05:35:53.944 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:53.942+0000 7fd916000640 1 -- 172.21.15.86:0/2298893273 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd91c0cf9c0 con 0x7fd91c0d1d00 2024-09-17T05:35:54.015 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.014+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cceafb1a-8d0e-469f-81a6-33930e8c3821", "id": 2} v 0) -- 0x7fd91c0cf1d0 con 0x7fd91c0d1d00 2024-09-17T05:35:54.021 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.018+0000 7fd916000640 1 -- 172.21.15.86:0/2298893273 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cceafb1a-8d0e-469f-81a6-33930e8c3821", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fd91800a640 con 0x7fd91c0d1d00 2024-09-17T05:35:54.022 INFO:teuthology.orchestra.run.smithi086.stdout:2 2024-09-17T05:35:54.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd91c0d1d00 msgr2=0x7fd91c1fc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd91c0d1d00 0x7fd91c1fc9d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c700 tx=0x7fd91800cbc0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 shutdown_connections 2024-09-17T05:35:54.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd91c0d1d00 0x7fd91c1fc9d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd91c0d18f0 0x7fd91c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 --2- 172.21.15.86:0/2298893273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd91c0cf5b0 0x7fd91c0b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 >> 172.21.15.86:0/2298893273 conn(0x7fd91c0b4240 msgr2=0x7fd91c15ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 shutdown_connections 2024-09-17T05:35:54.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.022+0000 7fd924800640 1 -- 172.21.15.86:0/2298893273 wait complete. 2024-09-17T05:35:54.040 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 661f651d-86da-4c54-9d7c-7fd7257752f9 3 2024-09-17T05:35:54.090 INFO:tasks.ceph.mgr.x.smithi086.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T05:35:54.091 INFO:tasks.ceph.mgr.x.smithi086.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T05:35:54.091 INFO:tasks.ceph.mgr.x.smithi086.stderr: from numpy import show_config as show_numpy_config 2024-09-17T05:35:54.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 -- 172.21.15.86:0/864931655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40d18f0 msgr2=0x7fc7f40b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 --2- 172.21.15.86:0/864931655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40d18f0 0x7fc7f40b1be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009840 tx=0x7fc7e401c760 comp rx=0 tx=0).stop 2024-09-17T05:35:54.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 -- 172.21.15.86:0/864931655 shutdown_connections 2024-09-17T05:35:54.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 --2- 172.21.15.86:0/864931655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7f40d1d00 0x7fc7f40cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 --2- 172.21.15.86:0/864931655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40d18f0 0x7fc7f40b1be0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 -- 172.21.15.86:0/864931655 >> 172.21.15.86:0/864931655 conn(0x7fc7f40b4240 msgr2=0x7fc7f40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 -- 172.21.15.86:0/864931655 shutdown_connections 2024-09-17T05:35:54.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.190+0000 7fc7fa600640 1 -- 172.21.15.86:0/864931655 wait complete. 2024-09-17T05:35:54.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 Processor -- start 2024-09-17T05:35:54.195 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 -- start start 2024-09-17T05:35:54.197 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40cf5b0 0x7fc7f41f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7f40d18f0 0x7fc7f41fab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f40d1d00 0x7fc7f41569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4169ee0 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f4169d60 con 0x7fc7f40d1d00 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7fa600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f416a060 con 0x7fc7f40d18f0 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7f40d18f0 0x7fc7f41fab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f40d1d00 0x7fc7f41569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40cf5b0 0x7fc7f41f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7ebe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7f40d18f0 0x7fc7f41fab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:53766/0 (socket says 172.21.15.86:53766) 2024-09-17T05:35:54.198 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7ebe00640 1 -- 172.21.15.86:0/685748199 learned_addr learned my addr 172.21.15.86:0/685748199 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:54.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3400640 1 -- 172.21.15.86:0/685748199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7f40d18f0 msgr2=0x7fc7f41fab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3400640 1 --2- 172.21.15.86:0/685748199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7f40d18f0 0x7fc7f41fab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3400640 1 -- 172.21.15.86:0/685748199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f40d1d00 msgr2=0x7fc7f41569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3400640 1 --2- 172.21.15.86:0/685748199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f40d1d00 0x7fc7f41569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3400640 1 -- 172.21.15.86:0/685748199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f41f7450 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.199 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7f3400640 1 --2- 172.21.15.86:0/685748199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40cf5b0 0x7fc7f41f6b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40ac000 tx=0x7fc7e4005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.194+0000 7fc7eb400640 1 -- 172.21.15.86:0/685748199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40b2040 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7eb400640 1 -- 172.21.15.86:0/685748199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7e4004320 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7eb400640 1 -- 172.21.15.86:0/685748199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40052d0 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f41f7730 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f40cb210 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7eb400640 1 -- 172.21.15.86:0/685748199 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc7e4004a60 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.200 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7eb400640 1 -- 172.21.15.86:0/685748199 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fc7e4003c20 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.201 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f40d10e0 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.202 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.198+0000 7fc7eb400640 1 -- 172.21.15.86:0/685748199 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc7e40be030 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.270 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.270+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd new", "uuid": "661f651d-86da-4c54-9d7c-7fd7257752f9", "id": 3} v 0) -- 0x7fc7f40b1b90 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.274 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7eb400640 1 -- 172.21.15.86:0/685748199 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "661f651d-86da-4c54-9d7c-7fd7257752f9", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fc7e4016410 con 0x7fc7f40cf5b0 2024-09-17T05:35:54.274 INFO:teuthology.orchestra.run.smithi086.stdout:3 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40cf5b0 msgr2=0x7fc7f41f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 --2- 172.21.15.86:0/685748199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40cf5b0 0x7fc7f41f6b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40ac000 tx=0x7fc7e4005d20 comp rx=0 tx=0).stop 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 shutdown_connections 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 --2- 172.21.15.86:0/685748199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7f40d1d00 0x7fc7f41569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 --2- 172.21.15.86:0/685748199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7f40d18f0 0x7fc7f41fab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 --2- 172.21.15.86:0/685748199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7f40cf5b0 0x7fc7f41f6b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 >> 172.21.15.86:0/685748199 conn(0x7fc7f40b4240 msgr2=0x7fc7f415b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 shutdown_connections 2024-09-17T05:35:54.276 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.274+0000 7fc7fa600640 1 -- 172.21.15.86:0/685748199 wait complete. 2024-09-17T05:35:54.295 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 2abc9322-dfe6-4b1f-993d-1985a2ce29ea 4 2024-09-17T05:35:54.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 -- 172.21.15.86:0/1173604188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 msgr2=0x7fc3400cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 --2- 172.21.15.86:0/1173604188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc3400cf070 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009870 tx=0x7fc32c01c7a0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.447 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 -- 172.21.15.86:0/1173604188 shutdown_connections 2024-09-17T05:35:54.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 --2- 172.21.15.86:0/1173604188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc3400cf070 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 -- 172.21.15.86:0/1173604188 >> 172.21.15.86:0/1173604188 conn(0x7fc3400b4240 msgr2=0x7fc3400b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 -- 172.21.15.86:0/1173604188 shutdown_connections 2024-09-17T05:35:54.448 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 -- 172.21.15.86:0/1173604188 wait complete. 2024-09-17T05:35:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 Processor -- start 2024-09-17T05:35:54.449 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.446+0000 7fc347800640 1 -- start start 2024-09-17T05:35:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3400cf5b0 0x7fc340152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3400d18f0 0x7fc34015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc34015f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc34016b110 con 0x7fc3400d18f0 2024-09-17T05:35:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc34016af90 con 0x7fc3400cf5b0 2024-09-17T05:35:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc34016b290 con 0x7fc3400d1d00 2024-09-17T05:35:54.451 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc345800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc34015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3400cf5b0 0x7fc340152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3400cf5b0 0x7fc340152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35402/0 (socket says 172.21.15.86:35402) 2024-09-17T05:35:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc345800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc34015f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:53776/0 (socket says 172.21.15.86:53776) 2024-09-17T05:35:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc33fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3400d18f0 0x7fc34015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.452 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 -- 172.21.15.86:0/3823189110 learned_addr learned my addr 172.21.15.86:0/3823189110 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 -- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 msgr2=0x7fc34015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.453 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc34015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 -- 172.21.15.86:0/3823189110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3400d18f0 msgr2=0x7fc34015f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3400d18f0 0x7fc34015f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 -- 172.21.15.86:0/3823189110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3401574c0 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc345800640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc34015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc33fe00640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3400d18f0 0x7fc34015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc344e00640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3400cf5b0 0x7fc340152520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c370 tx=0x7fc33400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc33cc00640 1 -- 172.21.15.86:0/3823189110 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334017070 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc33cc00640 1 -- 172.21.15.86:0/3823189110 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3340053c0 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc33cc00640 1 -- 172.21.15.86:0/3823189110 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334003860 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3401f9140 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3401f96c0 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc33cc00640 1 -- 172.21.15.86:0/3823189110 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc33401a070 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc33cc00640 1 -- 172.21.15.86:0/3823189110 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc334011c20 con 0x7fc3400cf5b0 2024-09-17T05:35:54.454 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.450+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3400cf070 con 0x7fc3400cf5b0 2024-09-17T05:35:54.456 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.454+0000 7fc33cc00640 1 -- 172.21.15.86:0/3823189110 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc334021070 con 0x7fc3400cf5b0 2024-09-17T05:35:54.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.522+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2abc9322-dfe6-4b1f-993d-1985a2ce29ea", "id": 4} v 0) -- 0x7fc34015ff30 con 0x7fc3400cf5b0 2024-09-17T05:35:54.531 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc33cc00640 1 -- 172.21.15.86:0/3823189110 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2abc9322-dfe6-4b1f-993d-1985a2ce29ea", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fc3400cf9c0 con 0x7fc3400cf5b0 2024-09-17T05:35:54.532 INFO:teuthology.orchestra.run.smithi086.stdout:4 2024-09-17T05:35:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3400cf5b0 msgr2=0x7fc340152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3400cf5b0 0x7fc340152520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c370 tx=0x7fc33400c830 comp rx=0 tx=0).stop 2024-09-17T05:35:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 shutdown_connections 2024-09-17T05:35:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3400d1d00 0x7fc34015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3400d18f0 0x7fc34015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.533 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 --2- 172.21.15.86:0/3823189110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3400cf5b0 0x7fc340152520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 >> 172.21.15.86:0/3823189110 conn(0x7fc3400b4240 msgr2=0x7fc340069020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 shutdown_connections 2024-09-17T05:35:54.534 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.530+0000 7fc347800640 1 -- 172.21.15.86:0/3823189110 wait complete. 2024-09-17T05:35:54.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 104f1a4a-b33b-4831-b0b6-f3d3a6000c58 5 2024-09-17T05:35:54.704 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 -- 172.21.15.86:0/4068223148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 msgr2=0x7f98a00b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 --2- 172.21.15.86:0/4068223148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a00b46a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98a00cddc0 tx=0x7f989801cc60 comp rx=0 tx=0).stop 2024-09-17T05:35:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 -- 172.21.15.86:0/4068223148 shutdown_connections 2024-09-17T05:35:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 --2- 172.21.15.86:0/4068223148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a00b46a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 --2- 172.21.15.86:0/4068223148 >> v2:172.21.15.44:3300/0 conn(0x7f98a015ef80 0x7f98a015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 -- 172.21.15.86:0/4068223148 >> 172.21.15.86:0/4068223148 conn(0x7f98a00d06c0 msgr2=0x7f98a00d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 -- 172.21.15.86:0/4068223148 shutdown_connections 2024-09-17T05:35:54.705 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.702+0000 7f98a5e00640 1 -- 172.21.15.86:0/4068223148 wait complete. 2024-09-17T05:35:54.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 Processor -- start 2024-09-17T05:35:54.706 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 -- start start 2024-09-17T05:35:54.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98a00afb60 0x7f98a014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a0156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98a015ef80 0x7f98a0156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.708 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98a0168920 con 0x7f98a015ef80 2024-09-17T05:35:54.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f98a0159350 con 0x7f98a00b4290 2024-09-17T05:35:54.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f98a0168aa0 con 0x7f98a00afb60 2024-09-17T05:35:54.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a0156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a0156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35424/0 (socket says 172.21.15.86:35424) 2024-09-17T05:35:54.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 -- 172.21.15.86:0/513283766 learned_addr learned my addr 172.21.15.86:0/513283766 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:54.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a4a00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98a00afb60 0x7f98a014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5400640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98a015ef80 0x7f98a0156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 -- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98a00afb60 msgr2=0x7f98a014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98a00afb60 0x7f98a014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 -- 172.21.15.86:0/513283766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98a015ef80 msgr2=0x7f98a0156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98a015ef80 0x7f98a0156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 -- 172.21.15.86:0/513283766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a0157e40 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989fe00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a0156940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f988c00e7f0 tx=0x7f988c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989cc00640 1 -- 172.21.15.86:0/513283766 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c00eea0 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989cc00640 1 -- 172.21.15.86:0/513283766 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f988c00cce0 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989cc00640 1 -- 172.21.15.86:0/513283766 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c004290 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a014d750 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a0157880 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989cc00640 1 -- 172.21.15.86:0/513283766 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f988c003990 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.706+0000 7f989cc00640 1 -- 172.21.15.86:0/513283766 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f988c003c80 con 0x7f98a00b4290 2024-09-17T05:35:54.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.710+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a00b46a0 con 0x7f98a00b4290 2024-09-17T05:35:54.713 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.710+0000 7f989cc00640 1 -- 172.21.15.86:0/513283766 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f988c004430 con 0x7f98a00b4290 2024-09-17T05:35:54.782 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.778+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "104f1a4a-b33b-4831-b0b6-f3d3a6000c58", "id": 5} v 0) -- 0x7f98a0153c00 con 0x7f98a00b4290 2024-09-17T05:35:54.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f989cc00640 1 -- 172.21.15.86:0/513283766 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "104f1a4a-b33b-4831-b0b6-f3d3a6000c58", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f988c021440 con 0x7f98a00b4290 2024-09-17T05:35:54.787 INFO:teuthology.orchestra.run.smithi086.stdout:5 2024-09-17T05:35:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 msgr2=0x7f98a0156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a0156940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f988c00e7f0 tx=0x7f988c00ecb0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 shutdown_connections 2024-09-17T05:35:54.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98a015ef80 0x7f98a0156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98a00b4290 0x7f98a0156940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 --2- 172.21.15.86:0/513283766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98a00afb60 0x7f98a014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 >> 172.21.15.86:0/513283766 conn(0x7f98a00d06c0 msgr2=0x7f98a006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 shutdown_connections 2024-09-17T05:35:54.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.786+0000 7f98a5e00640 1 -- 172.21.15.86:0/513283766 wait complete. 2024-09-17T05:35:54.806 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 00906172-03c2-4813-bb35-1d75cf3974a1 6 2024-09-17T05:35:54.892 INFO:tasks.ceph.mgr.y.smithi044.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T05:35:54.893 INFO:tasks.ceph.mgr.y.smithi044.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T05:35:54.893 INFO:tasks.ceph.mgr.y.smithi044.stderr: from numpy import show_config as show_numpy_config 2024-09-17T05:35:54.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 -- 172.21.15.86:0/3928682040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 msgr2=0x7fefd00cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 --2- 172.21.15.86:0/3928682040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 0x7fefd00cfb20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefd00b1cd0 tx=0x7fefc801cb10 comp rx=0 tx=0).stop 2024-09-17T05:35:54.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 -- 172.21.15.86:0/3928682040 shutdown_connections 2024-09-17T05:35:54.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 --2- 172.21.15.86:0/3928682040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 0x7fefd00cfb20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 -- 172.21.15.86:0/3928682040 >> 172.21.15.86:0/3928682040 conn(0x7fefd00732e0 msgr2=0x7fefd00b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.959 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 -- 172.21.15.86:0/3928682040 shutdown_connections 2024-09-17T05:35:54.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 -- 172.21.15.86:0/3928682040 wait complete. 2024-09-17T05:35:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 Processor -- start 2024-09-17T05:35:54.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.958+0000 7fefd5e00640 1 -- start start 2024-09-17T05:35:54.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd00b1740 0x7fefd014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 0x7fefd00ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.964 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd01593d0 0x7fefd00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fefd0169f00 con 0x7fefd0152410 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fefd0169d80 con 0x7fefd00b1740 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fefd016a080 con 0x7fefd01593d0 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd00b1740 0x7fefd014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd01593d0 0x7fefd00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd00b1740 0x7fefd014b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35426/0 (socket says 172.21.15.86:35426) 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 -- 172.21.15.86:0/1845692191 learned_addr learned my addr 172.21.15.86:0/1845692191 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefc7e00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 0x7fefd00ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 -- 172.21.15.86:0/1845692191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd01593d0 msgr2=0x7fefd00ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd01593d0 0x7fefd00ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 -- 172.21.15.86:0/1845692191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 msgr2=0x7fefd00ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 0x7fefd00ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.965 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 -- 172.21.15.86:0/1845692191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd00cbab0 con 0x7fefd00b1740 2024-09-17T05:35:54.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd4a00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd00b1740 0x7fefd014b8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c400 tx=0x7fefc000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefcd600640 1 -- 172.21.15.86:0/1845692191 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0017070 con 0x7fefd00b1740 2024-09-17T05:35:54.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefcd600640 1 -- 172.21.15.86:0/1845692191 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefc0005400 con 0x7fefd00b1740 2024-09-17T05:35:54.966 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd014be30 con 0x7fefd00b1740 2024-09-17T05:35:54.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefcd600640 1 -- 172.21.15.86:0/1845692191 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0003860 con 0x7fefd00b1740 2024-09-17T05:35:54.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd014e530 con 0x7fefd00b1740 2024-09-17T05:35:54.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefcd600640 1 -- 172.21.15.86:0/1845692191 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fefc001a070 con 0x7fefd00b1740 2024-09-17T05:35:54.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefcd600640 1 -- 172.21.15.86:0/1845692191 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fefc0011d10 con 0x7fefd00b1740 2024-09-17T05:35:54.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.962+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd006df50 con 0x7fefd00b1740 2024-09-17T05:35:54.967 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:54.966+0000 7fefcd600640 1 -- 172.21.15.86:0/1845692191 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fefc0011590 con 0x7fefd00b1740 2024-09-17T05:35:55.038 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.034+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00906172-03c2-4813-bb35-1d75cf3974a1", "id": 6} v 0) -- 0x7fefd00b5410 con 0x7fefd00b1740 2024-09-17T05:35:55.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefcd600640 1 -- 172.21.15.86:0/1845692191 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00906172-03c2-4813-bb35-1d75cf3974a1", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fefc0011770 con 0x7fefd00b1740 2024-09-17T05:35:55.043 INFO:teuthology.orchestra.run.smithi086.stdout:6 2024-09-17T05:35:55.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd00b1740 msgr2=0x7fefd014b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd00b1740 0x7fefd014b8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fefc000c400 tx=0x7fefc000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 shutdown_connections 2024-09-17T05:35:55.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fefd01593d0 0x7fefd00ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefd0152410 0x7fefd00ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 --2- 172.21.15.86:0/1845692191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fefd00b1740 0x7fefd014b8f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 >> 172.21.15.86:0/1845692191 conn(0x7fefd00732e0 msgr2=0x7fefd014d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 shutdown_connections 2024-09-17T05:35:55.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.042+0000 7fefd5e00640 1 -- 172.21.15.86:0/1845692191 wait complete. 2024-09-17T05:35:55.062 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 7a44b405-f09b-4844-b45f-11eba59767d4 7 2024-09-17T05:35:55.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 -- 172.21.15.86:0/3136296692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d18f0 msgr2=0x7ff4d00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 --2- 172.21.15.86:0/3136296692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d18f0 0x7ff4d00b1be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0073b70 tx=0x7ff4c401c800 comp rx=0 tx=0).stop 2024-09-17T05:35:55.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 -- 172.21.15.86:0/3136296692 shutdown_connections 2024-09-17T05:35:55.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 --2- 172.21.15.86:0/3136296692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00cf5b0 0x7ff4d015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 --2- 172.21.15.86:0/3136296692 >> v2:172.21.15.44:3300/0 conn(0x7ff4d00d1d00 0x7ff4d00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 --2- 172.21.15.86:0/3136296692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d18f0 0x7ff4d00b1be0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.216 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 -- 172.21.15.86:0/3136296692 >> 172.21.15.86:0/3136296692 conn(0x7ff4d00b4240 msgr2=0x7ff4d00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 -- 172.21.15.86:0/3136296692 shutdown_connections 2024-09-17T05:35:55.217 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 -- 172.21.15.86:0/3136296692 wait complete. 2024-09-17T05:35:55.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 Processor -- start 2024-09-17T05:35:55.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.214+0000 7ff4d7600640 1 -- start start 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4d00cf5b0 0x7ff4d01fc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00d18f0 0x7ff4d01fc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d00d0d70 con 0x7ff4d00cf5b0 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d00d0bf0 con 0x7ff4d00d1d00 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d00d0ef0 con 0x7ff4d00d18f0 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00d18f0 0x7ff4d01fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d5600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4d00cf5b0 0x7ff4d01fc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.220 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00d18f0 0x7ff4d01fc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.86:53810/0 (socket says 172.21.15.86:53810) 2024-09-17T05:35:55.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 -- 172.21.15.86:0/4084135236 learned_addr learned my addr 172.21.15.86:0/4084135236 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-17T05:35:55.221 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4d00cf5b0 0x7ff4d01fc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.86:34580/0 (socket says 172.21.15.86:34580) 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 -- 172.21.15.86:0/4084135236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d1d00 msgr2=0x7ff4d0071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 -- 172.21.15.86:0/4084135236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4d00cf5b0 msgr2=0x7ff4d01fc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4d00cf5b0 0x7ff4d01fc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 -- 172.21.15.86:0/4084135236 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d0155550 con 0x7ff4d00d18f0 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d4c00640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4d00cf5b0 0x7ff4d01fc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4cfe00640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00d18f0 0x7ff4d01fc930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00e7a0 tx=0x7ff4bc00eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:55.222 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4ccc00640 1 -- 172.21.15.86:0/4084135236 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc004220 con 0x7ff4d00d18f0 2024-09-17T05:35:55.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4ccc00640 1 -- 172.21.15.86:0/4084135236 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4bc0043c0 con 0x7ff4d00d18f0 2024-09-17T05:35:55.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4ccc00640 1 -- 172.21.15.86:0/4084135236 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00cb10 con 0x7ff4d00d18f0 2024-09-17T05:35:55.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d00b63e0 con 0x7ff4d00d18f0 2024-09-17T05:35:55.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d01401c0 con 0x7ff4d00d18f0 2024-09-17T05:35:55.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4ccc00640 1 -- 172.21.15.86:0/4084135236 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4bc003600 con 0x7ff4d00d18f0 2024-09-17T05:35:55.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4ccc00640 1 -- 172.21.15.86:0/4084135236 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff4bc018a90 con 0x7ff4d00d18f0 2024-09-17T05:35:55.223 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.218+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d00b1be0 con 0x7ff4d00d18f0 2024-09-17T05:35:55.224 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.222+0000 7ff4ccc00640 1 -- 172.21.15.86:0/4084135236 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff4bc021440 con 0x7ff4d00d18f0 2024-09-17T05:35:55.293 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.290+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7a44b405-f09b-4844-b45f-11eba59767d4", "id": 7} v 0) -- 0x7ff4d0155270 con 0x7ff4d00d18f0 2024-09-17T05:35:55.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.294+0000 7ff4ccc00640 1 -- 172.21.15.86:0/4084135236 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a44b405-f09b-4844-b45f-11eba59767d4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff4bc003ad0 con 0x7ff4d00d18f0 2024-09-17T05:35:55.298 INFO:teuthology.orchestra.run.smithi086.stdout:7 2024-09-17T05:35:55.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00d18f0 msgr2=0x7ff4d01fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00d18f0 0x7ff4d01fc930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00e7a0 tx=0x7ff4bc00eba0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 shutdown_connections 2024-09-17T05:35:55.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4d00d1d00 0x7ff4d0071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4d00d18f0 0x7ff4d01fc930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 --2- 172.21.15.86:0/4084135236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4d00cf5b0 0x7ff4d01fc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 >> 172.21.15.86:0/4084135236 conn(0x7ff4d00b4240 msgr2=0x7ff4d015bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 shutdown_connections 2024-09-17T05:35:55.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:35:55.298+0000 7ff4d7600640 1 -- 172.21.15.86:0/4084135236 wait complete. 2024-09-17T05:35:55.318 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T05:35:55.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T05:35:55.321 INFO:tasks.ceph.osd.0:Started 2024-09-17T05:35:55.321 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T05:35:55.321 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T05:35:55.324 INFO:tasks.ceph.osd.1:Started 2024-09-17T05:35:55.324 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T05:35:55.324 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T05:35:55.327 INFO:tasks.ceph.osd.2:Started 2024-09-17T05:35:55.327 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T05:35:55.327 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T05:35:55.331 INFO:tasks.ceph.osd.3:Started 2024-09-17T05:35:55.331 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T05:35:55.331 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T05:35:55.334 INFO:tasks.ceph.osd.4:Started 2024-09-17T05:35:55.335 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T05:35:55.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T05:35:55.337 INFO:tasks.ceph.osd.5:Started 2024-09-17T05:35:55.338 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T05:35:55.338 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T05:35:55.341 INFO:tasks.ceph.osd.6:Started 2024-09-17T05:35:55.341 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T05:35:55.341 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T05:35:55.345 INFO:tasks.ceph.osd.7:Started 2024-09-17T05:35:55.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 -- 172.21.15.44:0/2089075652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940cf5b0 msgr2=0x7fd29415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 --2- 172.21.15.44:0/2089075652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940cf5b0 0x7fd29415d060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009bf0 tx=0x7fd28c01ca00 comp rx=0 tx=0).stop 2024-09-17T05:35:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 -- 172.21.15.44:0/2089075652 shutdown_connections 2024-09-17T05:35:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 --2- 172.21.15.44:0/2089075652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940cf5b0 0x7fd29415d060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 --2- 172.21.15.44:0/2089075652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2940d1d00 0x7fd2940cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 -- 172.21.15.44:0/2089075652 >> 172.21.15.44:0/2089075652 conn(0x7fd2940b4240 msgr2=0x7fd2940b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 -- 172.21.15.44:0/2089075652 shutdown_connections 2024-09-17T05:35:55.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.534+0000 7fd29aa00640 1 -- 172.21.15.44:0/2089075652 wait complete. 2024-09-17T05:35:55.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 Processor -- start 2024-09-17T05:35:55.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 -- start start 2024-09-17T05:35:55.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2940cf5b0 0x7fd2941f9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2940d18f0 0x7fd294151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940d1d00 0x7fd2941fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd294169e80 con 0x7fd2940d18f0 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd294169d00 con 0x7fd2940d1d00 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd29416a000 con 0x7fd2940cf5b0 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd28be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2940d18f0 0x7fd294151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd293e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2940cf5b0 0x7fd2941f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd28be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2940d18f0 0x7fd294151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46122/0 (socket says 172.21.15.44:46122) 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd28be00640 1 -- 172.21.15.44:0/705016680 learned_addr learned my addr 172.21.15.44:0/705016680 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd298a00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940d1d00 0x7fd2941fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd293e00640 1 -- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940d1d00 msgr2=0x7fd2941fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd293e00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940d1d00 0x7fd2941fc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd293e00640 1 -- 172.21.15.44:0/705016680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2940d18f0 msgr2=0x7fd294151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd293e00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2940d18f0 0x7fd294151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd293e00640 1 -- 172.21.15.44:0/705016680 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2941f9d50 con 0x7fd2940cf5b0 2024-09-17T05:35:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd28be00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2940d18f0 0x7fd294151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:55.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd293e00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2940cf5b0 0x7fd2941f9810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd284001420 tx=0x7fd28400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd290c00640 1 -- 172.21.15.44:0/705016680 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284017070 con 0x7fd2940cf5b0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd290c00640 1 -- 172.21.15.44:0/705016680 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd284003600 con 0x7fd2940cf5b0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd290c00640 1 -- 172.21.15.44:0/705016680 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284003a50 con 0x7fd2940cf5b0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2940b7d60 con 0x7fd2940cf5b0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2941551a0 con 0x7fd2940cf5b0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd290c00640 1 -- 172.21.15.44:0/705016680 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd28401a070 con 0x7fd2940cf5b0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.538+0000 7fd290c00640 1 -- 172.21.15.44:0/705016680 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd28401cc60 con 0x7fd2940cf5b0 2024-09-17T05:35:55.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.542+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd29415d060 con 0x7fd2940cf5b0 2024-09-17T05:35:55.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.542+0000 7fd290c00640 1 -- 172.21.15.44:0/705016680 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd2941f9d50 con 0x7fd2940cf5b0 2024-09-17T05:35:55.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2940cd2e0 con 0x7fd2940cf5b0 2024-09-17T05:35:55.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd290c00640 1 -- 172.21.15.44:0/705016680 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd2940cf9c0 con 0x7fd2940cf5b0 2024-09-17T05:35:55.612 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:35:55.612 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:35:55.294984+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2940cf5b0 msgr2=0x7fd2941f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2940cf5b0 0x7fd2941f9810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd284001420 tx=0x7fd28400c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 shutdown_connections 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2940d1d00 0x7fd2941fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2940d18f0 0x7fd294151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 --2- 172.21.15.44:0/705016680 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd2940cf5b0 0x7fd2941f9810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 >> 172.21.15.44:0/705016680 conn(0x7fd2940b4240 msgr2=0x7fd294152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 shutdown_connections 2024-09-17T05:35:55.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:35:55.606+0000 7fd29aa00640 1 -- 172.21.15.44:0/705016680 wait complete. 2024-09-17T05:35:55.634 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T05:35:55.634 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T05:35:56.441 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:56.590 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 -- 172.21.15.44:0/1815517934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96540cb470 msgr2=0x7f96540cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.590 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 --2- 172.21.15.44:0/1815517934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96540cb470 0x7f96540cb880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f964c009bc0 tx=0x7f964c01cb10 comp rx=0 tx=0).stop 2024-09-17T05:35:56.590 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 -- 172.21.15.44:0/1815517934 shutdown_connections 2024-09-17T05:35:56.590 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 --2- 172.21.15.44:0/1815517934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96540cb470 0x7f96540cb880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.591 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 --2- 172.21.15.44:0/1815517934 >> v2:172.21.15.86:3300/0 conn(0x7f9654072e50 0x7f965415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.591 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 -- 172.21.15.44:0/1815517934 >> 172.21.15.44:0/1815517934 conn(0x7f96540ccaa0 msgr2=0x7f96540cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:56.591 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 -- 172.21.15.44:0/1815517934 shutdown_connections 2024-09-17T05:35:56.591 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 -- 172.21.15.44:0/1815517934 wait complete. 2024-09-17T05:35:56.592 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 Processor -- start 2024-09-17T05:35:56.592 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.586+0000 7f965b400640 1 -- start start 2024-09-17T05:35:56.594 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f965406de50 0x7f965415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:56.594 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9654072e50 0x7f965415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:56.594 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96540cb470 0x7f96541fa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9654168f70 con 0x7f965406de50 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9654168df0 con 0x7f96540cb470 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f96541690f0 con 0x7f9654072e50 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f965406de50 0x7f965415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f965406de50 0x7f965415d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46138/0 (socket says 172.21.15.44:46138) 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 -- 172.21.15.44:0/1807658530 learned_addr learned my addr 172.21.15.44:0/1807658530 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9659400640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96540cb470 0x7f96541fa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:56.595 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f964be00640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9654072e50 0x7f965415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:56.596 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 -- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9654072e50 msgr2=0x7f965415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.596 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9654072e50 0x7f965415d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 -- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96540cb470 msgr2=0x7f96541fa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96540cb470 0x7f96541fa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 -- 172.21.15.44:0/1807658530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965415aef0 con 0x7f965406de50 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9658a00640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f965406de50 0x7f965415d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f964400e9d0 tx=0x7f964400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9651600640 1 -- 172.21.15.44:0/1807658530 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964400cde0 con 0x7f965406de50 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9651600640 1 -- 172.21.15.44:0/1807658530 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9644004020 con 0x7f965406de50 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96541f7e90 con 0x7f965406de50 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9651600640 1 -- 172.21.15.44:0/1807658530 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9644004470 con 0x7f965406de50 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965415b470 con 0x7f965406de50 2024-09-17T05:35:56.597 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96540cb880 con 0x7f965406de50 2024-09-17T05:35:56.598 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.590+0000 7f9651600640 1 -- 172.21.15.44:0/1807658530 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 2) ==== 48655+0+0 (secure 0 0 0) 0x7f9644003600 con 0x7f965406de50 2024-09-17T05:35:56.598 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.594+0000 7f9651600640 1 -- 172.21.15.44:0/1807658530 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f964404f630 con 0x7f965406de50 2024-09-17T05:35:56.599 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.594+0000 7f9651600640 1 -- 172.21.15.44:0/1807658530 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f96440038f0 con 0x7f965406de50 2024-09-17T05:35:56.661 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.654+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96540b5fa0 con 0x7f965406de50 2024-09-17T05:35:56.661 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.654+0000 7f9651600640 1 -- 172.21.15.44:0/1807658530 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9644021430 con 0x7f965406de50 2024-09-17T05:35:56.662 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-17T05:35:56.662 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:35:55.294984+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f965406de50 msgr2=0x7f965415d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f965406de50 0x7f965415d190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f964400e9d0 tx=0x7f964400ee90 comp rx=0 tx=0).stop 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 shutdown_connections 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96540cb470 0x7f96541fa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9654072e50 0x7f965415d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 --2- 172.21.15.44:0/1807658530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f965406de50 0x7f965415d190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 >> 172.21.15.44:0/1807658530 conn(0x7f96540ccaa0 msgr2=0x7f96541556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 shutdown_connections 2024-09-17T05:35:56.663 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:35:56.658+0000 7f965b400640 1 -- 172.21.15.44:0/1807658530 wait complete. 2024-09-17T05:35:56.680 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T05:35:56.767 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-17T05:35:56.762+0000 7ffb46d537c0 -1 Falling back to public interface 2024-09-17T05:35:56.836 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-17T05:35:56.834+0000 7fbdb59887c0 -1 Falling back to public interface 2024-09-17T05:35:56.996 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-17T05:35:56.994+0000 7f8c46a2b7c0 -1 Falling back to public interface 2024-09-17T05:35:57.011 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-17T05:35:57.006+0000 7f89d02937c0 -1 Falling back to public interface 2024-09-17T05:35:57.035 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-17T05:35:57.030+0000 7fa59db437c0 -1 Falling back to public interface 2024-09-17T05:35:57.087 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-17T05:35:57.082+0000 7fbc8c56e7c0 -1 Falling back to public interface 2024-09-17T05:35:57.248 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-17T05:35:57.246+0000 7f5d093677c0 -1 Falling back to public interface 2024-09-17T05:35:57.252 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-17T05:35:57.250+0000 7fc5d42cb7c0 -1 Falling back to public interface 2024-09-17T05:35:57.262 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-17T05:35:57.262+0000 7fea8ae00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T05:35:57.263 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-17T05:35:57.262+0000 7fea8ae00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T05:36:00.916 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-17T05:36:00.913+0000 7fbdb59887c0 -1 osd.6 0 log_to_monitors true 2024-09-17T05:36:01.297 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-17T05:36:01.293+0000 7f8c46a2b7c0 -1 osd.4 0 log_to_monitors true 2024-09-17T05:36:01.303 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-17T05:36:01.298+0000 7ffb46d537c0 -1 osd.0 0 log_to_monitors true 2024-09-17T05:36:01.326 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-17T05:36:01.322+0000 7f89d02937c0 -1 osd.2 0 log_to_monitors true 2024-09-17T05:36:01.446 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-17T05:36:01.441+0000 7f5d093677c0 -1 osd.7 0 log_to_monitors true 2024-09-17T05:36:01.502 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-17T05:36:01.497+0000 7fc5d42cb7c0 -1 osd.5 0 log_to_monitors true 2024-09-17T05:36:01.522 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-17T05:36:01.518+0000 7fa59db437c0 -1 osd.1 0 log_to_monitors true 2024-09-17T05:36:01.670 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-17T05:36:01.666+0000 7fbc8c56e7c0 -1 osd.3 0 log_to_monitors true 2024-09-17T05:36:02.977 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-17T05:36:02.973+0000 7fbdb1200640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T05:36:03.008 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-17T05:36:03.005+0000 7fbda6800640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:03.487 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:03.677 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.670+0000 7f5eed800640 1 -- 172.21.15.44:0/964862136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80ceaa0 msgr2=0x7f5ee80d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.677 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.670+0000 7f5eed800640 1 --2- 172.21.15.44:0/964862136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80ceaa0 0x7f5ee80d0240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80b4400 tx=0x7f5ed801e4e0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.677 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.670+0000 7f5eed800640 1 -- 172.21.15.44:0/964862136 shutdown_connections 2024-09-17T05:36:03.677 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.670+0000 7f5eed800640 1 --2- 172.21.15.44:0/964862136 >> v2:172.21.15.86:3300/0 conn(0x7f5ee80b4e80 0x7f5ee80b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.678 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.670+0000 7f5eed800640 1 --2- 172.21.15.44:0/964862136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80ceaa0 0x7f5ee80d0240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.678 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.670+0000 7f5eed800640 1 -- 172.21.15.44:0/964862136 >> 172.21.15.44:0/964862136 conn(0x7f5ee806fb90 msgr2=0x7f5ee806ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:03.678 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.670+0000 7f5eed800640 1 -- 172.21.15.44:0/964862136 shutdown_connections 2024-09-17T05:36:03.680 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.674+0000 7f5eed800640 1 -- 172.21.15.44:0/964862136 wait complete. 2024-09-17T05:36:03.681 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.674+0000 7f5eed800640 1 Processor -- start 2024-09-17T05:36:03.681 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eed800640 1 -- start start 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eed800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee80711c0 0x7f5ee814f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eed800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80b4e80 0x7f5ee8165770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eed800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ee80ceaa0 0x7f5ee815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eed800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8167da0 con 0x7f5ee80b4e80 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eed800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee806dbc0 con 0x7f5ee80711c0 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eed800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee8167f20 con 0x7f5ee80ceaa0 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee80711c0 0x7f5ee814f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee80711c0 0x7f5ee814f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:50718/0 (socket says 172.21.15.44:50718) 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 -- 172.21.15.44:0/3939364244 learned_addr learned my addr 172.21.15.44:0/3939364244 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5eece00640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ee80ceaa0 0x7f5ee815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.685 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7400640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80b4e80 0x7f5ee8165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 -- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ee80ceaa0 msgr2=0x7f5ee815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ee80ceaa0 0x7f5ee815a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 -- 172.21.15.44:0/3939364244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80b4e80 msgr2=0x7f5ee8165770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80b4e80 0x7f5ee8165770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.678+0000 7f5ee7e00640 1 -- 172.21.15.44:0/3939364244 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee8150040 con 0x7f5ee80711c0 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5ee7400640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80b4e80 0x7f5ee8165770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5ee7e00640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee80711c0 0x7f5ee814f7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5ed801c110 tx=0x7f5ed8005d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5edfe00640 1 -- 172.21.15.44:0/3939364244 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80bb020 con 0x7f5ee80711c0 2024-09-17T05:36:03.687 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5edfe00640 1 -- 172.21.15.44:0/3939364244 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ed80adb90 con 0x7f5ee80711c0 2024-09-17T05:36:03.688 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee8157fc0 con 0x7f5ee80711c0 2024-09-17T05:36:03.688 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5edfe00640 1 -- 172.21.15.44:0/3939364244 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80b2040 con 0x7f5ee80711c0 2024-09-17T05:36:03.688 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee8159b20 con 0x7f5ee80711c0 2024-09-17T05:36:03.688 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee80b5290 con 0x7f5ee80711c0 2024-09-17T05:36:03.689 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.682+0000 7f5edfe00640 1 -- 172.21.15.44:0/3939364244 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 4) ==== 97178+0+0 (secure 0 0 0) 0x7f5ed80be020 con 0x7f5ee80711c0 2024-09-17T05:36:03.690 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.686+0000 7f5edfe00640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5ec80731a0 0x7f5ec80756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.690 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.686+0000 7f5edfe00640 1 -- 172.21.15.44:0/3939364244 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f5ed812f760 con 0x7f5ee80711c0 2024-09-17T05:36:03.691 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.686+0000 7f5ee7400640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5ec80731a0 0x7f5ec80756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.691 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.686+0000 7f5ee7400640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5ec80731a0 0x7f5ec80756b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81572a0 tx=0x7f5ed4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:03.695 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.690+0000 7f5edfe00640 1 -- 172.21.15.44:0/3939364244 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f5ed80c5030 con 0x7f5ee80711c0 2024-09-17T05:36:03.909 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.902+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ee8070420 con 0x7f5ee80711c0 2024-09-17T05:36:03.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5edfe00640 1 -- 172.21.15.44:0/3939364244 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7543 (secure 0 0 0) 0x7f5ed8018160 con 0x7f5ee80711c0 2024-09-17T05:36:03.910 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-17T05:36:03.910 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":13,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:03.019333+0000","last_up_change":"2024-09-17T05:36:03.019333+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5ec80731a0 msgr2=0x7f5ec80756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5ec80731a0 0x7f5ec80756b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81572a0 tx=0x7f5ed4009040 comp rx=0 tx=0).stop 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee80711c0 msgr2=0x7f5ee814f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee80711c0 0x7f5ee814f7c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5ed801c110 tx=0x7f5ed8005d40 comp rx=0 tx=0).stop 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 shutdown_connections 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5ee80ceaa0 0x7f5ee815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ee80b4e80 0x7f5ee8165770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5ec80731a0 0x7f5ec80756b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 --2- 172.21.15.44:0/3939364244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ee80711c0 0x7f5ee814f7c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 >> 172.21.15.44:0/3939364244 conn(0x7f5ee806fb90 msgr2=0x7f5ee80b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:03.914 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 shutdown_connections 2024-09-17T05:36:03.914 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:03.906+0000 7f5eed800640 1 -- 172.21.15.44:0/3939364244 wait complete. 2024-09-17T05:36:03.933 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T05:36:04.907 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-17T05:36:04.905+0000 7fc5cfc00640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T05:36:04.912 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-17T05:36:04.909+0000 7f5d04c00640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T05:36:04.926 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-17T05:36:04.921+0000 7f8c40e00640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T05:36:04.940 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-17T05:36:04.937+0000 7fc5c5200640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:04.952 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-17T05:36:04.949+0000 7f5cfa200640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:04.968 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-17T05:36:04.965+0000 7f8c36e00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:05.395 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-17T05:36:05.390+0000 7fbc87e00640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T05:36:05.427 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-09-17T05:36:05.422+0000 7fbc7d400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:05.450 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-17T05:36:05.446+0000 7f89cb200640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T05:36:05.460 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-17T05:36:05.454+0000 7ffb42600640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T05:36:05.483 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-09-17T05:36:05.478+0000 7f89c1200640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:05.483 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-17T05:36:05.478+0000 7fa599400640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T05:36:05.494 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-09-17T05:36:05.490+0000 7ffb37c00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:05.514 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-09-17T05:36:05.510+0000 7fa58ea00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:36:10.740 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:10.903 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 -- 172.21.15.44:0/4273078352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc828003c20 msgr2=0x7fc828004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.904 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 --2- 172.21.15.44:0/4273078352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc828003c20 0x7fc828004070 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc834001860 tx=0x7fc83401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.904 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc848c00640 1 -- 172.21.15.44:0/4273078352 reap_dead start 2024-09-17T05:36:10.904 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 -- 172.21.15.44:0/4273078352 shutdown_connections 2024-09-17T05:36:10.904 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 -- 172.21.15.44:0/4273078352 >> 172.21.15.44:0/4273078352 conn(0x7fc8440b2c40 msgr2=0x7fc8440b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:10.904 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 -- 172.21.15.44:0/4273078352 shutdown_connections 2024-09-17T05:36:10.904 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 -- 172.21.15.44:0/4273078352 wait complete. 2024-09-17T05:36:10.905 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 Processor -- start 2024-09-17T05:36:10.905 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.898+0000 7fc849600640 1 -- start start 2024-09-17T05:36:10.907 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828003c20 0x7fc84415d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.907 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc84414ad10 0x7fc8440cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.907 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc84414b120 0x7fc8440cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.907 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8441677d0 con 0x7fc84414b120 2024-09-17T05:36:10.907 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc844167650 con 0x7fc828003c20 2024-09-17T05:36:10.907 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc844167950 con 0x7fc84414ad10 2024-09-17T05:36:10.907 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc84414b120 0x7fc8440cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.908 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc84414b120 0x7fc8440cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47968/0 (socket says 172.21.15.44:47968) 2024-09-17T05:36:10.908 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 -- 172.21.15.44:0/3995001925 learned_addr learned my addr 172.21.15.44:0/3995001925 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:10.908 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc843e00640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828003c20 0x7fc84415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.908 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc83b400640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc84414ad10 0x7fc8440cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.909 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 -- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc84414ad10 msgr2=0x7fc8440cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.909 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc84414ad10 0x7fc8440cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.909 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 -- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828003c20 msgr2=0x7fc84415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.909 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828003c20 0x7fc84415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.909 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 -- 172.21.15.44:0/3995001925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84415df00 con 0x7fc84414b120 2024-09-17T05:36:10.909 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc848c00640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc84414b120 0x7fc8440cfb70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ce3f0 tx=0x7fc83c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:10.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc840c00640 1 -- 172.21.15.44:0/3995001925 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c004d30 con 0x7fc84414b120 2024-09-17T05:36:10.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc840c00640 1 -- 172.21.15.44:0/3995001925 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc83c00e5c0 con 0x7fc84414b120 2024-09-17T05:36:10.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84415e1e0 con 0x7fc84414b120 2024-09-17T05:36:10.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc840c00640 1 -- 172.21.15.44:0/3995001925 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00e9d0 con 0x7fc84414b120 2024-09-17T05:36:10.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84414d520 con 0x7fc84414b120 2024-09-17T05:36:10.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.902+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84415dc70 con 0x7fc84414b120 2024-09-17T05:36:10.910 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.906+0000 7fc840c00640 1 -- 172.21.15.44:0/3995001925 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc83c00eb70 con 0x7fc84414b120 2024-09-17T05:36:10.911 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.906+0000 7fc840c00640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc820073200 0x7fc820075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.912 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.906+0000 7fc840c00640 1 -- 172.21.15.44:0/3995001925 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc83c095950 con 0x7fc84414b120 2024-09-17T05:36:10.912 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.906+0000 7fc843e00640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc820073200 0x7fc820075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.913 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.906+0000 7fc843e00640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc820073200 0x7fc820075710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc834001830 tx=0x7fc834019720 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:10.925 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:10.918+0000 7fc840c00640 1 -- 172.21.15.44:0/3995001925 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc83c040080 con 0x7fc84414b120 2024-09-17T05:36:11.101 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.094+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc84415e700 con 0x7fc84414b120 2024-09-17T05:36:11.102 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc840c00640 1 -- 172.21.15.44:0/3995001925 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12848 (secure 0 0 0) 0x7fc84415e700 con 0x7fc84414b120 2024-09-17T05:36:11.102 INFO:teuthology.misc.health.smithi044.stdout: 2024-09-17T05:36:11.102 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":18,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:08.957053+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:11.104 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc820073200 msgr2=0x7fc820075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc820073200 0x7fc820075710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc834001830 tx=0x7fc834019720 comp rx=0 tx=0).stop 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc84414b120 msgr2=0x7fc8440cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc84414b120 0x7fc8440cfb70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ce3f0 tx=0x7fc83c00f790 comp rx=0 tx=0).stop 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 shutdown_connections 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc84414b120 0x7fc8440cfb70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc84414ad10 0x7fc8440cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc820073200 0x7fc820075710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 --2- 172.21.15.44:0/3995001925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828003c20 0x7fc84415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 >> 172.21.15.44:0/3995001925 conn(0x7fc8440b2c40 msgr2=0x7fc844074290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 shutdown_connections 2024-09-17T05:36:11.105 INFO:teuthology.misc.health.smithi044.stderr:2024-09-17T05:36:11.098+0000 7fc849600640 1 -- 172.21.15.44:0/3995001925 wait complete. 2024-09-17T05:36:11.123 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T05:36:11.123 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T05:36:11.123 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:36:11.124 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:36:11.127 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:36:11.127 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:36:11.127 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:36:11.131 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:36:11.131 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:36:11.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:36:11.134 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:36:11.135 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:36:11.135 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:36:11.138 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:36:11.138 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T05:36:11.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:11.236 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:36:11.237 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:36:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.298+0000 7fb74b000640 1 -- 172.21.15.44:0/2108308356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb744072e50 msgr2=0x7fb74415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.298+0000 7fb74b000640 1 --2- 172.21.15.44:0/2108308356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb744072e50 0x7fb74415e990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb734009840 tx=0x7fb73401c790 comp rx=0 tx=0).stop 2024-09-17T05:36:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.298+0000 7fb74b000640 1 -- 172.21.15.44:0/2108308356 shutdown_connections 2024-09-17T05:36:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.298+0000 7fb74b000640 1 --2- 172.21.15.44:0/2108308356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb744072e50 0x7fb74415e990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.298+0000 7fb74b000640 1 -- 172.21.15.44:0/2108308356 >> 172.21.15.44:0/2108308356 conn(0x7fb7440ccaa0 msgr2=0x7fb7440cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.298+0000 7fb74b000640 1 -- 172.21.15.44:0/2108308356 shutdown_connections 2024-09-17T05:36:11.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.298+0000 7fb74b000640 1 -- 172.21.15.44:0/2108308356 wait complete. 2024-09-17T05:36:11.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 Processor -- start 2024-09-17T05:36:11.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 -- start start 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74406de50 0x7fb7441fa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb744072e50 0x7fb7441563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7440cb470 0x7fb7441fc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb744169f80 con 0x7fb744072e50 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb744169e00 con 0x7fb74406de50 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb74b000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb74416a100 con 0x7fb7440cb470 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb744072e50 0x7fb7441563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb744072e50 0x7fb7441563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48012/0 (socket says 172.21.15.44:48012) 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 -- 172.21.15.44:0/618004953 learned_addr learned my addr 172.21.15.44:0/618004953 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb743e00640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74406de50 0x7fb7441fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb749000640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7440cb470 0x7fb7441fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 -- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7440cb470 msgr2=0x7fb7441fc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7440cb470 0x7fb7441fc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 -- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74406de50 msgr2=0x7fb7441fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74406de50 0x7fb7441fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.302+0000 7fb73be00640 1 -- 172.21.15.44:0/618004953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb744155340 con 0x7fb744072e50 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb73be00640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb744072e50 0x7fb7441563e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c430 tx=0x7fb72c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb740c00640 1 -- 172.21.15.44:0/618004953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c017070 con 0x7fb744072e50 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb744155620 con 0x7fb744072e50 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb740c00640 1 -- 172.21.15.44:0/618004953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb72c0053c0 con 0x7fb744072e50 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb740c00640 1 -- 172.21.15.44:0/618004953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c003860 con 0x7fb744072e50 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb744155be0 con 0x7fb744072e50 2024-09-17T05:36:11.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74415e990 con 0x7fb744072e50 2024-09-17T05:36:11.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb740c00640 1 -- 172.21.15.44:0/618004953 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb72c01a070 con 0x7fb744072e50 2024-09-17T05:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb740c00640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb720073200 0x7fb720075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.306+0000 7fb740c00640 1 -- 172.21.15.44:0/618004953 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fb72c093350 con 0x7fb744072e50 2024-09-17T05:36:11.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.310+0000 7fb743e00640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb720073200 0x7fb720075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.310+0000 7fb743e00640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb720073200 0x7fb720075710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7340af000 tx=0x7fb73401afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.314+0000 7fb740c00640 1 -- 172.21.15.44:0/618004953 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb72c05df50 con 0x7fb744072e50 2024-09-17T05:36:11.512 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:36:11.513 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:36:11.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.522+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7440b5fa0 con 0x7fb744072e50 2024-09-17T05:36:11.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.522+0000 7fb740c00640 1 -- 172.21.15.44:0/618004953 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fb72c062980 con 0x7fb744072e50 2024-09-17T05:36:11.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:11.529 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"btime":"2024-09-17T05:36:11:246830+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T05:36:11.529 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-09-17T05:36:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb720073200 msgr2=0x7fb720075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb720073200 0x7fb720075710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7340af000 tx=0x7fb73401afd0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb744072e50 msgr2=0x7fb7441563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb744072e50 0x7fb7441563e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c430 tx=0x7fb72c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 shutdown_connections 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7440cb470 0x7fb7441fc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb744072e50 0x7fb7441563e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb720073200 0x7fb720075710 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 --2- 172.21.15.44:0/618004953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74406de50 0x7fb7441fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 >> 172.21.15.44:0/618004953 conn(0x7fb7440ccaa0 msgr2=0x7fb744153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 shutdown_connections 2024-09-17T05:36:11.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:11.526+0000 7fb74b000640 1 -- 172.21.15.44:0/618004953 wait complete. 2024-09-17T05:36:11.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:11.612 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:13.551 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 -- 172.21.15.44:0/2156022997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c06de50 msgr2=0x7f1e8c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 --2- 172.21.15.44:0/2156022997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c06de50 0x7f1e8c06e260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009840 tx=0x7f1e7801c790 comp rx=0 tx=0).stop 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 -- 172.21.15.44:0/2156022997 shutdown_connections 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 --2- 172.21.15.44:0/2156022997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c06de50 0x7f1e8c06e260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 --2- 172.21.15.44:0/2156022997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e8c072e50 0x7f1e8c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 -- 172.21.15.44:0/2156022997 >> 172.21.15.44:0/2156022997 conn(0x7f1e8c0ccaa0 msgr2=0x7f1e8c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 -- 172.21.15.44:0/2156022997 shutdown_connections 2024-09-17T05:36:13.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 -- 172.21.15.44:0/2156022997 wait complete. 2024-09-17T05:36:13.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 Processor -- start 2024-09-17T05:36:13.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.718+0000 7f1e94000640 1 -- start start 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e8c06de50 0x7f1e8c1f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e8c072e50 0x7f1e8c0b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c0ced00 0x7f1e8c0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8c169410 con 0x7f1e8c0ced00 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8c169290 con 0x7f1e8c072e50 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1e8c169590 con 0x7f1e8c06de50 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c0ced00 0x7f1e8c0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c0ced00 0x7f1e8c0b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48022/0 (socket says 172.21.15.44:48022) 2024-09-17T05:36:13.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 -- 172.21.15.44:0/3762462079 learned_addr learned my addr 172.21.15.44:0/3762462079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e90c00640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e8c072e50 0x7f1e8c0b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e91600640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e8c06de50 0x7f1e8c1f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 -- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e8c06de50 msgr2=0x7f1e8c1f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e8c06de50 0x7f1e8c1f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 -- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e8c072e50 msgr2=0x7f1e8c0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e8c072e50 0x7f1e8c0b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 -- 172.21.15.44:0/3762462079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8c1fa0a0 con 0x7f1e8c0ced00 2024-09-17T05:36:13.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e90c00640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e8c072e50 0x7f1e8c0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e92000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c0ced00 0x7f1e8c0b0db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c730 tx=0x7f1e8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e89600640 1 -- 172.21.15.44:0/3762462079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e84003b80 con 0x7f1e8c0ced00 2024-09-17T05:36:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e89600640 1 -- 172.21.15.44:0/3762462079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e84003d40 con 0x7f1e8c0ced00 2024-09-17T05:36:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8c157260 con 0x7f1e8c0ced00 2024-09-17T05:36:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e89600640 1 -- 172.21.15.44:0/3762462079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e840052d0 con 0x7f1e8c0ced00 2024-09-17T05:36:13.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e8c1f9170 con 0x7f1e8c0ced00 2024-09-17T05:36:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.722+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8c06e260 con 0x7f1e8c0ced00 2024-09-17T05:36:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.726+0000 7f1e89600640 1 -- 172.21.15.44:0/3762462079 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1e84005680 con 0x7f1e8c0ced00 2024-09-17T05:36:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.726+0000 7f1e89600640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e6c073230 0x7f1e6c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.726+0000 7f1e89600640 1 -- 172.21.15.44:0/3762462079 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f1e84093ec0 con 0x7f1e8c0ced00 2024-09-17T05:36:13.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.726+0000 7f1e91600640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e6c073230 0x7f1e6c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.726+0000 7f1e91600640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e6c073230 0x7f1e6c075740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e800058d0 tx=0x7f1e80005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:13.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.730+0000 7f1e89600640 1 -- 172.21.15.44:0/3762462079 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1e8c06e7a0 con 0x7f1e8c0ced00 2024-09-17T05:36:13.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.938+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e8c1f9e10 con 0x7f1e8c0ced00 2024-09-17T05:36:13.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.938+0000 7f1e89600640 1 -- 172.21.15.44:0/3762462079 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3903 (secure 0 0 0) 0x7f1e8405f190 con 0x7f1e8c0ced00 2024-09-17T05:36:13.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:13.945 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":3,"btime":"2024-09-17T05:36:12:249985+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4414,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T05:36:13.946 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 3 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e6c073230 msgr2=0x7f1e6c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e6c073230 0x7f1e6c075740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e800058d0 tx=0x7f1e80005860 comp rx=0 tx=0).stop 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c0ced00 msgr2=0x7f1e8c0b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c0ced00 0x7f1e8c0b0db0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400c730 tx=0x7f1e8400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 shutdown_connections 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e8c0ced00 0x7f1e8c0b0db0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e6c073230 0x7f1e6c075740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e8c072e50 0x7f1e8c0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 --2- 172.21.15.44:0/3762462079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e8c06de50 0x7f1e8c1f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 >> 172.21.15.44:0/3762462079 conn(0x7f1e8c0ccaa0 msgr2=0x7f1e8c1578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:13.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 shutdown_connections 2024-09-17T05:36:13.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:13.942+0000 7f1e94000640 1 -- 172.21.15.44:0/3762462079 wait complete. 2024-09-17T05:36:13.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:36:14.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 -- 172.21.15.44:0/2475948835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497806de50 msgr2=0x7f497806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 --2- 172.21.15.44:0/2475948835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497806de50 0x7f497806e260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f49780ca7b0 tx=0x7f496001c770 comp rx=0 tx=0).stop 2024-09-17T05:36:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 -- 172.21.15.44:0/2475948835 shutdown_connections 2024-09-17T05:36:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 --2- 172.21.15.44:0/2475948835 >> v2:172.21.15.86:3300/0 conn(0x7f49780cb470 0x7f49780cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 --2- 172.21.15.44:0/2475948835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f497806de50 0x7f497806e260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 -- 172.21.15.44:0/2475948835 >> 172.21.15.44:0/2475948835 conn(0x7f49780ccaa0 msgr2=0x7f49780cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 -- 172.21.15.44:0/2475948835 shutdown_connections 2024-09-17T05:36:14.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.122+0000 7f497ea00640 1 -- 172.21.15.44:0/2475948835 wait complete. 2024-09-17T05:36:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 Processor -- start 2024-09-17T05:36:14.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 -- start start 2024-09-17T05:36:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f497806de50 0x7f49780c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4978072e50 0x7f49780b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49780cb470 0x7f49780b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4978168e30 con 0x7f4978072e50 2024-09-17T05:36:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4978168cb0 con 0x7f49780cb470 2024-09-17T05:36:14.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4978168fb0 con 0x7f497806de50 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4978072e50 0x7f49780b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4978072e50 0x7f49780b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48044/0 (socket says 172.21.15.44:48044) 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 -- 172.21.15.44:0/2022448988 learned_addr learned my addr 172.21.15.44:0/2022448988 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ca00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49780cb470 0x7f49780b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f4977e00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f497806de50 0x7f49780c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 -- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f497806de50 msgr2=0x7f49780c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f497806de50 0x7f49780c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 -- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49780cb470 msgr2=0x7f49780b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49780cb470 0x7f49780b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 -- 172.21.15.44:0/2022448988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49780af590 con 0x7f4978072e50 2024-09-17T05:36:14.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f4977e00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f497806de50 0x7f49780c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f496f400640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4978072e50 0x7f49780b0870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f496001cc50 tx=0x7f4960005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f4974c00640 1 -- 172.21.15.44:0/2022448988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49600b2040 con 0x7f4978072e50 2024-09-17T05:36:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f4974c00640 1 -- 172.21.15.44:0/2022448988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49600bb070 con 0x7f4978072e50 2024-09-17T05:36:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49780b2ff0 con 0x7f4978072e50 2024-09-17T05:36:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f4974c00640 1 -- 172.21.15.44:0/2022448988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960003600 con 0x7f4978072e50 2024-09-17T05:36:14.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.126+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49780b5ba0 con 0x7f4978072e50 2024-09-17T05:36:14.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.130+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497806e260 con 0x7f4978072e50 2024-09-17T05:36:14.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.130+0000 7f4974c00640 1 -- 172.21.15.44:0/2022448988 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f49600037a0 con 0x7f4978072e50 2024-09-17T05:36:14.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.130+0000 7f4974c00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4954073200 0x7f4954075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.130+0000 7f4974c00640 1 -- 172.21.15.44:0/2022448988 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f496012e340 con 0x7f4978072e50 2024-09-17T05:36:14.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.130+0000 7f4977e00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4954073200 0x7f4954075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.134+0000 7f4977e00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4954073200 0x7f4954075710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4968000f70 tx=0x7f4968009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.134+0000 7f4974c00640 1 -- 172.21.15.44:0/2022448988 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f49600163f0 con 0x7f4978072e50 2024-09-17T05:36:14.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f49780cf520 con 0x7f4978072e50 2024-09-17T05:36:14.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f4974c00640 1 -- 172.21.15.44:0/2022448988 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f49600f96a0 con 0x7f4978072e50 2024-09-17T05:36:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:14.323 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:36:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:36:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:36:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:36:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:36:14.324 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:36:14.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4954073200 msgr2=0x7f4954075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4954073200 0x7f4954075710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4968000f70 tx=0x7f4968009040 comp rx=0 tx=0).stop 2024-09-17T05:36:14.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4978072e50 msgr2=0x7f49780b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4978072e50 0x7f49780b0870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f496001cc50 tx=0x7f4960005db0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 shutdown_connections 2024-09-17T05:36:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4954073200 0x7f4954075710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49780cb470 0x7f49780b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4978072e50 0x7f49780b0870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 --2- 172.21.15.44:0/2022448988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f497806de50 0x7f49780c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 >> 172.21.15.44:0/2022448988 conn(0x7f49780ccaa0 msgr2=0x7f49780cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 shutdown_connections 2024-09-17T05:36:14.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.318+0000 7f497ea00640 1 -- 172.21.15.44:0/2022448988 wait complete. 2024-09-17T05:36:14.344 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:36:14.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 -- 172.21.15.44:0/3055612776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9815c470 msgr2=0x7fbb9806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 --2- 172.21.15.44:0/3055612776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9815c470 0x7fbb9806df50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009900 tx=0x7fbb8c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 -- 172.21.15.44:0/3055612776 shutdown_connections 2024-09-17T05:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 --2- 172.21.15.44:0/3055612776 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb9806e490 0x7fbb980cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 --2- 172.21.15.44:0/3055612776 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9815c470 0x7fbb9806df50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 -- 172.21.15.44:0/3055612776 >> 172.21.15.44:0/3055612776 conn(0x7fbb9809aa40 msgr2=0x7fbb980b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 -- 172.21.15.44:0/3055612776 shutdown_connections 2024-09-17T05:36:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 -- 172.21.15.44:0/3055612776 wait complete. 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 Processor -- start 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.502+0000 7fbba0200640 1 -- start start 2024-09-17T05:36:14.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9806e490 0x7fbb98147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb9806e8a0 0x7fbb981fc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb9815c470 0x7fbb9815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb98168d80 con 0x7fbb9806e490 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbb98168c00 con 0x7fbb9806e8a0 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbb98168f00 con 0x7fbb9815c470 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9806e490 0x7fbb98147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9806e490 0x7fbb98147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48064/0 (socket says 172.21.15.44:48064) 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 -- 172.21.15.44:0/3342959176 learned_addr learned my addr 172.21.15.44:0/3342959176 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9ce00640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb9806e8a0 0x7fbb981fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9e200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb9815c470 0x7fbb9815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 -- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb9815c470 msgr2=0x7fbb9815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb9815c470 0x7fbb9815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 -- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb9806e8a0 msgr2=0x7fbb981fc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb9806e8a0 0x7fbb981fc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 -- 172.21.15.44:0/3342959176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb980d1740 con 0x7fbb9806e490 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9e200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb9815c470 0x7fbb9815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb9d800640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9806e490 0x7fbb98147680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0b0040 tx=0x7fbb8c0a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb95600640 1 -- 172.21.15.44:0/3342959176 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0b2040 con 0x7fbb9806e490 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb95600640 1 -- 172.21.15.44:0/3342959176 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb8c0bd070 con 0x7fbb9806e490 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb95600640 1 -- 172.21.15.44:0/3342959176 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c003600 con 0x7fbb9806e490 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb980d11e0 con 0x7fbb9806e490 2024-09-17T05:36:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb980d1460 con 0x7fbb9806e490 2024-09-17T05:36:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9806df50 con 0x7fbb9806e490 2024-09-17T05:36:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.506+0000 7fbb95600640 1 -- 172.21.15.44:0/3342959176 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbb8c0037a0 con 0x7fbb9806e490 2024-09-17T05:36:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.510+0000 7fbb95600640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb78073200 0x7fbb78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.510+0000 7fbb95600640 1 -- 172.21.15.44:0/3342959176 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fbb8c12e900 con 0x7fbb9806e490 2024-09-17T05:36:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.510+0000 7fbb9ce00640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb78073200 0x7fbb78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.510+0000 7fbb9ce00640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb78073200 0x7fbb78075710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb980b0030 tx=0x7fbb8400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.514+0000 7fbb95600640 1 -- 172.21.15.44:0/3342959176 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbb980d11e0 con 0x7fbb9806e490 2024-09-17T05:36:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:14.686+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbb980d1e70 con 0x7fbb9806e490 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbb95600640 1 -- 172.21.15.44:0/3342959176 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fbb8c0164d0 con 0x7fbb9806e490 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb78073200 msgr2=0x7fbb78075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb78073200 0x7fbb78075710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb980b0030 tx=0x7fbb8400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9806e490 msgr2=0x7fbb98147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9806e490 0x7fbb98147680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0b0040 tx=0x7fbb8c0a56b0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 shutdown_connections 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb9815c470 0x7fbb9815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb78073200 0x7fbb78075710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb9806e8a0 0x7fbb981fc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.274+0000 7fbba0200640 1 --2- 172.21.15.44:0/3342959176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb9806e490 0x7fbb98147680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.278+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 >> 172.21.15.44:0/3342959176 conn(0x7fbb9809aa40 msgr2=0x7fbb980cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.278+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 shutdown_connections 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.278+0000 7fbba0200640 1 -- 172.21.15.44:0/3342959176 wait complete. 2024-09-17T05:36:15.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-17T05:36:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.474+0000 7f92ac000640 1 -- 172.21.15.44:0/2305934114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f928c003a10 msgr2=0x7f928c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.474+0000 7f92ac000640 1 --2- 172.21.15.44:0/2305934114 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f928c003a10 0x7f928c003e80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9298009b40 tx=0x7f929801d270 comp rx=0 tx=0).stop 2024-09-17T05:36:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.474+0000 7f92aa000640 1 -- 172.21.15.44:0/2305934114 reap_dead start 2024-09-17T05:36:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.474+0000 7f92ac000640 1 -- 172.21.15.44:0/2305934114 shutdown_connections 2024-09-17T05:36:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.474+0000 7f92ac000640 1 -- 172.21.15.44:0/2305934114 >> 172.21.15.44:0/2305934114 conn(0x7f92a40ccaa0 msgr2=0x7f92a40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.474+0000 7f92ac000640 1 -- 172.21.15.44:0/2305934114 shutdown_connections 2024-09-17T05:36:15.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.474+0000 7f92ac000640 1 -- 172.21.15.44:0/2305934114 wait complete. 2024-09-17T05:36:15.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 Processor -- start 2024-09-17T05:36:15.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 -- start start 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f928c003a10 0x7f92a40b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a409fb90 0x7f92a41fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a4157990 0x7f92a4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4166dd0 con 0x7f92a4157990 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4166c50 con 0x7f92a409fb90 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f92a4166f50 con 0x7f928c003a10 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a4157990 0x7f92a4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92a9600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f928c003a10 0x7f92a40b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92a8c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a409fb90 0x7f92a41fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a4157990 0x7f92a4157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48084/0 (socket says 172.21.15.44:48084) 2024-09-17T05:36:15.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 -- 172.21.15.44:0/1365491538 learned_addr learned my addr 172.21.15.44:0/1365491538 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 -- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f928c003a10 msgr2=0x7f92a40b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f928c003a10 0x7f92a40b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 -- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a409fb90 msgr2=0x7f92a41fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a409fb90 0x7f92a41fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 -- 172.21.15.44:0/1365491538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a41582e0 con 0x7f92a4157990 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92a8c00640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a409fb90 0x7f92a41fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92aa000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a4157990 0x7f92a4157da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92a40ca7b0 tx=0x7f929c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92a1600640 1 -- 172.21.15.44:0/1365491538 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c004b30 con 0x7f92a4157990 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92a1600640 1 -- 172.21.15.44:0/1365491538 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f929c004cd0 con 0x7f92a4157990 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a40af0f0 con 0x7f92a4157990 2024-09-17T05:36:15.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92a1600640 1 -- 172.21.15.44:0/1365491538 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c003be0 con 0x7f92a4157990 2024-09-17T05:36:15.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.478+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a40c3c50 con 0x7f92a4157990 2024-09-17T05:36:15.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.482+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a4163040 con 0x7f92a4157990 2024-09-17T05:36:15.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.482+0000 7f92a1600640 1 -- 172.21.15.44:0/1365491538 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f929c004030 con 0x7f92a4157990 2024-09-17T05:36:15.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.482+0000 7f92a1600640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073230 0x7f9284075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.482+0000 7f92a1600640 1 -- 172.21.15.44:0/1365491538 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f929c0951a0 con 0x7f92a4157990 2024-09-17T05:36:15.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.482+0000 7f92a9600640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073230 0x7f9284075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.486+0000 7f92a9600640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073230 0x7f9284075740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9298009b40 tx=0x7f929801a010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.486+0000 7f92a1600640 1 -- 172.21.15.44:0/1365491538 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f929c01f060 con 0x7f92a4157990 2024-09-17T05:36:15.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:15.662+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f92a40cb880 con 0x7f92a4157990 2024-09-17T05:36:16.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.282+0000 7f92a1600640 1 -- 172.21.15.44:0/1365491538 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f92a41582e0 con 0x7f92a4157990 2024-09-17T05:36:16.287 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:36:16.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073230 msgr2=0x7f9284075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073230 0x7f9284075740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9298009b40 tx=0x7f929801a010 comp rx=0 tx=0).stop 2024-09-17T05:36:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a4157990 msgr2=0x7f92a4157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a4157990 0x7f92a4157da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f92a40ca7b0 tx=0x7f929c00f3c0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 shutdown_connections 2024-09-17T05:36:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a4157990 0x7f92a4157da0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073230 0x7f9284075740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a409fb90 0x7f92a41fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 --2- 172.21.15.44:0/1365491538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f928c003a10 0x7f92a40b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.286+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 >> 172.21.15.44:0/1365491538 conn(0x7f92a40ccaa0 msgr2=0x7f92a4159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:16.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.290+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 shutdown_connections 2024-09-17T05:36:16.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.290+0000 7f92ac000640 1 -- 172.21.15.44:0/1365491538 wait complete. 2024-09-17T05:36:16.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 -- 172.21.15.44:0/1472909669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4480cc1e0 msgr2=0x7fb44806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 --2- 172.21.15.44:0/1472909669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4480cc1e0 0x7fb44806fe80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb448072ee0 tx=0x7fb44001ccc0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 -- 172.21.15.44:0/1472909669 shutdown_connections 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 --2- 172.21.15.44:0/1472909669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4480cc1e0 0x7fb44806fe80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 --2- 172.21.15.44:0/1472909669 >> v2:172.21.15.86:3300/0 conn(0x7fb44815a080 0x7fb4480cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 -- 172.21.15.44:0/1472909669 >> 172.21.15.44:0/1472909669 conn(0x7fb4480cd930 msgr2=0x7fb4480cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 -- 172.21.15.44:0/1472909669 shutdown_connections 2024-09-17T05:36:16.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.506+0000 7fb450400640 1 -- 172.21.15.44:0/1472909669 wait complete. 2024-09-17T05:36:16.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 Processor -- start 2024-09-17T05:36:16.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 -- start start 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4480cc1e0 0x7fb4480b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb44815a080 0x7fb44814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb44815d560 0x7fb4481511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb448169870 con 0x7fb44815a080 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481696f0 con 0x7fb4480cc1e0 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb4481699f0 con 0x7fb44815d560 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb44815a080 0x7fb44814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb44815a080 0x7fb44814d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48112/0 (socket says 172.21.15.44:48112) 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 -- 172.21.15.44:0/972534201 learned_addr learned my addr 172.21.15.44:0/972534201 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:16.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44da00640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4480cc1e0 0x7fb4480b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:16.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44e400640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb44815d560 0x7fb4481511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:16.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 -- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb44815d560 msgr2=0x7fb4481511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:16.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb44815d560 0x7fb4481511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 -- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4480cc1e0 msgr2=0x7fb4480b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:16.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4480cc1e0 0x7fb4480b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 -- 172.21.15.44:0/972534201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb448153240 con 0x7fb44815a080 2024-09-17T05:36:16.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb44d000640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb44815a080 0x7fb44814d060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb43400e7f0 tx=0x7fb43400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:16.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb445600640 1 -- 172.21.15.44:0/972534201 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43400ccc0 con 0x7fb44815a080 2024-09-17T05:36:16.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb445600640 1 -- 172.21.15.44:0/972534201 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb43400ce80 con 0x7fb44815a080 2024-09-17T05:36:16.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.510+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb448150fb0 con 0x7fb44815a080 2024-09-17T05:36:16.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.514+0000 7fb445600640 1 -- 172.21.15.44:0/972534201 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434005280 con 0x7fb44815a080 2024-09-17T05:36:16.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.514+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb448150cd0 con 0x7fb44815a080 2024-09-17T05:36:16.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.514+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44806fe80 con 0x7fb44815a080 2024-09-17T05:36:16.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.514+0000 7fb445600640 1 -- 172.21.15.44:0/972534201 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb434005420 con 0x7fb44815a080 2024-09-17T05:36:16.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.518+0000 7fb445600640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb428073200 0x7fb428075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:16.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.518+0000 7fb445600640 1 -- 172.21.15.44:0/972534201 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fb434095070 con 0x7fb44815a080 2024-09-17T05:36:16.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.518+0000 7fb44da00640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb428073200 0x7fb428075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:16.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.518+0000 7fb44da00640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb428073200 0x7fb428075710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb43c007fd0 tx=0x7fb43c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:16.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.518+0000 7fb445600640 1 -- 172.21.15.44:0/972534201 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb43405fa80 con 0x7fb44815a080 2024-09-17T05:36:16.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:16.738+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb44806cfe0 con 0x7fb44815a080 2024-09-17T05:36:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb445600640 1 -- 172.21.15.44:0/972534201 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb4340644b0 con 0x7fb44815a080 2024-09-17T05:36:17.290 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb428073200 msgr2=0x7fb428075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb428073200 0x7fb428075710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb43c007fd0 tx=0x7fb43c009040 comp rx=0 tx=0).stop 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb44815a080 msgr2=0x7fb44814d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb44815a080 0x7fb44814d060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb43400e7f0 tx=0x7fb43400ecb0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 shutdown_connections 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb44815d560 0x7fb4481511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb44815a080 0x7fb44814d060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb428073200 0x7fb428075710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 --2- 172.21.15.44:0/972534201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4480cc1e0 0x7fb4480b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 >> 172.21.15.44:0/972534201 conn(0x7fb4480cd930 msgr2=0x7fb4480cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:17.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 shutdown_connections 2024-09-17T05:36:17.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.286+0000 7fb450400640 1 -- 172.21.15.44:0/972534201 wait complete. 2024-09-17T05:36:17.356 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-17T05:36:17.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-17T05:36:17.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 -- 172.21.15.44:0/361859143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0741e0 msgr2=0x7f57ac0cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 --2- 172.21.15.44:0/361859143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0741e0 0x7f57ac0cf670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f57ac15d590 tx=0x7f57a401cd10 comp rx=0 tx=0).stop 2024-09-17T05:36:17.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 -- 172.21.15.44:0/361859143 shutdown_connections 2024-09-17T05:36:17.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 --2- 172.21.15.44:0/361859143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0741e0 0x7f57ac0cf670 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 --2- 172.21.15.44:0/361859143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ac06e560 0x7f57ac0afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 -- 172.21.15.44:0/361859143 >> 172.21.15.44:0/361859143 conn(0x7f57ac0736c0 msgr2=0x7f57ac073ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 -- 172.21.15.44:0/361859143 shutdown_connections 2024-09-17T05:36:17.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 -- 172.21.15.44:0/361859143 wait complete. 2024-09-17T05:36:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 Processor -- start 2024-09-17T05:36:17.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.518+0000 7f57b3600640 1 -- start start 2024-09-17T05:36:17.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ac0741e0 0x7f57ac15f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0746f0 0x7f57ac13d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ac152500 0x7f57ac13d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac16a480 con 0x7f57ac0746f0 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac16a300 con 0x7f57ac152500 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f57ac16a600 con 0x7f57ac0741e0 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0746f0 0x7f57ac13d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0746f0 0x7f57ac13d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48128/0 (socket says 172.21.15.44:48128) 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 -- 172.21.15.44:0/3918133224 learned_addr learned my addr 172.21.15.44:0/3918133224 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b0c00640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ac0741e0 0x7f57ac15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b1600640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ac152500 0x7f57ac13d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 -- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ac0741e0 msgr2=0x7f57ac15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ac0741e0 0x7f57ac15f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 -- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ac152500 msgr2=0x7f57ac13d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ac152500 0x7f57ac13d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 -- 172.21.15.44:0/3918133224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ac15e5a0 con 0x7f57ac0746f0 2024-09-17T05:36:17.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57abe00640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0746f0 0x7f57ac13d370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57980058d0 tx=0x7f579800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:17.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57a8c00640 1 -- 172.21.15.44:0/3918133224 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5798017070 con 0x7f57ac0746f0 2024-09-17T05:36:17.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57a8c00640 1 -- 172.21.15.44:0/3918133224 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5798009d20 con 0x7f57ac0746f0 2024-09-17T05:36:17.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ac15e880 con 0x7f57ac0746f0 2024-09-17T05:36:17.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57a8c00640 1 -- 172.21.15.44:0/3918133224 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57980106c0 con 0x7f57ac0746f0 2024-09-17T05:36:17.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ac15ee40 con 0x7f57ac0746f0 2024-09-17T05:36:17.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.522+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ac0afeb0 con 0x7f57ac0746f0 2024-09-17T05:36:17.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.526+0000 7f57a8c00640 1 -- 172.21.15.44:0/3918133224 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f579801a070 con 0x7f57ac0746f0 2024-09-17T05:36:17.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.526+0000 7f57a8c00640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f578c073200 0x7f578c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.526+0000 7f57a8c00640 1 -- 172.21.15.44:0/3918133224 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5798094360 con 0x7f57ac0746f0 2024-09-17T05:36:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.526+0000 7f57b0c00640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f578c073200 0x7f578c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.526+0000 7f57b0c00640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f578c073200 0x7f578c075710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007fd0 tx=0x7f57a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:17.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.530+0000 7f57a8c00640 1 -- 172.21.15.44:0/3918133224 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f579805ec90 con 0x7f57ac0746f0 2024-09-17T05:36:17.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:17.714+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f57ac06ae00 con 0x7f57ac0746f0 2024-09-17T05:36:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.302+0000 7f57a8c00640 1 -- 172.21.15.44:0/3918133224 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f57980636c0 con 0x7f57ac0746f0 2024-09-17T05:36:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f578c073200 msgr2=0x7f578c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f578c073200 0x7f578c075710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007fd0 tx=0x7f57a0009040 comp rx=0 tx=0).stop 2024-09-17T05:36:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0746f0 msgr2=0x7f57ac13d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0746f0 0x7f57ac13d370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57980058d0 tx=0x7f579800dde0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 shutdown_connections 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f578c073200 0x7f578c075710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ac152500 0x7f57ac13d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ac0746f0 0x7f57ac13d370 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57980058d0 tx=0x7f579800dde0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 --2- 172.21.15.44:0/3918133224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ac0741e0 0x7f57ac15f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 >> 172.21.15.44:0/3918133224 conn(0x7f57ac0736c0 msgr2=0x7f57ac15b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 shutdown_connections 2024-09-17T05:36:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.306+0000 7f57b3600640 1 -- 172.21.15.44:0/3918133224 wait complete. 2024-09-17T05:36:18.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 -- 172.21.15.44:0/3134693594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f813015fcb0 msgr2=0x7f8130152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 --2- 172.21.15.44:0/3134693594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f813015fcb0 0x7f8130152d70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8128009c80 tx=0x7f812801ccd0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 -- 172.21.15.44:0/3134693594 shutdown_connections 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 --2- 172.21.15.44:0/3134693594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f813015fcb0 0x7f8130152d70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 --2- 172.21.15.44:0/3134693594 >> v2:172.21.15.86:3300/0 conn(0x7f81300cf6c0 0x7f813015f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 -- 172.21.15.44:0/3134693594 >> 172.21.15.44:0/3134693594 conn(0x7f81300b4160 msgr2=0x7f81300b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 -- 172.21.15.44:0/3134693594 shutdown_connections 2024-09-17T05:36:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.506+0000 7f8135800640 1 -- 172.21.15.44:0/3134693594 wait complete. 2024-09-17T05:36:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 Processor -- start 2024-09-17T05:36:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 -- start start 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f813015fcb0 0x7f813014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8130156330 0x7f8130150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8130156740 0x7f8130151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f813015e140 con 0x7f8130156740 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f813015dfc0 con 0x7f813015fcb0 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f813016a1d0 con 0x7f8130156330 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8130156740 0x7f8130151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f813015fcb0 0x7f813014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f813015fcb0 0x7f813014e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:37926/0 (socket says 172.21.15.44:37926) 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8126000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8130156330 0x7f8130150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812ea00640 1 -- 172.21.15.44:0/3791206584 learned_addr learned my addr 172.21.15.44:0/3791206584 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8130156740 0x7f8130151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48144/0 (socket says 172.21.15.44:48144) 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 -- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8130156330 msgr2=0x7f8130150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8130156330 0x7f8130150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 -- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f813015fcb0 msgr2=0x7f813014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f813015fcb0 0x7f813014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 -- 172.21.15.44:0/3791206584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813014f260 con 0x7f8130156740 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8126000640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8130156330 0x7f8130150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812ea00640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f813015fcb0 0x7f813014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f812f400640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8130156740 0x7f8130151400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81280ac000 tx=0x7f81280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8127400640 1 -- 172.21.15.44:0/3791206584 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280bc070 con 0x7f8130156740 2024-09-17T05:36:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8127400640 1 -- 172.21.15.44:0/3791206584 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81280044e0 con 0x7f8130156740 2024-09-17T05:36:18.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813014f540 con 0x7f8130156740 2024-09-17T05:36:18.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8127400640 1 -- 172.21.15.44:0/3791206584 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280b2040 con 0x7f8130156740 2024-09-17T05:36:18.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.510+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813014fb00 con 0x7f8130156740 2024-09-17T05:36:18.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.514+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81300d1cd0 con 0x7f8130156740 2024-09-17T05:36:18.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.514+0000 7f8127400640 1 -- 172.21.15.44:0/3791206584 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f81280bf070 con 0x7f8130156740 2024-09-17T05:36:18.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.514+0000 7f8127400640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073200 0x7f810c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.514+0000 7f8127400640 1 -- 172.21.15.44:0/3791206584 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f812812e290 con 0x7f8130156740 2024-09-17T05:36:18.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.514+0000 7f812ea00640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073200 0x7f810c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.514+0000 7f812ea00640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073200 0x7f810c075710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8120001c60 tx=0x7f8120009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.518+0000 7f8127400640 1 -- 172.21.15.44:0/3791206584 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8128016950 con 0x7f8130156740 2024-09-17T05:36:18.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:18.694+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f81300b4830 con 0x7f8130156740 2024-09-17T05:36:20.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.318+0000 7f8127400640 1 -- 172.21.15.44:0/3791206584 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f81280f8a90 con 0x7f8130156740 2024-09-17T05:36:20.324 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' created 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073200 msgr2=0x7f810c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073200 0x7f810c075710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8120001c60 tx=0x7f8120009040 comp rx=0 tx=0).stop 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8130156740 msgr2=0x7f8130151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8130156740 0x7f8130151400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81280ac000 tx=0x7f81280042f0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 shutdown_connections 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8130156740 0x7f8130151400 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8130156330 0x7f8130150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073200 0x7f810c075710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 --2- 172.21.15.44:0/3791206584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f813015fcb0 0x7f813014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 >> 172.21.15.44:0/3791206584 conn(0x7f81300b4160 msgr2=0x7f8130071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:20.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 shutdown_connections 2024-09-17T05:36:20.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.322+0000 7f8135800640 1 -- 172.21.15.44:0/3791206584 wait complete. 2024-09-17T05:36:20.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-17T05:36:20.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 -- 172.21.15.44:0/1920397709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 msgr2=0x7f54bc160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:20.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 --2- 172.21.15.44:0/1920397709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 0x7f54bc160000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009900 tx=0x7f54a401c8b0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 -- 172.21.15.44:0/1920397709 shutdown_connections 2024-09-17T05:36:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 --2- 172.21.15.44:0/1920397709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 0x7f54bc160000 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 --2- 172.21.15.44:0/1920397709 >> v2:172.21.15.86:3300/0 conn(0x7f54bc156980 0x7f54bc0cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 -- 172.21.15.44:0/1920397709 >> 172.21.15.44:0/1920397709 conn(0x7f54bc0cec30 msgr2=0x7f54bc0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 -- 172.21.15.44:0/1920397709 shutdown_connections 2024-09-17T05:36:20.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.526+0000 7f54c2200640 1 -- 172.21.15.44:0/1920397709 wait complete. 2024-09-17T05:36:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 Processor -- start 2024-09-17T05:36:20.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 -- start start 2024-09-17T05:36:20.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 0x7f54bc0cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:20.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc156980 0x7f54bc071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:20.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54bc160540 0x7f54bc159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:20.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc169bb0 con 0x7f54bc156980 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0d1100 con 0x7f54bc160540 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc169d30 con 0x7f54bc0ccd40 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc156980 0x7f54bc071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc156980 0x7f54bc071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36536/0 (socket says 172.21.15.44:36536) 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 -- 172.21.15.44:0/681759127 learned_addr learned my addr 172.21.15.44:0/681759127 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54bb400640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 0x7f54bc0cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54bbe00640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54bc160540 0x7f54bc159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 -- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 msgr2=0x7f54bc0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 0x7f54bc0cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 -- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54bc160540 msgr2=0x7f54bc159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54bc160540 0x7f54bc159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 -- 172.21.15.44:0/681759127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0cbb30 con 0x7f54bc156980 2024-09-17T05:36:20.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3e00640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc156980 0x7f54bc071470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009850 tx=0x7f54a4005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3400640 1 -- 172.21.15.44:0/681759127 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a40b2040 con 0x7f54bc156980 2024-09-17T05:36:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3400640 1 -- 172.21.15.44:0/681759127 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54a4005020 con 0x7f54bc156980 2024-09-17T05:36:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54b3400640 1 -- 172.21.15.44:0/681759127 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4005430 con 0x7f54bc156980 2024-09-17T05:36:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc0b7160 con 0x7f54bc156980 2024-09-17T05:36:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.530+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc0b7720 con 0x7f54bc156980 2024-09-17T05:36:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.534+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc160000 con 0x7f54bc156980 2024-09-17T05:36:20.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.534+0000 7f54b3400640 1 -- 172.21.15.44:0/681759127 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f54a40bf030 con 0x7f54bc156980 2024-09-17T05:36:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.534+0000 7f54b3400640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5498073200 0x7f5498075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:20.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.534+0000 7f54b3400640 1 -- 172.21.15.44:0/681759127 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f54a412ebc0 con 0x7f54bc156980 2024-09-17T05:36:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.534+0000 7f54bb400640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5498073200 0x7f5498075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:20.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.538+0000 7f54bb400640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5498073200 0x7f5498075710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009b40 tx=0x7f54ac0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:20.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.542+0000 7f54b3400640 1 -- 172.21.15.44:0/681759127 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f54a40c6060 con 0x7f54bc156980 2024-09-17T05:36:20.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:20.714+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f54bc06ade0 con 0x7f54bc156980 2024-09-17T05:36:21.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.326+0000 7f54b3400640 1 -- 172.21.15.44:0/681759127 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f54a40164d0 con 0x7f54bc156980 2024-09-17T05:36:21.333 INFO:teuthology.orchestra.run.smithi044.stderr:set pool 4 allow_ec_overwrites to true 2024-09-17T05:36:21.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.330+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5498073200 msgr2=0x7f5498075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.330+0000 7f54c2200640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5498073200 0x7f5498075710 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009b40 tx=0x7f54ac0091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.330+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc156980 msgr2=0x7f54bc071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.330+0000 7f54c2200640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc156980 0x7f54bc071470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009850 tx=0x7f54a4005de0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 shutdown_connections 2024-09-17T05:36:21.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5498073200 0x7f5498075710 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54bc160540 0x7f54bc159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc156980 0x7f54bc071470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 --2- 172.21.15.44:0/681759127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54bc0ccd40 0x7f54bc0cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 >> 172.21.15.44:0/681759127 conn(0x7f54bc0cec30 msgr2=0x7f54bc152690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:21.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 shutdown_connections 2024-09-17T05:36:21.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.334+0000 7f54c2200640 1 -- 172.21.15.44:0/681759127 wait complete. 2024-09-17T05:36:21.384 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 -- 172.21.15.44:0/3915354091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4073910 msgr2=0x7fe1a40afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 --2- 172.21.15.44:0/3915354091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4073910 0x7fe1a40afad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40cf060 tx=0x7fe19001c7e0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 -- 172.21.15.44:0/3915354091 shutdown_connections 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 --2- 172.21.15.44:0/3915354091 >> v2:172.21.15.86:3300/0 conn(0x7fe1a40b39c0 0x7fe1a40b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 --2- 172.21.15.44:0/3915354091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a4073910 0x7fe1a40afad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 -- 172.21.15.44:0/3915354091 >> 172.21.15.44:0/3915354091 conn(0x7fe1a40ccf30 msgr2=0x7fe1a40cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 -- 172.21.15.44:0/3915354091 shutdown_connections 2024-09-17T05:36:21.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.542+0000 7fe1abe00640 1 -- 172.21.15.44:0/3915354091 wait complete. 2024-09-17T05:36:21.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 Processor -- start 2024-09-17T05:36:21.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 -- start start 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a40b39c0 0x7fe1a414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a40ce060 0x7fe1a4143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a414a4c0 0x7fe1a4144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a41690a0 con 0x7fe1a40b39c0 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4168f20 con 0x7fe1a40ce060 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a4169220 con 0x7fe1a414a4c0 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a40b39c0 0x7fe1a414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a40b39c0 0x7fe1a414bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36544/0 (socket says 172.21.15.44:36544) 2024-09-17T05:36:21.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 -- 172.21.15.44:0/2942981562 learned_addr learned my addr 172.21.15.44:0/2942981562 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9e00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a414a4c0 0x7fe1a4144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a8a00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a40ce060 0x7fe1a4143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 -- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a414a4c0 msgr2=0x7fe1a4144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a414a4c0 0x7fe1a4144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 -- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a40ce060 msgr2=0x7fe1a4143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a40ce060 0x7fe1a4143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 -- 172.21.15.44:0/2942981562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a414aa60 con 0x7fe1a40b39c0 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a8a00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a40ce060 0x7fe1a4143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9e00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a414a4c0 0x7fe1a4144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a9400640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a40b39c0 0x7fe1a414bb00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe19800c460 tx=0x7fe19800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a1600640 1 -- 172.21.15.44:0/2942981562 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198016020 con 0x7fe1a40b39c0 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a1600640 1 -- 172.21.15.44:0/2942981562 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe198012940 con 0x7fe1a40b39c0 2024-09-17T05:36:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a414ad40 con 0x7fe1a40b39c0 2024-09-17T05:36:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1a1600640 1 -- 172.21.15.44:0/2942981562 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe198012d90 con 0x7fe1a40b39c0 2024-09-17T05:36:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.546+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a414b300 con 0x7fe1a40b39c0 2024-09-17T05:36:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.550+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a40afad0 con 0x7fe1a40b39c0 2024-09-17T05:36:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.550+0000 7fe1a1600640 1 -- 172.21.15.44:0/2942981562 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe198019020 con 0x7fe1a40b39c0 2024-09-17T05:36:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.550+0000 7fe1a1600640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.550+0000 7fe1a1600640 1 -- 172.21.15.44:0/2942981562 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fe198094550 con 0x7fe1a40b39c0 2024-09-17T05:36:21.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.550+0000 7fe1a8a00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.554+0000 7fe1a8a00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1900af000 tx=0x7fe19001b020 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:21.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.554+0000 7fe1a1600640 1 -- 172.21.15.44:0/2942981562 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe198020020 con 0x7fe1a40b39c0 2024-09-17T05:36:21.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:21.766+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fe1a40b1cd0 con 0x7fe1a40b39c0 2024-09-17T05:36:22.263 INFO:tasks.ceph.mds.d.smithi086.stderr:2024-09-17T05:36:22.260+0000 7f9625a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:36:22.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.338+0000 7fe1a1600640 1 -- 172.21.15.44:0/2942981562 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fe19805f270 con 0x7fe1a40b39c0 2024-09-17T05:36:22.345 INFO:teuthology.orchestra.run.smithi044.stderr:added data pool 4 to fsmap 2024-09-17T05:36:22.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 msgr2=0x7fe184075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1900af000 tx=0x7fe19001b020 comp rx=0 tx=0).stop 2024-09-17T05:36:22.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a40b39c0 msgr2=0x7fe1a414bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a40b39c0 0x7fe1a414bb00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe19800c460 tx=0x7fe19800c920 comp rx=0 tx=0).stop 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 shutdown_connections 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a414a4c0 0x7fe1a4144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a40ce060 0x7fe1a4143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 --2- 172.21.15.44:0/2942981562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a40b39c0 0x7fe1a414bb00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 >> 172.21.15.44:0/2942981562 conn(0x7fe1a40ccf30 msgr2=0x7fe1a40b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 shutdown_connections 2024-09-17T05:36:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.342+0000 7fe1abe00640 1 -- 172.21.15.44:0/2942981562 wait complete. 2024-09-17T05:36:22.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:22.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 -- 172.21.15.44:0/185355873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 msgr2=0x7f07940cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 --2- 172.21.15.44:0/185355873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 0x7f07940cf070 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f077c009900 tx=0x7f077c01c820 comp rx=0 tx=0).stop 2024-09-17T05:36:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 -- 172.21.15.44:0/185355873 shutdown_connections 2024-09-17T05:36:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 --2- 172.21.15.44:0/185355873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 0x7f07940cf070 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 --2- 172.21.15.44:0/185355873 >> v2:172.21.15.86:3300/0 conn(0x7f07940d18f0 0x7f07940b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 -- 172.21.15.44:0/185355873 >> 172.21.15.44:0/185355873 conn(0x7f07940b4240 msgr2=0x7f07940b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 -- 172.21.15.44:0/185355873 shutdown_connections 2024-09-17T05:36:22.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.526+0000 7f0798c00640 1 -- 172.21.15.44:0/185355873 wait complete. 2024-09-17T05:36:22.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 Processor -- start 2024-09-17T05:36:22.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 -- start start 2024-09-17T05:36:22.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07940cf5b0 0x7f079406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07940d18f0 0x7f07940cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 0x7f07941f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0794169ee0 con 0x7f07940d18f0 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0794169d60 con 0x7f07940cf5b0 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f0798c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f079416a060 con 0x7f07940d1d00 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f078be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07940d18f0 0x7f07940cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f078be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07940d18f0 0x7f07940cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36548/0 (socket says 172.21.15.44:36548) 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.530+0000 7f078be00640 1 -- 172.21.15.44:0/823133365 learned_addr learned my addr 172.21.15.44:0/823133365 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f0791e00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07940cf5b0 0x7f079406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f0792800640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 0x7f07941f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078be00640 1 -- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 msgr2=0x7f07941f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078be00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 0x7f07941f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078be00640 1 -- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07940cf5b0 msgr2=0x7f079406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078be00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07940cf5b0 0x7f079406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078be00640 1 -- 172.21.15.44:0/823133365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07941f97e0 con 0x7f07940d18f0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078be00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07940d18f0 0x7f07940cbfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f077c009850 tx=0x7f077c0a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078a000640 1 -- 172.21.15.44:0/823133365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c0b2040 con 0x7f07940d18f0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078a000640 1 -- 172.21.15.44:0/823133365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f077c0042c0 con 0x7f07940d18f0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07941f9ac0 con 0x7f07940d18f0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078a000640 1 -- 172.21.15.44:0/823133365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c005030 con 0x7f07940d18f0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079415dd80 con 0x7f07940d18f0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07940b1be0 con 0x7f07940d18f0 2024-09-17T05:36:22.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.534+0000 7f078a000640 1 -- 172.21.15.44:0/823133365 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f077c0051f0 con 0x7f07940d18f0 2024-09-17T05:36:22.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.538+0000 7f078a000640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0770073230 0x7f0770075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.538+0000 7f078a000640 1 -- 172.21.15.44:0/823133365 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f077c12dfe0 con 0x7f07940d18f0 2024-09-17T05:36:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.538+0000 7f0791e00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0770073230 0x7f0770075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.538+0000 7f0791e00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0770073230 0x7f0770075740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0784009b40 tx=0x7f07840091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.542+0000 7f078a000640 1 -- 172.21.15.44:0/823133365 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f077c0164d0 con 0x7f07940d18f0 2024-09-17T05:36:22.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.754+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f079415c000 con 0x7f07940d18f0 2024-09-17T05:36:22.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.754+0000 7f078a000640 1 -- 172.21.15.44:0/823133365 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5216 (secure 0 0 0) 0x7f077c0f8d60 con 0x7f07940d18f0 2024-09-17T05:36:22.761 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:22.761 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"btime":"2024-09-17T05:36:22:334321+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:21.773966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:22.761 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-17T05:36:22.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0770073230 msgr2=0x7f0770075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0770073230 0x7f0770075740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0784009b40 tx=0x7f07840091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07940d18f0 msgr2=0x7f07940cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07940d18f0 0x7f07940cbfc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f077c009850 tx=0x7f077c0a55f0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 shutdown_connections 2024-09-17T05:36:22.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07940d1d00 0x7f07941f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07940d18f0 0x7f07940cbfc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0770073230 0x7f0770075740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 --2- 172.21.15.44:0/823133365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07940cf5b0 0x7f079406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 >> 172.21.15.44:0/823133365 conn(0x7f07940b4240 msgr2=0x7f07940b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 shutdown_connections 2024-09-17T05:36:22.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.758+0000 7f0798c00640 1 -- 172.21.15.44:0/823133365 wait complete. 2024-09-17T05:36:22.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 -- 172.21.15.44:0/3049413320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280d1d00 msgr2=0x7f10280cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 --2- 172.21.15.44:0/3049413320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280d1d00 0x7f10280cf070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1010009870 tx=0x7f101001c7a0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 -- 172.21.15.44:0/3049413320 shutdown_connections 2024-09-17T05:36:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 --2- 172.21.15.44:0/3049413320 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280d1d00 0x7f10280cf070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 -- 172.21.15.44:0/3049413320 >> 172.21.15.44:0/3049413320 conn(0x7f10280b4240 msgr2=0x7f10280b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 -- 172.21.15.44:0/3049413320 shutdown_connections 2024-09-17T05:36:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 -- 172.21.15.44:0/3049413320 wait complete. 2024-09-17T05:36:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 Processor -- start 2024-09-17T05:36:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.938+0000 7f102de00640 1 -- start start 2024-09-17T05:36:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280cf5b0 0x7f10280cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10280d18f0 0x7f10280b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10280d1d00 0x7f10280b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f102816b0d0 con 0x7f10280d1d00 2024-09-17T05:36:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f102816af50 con 0x7f10280d18f0 2024-09-17T05:36:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f102816b250 con 0x7f10280cf5b0 2024-09-17T05:36:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10280d1d00 0x7f10280b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10280d1d00 0x7f10280b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36552/0 (socket says 172.21.15.44:36552) 2024-09-17T05:36:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 -- 172.21.15.44:0/3405804810 learned_addr learned my addr 172.21.15.44:0/3405804810 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1026a00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280cf5b0 0x7f10280cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f101fe00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10280d18f0 0x7f10280b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 -- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280cf5b0 msgr2=0x7f10280cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280cf5b0 0x7f10280cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 -- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10280d18f0 msgr2=0x7f10280b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10280d18f0 0x7f10280b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 -- 172.21.15.44:0/3405804810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10280cc590 con 0x7f10280d1d00 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1026a00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280cf5b0 0x7f10280cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f101fe00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10280d18f0 0x7f10280b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f1027400640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10280d1d00 0x7f10280b6250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1020001470 tx=0x7f102000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f101f400640 1 -- 172.21.15.44:0/3405804810 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020016020 con 0x7f10280d1d00 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f101f400640 1 -- 172.21.15.44:0/3405804810 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f102000aa50 con 0x7f10280d1d00 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f101f400640 1 -- 172.21.15.44:0/3405804810 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020012420 con 0x7f10280d1d00 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1028165770 con 0x7f10280d1d00 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1028165d30 con 0x7f10280d1d00 2024-09-17T05:36:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.942+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10280cf070 con 0x7f10280d1d00 2024-09-17T05:36:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.946+0000 7f101f400640 1 -- 172.21.15.44:0/3405804810 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1020019020 con 0x7f10280d1d00 2024-09-17T05:36:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.946+0000 7f101f400640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1004073200 0x7f1004075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.946+0000 7f101f400640 1 -- 172.21.15.44:0/3405804810 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f10200948e0 con 0x7f10280d1d00 2024-09-17T05:36:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.946+0000 7f1026a00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1004073200 0x7f1004075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.946+0000 7f1026a00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1004073200 0x7f1004075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1018000c10 tx=0x7f1018009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:22.950+0000 7f101f400640 1 -- 172.21.15.44:0/3405804810 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1020020020 con 0x7f10280d1d00 2024-09-17T05:36:23.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.126+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1028159b60 con 0x7f10280d1d00 2024-09-17T05:36:23.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.126+0000 7f101f400640 1 -- 172.21.15.44:0/3405804810 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7f10280cf9c0 con 0x7f10280d1d00 2024-09-17T05:36:23.133 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:23.133 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1004073200 msgr2=0x7f1004075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1004073200 0x7f1004075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1018000c10 tx=0x7f1018009040 comp rx=0 tx=0).stop 2024-09-17T05:36:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10280d1d00 msgr2=0x7f10280b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10280d1d00 0x7f10280b6250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1020001470 tx=0x7f102000ccc0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 shutdown_connections 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10280d1d00 0x7f10280b6250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1004073200 0x7f1004075710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10280d18f0 0x7f10280b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 --2- 172.21.15.44:0/3405804810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f10280cf5b0 0x7f10280cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 >> 172.21.15.44:0/3405804810 conn(0x7f10280b4240 msgr2=0x7f10280b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 shutdown_connections 2024-09-17T05:36:23.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.130+0000 7f102de00640 1 -- 172.21.15.44:0/3405804810 wait complete. 2024-09-17T05:36:23.156 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 -- 172.21.15.44:0/1454419070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc06e160 msgr2=0x7f3bfc15f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 --2- 172.21.15.44:0/1454419070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc06e160 0x7f3bfc15f7f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009bc0 tx=0x7f3bf401ca80 comp rx=0 tx=0).stop 2024-09-17T05:36:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 -- 172.21.15.44:0/1454419070 shutdown_connections 2024-09-17T05:36:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 --2- 172.21.15.44:0/1454419070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc06e160 0x7f3bfc15f7f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 -- 172.21.15.44:0/1454419070 >> 172.21.15.44:0/1454419070 conn(0x7f3bfc0d1120 msgr2=0x7f3bfc0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 -- 172.21.15.44:0/1454419070 shutdown_connections 2024-09-17T05:36:23.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 -- 172.21.15.44:0/1454419070 wait complete. 2024-09-17T05:36:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 Processor -- start 2024-09-17T05:36:23.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.310+0000 7f3c02200640 1 -- start start 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bfc06e160 0x7f3bfc1601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bfc072190 0x7f3bfc145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc159b80 0x7f3bfc15f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc169f60 con 0x7f3bfc159b80 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc169de0 con 0x7f3bfc06e160 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3bfc16a0e0 con 0x7f3bfc072190 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc159b80 0x7f3bfc15f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bf2a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bfc072190 0x7f3bfc145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc159b80 0x7f3bfc15f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36574/0 (socket says 172.21.15.44:36574) 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 -- 172.21.15.44:0/3184159785 learned_addr learned my addr 172.21.15.44:0/3184159785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:23.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bfc06e160 0x7f3bfc1601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 -- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bfc072190 msgr2=0x7f3bfc145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bfc072190 0x7f3bfc145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 -- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bfc06e160 msgr2=0x7f3bfc1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bfc06e160 0x7f3bfc1601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 -- 172.21.15.44:0/3184159785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bfc160830 con 0x7f3bfc159b80 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bfbe00640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc159b80 0x7f3bfc15f070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40b0040 tx=0x7f3bf4005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bf3e00640 1 -- 172.21.15.44:0/3184159785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40ba020 con 0x7f3bfc159b80 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bf3e00640 1 -- 172.21.15.44:0/3184159785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bf4004330 con 0x7f3bfc159b80 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bf3e00640 1 -- 172.21.15.44:0/3184159785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40b2040 con 0x7f3bfc159b80 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bfc1486f0 con 0x7f3bfc159b80 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bfc148c70 con 0x7f3bfc159b80 2024-09-17T05:36:23.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc0cecf0 con 0x7f3bfc159b80 2024-09-17T05:36:23.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.314+0000 7f3bf3e00640 1 -- 172.21.15.44:0/3184159785 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3bf40bd020 con 0x7f3bfc159b80 2024-09-17T05:36:23.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.318+0000 7f3bf3e00640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bd8073230 0x7f3bd8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.318+0000 7f3bf3e00640 1 -- 172.21.15.44:0/3184159785 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3bf412ed30 con 0x7f3bfc159b80 2024-09-17T05:36:23.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.318+0000 7f3bfb400640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bd8073230 0x7f3bd8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.318+0000 7f3bfb400640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bd8073230 0x7f3bd8075740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0046c0 tx=0x7f3bec007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.322+0000 7f3bf3e00640 1 -- 172.21.15.44:0/3184159785 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3bf40c4030 con 0x7f3bfc159b80 2024-09-17T05:36:23.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.494+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bfc0d1db0 con 0x7f3bfc159b80 2024-09-17T05:36:23.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3bf3e00640 1 -- 172.21.15.44:0/3184159785 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7f3bf4016790 con 0x7f3bfc159b80 2024-09-17T05:36:23.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:23.502 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bd8073230 msgr2=0x7f3bd8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bd8073230 0x7f3bd8075740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0046c0 tx=0x7f3bec007cd0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc159b80 msgr2=0x7f3bfc15f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc159b80 0x7f3bfc15f070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40b0040 tx=0x7f3bf4005ae0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 shutdown_connections 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3bfc159b80 0x7f3bfc15f070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3bfc072190 0x7f3bfc145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bd8073230 0x7f3bd8075740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 --2- 172.21.15.44:0/3184159785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bfc06e160 0x7f3bfc1601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 >> 172.21.15.44:0/3184159785 conn(0x7f3bfc0d1120 msgr2=0x7f3bfc06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 shutdown_connections 2024-09-17T05:36:23.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.498+0000 7f3c02200640 1 -- 172.21.15.44:0/3184159785 wait complete. 2024-09-17T05:36:23.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:23.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 -- 172.21.15.44:0/2342784993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70072e50 msgr2=0x7f9a7015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 --2- 172.21.15.44:0/2342784993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70072e50 0x7f9a7015e990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009840 tx=0x7f9a6001c790 comp rx=0 tx=0).stop 2024-09-17T05:36:23.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 -- 172.21.15.44:0/2342784993 shutdown_connections 2024-09-17T05:36:23.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 --2- 172.21.15.44:0/2342784993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a700cb470 0x7f9a700cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 --2- 172.21.15.44:0/2342784993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a70072e50 0x7f9a7015e990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 -- 172.21.15.44:0/2342784993 >> 172.21.15.44:0/2342784993 conn(0x7f9a700ccaa0 msgr2=0x7f9a700cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 -- 172.21.15.44:0/2342784993 shutdown_connections 2024-09-17T05:36:23.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 -- 172.21.15.44:0/2342784993 wait complete. 2024-09-17T05:36:23.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 Processor -- start 2024-09-17T05:36:23.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.694+0000 7f9a77000640 1 -- start start 2024-09-17T05:36:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a7006de50 0x7f9a701fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a70072e50 0x7f9a70155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a700cb470 0x7f9a70155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70168f70 con 0x7f9a700cb470 2024-09-17T05:36:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a70168df0 con 0x7f9a7006de50 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9a701690f0 con 0x7f9a70072e50 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a700cb470 0x7f9a70155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a700cb470 0x7f9a70155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36582/0 (socket says 172.21.15.44:36582) 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 -- 172.21.15.44:0/2438196737 learned_addr learned my addr 172.21.15.44:0/2438196737 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a67400640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a70072e50 0x7f9a70155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a6fe00640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a7006de50 0x7f9a701fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 -- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a70072e50 msgr2=0x7f9a70155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a70072e50 0x7f9a70155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 -- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a7006de50 msgr2=0x7f9a701fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a7006de50 0x7f9a701fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 -- 172.21.15.44:0/2438196737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7015ee50 con 0x7f9a700cb470 2024-09-17T05:36:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a75000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a700cb470 0x7f9a70155b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800e970 tx=0x7f9a6800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a6cc00640 1 -- 172.21.15.44:0/2438196737 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68004d30 con 0x7f9a700cb470 2024-09-17T05:36:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a6cc00640 1 -- 172.21.15.44:0/2438196737 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a6800cb20 con 0x7f9a700cb470 2024-09-17T05:36:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a6cc00640 1 -- 172.21.15.44:0/2438196737 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68005020 con 0x7f9a700cb470 2024-09-17T05:36:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7009e3e0 con 0x7f9a700cb470 2024-09-17T05:36:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7009e6a0 con 0x7f9a700cb470 2024-09-17T05:36:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a700cb880 con 0x7f9a700cb470 2024-09-17T05:36:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.698+0000 7f9a6cc00640 1 -- 172.21.15.44:0/2438196737 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9a680051c0 con 0x7f9a700cb470 2024-09-17T05:36:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.702+0000 7f9a6cc00640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a4c073200 0x7f9a4c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.702+0000 7f9a6cc00640 1 -- 172.21.15.44:0/2438196737 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9a68094e60 con 0x7f9a700cb470 2024-09-17T05:36:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.702+0000 7f9a6fe00640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a4c073200 0x7f9a4c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.702+0000 7f9a6fe00640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a4c073200 0x7f9a4c075710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a600af000 tx=0x7f9a6001afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.706+0000 7f9a6cc00640 1 -- 172.21.15.44:0/2438196737 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9a7015ee50 con 0x7f9a700cb470 2024-09-17T05:36:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a701fd2d0 con 0x7f9a700cb470 2024-09-17T05:36:23.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a6cc00640 1 -- 172.21.15.44:0/2438196737 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5216 (secure 0 0 0) 0x7f9a68016030 con 0x7f9a700cb470 2024-09-17T05:36:23.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:23.919 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"btime":"2024-09-17T05:36:22:334321+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:21.773966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:23.920 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-09-17T05:36:23.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a4c073200 msgr2=0x7f9a4c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a4c073200 0x7f9a4c075710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a600af000 tx=0x7f9a6001afd0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a700cb470 msgr2=0x7f9a70155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a700cb470 0x7f9a70155b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800e970 tx=0x7f9a6800ee30 comp rx=0 tx=0).stop 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 shutdown_connections 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a700cb470 0x7f9a70155b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a70072e50 0x7f9a70155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a4c073200 0x7f9a4c075710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 --2- 172.21.15.44:0/2438196737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a7006de50 0x7f9a701fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.914+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 >> 172.21.15.44:0/2438196737 conn(0x7f9a700ccaa0 msgr2=0x7f9a70157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.918+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 shutdown_connections 2024-09-17T05:36:23.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:23.918+0000 7f9a77000640 1 -- 172.21.15.44:0/2438196737 wait complete. 2024-09-17T05:36:23.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.094+0000 7f94a8c00640 1 -- 172.21.15.44:0/2570653149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a40cf400 msgr2=0x7f94a406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.094+0000 7f94a8c00640 1 --2- 172.21.15.44:0/2570653149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a40cf400 0x7f94a406e160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f948c009840 tx=0x7f948c01c700 comp rx=0 tx=0).stop 2024-09-17T05:36:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.094+0000 7f94a8c00640 1 -- 172.21.15.44:0/2570653149 shutdown_connections 2024-09-17T05:36:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.094+0000 7f94a8c00640 1 --2- 172.21.15.44:0/2570653149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a40cf400 0x7f94a406e160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.094+0000 7f94a8c00640 1 -- 172.21.15.44:0/2570653149 >> 172.21.15.44:0/2570653149 conn(0x7f94a40d1120 msgr2=0x7f94a40d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.094+0000 7f94a8c00640 1 -- 172.21.15.44:0/2570653149 shutdown_connections 2024-09-17T05:36:24.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.094+0000 7f94a8c00640 1 -- 172.21.15.44:0/2570653149 wait complete. 2024-09-17T05:36:24.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 Processor -- start 2024-09-17T05:36:24.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 -- start start 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a4072190 0x7f94a4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94a415f0e0 0x7f94a40b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94a40b2cb0 0x7f94a4158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94a4169fe0 con 0x7f94a4072190 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94a4169e60 con 0x7f94a40b2cb0 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f94a416a160 con 0x7f94a415f0e0 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a4072190 0x7f94a4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a4072190 0x7f94a4153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36612/0 (socket says 172.21.15.44:36612) 2024-09-17T05:36:24.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 -- 172.21.15.44:0/1219216513 learned_addr learned my addr 172.21.15.44:0/1219216513 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a2800640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94a40b2cb0 0x7f94a4158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f9499400640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94a415f0e0 0x7f94a40b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 -- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94a415f0e0 msgr2=0x7f94a40b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94a415f0e0 0x7f94a40b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 -- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94a40b2cb0 msgr2=0x7f94a4158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94a40b2cb0 0x7f94a4158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 -- 172.21.15.44:0/1219216513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a40b1ef0 con 0x7f94a4072190 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a1e00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a4072190 0x7f94a4153ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f949400c3f0 tx=0x7f949400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f949aa00640 1 -- 172.21.15.44:0/1219216513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494011790 con 0x7f94a4072190 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f949aa00640 1 -- 172.21.15.44:0/1219216513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9494017070 con 0x7f94a4072190 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f949aa00640 1 -- 172.21.15.44:0/1219216513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494011ce0 con 0x7f94a4072190 2024-09-17T05:36:24.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a40b21d0 con 0x7f94a4072190 2024-09-17T05:36:24.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.098+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a4158710 con 0x7f94a4072190 2024-09-17T05:36:24.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.102+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a406e160 con 0x7f94a4072190 2024-09-17T05:36:24.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.102+0000 7f949aa00640 1 -- 172.21.15.44:0/1219216513 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f949401c460 con 0x7f94a4072190 2024-09-17T05:36:24.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.102+0000 7f949aa00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9480073230 0x7f9480075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.102+0000 7f949aa00640 1 -- 172.21.15.44:0/1219216513 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9494094290 con 0x7f94a4072190 2024-09-17T05:36:24.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.102+0000 7f9499400640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9480073230 0x7f9480075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.106+0000 7f9499400640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9480073230 0x7f9480075740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f948c0af000 tx=0x7f948c01af40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.106+0000 7f949aa00640 1 -- 172.21.15.44:0/1219216513 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f949405eff0 con 0x7f94a4072190 2024-09-17T05:36:24.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.282+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94a40d1db0 con 0x7f94a4072190 2024-09-17T05:36:24.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.282+0000 7f949aa00640 1 -- 172.21.15.44:0/1219216513 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7f949405e8f0 con 0x7f94a4072190 2024-09-17T05:36:24.289 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:24.290 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9480073230 msgr2=0x7f9480075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9480073230 0x7f9480075740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f948c0af000 tx=0x7f948c01af40 comp rx=0 tx=0).stop 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a4072190 msgr2=0x7f94a4153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a4072190 0x7f94a4153ed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f949400c3f0 tx=0x7f949400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 shutdown_connections 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9480073230 0x7f9480075740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94a40b2cb0 0x7f94a4158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94a415f0e0 0x7f94a40b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 --2- 172.21.15.44:0/1219216513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94a4072190 0x7f94a4153ed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 >> 172.21.15.44:0/1219216513 conn(0x7f94a40d1120 msgr2=0x7f94a415b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 shutdown_connections 2024-09-17T05:36:24.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.286+0000 7f94a8c00640 1 -- 172.21.15.44:0/1219216513 wait complete. 2024-09-17T05:36:24.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:36:16.743512+0000', 'modified': '2024-09-17T05:36:21.773966+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4414}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4414': {'gid': 4414, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/2118333120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 2118333120}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 2118333120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4414, 'qdb_cluster': [4414]} 2024-09-17T05:36:24.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:36:24.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:36:24.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.874+0000 7f5309000640 1 -- 172.21.15.44:0/2557655973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 msgr2=0x7f530415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.874+0000 7f5309000640 1 --2- 172.21.15.44:0/2557655973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 0x7f530415e990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009840 tx=0x7f52f401c6b0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.874+0000 7f5309000640 1 -- 172.21.15.44:0/2557655973 shutdown_connections 2024-09-17T05:36:24.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.874+0000 7f5309000640 1 --2- 172.21.15.44:0/2557655973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 0x7f530415e990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.874+0000 7f5309000640 1 -- 172.21.15.44:0/2557655973 >> 172.21.15.44:0/2557655973 conn(0x7f53040ccaa0 msgr2=0x7f53040cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.874+0000 7f5309000640 1 -- 172.21.15.44:0/2557655973 shutdown_connections 2024-09-17T05:36:24.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.874+0000 7f5309000640 1 -- 172.21.15.44:0/2557655973 wait complete. 2024-09-17T05:36:24.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 Processor -- start 2024-09-17T05:36:24.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 -- start start 2024-09-17T05:36:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f530406de50 0x7f53041f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 0x7f53041fa300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53040cb470 0x7f53041588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5304169f80 con 0x7f530406de50 2024-09-17T05:36:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5304169e00 con 0x7f5304072e50 2024-09-17T05:36:24.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f530416a100 con 0x7f53040cb470 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f530406de50 0x7f53041f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f530406de50 0x7f53041f9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36616/0 (socket says 172.21.15.44:36616) 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 -- 172.21.15.44:0/448043210 learned_addr learned my addr 172.21.15.44:0/448043210 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301400640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 0x7f53041fa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5302800640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53040cb470 0x7f53041588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 -- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53040cb470 msgr2=0x7f53041588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53040cb470 0x7f53041588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 -- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 msgr2=0x7f53041fa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 0x7f53041fa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 -- 172.21.15.44:0/448043210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53041534a0 con 0x7f530406de50 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5302800640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53040cb470 0x7f53041588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5301e00640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f530406de50 0x7f53041f9dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52f401cb90 tx=0x7f52f40056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f52fa000640 1 -- 172.21.15.44:0/448043210 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40040f0 con 0x7f530406de50 2024-09-17T05:36:24.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f52fa000640 1 -- 172.21.15.44:0/448043210 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52f4004290 con 0x7f530406de50 2024-09-17T05:36:24.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530415a700 con 0x7f530406de50 2024-09-17T05:36:24.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f52fa000640 1 -- 172.21.15.44:0/448043210 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40046d0 con 0x7f530406de50 2024-09-17T05:36:24.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53040c3310 con 0x7f530406de50 2024-09-17T05:36:24.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.878+0000 7f52fa000640 1 -- 172.21.15.44:0/448043210 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f52f4004890 con 0x7f530406de50 2024-09-17T05:36:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f52fa000640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f52e4073200 0x7f52e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f52fa000640 1 -- 172.21.15.44:0/448043210 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f52f412e290 con 0x7f530406de50 2024-09-17T05:36:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 Processor -- start 2024-09-17T05:36:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301400640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f52e4073200 0x7f52e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 -- start start 2024-09-17T05:36:24.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301400640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f52e4073200 0x7f52e4075710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f53041548d0 tx=0x7f52f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada65b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad910950 0x55aaada66040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad8f9ca0 0x55aaada66580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55aaad936410 con 0x55aaad520460 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55aaad873b40 con 0x55aaad910950 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55aaad862f70 con 0x55aaad8f9ca0 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada65b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada65b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36628/0 (socket says 172.21.15.44:36628) 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 -- 172.21.15.44:0/1466818722 learned_addr learned my addr 172.21.15.44:0/1466818722 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301400640 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad910950 0x55aaada66040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5302800640 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad8f9ca0 0x55aaada66580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 -- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad8f9ca0 msgr2=0x55aaada66580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad8f9ca0 0x55aaada66580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 -- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad910950 msgr2=0x55aaada66040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad910950 0x55aaada66040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 -- 172.21.15.44:0/1466818722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaad82a5b0 con 0x55aaad520460 2024-09-17T05:36:24.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5302800640 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad8f9ca0 0x55aaada66580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:24.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f5301e00640 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada65b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52f40f8760 tx=0x7f52f40f8250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa66b0a1ce41d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.882+0000 7f52eea00640 1 -- 172.21.15.44:0/1466818722 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40f87d0 con 0x55aaad520460 2024-09-17T05:36:24.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f52eea00640 1 -- 172.21.15.44:0/1466818722 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52f40fd2b0 con 0x55aaad520460 2024-09-17T05:36:24.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f52eea00640 1 -- 172.21.15.44:0/1466818722 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f41021f0 con 0x55aaad520460 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- 172.21.15.44:0/1466818722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 msgr2=0x55aaada65b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada65b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52f40f8760 tx=0x7f52f40f8250 comp rx=0 tx=0).stop 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- 172.21.15.44:0/1466818722 shutdown_connections 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad8f9ca0 0x55aaada66580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad910950 0x55aaada66040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 --2- 172.21.15.44:0/1466818722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada65b00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- 172.21.15.44:0/1466818722 >> 172.21.15.44:0/1466818722 conn(0x55aaad9e6d90 msgr2=0x55aaada16690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- 172.21.15.44:0/1466818722 shutdown_connections 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- 172.21.15.44:0/1466818722 wait complete. 2024-09-17T05:36:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- start start 2024-09-17T05:36:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 Processor -- start 2024-09-17T05:36:24.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaada54120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaada54660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada54ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55aaad7fd5f0 con 0x55aaad8f9ca0 2024-09-17T05:36:24.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55aaad866d80 con 0x55aaad520460 2024-09-17T05:36:24.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55aaad809520 con 0x55aaad910950 2024-09-17T05:36:24.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5310809000 10 client.0 _ll_register_callbacks cb 0x55aaad80d830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.886+0000 7f5301400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaada54660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaada54660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36642/0 (socket says 172.21.15.44:36642) 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 -- 172.21.15.44:0/3231715802 learned_addr learned my addr 172.21.15.44:0/3231715802 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5302800640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada54ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301e00640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaada54120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 -- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 msgr2=0x55aaada54ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada54ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 -- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 msgr2=0x55aaada54120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaada54120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 -- 172.21.15.44:0/3231715802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaad801190 con 0x55aaad8f9ca0 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301e00640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaada54120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:24.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301400640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaada54660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e910 tx=0x7f52f0000ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26aebacf181a97d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 1 -- 172.21.15.44:0/3231715802 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0028060 con 0x55aaad8f9ca0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aaad7fb110 con 0x55aaad8f9ca0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 1 -- 172.21.15.44:0/3231715802 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f52f0010040 con 0x55aaad8f9ca0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 1 -- 172.21.15.44:0/3231715802 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f52f0003b80 con 0x55aaad8f9ca0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 10 client.4515 fetch_fsmap learned FSMap version 7 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55aaad8e7f10 con 0x55aaad8f9ca0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 1 -- 172.21.15.44:0/3231715802 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55aaad7fb110 con 0x55aaad8f9ca0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 1 -- 172.21.15.44:0/3231715802 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f52f0013420 con 0x55aaad8f9ca0 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 10 client.4515 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 10 client.4515 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 20 client.4515 populate_metadata read hostname 'smithi044' 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad5057d0 0x55aaada555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 4 client.4515 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:36:24.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 --> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaad875a90 con 0x55aaad5057d0 2024-09-17T05:36:24.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301e00640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad5057d0 0x55aaada555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5301e00640 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad5057d0 0x55aaada555b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb64a3894ac9c1b8 server_cookie=82ca03862e34e86f in_seq=0 out_seq=0 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 10 client.4515 ms_handle_connect on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 1 -- 172.21.15.44:0/3231715802 <== mds.0 v2:172.21.15.86:6834/2118333120 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aaad875a90 con 0x55aaad5057d0 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f52e3400640 10 client.4515 handle_command_reply: tid=0 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.890+0000 7f5310809000 1 client.4515 shutdown 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 msgr2=0x55aaada54660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaada54660 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52f000e910 tx=0x7f52f0000ff0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 shutdown_connections 2024-09-17T05:36:24.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad5057d0 0x55aaada555b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada54ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaada54660 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 --2- 172.21.15.44:0/3231715802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaada54120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f52e3400640 0 client.4515 ms_handle_reset on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 >> 172.21.15.44:0/3231715802 conn(0x55aaad9e6d90 msgr2=0x55aaada1e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 shutdown_connections 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 1 -- 172.21.15.44:0/3231715802 wait complete. 2024-09-17T05:36:24.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.894+0000 7f5310809000 20 client.4515 trim_cache size 0 max 16384 2024-09-17T05:36:24.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.914+0000 7f5310809000 1 Processor -- start 2024-09-17T05:36:24.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.914+0000 7f5310809000 1 -- start start 2024-09-17T05:36:24.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada23190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad8f9ca0 0x55aaada236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada7c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53042022a0 con 0x55aaad520460 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f53042012a0 con 0x55aaad8f9ca0 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f53041f7630 con 0x55aaad910950 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada23190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada23190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36648/0 (socket says 172.21.15.44:36648) 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 -- 172.21.15.44:0/3320383898 learned_addr learned my addr 172.21.15.44:0/3320383898 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5302800640 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada7c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 -- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 msgr2=0x55aaada7c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada7c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 -- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad8f9ca0 msgr2=0x55aaada236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad8f9ca0 0x55aaada236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad8f9ca0 0x55aaada236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 -- 172.21.15.44:0/3320383898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaad8bedb0 con 0x55aaad520460 2024-09-17T05:36:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5302800640 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad8f9ca0 0x55aaada236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada23190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52f40f8760 tx=0x7f52f412e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2ce3d5e791c408 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52ee000640 1 -- 172.21.15.44:0/3320383898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f41021f0 con 0x55aaad520460 2024-09-17T05:36:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52ee000640 1 -- 172.21.15.44:0/3320383898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52f40fd2b0 con 0x55aaad520460 2024-09-17T05:36:24.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52ee000640 1 -- 172.21.15.44:0/3320383898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4004de0 con 0x55aaad520460 2024-09-17T05:36:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/3320383898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 msgr2=0x55aaada23190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada23190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f52f40f8760 tx=0x7f52f412e040 comp rx=0 tx=0).stop 2024-09-17T05:36:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/3320383898 shutdown_connections 2024-09-17T05:36:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaada7c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad8f9ca0 0x55aaada236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- 172.21.15.44:0/3320383898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad520460 0x55aaada23190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/3320383898 >> 172.21.15.44:0/3320383898 conn(0x55aaad9e6d90 msgr2=0x55aaada22a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/3320383898 shutdown_connections 2024-09-17T05:36:24.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/3320383898 wait complete. 2024-09-17T05:36:24.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- start start 2024-09-17T05:36:24.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 Processor -- start 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaadadb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaadadbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaadadc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55aaad7fd5f0 con 0x55aaad8f9ca0 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55aaada54f60 con 0x55aaad520460 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55aaad922750 con 0x55aaad910950 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 10 client.0 _ll_register_callbacks cb 0x7f52f0001d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaadadbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaadadbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36662/0 (socket says 172.21.15.44:36662) 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 -- 172.21.15.44:0/1904835519 learned_addr learned my addr 172.21.15.44:0/1904835519 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301e00640 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaadadb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5302800640 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaadadc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 -- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 msgr2=0x55aaadadc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaadadc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 -- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 msgr2=0x55aaadadb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaadadb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 -- 172.21.15.44:0/1904835519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaad829ab0 con 0x55aaad8f9ca0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5301400640 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaadadbc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52f00014a0 tx=0x7f52f00014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acef5da6fa2045da server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52e3400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52e3400640 1 -- 172.21.15.44:0/1904835519 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0013970 con 0x55aaad8f9ca0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52e3400640 1 -- 172.21.15.44:0/1904835519 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f52f0010040 con 0x55aaad8f9ca0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52f40fd2b0 con 0x55aaad8f9ca0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52e3400640 1 -- 172.21.15.44:0/1904835519 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f52f003d050 con 0x55aaad8f9ca0 2024-09-17T05:36:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 10 client.4521 fetch_fsmap learned FSMap version 7 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55aaad808070 con 0x55aaad8f9ca0 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52e3400640 1 -- 172.21.15.44:0/1904835519 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52f40fd2b0 con 0x55aaad8f9ca0 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f52e3400640 1 -- 172.21.15.44:0/1904835519 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f52f0040020 con 0x55aaad8f9ca0 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 10 client.4521 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 10 client.4521 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 20 client.4521 populate_metadata read hostname 'smithi044' 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad4f3830 0x55aaada78f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 4 client.4521 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.918+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 --> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] -- command(tid 0: {"prefix": "status"}) -- 0x55aaad871540 con 0x55aaad4f3830 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5301e00640 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad4f3830 0x55aaada78f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5301e00640 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad4f3830 0x55aaada78f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508ebff1557d698a server_cookie=11bb11a2da19d5f5 in_seq=0 out_seq=0 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f52e3400640 10 client.4521 ms_handle_connect on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f52e3400640 1 -- 172.21.15.44:0/1904835519 <== mds.0 v2:172.21.15.86:6834/2118333120 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55aaad871540 con 0x55aaad4f3830 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f52e3400640 10 client.4521 handle_command_reply: tid=0 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 client.4521 shutdown 2024-09-17T05:36:24.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 msgr2=0x55aaadadbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaadadbc10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52f00014a0 tx=0x7f52f00014d0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 shutdown_connections 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x55aaad4f3830 0x55aaada78f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55aaad910950 0x55aaadadc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55aaad8f9ca0 0x55aaadadbc10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 --2- 172.21.15.44:0/1904835519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aaad520460 0x55aaadadb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f52e3400640 0 client.4521 ms_handle_reset on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 >> 172.21.15.44:0/1904835519 conn(0x55aaad9e6d90 msgr2=0x55aaada23440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 shutdown_connections 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 1 -- 172.21.15.44:0/1904835519 wait complete. 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5310809000 20 client.4521 trim_cache size 0 max 16384 2024-09-17T05:36:24.931 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4414, 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 7.6351732290000003, 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 7, 2024-09-17T05:36:24.932 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 26, 2024-09-17T05:36:24.933 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 26, 2024-09-17T05:36:24.933 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 13.41089289 2024-09-17T05:36:24.933 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:36:24.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f52e4073200 msgr2=0x7f52e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f52e4073200 0x7f52e4075710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f53041548d0 tx=0x7f52f0009040 comp rx=0 tx=0).stop 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f530406de50 msgr2=0x7f53041f9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f530406de50 0x7f53041f9dc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52f401cb90 tx=0x7f52f40056b0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 shutdown_connections 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53040cb470 0x7f53041588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f52e4073200 0x7f52e4075710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5304072e50 0x7f53041fa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 --2- 172.21.15.44:0/448043210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f530406de50 0x7f53041f9dc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 >> 172.21.15.44:0/448043210 conn(0x7f53040ccaa0 msgr2=0x7f53040afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 shutdown_connections 2024-09-17T05:36:24.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:24.922+0000 7f5309000640 1 -- 172.21.15.44:0/448043210 wait complete. 2024-09-17T05:36:24.947 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:36:24.947 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:24.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 -- 172.21.15.44:0/3496459629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580cf5b0 msgr2=0x7f305815d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 --2- 172.21.15.44:0/3496459629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580cf5b0 0x7f305815d060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3050009bf0 tx=0x7f305001cae0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 -- 172.21.15.44:0/3496459629 shutdown_connections 2024-09-17T05:36:25.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 --2- 172.21.15.44:0/3496459629 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580cf5b0 0x7f305815d060 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 --2- 172.21.15.44:0/3496459629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30580d1d00 0x7f30580cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 -- 172.21.15.44:0/3496459629 >> 172.21.15.44:0/3496459629 conn(0x7f30580b4240 msgr2=0x7f30580b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 -- 172.21.15.44:0/3496459629 shutdown_connections 2024-09-17T05:36:25.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.098+0000 7f305e600640 1 -- 172.21.15.44:0/3496459629 wait complete. 2024-09-17T05:36:25.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 Processor -- start 2024-09-17T05:36:25.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 -- start start 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30580cf5b0 0x7f30580cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580d18f0 0x7f305815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30580d1d00 0x7f305815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3058169e80 con 0x7f30580d18f0 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3058169d00 con 0x7f30580d1d00 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f305e600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f305816a000 con 0x7f30580cf5b0 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f304fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580d18f0 0x7f305815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f304fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580d18f0 0x7f305815dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36676/0 (socket says 172.21.15.44:36676) 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f304fe00640 1 -- 172.21.15.44:0/479391567 learned_addr learned my addr 172.21.15.44:0/479391567 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:25.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f304fe00640 1 -- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30580cf5b0 msgr2=0x7f30580cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.102+0000 7f304fe00640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30580cf5b0 0x7f30580cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304fe00640 1 -- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30580d1d00 msgr2=0x7f305815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f3057e00640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30580d1d00 0x7f305815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304fe00640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30580d1d00 0x7f305815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304fe00640 1 -- 172.21.15.44:0/479391567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30580cc2f0 con 0x7f30580d18f0 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f3057e00640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30580d1d00 0x7f305815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304fe00640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580d18f0 0x7f305815dce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f304000e7c0 tx=0x7f304000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304f400640 1 -- 172.21.15.44:0/479391567 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304000cc60 con 0x7f30580d18f0 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304f400640 1 -- 172.21.15.44:0/479391567 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f304000ce00 con 0x7f30580d18f0 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304f400640 1 -- 172.21.15.44:0/479391567 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040005280 con 0x7f30580d18f0 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305814edf0 con 0x7f30580d18f0 2024-09-17T05:36:25.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305814e440 con 0x7f30580d18f0 2024-09-17T05:36:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305815d060 con 0x7f30580d18f0 2024-09-17T05:36:25.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304f400640 1 -- 172.21.15.44:0/479391567 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3040005420 con 0x7f30580d18f0 2024-09-17T05:36:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.106+0000 7f304f400640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3034073230 0x7f3034075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.110+0000 7f304f400640 1 -- 172.21.15.44:0/479391567 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3040094f00 con 0x7f30580d18f0 2024-09-17T05:36:25.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.110+0000 7f3057400640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3034073230 0x7f3034075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:25.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.110+0000 7f3057400640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3034073230 0x7f3034075740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30480046c0 tx=0x7f3048001280 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:25.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.118+0000 7f304f400640 1 -- 172.21.15.44:0/479391567 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f30580cc2f0 con 0x7f30580d18f0 2024-09-17T05:36:25.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f30580b1ac0 con 0x7f30580d18f0 2024-09-17T05:36:25.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f304f400640 1 -- 172.21.15.44:0/479391567 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f304005fbd0 con 0x7f30580d18f0 2024-09-17T05:36:25.334 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3034073230 msgr2=0x7f3034075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3034073230 0x7f3034075740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f30480046c0 tx=0x7f3048001280 comp rx=0 tx=0).stop 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580d18f0 msgr2=0x7f305815dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580d18f0 0x7f305815dce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f304000e7c0 tx=0x7f304000ec80 comp rx=0 tx=0).stop 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 shutdown_connections 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3034073230 0x7f3034075740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30580d1d00 0x7f305815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30580d18f0 0x7f305815dce0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 --2- 172.21.15.44:0/479391567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30580cf5b0 0x7f30580cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 >> 172.21.15.44:0/479391567 conn(0x7f30580b4240 msgr2=0x7f3058150550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:25.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 shutdown_connections 2024-09-17T05:36:25.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25.330+0000 7f305e600640 1 -- 172.21.15.44:0/479391567 wait complete. 2024-09-17T05:36:25.356 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:25.357 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T05:36:25.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:25.357 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:36:25.366 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:36:25.367 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42420sec preferred_lft 42420sec 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:25.368 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:25.369 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:36:25.369 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:25.369 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:25.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:36:25.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-09-17T05:36:25.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-09-17T05:36:25.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:36:25.369 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:25.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:25.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:25.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:25.528 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:25.546 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:36:25.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:25.548 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:36:25.616 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:36:25.616 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:25.616 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:36:25.616 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:25.616 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:36:25.617 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:25.617 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:25.617 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:25.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:36:25.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:36:25.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:36:25.617 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:25.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:25.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:25.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:25.758 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:36:25.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:25.767 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-09-17T05:36:25.818 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:25.818 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:25.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:25.818 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-17T05:36:25.818 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:25.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:25.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:25.950 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-17T05:36:25.950 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:25.950 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:25.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-17T05:36:25.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:36:25.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-17T05:36:25.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-17T05:36:25.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-17T05:36:25.951 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:26.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:26.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:26.175 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:26.175 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:26.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:36:26.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:36:26.175 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:26.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:26.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:26.262 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-17T05:36:26.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:26.262 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:26.271 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-17T05:36:26.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:26.271 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:26.324 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-17T05:36:26.390 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:36:26.442 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-09-17T05:36:26.443 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:36:26.444 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:36:26.445 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:36:26.445 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:36:26.445 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-09-17T05:36:26.445 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:26.445 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:26.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:26.446 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-17T05:36:26.497 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:36:26.497 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-17T05:36:26.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-17T05:36:26.564 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:36:26.618 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-09-17T05:36:26.618 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-09-17T05:36:26.619 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:36:26.620 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:36:26.621 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:36:26.621 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:36:26.621 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-09-17T05:36:26.621 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:26.621 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:26.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:26.622 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-17T05:36:26.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:2024-09-17T05:36:26.654+0000 7f0f1e123580 -1 init, newargv = 0x55b00c051110 newargc=15 2024-09-17T05:36:26.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[35387]: starting ceph client 2024-09-17T05:36:26.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[35387]: starting fuse 2024-09-17T05:36:27.764 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-09-17T05:36:27.788 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-09-17T05:36:27.844 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/run/lock 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-09-17T05:36:27.845 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/fs/nfsd 2024-09-17T05:36:27.846 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-09-17T05:36:27.846 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-09-17T05:36:27.846 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysusers.service 2024-09-17T05:36:27.846 INFO:teuthology.orchestra.run.smithi044.stdout:/run/rpc_pipefs 2024-09-17T05:36:27.846 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-09-17T05:36:27.846 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-09-17T05:36:27.847 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:36:27.847 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:36:27.847 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:36:27.847 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:36:27.847 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-09-17T05:36:27.847 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:27.848 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:27.848 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:27.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:27.850 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-09-17T05:36:27.906 INFO:teuthology.orchestra.run.smithi044.stdout:44 2024-09-17T05:36:27.906 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-17T05:36:27.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-09-17T05:36:27.908 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.admin")) 2024-09-17T05:36:27.909 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:36:28.044 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.admin.35387.asok 2024-09-17T05:36:28.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:28.056 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.35387.asok 2024-09-17T05:36:28.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:28.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.35387.asok status 2024-09-17T05:36:28.239 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:36:28.239 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-09-17T05:36:28.239 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "ce1b342bf8c6349a8c90cd607f83bff2443f21cf", 2024-09-17T05:36:28.239 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.3.0-4989-gce1b342b (ce1b342bf8c6349a8c90cd607f83bff2443f21cf) squid (dev)", 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "admin", 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "35387", 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4536, 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-09-17T05:36:28.240 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4536 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 499371579 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 499371579 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:36:28.241 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4536 192.168.0.1:0/499371579", 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/499371579", 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 7, 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 26, 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-09-17T05:36:28.242 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:36:28.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:28.255 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-09-17T05:36:28.255 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:28.264 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-09-17T05:36:28.265 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:28.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:28.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:28.330 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-17T05:36:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:28.467 INFO:teuthology.orchestra.run.smithi044.stdout:# file: . 2024-09-17T05:36:28.467 INFO:teuthology.orchestra.run.smithi044.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-17T05:36:28.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:28.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:28.474 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:28.474 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:28.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 -- 172.21.15.44:0/2684830325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61006f0e0 msgr2=0x7fb61006f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 --2- 172.21.15.44:0/2684830325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61006f0e0 0x7fb61006f4f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb6100cf9d0 tx=0x7fb5fc01c870 comp rx=0 tx=0).stop 2024-09-17T05:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 -- 172.21.15.44:0/2684830325 shutdown_connections 2024-09-17T05:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 --2- 172.21.15.44:0/2684830325 >> v2:172.21.15.86:3300/0 conn(0x7fb61015ff20 0x7fb610160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 --2- 172.21.15.44:0/2684830325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61006f0e0 0x7fb61006f4f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 --2- 172.21.15.44:0/2684830325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6101455b0 0x7fb610144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 -- 172.21.15.44:0/2684830325 >> 172.21.15.44:0/2684830325 conn(0x7fb61006ce40 msgr2=0x7fb61006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 -- 172.21.15.44:0/2684830325 shutdown_connections 2024-09-17T05:36:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 -- 172.21.15.44:0/2684830325 wait complete. 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.686+0000 7fb616800640 1 Processor -- start 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 -- start start 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb61006f0e0 0x7fb61013d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6101455b0 0x7fb6101fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61015ff20 0x7fb6101fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb610073b90 con 0x7fb61015ff20 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb610073a10 con 0x7fb61006f0e0 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb610073d10 con 0x7fb6101455b0 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61015ff20 0x7fb6101fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61015ff20 0x7fb6101fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36694/0 (socket says 172.21.15.44:36694) 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 -- 172.21.15.44:0/2683087829 learned_addr learned my addr 172.21.15.44:0/2683087829 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615400640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb61006f0e0 0x7fb61013d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb614a00640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6101455b0 0x7fb6101fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 -- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6101455b0 msgr2=0x7fb6101fbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6101455b0 0x7fb6101fbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 -- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb61006f0e0 msgr2=0x7fb61013d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb61006f0e0 0x7fb61013d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 -- 172.21.15.44:0/2683087829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6100cc250 con 0x7fb61015ff20 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb615e00640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61015ff20 0x7fb6101fc0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e9a0 tx=0x7fb60800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb60d600640 1 -- 172.21.15.44:0/2683087829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608004d30 con 0x7fb61015ff20 2024-09-17T05:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb60d600640 1 -- 172.21.15.44:0/2683087829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb60800cb20 con 0x7fb61015ff20 2024-09-17T05:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb60d600640 1 -- 172.21.15.44:0/2683087829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608005020 con 0x7fb61015ff20 2024-09-17T05:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6101fc910 con 0x7fb61015ff20 2024-09-17T05:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6100b3690 con 0x7fb61015ff20 2024-09-17T05:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.690+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6100b38c0 con 0x7fb61015ff20 2024-09-17T05:36:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.694+0000 7fb60d600640 1 -- 172.21.15.44:0/2683087829 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6080051c0 con 0x7fb61015ff20 2024-09-17T05:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.694+0000 7fb60d600640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5f0073200 0x7fb5f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.694+0000 7fb60d600640 1 -- 172.21.15.44:0/2683087829 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb608095180 con 0x7fb61015ff20 2024-09-17T05:36:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.694+0000 7fb615400640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5f0073200 0x7fb5f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.694+0000 7fb615400640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5f0073200 0x7fb5f0075710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb604005fd0 tx=0x7fb604005d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:28.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.698+0000 7fb60d600640 1 -- 172.21.15.44:0/2683087829 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb6100b38c0 con 0x7fb61015ff20 2024-09-17T05:36:28.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.882+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6101fcae0 con 0x7fb61015ff20 2024-09-17T05:36:28.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.882+0000 7fb60d600640 1 -- 172.21.15.44:0/2683087829 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb6101fcae0 con 0x7fb61015ff20 2024-09-17T05:36:28.885 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:36:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5f0073200 msgr2=0x7fb5f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5f0073200 0x7fb5f0075710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb604005fd0 tx=0x7fb604005d80 comp rx=0 tx=0).stop 2024-09-17T05:36:28.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61015ff20 msgr2=0x7fb6101fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61015ff20 0x7fb6101fc0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e9a0 tx=0x7fb60800ee60 comp rx=0 tx=0).stop 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 shutdown_connections 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb61015ff20 0x7fb6101fc0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6101455b0 0x7fb6101fbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5f0073200 0x7fb5f0075710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 --2- 172.21.15.44:0/2683087829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb61006f0e0 0x7fb61013d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 >> 172.21.15.44:0/2683087829 conn(0x7fb61006ce40 msgr2=0x7fb61013f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 shutdown_connections 2024-09-17T05:36:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:28.886+0000 7fb616800640 1 -- 172.21.15.44:0/2683087829 wait complete. 2024-09-17T05:36:28.907 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:28.907 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:28.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:29.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 -- 172.21.15.44:0/2576368770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d006e390 msgr2=0x7f58d00cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 --2- 172.21.15.44:0/2576368770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d006e390 0x7f58d00cdbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009900 tx=0x7f58b801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 -- 172.21.15.44:0/2576368770 shutdown_connections 2024-09-17T05:36:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 --2- 172.21.15.44:0/2576368770 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d006e390 0x7f58d00cdbf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 --2- 172.21.15.44:0/2576368770 >> v2:172.21.15.86:3300/0 conn(0x7f58d00b5880 0x7f58d006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 -- 172.21.15.44:0/2576368770 >> 172.21.15.44:0/2576368770 conn(0x7f58d00ccaa0 msgr2=0x7f58d00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 -- 172.21.15.44:0/2576368770 shutdown_connections 2024-09-17T05:36:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.114+0000 7f58d5800640 1 -- 172.21.15.44:0/2576368770 wait complete. 2024-09-17T05:36:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 Processor -- start 2024-09-17T05:36:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 -- start start 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58d006e390 0x7f58d00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58d00b5880 0x7f58d009f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d00ce130 0x7f58d00b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f58d016a2c0 con 0x7f58d006e390 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58d016a140 con 0x7f58d00b5880 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f58d016a440 con 0x7f58d00ce130 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58d006e390 0x7f58d00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58d006e390 0x7f58d00c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48886/0 (socket says 172.21.15.44:48886) 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 -- 172.21.15.44:0/3046243651 learned_addr learned my addr 172.21.15.44:0/3046243651 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cf400640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d00ce130 0x7f58d00b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58c6000640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58d00b5880 0x7f58d009f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 -- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d00ce130 msgr2=0x7f58d00b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d00ce130 0x7f58d00b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 -- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58d00b5880 msgr2=0x7f58d009f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58d00b5880 0x7f58d009f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 -- 172.21.15.44:0/3046243651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d01f9c80 con 0x7f58d006e390 2024-09-17T05:36:29.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58cea00640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58d006e390 0x7f58d00c93e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58c000ed30 tx=0x7f58c000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58c7400640 1 -- 172.21.15.44:0/3046243651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0003b80 con 0x7f58d006e390 2024-09-17T05:36:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58c7400640 1 -- 172.21.15.44:0/3046243651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58c0003d20 con 0x7f58d006e390 2024-09-17T05:36:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58c7400640 1 -- 172.21.15.44:0/3046243651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0004280 con 0x7f58d006e390 2024-09-17T05:36:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d00a0c60 con 0x7f58d006e390 2024-09-17T05:36:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.118+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d009d850 con 0x7f58d006e390 2024-09-17T05:36:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.122+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d00b11e0 con 0x7f58d006e390 2024-09-17T05:36:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.122+0000 7f58c7400640 1 -- 172.21.15.44:0/3046243651 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f58c0004420 con 0x7f58d006e390 2024-09-17T05:36:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.122+0000 7f58c7400640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f58ac073230 0x7f58ac075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.122+0000 7f58c7400640 1 -- 172.21.15.44:0/3046243651 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f58c0095300 con 0x7f58d006e390 2024-09-17T05:36:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.122+0000 7f58c6000640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f58ac073230 0x7f58ac075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.122+0000 7f58c6000640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f58ac073230 0x7f58ac075740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58b80af000 tx=0x7f58b801b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.126+0000 7f58c7400640 1 -- 172.21.15.44:0/3046243651 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f58c005ff40 con 0x7f58d006e390 2024-09-17T05:36:29.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f58d00cdbd0 con 0x7f58d006e390 2024-09-17T05:36:29.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58c7400640 1 -- 172.21.15.44:0/3046243651 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f58c005f840 con 0x7f58d006e390 2024-09-17T05:36:29.314 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f58ac073230 msgr2=0x7f58ac075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f58ac073230 0x7f58ac075740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58b80af000 tx=0x7f58b801b120 comp rx=0 tx=0).stop 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58d006e390 msgr2=0x7f58d00c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58d006e390 0x7f58d00c93e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58c000ed30 tx=0x7f58c000c6a0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 shutdown_connections 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f58d00ce130 0x7f58d00b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f58ac073230 0x7f58ac075740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58d00b5880 0x7f58d009f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 --2- 172.21.15.44:0/3046243651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f58d006e390 0x7f58d00c93e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 >> 172.21.15.44:0/3046243651 conn(0x7f58d00ccaa0 msgr2=0x7f58d00b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 shutdown_connections 2024-09-17T05:36:29.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.314+0000 7f58d5800640 1 -- 172.21.15.44:0/3046243651 wait complete. 2024-09-17T05:36:29.337 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-09-17T05:36:29.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:29.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-17T05:36:29.366 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[35387]: fuse finished with error 0 and tester_r 0 2024-09-17T05:36:29.370 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:29.425 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:36:29.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:29.425 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-17T05:36:29.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 -- 172.21.15.44:0/2964094211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 msgr2=0x7fe1dc15c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2964094211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc15c430 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009900 tx=0x7fe1cc01c8a0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 -- 172.21.15.44:0/2964094211 shutdown_connections 2024-09-17T05:36:29.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2964094211 >> v2:172.21.15.86:3300/0 conn(0x7fe1dc0cf700 0x7fe1dc160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2964094211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc15c430 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 -- 172.21.15.44:0/2964094211 >> 172.21.15.44:0/2964094211 conn(0x7fe1dc0d1120 msgr2=0x7fe1dc0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 -- 172.21.15.44:0/2964094211 shutdown_connections 2024-09-17T05:36:29.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 -- 172.21.15.44:0/2964094211 wait complete. 2024-09-17T05:36:29.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 Processor -- start 2024-09-17T05:36:29.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.634+0000 7fe1e1400640 1 -- start start 2024-09-17T05:36:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc165db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1dc0cf700 0x7fe1dc14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1dc160550 0x7fe1dc166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc169970 con 0x7fe1dc06dd30 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1dc1697f0 con 0x7fe1dc0cf700 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe1dc169af0 con 0x7fe1dc160550 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc165db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc165db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48902/0 (socket says 172.21.15.44:48902) 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 -- 172.21.15.44:0/2736420796 learned_addr learned my addr 172.21.15.44:0/2736420796 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 -- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1dc160550 msgr2=0x7fe1dc166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1d3e00640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1dc0cf700 0x7fe1dc14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1db200640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1dc160550 0x7fe1dc166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1dc160550 0x7fe1dc166540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 -- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1dc0cf700 msgr2=0x7fe1dc14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1dc0cf700 0x7fe1dc14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 -- 172.21.15.44:0/2736420796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1dc14b980 con 0x7fe1dc06dd30 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1d3e00640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1dc0cf700 0x7fe1dc14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1db200640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1dc160550 0x7fe1dc166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1da800640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc165db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009850 tx=0x7fe1cc005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1d2a00640 1 -- 172.21.15.44:0/2736420796 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0bc070 con 0x7fe1dc06dd30 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1d2a00640 1 -- 172.21.15.44:0/2736420796 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1cc004330 con 0x7fe1dc06dd30 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1d2a00640 1 -- 172.21.15.44:0/2736420796 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0b2040 con 0x7fe1dc06dd30 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1dc1612a0 con 0x7fe1dc06dd30 2024-09-17T05:36:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1dc162e00 con 0x7fe1dc06dd30 2024-09-17T05:36:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.638+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1dc15c430 con 0x7fe1dc06dd30 2024-09-17T05:36:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.642+0000 7fe1d2a00640 1 -- 172.21.15.44:0/2736420796 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe1cc005280 con 0x7fe1dc06dd30 2024-09-17T05:36:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.642+0000 7fe1d2a00640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe1b8073200 0x7fe1b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.642+0000 7fe1d2a00640 1 -- 172.21.15.44:0/2736420796 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe1cc12e320 con 0x7fe1dc06dd30 2024-09-17T05:36:29.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.642+0000 7fe1d3e00640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe1b8073200 0x7fe1b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.642+0000 7fe1d3e00640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe1b8073200 0x7fe1b8075710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc0cb290 tx=0x7fe1c40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.646+0000 7fe1d2a00640 1 -- 172.21.15.44:0/2736420796 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe1cc016490 con 0x7fe1dc06dd30 2024-09-17T05:36:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.822+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1dc0cefd0 con 0x7fe1dc06dd30 2024-09-17T05:36:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.822+0000 7fe1d2a00640 1 -- 172.21.15.44:0/2736420796 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7fe1cc0f8ff0 con 0x7fe1dc06dd30 2024-09-17T05:36:29.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:29.824 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe1b8073200 msgr2=0x7fe1b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe1b8073200 0x7fe1b8075710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc0cb290 tx=0x7fe1c40091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 msgr2=0x7fe1dc165db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc165db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009850 tx=0x7fe1cc005de0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 shutdown_connections 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1dc160550 0x7fe1dc166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe1b8073200 0x7fe1b8075710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1dc0cf700 0x7fe1dc14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 --2- 172.21.15.44:0/2736420796 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1dc06dd30 0x7fe1dc165db0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 >> 172.21.15.44:0/2736420796 conn(0x7fe1dc0d1120 msgr2=0x7fe1dc06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 shutdown_connections 2024-09-17T05:36:29.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:29.826+0000 7fe1e1400640 1 -- 172.21.15.44:0/2736420796 wait complete. 2024-09-17T05:36:29.847 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 -- 172.21.15.44:0/2432882759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0d18f0 msgr2=0x7f2c8c0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 --2- 172.21.15.44:0/2432882759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0d18f0 0x7f2c8c0b1be0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009840 tx=0x7f2c7c01c760 comp rx=0 tx=0).stop 2024-09-17T05:36:30.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 -- 172.21.15.44:0/2432882759 shutdown_connections 2024-09-17T05:36:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 --2- 172.21.15.44:0/2432882759 >> v2:172.21.15.86:3300/0 conn(0x7f2c8c0d1d00 0x7f2c8c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 --2- 172.21.15.44:0/2432882759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0d18f0 0x7f2c8c0b1be0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 -- 172.21.15.44:0/2432882759 >> 172.21.15.44:0/2432882759 conn(0x7f2c8c0b4240 msgr2=0x7f2c8c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 -- 172.21.15.44:0/2432882759 shutdown_connections 2024-09-17T05:36:30.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 -- 172.21.15.44:0/2432882759 wait complete. 2024-09-17T05:36:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 Processor -- start 2024-09-17T05:36:30.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.006+0000 7f2c92e00640 1 -- start start 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0cf5b0 0x7f2c8c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c8c0d18f0 0x7f2c8c15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c8c0d1d00 0x7f2c8c154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c169ee0 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c169d60 con 0x7f2c8c0d1d00 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8c16a060 con 0x7f2c8c0cf5b0 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c8c0d18f0 0x7f2c8c15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c8c0d18f0 0x7f2c8c15f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48906/0 (socket says 172.21.15.44:48906) 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 -- 172.21.15.44:0/1524971977 learned_addr learned my addr 172.21.15.44:0/1524971977 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8be00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0cf5b0 0x7f2c8c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c90e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c8c0d1d00 0x7f2c8c154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 -- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0cf5b0 msgr2=0x7f2c8c14baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0cf5b0 0x7f2c8c14baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 -- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c8c0d1d00 msgr2=0x7f2c8c154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c8c0d1d00 0x7f2c8c154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 -- 172.21.15.44:0/1524971977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c15f920 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c8b400640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c8c0d18f0 0x7f2c8c15f3e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800e7a0 tx=0x7f2c7800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c83e00640 1 -- 172.21.15.44:0/1524971977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800ccc0 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c83e00640 1 -- 172.21.15.44:0/1524971977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c7800ce60 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c83e00640 1 -- 172.21.15.44:0/1524971977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78005260 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c15dd00 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c15e2c0 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.010+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c15faf0 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.014+0000 7f2c83e00640 1 -- 172.21.15.44:0/1524971977 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2c78005400 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.014+0000 7f2c83e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2c6c073200 0x7f2c6c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.014+0000 7f2c83e00640 1 -- 172.21.15.44:0/1524971977 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2c78094de0 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.014+0000 7f2c8be00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2c6c073200 0x7f2c6c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.014+0000 7f2c8be00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2c6c073200 0x7f2c6c075710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0af000 tx=0x7f2c7c01afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.018+0000 7f2c83e00640 1 -- 172.21.15.44:0/1524971977 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2c7805f460 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.190+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c8c0b1be0 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c83e00640 1 -- 172.21.15.44:0/1524971977 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7f2c78063e90 con 0x7f2c8c0d18f0 2024-09-17T05:36:30.194 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:30.195 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2c6c073200 msgr2=0x7f2c6c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2c6c073200 0x7f2c6c075710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0af000 tx=0x7f2c7c01afa0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c8c0d18f0 msgr2=0x7f2c8c15f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c8c0d18f0 0x7f2c8c15f3e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800e7a0 tx=0x7f2c7800ec60 comp rx=0 tx=0).stop 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 shutdown_connections 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2c6c073200 0x7f2c6c075710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c8c0d1d00 0x7f2c8c154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2c8c0d18f0 0x7f2c8c15f3e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 --2- 172.21.15.44:0/1524971977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2c8c0cf5b0 0x7f2c8c14baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 >> 172.21.15.44:0/1524971977 conn(0x7f2c8c0b4240 msgr2=0x7f2c8c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 shutdown_connections 2024-09-17T05:36:30.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.194+0000 7f2c92e00640 1 -- 172.21.15.44:0/1524971977 wait complete. 2024-09-17T05:36:30.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:36:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.378+0000 7f15b9000640 1 -- 172.21.15.44:0/153867504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 msgr2=0x7f15b40b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/153867504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b40b1be0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009900 tx=0x7f15a401c820 comp rx=0 tx=0).stop 2024-09-17T05:36:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.378+0000 7f15b9000640 1 -- 172.21.15.44:0/153867504 shutdown_connections 2024-09-17T05:36:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/153867504 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15b40d1d00 0x7f15b40cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/153867504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b40b1be0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.378+0000 7f15b9000640 1 -- 172.21.15.44:0/153867504 >> 172.21.15.44:0/153867504 conn(0x7f15b40b4240 msgr2=0x7f15b40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 -- 172.21.15.44:0/153867504 shutdown_connections 2024-09-17T05:36:30.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 -- 172.21.15.44:0/153867504 wait complete. 2024-09-17T05:36:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 Processor -- start 2024-09-17T05:36:30.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 -- start start 2024-09-17T05:36:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15b40cf5b0 0x7f15b415f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b4158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15b40d1d00 0x7f15b4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4169e80 con 0x7f15b40d18f0 2024-09-17T05:36:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4169d00 con 0x7f15b40d1d00 2024-09-17T05:36:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15b9000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f15b416a000 con 0x7f15b40cf5b0 2024-09-17T05:36:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.382+0000 7f15abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b4158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b4158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48916/0 (socket says 172.21.15.44:48916) 2024-09-17T05:36:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 -- 172.21.15.44:0/766202959 learned_addr learned my addr 172.21.15.44:0/766202959 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15b2800640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15b40d1d00 0x7f15b4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15b1e00640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15b40cf5b0 0x7f15b415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 -- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15b40cf5b0 msgr2=0x7f15b415f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15b40cf5b0 0x7f15b415f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 -- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15b40d1d00 msgr2=0x7f15b4158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15b40d1d00 0x7f15b4158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 -- 172.21.15.44:0/766202959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b415fa50 con 0x7f15b40d18f0 2024-09-17T05:36:30.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15b1e00640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15b40cf5b0 0x7f15b415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:30.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15b2800640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15b40d1d00 0x7f15b4158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:30.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15abe00640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b4158a40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d720 tx=0x7f159c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:30.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15aa000640 1 -- 172.21.15.44:0/766202959 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c017070 con 0x7f15b40d18f0 2024-09-17T05:36:30.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15aa000640 1 -- 172.21.15.44:0/766202959 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f159c009d20 con 0x7f15b40d18f0 2024-09-17T05:36:30.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15aa000640 1 -- 172.21.15.44:0/766202959 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159c0106c0 con 0x7f15b40d18f0 2024-09-17T05:36:30.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b41fa430 con 0x7f15b40d18f0 2024-09-17T05:36:30.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b41fa9f0 con 0x7f15b40d18f0 2024-09-17T05:36:30.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b415c300 con 0x7f15b40d18f0 2024-09-17T05:36:30.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.386+0000 7f15aa000640 1 -- 172.21.15.44:0/766202959 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f159c01a070 con 0x7f15b40d18f0 2024-09-17T05:36:30.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.390+0000 7f15aa000640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1590073200 0x7f1590075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.390+0000 7f15aa000640 1 -- 172.21.15.44:0/766202959 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f159c0946c0 con 0x7f15b40d18f0 2024-09-17T05:36:30.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.390+0000 7f15b1e00640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1590073200 0x7f1590075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.390+0000 7f15b1e00640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1590073200 0x7f1590075710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15a40af000 tx=0x7f15a401b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:30.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.394+0000 7f15aa000640 1 -- 172.21.15.44:0/766202959 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f159c05f380 con 0x7f15b40d18f0 2024-09-17T05:36:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:30.602+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f15b415fcf0 con 0x7f15b40d18f0 2024-09-17T05:36:31.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.374+0000 7f15aa000640 1 -- 172.21.15.44:0/766202959 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f159c05ec80 con 0x7f15b40d18f0 2024-09-17T05:36:31.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1590073200 msgr2=0x7f1590075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1590073200 0x7f1590075710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f15a40af000 tx=0x7f15a401b060 comp rx=0 tx=0).stop 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 msgr2=0x7f15b4158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b4158a40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f159c00d720 tx=0x7f159c00dbe0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 shutdown_connections 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1590073200 0x7f1590075710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15b40d1d00 0x7f15b4158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15b40d18f0 0x7f15b4158a40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 --2- 172.21.15.44:0/766202959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15b40cf5b0 0x7f15b415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 >> 172.21.15.44:0/766202959 conn(0x7f15b40b4240 msgr2=0x7f15b41566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 shutdown_connections 2024-09-17T05:36:31.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.378+0000 7f15b9000640 1 -- 172.21.15.44:0/766202959 wait complete. 2024-09-17T05:36:31.400 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-17T05:36:31.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:36:31.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 -- 172.21.15.44:0/1440575363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a815c900 msgr2=0x7f16a80b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 --2- 172.21.15.44:0/1440575363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a815c900 0x7f16a80b3cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1690009900 tx=0x7f169001c820 comp rx=0 tx=0).stop 2024-09-17T05:36:31.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 -- 172.21.15.44:0/1440575363 shutdown_connections 2024-09-17T05:36:31.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 --2- 172.21.15.44:0/1440575363 >> v2:172.21.15.86:3300/0 conn(0x7f16a80b4210 0x7f16a80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 --2- 172.21.15.44:0/1440575363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a815c900 0x7f16a80b3cd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 -- 172.21.15.44:0/1440575363 >> 172.21.15.44:0/1440575363 conn(0x7f16a80d2000 msgr2=0x7f16a80d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:31.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 -- 172.21.15.44:0/1440575363 shutdown_connections 2024-09-17T05:36:31.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.566+0000 7f16a7200640 1 -- 172.21.15.44:0/1440575363 wait complete. 2024-09-17T05:36:31.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 Processor -- start 2024-09-17T05:36:31.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 -- start start 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a80b4210 0x7f16a80cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a8145c50 0x7f16a81409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a815c900 0x7f16a815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16a8169c20 con 0x7f16a80b4210 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16a8169aa0 con 0x7f16a815c900 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a7200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f16a8169da0 con 0x7f16a8145c50 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a80b4210 0x7f16a80cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a80b4210 0x7f16a80cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48920/0 (socket says 172.21.15.44:48920) 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 -- 172.21.15.44:0/1562009683 learned_addr learned my addr 172.21.15.44:0/1562009683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f169d400640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a8145c50 0x7f16a81409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a6800640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a815c900 0x7f16a815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 -- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a8145c50 msgr2=0x7f16a81409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a8145c50 0x7f16a81409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 -- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a815c900 msgr2=0x7f16a815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a815c900 0x7f16a815a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 -- 172.21.15.44:0/1562009683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a80ce010 con 0x7f16a80b4210 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a6800640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a815c900 0x7f16a815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.570+0000 7f16a5e00640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a80b4210 0x7f16a80cdad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f169800c3c0 tx=0x7f169800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:31.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.574+0000 7f169ea00640 1 -- 172.21.15.44:0/1562009683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698017070 con 0x7f16a80b4210 2024-09-17T05:36:31.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.574+0000 7f169ea00640 1 -- 172.21.15.44:0/1562009683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16980053c0 con 0x7f16a80b4210 2024-09-17T05:36:31.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.574+0000 7f169ea00640 1 -- 172.21.15.44:0/1562009683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698003860 con 0x7f16a80b4210 2024-09-17T05:36:31.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.574+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a81fc3b0 con 0x7f16a80b4210 2024-09-17T05:36:31.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.574+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a80ce6e0 con 0x7f16a80b4210 2024-09-17T05:36:31.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.574+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a80b20e0 con 0x7f16a80b4210 2024-09-17T05:36:31.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.574+0000 7f169ea00640 1 -- 172.21.15.44:0/1562009683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f169801a070 con 0x7f16a80b4210 2024-09-17T05:36:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.578+0000 7f169ea00640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1684073230 0x7f1684075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.578+0000 7f169ea00640 1 -- 172.21.15.44:0/1562009683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f16980937c0 con 0x7f16a80b4210 2024-09-17T05:36:31.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.578+0000 7f169d400640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1684073230 0x7f1684075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.578+0000 7f169d400640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1684073230 0x7f1684075740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16900af000 tx=0x7f169001b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.582+0000 7f169ea00640 1 -- 172.21.15.44:0/1562009683 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f16a80b4620 con 0x7f16a80b4210 2024-09-17T05:36:31.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:31.790+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f16a81430a0 con 0x7f16a80b4210 2024-09-17T05:36:32.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f169ea00640 1 -- 172.21.15.44:0/1562009683 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f169805dec0 con 0x7f16a80b4210 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1684073230 msgr2=0x7f1684075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1684073230 0x7f1684075740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16900af000 tx=0x7f169001b060 comp rx=0 tx=0).stop 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a80b4210 msgr2=0x7f16a80cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a80b4210 0x7f16a80cdad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f169800c3c0 tx=0x7f169800c880 comp rx=0 tx=0).stop 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 shutdown_connections 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1684073230 0x7f1684075740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a815c900 0x7f16a815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a8145c50 0x7f16a81409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 --2- 172.21.15.44:0/1562009683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a80b4210 0x7f16a80cdad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 >> 172.21.15.44:0/1562009683 conn(0x7f16a80d2000 msgr2=0x7f16a80c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:32.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 shutdown_connections 2024-09-17T05:36:32.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.382+0000 7f16a7200640 1 -- 172.21.15.44:0/1562009683 wait complete. 2024-09-17T05:36:32.408 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:36:32.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 -- 172.21.15.44:0/1315750172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 msgr2=0x7fb20415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 --2- 172.21.15.44:0/1315750172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 0x7fb20415e990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009840 tx=0x7fb1f801c790 comp rx=0 tx=0).stop 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 -- 172.21.15.44:0/1315750172 shutdown_connections 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 --2- 172.21.15.44:0/1315750172 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb20406de50 0x7fb20406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 --2- 172.21.15.44:0/1315750172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 0x7fb20415e990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 -- 172.21.15.44:0/1315750172 >> 172.21.15.44:0/1315750172 conn(0x7fb2040ccaa0 msgr2=0x7fb2040cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 -- 172.21.15.44:0/1315750172 shutdown_connections 2024-09-17T05:36:32.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.570+0000 7fb20c600640 1 -- 172.21.15.44:0/1315750172 wait complete. 2024-09-17T05:36:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 Processor -- start 2024-09-17T05:36:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 -- start start 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb20406de50 0x7fb2040c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 0x7fb20409fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2040ced00 0x7fb2040a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb204169410 con 0x7fb2040ced00 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb204169290 con 0x7fb204072e50 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb204169590 con 0x7fb20406de50 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2040ced00 0x7fb2040a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2040ced00 0x7fb2040a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48928/0 (socket says 172.21.15.44:48928) 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 -- 172.21.15.44:0/2332547700 learned_addr learned my addr 172.21.15.44:0/2332547700 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb209200640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 0x7fb20409fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb209c00640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb20406de50 0x7fb2040c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 -- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb20406de50 msgr2=0x7fb2040c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb20406de50 0x7fb2040c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 -- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 msgr2=0x7fb20409fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 0x7fb20409fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 -- 172.21.15.44:0/2332547700 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb204153020 con 0x7fb2040ced00 2024-09-17T05:36:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20a600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2040ced00 0x7fb2040a0290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00cad0 tx=0x7fb1fc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb201600640 1 -- 172.21.15.44:0/2332547700 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc016020 con 0x7fb2040ced00 2024-09-17T05:36:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb201600640 1 -- 172.21.15.44:0/2332547700 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1fc00ab40 con 0x7fb2040ced00 2024-09-17T05:36:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20409b730 con 0x7fb2040ced00 2024-09-17T05:36:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb201600640 1 -- 172.21.15.44:0/2332547700 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00ce10 con 0x7fb2040ced00 2024-09-17T05:36:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.574+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2040a0ec0 con 0x7fb2040ced00 2024-09-17T05:36:32.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.578+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2041531f0 con 0x7fb2040ced00 2024-09-17T05:36:32.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.578+0000 7fb201600640 1 -- 172.21.15.44:0/2332547700 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb1fc019020 con 0x7fb2040ced00 2024-09-17T05:36:32.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.578+0000 7fb201600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb1e4073230 0x7fb1e4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.578+0000 7fb201600640 1 -- 172.21.15.44:0/2332547700 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb1fc094680 con 0x7fb2040ced00 2024-09-17T05:36:32.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.578+0000 7fb209c00640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb1e4073230 0x7fb1e4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.578+0000 7fb209c00640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb1e4073230 0x7fb1e4075740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80af000 tx=0x7fb1f801afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:32.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.582+0000 7fb201600640 1 -- 172.21.15.44:0/2332547700 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb1fc020020 con 0x7fb2040ced00 2024-09-17T05:36:32.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.794+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb20406e260 con 0x7fb2040ced00 2024-09-17T05:36:32.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.794+0000 7fb201600640 1 -- 172.21.15.44:0/2332547700 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7fb20406e7a0 con 0x7fb2040ced00 2024-09-17T05:36:32.796 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:32.797 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:32.797 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb1e4073230 msgr2=0x7fb1e4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb1e4073230 0x7fb1e4075740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80af000 tx=0x7fb1f801afd0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2040ced00 msgr2=0x7fb2040a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2040ced00 0x7fb2040a0290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00cad0 tx=0x7fb1fc00cbc0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 shutdown_connections 2024-09-17T05:36:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb2040ced00 0x7fb2040a0290 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb1e4073230 0x7fb1e4075740 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb204072e50 0x7fb20409fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 --2- 172.21.15.44:0/2332547700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb20406de50 0x7fb2040c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 >> 172.21.15.44:0/2332547700 conn(0x7fb2040ccaa0 msgr2=0x7fb20415f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 shutdown_connections 2024-09-17T05:36:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.798+0000 7fb20c600640 1 -- 172.21.15.44:0/2332547700 wait complete. 2024-09-17T05:36:32.820 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 -- 172.21.15.44:0/293535761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad5c004810 msgr2=0x7fad5c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 --2- 172.21.15.44:0/293535761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad5c004810 0x7fad5c004c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad64009b30 tx=0x7fad6401d240 comp rx=0 tx=0).stop 2024-09-17T05:36:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ca00640 1 -- 172.21.15.44:0/293535761 reap_dead start 2024-09-17T05:36:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 -- 172.21.15.44:0/293535761 shutdown_connections 2024-09-17T05:36:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 -- 172.21.15.44:0/293535761 >> 172.21.15.44:0/293535761 conn(0x7fad780b4240 msgr2=0x7fad780b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 -- 172.21.15.44:0/293535761 shutdown_connections 2024-09-17T05:36:32.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 -- 172.21.15.44:0/293535761 wait complete. 2024-09-17T05:36:32.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 Processor -- start 2024-09-17T05:36:32.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.978+0000 7fad7ea00640 1 -- start start 2024-09-17T05:36:32.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad5c004810 0x7fad78152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad781558d0 0x7fad781f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad781fbf20 0x7fad781fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad78167450 con 0x7fad781558d0 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fad781672d0 con 0x7fad781fbf20 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fad781675d0 con 0x7fad5c004810 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad781558d0 0x7fad781f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad781558d0 0x7fad781f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48946/0 (socket says 172.21.15.44:48946) 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 -- 172.21.15.44:0/1524962603 learned_addr learned my addr 172.21.15.44:0/1524962603 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77e00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad5c004810 0x7fad78152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ca00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad781fbf20 0x7fad781fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 -- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad5c004810 msgr2=0x7fad78152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad5c004810 0x7fad78152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 -- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad781fbf20 msgr2=0x7fad781fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad781fbf20 0x7fad781fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 -- 172.21.15.44:0/1524962603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad78152890 con 0x7fad781558d0 2024-09-17T05:36:32.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ca00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad781fbf20 0x7fad781fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad77400640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad781558d0 0x7fad781f5c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad64009b30 tx=0x7fad640acd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad6fe00640 1 -- 172.21.15.44:0/1524962603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad640b1040 con 0x7fad781558d0 2024-09-17T05:36:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad6fe00640 1 -- 172.21.15.44:0/1524962603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad640ac400 con 0x7fad781558d0 2024-09-17T05:36:32.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad781fc870 con 0x7fad781558d0 2024-09-17T05:36:32.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad6fe00640 1 -- 172.21.15.44:0/1524962603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64009730 con 0x7fad781558d0 2024-09-17T05:36:32.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad78153e80 con 0x7fad781558d0 2024-09-17T05:36:32.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.982+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad780cf070 con 0x7fad781558d0 2024-09-17T05:36:32.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.986+0000 7fad6fe00640 1 -- 172.21.15.44:0/1524962603 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fad640c0030 con 0x7fad781558d0 2024-09-17T05:36:32.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.986+0000 7fad6fe00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad58073200 0x7fad58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:32.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.986+0000 7fad6fe00640 1 -- 172.21.15.44:0/1524962603 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fad6412f450 con 0x7fad781558d0 2024-09-17T05:36:32.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.986+0000 7fad77e00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad58073200 0x7fad58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:32.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.986+0000 7fad77e00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad58073200 0x7fad58075710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad68000fe0 tx=0x7fad680019a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:32.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:32.990+0000 7fad6fe00640 1 -- 172.21.15.44:0/1524962603 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fad781fc870 con 0x7fad781558d0 2024-09-17T05:36:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.162+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad781f9640 con 0x7fad781558d0 2024-09-17T05:36:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad6fe00640 1 -- 172.21.15.44:0/1524962603 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7fad64016f80 con 0x7fad781558d0 2024-09-17T05:36:33.166 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:33.167 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad58073200 msgr2=0x7fad58075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad58073200 0x7fad58075710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad68000fe0 tx=0x7fad680019a0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad781558d0 msgr2=0x7fad781f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad781558d0 0x7fad781f5c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad64009b30 tx=0x7fad640acd40 comp rx=0 tx=0).stop 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 shutdown_connections 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad58073200 0x7fad58075710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad781fbf20 0x7fad781fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad781558d0 0x7fad781f5c80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 --2- 172.21.15.44:0/1524962603 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad5c004810 0x7fad78152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 >> 172.21.15.44:0/1524962603 conn(0x7fad780b4240 msgr2=0x7fad780b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 shutdown_connections 2024-09-17T05:36:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.166+0000 7fad7ea00640 1 -- 172.21.15.44:0/1524962603 wait complete. 2024-09-17T05:36:33.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:36:33.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 -- 172.21.15.44:0/3546761816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c200cecf0 msgr2=0x7f9c200cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3546761816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c200cecf0 0x7f9c200cf100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c009840 tx=0x7f9c0c01c700 comp rx=0 tx=0).stop 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 -- 172.21.15.44:0/3546761816 shutdown_connections 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3546761816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c200cecf0 0x7f9c200cf100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3546761816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c20072190 0x7f9c2006e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 -- 172.21.15.44:0/3546761816 >> 172.21.15.44:0/3546761816 conn(0x7f9c200d1120 msgr2=0x7f9c200d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 -- 172.21.15.44:0/3546761816 shutdown_connections 2024-09-17T05:36:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 -- 172.21.15.44:0/3546761816 wait complete. 2024-09-17T05:36:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 Processor -- start 2024-09-17T05:36:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.350+0000 7f9c27a00640 1 -- start start 2024-09-17T05:36:33.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c20072190 0x7f9c201f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c200ae3e0 0x7f9c200b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c200cecf0 0x7f9c200c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20168e40 con 0x7f9c20072190 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9c20168cc0 con 0x7f9c200ae3e0 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9c20168fc0 con 0x7f9c200cecf0 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c20072190 0x7f9c201f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c20072190 0x7f9c201f99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48962/0 (socket says 172.21.15.44:48962) 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 -- 172.21.15.44:0/3137270009 learned_addr learned my addr 172.21.15.44:0/3137270009 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c1fe00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c200ae3e0 0x7f9c200b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25a00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c200cecf0 0x7f9c200c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 -- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c200cecf0 msgr2=0x7f9c200c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c200cecf0 0x7f9c200c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 -- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c200ae3e0 msgr2=0x7f9c200b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c200ae3e0 0x7f9c200b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 -- 172.21.15.44:0/3137270009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200b68c0 con 0x7f9c20072190 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c25000640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c20072190 0x7f9c201f99a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e7c0 tx=0x7f9c1400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c1cc00640 1 -- 172.21.15.44:0/3137270009 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1400ccc0 con 0x7f9c20072190 2024-09-17T05:36:33.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c1cc00640 1 -- 172.21.15.44:0/3137270009 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c1400ce80 con 0x7f9c20072190 2024-09-17T05:36:33.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c200b6ba0 con 0x7f9c20072190 2024-09-17T05:36:33.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c1cc00640 1 -- 172.21.15.44:0/3137270009 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14005280 con 0x7f9c20072190 2024-09-17T05:36:33.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c200b2490 con 0x7f9c20072190 2024-09-17T05:36:33.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.354+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c200b6de0 con 0x7f9c20072190 2024-09-17T05:36:33.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.358+0000 7f9c1cc00640 1 -- 172.21.15.44:0/3137270009 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9c14005420 con 0x7f9c20072190 2024-09-17T05:36:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.358+0000 7f9c1cc00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c00073230 0x7f9c00075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.358+0000 7f9c1cc00640 1 -- 172.21.15.44:0/3137270009 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c14094e70 con 0x7f9c20072190 2024-09-17T05:36:33.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.358+0000 7f9c1fe00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c00073230 0x7f9c00075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.358+0000 7f9c1fe00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c00073230 0x7f9c00075740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0af000 tx=0x7f9c0c01af40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.362+0000 7f9c1cc00640 1 -- 172.21.15.44:0/3137270009 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9c200b6de0 con 0x7f9c20072190 2024-09-17T05:36:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.534+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c200b2730 con 0x7f9c00073230 2024-09-17T05:36:33.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.542+0000 7f9c1cc00640 1 -- 172.21.15.44:0/3137270009 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332555 (secure 0 0 0) 0x7f9c200b2730 con 0x7f9c00073230 2024-09-17T05:36:33.546 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:33.550 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c00073230 msgr2=0x7f9c00075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c00073230 0x7f9c00075740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0af000 tx=0x7f9c0c01af40 comp rx=0 tx=0).stop 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c20072190 msgr2=0x7f9c201f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c20072190 0x7f9c201f99a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e7c0 tx=0x7f9c1400ec80 comp rx=0 tx=0).stop 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 shutdown_connections 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9c200cecf0 0x7f9c200c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c00073230 0x7f9c00075740 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c200ae3e0 0x7f9c200b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 --2- 172.21.15.44:0/3137270009 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9c20072190 0x7f9c201f99a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 >> 172.21.15.44:0/3137270009 conn(0x7f9c200d1120 msgr2=0x7f9c200cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 shutdown_connections 2024-09-17T05:36:33.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.546+0000 7f9c27a00640 1 -- 172.21.15.44:0/3137270009 wait complete. 2024-09-17T05:36:33.569 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-17T05:36:32.261079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219556,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755164,"statfs":{"total":773094113280,"available":772869287936,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003017"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344741+0000","last_change":"2024-09-17T05:36:16.322687+0000","last_active":"2024-09-17T05:36:22.344741+0000","last_peered":"2024-09-17T05:36:22.344741+0000","last_clean":"2024-09-17T05:36:22.344741+0000","last_became_active":"2024-09-17T05:36:16.322327+0000","last_became_peered":"2024-09-17T05:36:16.322327+0000","last_unstale":"2024-09-17T05:36:22.344741+0000","last_undegraded":"2024-09-17T05:36:22.344741+0000","last_fullsized":"2024-09-17T05:36:22.344741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528771+0000","last_change":"2024-09-17T05:36:17.346577+0000","last_active":"2024-09-17T05:36:23.528771+0000","last_peered":"2024-09-17T05:36:23.528771+0000","last_clean":"2024-09-17T05:36:23.528771+0000","last_became_active":"2024-09-17T05:36:17.346190+0000","last_became_peered":"2024-09-17T05:36:17.346190+0000","last_unstale":"2024-09-17T05:36:23.528771+0000","last_undegraded":"2024-09-17T05:36:23.528771+0000","last_fullsized":"2024-09-17T05:36:23.528771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528503+0000","last_change":"2024-09-17T05:36:21.378187+0000","last_active":"2024-09-17T05:36:23.528503+0000","last_peered":"2024-09-17T05:36:23.528503+0000","last_clean":"2024-09-17T05:36:23.528503+0000","last_became_active":"2024-09-17T05:36:21.377733+0000","last_became_peered":"2024-09-17T05:36:21.377733+0000","last_unstale":"2024-09-17T05:36:23.528503+0000","last_undegraded":"2024-09-17T05:36:23.528503+0000","last_fullsized":"2024-09-17T05:36:23.528503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:33.577546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528970+0000","last_change":"2024-09-17T05:36:16.318233+0000","last_active":"2024-09-17T05:36:23.528970+0000","last_peered":"2024-09-17T05:36:23.528970+0000","last_clean":"2024-09-17T05:36:23.528970+0000","last_became_active":"2024-09-17T05:36:16.316897+0000","last_became_peered":"2024-09-17T05:36:16.316897+0000","last_unstale":"2024-09-17T05:36:23.528970+0000","last_undegraded":"2024-09-17T05:36:23.528970+0000","last_fullsized":"2024-09-17T05:36:23.528970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528763+0000","last_change":"2024-09-17T05:36:17.337382+0000","last_active":"2024-09-17T05:36:23.528763+0000","last_peered":"2024-09-17T05:36:23.528763+0000","last_clean":"2024-09-17T05:36:23.528763+0000","last_became_active":"2024-09-17T05:36:17.330732+0000","last_became_peered":"2024-09-17T05:36:17.330732+0000","last_unstale":"2024-09-17T05:36:23.528763+0000","last_undegraded":"2024-09-17T05:36:23.528763+0000","last_fullsized":"2024-09-17T05:36:23.528763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:20.100003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340737+0000","last_change":"2024-09-17T05:36:21.371771+0000","last_active":"2024-09-17T05:36:22.340737+0000","last_peered":"2024-09-17T05:36:22.340737+0000","last_clean":"2024-09-17T05:36:22.340737+0000","last_became_active":"2024-09-17T05:36:21.370880+0000","last_became_peered":"2024-09-17T05:36:21.370880+0000","last_unstale":"2024-09-17T05:36:22.340737+0000","last_undegraded":"2024-09-17T05:36:22.340737+0000","last_fullsized":"2024-09-17T05:36:22.340737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:14.478542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715355+0000","last_change":"2024-09-17T05:36:16.327231+0000","last_active":"2024-09-17T05:36:22.715355+0000","last_peered":"2024-09-17T05:36:22.715355+0000","last_clean":"2024-09-17T05:36:22.715355+0000","last_became_active":"2024-09-17T05:36:16.326856+0000","last_became_peered":"2024-09-17T05:36:16.326856+0000","last_unstale":"2024-09-17T05:36:22.715355+0000","last_undegraded":"2024-09-17T05:36:22.715355+0000","last_fullsized":"2024-09-17T05:36:22.715355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:29.442629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527139+0000","last_change":"2024-09-17T05:36:17.331749+0000","last_active":"2024-09-17T05:36:23.527139+0000","last_peered":"2024-09-17T05:36:23.527139+0000","last_clean":"2024-09-17T05:36:23.527139+0000","last_became_active":"2024-09-17T05:36:17.329815+0000","last_became_peered":"2024-09-17T05:36:17.329815+0000","last_unstale":"2024-09-17T05:36:23.527139+0000","last_undegraded":"2024-09-17T05:36:23.527139+0000","last_fullsized":"2024-09-17T05:36:23.527139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:13.966029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341080+0000","last_change":"2024-09-17T05:36:21.372497+0000","last_active":"2024-09-17T05:36:22.341080+0000","last_peered":"2024-09-17T05:36:22.341080+0000","last_clean":"2024-09-17T05:36:22.341080+0000","last_became_active":"2024-09-17T05:36:21.372038+0000","last_became_peered":"2024-09-17T05:36:21.372038+0000","last_unstale":"2024-09-17T05:36:22.341080+0000","last_undegraded":"2024-09-17T05:36:22.341080+0000","last_fullsized":"2024-09-17T05:36:22.341080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715174+0000","last_change":"2024-09-17T05:36:16.328078+0000","last_active":"2024-09-17T05:36:22.715174+0000","last_peered":"2024-09-17T05:36:22.715174+0000","last_clean":"2024-09-17T05:36:22.715174+0000","last_became_active":"2024-09-17T05:36:16.327672+0000","last_became_peered":"2024-09-17T05:36:16.327672+0000","last_unstale":"2024-09-17T05:36:22.715174+0000","last_undegraded":"2024-09-17T05:36:22.715174+0000","last_fullsized":"2024-09-17T05:36:22.715174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981888+0000","last_change":"2024-09-17T05:36:17.316048+0000","last_active":"2024-09-17T05:36:22.981888+0000","last_peered":"2024-09-17T05:36:22.981888+0000","last_clean":"2024-09-17T05:36:22.981888+0000","last_became_active":"2024-09-17T05:36:17.315721+0000","last_became_peered":"2024-09-17T05:36:17.315721+0000","last_unstale":"2024-09-17T05:36:22.981888+0000","last_undegraded":"2024-09-17T05:36:22.981888+0000","last_fullsized":"2024-09-17T05:36:22.981888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:00.464476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340720+0000","last_change":"2024-09-17T05:36:21.373595+0000","last_active":"2024-09-17T05:36:22.340720+0000","last_peered":"2024-09-17T05:36:22.340720+0000","last_clean":"2024-09-17T05:36:22.340720+0000","last_became_active":"2024-09-17T05:36:21.372679+0000","last_became_peered":"2024-09-17T05:36:21.372679+0000","last_unstale":"2024-09-17T05:36:22.340720+0000","last_undegraded":"2024-09-17T05:36:22.340720+0000","last_fullsized":"2024-09-17T05:36:22.340720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:10.401214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981418+0000","last_change":"2024-09-17T05:36:17.308500+0000","last_active":"2024-09-17T05:36:22.981418+0000","last_peered":"2024-09-17T05:36:22.981418+0000","last_clean":"2024-09-17T05:36:22.981418+0000","last_became_active":"2024-09-17T05:36:17.303262+0000","last_became_peered":"2024-09-17T05:36:17.303262+0000","last_unstale":"2024-09-17T05:36:22.981418+0000","last_undegraded":"2024-09-17T05:36:22.981418+0000","last_fullsized":"2024-09-17T05:36:22.981418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:16.966266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981661+0000","last_change":"2024-09-17T05:36:16.333433+0000","last_active":"2024-09-17T05:36:22.981661+0000","last_peered":"2024-09-17T05:36:22.981661+0000","last_clean":"2024-09-17T05:36:22.981661+0000","last_became_active":"2024-09-17T05:36:16.328517+0000","last_became_peered":"2024-09-17T05:36:16.328517+0000","last_unstale":"2024-09-17T05:36:22.981661+0000","last_undegraded":"2024-09-17T05:36:22.981661+0000","last_fullsized":"2024-09-17T05:36:22.981661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:43.294722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981779+0000","last_change":"2024-09-17T05:36:21.377118+0000","last_active":"2024-09-17T05:36:22.981779+0000","last_peered":"2024-09-17T05:36:22.981779+0000","last_clean":"2024-09-17T05:36:22.981779+0000","last_became_active":"2024-09-17T05:36:21.376379+0000","last_became_peered":"2024-09-17T05:36:21.376379+0000","last_unstale":"2024-09-17T05:36:22.981779+0000","last_undegraded":"2024-09-17T05:36:22.981779+0000","last_fullsized":"2024-09-17T05:36:22.981779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:22.735617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529100+0000","last_change":"2024-09-17T05:36:17.344836+0000","last_active":"2024-09-17T05:36:23.529100+0000","last_peered":"2024-09-17T05:36:23.529100+0000","last_clean":"2024-09-17T05:36:23.529100+0000","last_became_active":"2024-09-17T05:36:17.343959+0000","last_became_peered":"2024-09-17T05:36:17.343959+0000","last_unstale":"2024-09-17T05:36:23.529100+0000","last_undegraded":"2024-09-17T05:36:23.529100+0000","last_fullsized":"2024-09-17T05:36:23.529100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343968+0000","last_change":"2024-09-17T05:36:16.321265+0000","last_active":"2024-09-17T05:36:22.343968+0000","last_peered":"2024-09-17T05:36:22.343968+0000","last_clean":"2024-09-17T05:36:22.343968+0000","last_became_active":"2024-09-17T05:36:16.320994+0000","last_became_peered":"2024-09-17T05:36:16.320994+0000","last_unstale":"2024-09-17T05:36:22.343968+0000","last_undegraded":"2024-09-17T05:36:22.343968+0000","last_fullsized":"2024-09-17T05:36:22.343968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:12.139048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714749+0000","last_change":"2024-09-17T05:36:21.363951+0000","last_active":"2024-09-17T05:36:22.714749+0000","last_peered":"2024-09-17T05:36:22.714749+0000","last_clean":"2024-09-17T05:36:22.714749+0000","last_became_active":"2024-09-17T05:36:21.363462+0000","last_became_peered":"2024-09-17T05:36:21.363462+0000","last_unstale":"2024-09-17T05:36:22.714749+0000","last_undegraded":"2024-09-17T05:36:22.714749+0000","last_fullsized":"2024-09-17T05:36:22.714749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:35.701351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342422+0000","last_change":"2024-09-17T05:36:17.337740+0000","last_active":"2024-09-17T05:36:22.342422+0000","last_peered":"2024-09-17T05:36:22.342422+0000","last_clean":"2024-09-17T05:36:22.342422+0000","last_became_active":"2024-09-17T05:36:17.332701+0000","last_became_peered":"2024-09-17T05:36:17.332701+0000","last_unstale":"2024-09-17T05:36:22.342422+0000","last_undegraded":"2024-09-17T05:36:22.342422+0000","last_fullsized":"2024-09-17T05:36:22.342422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:58.266096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342734+0000","last_change":"2024-09-17T05:36:16.316754+0000","last_active":"2024-09-17T05:36:22.342734+0000","last_peered":"2024-09-17T05:36:22.342734+0000","last_clean":"2024-09-17T05:36:22.342734+0000","last_became_active":"2024-09-17T05:36:16.316437+0000","last_became_peered":"2024-09-17T05:36:16.316437+0000","last_unstale":"2024-09-17T05:36:22.342734+0000","last_undegraded":"2024-09-17T05:36:22.342734+0000","last_fullsized":"2024-09-17T05:36:22.342734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529269+0000","last_change":"2024-09-17T05:36:21.387657+0000","last_active":"2024-09-17T05:36:23.529269+0000","last_peered":"2024-09-17T05:36:23.529269+0000","last_clean":"2024-09-17T05:36:23.529269+0000","last_became_active":"2024-09-17T05:36:21.387055+0000","last_became_peered":"2024-09-17T05:36:21.387055+0000","last_unstale":"2024-09-17T05:36:23.529269+0000","last_undegraded":"2024-09-17T05:36:23.529269+0000","last_fullsized":"2024-09-17T05:36:23.529269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:32.937859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981203+0000","last_change":"2024-09-17T05:36:17.322184+0000","last_active":"2024-09-17T05:36:22.981203+0000","last_peered":"2024-09-17T05:36:22.981203+0000","last_clean":"2024-09-17T05:36:22.981203+0000","last_became_active":"2024-09-17T05:36:17.320864+0000","last_became_peered":"2024-09-17T05:36:17.320864+0000","last_unstale":"2024-09-17T05:36:22.981203+0000","last_undegraded":"2024-09-17T05:36:22.981203+0000","last_fullsized":"2024-09-17T05:36:22.981203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714387+0000","last_change":"2024-09-17T05:36:16.317147+0000","last_active":"2024-09-17T05:36:22.714387+0000","last_peered":"2024-09-17T05:36:22.714387+0000","last_clean":"2024-09-17T05:36:22.714387+0000","last_became_active":"2024-09-17T05:36:16.316600+0000","last_became_peered":"2024-09-17T05:36:16.316600+0000","last_unstale":"2024-09-17T05:36:22.714387+0000","last_undegraded":"2024-09-17T05:36:22.714387+0000","last_fullsized":"2024-09-17T05:36:22.714387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341697+0000","last_change":"2024-09-17T05:36:21.366149+0000","last_active":"2024-09-17T05:36:22.341697+0000","last_peered":"2024-09-17T05:36:22.341697+0000","last_clean":"2024-09-17T05:36:22.341697+0000","last_became_active":"2024-09-17T05:36:21.365665+0000","last_became_peered":"2024-09-17T05:36:21.365665+0000","last_unstale":"2024-09-17T05:36:22.341697+0000","last_undegraded":"2024-09-17T05:36:22.341697+0000","last_fullsized":"2024-09-17T05:36:22.341697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:04.721488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344454+0000","last_change":"2024-09-17T05:36:17.334934+0000","last_active":"2024-09-17T05:36:22.344454+0000","last_peered":"2024-09-17T05:36:22.344454+0000","last_clean":"2024-09-17T05:36:22.344454+0000","last_became_active":"2024-09-17T05:36:17.334132+0000","last_became_peered":"2024-09-17T05:36:17.334132+0000","last_unstale":"2024-09-17T05:36:22.344454+0000","last_undegraded":"2024-09-17T05:36:22.344454+0000","last_fullsized":"2024-09-17T05:36:22.344454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982376+0000","last_change":"2024-09-17T05:36:16.325337+0000","last_active":"2024-09-17T05:36:22.982376+0000","last_peered":"2024-09-17T05:36:22.982376+0000","last_clean":"2024-09-17T05:36:22.982376+0000","last_became_active":"2024-09-17T05:36:16.322984+0000","last_became_peered":"2024-09-17T05:36:16.322984+0000","last_unstale":"2024-09-17T05:36:22.982376+0000","last_undegraded":"2024-09-17T05:36:22.982376+0000","last_fullsized":"2024-09-17T05:36:22.982376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:06.046560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341200+0000","last_change":"2024-09-17T05:36:21.358756+0000","last_active":"2024-09-17T05:36:22.341200+0000","last_peered":"2024-09-17T05:36:22.341200+0000","last_clean":"2024-09-17T05:36:22.341200+0000","last_became_active":"2024-09-17T05:36:21.358225+0000","last_became_peered":"2024-09-17T05:36:21.358225+0000","last_unstale":"2024-09-17T05:36:22.341200+0000","last_undegraded":"2024-09-17T05:36:22.341200+0000","last_fullsized":"2024-09-17T05:36:22.341200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:10.794511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344614+0000","last_change":"2024-09-17T05:36:17.321481+0000","last_active":"2024-09-17T05:36:22.344614+0000","last_peered":"2024-09-17T05:36:22.344614+0000","last_clean":"2024-09-17T05:36:22.344614+0000","last_became_active":"2024-09-17T05:36:17.321132+0000","last_became_peered":"2024-09-17T05:36:17.321132+0000","last_unstale":"2024-09-17T05:36:22.344614+0000","last_undegraded":"2024-09-17T05:36:22.344614+0000","last_fullsized":"2024-09-17T05:36:22.344614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344664+0000","last_change":"2024-09-17T05:36:16.314881+0000","last_active":"2024-09-17T05:36:22.344664+0000","last_peered":"2024-09-17T05:36:22.344664+0000","last_clean":"2024-09-17T05:36:22.344664+0000","last_became_active":"2024-09-17T05:36:16.314473+0000","last_became_peered":"2024-09-17T05:36:16.314473+0000","last_unstale":"2024-09-17T05:36:22.344664+0000","last_undegraded":"2024-09-17T05:36:22.344664+0000","last_fullsized":"2024-09-17T05:36:22.344664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:34.851574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342176+0000","last_change":"2024-09-17T05:36:21.359463+0000","last_active":"2024-09-17T05:36:22.342176+0000","last_peered":"2024-09-17T05:36:22.342176+0000","last_clean":"2024-09-17T05:36:22.342176+0000","last_became_active":"2024-09-17T05:36:21.358945+0000","last_became_peered":"2024-09-17T05:36:21.358945+0000","last_unstale":"2024-09-17T05:36:22.342176+0000","last_undegraded":"2024-09-17T05:36:22.342176+0000","last_fullsized":"2024-09-17T05:36:22.342176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:16.789795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343353+0000","last_change":"2024-09-17T05:36:17.352141+0000","last_active":"2024-09-17T05:36:22.343353+0000","last_peered":"2024-09-17T05:36:22.343353+0000","last_clean":"2024-09-17T05:36:22.343353+0000","last_became_active":"2024-09-17T05:36:17.351766+0000","last_became_peered":"2024-09-17T05:36:17.351766+0000","last_unstale":"2024-09-17T05:36:22.343353+0000","last_undegraded":"2024-09-17T05:36:22.343353+0000","last_fullsized":"2024-09-17T05:36:22.343353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:50.090463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982180+0000","last_change":"2024-09-17T05:36:16.321568+0000","last_active":"2024-09-17T05:36:22.982180+0000","last_peered":"2024-09-17T05:36:22.982180+0000","last_clean":"2024-09-17T05:36:22.982180+0000","last_became_active":"2024-09-17T05:36:16.321260+0000","last_became_peered":"2024-09-17T05:36:16.321260+0000","last_unstale":"2024-09-17T05:36:22.982180+0000","last_undegraded":"2024-09-17T05:36:22.982180+0000","last_fullsized":"2024-09-17T05:36:22.982180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:57.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342554+0000","last_change":"2024-09-17T05:36:21.368740+0000","last_active":"2024-09-17T05:36:22.342554+0000","last_peered":"2024-09-17T05:36:22.342554+0000","last_clean":"2024-09-17T05:36:22.342554+0000","last_became_active":"2024-09-17T05:36:21.367320+0000","last_became_peered":"2024-09-17T05:36:21.367320+0000","last_unstale":"2024-09-17T05:36:22.342554+0000","last_undegraded":"2024-09-17T05:36:22.342554+0000","last_fullsized":"2024-09-17T05:36:22.342554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:31.367750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340925+0000","last_change":"2024-09-17T05:36:17.324299+0000","last_active":"2024-09-17T05:36:22.340925+0000","last_peered":"2024-09-17T05:36:22.340925+0000","last_clean":"2024-09-17T05:36:22.340925+0000","last_became_active":"2024-09-17T05:36:17.323941+0000","last_became_peered":"2024-09-17T05:36:17.323941+0000","last_unstale":"2024-09-17T05:36:22.340925+0000","last_undegraded":"2024-09-17T05:36:22.340925+0000","last_fullsized":"2024-09-17T05:36:22.340925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528295+0000","last_change":"2024-09-17T05:36:16.318757+0000","last_active":"2024-09-17T05:36:23.528295+0000","last_peered":"2024-09-17T05:36:23.528295+0000","last_clean":"2024-09-17T05:36:23.528295+0000","last_became_active":"2024-09-17T05:36:16.318452+0000","last_became_peered":"2024-09-17T05:36:16.318452+0000","last_unstale":"2024-09-17T05:36:23.528295+0000","last_undegraded":"2024-09-17T05:36:23.528295+0000","last_fullsized":"2024-09-17T05:36:23.528295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342943+0000","last_change":"2024-09-17T05:36:21.374533+0000","last_active":"2024-09-17T05:36:22.342943+0000","last_peered":"2024-09-17T05:36:22.342943+0000","last_clean":"2024-09-17T05:36:22.342943+0000","last_became_active":"2024-09-17T05:36:21.373222+0000","last_became_peered":"2024-09-17T05:36:21.373222+0000","last_unstale":"2024-09-17T05:36:22.342943+0000","last_undegraded":"2024-09-17T05:36:22.342943+0000","last_fullsized":"2024-09-17T05:36:22.342943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:51.191726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714674+0000","last_change":"2024-09-17T05:36:17.336498+0000","last_active":"2024-09-17T05:36:22.714674+0000","last_peered":"2024-09-17T05:36:22.714674+0000","last_clean":"2024-09-17T05:36:22.714674+0000","last_became_active":"2024-09-17T05:36:17.335606+0000","last_became_peered":"2024-09-17T05:36:17.335606+0000","last_unstale":"2024-09-17T05:36:22.714674+0000","last_undegraded":"2024-09-17T05:36:22.714674+0000","last_fullsized":"2024-09-17T05:36:22.714674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981647+0000","last_change":"2024-09-17T05:36:16.307663+0000","last_active":"2024-09-17T05:36:22.981647+0000","last_peered":"2024-09-17T05:36:22.981647+0000","last_clean":"2024-09-17T05:36:22.981647+0000","last_became_active":"2024-09-17T05:36:16.307264+0000","last_became_peered":"2024-09-17T05:36:16.307264+0000","last_unstale":"2024-09-17T05:36:22.981647+0000","last_undegraded":"2024-09-17T05:36:22.981647+0000","last_fullsized":"2024-09-17T05:36:22.981647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:19.042460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343190+0000","last_change":"2024-09-17T05:36:21.372969+0000","last_active":"2024-09-17T05:36:22.343190+0000","last_peered":"2024-09-17T05:36:22.343190+0000","last_clean":"2024-09-17T05:36:22.343190+0000","last_became_active":"2024-09-17T05:36:21.368548+0000","last_became_peered":"2024-09-17T05:36:21.368548+0000","last_unstale":"2024-09-17T05:36:22.343190+0000","last_undegraded":"2024-09-17T05:36:22.343190+0000","last_fullsized":"2024-09-17T05:36:22.343190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.206523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527667+0000","last_change":"2024-09-17T05:36:17.328522+0000","last_active":"2024-09-17T05:36:23.527667+0000","last_peered":"2024-09-17T05:36:23.527667+0000","last_clean":"2024-09-17T05:36:23.527667+0000","last_became_active":"2024-09-17T05:36:17.327985+0000","last_became_peered":"2024-09-17T05:36:17.327985+0000","last_unstale":"2024-09-17T05:36:23.527667+0000","last_undegraded":"2024-09-17T05:36:23.527667+0000","last_fullsized":"2024-09-17T05:36:23.527667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528925+0000","last_change":"2024-09-17T05:36:16.316486+0000","last_active":"2024-09-17T05:36:23.528925+0000","last_peered":"2024-09-17T05:36:23.528925+0000","last_clean":"2024-09-17T05:36:23.528925+0000","last_became_active":"2024-09-17T05:36:16.316098+0000","last_became_peered":"2024-09-17T05:36:16.316098+0000","last_unstale":"2024-09-17T05:36:23.528925+0000","last_undegraded":"2024-09-17T05:36:23.528925+0000","last_fullsized":"2024-09-17T05:36:23.528925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343972+0000","last_change":"2024-09-17T05:36:21.369648+0000","last_active":"2024-09-17T05:36:22.343972+0000","last_peered":"2024-09-17T05:36:22.343972+0000","last_clean":"2024-09-17T05:36:22.343972+0000","last_became_active":"2024-09-17T05:36:21.366772+0000","last_became_peered":"2024-09-17T05:36:21.366772+0000","last_unstale":"2024-09-17T05:36:22.343972+0000","last_undegraded":"2024-09-17T05:36:22.343972+0000","last_fullsized":"2024-09-17T05:36:22.343972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:06.404204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342292+0000","last_change":"2024-09-17T05:36:17.340972+0000","last_active":"2024-09-17T05:36:22.342292+0000","last_peered":"2024-09-17T05:36:22.342292+0000","last_clean":"2024-09-17T05:36:22.342292+0000","last_became_active":"2024-09-17T05:36:17.340593+0000","last_became_peered":"2024-09-17T05:36:17.340593+0000","last_unstale":"2024-09-17T05:36:22.342292+0000","last_undegraded":"2024-09-17T05:36:22.342292+0000","last_fullsized":"2024-09-17T05:36:22.342292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:44.722774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981430+0000","last_change":"2024-09-17T05:36:16.335220+0000","last_active":"2024-09-17T05:36:22.981430+0000","last_peered":"2024-09-17T05:36:22.981430+0000","last_clean":"2024-09-17T05:36:22.981430+0000","last_became_active":"2024-09-17T05:36:16.334710+0000","last_became_peered":"2024-09-17T05:36:16.334710+0000","last_unstale":"2024-09-17T05:36:22.981430+0000","last_undegraded":"2024-09-17T05:36:22.981430+0000","last_fullsized":"2024-09-17T05:36:22.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:26.451376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528550+0000","last_change":"2024-09-17T05:36:21.375167+0000","last_active":"2024-09-17T05:36:23.528550+0000","last_peered":"2024-09-17T05:36:23.528550+0000","last_clean":"2024-09-17T05:36:23.528550+0000","last_became_active":"2024-09-17T05:36:21.374539+0000","last_became_peered":"2024-09-17T05:36:21.374539+0000","last_unstale":"2024-09-17T05:36:23.528550+0000","last_undegraded":"2024-09-17T05:36:23.528550+0000","last_fullsized":"2024-09-17T05:36:23.528550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:34.823660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343374+0000","last_change":"2024-09-17T05:36:17.334660+0000","last_active":"2024-09-17T05:36:22.343374+0000","last_peered":"2024-09-17T05:36:22.343374+0000","last_clean":"2024-09-17T05:36:22.343374+0000","last_became_active":"2024-09-17T05:36:17.334310+0000","last_became_peered":"2024-09-17T05:36:17.334310+0000","last_unstale":"2024-09-17T05:36:22.343374+0000","last_undegraded":"2024-09-17T05:36:22.343374+0000","last_fullsized":"2024-09-17T05:36:22.343374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981696+0000","last_change":"2024-09-17T05:36:16.328867+0000","last_active":"2024-09-17T05:36:22.981696+0000","last_peered":"2024-09-17T05:36:22.981696+0000","last_clean":"2024-09-17T05:36:22.981696+0000","last_became_active":"2024-09-17T05:36:16.328108+0000","last_became_peered":"2024-09-17T05:36:16.328108+0000","last_unstale":"2024-09-17T05:36:22.981696+0000","last_undegraded":"2024-09-17T05:36:22.981696+0000","last_fullsized":"2024-09-17T05:36:22.981696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526996+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:36:23.526996+0000","last_peered":"2024-09-17T05:36:23.526996+0000","last_clean":"2024-09-17T05:36:23.526996+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:36:23.526996+0000","last_undegraded":"2024-09-17T05:36:23.526996+0000","last_fullsized":"2024-09-17T05:36:23.526996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982083+0000","last_change":"2024-09-17T05:36:21.383242+0000","last_active":"2024-09-17T05:36:22.982083+0000","last_peered":"2024-09-17T05:36:22.982083+0000","last_clean":"2024-09-17T05:36:22.982083+0000","last_became_active":"2024-09-17T05:36:21.382738+0000","last_became_peered":"2024-09-17T05:36:21.382738+0000","last_unstale":"2024-09-17T05:36:22.982083+0000","last_undegraded":"2024-09-17T05:36:22.982083+0000","last_fullsized":"2024-09-17T05:36:22.982083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.889971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982006+0000","last_change":"2024-09-17T05:36:17.310411+0000","last_active":"2024-09-17T05:36:22.982006+0000","last_peered":"2024-09-17T05:36:22.982006+0000","last_clean":"2024-09-17T05:36:22.982006+0000","last_became_active":"2024-09-17T05:36:17.310092+0000","last_became_peered":"2024-09-17T05:36:17.310092+0000","last_unstale":"2024-09-17T05:36:22.982006+0000","last_undegraded":"2024-09-17T05:36:22.982006+0000","last_fullsized":"2024-09-17T05:36:22.982006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:30.785518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343432+0000","last_change":"2024-09-17T05:36:16.322081+0000","last_active":"2024-09-17T05:36:22.343432+0000","last_peered":"2024-09-17T05:36:22.343432+0000","last_clean":"2024-09-17T05:36:22.343432+0000","last_became_active":"2024-09-17T05:36:16.321784+0000","last_became_peered":"2024-09-17T05:36:16.321784+0000","last_unstale":"2024-09-17T05:36:22.343432+0000","last_undegraded":"2024-09-17T05:36:22.343432+0000","last_fullsized":"2024-09-17T05:36:22.343432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:00.321077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340797+0000","last_change":"2024-09-17T05:36:21.373176+0000","last_active":"2024-09-17T05:36:22.340797+0000","last_peered":"2024-09-17T05:36:22.340797+0000","last_clean":"2024-09-17T05:36:22.340797+0000","last_became_active":"2024-09-17T05:36:21.372030+0000","last_became_peered":"2024-09-17T05:36:21.372030+0000","last_unstale":"2024-09-17T05:36:22.340797+0000","last_undegraded":"2024-09-17T05:36:22.340797+0000","last_fullsized":"2024-09-17T05:36:22.340797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:42.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715087+0000","last_change":"2024-09-17T05:36:17.329006+0000","last_active":"2024-09-17T05:36:22.715087+0000","last_peered":"2024-09-17T05:36:22.715087+0000","last_clean":"2024-09-17T05:36:22.715087+0000","last_became_active":"2024-09-17T05:36:17.328683+0000","last_became_peered":"2024-09-17T05:36:17.328683+0000","last_unstale":"2024-09-17T05:36:22.715087+0000","last_undegraded":"2024-09-17T05:36:22.715087+0000","last_fullsized":"2024-09-17T05:36:22.715087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529439+0000","last_change":"2024-09-17T05:36:16.321759+0000","last_active":"2024-09-17T05:36:23.529439+0000","last_peered":"2024-09-17T05:36:23.529439+0000","last_clean":"2024-09-17T05:36:23.529439+0000","last_became_active":"2024-09-17T05:36:16.321356+0000","last_became_peered":"2024-09-17T05:36:16.321356+0000","last_unstale":"2024-09-17T05:36:23.529439+0000","last_undegraded":"2024-09-17T05:36:23.529439+0000","last_fullsized":"2024-09-17T05:36:23.529439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528292+0000","last_change":"2024-09-17T05:36:21.379637+0000","last_active":"2024-09-17T05:36:23.528292+0000","last_peered":"2024-09-17T05:36:23.528292+0000","last_clean":"2024-09-17T05:36:23.528292+0000","last_became_active":"2024-09-17T05:36:21.379220+0000","last_became_peered":"2024-09-17T05:36:21.379220+0000","last_unstale":"2024-09-17T05:36:23.528292+0000","last_undegraded":"2024-09-17T05:36:23.528292+0000","last_fullsized":"2024-09-17T05:36:23.528292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:11.229153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715278+0000","last_change":"2024-09-17T05:36:17.326522+0000","last_active":"2024-09-17T05:36:22.715278+0000","last_peered":"2024-09-17T05:36:22.715278+0000","last_clean":"2024-09-17T05:36:22.715278+0000","last_became_active":"2024-09-17T05:36:17.326199+0000","last_became_peered":"2024-09-17T05:36:17.326199+0000","last_unstale":"2024-09-17T05:36:22.715278+0000","last_undegraded":"2024-09-17T05:36:22.715278+0000","last_fullsized":"2024-09-17T05:36:22.715278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344595+0000","last_change":"2024-09-17T05:36:16.319960+0000","last_active":"2024-09-17T05:36:22.344595+0000","last_peered":"2024-09-17T05:36:22.344595+0000","last_clean":"2024-09-17T05:36:22.344595+0000","last_became_active":"2024-09-17T05:36:16.319686+0000","last_became_peered":"2024-09-17T05:36:16.319686+0000","last_unstale":"2024-09-17T05:36:22.344595+0000","last_undegraded":"2024-09-17T05:36:22.344595+0000","last_fullsized":"2024-09-17T05:36:22.344595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981056+0000","last_change":"2024-09-17T05:36:21.377298+0000","last_active":"2024-09-17T05:36:22.981056+0000","last_peered":"2024-09-17T05:36:22.981056+0000","last_clean":"2024-09-17T05:36:22.981056+0000","last_became_active":"2024-09-17T05:36:21.375463+0000","last_became_peered":"2024-09-17T05:36:21.375463+0000","last_unstale":"2024-09-17T05:36:22.981056+0000","last_undegraded":"2024-09-17T05:36:22.981056+0000","last_fullsized":"2024-09-17T05:36:22.981056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:39.055127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341881+0000","last_change":"2024-09-17T05:36:17.340442+0000","last_active":"2024-09-17T05:36:22.341881+0000","last_peered":"2024-09-17T05:36:22.341881+0000","last_clean":"2024-09-17T05:36:22.341881+0000","last_became_active":"2024-09-17T05:36:17.339752+0000","last_became_peered":"2024-09-17T05:36:17.339752+0000","last_unstale":"2024-09-17T05:36:22.341881+0000","last_undegraded":"2024-09-17T05:36:22.341881+0000","last_fullsized":"2024-09-17T05:36:22.341881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:22.275599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715407+0000","last_change":"2024-09-17T05:36:16.331663+0000","last_active":"2024-09-17T05:36:22.715407+0000","last_peered":"2024-09-17T05:36:22.715407+0000","last_clean":"2024-09-17T05:36:22.715407+0000","last_became_active":"2024-09-17T05:36:16.331428+0000","last_became_peered":"2024-09-17T05:36:16.331428+0000","last_unstale":"2024-09-17T05:36:22.715407+0000","last_undegraded":"2024-09-17T05:36:22.715407+0000","last_fullsized":"2024-09-17T05:36:22.715407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:50.759005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526933+0000","last_change":"2024-09-17T05:36:21.356148+0000","last_active":"2024-09-17T05:36:23.526933+0000","last_peered":"2024-09-17T05:36:23.526933+0000","last_clean":"2024-09-17T05:36:23.526933+0000","last_became_active":"2024-09-17T05:36:21.354594+0000","last_became_peered":"2024-09-17T05:36:21.354594+0000","last_unstale":"2024-09-17T05:36:23.526933+0000","last_undegraded":"2024-09-17T05:36:23.526933+0000","last_fullsized":"2024-09-17T05:36:23.526933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:46.831413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981160+0000","last_change":"2024-09-17T05:36:17.340510+0000","last_active":"2024-09-17T05:36:22.981160+0000","last_peered":"2024-09-17T05:36:22.981160+0000","last_clean":"2024-09-17T05:36:22.981160+0000","last_became_active":"2024-09-17T05:36:17.340124+0000","last_became_peered":"2024-09-17T05:36:17.340124+0000","last_unstale":"2024-09-17T05:36:22.981160+0000","last_undegraded":"2024-09-17T05:36:22.981160+0000","last_fullsized":"2024-09-17T05:36:22.981160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342894+0000","last_change":"2024-09-17T05:36:16.307077+0000","last_active":"2024-09-17T05:36:22.342894+0000","last_peered":"2024-09-17T05:36:22.342894+0000","last_clean":"2024-09-17T05:36:22.342894+0000","last_became_active":"2024-09-17T05:36:16.306568+0000","last_became_peered":"2024-09-17T05:36:16.306568+0000","last_unstale":"2024-09-17T05:36:22.342894+0000","last_undegraded":"2024-09-17T05:36:22.342894+0000","last_fullsized":"2024-09-17T05:36:22.342894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528731+0000","last_change":"2024-09-17T05:36:21.365391+0000","last_active":"2024-09-17T05:36:23.528731+0000","last_peered":"2024-09-17T05:36:23.528731+0000","last_clean":"2024-09-17T05:36:23.528731+0000","last_became_active":"2024-09-17T05:36:21.364791+0000","last_became_peered":"2024-09-17T05:36:21.364791+0000","last_unstale":"2024-09-17T05:36:23.528731+0000","last_undegraded":"2024-09-17T05:36:23.528731+0000","last_fullsized":"2024-09-17T05:36:23.528731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:04.502618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526809+0000","last_change":"2024-09-17T05:36:17.335760+0000","last_active":"2024-09-17T05:36:23.526809+0000","last_peered":"2024-09-17T05:36:23.526809+0000","last_clean":"2024-09-17T05:36:23.526809+0000","last_became_active":"2024-09-17T05:36:17.335388+0000","last_became_peered":"2024-09-17T05:36:17.335388+0000","last_unstale":"2024-09-17T05:36:23.526809+0000","last_undegraded":"2024-09-17T05:36:23.526809+0000","last_fullsized":"2024-09-17T05:36:23.526809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:27.462285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714588+0000","last_change":"2024-09-17T05:36:16.329939+0000","last_active":"2024-09-17T05:36:22.714588+0000","last_peered":"2024-09-17T05:36:22.714588+0000","last_clean":"2024-09-17T05:36:22.714588+0000","last_became_active":"2024-09-17T05:36:16.329632+0000","last_became_peered":"2024-09-17T05:36:16.329632+0000","last_unstale":"2024-09-17T05:36:22.714588+0000","last_undegraded":"2024-09-17T05:36:22.714588+0000","last_fullsized":"2024-09-17T05:36:22.714588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528745+0000","last_change":"2024-09-17T05:36:21.365043+0000","last_active":"2024-09-17T05:36:23.528745+0000","last_peered":"2024-09-17T05:36:23.528745+0000","last_clean":"2024-09-17T05:36:23.528745+0000","last_became_active":"2024-09-17T05:36:21.364610+0000","last_became_peered":"2024-09-17T05:36:21.364610+0000","last_unstale":"2024-09-17T05:36:23.528745+0000","last_undegraded":"2024-09-17T05:36:23.528745+0000","last_fullsized":"2024-09-17T05:36:23.528745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:55.108229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981556+0000","last_change":"2024-09-17T05:36:17.315566+0000","last_active":"2024-09-17T05:36:22.981556+0000","last_peered":"2024-09-17T05:36:22.981556+0000","last_clean":"2024-09-17T05:36:22.981556+0000","last_became_active":"2024-09-17T05:36:17.315280+0000","last_became_peered":"2024-09-17T05:36:17.315280+0000","last_unstale":"2024-09-17T05:36:22.981556+0000","last_undegraded":"2024-09-17T05:36:22.981556+0000","last_fullsized":"2024-09-17T05:36:22.981556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:07.191011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981531+0000","last_change":"2024-09-17T05:36:16.305788+0000","last_active":"2024-09-17T05:36:22.981531+0000","last_peered":"2024-09-17T05:36:22.981531+0000","last_clean":"2024-09-17T05:36:22.981531+0000","last_became_active":"2024-09-17T05:36:16.305404+0000","last_became_peered":"2024-09-17T05:36:16.305404+0000","last_unstale":"2024-09-17T05:36:22.981531+0000","last_undegraded":"2024-09-17T05:36:22.981531+0000","last_fullsized":"2024-09-17T05:36:22.981531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:55.852770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342770+0000","last_change":"2024-09-17T05:36:21.362271+0000","last_active":"2024-09-17T05:36:22.342770+0000","last_peered":"2024-09-17T05:36:22.342770+0000","last_clean":"2024-09-17T05:36:22.342770+0000","last_became_active":"2024-09-17T05:36:21.361775+0000","last_became_peered":"2024-09-17T05:36:21.361775+0000","last_unstale":"2024-09-17T05:36:22.342770+0000","last_undegraded":"2024-09-17T05:36:22.342770+0000","last_fullsized":"2024-09-17T05:36:22.342770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.770468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343845+0000","last_change":"2024-09-17T05:36:17.335234+0000","last_active":"2024-09-17T05:36:22.343845+0000","last_peered":"2024-09-17T05:36:22.343845+0000","last_clean":"2024-09-17T05:36:22.343845+0000","last_became_active":"2024-09-17T05:36:17.334898+0000","last_became_peered":"2024-09-17T05:36:17.334898+0000","last_unstale":"2024-09-17T05:36:22.343845+0000","last_undegraded":"2024-09-17T05:36:22.343845+0000","last_fullsized":"2024-09-17T05:36:22.343845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:29.554952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529339+0000","last_change":"2024-09-17T05:36:16.321488+0000","last_active":"2024-09-17T05:36:23.529339+0000","last_peered":"2024-09-17T05:36:23.529339+0000","last_clean":"2024-09-17T05:36:23.529339+0000","last_became_active":"2024-09-17T05:36:16.321104+0000","last_became_peered":"2024-09-17T05:36:16.321104+0000","last_unstale":"2024-09-17T05:36:23.529339+0000","last_undegraded":"2024-09-17T05:36:23.529339+0000","last_fullsized":"2024-09-17T05:36:23.529339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:51.739528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981857+0000","last_change":"2024-09-17T05:36:21.369908+0000","last_active":"2024-09-17T05:36:22.981857+0000","last_peered":"2024-09-17T05:36:22.981857+0000","last_clean":"2024-09-17T05:36:22.981857+0000","last_became_active":"2024-09-17T05:36:21.369460+0000","last_became_peered":"2024-09-17T05:36:21.369460+0000","last_unstale":"2024-09-17T05:36:22.981857+0000","last_undegraded":"2024-09-17T05:36:22.981857+0000","last_fullsized":"2024-09-17T05:36:22.981857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:57.419038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715227+0000","last_change":"2024-09-17T05:36:17.325334+0000","last_active":"2024-09-17T05:36:22.715227+0000","last_peered":"2024-09-17T05:36:22.715227+0000","last_clean":"2024-09-17T05:36:22.715227+0000","last_became_active":"2024-09-17T05:36:17.324663+0000","last_became_peered":"2024-09-17T05:36:17.324663+0000","last_unstale":"2024-09-17T05:36:22.715227+0000","last_undegraded":"2024-09-17T05:36:22.715227+0000","last_fullsized":"2024-09-17T05:36:22.715227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:28.454347+0000","last_change":"2024-09-17T05:36:16.313188+0000","last_active":"2024-09-17T05:36:28.454347+0000","last_peered":"2024-09-17T05:36:28.454347+0000","last_clean":"2024-09-17T05:36:28.454347+0000","last_became_active":"2024-09-17T05:36:16.312743+0000","last_became_peered":"2024-09-17T05:36:16.312743+0000","last_unstale":"2024-09-17T05:36:28.454347+0000","last_undegraded":"2024-09-17T05:36:28.454347+0000","last_fullsized":"2024-09-17T05:36:28.454347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:01.199020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343072+0000","last_change":"2024-09-17T05:36:21.364603+0000","last_active":"2024-09-17T05:36:22.343072+0000","last_peered":"2024-09-17T05:36:22.343072+0000","last_clean":"2024-09-17T05:36:22.343072+0000","last_became_active":"2024-09-17T05:36:21.359803+0000","last_became_peered":"2024-09-17T05:36:21.359803+0000","last_unstale":"2024-09-17T05:36:22.343072+0000","last_undegraded":"2024-09-17T05:36:22.343072+0000","last_fullsized":"2024-09-17T05:36:22.343072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:31.234403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981683+0000","last_change":"2024-09-17T05:36:17.333946+0000","last_active":"2024-09-17T05:36:22.981683+0000","last_peered":"2024-09-17T05:36:22.981683+0000","last_clean":"2024-09-17T05:36:22.981683+0000","last_became_active":"2024-09-17T05:36:17.333733+0000","last_became_peered":"2024-09-17T05:36:17.333733+0000","last_unstale":"2024-09-17T05:36:22.981683+0000","last_undegraded":"2024-09-17T05:36:22.981683+0000","last_fullsized":"2024-09-17T05:36:22.981683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:32.104558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529814+0000","last_change":"2024-09-17T05:36:16.312691+0000","last_active":"2024-09-17T05:36:23.529814+0000","last_peered":"2024-09-17T05:36:23.529814+0000","last_clean":"2024-09-17T05:36:23.529814+0000","last_became_active":"2024-09-17T05:36:16.312304+0000","last_became_peered":"2024-09-17T05:36:16.312304+0000","last_unstale":"2024-09-17T05:36:23.529814+0000","last_undegraded":"2024-09-17T05:36:23.529814+0000","last_fullsized":"2024-09-17T05:36:23.529814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341396+0000","last_change":"2024-09-17T05:36:21.375235+0000","last_active":"2024-09-17T05:36:22.341396+0000","last_peered":"2024-09-17T05:36:22.341396+0000","last_clean":"2024-09-17T05:36:22.341396+0000","last_became_active":"2024-09-17T05:36:21.374507+0000","last_became_peered":"2024-09-17T05:36:21.374507+0000","last_unstale":"2024-09-17T05:36:22.341396+0000","last_undegraded":"2024-09-17T05:36:22.341396+0000","last_fullsized":"2024-09-17T05:36:22.341396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:35.263335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528891+0000","last_change":"2024-09-17T05:36:17.338094+0000","last_active":"2024-09-17T05:36:23.528891+0000","last_peered":"2024-09-17T05:36:23.528891+0000","last_clean":"2024-09-17T05:36:23.528891+0000","last_became_active":"2024-09-17T05:36:17.337765+0000","last_became_peered":"2024-09-17T05:36:17.337765+0000","last_unstale":"2024-09-17T05:36:23.528891+0000","last_undegraded":"2024-09-17T05:36:23.528891+0000","last_fullsized":"2024-09-17T05:36:23.528891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715086+0000","last_change":"2024-09-17T05:36:16.327589+0000","last_active":"2024-09-17T05:36:22.715086+0000","last_peered":"2024-09-17T05:36:22.715086+0000","last_clean":"2024-09-17T05:36:22.715086+0000","last_became_active":"2024-09-17T05:36:16.327204+0000","last_became_peered":"2024-09-17T05:36:16.327204+0000","last_unstale":"2024-09-17T05:36:22.715086+0000","last_undegraded":"2024-09-17T05:36:22.715086+0000","last_fullsized":"2024-09-17T05:36:22.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527788+0000","last_change":"2024-09-17T05:36:21.387662+0000","last_active":"2024-09-17T05:36:23.527788+0000","last_peered":"2024-09-17T05:36:23.527788+0000","last_clean":"2024-09-17T05:36:23.527788+0000","last_became_active":"2024-09-17T05:36:21.387130+0000","last_became_peered":"2024-09-17T05:36:21.387130+0000","last_unstale":"2024-09-17T05:36:23.527788+0000","last_undegraded":"2024-09-17T05:36:23.527788+0000","last_fullsized":"2024-09-17T05:36:23.527788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:02.304238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341833+0000","last_change":"2024-09-17T05:36:17.340549+0000","last_active":"2024-09-17T05:36:22.341833+0000","last_peered":"2024-09-17T05:36:22.341833+0000","last_clean":"2024-09-17T05:36:22.341833+0000","last_became_active":"2024-09-17T05:36:17.339625+0000","last_became_peered":"2024-09-17T05:36:17.339625+0000","last_unstale":"2024-09-17T05:36:22.341833+0000","last_undegraded":"2024-09-17T05:36:22.341833+0000","last_fullsized":"2024-09-17T05:36:22.341833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:25.066974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527645+0000","last_change":"2024-09-17T05:36:16.298680+0000","last_active":"2024-09-17T05:36:23.527645+0000","last_peered":"2024-09-17T05:36:23.527645+0000","last_clean":"2024-09-17T05:36:23.527645+0000","last_became_active":"2024-09-17T05:36:16.298036+0000","last_became_peered":"2024-09-17T05:36:16.298036+0000","last_unstale":"2024-09-17T05:36:23.527645+0000","last_undegraded":"2024-09-17T05:36:23.527645+0000","last_fullsized":"2024-09-17T05:36:23.527645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:23.083593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342660+0000","last_change":"2024-09-17T05:36:21.368736+0000","last_active":"2024-09-17T05:36:22.342660+0000","last_peered":"2024-09-17T05:36:22.342660+0000","last_clean":"2024-09-17T05:36:22.342660+0000","last_became_active":"2024-09-17T05:36:21.367445+0000","last_became_peered":"2024-09-17T05:36:21.367445+0000","last_unstale":"2024-09-17T05:36:22.342660+0000","last_undegraded":"2024-09-17T05:36:22.342660+0000","last_fullsized":"2024-09-17T05:36:22.342660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:05.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344488+0000","last_change":"2024-09-17T05:36:21.363851+0000","last_active":"2024-09-17T05:36:22.344488+0000","last_peered":"2024-09-17T05:36:22.344488+0000","last_clean":"2024-09-17T05:36:22.344488+0000","last_became_active":"2024-09-17T05:36:21.363389+0000","last_became_peered":"2024-09-17T05:36:21.363389+0000","last_unstale":"2024-09-17T05:36:22.344488+0000","last_undegraded":"2024-09-17T05:36:22.344488+0000","last_fullsized":"2024-09-17T05:36:22.344488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:30.627064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342621+0000","last_change":"2024-09-17T05:36:17.327105+0000","last_active":"2024-09-17T05:36:22.342621+0000","last_peered":"2024-09-17T05:36:22.342621+0000","last_clean":"2024-09-17T05:36:22.342621+0000","last_became_active":"2024-09-17T05:36:17.326723+0000","last_became_peered":"2024-09-17T05:36:17.326723+0000","last_unstale":"2024-09-17T05:36:22.342621+0000","last_undegraded":"2024-09-17T05:36:22.342621+0000","last_fullsized":"2024-09-17T05:36:22.342621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:28.899717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981380+0000","last_change":"2024-09-17T05:36:16.333855+0000","last_active":"2024-09-17T05:36:22.981380+0000","last_peered":"2024-09-17T05:36:22.981380+0000","last_clean":"2024-09-17T05:36:22.981380+0000","last_became_active":"2024-09-17T05:36:16.327526+0000","last_became_peered":"2024-09-17T05:36:16.327526+0000","last_unstale":"2024-09-17T05:36:22.981380+0000","last_undegraded":"2024-09-17T05:36:22.981380+0000","last_fullsized":"2024-09-17T05:36:22.981380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982107+0000","last_change":"2024-09-17T05:36:21.382312+0000","last_active":"2024-09-17T05:36:22.982107+0000","last_peered":"2024-09-17T05:36:22.982107+0000","last_clean":"2024-09-17T05:36:22.982107+0000","last_became_active":"2024-09-17T05:36:21.381775+0000","last_became_peered":"2024-09-17T05:36:21.381775+0000","last_unstale":"2024-09-17T05:36:22.982107+0000","last_undegraded":"2024-09-17T05:36:22.982107+0000","last_fullsized":"2024-09-17T05:36:22.982107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:54.623675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527876+0000","last_change":"2024-09-17T05:36:17.336803+0000","last_active":"2024-09-17T05:36:23.527876+0000","last_peered":"2024-09-17T05:36:23.527876+0000","last_clean":"2024-09-17T05:36:23.527876+0000","last_became_active":"2024-09-17T05:36:17.336509+0000","last_became_peered":"2024-09-17T05:36:17.336509+0000","last_unstale":"2024-09-17T05:36:23.527876+0000","last_undegraded":"2024-09-17T05:36:23.527876+0000","last_fullsized":"2024-09-17T05:36:23.527876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342443+0000","last_change":"2024-09-17T05:36:16.319485+0000","last_active":"2024-09-17T05:36:22.342443+0000","last_peered":"2024-09-17T05:36:22.342443+0000","last_clean":"2024-09-17T05:36:22.342443+0000","last_became_active":"2024-09-17T05:36:16.319042+0000","last_became_peered":"2024-09-17T05:36:16.319042+0000","last_unstale":"2024-09-17T05:36:22.342443+0000","last_undegraded":"2024-09-17T05:36:22.342443+0000","last_fullsized":"2024-09-17T05:36:22.342443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.491679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981509+0000","last_change":"2024-09-17T05:36:16.323135+0000","last_active":"2024-09-17T05:36:22.981509+0000","last_peered":"2024-09-17T05:36:22.981509+0000","last_clean":"2024-09-17T05:36:22.981509+0000","last_became_active":"2024-09-17T05:36:16.322812+0000","last_became_peered":"2024-09-17T05:36:16.322812+0000","last_unstale":"2024-09-17T05:36:22.981509+0000","last_undegraded":"2024-09-17T05:36:22.981509+0000","last_fullsized":"2024-09-17T05:36:22.981509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:12.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343453+0000","last_change":"2024-09-17T05:36:17.323771+0000","last_active":"2024-09-17T05:36:22.343453+0000","last_peered":"2024-09-17T05:36:22.343453+0000","last_clean":"2024-09-17T05:36:22.343453+0000","last_became_active":"2024-09-17T05:36:17.323383+0000","last_became_peered":"2024-09-17T05:36:17.323383+0000","last_unstale":"2024-09-17T05:36:22.343453+0000","last_undegraded":"2024-09-17T05:36:22.343453+0000","last_fullsized":"2024-09-17T05:36:22.343453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343969+0000","last_change":"2024-09-17T05:36:21.364040+0000","last_active":"2024-09-17T05:36:22.343969+0000","last_peered":"2024-09-17T05:36:22.343969+0000","last_clean":"2024-09-17T05:36:22.343969+0000","last_became_active":"2024-09-17T05:36:21.363341+0000","last_became_peered":"2024-09-17T05:36:21.363341+0000","last_unstale":"2024-09-17T05:36:22.343969+0000","last_undegraded":"2024-09-17T05:36:22.343969+0000","last_fullsized":"2024-09-17T05:36:22.343969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:02.548547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528352+0000","last_change":"2024-09-17T05:36:16.316663+0000","last_active":"2024-09-17T05:36:23.528352+0000","last_peered":"2024-09-17T05:36:23.528352+0000","last_clean":"2024-09-17T05:36:23.528352+0000","last_became_active":"2024-09-17T05:36:16.316362+0000","last_became_peered":"2024-09-17T05:36:16.316362+0000","last_unstale":"2024-09-17T05:36:23.528352+0000","last_undegraded":"2024-09-17T05:36:23.528352+0000","last_fullsized":"2024-09-17T05:36:23.528352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526808+0000","last_change":"2024-09-17T05:36:17.310831+0000","last_active":"2024-09-17T05:36:23.526808+0000","last_peered":"2024-09-17T05:36:23.526808+0000","last_clean":"2024-09-17T05:36:23.526808+0000","last_became_active":"2024-09-17T05:36:17.309876+0000","last_became_peered":"2024-09-17T05:36:17.309876+0000","last_unstale":"2024-09-17T05:36:23.526808+0000","last_undegraded":"2024-09-17T05:36:23.526808+0000","last_fullsized":"2024-09-17T05:36:23.526808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:07.057468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529654+0000","last_change":"2024-09-17T05:36:21.379986+0000","last_active":"2024-09-17T05:36:23.529654+0000","last_peered":"2024-09-17T05:36:23.529654+0000","last_clean":"2024-09-17T05:36:23.529654+0000","last_became_active":"2024-09-17T05:36:21.379475+0000","last_became_peered":"2024-09-17T05:36:21.379475+0000","last_unstale":"2024-09-17T05:36:23.529654+0000","last_undegraded":"2024-09-17T05:36:23.529654+0000","last_fullsized":"2024-09-17T05:36:23.529654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:00.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341151+0000","last_change":"2024-09-17T05:36:17.321338+0000","last_active":"2024-09-17T05:36:22.341151+0000","last_peered":"2024-09-17T05:36:22.341151+0000","last_clean":"2024-09-17T05:36:22.341151+0000","last_became_active":"2024-09-17T05:36:17.320935+0000","last_became_peered":"2024-09-17T05:36:17.320935+0000","last_unstale":"2024-09-17T05:36:22.341151+0000","last_undegraded":"2024-09-17T05:36:22.341151+0000","last_fullsized":"2024-09-17T05:36:22.341151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528779+0000","last_change":"2024-09-17T05:36:17.344784+0000","last_active":"2024-09-17T05:36:23.528779+0000","last_peered":"2024-09-17T05:36:23.528779+0000","last_clean":"2024-09-17T05:36:23.528779+0000","last_became_active":"2024-09-17T05:36:17.344318+0000","last_became_peered":"2024-09-17T05:36:17.344318+0000","last_unstale":"2024-09-17T05:36:23.528779+0000","last_undegraded":"2024-09-17T05:36:23.528779+0000","last_fullsized":"2024-09-17T05:36:23.528779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981361+0000","last_change":"2024-09-17T05:36:17.330884+0000","last_active":"2024-09-17T05:36:22.981361+0000","last_peered":"2024-09-17T05:36:22.981361+0000","last_clean":"2024-09-17T05:36:22.981361+0000","last_became_active":"2024-09-17T05:36:17.330452+0000","last_became_peered":"2024-09-17T05:36:17.330452+0000","last_unstale":"2024-09-17T05:36:22.981361+0000","last_undegraded":"2024-09-17T05:36:22.981361+0000","last_fullsized":"2024-09-17T05:36:22.981361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:29.774698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528209+0000","last_change":"2024-09-17T05:36:17.328894+0000","last_active":"2024-09-17T05:36:23.528209+0000","last_peered":"2024-09-17T05:36:23.528209+0000","last_clean":"2024-09-17T05:36:23.528209+0000","last_became_active":"2024-09-17T05:36:17.327780+0000","last_became_peered":"2024-09-17T05:36:17.327780+0000","last_unstale":"2024-09-17T05:36:23.528209+0000","last_undegraded":"2024-09-17T05:36:23.528209+0000","last_fullsized":"2024-09-17T05:36:23.528209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343281+0000","last_change":"2024-09-17T05:36:17.332587+0000","last_active":"2024-09-17T05:36:22.343281+0000","last_peered":"2024-09-17T05:36:22.343281+0000","last_clean":"2024-09-17T05:36:22.343281+0000","last_became_active":"2024-09-17T05:36:17.332288+0000","last_became_peered":"2024-09-17T05:36:17.332288+0000","last_unstale":"2024-09-17T05:36:22.343281+0000","last_undegraded":"2024-09-17T05:36:22.343281+0000","last_fullsized":"2024-09-17T05:36:22.343281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:06.339627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343457+0000","last_change":"2024-09-17T05:36:17.332485+0000","last_active":"2024-09-17T05:36:22.343457+0000","last_peered":"2024-09-17T05:36:22.343457+0000","last_clean":"2024-09-17T05:36:22.343457+0000","last_became_active":"2024-09-17T05:36:17.332115+0000","last_became_peered":"2024-09-17T05:36:17.332115+0000","last_unstale":"2024-09-17T05:36:22.343457+0000","last_undegraded":"2024-09-17T05:36:22.343457+0000","last_fullsized":"2024-09-17T05:36:22.343457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:05.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341705+0000","last_change":"2024-09-17T05:36:17.340797+0000","last_active":"2024-09-17T05:36:22.341705+0000","last_peered":"2024-09-17T05:36:22.341705+0000","last_clean":"2024-09-17T05:36:22.341705+0000","last_became_active":"2024-09-17T05:36:17.340122+0000","last_became_peered":"2024-09-17T05:36:17.340122+0000","last_unstale":"2024-09-17T05:36:22.341705+0000","last_undegraded":"2024-09-17T05:36:22.341705+0000","last_fullsized":"2024-09-17T05:36:22.341705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:46.074621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528625+0000","last_change":"2024-09-17T05:36:17.346906+0000","last_active":"2024-09-17T05:36:23.528625+0000","last_peered":"2024-09-17T05:36:23.528625+0000","last_clean":"2024-09-17T05:36:23.528625+0000","last_became_active":"2024-09-17T05:36:17.340932+0000","last_became_peered":"2024-09-17T05:36:17.340932+0000","last_unstale":"2024-09-17T05:36:23.528625+0000","last_undegraded":"2024-09-17T05:36:23.528625+0000","last_fullsized":"2024-09-17T05:36:23.528625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981266+0000","last_change":"2024-09-17T05:36:17.346011+0000","last_active":"2024-09-17T05:36:22.981266+0000","last_peered":"2024-09-17T05:36:22.981266+0000","last_clean":"2024-09-17T05:36:22.981266+0000","last_became_active":"2024-09-17T05:36:17.345659+0000","last_became_peered":"2024-09-17T05:36:17.345659+0000","last_unstale":"2024-09-17T05:36:22.981266+0000","last_undegraded":"2024-09-17T05:36:22.981266+0000","last_fullsized":"2024-09-17T05:36:22.981266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527926+0000","last_change":"2024-09-17T05:36:17.339568+0000","last_active":"2024-09-17T05:36:23.527926+0000","last_peered":"2024-09-17T05:36:23.527926+0000","last_clean":"2024-09-17T05:36:23.527926+0000","last_became_active":"2024-09-17T05:36:17.339206+0000","last_became_peered":"2024-09-17T05:36:17.339206+0000","last_unstale":"2024-09-17T05:36:23.527926+0000","last_undegraded":"2024-09-17T05:36:23.527926+0000","last_fullsized":"2024-09-17T05:36:23.527926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526829+0000","last_change":"2024-09-17T05:36:17.319470+0000","last_active":"2024-09-17T05:36:23.526829+0000","last_peered":"2024-09-17T05:36:23.526829+0000","last_clean":"2024-09-17T05:36:23.526829+0000","last_became_active":"2024-09-17T05:36:17.319072+0000","last_became_peered":"2024-09-17T05:36:17.319072+0000","last_unstale":"2024-09-17T05:36:23.526829+0000","last_undegraded":"2024-09-17T05:36:23.526829+0000","last_fullsized":"2024-09-17T05:36:23.526829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:44.305630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343303+0000","last_change":"2024-09-17T05:36:17.335377+0000","last_active":"2024-09-17T05:36:22.343303+0000","last_peered":"2024-09-17T05:36:22.343303+0000","last_clean":"2024-09-17T05:36:22.343303+0000","last_became_active":"2024-09-17T05:36:17.335031+0000","last_became_peered":"2024-09-17T05:36:17.335031+0000","last_unstale":"2024-09-17T05:36:22.343303+0000","last_undegraded":"2024-09-17T05:36:22.343303+0000","last_fullsized":"2024-09-17T05:36:22.343303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:29.539404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715039+0000","last_change":"2024-09-17T05:36:17.326013+0000","last_active":"2024-09-17T05:36:22.715039+0000","last_peered":"2024-09-17T05:36:22.715039+0000","last_clean":"2024-09-17T05:36:22.715039+0000","last_became_active":"2024-09-17T05:36:17.325380+0000","last_became_peered":"2024-09-17T05:36:17.325380+0000","last_unstale":"2024-09-17T05:36:22.715039+0000","last_undegraded":"2024-09-17T05:36:22.715039+0000","last_fullsized":"2024-09-17T05:36:22.715039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982122+0000","last_change":"2024-09-17T05:36:17.322938+0000","last_active":"2024-09-17T05:36:22.982122+0000","last_peered":"2024-09-17T05:36:22.982122+0000","last_clean":"2024-09-17T05:36:22.982122+0000","last_became_active":"2024-09-17T05:36:17.322588+0000","last_became_peered":"2024-09-17T05:36:17.322588+0000","last_unstale":"2024-09-17T05:36:22.982122+0000","last_undegraded":"2024-09-17T05:36:22.982122+0000","last_fullsized":"2024-09-17T05:36:22.982122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:51.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529825+0000","last_change":"2024-09-17T05:36:17.347278+0000","last_active":"2024-09-17T05:36:23.529825+0000","last_peered":"2024-09-17T05:36:23.529825+0000","last_clean":"2024-09-17T05:36:23.529825+0000","last_became_active":"2024-09-17T05:36:17.346983+0000","last_became_peered":"2024-09-17T05:36:17.346983+0000","last_unstale":"2024-09-17T05:36:23.529825+0000","last_undegraded":"2024-09-17T05:36:23.529825+0000","last_fullsized":"2024-09-17T05:36:23.529825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982334+0000","last_change":"2024-09-17T05:36:17.328660+0000","last_active":"2024-09-17T05:36:22.982334+0000","last_peered":"2024-09-17T05:36:22.982334+0000","last_clean":"2024-09-17T05:36:22.982334+0000","last_became_active":"2024-09-17T05:36:17.324799+0000","last_became_peered":"2024-09-17T05:36:17.324799+0000","last_unstale":"2024-09-17T05:36:22.982334+0000","last_undegraded":"2024-09-17T05:36:22.982334+0000","last_fullsized":"2024-09-17T05:36:22.982334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:25.124191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981321+0000","last_change":"2024-09-17T05:36:17.323989+0000","last_active":"2024-09-17T05:36:22.981321+0000","last_peered":"2024-09-17T05:36:22.981321+0000","last_clean":"2024-09-17T05:36:22.981321+0000","last_became_active":"2024-09-17T05:36:17.321569+0000","last_became_peered":"2024-09-17T05:36:17.321569+0000","last_unstale":"2024-09-17T05:36:22.981321+0000","last_undegraded":"2024-09-17T05:36:22.981321+0000","last_fullsized":"2024-09-17T05:36:22.981321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527794+0000","last_change":"2024-09-17T05:36:17.329281+0000","last_active":"2024-09-17T05:36:23.527794+0000","last_peered":"2024-09-17T05:36:23.527794+0000","last_clean":"2024-09-17T05:36:23.527794+0000","last_became_active":"2024-09-17T05:36:17.328142+0000","last_became_peered":"2024-09-17T05:36:17.328142+0000","last_unstale":"2024-09-17T05:36:23.527794+0000","last_undegraded":"2024-09-17T05:36:23.527794+0000","last_fullsized":"2024-09-17T05:36:23.527794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343704+0000","last_change":"2024-09-17T05:36:17.331419+0000","last_active":"2024-09-17T05:36:22.343704+0000","last_peered":"2024-09-17T05:36:22.343704+0000","last_clean":"2024-09-17T05:36:22.343704+0000","last_became_active":"2024-09-17T05:36:17.330949+0000","last_became_peered":"2024-09-17T05:36:17.330949+0000","last_unstale":"2024-09-17T05:36:22.343704+0000","last_undegraded":"2024-09-17T05:36:22.343704+0000","last_fullsized":"2024-09-17T05:36:22.343704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:01.895132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342869+0000","last_change":"2024-09-17T05:36:17.337108+0000","last_active":"2024-09-17T05:36:22.342869+0000","last_peered":"2024-09-17T05:36:22.342869+0000","last_clean":"2024-09-17T05:36:22.342869+0000","last_became_active":"2024-09-17T05:36:17.330031+0000","last_became_peered":"2024-09-17T05:36:17.330031+0000","last_unstale":"2024-09-17T05:36:22.342869+0000","last_undegraded":"2024-09-17T05:36:22.342869+0000","last_fullsized":"2024-09-17T05:36:22.342869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:20.371899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714967+0000","last_change":"2024-09-17T05:36:17.326415+0000","last_active":"2024-09-17T05:36:22.714967+0000","last_peered":"2024-09-17T05:36:22.714967+0000","last_clean":"2024-09-17T05:36:22.714967+0000","last_became_active":"2024-09-17T05:36:17.325865+0000","last_became_peered":"2024-09-17T05:36:17.325865+0000","last_unstale":"2024-09-17T05:36:22.714967+0000","last_undegraded":"2024-09-17T05:36:22.714967+0000","last_fullsized":"2024-09-17T05:36:22.714967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715119+0000","last_change":"2024-09-17T05:36:17.324996+0000","last_active":"2024-09-17T05:36:22.715119+0000","last_peered":"2024-09-17T05:36:22.715119+0000","last_clean":"2024-09-17T05:36:22.715119+0000","last_became_active":"2024-09-17T05:36:17.324236+0000","last_became_peered":"2024-09-17T05:36:17.324236+0000","last_unstale":"2024-09-17T05:36:22.715119+0000","last_undegraded":"2024-09-17T05:36:22.715119+0000","last_fullsized":"2024-09-17T05:36:22.715119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714911+0000","last_change":"2024-09-17T05:36:17.344886+0000","last_active":"2024-09-17T05:36:22.714911+0000","last_peered":"2024-09-17T05:36:22.714911+0000","last_clean":"2024-09-17T05:36:22.714911+0000","last_became_active":"2024-09-17T05:36:17.344366+0000","last_became_peered":"2024-09-17T05:36:17.344366+0000","last_unstale":"2024-09-17T05:36:22.714911+0000","last_undegraded":"2024-09-17T05:36:22.714911+0000","last_fullsized":"2024-09-17T05:36:22.714911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:31.225193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527631+0000","last_change":"2024-09-17T05:36:17.315032+0000","last_active":"2024-09-17T05:36:23.527631+0000","last_peered":"2024-09-17T05:36:23.527631+0000","last_clean":"2024-09-17T05:36:23.527631+0000","last_became_active":"2024-09-17T05:36:17.313444+0000","last_became_peered":"2024-09-17T05:36:17.313444+0000","last_unstale":"2024-09-17T05:36:23.527631+0000","last_undegraded":"2024-09-17T05:36:23.527631+0000","last_fullsized":"2024-09-17T05:36:23.527631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:54.948931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527661+0000","last_change":"2024-09-17T05:36:17.334347+0000","last_active":"2024-09-17T05:36:23.527661+0000","last_peered":"2024-09-17T05:36:23.527661+0000","last_clean":"2024-09-17T05:36:23.527661+0000","last_became_active":"2024-09-17T05:36:17.328605+0000","last_became_peered":"2024-09-17T05:36:17.328605+0000","last_unstale":"2024-09-17T05:36:23.527661+0000","last_undegraded":"2024-09-17T05:36:23.527661+0000","last_fullsized":"2024-09-17T05:36:23.527661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714540+0000","last_change":"2024-09-17T05:36:17.317414+0000","last_active":"2024-09-17T05:36:22.714540+0000","last_peered":"2024-09-17T05:36:22.714540+0000","last_clean":"2024-09-17T05:36:22.714540+0000","last_became_active":"2024-09-17T05:36:17.316995+0000","last_became_peered":"2024-09-17T05:36:17.316995+0000","last_unstale":"2024-09-17T05:36:22.714540+0000","last_undegraded":"2024-09-17T05:36:22.714540+0000","last_fullsized":"2024-09-17T05:36:22.714540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341035+0000","last_change":"2024-09-17T05:36:17.338794+0000","last_active":"2024-09-17T05:36:22.341035+0000","last_peered":"2024-09-17T05:36:22.341035+0000","last_clean":"2024-09-17T05:36:22.341035+0000","last_became_active":"2024-09-17T05:36:17.338484+0000","last_became_peered":"2024-09-17T05:36:17.338484+0000","last_unstale":"2024-09-17T05:36:22.341035+0000","last_undegraded":"2024-09-17T05:36:22.341035+0000","last_fullsized":"2024-09-17T05:36:22.341035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:11.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714807+0000","last_change":"2024-09-17T05:36:17.338013+0000","last_active":"2024-09-17T05:36:22.714807+0000","last_peered":"2024-09-17T05:36:22.714807+0000","last_clean":"2024-09-17T05:36:22.714807+0000","last_became_active":"2024-09-17T05:36:17.336108+0000","last_became_peered":"2024-09-17T05:36:17.336108+0000","last_unstale":"2024-09-17T05:36:22.714807+0000","last_undegraded":"2024-09-17T05:36:22.714807+0000","last_fullsized":"2024-09-17T05:36:22.714807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340824+0000","last_change":"2024-09-17T05:36:17.338178+0000","last_active":"2024-09-17T05:36:22.340824+0000","last_peered":"2024-09-17T05:36:22.340824+0000","last_clean":"2024-09-17T05:36:22.340824+0000","last_became_active":"2024-09-17T05:36:17.332226+0000","last_became_peered":"2024-09-17T05:36:17.332226+0000","last_unstale":"2024-09-17T05:36:22.340824+0000","last_undegraded":"2024-09-17T05:36:22.340824+0000","last_fullsized":"2024-09-17T05:36:22.340824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529229+0000","last_change":"2024-09-17T05:36:17.339093+0000","last_active":"2024-09-17T05:36:23.529229+0000","last_peered":"2024-09-17T05:36:23.529229+0000","last_clean":"2024-09-17T05:36:23.529229+0000","last_became_active":"2024-09-17T05:36:17.338568+0000","last_became_peered":"2024-09-17T05:36:17.338568+0000","last_unstale":"2024-09-17T05:36:23.529229+0000","last_undegraded":"2024-09-17T05:36:23.529229+0000","last_fullsized":"2024-09-17T05:36:23.529229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528481+0000","last_change":"2024-09-17T05:36:17.339579+0000","last_active":"2024-09-17T05:36:23.528481+0000","last_peered":"2024-09-17T05:36:23.528481+0000","last_clean":"2024-09-17T05:36:23.528481+0000","last_became_active":"2024-09-17T05:36:17.339156+0000","last_became_peered":"2024-09-17T05:36:17.339156+0000","last_unstale":"2024-09-17T05:36:23.528481+0000","last_undegraded":"2024-09-17T05:36:23.528481+0000","last_fullsized":"2024-09-17T05:36:23.528481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715225+0000","last_change":"2024-09-17T05:36:17.334244+0000","last_active":"2024-09-17T05:36:22.715225+0000","last_peered":"2024-09-17T05:36:22.715225+0000","last_clean":"2024-09-17T05:36:22.715225+0000","last_became_active":"2024-09-17T05:36:17.333913+0000","last_became_peered":"2024-09-17T05:36:17.333913+0000","last_unstale":"2024-09-17T05:36:22.715225+0000","last_undegraded":"2024-09-17T05:36:22.715225+0000","last_fullsized":"2024-09-17T05:36:22.715225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:33.576 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 -- 172.21.15.44:0/3879407581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 msgr2=0x7ff860071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 --2- 172.21.15.44:0/3879407581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff860071c60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff850009900 tx=0x7ff85001c850 comp rx=0 tx=0).stop 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 -- 172.21.15.44:0/3879407581 shutdown_connections 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 --2- 172.21.15.44:0/3879407581 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff86006e660 0x7ff860151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 --2- 172.21.15.44:0/3879407581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff860071c60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 -- 172.21.15.44:0/3879407581 >> 172.21.15.44:0/3879407581 conn(0x7ff8600cd930 msgr2=0x7ff8600cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 -- 172.21.15.44:0/3879407581 shutdown_connections 2024-09-17T05:36:33.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.774+0000 7ff865e00640 1 -- 172.21.15.44:0/3879407581 wait complete. 2024-09-17T05:36:33.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 Processor -- start 2024-09-17T05:36:33.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 -- start start 2024-09-17T05:36:33.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff8601402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8600ccb60 0x7ff86015e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff860153830 0x7ff8600b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff86015c580 con 0x7ff860070e00 2024-09-17T05:36:33.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff86015c400 con 0x7ff8600ccb60 2024-09-17T05:36:33.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff86015c700 con 0x7ff860153830 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff8601402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff8601402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48984/0 (socket says 172.21.15.44:48984) 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 -- 172.21.15.44:0/3985087382 learned_addr learned my addr 172.21.15.44:0/3985087382 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff857e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8600ccb60 0x7ff86015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85f400640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff860153830 0x7ff8600b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 -- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff860153830 msgr2=0x7ff8600b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff860153830 0x7ff8600b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 -- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8600ccb60 msgr2=0x7ff86015e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8600ccb60 0x7ff86015e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 -- 172.21.15.44:0/3985087382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86015d6a0 con 0x7ff860070e00 2024-09-17T05:36:33.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff857e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8600ccb60 0x7ff86015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:33.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff85ea00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff8601402c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8500b0040 tx=0x7ff8500056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff857400640 1 -- 172.21.15.44:0/3985087382 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8500b2040 con 0x7ff860070e00 2024-09-17T05:36:33.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff857400640 1 -- 172.21.15.44:0/3985087382 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8500bd070 con 0x7ff860070e00 2024-09-17T05:36:33.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff857400640 1 -- 172.21.15.44:0/3985087382 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850004370 con 0x7ff860070e00 2024-09-17T05:36:33.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86015d980 con 0x7ff860070e00 2024-09-17T05:36:33.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.778+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86015df40 con 0x7ff860070e00 2024-09-17T05:36:33.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.782+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff860151b00 con 0x7ff860070e00 2024-09-17T05:36:33.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.782+0000 7ff857400640 1 -- 172.21.15.44:0/3985087382 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff850003600 con 0x7ff860070e00 2024-09-17T05:36:33.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.782+0000 7ff857400640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff83c073200 0x7ff83c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.782+0000 7ff857400640 1 -- 172.21.15.44:0/3985087382 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff85012eed0 con 0x7ff860070e00 2024-09-17T05:36:33.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.782+0000 7ff857e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff83c073200 0x7ff83c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.782+0000 7ff857e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff83c073200 0x7ff83c075710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff860153520 tx=0x7ff848009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:33.786+0000 7ff857400640 1 -- 172.21.15.44:0/3985087382 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff8500164d0 con 0x7ff860070e00 2024-09-17T05:36:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.030+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8600cc480 con 0x7ff83c073200 2024-09-17T05:36:34.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.034+0000 7ff857400640 1 -- 172.21.15.44:0/3985087382 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332555 (secure 0 0 0) 0x7ff8600cc480 con 0x7ff83c073200 2024-09-17T05:36:34.040 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:34.042 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:36:34.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff83c073200 msgr2=0x7ff83c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff83c073200 0x7ff83c075710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff860153520 tx=0x7ff848009040 comp rx=0 tx=0).stop 2024-09-17T05:36:34.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 msgr2=0x7ff8601402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff8601402c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8500b0040 tx=0x7ff8500056e0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 shutdown_connections 2024-09-17T05:36:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff860153830 0x7ff8600b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff83c073200 0x7ff83c075710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8600ccb60 0x7ff86015e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 --2- 172.21.15.44:0/3985087382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff860070e00 0x7ff8601402c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.038+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 >> 172.21.15.44:0/3985087382 conn(0x7ff8600cd930 msgr2=0x7ff86006da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.042+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 shutdown_connections 2024-09-17T05:36:34.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.042+0000 7ff865e00640 1 -- 172.21.15.44:0/3985087382 wait complete. 2024-09-17T05:36:34.061 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-17T05:36:32.261079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219556,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755164,"statfs":{"total":773094113280,"available":772869287936,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003017"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344741+0000","last_change":"2024-09-17T05:36:16.322687+0000","last_active":"2024-09-17T05:36:22.344741+0000","last_peered":"2024-09-17T05:36:22.344741+0000","last_clean":"2024-09-17T05:36:22.344741+0000","last_became_active":"2024-09-17T05:36:16.322327+0000","last_became_peered":"2024-09-17T05:36:16.322327+0000","last_unstale":"2024-09-17T05:36:22.344741+0000","last_undegraded":"2024-09-17T05:36:22.344741+0000","last_fullsized":"2024-09-17T05:36:22.344741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528771+0000","last_change":"2024-09-17T05:36:17.346577+0000","last_active":"2024-09-17T05:36:23.528771+0000","last_peered":"2024-09-17T05:36:23.528771+0000","last_clean":"2024-09-17T05:36:23.528771+0000","last_became_active":"2024-09-17T05:36:17.346190+0000","last_became_peered":"2024-09-17T05:36:17.346190+0000","last_unstale":"2024-09-17T05:36:23.528771+0000","last_undegraded":"2024-09-17T05:36:23.528771+0000","last_fullsized":"2024-09-17T05:36:23.528771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528503+0000","last_change":"2024-09-17T05:36:21.378187+0000","last_active":"2024-09-17T05:36:23.528503+0000","last_peered":"2024-09-17T05:36:23.528503+0000","last_clean":"2024-09-17T05:36:23.528503+0000","last_became_active":"2024-09-17T05:36:21.377733+0000","last_became_peered":"2024-09-17T05:36:21.377733+0000","last_unstale":"2024-09-17T05:36:23.528503+0000","last_undegraded":"2024-09-17T05:36:23.528503+0000","last_fullsized":"2024-09-17T05:36:23.528503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:33.577546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528970+0000","last_change":"2024-09-17T05:36:16.318233+0000","last_active":"2024-09-17T05:36:23.528970+0000","last_peered":"2024-09-17T05:36:23.528970+0000","last_clean":"2024-09-17T05:36:23.528970+0000","last_became_active":"2024-09-17T05:36:16.316897+0000","last_became_peered":"2024-09-17T05:36:16.316897+0000","last_unstale":"2024-09-17T05:36:23.528970+0000","last_undegraded":"2024-09-17T05:36:23.528970+0000","last_fullsized":"2024-09-17T05:36:23.528970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528763+0000","last_change":"2024-09-17T05:36:17.337382+0000","last_active":"2024-09-17T05:36:23.528763+0000","last_peered":"2024-09-17T05:36:23.528763+0000","last_clean":"2024-09-17T05:36:23.528763+0000","last_became_active":"2024-09-17T05:36:17.330732+0000","last_became_peered":"2024-09-17T05:36:17.330732+0000","last_unstale":"2024-09-17T05:36:23.528763+0000","last_undegraded":"2024-09-17T05:36:23.528763+0000","last_fullsized":"2024-09-17T05:36:23.528763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:20.100003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340737+0000","last_change":"2024-09-17T05:36:21.371771+0000","last_active":"2024-09-17T05:36:22.340737+0000","last_peered":"2024-09-17T05:36:22.340737+0000","last_clean":"2024-09-17T05:36:22.340737+0000","last_became_active":"2024-09-17T05:36:21.370880+0000","last_became_peered":"2024-09-17T05:36:21.370880+0000","last_unstale":"2024-09-17T05:36:22.340737+0000","last_undegraded":"2024-09-17T05:36:22.340737+0000","last_fullsized":"2024-09-17T05:36:22.340737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:14.478542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715355+0000","last_change":"2024-09-17T05:36:16.327231+0000","last_active":"2024-09-17T05:36:22.715355+0000","last_peered":"2024-09-17T05:36:22.715355+0000","last_clean":"2024-09-17T05:36:22.715355+0000","last_became_active":"2024-09-17T05:36:16.326856+0000","last_became_peered":"2024-09-17T05:36:16.326856+0000","last_unstale":"2024-09-17T05:36:22.715355+0000","last_undegraded":"2024-09-17T05:36:22.715355+0000","last_fullsized":"2024-09-17T05:36:22.715355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:29.442629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527139+0000","last_change":"2024-09-17T05:36:17.331749+0000","last_active":"2024-09-17T05:36:23.527139+0000","last_peered":"2024-09-17T05:36:23.527139+0000","last_clean":"2024-09-17T05:36:23.527139+0000","last_became_active":"2024-09-17T05:36:17.329815+0000","last_became_peered":"2024-09-17T05:36:17.329815+0000","last_unstale":"2024-09-17T05:36:23.527139+0000","last_undegraded":"2024-09-17T05:36:23.527139+0000","last_fullsized":"2024-09-17T05:36:23.527139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:13.966029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341080+0000","last_change":"2024-09-17T05:36:21.372497+0000","last_active":"2024-09-17T05:36:22.341080+0000","last_peered":"2024-09-17T05:36:22.341080+0000","last_clean":"2024-09-17T05:36:22.341080+0000","last_became_active":"2024-09-17T05:36:21.372038+0000","last_became_peered":"2024-09-17T05:36:21.372038+0000","last_unstale":"2024-09-17T05:36:22.341080+0000","last_undegraded":"2024-09-17T05:36:22.341080+0000","last_fullsized":"2024-09-17T05:36:22.341080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715174+0000","last_change":"2024-09-17T05:36:16.328078+0000","last_active":"2024-09-17T05:36:22.715174+0000","last_peered":"2024-09-17T05:36:22.715174+0000","last_clean":"2024-09-17T05:36:22.715174+0000","last_became_active":"2024-09-17T05:36:16.327672+0000","last_became_peered":"2024-09-17T05:36:16.327672+0000","last_unstale":"2024-09-17T05:36:22.715174+0000","last_undegraded":"2024-09-17T05:36:22.715174+0000","last_fullsized":"2024-09-17T05:36:22.715174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981888+0000","last_change":"2024-09-17T05:36:17.316048+0000","last_active":"2024-09-17T05:36:22.981888+0000","last_peered":"2024-09-17T05:36:22.981888+0000","last_clean":"2024-09-17T05:36:22.981888+0000","last_became_active":"2024-09-17T05:36:17.315721+0000","last_became_peered":"2024-09-17T05:36:17.315721+0000","last_unstale":"2024-09-17T05:36:22.981888+0000","last_undegraded":"2024-09-17T05:36:22.981888+0000","last_fullsized":"2024-09-17T05:36:22.981888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:00.464476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340720+0000","last_change":"2024-09-17T05:36:21.373595+0000","last_active":"2024-09-17T05:36:22.340720+0000","last_peered":"2024-09-17T05:36:22.340720+0000","last_clean":"2024-09-17T05:36:22.340720+0000","last_became_active":"2024-09-17T05:36:21.372679+0000","last_became_peered":"2024-09-17T05:36:21.372679+0000","last_unstale":"2024-09-17T05:36:22.340720+0000","last_undegraded":"2024-09-17T05:36:22.340720+0000","last_fullsized":"2024-09-17T05:36:22.340720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:10.401214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981418+0000","last_change":"2024-09-17T05:36:17.308500+0000","last_active":"2024-09-17T05:36:22.981418+0000","last_peered":"2024-09-17T05:36:22.981418+0000","last_clean":"2024-09-17T05:36:22.981418+0000","last_became_active":"2024-09-17T05:36:17.303262+0000","last_became_peered":"2024-09-17T05:36:17.303262+0000","last_unstale":"2024-09-17T05:36:22.981418+0000","last_undegraded":"2024-09-17T05:36:22.981418+0000","last_fullsized":"2024-09-17T05:36:22.981418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:16.966266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981661+0000","last_change":"2024-09-17T05:36:16.333433+0000","last_active":"2024-09-17T05:36:22.981661+0000","last_peered":"2024-09-17T05:36:22.981661+0000","last_clean":"2024-09-17T05:36:22.981661+0000","last_became_active":"2024-09-17T05:36:16.328517+0000","last_became_peered":"2024-09-17T05:36:16.328517+0000","last_unstale":"2024-09-17T05:36:22.981661+0000","last_undegraded":"2024-09-17T05:36:22.981661+0000","last_fullsized":"2024-09-17T05:36:22.981661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:43.294722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981779+0000","last_change":"2024-09-17T05:36:21.377118+0000","last_active":"2024-09-17T05:36:22.981779+0000","last_peered":"2024-09-17T05:36:22.981779+0000","last_clean":"2024-09-17T05:36:22.981779+0000","last_became_active":"2024-09-17T05:36:21.376379+0000","last_became_peered":"2024-09-17T05:36:21.376379+0000","last_unstale":"2024-09-17T05:36:22.981779+0000","last_undegraded":"2024-09-17T05:36:22.981779+0000","last_fullsized":"2024-09-17T05:36:22.981779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:22.735617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529100+0000","last_change":"2024-09-17T05:36:17.344836+0000","last_active":"2024-09-17T05:36:23.529100+0000","last_peered":"2024-09-17T05:36:23.529100+0000","last_clean":"2024-09-17T05:36:23.529100+0000","last_became_active":"2024-09-17T05:36:17.343959+0000","last_became_peered":"2024-09-17T05:36:17.343959+0000","last_unstale":"2024-09-17T05:36:23.529100+0000","last_undegraded":"2024-09-17T05:36:23.529100+0000","last_fullsized":"2024-09-17T05:36:23.529100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343968+0000","last_change":"2024-09-17T05:36:16.321265+0000","last_active":"2024-09-17T05:36:22.343968+0000","last_peered":"2024-09-17T05:36:22.343968+0000","last_clean":"2024-09-17T05:36:22.343968+0000","last_became_active":"2024-09-17T05:36:16.320994+0000","last_became_peered":"2024-09-17T05:36:16.320994+0000","last_unstale":"2024-09-17T05:36:22.343968+0000","last_undegraded":"2024-09-17T05:36:22.343968+0000","last_fullsized":"2024-09-17T05:36:22.343968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:12.139048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714749+0000","last_change":"2024-09-17T05:36:21.363951+0000","last_active":"2024-09-17T05:36:22.714749+0000","last_peered":"2024-09-17T05:36:22.714749+0000","last_clean":"2024-09-17T05:36:22.714749+0000","last_became_active":"2024-09-17T05:36:21.363462+0000","last_became_peered":"2024-09-17T05:36:21.363462+0000","last_unstale":"2024-09-17T05:36:22.714749+0000","last_undegraded":"2024-09-17T05:36:22.714749+0000","last_fullsized":"2024-09-17T05:36:22.714749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:35.701351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342422+0000","last_change":"2024-09-17T05:36:17.337740+0000","last_active":"2024-09-17T05:36:22.342422+0000","last_peered":"2024-09-17T05:36:22.342422+0000","last_clean":"2024-09-17T05:36:22.342422+0000","last_became_active":"2024-09-17T05:36:17.332701+0000","last_became_peered":"2024-09-17T05:36:17.332701+0000","last_unstale":"2024-09-17T05:36:22.342422+0000","last_undegraded":"2024-09-17T05:36:22.342422+0000","last_fullsized":"2024-09-17T05:36:22.342422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:58.266096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342734+0000","last_change":"2024-09-17T05:36:16.316754+0000","last_active":"2024-09-17T05:36:22.342734+0000","last_peered":"2024-09-17T05:36:22.342734+0000","last_clean":"2024-09-17T05:36:22.342734+0000","last_became_active":"2024-09-17T05:36:16.316437+0000","last_became_peered":"2024-09-17T05:36:16.316437+0000","last_unstale":"2024-09-17T05:36:22.342734+0000","last_undegraded":"2024-09-17T05:36:22.342734+0000","last_fullsized":"2024-09-17T05:36:22.342734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529269+0000","last_change":"2024-09-17T05:36:21.387657+0000","last_active":"2024-09-17T05:36:23.529269+0000","last_peered":"2024-09-17T05:36:23.529269+0000","last_clean":"2024-09-17T05:36:23.529269+0000","last_became_active":"2024-09-17T05:36:21.387055+0000","last_became_peered":"2024-09-17T05:36:21.387055+0000","last_unstale":"2024-09-17T05:36:23.529269+0000","last_undegraded":"2024-09-17T05:36:23.529269+0000","last_fullsized":"2024-09-17T05:36:23.529269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:32.937859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981203+0000","last_change":"2024-09-17T05:36:17.322184+0000","last_active":"2024-09-17T05:36:22.981203+0000","last_peered":"2024-09-17T05:36:22.981203+0000","last_clean":"2024-09-17T05:36:22.981203+0000","last_became_active":"2024-09-17T05:36:17.320864+0000","last_became_peered":"2024-09-17T05:36:17.320864+0000","last_unstale":"2024-09-17T05:36:22.981203+0000","last_undegraded":"2024-09-17T05:36:22.981203+0000","last_fullsized":"2024-09-17T05:36:22.981203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714387+0000","last_change":"2024-09-17T05:36:16.317147+0000","last_active":"2024-09-17T05:36:22.714387+0000","last_peered":"2024-09-17T05:36:22.714387+0000","last_clean":"2024-09-17T05:36:22.714387+0000","last_became_active":"2024-09-17T05:36:16.316600+0000","last_became_peered":"2024-09-17T05:36:16.316600+0000","last_unstale":"2024-09-17T05:36:22.714387+0000","last_undegraded":"2024-09-17T05:36:22.714387+0000","last_fullsized":"2024-09-17T05:36:22.714387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341697+0000","last_change":"2024-09-17T05:36:21.366149+0000","last_active":"2024-09-17T05:36:22.341697+0000","last_peered":"2024-09-17T05:36:22.341697+0000","last_clean":"2024-09-17T05:36:22.341697+0000","last_became_active":"2024-09-17T05:36:21.365665+0000","last_became_peered":"2024-09-17T05:36:21.365665+0000","last_unstale":"2024-09-17T05:36:22.341697+0000","last_undegraded":"2024-09-17T05:36:22.341697+0000","last_fullsized":"2024-09-17T05:36:22.341697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:04.721488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344454+0000","last_change":"2024-09-17T05:36:17.334934+0000","last_active":"2024-09-17T05:36:22.344454+0000","last_peered":"2024-09-17T05:36:22.344454+0000","last_clean":"2024-09-17T05:36:22.344454+0000","last_became_active":"2024-09-17T05:36:17.334132+0000","last_became_peered":"2024-09-17T05:36:17.334132+0000","last_unstale":"2024-09-17T05:36:22.344454+0000","last_undegraded":"2024-09-17T05:36:22.344454+0000","last_fullsized":"2024-09-17T05:36:22.344454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982376+0000","last_change":"2024-09-17T05:36:16.325337+0000","last_active":"2024-09-17T05:36:22.982376+0000","last_peered":"2024-09-17T05:36:22.982376+0000","last_clean":"2024-09-17T05:36:22.982376+0000","last_became_active":"2024-09-17T05:36:16.322984+0000","last_became_peered":"2024-09-17T05:36:16.322984+0000","last_unstale":"2024-09-17T05:36:22.982376+0000","last_undegraded":"2024-09-17T05:36:22.982376+0000","last_fullsized":"2024-09-17T05:36:22.982376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:06.046560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341200+0000","last_change":"2024-09-17T05:36:21.358756+0000","last_active":"2024-09-17T05:36:22.341200+0000","last_peered":"2024-09-17T05:36:22.341200+0000","last_clean":"2024-09-17T05:36:22.341200+0000","last_became_active":"2024-09-17T05:36:21.358225+0000","last_became_peered":"2024-09-17T05:36:21.358225+0000","last_unstale":"2024-09-17T05:36:22.341200+0000","last_undegraded":"2024-09-17T05:36:22.341200+0000","last_fullsized":"2024-09-17T05:36:22.341200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:10.794511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344614+0000","last_change":"2024-09-17T05:36:17.321481+0000","last_active":"2024-09-17T05:36:22.344614+0000","last_peered":"2024-09-17T05:36:22.344614+0000","last_clean":"2024-09-17T05:36:22.344614+0000","last_became_active":"2024-09-17T05:36:17.321132+0000","last_became_peered":"2024-09-17T05:36:17.321132+0000","last_unstale":"2024-09-17T05:36:22.344614+0000","last_undegraded":"2024-09-17T05:36:22.344614+0000","last_fullsized":"2024-09-17T05:36:22.344614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344664+0000","last_change":"2024-09-17T05:36:16.314881+0000","last_active":"2024-09-17T05:36:22.344664+0000","last_peered":"2024-09-17T05:36:22.344664+0000","last_clean":"2024-09-17T05:36:22.344664+0000","last_became_active":"2024-09-17T05:36:16.314473+0000","last_became_peered":"2024-09-17T05:36:16.314473+0000","last_unstale":"2024-09-17T05:36:22.344664+0000","last_undegraded":"2024-09-17T05:36:22.344664+0000","last_fullsized":"2024-09-17T05:36:22.344664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:34.851574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342176+0000","last_change":"2024-09-17T05:36:21.359463+0000","last_active":"2024-09-17T05:36:22.342176+0000","last_peered":"2024-09-17T05:36:22.342176+0000","last_clean":"2024-09-17T05:36:22.342176+0000","last_became_active":"2024-09-17T05:36:21.358945+0000","last_became_peered":"2024-09-17T05:36:21.358945+0000","last_unstale":"2024-09-17T05:36:22.342176+0000","last_undegraded":"2024-09-17T05:36:22.342176+0000","last_fullsized":"2024-09-17T05:36:22.342176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:16.789795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343353+0000","last_change":"2024-09-17T05:36:17.352141+0000","last_active":"2024-09-17T05:36:22.343353+0000","last_peered":"2024-09-17T05:36:22.343353+0000","last_clean":"2024-09-17T05:36:22.343353+0000","last_became_active":"2024-09-17T05:36:17.351766+0000","last_became_peered":"2024-09-17T05:36:17.351766+0000","last_unstale":"2024-09-17T05:36:22.343353+0000","last_undegraded":"2024-09-17T05:36:22.343353+0000","last_fullsized":"2024-09-17T05:36:22.343353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:50.090463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982180+0000","last_change":"2024-09-17T05:36:16.321568+0000","last_active":"2024-09-17T05:36:22.982180+0000","last_peered":"2024-09-17T05:36:22.982180+0000","last_clean":"2024-09-17T05:36:22.982180+0000","last_became_active":"2024-09-17T05:36:16.321260+0000","last_became_peered":"2024-09-17T05:36:16.321260+0000","last_unstale":"2024-09-17T05:36:22.982180+0000","last_undegraded":"2024-09-17T05:36:22.982180+0000","last_fullsized":"2024-09-17T05:36:22.982180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:57.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342554+0000","last_change":"2024-09-17T05:36:21.368740+0000","last_active":"2024-09-17T05:36:22.342554+0000","last_peered":"2024-09-17T05:36:22.342554+0000","last_clean":"2024-09-17T05:36:22.342554+0000","last_became_active":"2024-09-17T05:36:21.367320+0000","last_became_peered":"2024-09-17T05:36:21.367320+0000","last_unstale":"2024-09-17T05:36:22.342554+0000","last_undegraded":"2024-09-17T05:36:22.342554+0000","last_fullsized":"2024-09-17T05:36:22.342554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:31.367750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340925+0000","last_change":"2024-09-17T05:36:17.324299+0000","last_active":"2024-09-17T05:36:22.340925+0000","last_peered":"2024-09-17T05:36:22.340925+0000","last_clean":"2024-09-17T05:36:22.340925+0000","last_became_active":"2024-09-17T05:36:17.323941+0000","last_became_peered":"2024-09-17T05:36:17.323941+0000","last_unstale":"2024-09-17T05:36:22.340925+0000","last_undegraded":"2024-09-17T05:36:22.340925+0000","last_fullsized":"2024-09-17T05:36:22.340925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528295+0000","last_change":"2024-09-17T05:36:16.318757+0000","last_active":"2024-09-17T05:36:23.528295+0000","last_peered":"2024-09-17T05:36:23.528295+0000","last_clean":"2024-09-17T05:36:23.528295+0000","last_became_active":"2024-09-17T05:36:16.318452+0000","last_became_peered":"2024-09-17T05:36:16.318452+0000","last_unstale":"2024-09-17T05:36:23.528295+0000","last_undegraded":"2024-09-17T05:36:23.528295+0000","last_fullsized":"2024-09-17T05:36:23.528295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342943+0000","last_change":"2024-09-17T05:36:21.374533+0000","last_active":"2024-09-17T05:36:22.342943+0000","last_peered":"2024-09-17T05:36:22.342943+0000","last_clean":"2024-09-17T05:36:22.342943+0000","last_became_active":"2024-09-17T05:36:21.373222+0000","last_became_peered":"2024-09-17T05:36:21.373222+0000","last_unstale":"2024-09-17T05:36:22.342943+0000","last_undegraded":"2024-09-17T05:36:22.342943+0000","last_fullsized":"2024-09-17T05:36:22.342943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:51.191726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714674+0000","last_change":"2024-09-17T05:36:17.336498+0000","last_active":"2024-09-17T05:36:22.714674+0000","last_peered":"2024-09-17T05:36:22.714674+0000","last_clean":"2024-09-17T05:36:22.714674+0000","last_became_active":"2024-09-17T05:36:17.335606+0000","last_became_peered":"2024-09-17T05:36:17.335606+0000","last_unstale":"2024-09-17T05:36:22.714674+0000","last_undegraded":"2024-09-17T05:36:22.714674+0000","last_fullsized":"2024-09-17T05:36:22.714674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981647+0000","last_change":"2024-09-17T05:36:16.307663+0000","last_active":"2024-09-17T05:36:22.981647+0000","last_peered":"2024-09-17T05:36:22.981647+0000","last_clean":"2024-09-17T05:36:22.981647+0000","last_became_active":"2024-09-17T05:36:16.307264+0000","last_became_peered":"2024-09-17T05:36:16.307264+0000","last_unstale":"2024-09-17T05:36:22.981647+0000","last_undegraded":"2024-09-17T05:36:22.981647+0000","last_fullsized":"2024-09-17T05:36:22.981647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:19.042460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343190+0000","last_change":"2024-09-17T05:36:21.372969+0000","last_active":"2024-09-17T05:36:22.343190+0000","last_peered":"2024-09-17T05:36:22.343190+0000","last_clean":"2024-09-17T05:36:22.343190+0000","last_became_active":"2024-09-17T05:36:21.368548+0000","last_became_peered":"2024-09-17T05:36:21.368548+0000","last_unstale":"2024-09-17T05:36:22.343190+0000","last_undegraded":"2024-09-17T05:36:22.343190+0000","last_fullsized":"2024-09-17T05:36:22.343190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.206523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527667+0000","last_change":"2024-09-17T05:36:17.328522+0000","last_active":"2024-09-17T05:36:23.527667+0000","last_peered":"2024-09-17T05:36:23.527667+0000","last_clean":"2024-09-17T05:36:23.527667+0000","last_became_active":"2024-09-17T05:36:17.327985+0000","last_became_peered":"2024-09-17T05:36:17.327985+0000","last_unstale":"2024-09-17T05:36:23.527667+0000","last_undegraded":"2024-09-17T05:36:23.527667+0000","last_fullsized":"2024-09-17T05:36:23.527667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528925+0000","last_change":"2024-09-17T05:36:16.316486+0000","last_active":"2024-09-17T05:36:23.528925+0000","last_peered":"2024-09-17T05:36:23.528925+0000","last_clean":"2024-09-17T05:36:23.528925+0000","last_became_active":"2024-09-17T05:36:16.316098+0000","last_became_peered":"2024-09-17T05:36:16.316098+0000","last_unstale":"2024-09-17T05:36:23.528925+0000","last_undegraded":"2024-09-17T05:36:23.528925+0000","last_fullsized":"2024-09-17T05:36:23.528925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343972+0000","last_change":"2024-09-17T05:36:21.369648+0000","last_active":"2024-09-17T05:36:22.343972+0000","last_peered":"2024-09-17T05:36:22.343972+0000","last_clean":"2024-09-17T05:36:22.343972+0000","last_became_active":"2024-09-17T05:36:21.366772+0000","last_became_peered":"2024-09-17T05:36:21.366772+0000","last_unstale":"2024-09-17T05:36:22.343972+0000","last_undegraded":"2024-09-17T05:36:22.343972+0000","last_fullsized":"2024-09-17T05:36:22.343972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:06.404204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342292+0000","last_change":"2024-09-17T05:36:17.340972+0000","last_active":"2024-09-17T05:36:22.342292+0000","last_peered":"2024-09-17T05:36:22.342292+0000","last_clean":"2024-09-17T05:36:22.342292+0000","last_became_active":"2024-09-17T05:36:17.340593+0000","last_became_peered":"2024-09-17T05:36:17.340593+0000","last_unstale":"2024-09-17T05:36:22.342292+0000","last_undegraded":"2024-09-17T05:36:22.342292+0000","last_fullsized":"2024-09-17T05:36:22.342292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:44.722774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981430+0000","last_change":"2024-09-17T05:36:16.335220+0000","last_active":"2024-09-17T05:36:22.981430+0000","last_peered":"2024-09-17T05:36:22.981430+0000","last_clean":"2024-09-17T05:36:22.981430+0000","last_became_active":"2024-09-17T05:36:16.334710+0000","last_became_peered":"2024-09-17T05:36:16.334710+0000","last_unstale":"2024-09-17T05:36:22.981430+0000","last_undegraded":"2024-09-17T05:36:22.981430+0000","last_fullsized":"2024-09-17T05:36:22.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:26.451376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528550+0000","last_change":"2024-09-17T05:36:21.375167+0000","last_active":"2024-09-17T05:36:23.528550+0000","last_peered":"2024-09-17T05:36:23.528550+0000","last_clean":"2024-09-17T05:36:23.528550+0000","last_became_active":"2024-09-17T05:36:21.374539+0000","last_became_peered":"2024-09-17T05:36:21.374539+0000","last_unstale":"2024-09-17T05:36:23.528550+0000","last_undegraded":"2024-09-17T05:36:23.528550+0000","last_fullsized":"2024-09-17T05:36:23.528550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:34.823660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343374+0000","last_change":"2024-09-17T05:36:17.334660+0000","last_active":"2024-09-17T05:36:22.343374+0000","last_peered":"2024-09-17T05:36:22.343374+0000","last_clean":"2024-09-17T05:36:22.343374+0000","last_became_active":"2024-09-17T05:36:17.334310+0000","last_became_peered":"2024-09-17T05:36:17.334310+0000","last_unstale":"2024-09-17T05:36:22.343374+0000","last_undegraded":"2024-09-17T05:36:22.343374+0000","last_fullsized":"2024-09-17T05:36:22.343374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981696+0000","last_change":"2024-09-17T05:36:16.328867+0000","last_active":"2024-09-17T05:36:22.981696+0000","last_peered":"2024-09-17T05:36:22.981696+0000","last_clean":"2024-09-17T05:36:22.981696+0000","last_became_active":"2024-09-17T05:36:16.328108+0000","last_became_peered":"2024-09-17T05:36:16.328108+0000","last_unstale":"2024-09-17T05:36:22.981696+0000","last_undegraded":"2024-09-17T05:36:22.981696+0000","last_fullsized":"2024-09-17T05:36:22.981696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526996+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:36:23.526996+0000","last_peered":"2024-09-17T05:36:23.526996+0000","last_clean":"2024-09-17T05:36:23.526996+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:36:23.526996+0000","last_undegraded":"2024-09-17T05:36:23.526996+0000","last_fullsized":"2024-09-17T05:36:23.526996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982083+0000","last_change":"2024-09-17T05:36:21.383242+0000","last_active":"2024-09-17T05:36:22.982083+0000","last_peered":"2024-09-17T05:36:22.982083+0000","last_clean":"2024-09-17T05:36:22.982083+0000","last_became_active":"2024-09-17T05:36:21.382738+0000","last_became_peered":"2024-09-17T05:36:21.382738+0000","last_unstale":"2024-09-17T05:36:22.982083+0000","last_undegraded":"2024-09-17T05:36:22.982083+0000","last_fullsized":"2024-09-17T05:36:22.982083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.889971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982006+0000","last_change":"2024-09-17T05:36:17.310411+0000","last_active":"2024-09-17T05:36:22.982006+0000","last_peered":"2024-09-17T05:36:22.982006+0000","last_clean":"2024-09-17T05:36:22.982006+0000","last_became_active":"2024-09-17T05:36:17.310092+0000","last_became_peered":"2024-09-17T05:36:17.310092+0000","last_unstale":"2024-09-17T05:36:22.982006+0000","last_undegraded":"2024-09-17T05:36:22.982006+0000","last_fullsized":"2024-09-17T05:36:22.982006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:30.785518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343432+0000","last_change":"2024-09-17T05:36:16.322081+0000","last_active":"2024-09-17T05:36:22.343432+0000","last_peered":"2024-09-17T05:36:22.343432+0000","last_clean":"2024-09-17T05:36:22.343432+0000","last_became_active":"2024-09-17T05:36:16.321784+0000","last_became_peered":"2024-09-17T05:36:16.321784+0000","last_unstale":"2024-09-17T05:36:22.343432+0000","last_undegraded":"2024-09-17T05:36:22.343432+0000","last_fullsized":"2024-09-17T05:36:22.343432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:00.321077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340797+0000","last_change":"2024-09-17T05:36:21.373176+0000","last_active":"2024-09-17T05:36:22.340797+0000","last_peered":"2024-09-17T05:36:22.340797+0000","last_clean":"2024-09-17T05:36:22.340797+0000","last_became_active":"2024-09-17T05:36:21.372030+0000","last_became_peered":"2024-09-17T05:36:21.372030+0000","last_unstale":"2024-09-17T05:36:22.340797+0000","last_undegraded":"2024-09-17T05:36:22.340797+0000","last_fullsized":"2024-09-17T05:36:22.340797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:42.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715087+0000","last_change":"2024-09-17T05:36:17.329006+0000","last_active":"2024-09-17T05:36:22.715087+0000","last_peered":"2024-09-17T05:36:22.715087+0000","last_clean":"2024-09-17T05:36:22.715087+0000","last_became_active":"2024-09-17T05:36:17.328683+0000","last_became_peered":"2024-09-17T05:36:17.328683+0000","last_unstale":"2024-09-17T05:36:22.715087+0000","last_undegraded":"2024-09-17T05:36:22.715087+0000","last_fullsized":"2024-09-17T05:36:22.715087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529439+0000","last_change":"2024-09-17T05:36:16.321759+0000","last_active":"2024-09-17T05:36:23.529439+0000","last_peered":"2024-09-17T05:36:23.529439+0000","last_clean":"2024-09-17T05:36:23.529439+0000","last_became_active":"2024-09-17T05:36:16.321356+0000","last_became_peered":"2024-09-17T05:36:16.321356+0000","last_unstale":"2024-09-17T05:36:23.529439+0000","last_undegraded":"2024-09-17T05:36:23.529439+0000","last_fullsized":"2024-09-17T05:36:23.529439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528292+0000","last_change":"2024-09-17T05:36:21.379637+0000","last_active":"2024-09-17T05:36:23.528292+0000","last_peered":"2024-09-17T05:36:23.528292+0000","last_clean":"2024-09-17T05:36:23.528292+0000","last_became_active":"2024-09-17T05:36:21.379220+0000","last_became_peered":"2024-09-17T05:36:21.379220+0000","last_unstale":"2024-09-17T05:36:23.528292+0000","last_undegraded":"2024-09-17T05:36:23.528292+0000","last_fullsized":"2024-09-17T05:36:23.528292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:11.229153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715278+0000","last_change":"2024-09-17T05:36:17.326522+0000","last_active":"2024-09-17T05:36:22.715278+0000","last_peered":"2024-09-17T05:36:22.715278+0000","last_clean":"2024-09-17T05:36:22.715278+0000","last_became_active":"2024-09-17T05:36:17.326199+0000","last_became_peered":"2024-09-17T05:36:17.326199+0000","last_unstale":"2024-09-17T05:36:22.715278+0000","last_undegraded":"2024-09-17T05:36:22.715278+0000","last_fullsized":"2024-09-17T05:36:22.715278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344595+0000","last_change":"2024-09-17T05:36:16.319960+0000","last_active":"2024-09-17T05:36:22.344595+0000","last_peered":"2024-09-17T05:36:22.344595+0000","last_clean":"2024-09-17T05:36:22.344595+0000","last_became_active":"2024-09-17T05:36:16.319686+0000","last_became_peered":"2024-09-17T05:36:16.319686+0000","last_unstale":"2024-09-17T05:36:22.344595+0000","last_undegraded":"2024-09-17T05:36:22.344595+0000","last_fullsized":"2024-09-17T05:36:22.344595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981056+0000","last_change":"2024-09-17T05:36:21.377298+0000","last_active":"2024-09-17T05:36:22.981056+0000","last_peered":"2024-09-17T05:36:22.981056+0000","last_clean":"2024-09-17T05:36:22.981056+0000","last_became_active":"2024-09-17T05:36:21.375463+0000","last_became_peered":"2024-09-17T05:36:21.375463+0000","last_unstale":"2024-09-17T05:36:22.981056+0000","last_undegraded":"2024-09-17T05:36:22.981056+0000","last_fullsized":"2024-09-17T05:36:22.981056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:39.055127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341881+0000","last_change":"2024-09-17T05:36:17.340442+0000","last_active":"2024-09-17T05:36:22.341881+0000","last_peered":"2024-09-17T05:36:22.341881+0000","last_clean":"2024-09-17T05:36:22.341881+0000","last_became_active":"2024-09-17T05:36:17.339752+0000","last_became_peered":"2024-09-17T05:36:17.339752+0000","last_unstale":"2024-09-17T05:36:22.341881+0000","last_undegraded":"2024-09-17T05:36:22.341881+0000","last_fullsized":"2024-09-17T05:36:22.341881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:22.275599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715407+0000","last_change":"2024-09-17T05:36:16.331663+0000","last_active":"2024-09-17T05:36:22.715407+0000","last_peered":"2024-09-17T05:36:22.715407+0000","last_clean":"2024-09-17T05:36:22.715407+0000","last_became_active":"2024-09-17T05:36:16.331428+0000","last_became_peered":"2024-09-17T05:36:16.331428+0000","last_unstale":"2024-09-17T05:36:22.715407+0000","last_undegraded":"2024-09-17T05:36:22.715407+0000","last_fullsized":"2024-09-17T05:36:22.715407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:50.759005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526933+0000","last_change":"2024-09-17T05:36:21.356148+0000","last_active":"2024-09-17T05:36:23.526933+0000","last_peered":"2024-09-17T05:36:23.526933+0000","last_clean":"2024-09-17T05:36:23.526933+0000","last_became_active":"2024-09-17T05:36:21.354594+0000","last_became_peered":"2024-09-17T05:36:21.354594+0000","last_unstale":"2024-09-17T05:36:23.526933+0000","last_undegraded":"2024-09-17T05:36:23.526933+0000","last_fullsized":"2024-09-17T05:36:23.526933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:46.831413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981160+0000","last_change":"2024-09-17T05:36:17.340510+0000","last_active":"2024-09-17T05:36:22.981160+0000","last_peered":"2024-09-17T05:36:22.981160+0000","last_clean":"2024-09-17T05:36:22.981160+0000","last_became_active":"2024-09-17T05:36:17.340124+0000","last_became_peered":"2024-09-17T05:36:17.340124+0000","last_unstale":"2024-09-17T05:36:22.981160+0000","last_undegraded":"2024-09-17T05:36:22.981160+0000","last_fullsized":"2024-09-17T05:36:22.981160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342894+0000","last_change":"2024-09-17T05:36:16.307077+0000","last_active":"2024-09-17T05:36:22.342894+0000","last_peered":"2024-09-17T05:36:22.342894+0000","last_clean":"2024-09-17T05:36:22.342894+0000","last_became_active":"2024-09-17T05:36:16.306568+0000","last_became_peered":"2024-09-17T05:36:16.306568+0000","last_unstale":"2024-09-17T05:36:22.342894+0000","last_undegraded":"2024-09-17T05:36:22.342894+0000","last_fullsized":"2024-09-17T05:36:22.342894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528731+0000","last_change":"2024-09-17T05:36:21.365391+0000","last_active":"2024-09-17T05:36:23.528731+0000","last_peered":"2024-09-17T05:36:23.528731+0000","last_clean":"2024-09-17T05:36:23.528731+0000","last_became_active":"2024-09-17T05:36:21.364791+0000","last_became_peered":"2024-09-17T05:36:21.364791+0000","last_unstale":"2024-09-17T05:36:23.528731+0000","last_undegraded":"2024-09-17T05:36:23.528731+0000","last_fullsized":"2024-09-17T05:36:23.528731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:04.502618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526809+0000","last_change":"2024-09-17T05:36:17.335760+0000","last_active":"2024-09-17T05:36:23.526809+0000","last_peered":"2024-09-17T05:36:23.526809+0000","last_clean":"2024-09-17T05:36:23.526809+0000","last_became_active":"2024-09-17T05:36:17.335388+0000","last_became_peered":"2024-09-17T05:36:17.335388+0000","last_unstale":"2024-09-17T05:36:23.526809+0000","last_undegraded":"2024-09-17T05:36:23.526809+0000","last_fullsized":"2024-09-17T05:36:23.526809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:27.462285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714588+0000","last_change":"2024-09-17T05:36:16.329939+0000","last_active":"2024-09-17T05:36:22.714588+0000","last_peered":"2024-09-17T05:36:22.714588+0000","last_clean":"2024-09-17T05:36:22.714588+0000","last_became_active":"2024-09-17T05:36:16.329632+0000","last_became_peered":"2024-09-17T05:36:16.329632+0000","last_unstale":"2024-09-17T05:36:22.714588+0000","last_undegraded":"2024-09-17T05:36:22.714588+0000","last_fullsized":"2024-09-17T05:36:22.714588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528745+0000","last_change":"2024-09-17T05:36:21.365043+0000","last_active":"2024-09-17T05:36:23.528745+0000","last_peered":"2024-09-17T05:36:23.528745+0000","last_clean":"2024-09-17T05:36:23.528745+0000","last_became_active":"2024-09-17T05:36:21.364610+0000","last_became_peered":"2024-09-17T05:36:21.364610+0000","last_unstale":"2024-09-17T05:36:23.528745+0000","last_undegraded":"2024-09-17T05:36:23.528745+0000","last_fullsized":"2024-09-17T05:36:23.528745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:55.108229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981556+0000","last_change":"2024-09-17T05:36:17.315566+0000","last_active":"2024-09-17T05:36:22.981556+0000","last_peered":"2024-09-17T05:36:22.981556+0000","last_clean":"2024-09-17T05:36:22.981556+0000","last_became_active":"2024-09-17T05:36:17.315280+0000","last_became_peered":"2024-09-17T05:36:17.315280+0000","last_unstale":"2024-09-17T05:36:22.981556+0000","last_undegraded":"2024-09-17T05:36:22.981556+0000","last_fullsized":"2024-09-17T05:36:22.981556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:07.191011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981531+0000","last_change":"2024-09-17T05:36:16.305788+0000","last_active":"2024-09-17T05:36:22.981531+0000","last_peered":"2024-09-17T05:36:22.981531+0000","last_clean":"2024-09-17T05:36:22.981531+0000","last_became_active":"2024-09-17T05:36:16.305404+0000","last_became_peered":"2024-09-17T05:36:16.305404+0000","last_unstale":"2024-09-17T05:36:22.981531+0000","last_undegraded":"2024-09-17T05:36:22.981531+0000","last_fullsized":"2024-09-17T05:36:22.981531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:55.852770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342770+0000","last_change":"2024-09-17T05:36:21.362271+0000","last_active":"2024-09-17T05:36:22.342770+0000","last_peered":"2024-09-17T05:36:22.342770+0000","last_clean":"2024-09-17T05:36:22.342770+0000","last_became_active":"2024-09-17T05:36:21.361775+0000","last_became_peered":"2024-09-17T05:36:21.361775+0000","last_unstale":"2024-09-17T05:36:22.342770+0000","last_undegraded":"2024-09-17T05:36:22.342770+0000","last_fullsized":"2024-09-17T05:36:22.342770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.770468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343845+0000","last_change":"2024-09-17T05:36:17.335234+0000","last_active":"2024-09-17T05:36:22.343845+0000","last_peered":"2024-09-17T05:36:22.343845+0000","last_clean":"2024-09-17T05:36:22.343845+0000","last_became_active":"2024-09-17T05:36:17.334898+0000","last_became_peered":"2024-09-17T05:36:17.334898+0000","last_unstale":"2024-09-17T05:36:22.343845+0000","last_undegraded":"2024-09-17T05:36:22.343845+0000","last_fullsized":"2024-09-17T05:36:22.343845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:29.554952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529339+0000","last_change":"2024-09-17T05:36:16.321488+0000","last_active":"2024-09-17T05:36:23.529339+0000","last_peered":"2024-09-17T05:36:23.529339+0000","last_clean":"2024-09-17T05:36:23.529339+0000","last_became_active":"2024-09-17T05:36:16.321104+0000","last_became_peered":"2024-09-17T05:36:16.321104+0000","last_unstale":"2024-09-17T05:36:23.529339+0000","last_undegraded":"2024-09-17T05:36:23.529339+0000","last_fullsized":"2024-09-17T05:36:23.529339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:51.739528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981857+0000","last_change":"2024-09-17T05:36:21.369908+0000","last_active":"2024-09-17T05:36:22.981857+0000","last_peered":"2024-09-17T05:36:22.981857+0000","last_clean":"2024-09-17T05:36:22.981857+0000","last_became_active":"2024-09-17T05:36:21.369460+0000","last_became_peered":"2024-09-17T05:36:21.369460+0000","last_unstale":"2024-09-17T05:36:22.981857+0000","last_undegraded":"2024-09-17T05:36:22.981857+0000","last_fullsized":"2024-09-17T05:36:22.981857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:57.419038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715227+0000","last_change":"2024-09-17T05:36:17.325334+0000","last_active":"2024-09-17T05:36:22.715227+0000","last_peered":"2024-09-17T05:36:22.715227+0000","last_clean":"2024-09-17T05:36:22.715227+0000","last_became_active":"2024-09-17T05:36:17.324663+0000","last_became_peered":"2024-09-17T05:36:17.324663+0000","last_unstale":"2024-09-17T05:36:22.715227+0000","last_undegraded":"2024-09-17T05:36:22.715227+0000","last_fullsized":"2024-09-17T05:36:22.715227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:28.454347+0000","last_change":"2024-09-17T05:36:16.313188+0000","last_active":"2024-09-17T05:36:28.454347+0000","last_peered":"2024-09-17T05:36:28.454347+0000","last_clean":"2024-09-17T05:36:28.454347+0000","last_became_active":"2024-09-17T05:36:16.312743+0000","last_became_peered":"2024-09-17T05:36:16.312743+0000","last_unstale":"2024-09-17T05:36:28.454347+0000","last_undegraded":"2024-09-17T05:36:28.454347+0000","last_fullsized":"2024-09-17T05:36:28.454347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:01.199020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343072+0000","last_change":"2024-09-17T05:36:21.364603+0000","last_active":"2024-09-17T05:36:22.343072+0000","last_peered":"2024-09-17T05:36:22.343072+0000","last_clean":"2024-09-17T05:36:22.343072+0000","last_became_active":"2024-09-17T05:36:21.359803+0000","last_became_peered":"2024-09-17T05:36:21.359803+0000","last_unstale":"2024-09-17T05:36:22.343072+0000","last_undegraded":"2024-09-17T05:36:22.343072+0000","last_fullsized":"2024-09-17T05:36:22.343072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:31.234403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981683+0000","last_change":"2024-09-17T05:36:17.333946+0000","last_active":"2024-09-17T05:36:22.981683+0000","last_peered":"2024-09-17T05:36:22.981683+0000","last_clean":"2024-09-17T05:36:22.981683+0000","last_became_active":"2024-09-17T05:36:17.333733+0000","last_became_peered":"2024-09-17T05:36:17.333733+0000","last_unstale":"2024-09-17T05:36:22.981683+0000","last_undegraded":"2024-09-17T05:36:22.981683+0000","last_fullsized":"2024-09-17T05:36:22.981683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:32.104558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529814+0000","last_change":"2024-09-17T05:36:16.312691+0000","last_active":"2024-09-17T05:36:23.529814+0000","last_peered":"2024-09-17T05:36:23.529814+0000","last_clean":"2024-09-17T05:36:23.529814+0000","last_became_active":"2024-09-17T05:36:16.312304+0000","last_became_peered":"2024-09-17T05:36:16.312304+0000","last_unstale":"2024-09-17T05:36:23.529814+0000","last_undegraded":"2024-09-17T05:36:23.529814+0000","last_fullsized":"2024-09-17T05:36:23.529814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341396+0000","last_change":"2024-09-17T05:36:21.375235+0000","last_active":"2024-09-17T05:36:22.341396+0000","last_peered":"2024-09-17T05:36:22.341396+0000","last_clean":"2024-09-17T05:36:22.341396+0000","last_became_active":"2024-09-17T05:36:21.374507+0000","last_became_peered":"2024-09-17T05:36:21.374507+0000","last_unstale":"2024-09-17T05:36:22.341396+0000","last_undegraded":"2024-09-17T05:36:22.341396+0000","last_fullsized":"2024-09-17T05:36:22.341396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:35.263335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528891+0000","last_change":"2024-09-17T05:36:17.338094+0000","last_active":"2024-09-17T05:36:23.528891+0000","last_peered":"2024-09-17T05:36:23.528891+0000","last_clean":"2024-09-17T05:36:23.528891+0000","last_became_active":"2024-09-17T05:36:17.337765+0000","last_became_peered":"2024-09-17T05:36:17.337765+0000","last_unstale":"2024-09-17T05:36:23.528891+0000","last_undegraded":"2024-09-17T05:36:23.528891+0000","last_fullsized":"2024-09-17T05:36:23.528891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715086+0000","last_change":"2024-09-17T05:36:16.327589+0000","last_active":"2024-09-17T05:36:22.715086+0000","last_peered":"2024-09-17T05:36:22.715086+0000","last_clean":"2024-09-17T05:36:22.715086+0000","last_became_active":"2024-09-17T05:36:16.327204+0000","last_became_peered":"2024-09-17T05:36:16.327204+0000","last_unstale":"2024-09-17T05:36:22.715086+0000","last_undegraded":"2024-09-17T05:36:22.715086+0000","last_fullsized":"2024-09-17T05:36:22.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527788+0000","last_change":"2024-09-17T05:36:21.387662+0000","last_active":"2024-09-17T05:36:23.527788+0000","last_peered":"2024-09-17T05:36:23.527788+0000","last_clean":"2024-09-17T05:36:23.527788+0000","last_became_active":"2024-09-17T05:36:21.387130+0000","last_became_peered":"2024-09-17T05:36:21.387130+0000","last_unstale":"2024-09-17T05:36:23.527788+0000","last_undegraded":"2024-09-17T05:36:23.527788+0000","last_fullsized":"2024-09-17T05:36:23.527788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:02.304238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341833+0000","last_change":"2024-09-17T05:36:17.340549+0000","last_active":"2024-09-17T05:36:22.341833+0000","last_peered":"2024-09-17T05:36:22.341833+0000","last_clean":"2024-09-17T05:36:22.341833+0000","last_became_active":"2024-09-17T05:36:17.339625+0000","last_became_peered":"2024-09-17T05:36:17.339625+0000","last_unstale":"2024-09-17T05:36:22.341833+0000","last_undegraded":"2024-09-17T05:36:22.341833+0000","last_fullsized":"2024-09-17T05:36:22.341833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:25.066974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527645+0000","last_change":"2024-09-17T05:36:16.298680+0000","last_active":"2024-09-17T05:36:23.527645+0000","last_peered":"2024-09-17T05:36:23.527645+0000","last_clean":"2024-09-17T05:36:23.527645+0000","last_became_active":"2024-09-17T05:36:16.298036+0000","last_became_peered":"2024-09-17T05:36:16.298036+0000","last_unstale":"2024-09-17T05:36:23.527645+0000","last_undegraded":"2024-09-17T05:36:23.527645+0000","last_fullsized":"2024-09-17T05:36:23.527645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:23.083593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342660+0000","last_change":"2024-09-17T05:36:21.368736+0000","last_active":"2024-09-17T05:36:22.342660+0000","last_peered":"2024-09-17T05:36:22.342660+0000","last_clean":"2024-09-17T05:36:22.342660+0000","last_became_active":"2024-09-17T05:36:21.367445+0000","last_became_peered":"2024-09-17T05:36:21.367445+0000","last_unstale":"2024-09-17T05:36:22.342660+0000","last_undegraded":"2024-09-17T05:36:22.342660+0000","last_fullsized":"2024-09-17T05:36:22.342660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:05.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344488+0000","last_change":"2024-09-17T05:36:21.363851+0000","last_active":"2024-09-17T05:36:22.344488+0000","last_peered":"2024-09-17T05:36:22.344488+0000","last_clean":"2024-09-17T05:36:22.344488+0000","last_became_active":"2024-09-17T05:36:21.363389+0000","last_became_peered":"2024-09-17T05:36:21.363389+0000","last_unstale":"2024-09-17T05:36:22.344488+0000","last_undegraded":"2024-09-17T05:36:22.344488+0000","last_fullsized":"2024-09-17T05:36:22.344488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:30.627064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342621+0000","last_change":"2024-09-17T05:36:17.327105+0000","last_active":"2024-09-17T05:36:22.342621+0000","last_peered":"2024-09-17T05:36:22.342621+0000","last_clean":"2024-09-17T05:36:22.342621+0000","last_became_active":"2024-09-17T05:36:17.326723+0000","last_became_peered":"2024-09-17T05:36:17.326723+0000","last_unstale":"2024-09-17T05:36:22.342621+0000","last_undegraded":"2024-09-17T05:36:22.342621+0000","last_fullsized":"2024-09-17T05:36:22.342621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:28.899717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981380+0000","last_change":"2024-09-17T05:36:16.333855+0000","last_active":"2024-09-17T05:36:22.981380+0000","last_peered":"2024-09-17T05:36:22.981380+0000","last_clean":"2024-09-17T05:36:22.981380+0000","last_became_active":"2024-09-17T05:36:16.327526+0000","last_became_peered":"2024-09-17T05:36:16.327526+0000","last_unstale":"2024-09-17T05:36:22.981380+0000","last_undegraded":"2024-09-17T05:36:22.981380+0000","last_fullsized":"2024-09-17T05:36:22.981380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982107+0000","last_change":"2024-09-17T05:36:21.382312+0000","last_active":"2024-09-17T05:36:22.982107+0000","last_peered":"2024-09-17T05:36:22.982107+0000","last_clean":"2024-09-17T05:36:22.982107+0000","last_became_active":"2024-09-17T05:36:21.381775+0000","last_became_peered":"2024-09-17T05:36:21.381775+0000","last_unstale":"2024-09-17T05:36:22.982107+0000","last_undegraded":"2024-09-17T05:36:22.982107+0000","last_fullsized":"2024-09-17T05:36:22.982107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:54.623675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527876+0000","last_change":"2024-09-17T05:36:17.336803+0000","last_active":"2024-09-17T05:36:23.527876+0000","last_peered":"2024-09-17T05:36:23.527876+0000","last_clean":"2024-09-17T05:36:23.527876+0000","last_became_active":"2024-09-17T05:36:17.336509+0000","last_became_peered":"2024-09-17T05:36:17.336509+0000","last_unstale":"2024-09-17T05:36:23.527876+0000","last_undegraded":"2024-09-17T05:36:23.527876+0000","last_fullsized":"2024-09-17T05:36:23.527876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342443+0000","last_change":"2024-09-17T05:36:16.319485+0000","last_active":"2024-09-17T05:36:22.342443+0000","last_peered":"2024-09-17T05:36:22.342443+0000","last_clean":"2024-09-17T05:36:22.342443+0000","last_became_active":"2024-09-17T05:36:16.319042+0000","last_became_peered":"2024-09-17T05:36:16.319042+0000","last_unstale":"2024-09-17T05:36:22.342443+0000","last_undegraded":"2024-09-17T05:36:22.342443+0000","last_fullsized":"2024-09-17T05:36:22.342443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.491679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981509+0000","last_change":"2024-09-17T05:36:16.323135+0000","last_active":"2024-09-17T05:36:22.981509+0000","last_peered":"2024-09-17T05:36:22.981509+0000","last_clean":"2024-09-17T05:36:22.981509+0000","last_became_active":"2024-09-17T05:36:16.322812+0000","last_became_peered":"2024-09-17T05:36:16.322812+0000","last_unstale":"2024-09-17T05:36:22.981509+0000","last_undegraded":"2024-09-17T05:36:22.981509+0000","last_fullsized":"2024-09-17T05:36:22.981509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:12.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343453+0000","last_change":"2024-09-17T05:36:17.323771+0000","last_active":"2024-09-17T05:36:22.343453+0000","last_peered":"2024-09-17T05:36:22.343453+0000","last_clean":"2024-09-17T05:36:22.343453+0000","last_became_active":"2024-09-17T05:36:17.323383+0000","last_became_peered":"2024-09-17T05:36:17.323383+0000","last_unstale":"2024-09-17T05:36:22.343453+0000","last_undegraded":"2024-09-17T05:36:22.343453+0000","last_fullsized":"2024-09-17T05:36:22.343453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343969+0000","last_change":"2024-09-17T05:36:21.364040+0000","last_active":"2024-09-17T05:36:22.343969+0000","last_peered":"2024-09-17T05:36:22.343969+0000","last_clean":"2024-09-17T05:36:22.343969+0000","last_became_active":"2024-09-17T05:36:21.363341+0000","last_became_peered":"2024-09-17T05:36:21.363341+0000","last_unstale":"2024-09-17T05:36:22.343969+0000","last_undegraded":"2024-09-17T05:36:22.343969+0000","last_fullsized":"2024-09-17T05:36:22.343969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:02.548547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528352+0000","last_change":"2024-09-17T05:36:16.316663+0000","last_active":"2024-09-17T05:36:23.528352+0000","last_peered":"2024-09-17T05:36:23.528352+0000","last_clean":"2024-09-17T05:36:23.528352+0000","last_became_active":"2024-09-17T05:36:16.316362+0000","last_became_peered":"2024-09-17T05:36:16.316362+0000","last_unstale":"2024-09-17T05:36:23.528352+0000","last_undegraded":"2024-09-17T05:36:23.528352+0000","last_fullsized":"2024-09-17T05:36:23.528352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526808+0000","last_change":"2024-09-17T05:36:17.310831+0000","last_active":"2024-09-17T05:36:23.526808+0000","last_peered":"2024-09-17T05:36:23.526808+0000","last_clean":"2024-09-17T05:36:23.526808+0000","last_became_active":"2024-09-17T05:36:17.309876+0000","last_became_peered":"2024-09-17T05:36:17.309876+0000","last_unstale":"2024-09-17T05:36:23.526808+0000","last_undegraded":"2024-09-17T05:36:23.526808+0000","last_fullsized":"2024-09-17T05:36:23.526808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:07.057468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529654+0000","last_change":"2024-09-17T05:36:21.379986+0000","last_active":"2024-09-17T05:36:23.529654+0000","last_peered":"2024-09-17T05:36:23.529654+0000","last_clean":"2024-09-17T05:36:23.529654+0000","last_became_active":"2024-09-17T05:36:21.379475+0000","last_became_peered":"2024-09-17T05:36:21.379475+0000","last_unstale":"2024-09-17T05:36:23.529654+0000","last_undegraded":"2024-09-17T05:36:23.529654+0000","last_fullsized":"2024-09-17T05:36:23.529654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:00.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341151+0000","last_change":"2024-09-17T05:36:17.321338+0000","last_active":"2024-09-17T05:36:22.341151+0000","last_peered":"2024-09-17T05:36:22.341151+0000","last_clean":"2024-09-17T05:36:22.341151+0000","last_became_active":"2024-09-17T05:36:17.320935+0000","last_became_peered":"2024-09-17T05:36:17.320935+0000","last_unstale":"2024-09-17T05:36:22.341151+0000","last_undegraded":"2024-09-17T05:36:22.341151+0000","last_fullsized":"2024-09-17T05:36:22.341151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528779+0000","last_change":"2024-09-17T05:36:17.344784+0000","last_active":"2024-09-17T05:36:23.528779+0000","last_peered":"2024-09-17T05:36:23.528779+0000","last_clean":"2024-09-17T05:36:23.528779+0000","last_became_active":"2024-09-17T05:36:17.344318+0000","last_became_peered":"2024-09-17T05:36:17.344318+0000","last_unstale":"2024-09-17T05:36:23.528779+0000","last_undegraded":"2024-09-17T05:36:23.528779+0000","last_fullsized":"2024-09-17T05:36:23.528779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981361+0000","last_change":"2024-09-17T05:36:17.330884+0000","last_active":"2024-09-17T05:36:22.981361+0000","last_peered":"2024-09-17T05:36:22.981361+0000","last_clean":"2024-09-17T05:36:22.981361+0000","last_became_active":"2024-09-17T05:36:17.330452+0000","last_became_peered":"2024-09-17T05:36:17.330452+0000","last_unstale":"2024-09-17T05:36:22.981361+0000","last_undegraded":"2024-09-17T05:36:22.981361+0000","last_fullsized":"2024-09-17T05:36:22.981361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:29.774698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528209+0000","last_change":"2024-09-17T05:36:17.328894+0000","last_active":"2024-09-17T05:36:23.528209+0000","last_peered":"2024-09-17T05:36:23.528209+0000","last_clean":"2024-09-17T05:36:23.528209+0000","last_became_active":"2024-09-17T05:36:17.327780+0000","last_became_peered":"2024-09-17T05:36:17.327780+0000","last_unstale":"2024-09-17T05:36:23.528209+0000","last_undegraded":"2024-09-17T05:36:23.528209+0000","last_fullsized":"2024-09-17T05:36:23.528209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343281+0000","last_change":"2024-09-17T05:36:17.332587+0000","last_active":"2024-09-17T05:36:22.343281+0000","last_peered":"2024-09-17T05:36:22.343281+0000","last_clean":"2024-09-17T05:36:22.343281+0000","last_became_active":"2024-09-17T05:36:17.332288+0000","last_became_peered":"2024-09-17T05:36:17.332288+0000","last_unstale":"2024-09-17T05:36:22.343281+0000","last_undegraded":"2024-09-17T05:36:22.343281+0000","last_fullsized":"2024-09-17T05:36:22.343281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:06.339627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343457+0000","last_change":"2024-09-17T05:36:17.332485+0000","last_active":"2024-09-17T05:36:22.343457+0000","last_peered":"2024-09-17T05:36:22.343457+0000","last_clean":"2024-09-17T05:36:22.343457+0000","last_became_active":"2024-09-17T05:36:17.332115+0000","last_became_peered":"2024-09-17T05:36:17.332115+0000","last_unstale":"2024-09-17T05:36:22.343457+0000","last_undegraded":"2024-09-17T05:36:22.343457+0000","last_fullsized":"2024-09-17T05:36:22.343457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:05.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341705+0000","last_change":"2024-09-17T05:36:17.340797+0000","last_active":"2024-09-17T05:36:22.341705+0000","last_peered":"2024-09-17T05:36:22.341705+0000","last_clean":"2024-09-17T05:36:22.341705+0000","last_became_active":"2024-09-17T05:36:17.340122+0000","last_became_peered":"2024-09-17T05:36:17.340122+0000","last_unstale":"2024-09-17T05:36:22.341705+0000","last_undegraded":"2024-09-17T05:36:22.341705+0000","last_fullsized":"2024-09-17T05:36:22.341705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:46.074621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528625+0000","last_change":"2024-09-17T05:36:17.346906+0000","last_active":"2024-09-17T05:36:23.528625+0000","last_peered":"2024-09-17T05:36:23.528625+0000","last_clean":"2024-09-17T05:36:23.528625+0000","last_became_active":"2024-09-17T05:36:17.340932+0000","last_became_peered":"2024-09-17T05:36:17.340932+0000","last_unstale":"2024-09-17T05:36:23.528625+0000","last_undegraded":"2024-09-17T05:36:23.528625+0000","last_fullsized":"2024-09-17T05:36:23.528625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981266+0000","last_change":"2024-09-17T05:36:17.346011+0000","last_active":"2024-09-17T05:36:22.981266+0000","last_peered":"2024-09-17T05:36:22.981266+0000","last_clean":"2024-09-17T05:36:22.981266+0000","last_became_active":"2024-09-17T05:36:17.345659+0000","last_became_peered":"2024-09-17T05:36:17.345659+0000","last_unstale":"2024-09-17T05:36:22.981266+0000","last_undegraded":"2024-09-17T05:36:22.981266+0000","last_fullsized":"2024-09-17T05:36:22.981266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527926+0000","last_change":"2024-09-17T05:36:17.339568+0000","last_active":"2024-09-17T05:36:23.527926+0000","last_peered":"2024-09-17T05:36:23.527926+0000","last_clean":"2024-09-17T05:36:23.527926+0000","last_became_active":"2024-09-17T05:36:17.339206+0000","last_became_peered":"2024-09-17T05:36:17.339206+0000","last_unstale":"2024-09-17T05:36:23.527926+0000","last_undegraded":"2024-09-17T05:36:23.527926+0000","last_fullsized":"2024-09-17T05:36:23.527926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526829+0000","last_change":"2024-09-17T05:36:17.319470+0000","last_active":"2024-09-17T05:36:23.526829+0000","last_peered":"2024-09-17T05:36:23.526829+0000","last_clean":"2024-09-17T05:36:23.526829+0000","last_became_active":"2024-09-17T05:36:17.319072+0000","last_became_peered":"2024-09-17T05:36:17.319072+0000","last_unstale":"2024-09-17T05:36:23.526829+0000","last_undegraded":"2024-09-17T05:36:23.526829+0000","last_fullsized":"2024-09-17T05:36:23.526829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:44.305630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343303+0000","last_change":"2024-09-17T05:36:17.335377+0000","last_active":"2024-09-17T05:36:22.343303+0000","last_peered":"2024-09-17T05:36:22.343303+0000","last_clean":"2024-09-17T05:36:22.343303+0000","last_became_active":"2024-09-17T05:36:17.335031+0000","last_became_peered":"2024-09-17T05:36:17.335031+0000","last_unstale":"2024-09-17T05:36:22.343303+0000","last_undegraded":"2024-09-17T05:36:22.343303+0000","last_fullsized":"2024-09-17T05:36:22.343303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:29.539404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715039+0000","last_change":"2024-09-17T05:36:17.326013+0000","last_active":"2024-09-17T05:36:22.715039+0000","last_peered":"2024-09-17T05:36:22.715039+0000","last_clean":"2024-09-17T05:36:22.715039+0000","last_became_active":"2024-09-17T05:36:17.325380+0000","last_became_peered":"2024-09-17T05:36:17.325380+0000","last_unstale":"2024-09-17T05:36:22.715039+0000","last_undegraded":"2024-09-17T05:36:22.715039+0000","last_fullsized":"2024-09-17T05:36:22.715039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982122+0000","last_change":"2024-09-17T05:36:17.322938+0000","last_active":"2024-09-17T05:36:22.982122+0000","last_peered":"2024-09-17T05:36:22.982122+0000","last_clean":"2024-09-17T05:36:22.982122+0000","last_became_active":"2024-09-17T05:36:17.322588+0000","last_became_peered":"2024-09-17T05:36:17.322588+0000","last_unstale":"2024-09-17T05:36:22.982122+0000","last_undegraded":"2024-09-17T05:36:22.982122+0000","last_fullsized":"2024-09-17T05:36:22.982122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:51.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529825+0000","last_change":"2024-09-17T05:36:17.347278+0000","last_active":"2024-09-17T05:36:23.529825+0000","last_peered":"2024-09-17T05:36:23.529825+0000","last_clean":"2024-09-17T05:36:23.529825+0000","last_became_active":"2024-09-17T05:36:17.346983+0000","last_became_peered":"2024-09-17T05:36:17.346983+0000","last_unstale":"2024-09-17T05:36:23.529825+0000","last_undegraded":"2024-09-17T05:36:23.529825+0000","last_fullsized":"2024-09-17T05:36:23.529825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982334+0000","last_change":"2024-09-17T05:36:17.328660+0000","last_active":"2024-09-17T05:36:22.982334+0000","last_peered":"2024-09-17T05:36:22.982334+0000","last_clean":"2024-09-17T05:36:22.982334+0000","last_became_active":"2024-09-17T05:36:17.324799+0000","last_became_peered":"2024-09-17T05:36:17.324799+0000","last_unstale":"2024-09-17T05:36:22.982334+0000","last_undegraded":"2024-09-17T05:36:22.982334+0000","last_fullsized":"2024-09-17T05:36:22.982334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:25.124191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981321+0000","last_change":"2024-09-17T05:36:17.323989+0000","last_active":"2024-09-17T05:36:22.981321+0000","last_peered":"2024-09-17T05:36:22.981321+0000","last_clean":"2024-09-17T05:36:22.981321+0000","last_became_active":"2024-09-17T05:36:17.321569+0000","last_became_peered":"2024-09-17T05:36:17.321569+0000","last_unstale":"2024-09-17T05:36:22.981321+0000","last_undegraded":"2024-09-17T05:36:22.981321+0000","last_fullsized":"2024-09-17T05:36:22.981321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527794+0000","last_change":"2024-09-17T05:36:17.329281+0000","last_active":"2024-09-17T05:36:23.527794+0000","last_peered":"2024-09-17T05:36:23.527794+0000","last_clean":"2024-09-17T05:36:23.527794+0000","last_became_active":"2024-09-17T05:36:17.328142+0000","last_became_peered":"2024-09-17T05:36:17.328142+0000","last_unstale":"2024-09-17T05:36:23.527794+0000","last_undegraded":"2024-09-17T05:36:23.527794+0000","last_fullsized":"2024-09-17T05:36:23.527794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343704+0000","last_change":"2024-09-17T05:36:17.331419+0000","last_active":"2024-09-17T05:36:22.343704+0000","last_peered":"2024-09-17T05:36:22.343704+0000","last_clean":"2024-09-17T05:36:22.343704+0000","last_became_active":"2024-09-17T05:36:17.330949+0000","last_became_peered":"2024-09-17T05:36:17.330949+0000","last_unstale":"2024-09-17T05:36:22.343704+0000","last_undegraded":"2024-09-17T05:36:22.343704+0000","last_fullsized":"2024-09-17T05:36:22.343704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:01.895132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342869+0000","last_change":"2024-09-17T05:36:17.337108+0000","last_active":"2024-09-17T05:36:22.342869+0000","last_peered":"2024-09-17T05:36:22.342869+0000","last_clean":"2024-09-17T05:36:22.342869+0000","last_became_active":"2024-09-17T05:36:17.330031+0000","last_became_peered":"2024-09-17T05:36:17.330031+0000","last_unstale":"2024-09-17T05:36:22.342869+0000","last_undegraded":"2024-09-17T05:36:22.342869+0000","last_fullsized":"2024-09-17T05:36:22.342869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:20.371899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714967+0000","last_change":"2024-09-17T05:36:17.326415+0000","last_active":"2024-09-17T05:36:22.714967+0000","last_peered":"2024-09-17T05:36:22.714967+0000","last_clean":"2024-09-17T05:36:22.714967+0000","last_became_active":"2024-09-17T05:36:17.325865+0000","last_became_peered":"2024-09-17T05:36:17.325865+0000","last_unstale":"2024-09-17T05:36:22.714967+0000","last_undegraded":"2024-09-17T05:36:22.714967+0000","last_fullsized":"2024-09-17T05:36:22.714967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715119+0000","last_change":"2024-09-17T05:36:17.324996+0000","last_active":"2024-09-17T05:36:22.715119+0000","last_peered":"2024-09-17T05:36:22.715119+0000","last_clean":"2024-09-17T05:36:22.715119+0000","last_became_active":"2024-09-17T05:36:17.324236+0000","last_became_peered":"2024-09-17T05:36:17.324236+0000","last_unstale":"2024-09-17T05:36:22.715119+0000","last_undegraded":"2024-09-17T05:36:22.715119+0000","last_fullsized":"2024-09-17T05:36:22.715119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714911+0000","last_change":"2024-09-17T05:36:17.344886+0000","last_active":"2024-09-17T05:36:22.714911+0000","last_peered":"2024-09-17T05:36:22.714911+0000","last_clean":"2024-09-17T05:36:22.714911+0000","last_became_active":"2024-09-17T05:36:17.344366+0000","last_became_peered":"2024-09-17T05:36:17.344366+0000","last_unstale":"2024-09-17T05:36:22.714911+0000","last_undegraded":"2024-09-17T05:36:22.714911+0000","last_fullsized":"2024-09-17T05:36:22.714911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:31.225193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527631+0000","last_change":"2024-09-17T05:36:17.315032+0000","last_active":"2024-09-17T05:36:23.527631+0000","last_peered":"2024-09-17T05:36:23.527631+0000","last_clean":"2024-09-17T05:36:23.527631+0000","last_became_active":"2024-09-17T05:36:17.313444+0000","last_became_peered":"2024-09-17T05:36:17.313444+0000","last_unstale":"2024-09-17T05:36:23.527631+0000","last_undegraded":"2024-09-17T05:36:23.527631+0000","last_fullsized":"2024-09-17T05:36:23.527631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:54.948931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527661+0000","last_change":"2024-09-17T05:36:17.334347+0000","last_active":"2024-09-17T05:36:23.527661+0000","last_peered":"2024-09-17T05:36:23.527661+0000","last_clean":"2024-09-17T05:36:23.527661+0000","last_became_active":"2024-09-17T05:36:17.328605+0000","last_became_peered":"2024-09-17T05:36:17.328605+0000","last_unstale":"2024-09-17T05:36:23.527661+0000","last_undegraded":"2024-09-17T05:36:23.527661+0000","last_fullsized":"2024-09-17T05:36:23.527661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714540+0000","last_change":"2024-09-17T05:36:17.317414+0000","last_active":"2024-09-17T05:36:22.714540+0000","last_peered":"2024-09-17T05:36:22.714540+0000","last_clean":"2024-09-17T05:36:22.714540+0000","last_became_active":"2024-09-17T05:36:17.316995+0000","last_became_peered":"2024-09-17T05:36:17.316995+0000","last_unstale":"2024-09-17T05:36:22.714540+0000","last_undegraded":"2024-09-17T05:36:22.714540+0000","last_fullsized":"2024-09-17T05:36:22.714540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341035+0000","last_change":"2024-09-17T05:36:17.338794+0000","last_active":"2024-09-17T05:36:22.341035+0000","last_peered":"2024-09-17T05:36:22.341035+0000","last_clean":"2024-09-17T05:36:22.341035+0000","last_became_active":"2024-09-17T05:36:17.338484+0000","last_became_peered":"2024-09-17T05:36:17.338484+0000","last_unstale":"2024-09-17T05:36:22.341035+0000","last_undegraded":"2024-09-17T05:36:22.341035+0000","last_fullsized":"2024-09-17T05:36:22.341035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:11.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714807+0000","last_change":"2024-09-17T05:36:17.338013+0000","last_active":"2024-09-17T05:36:22.714807+0000","last_peered":"2024-09-17T05:36:22.714807+0000","last_clean":"2024-09-17T05:36:22.714807+0000","last_became_active":"2024-09-17T05:36:17.336108+0000","last_became_peered":"2024-09-17T05:36:17.336108+0000","last_unstale":"2024-09-17T05:36:22.714807+0000","last_undegraded":"2024-09-17T05:36:22.714807+0000","last_fullsized":"2024-09-17T05:36:22.714807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340824+0000","last_change":"2024-09-17T05:36:17.338178+0000","last_active":"2024-09-17T05:36:22.340824+0000","last_peered":"2024-09-17T05:36:22.340824+0000","last_clean":"2024-09-17T05:36:22.340824+0000","last_became_active":"2024-09-17T05:36:17.332226+0000","last_became_peered":"2024-09-17T05:36:17.332226+0000","last_unstale":"2024-09-17T05:36:22.340824+0000","last_undegraded":"2024-09-17T05:36:22.340824+0000","last_fullsized":"2024-09-17T05:36:22.340824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529229+0000","last_change":"2024-09-17T05:36:17.339093+0000","last_active":"2024-09-17T05:36:23.529229+0000","last_peered":"2024-09-17T05:36:23.529229+0000","last_clean":"2024-09-17T05:36:23.529229+0000","last_became_active":"2024-09-17T05:36:17.338568+0000","last_became_peered":"2024-09-17T05:36:17.338568+0000","last_unstale":"2024-09-17T05:36:23.529229+0000","last_undegraded":"2024-09-17T05:36:23.529229+0000","last_fullsized":"2024-09-17T05:36:23.529229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528481+0000","last_change":"2024-09-17T05:36:17.339579+0000","last_active":"2024-09-17T05:36:23.528481+0000","last_peered":"2024-09-17T05:36:23.528481+0000","last_clean":"2024-09-17T05:36:23.528481+0000","last_became_active":"2024-09-17T05:36:17.339156+0000","last_became_peered":"2024-09-17T05:36:17.339156+0000","last_unstale":"2024-09-17T05:36:23.528481+0000","last_undegraded":"2024-09-17T05:36:23.528481+0000","last_fullsized":"2024-09-17T05:36:23.528481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715225+0000","last_change":"2024-09-17T05:36:17.334244+0000","last_active":"2024-09-17T05:36:22.715225+0000","last_peered":"2024-09-17T05:36:22.715225+0000","last_clean":"2024-09-17T05:36:22.715225+0000","last_became_active":"2024-09-17T05:36:17.333913+0000","last_became_peered":"2024-09-17T05:36:17.333913+0000","last_unstale":"2024-09-17T05:36:22.715225+0000","last_undegraded":"2024-09-17T05:36:22.715225+0000","last_fullsized":"2024-09-17T05:36:22.715225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:34.066 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:36:34.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T05:36:34.067 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T05:36:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 -- 172.21.15.44:0/3257983952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0cbf30 msgr2=0x7f0c6c0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 --2- 172.21.15.44:0/3257983952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0cbf30 0x7f0c6c0cecf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009bc0 tx=0x7f0c6401cb70 comp rx=0 tx=0).stop 2024-09-17T05:36:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 -- 172.21.15.44:0/3257983952 shutdown_connections 2024-09-17T05:36:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 --2- 172.21.15.44:0/3257983952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0cbf30 0x7f0c6c0cecf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 --2- 172.21.15.44:0/3257983952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c6c0aec80 0x7f0c6c0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 -- 172.21.15.44:0/3257983952 >> 172.21.15.44:0/3257983952 conn(0x7f0c6c0d1120 msgr2=0x7f0c6c0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 -- 172.21.15.44:0/3257983952 shutdown_connections 2024-09-17T05:36:34.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.262+0000 7f0c74000640 1 -- 172.21.15.44:0/3257983952 wait complete. 2024-09-17T05:36:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 Processor -- start 2024-09-17T05:36:34.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 -- start start 2024-09-17T05:36:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0ae870 0x7f0c6c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c6c0aec80 0x7f0c6c150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c6c0cbf30 0x7f0c6c150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c15f950 con 0x7f0c6c0ae870 2024-09-17T05:36:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c15f7d0 con 0x7f0c6c0aec80 2024-09-17T05:36:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6c15fad0 con 0x7f0c6c0cbf30 2024-09-17T05:36:34.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0ae870 0x7f0c6c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0ae870 0x7f0c6c157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49002/0 (socket says 172.21.15.44:49002) 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 -- 172.21.15.44:0/2818677433 learned_addr learned my addr 172.21.15.44:0/2818677433 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c70c00640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c6c0aec80 0x7f0c6c150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c72000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c6c0cbf30 0x7f0c6c150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 -- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c6c0cbf30 msgr2=0x7f0c6c150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c6c0cbf30 0x7f0c6c150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 -- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c6c0aec80 msgr2=0x7f0c6c150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c6c0aec80 0x7f0c6c150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 -- 172.21.15.44:0/2818677433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c15cb00 con 0x7f0c6c0ae870 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c70c00640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c6c0aec80 0x7f0c6c150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c72000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c6c0cbf30 0x7f0c6c150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:34.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c71600640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0ae870 0x7f0c6c157c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c400 tx=0x7f0c6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c69600640 1 -- 172.21.15.44:0/2818677433 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60017070 con 0x7f0c6c0ae870 2024-09-17T05:36:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c69600640 1 -- 172.21.15.44:0/2818677433 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c60003600 con 0x7f0c6c0ae870 2024-09-17T05:36:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c69600640 1 -- 172.21.15.44:0/2818677433 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60003a50 con 0x7f0c6c0ae870 2024-09-17T05:36:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.266+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c15cde0 con 0x7f0c6c0ae870 2024-09-17T05:36:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.270+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c15d3a0 con 0x7f0c6c0ae870 2024-09-17T05:36:34.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.270+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c0cb9f0 con 0x7f0c6c0ae870 2024-09-17T05:36:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.270+0000 7f0c69600640 1 -- 172.21.15.44:0/2818677433 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0c6001a070 con 0x7f0c6c0ae870 2024-09-17T05:36:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.270+0000 7f0c69600640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c4c073200 0x7f0c4c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.270+0000 7f0c69600640 1 -- 172.21.15.44:0/2818677433 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0c600938a0 con 0x7f0c6c0ae870 2024-09-17T05:36:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.270+0000 7f0c70c00640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c4c073200 0x7f0c4c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.274+0000 7f0c70c00640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c4c073200 0x7f0c4c075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c15ed80 tx=0x7f0c58005eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.274+0000 7f0c69600640 1 -- 172.21.15.44:0/2818677433 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0c6c0cc340 con 0x7f0c6c0ae870 2024-09-17T05:36:34.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.450+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f0c6c0742a0 con 0x7f0c6c0ae870 2024-09-17T05:36:34.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c69600640 1 -- 172.21.15.44:0/2818677433 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f0c6005e570 con 0x7f0c6c0ae870 2024-09-17T05:36:34.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:34.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c4c073200 msgr2=0x7f0c4c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c4c073200 0x7f0c4c075710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c15ed80 tx=0x7f0c58005eb0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0ae870 msgr2=0x7f0c6c157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0ae870 0x7f0c6c157c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c400 tx=0x7f0c6000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 shutdown_connections 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0c6c0cbf30 0x7f0c6c150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c4c073200 0x7f0c4c075710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c6c0aec80 0x7f0c6c150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 --2- 172.21.15.44:0/2818677433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c6c0ae870 0x7f0c6c157c90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 >> 172.21.15.44:0/2818677433 conn(0x7f0c6c0d1120 msgr2=0x7f0c6c06e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 shutdown_connections 2024-09-17T05:36:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.454+0000 7f0c74000640 1 -- 172.21.15.44:0/2818677433 wait complete. 2024-09-17T05:36:34.476 INFO:teuthology.orchestra.run.smithi044.stdout:[{"version":31,"timestamp":"2024-09-17T05:36:05.484626+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"3184.697297"}]}] 2024-09-17T05:36:34.476 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T05:36:34.476 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T05:36:34.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T05:36:34.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T05:36:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 -- 172.21.15.44:0/545319333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40cf780 msgr2=0x7f03f415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 --2- 172.21.15.44:0/545319333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40cf780 0x7f03f415d060 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009c80 tx=0x7f03ec01cce0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 -- 172.21.15.44:0/545319333 shutdown_connections 2024-09-17T05:36:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 --2- 172.21.15.44:0/545319333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40cf780 0x7f03f415d060 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 -- 172.21.15.44:0/545319333 >> 172.21.15.44:0/545319333 conn(0x7f03f40b4240 msgr2=0x7f03f40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 -- 172.21.15.44:0/545319333 shutdown_connections 2024-09-17T05:36:34.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 -- 172.21.15.44:0/545319333 wait complete. 2024-09-17T05:36:34.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 Processor -- start 2024-09-17T05:36:34.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.634+0000 7f03f9a00640 1 -- start start 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40d18f0 0x7f03f40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03f40d1d00 0x7f03f4165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f4165fe0 0x7f03f41663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03f416af40 con 0x7f03f40d18f0 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03f416adc0 con 0x7f03f40d1d00 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f03f416b0c0 con 0x7f03f4165fe0 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40d18f0 0x7f03f40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40d18f0 0x7f03f40cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49016/0 (socket says 172.21.15.44:49016) 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 -- 172.21.15.44:0/94123459 learned_addr learned my addr 172.21.15.44:0/94123459 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:34.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f3400640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f4165fe0 0x7f03f41663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03ea000640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03f40d1d00 0x7f03f4165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 -- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f4165fe0 msgr2=0x7f03f41663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f4165fe0 0x7f03f41663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 -- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03f40d1d00 msgr2=0x7f03f4165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03f40d1d00 0x7f03f4165aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 -- 172.21.15.44:0/94123459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f4166930 con 0x7f03f40d18f0 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03ea000640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03f40d1d00 0x7f03f4165aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f2a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40d18f0 0x7f03f40cbae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c3f0 tx=0x7f03e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03eb400640 1 -- 172.21.15.44:0/94123459 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4017070 con 0x7f03f40d18f0 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03eb400640 1 -- 172.21.15.44:0/94123459 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03e40053c0 con 0x7f03f40d18f0 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f40b7260 con 0x7f03f40d18f0 2024-09-17T05:36:34.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03eb400640 1 -- 172.21.15.44:0/94123459 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e4003860 con 0x7f03f40d18f0 2024-09-17T05:36:34.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f40b7820 con 0x7f03f40d18f0 2024-09-17T05:36:34.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.638+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f415d060 con 0x7f03f40d18f0 2024-09-17T05:36:34.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.642+0000 7f03eb400640 1 -- 172.21.15.44:0/94123459 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f03e401a070 con 0x7f03f40d18f0 2024-09-17T05:36:34.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.642+0000 7f03eb400640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03d0073200 0x7f03d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.642+0000 7f03eb400640 1 -- 172.21.15.44:0/94123459 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f03e4093820 con 0x7f03f40d18f0 2024-09-17T05:36:34.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.642+0000 7f03ea000640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03d0073200 0x7f03d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.642+0000 7f03ea000640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03d0073200 0x7f03d0075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03f40cc970 tx=0x7f03dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.646+0000 7f03eb400640 1 -- 172.21.15.44:0/94123459 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f03e405dea0 con 0x7f03f40d18f0 2024-09-17T05:36:34.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.862+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f03f415b420 con 0x7f03f40d18f0 2024-09-17T05:36:34.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.866+0000 7f03eb400640 1 -- 172.21.15.44:0/94123459 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186457 (secure 0 0 0) 0x7f03e40628d0 con 0x7f03f40d18f0 2024-09-17T05:36:34.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03d0073200 msgr2=0x7f03d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03d0073200 0x7f03d0075710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03f40cc970 tx=0x7f03dc009040 comp rx=0 tx=0).stop 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40d18f0 msgr2=0x7f03f40cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40d18f0 0x7f03f40cbae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c3f0 tx=0x7f03e400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 shutdown_connections 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03f4165fe0 0x7f03f41663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03d0073200 0x7f03d0075710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03f40d1d00 0x7f03f4165aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 --2- 172.21.15.44:0/94123459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03f40d18f0 0x7f03f40cbae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 >> 172.21.15.44:0/94123459 conn(0x7f03f40b4240 msgr2=0x7f03f40d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 shutdown_connections 2024-09-17T05:36:34.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:34.870+0000 7f03f9a00640 1 -- 172.21.15.44:0/94123459 wait complete. 2024-09-17T05:36:34.891 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":2120607983},{"type":"v1","addr":"172.21.15.86:6801","nonce":2120607983}]},"active_addr":"172.21.15.86:6801/2120607983","active_change":"2024-09-17T05:35:56.239323+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3940899305}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2767979697}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2637049744}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":3897727031}]}]} 2024-09-17T05:36:34.896 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T05:36:34.896 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T05:36:34.896 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 -- 172.21.15.44:0/4082375836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 msgr2=0x7efe50071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 --2- 172.21.15.44:0/4082375836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe50071c60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe5015b950 tx=0x7efe4001c830 comp rx=0 tx=0).stop 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 -- 172.21.15.44:0/4082375836 shutdown_connections 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 --2- 172.21.15.44:0/4082375836 >> v2:172.21.15.86:3300/0 conn(0x7efe500ccb60 0x7efe5006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 --2- 172.21.15.44:0/4082375836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe50071c60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 -- 172.21.15.44:0/4082375836 >> 172.21.15.44:0/4082375836 conn(0x7efe500cd930 msgr2=0x7efe500cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 -- 172.21.15.44:0/4082375836 shutdown_connections 2024-09-17T05:36:35.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.054+0000 7efe56200640 1 -- 172.21.15.44:0/4082375836 wait complete. 2024-09-17T05:36:35.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 Processor -- start 2024-09-17T05:36:35.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 -- start start 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe5006e490 0x7efe50148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe5015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe500ccb60 0x7efe5015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe5015c300 con 0x7efe50070e00 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe5015c180 con 0x7efe500ccb60 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efe5015c480 con 0x7efe5006e490 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe5015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe5015ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49034/0 (socket says 172.21.15.44:49034) 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 -- 172.21.15.44:0/3848962807 learned_addr learned my addr 172.21.15.44:0/3848962807 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe4f400640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe5006e490 0x7efe50148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe4fe00640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe500ccb60 0x7efe5015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 -- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe5006e490 msgr2=0x7efe50148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe5006e490 0x7efe50148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 -- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe500ccb60 msgr2=0x7efe5015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe500ccb60 0x7efe5015d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 -- 172.21.15.44:0/3848962807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe50148050 con 0x7efe50070e00 2024-09-17T05:36:35.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47e00640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe5015ce40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d6d0 tx=0x7efe3800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47400640 1 -- 172.21.15.44:0/3848962807 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38017070 con 0x7efe50070e00 2024-09-17T05:36:35.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47400640 1 -- 172.21.15.44:0/3848962807 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe38009b10 con 0x7efe50070e00 2024-09-17T05:36:35.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5014df30 con 0x7efe50070e00 2024-09-17T05:36:35.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe47400640 1 -- 172.21.15.44:0/3848962807 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38010460 con 0x7efe50070e00 2024-09-17T05:36:35.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.058+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe501482f0 con 0x7efe50070e00 2024-09-17T05:36:35.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.062+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe50071c60 con 0x7efe50070e00 2024-09-17T05:36:35.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.062+0000 7efe47400640 1 -- 172.21.15.44:0/3848962807 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe3801a070 con 0x7efe50070e00 2024-09-17T05:36:35.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.062+0000 7efe47400640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe2c073200 0x7efe2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.062+0000 7efe47400640 1 -- 172.21.15.44:0/3848962807 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efe38094730 con 0x7efe50070e00 2024-09-17T05:36:35.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.062+0000 7efe4f400640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe2c073200 0x7efe2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.066+0000 7efe4f400640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe2c073200 0x7efe2c075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe400af000 tx=0x7efe4001b070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.066+0000 7efe47400640 1 -- 172.21.15.44:0/3848962807 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efe3805ed20 con 0x7efe50070e00 2024-09-17T05:36:35.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe500709e0 con 0x7efe50070e00 2024-09-17T05:36:35.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe47400640 1 -- 172.21.15.44:0/3848962807 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7efe38063750 con 0x7efe50070e00 2024-09-17T05:36:35.247 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:35.247 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe2c073200 msgr2=0x7efe2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe2c073200 0x7efe2c075710 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe400af000 tx=0x7efe4001b070 comp rx=0 tx=0).stop 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 msgr2=0x7efe5015ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe5015ce40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d6d0 tx=0x7efe3800db90 comp rx=0 tx=0).stop 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 shutdown_connections 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe2c073200 0x7efe2c075710 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe500ccb60 0x7efe5015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe50070e00 0x7efe5015ce40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 --2- 172.21.15.44:0/3848962807 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe5006e490 0x7efe50148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 >> 172.21.15.44:0/3848962807 conn(0x7efe500cd930 msgr2=0x7efe500c9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 shutdown_connections 2024-09-17T05:36:35.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.246+0000 7efe56200640 1 -- 172.21.15.44:0/3848962807 wait complete. 2024-09-17T05:36:35.270 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T05:36:35.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:35.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 -- 172.21.15.44:0/1489804337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00d8004810 msgr2=0x7f00d8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 --2- 172.21.15.44:0/1489804337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00d8004810 0x7f00d8004c20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009b60 tx=0x7f00dc01d240 comp rx=0 tx=0).stop 2024-09-17T05:36:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f3400640 1 -- 172.21.15.44:0/1489804337 reap_dead start 2024-09-17T05:36:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 -- 172.21.15.44:0/1489804337 shutdown_connections 2024-09-17T05:36:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 -- 172.21.15.44:0/1489804337 >> 172.21.15.44:0/1489804337 conn(0x7f00f40b4240 msgr2=0x7f00f40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 -- 172.21.15.44:0/1489804337 shutdown_connections 2024-09-17T05:36:35.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 -- 172.21.15.44:0/1489804337 wait complete. 2024-09-17T05:36:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 Processor -- start 2024-09-17T05:36:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.430+0000 7f00f9c00640 1 -- start start 2024-09-17T05:36:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d8004810 0x7f00f4165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f40b03d0 0x7f00f40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00f4148490 0x7f00f41488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00f41678d0 con 0x7f00f40b03d0 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00f4167750 con 0x7f00d8004810 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f00f4167a50 con 0x7f00f4148490 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f40b03d0 0x7f00f40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f40b03d0 0x7f00f40718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49056/0 (socket says 172.21.15.44:49056) 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 -- 172.21.15.44:0/1047904056 learned_addr learned my addr 172.21.15.44:0/1047904056 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f2a00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d8004810 0x7f00f4165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f3400640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00f4148490 0x7f00f41488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 -- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00f4148490 msgr2=0x7f00f41488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00f4148490 0x7f00f41488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 -- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d8004810 msgr2=0x7f00f4165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d8004810 0x7f00f4165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 -- 172.21.15.44:0/1047904056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f4148de0 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f3400640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00f4148490 0x7f00f41488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00ebe00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f40b03d0 0x7f00f40718c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00dc01d070 tx=0x7f00dc0055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00eaa00640 1 -- 172.21.15.44:0/1047904056 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0b1040 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00eaa00640 1 -- 172.21.15.44:0/1047904056 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00dc004030 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00eaa00640 1 -- 172.21.15.44:0/1047904056 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc004440 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f4071e00 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f40b0910 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f40cf070 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.434+0000 7f00eaa00640 1 -- 172.21.15.44:0/1047904056 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f00dc0bd020 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.438+0000 7f00eaa00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f00d0073200 0x7f00d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.438+0000 7f00eaa00640 1 -- 172.21.15.44:0/1047904056 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f00dc12ee30 con 0x7f00f40b03d0 2024-09-17T05:36:35.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.438+0000 7f00f2a00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f00d0073200 0x7f00d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.438+0000 7f00f2a00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f00d0073200 0x7f00d0075710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00e4005fd0 tx=0x7f00e400b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.442+0000 7f00eaa00640 1 -- 172.21.15.44:0/1047904056 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f00dc0c4020 con 0x7f00f40b03d0 2024-09-17T05:36:35.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.614+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00f40b46f0 con 0x7f00f40b03d0 2024-09-17T05:36:35.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00eaa00640 1 -- 172.21.15.44:0/1047904056 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7f00f4071e00 con 0x7f00f40b03d0 2024-09-17T05:36:35.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:35.618 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f00d0073200 msgr2=0x7f00d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f00d0073200 0x7f00d0075710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f00e4005fd0 tx=0x7f00e400b260 comp rx=0 tx=0).stop 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f40b03d0 msgr2=0x7f00f40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f40b03d0 0x7f00f40718c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f00dc01d070 tx=0x7f00dc0055d0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 shutdown_connections 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f00f4148490 0x7f00f41488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00f40b03d0 0x7f00f40718c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f00d0073200 0x7f00d0075710 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 --2- 172.21.15.44:0/1047904056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00d8004810 0x7f00f4165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 >> 172.21.15.44:0/1047904056 conn(0x7f00f40b4240 msgr2=0x7f00f40b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 shutdown_connections 2024-09-17T05:36:35.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.618+0000 7f00f9c00640 1 -- 172.21.15.44:0/1047904056 wait complete. 2024-09-17T05:36:35.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T05:36:35.641 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T05:36:35.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T05:36:35.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T05:36:35.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T05:36:35.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T05:36:35.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T05:36:35.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T05:36:35.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 -- 172.21.15.44:0/786843072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 msgr2=0x7f812c15eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 --2- 172.21.15.44:0/786843072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 0x7f812c15eee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8120009900 tx=0x7f812001c720 comp rx=0 tx=0).stop 2024-09-17T05:36:35.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 -- 172.21.15.44:0/786843072 shutdown_connections 2024-09-17T05:36:35.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 --2- 172.21.15.44:0/786843072 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0711c0 0x7f812c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 --2- 172.21.15.44:0/786843072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 0x7f812c15eee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 -- 172.21.15.44:0/786843072 >> 172.21.15.44:0/786843072 conn(0x7f812c0b2c40 msgr2=0x7f812c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 -- 172.21.15.44:0/786843072 shutdown_connections 2024-09-17T05:36:35.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.930+0000 7f8132a00640 1 -- 172.21.15.44:0/786843072 wait complete. 2024-09-17T05:36:35.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.934+0000 7f8132a00640 1 Processor -- start 2024-09-17T05:36:35.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.934+0000 7f8132a00640 1 -- start start 2024-09-17T05:36:35.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.934+0000 7fb467200640 1 -- 172.21.15.44:0/3409890314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 msgr2=0x7fb4680ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.934+0000 7fb467200640 1 --2- 172.21.15.44:0/3409890314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 0x7fb4680ccaa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb460009bc0 tx=0x7fb46001cbc0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.934+0000 7fb467200640 1 -- 172.21.15.44:0/3409890314 shutdown_connections 2024-09-17T05:36:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.934+0000 7fb467200640 1 --2- 172.21.15.44:0/3409890314 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 0x7fb4680ccaa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.934+0000 7fb467200640 1 --2- 172.21.15.44:0/3409890314 >> v2:172.21.15.86:3300/0 conn(0x7fb468155890 0x7fb46815ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7fb467200640 1 -- 172.21.15.44:0/3409890314 >> 172.21.15.44:0/3409890314 conn(0x7fb4680732e0 msgr2=0x7fb4680b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7fb467200640 1 -- 172.21.15.44:0/3409890314 shutdown_connections 2024-09-17T05:36:35.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7fb467200640 1 -- 172.21.15.44:0/3409890314 wait complete. 2024-09-17T05:36:35.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 -- 172.21.15.44:0/1223278024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780b4e80 msgr2=0x7f79780b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 --2- 172.21.15.44:0/1223278024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780b4e80 0x7f79780b5290 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f79780b4730 tx=0x7f797001cb10 comp rx=0 tx=0).stop 2024-09-17T05:36:35.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 -- 172.21.15.44:0/1223278024 shutdown_connections 2024-09-17T05:36:35.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 --2- 172.21.15.44:0/1223278024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780b4e80 0x7f79780b5290 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 --2- 172.21.15.44:0/1223278024 >> v2:172.21.15.44:3300/0 conn(0x7f79780711c0 0x7f79780715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 -- 172.21.15.44:0/1223278024 >> 172.21.15.44:0/1223278024 conn(0x7f797806fb90 msgr2=0x7f797806ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0711c0 0x7f812c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c0b3f40 0x7f812c14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 0x7f812c2058e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f812c06ce40 con 0x7f812c0b3f40 2024-09-17T05:36:35.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 -- 172.21.15.44:0/1223278024 shutdown_connections 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f812c15f630 con 0x7f812c155800 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f812c06cfc0 con 0x7f812c0711c0 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8131600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0711c0 0x7f812c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8131600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0711c0 0x7f812c153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57296/0 (socket says 172.21.15.44:57296) 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8131600640 1 -- 172.21.15.44:0/2485633118 learned_addr learned my addr 172.21.15.44:0/2485633118 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132000640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 0x7f812c2058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8130c00640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c0b3f40 0x7f812c14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132000640 1 -- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0711c0 msgr2=0x7f812c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132000640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0711c0 0x7f812c153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132000640 1 -- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c0b3f40 msgr2=0x7f812c14dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132000640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c0b3f40 0x7f812c14dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8132000640 1 -- 172.21.15.44:0/2485633118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c14eb10 con 0x7f812c155800 2024-09-17T05:36:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f8130c00640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c0b3f40 0x7f812c14dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7fb467200640 1 Processor -- start 2024-09-17T05:36:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f8132000640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 0x7f812c2058e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f812400be20 tx=0x7f812400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124019070 con 0x7f812c155800 2024-09-17T05:36:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8124014440 con 0x7f812c155800 2024-09-17T05:36:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124014890 con 0x7f812c155800 2024-09-17T05:36:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f8132a00640 1 -- 172.21.15.44:0/2485633118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c14edf0 con 0x7f812c155800 2024-09-17T05:36:35.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f8132a00640 1 -- 172.21.15.44:0/2485633118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c14f3b0 con 0x7f812c155800 2024-09-17T05:36:35.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.938+0000 7f7977200640 1 -- 172.21.15.44:0/1223278024 wait complete. 2024-09-17T05:36:35.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f7977200640 1 Processor -- start 2024-09-17T05:36:35.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7fb467200640 1 -- start start 2024-09-17T05:36:35.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7fb467200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 0x7fb4681451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7fb467200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb468155890 0x7fb4680ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7fb467200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46815f180 0x7fb4680702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7f7977200640 1 -- start start 2024-09-17T05:36:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.942+0000 7fb467200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb46816c070 con 0x7fb46815f180 2024-09-17T05:36:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb467200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb46816bef0 con 0x7fb468155890 2024-09-17T05:36:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb467200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb46816c1f0 con 0x7fb4680af700 2024-09-17T05:36:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 0x7fb4681451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 -- 172.21.15.44:0/2540088844 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91940ae870 msgr2=0x7f9194073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 --2- 172.21.15.44:0/2540088844 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91940ae870 0x7f9194073f60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9184009900 tx=0x7f918401c8f0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 -- 172.21.15.44:0/2540088844 shutdown_connections 2024-09-17T05:36:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 --2- 172.21.15.44:0/2540088844 >> v2:172.21.15.86:3300/0 conn(0x7f91940cc100 0x7f91940cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 --2- 172.21.15.44:0/2540088844 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91940ae870 0x7f9194073f60 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9184009900 tx=0x7f918401c8f0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 -- 172.21.15.44:0/2540088844 >> 172.21.15.44:0/2540088844 conn(0x7f91940d1120 msgr2=0x7f91940d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 0x7fb4681451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57316/0 (socket says 172.21.15.44:57316) 2024-09-17T05:36:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465e00640 1 -- 172.21.15.44:0/1677653977 learned_addr learned my addr 172.21.15.44:0/1677653977 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465400640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb468155890 0x7fb4680ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb466800640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46815f180 0x7fb4680702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465400640 1 -- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 msgr2=0x7fb4681451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465400640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4680af700 0x7fb4681451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465400640 1 -- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46815f180 msgr2=0x7fb4680702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465400640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46815f180 0x7fb4680702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465400640 1 -- 172.21.15.44:0/1677653977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4680d10f0 con 0x7fb468155890 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb465400640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb468155890 0x7fb4680ce1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb458000f70 tx=0x7fb45800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458017070 con 0x7fb468155890 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb458003600 con 0x7fb468155890 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458003a50 con 0x7fb468155890 2024-09-17T05:36:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4681456f0 con 0x7fb468155890 2024-09-17T05:36:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 -- 172.21.15.44:0/2540088844 shutdown_connections 2024-09-17T05:36:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f919b000640 1 -- 172.21.15.44:0/2540088844 wait complete. 2024-09-17T05:36:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2681110712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 msgr2=0x7fc288003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4680d0b30 con 0x7fb468155890 2024-09-17T05:36:35.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f7977200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79780711c0 0x7f7978205530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fc2a7c00640 1 --2- 172.21.15.44:0/2681110712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 0x7fc288003f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc294006ea0 tx=0x7fc29401cd60 comp rx=0 tx=0).stop 2024-09-17T05:36:35.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2681110712 shutdown_connections 2024-09-17T05:36:35.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fc2a7c00640 1 --2- 172.21.15.44:0/2681110712 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 0x7fc288003f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f7977200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79780b4e80 0x7f7978209400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f7977200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780ceaa0 0x7f7978157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2681110712 >> 172.21.15.44:0/2681110712 conn(0x7fc2a00ccaa0 msgr2=0x7fc2a00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8100001040 con 0x7f812c155800 2024-09-17T05:36:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.946+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f812401c070 con 0x7f812c155800 2024-09-17T05:36:35.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7977200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f797806db20 con 0x7f79780711c0 2024-09-17T05:36:35.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780ceaa0 0x7f7978157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780ceaa0 0x7f7978157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:45808/0 (socket says 172.21.15.44:45808) 2024-09-17T05:36:35.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 -- 172.21.15.44:0/3609054542 learned_addr learned my addr 172.21.15.44:0/3609054542 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb4680ccaa0 con 0x7fb468155890 2024-09-17T05:36:35.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7975e00640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79780711c0 0x7f7978205530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2681110712 shutdown_connections 2024-09-17T05:36:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f797806d9a0 con 0x7f79780ceaa0 2024-09-17T05:36:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f797806dca0 con 0x7f79780b4e80 2024-09-17T05:36:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8129600640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073250 0x7f810c075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f812405adf0 con 0x7f812c155800 2024-09-17T05:36:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 -- 172.21.15.44:0/2624498931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 msgr2=0x7f81d80dfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 --2- 172.21.15.44:0/2624498931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 0x7f81d80dfe70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81d80e4a80 tx=0x7f81e00986e0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7975400640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79780b4e80 0x7f7978209400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8131600640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073250 0x7f810c075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2681110712 wait complete. 2024-09-17T05:36:35.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8129600640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7f810c07d670 0x7f810c07fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f810c080230 con 0x7f810c07d670 2024-09-17T05:36:35.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f812405b370 con 0x7f812c155800 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 -- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79780b4e80 msgr2=0x7f7978209400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f79780b4e80 0x7f7978209400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 -- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79780711c0 msgr2=0x7f7978205530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79780711c0 0x7f7978205530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7978205ea0 con 0x7f79780ceaa0 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 -- 172.21.15.44:0/2624498931 shutdown_connections 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 --2- 172.21.15.44:0/2624498931 >> v2:172.21.15.44:3300/0 conn(0x7f81d8034e30 0x7f81d8035240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 --2- 172.21.15.44:0/2624498931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 0x7f81d80dfe70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 -- 172.21.15.44:0/2624498931 >> 172.21.15.44:0/2624498931 conn(0x7f81d801d9b0 msgr2=0x7f81d8039670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8130c00640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7f810c07d670 0x7f810c07fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f8131600640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073250 0x7f810c075760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f812001c550 tx=0x7f812001af60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb45801a070 con 0x7fb468155890 2024-09-17T05:36:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7976800640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780ceaa0 0x7f7978157720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f797001c580 tx=0x7f79700a5750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79700bc070 con 0x7f79780ceaa0 2024-09-17T05:36:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79700ad730 con 0x7f79780ceaa0 2024-09-17T05:36:35.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7978206180 con 0x7f79780ceaa0 2024-09-17T05:36:35.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 -- 172.21.15.44:0/2624498931 shutdown_connections 2024-09-17T05:36:35.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f81e7e00640 1 -- 172.21.15.44:0/2624498931 wait complete. 2024-09-17T05:36:35.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7978159a60 con 0x7f79780ceaa0 2024-09-17T05:36:35.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f89e7000640 1 -- 172.21.15.44:0/1954486738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89e00ce130 msgr2=0x7f89e00ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f89e7000640 1 --2- 172.21.15.44:0/1954486738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89e00ce130 0x7f89e00ce540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89e0072de0 tx=0x7f89d801cda0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7f919b000640 1 Processor -- start 2024-09-17T05:36:35.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fde69000640 1 -- 172.21.15.44:0/1245147039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640ceaa0 msgr2=0x7fde640d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fde69000640 1 --2- 172.21.15.44:0/1245147039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640ceaa0 0x7fde640d0240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde50009930 tx=0x7fde5001c890 comp rx=0 tx=0).stop 2024-09-17T05:36:35.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fde69000640 1 -- 172.21.15.44:0/1245147039 shutdown_connections 2024-09-17T05:36:35.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fde69000640 1 --2- 172.21.15.44:0/1245147039 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640ceaa0 0x7fde640d0240 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fde50009930 tx=0x7fde5001c890 comp rx=0 tx=0).stop 2024-09-17T05:36:35.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fde69000640 1 -- 172.21.15.44:0/1245147039 >> 172.21.15.44:0/1245147039 conn(0x7fde6406fb90 msgr2=0x7fde6406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f8130c00640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7f810c07d670 0x7f810c07fb60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f919b000640 1 -- start start 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.950+0000 7fb45e000640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb444073250 0x7fb444075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb4580937a0 con 0x7fb468155890 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb465e00640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb444073250 0x7fb444075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb45e000640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7fb44407ca10 0x7fb44407eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb44407f570 con 0x7fb44407ca10 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb45809a050 con 0x7fb468155890 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb466800640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7fb44407ca10 0x7fb44407eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f89e7000640 1 -- 172.21.15.44:0/1954486738 shutdown_connections 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f89e7000640 1 --2- 172.21.15.44:0/1954486738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89e00ce130 0x7f89e00ce540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f89e7000640 1 --2- 172.21.15.44:0/1954486738 >> v2:172.21.15.44:3300/0 conn(0x7f89e006e390 0x7f89e00cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f89e7000640 1 --2- 172.21.15.44:0/1954486738 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89e00b5880 0x7f89e006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f89e7000640 1 -- 172.21.15.44:0/1954486738 >> 172.21.15.44:0/1954486738 conn(0x7f89e00ccaa0 msgr2=0x7f89e00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f89e7000640 1 -- 172.21.15.44:0/1954486738 shutdown_connections 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f89e7000640 1 -- 172.21.15.44:0/1954486738 wait complete. 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79700b2040 con 0x7f79780ceaa0 2024-09-17T05:36:35.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79780715d0 con 0x7f79780ceaa0 2024-09-17T05:36:35.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fde69000640 1 -- 172.21.15.44:0/1245147039 shutdown_connections 2024-09-17T05:36:35.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f810c080230 con 0x7f810c07d670 2024-09-17T05:36:35.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fde69000640 1 -- 172.21.15.44:0/1245147039 wait complete. 2024-09-17T05:36:35.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb465e00640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb444073250 0x7fb444075760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4500099b0 tx=0x7fb450009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fb466800640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7fb44407ca10 0x7fb44407eea0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f919b000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91940aec80 0x7f91940c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fc2a7c00640 1 Processor -- start 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f81e7e00640 1 Processor -- start 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f81e7e00640 1 -- start start 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81d8005c60 0x7f81d80d7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 0x7f81d80e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81d8034e30 0x7f81d80ea420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f919b000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91940c9f20 0x7f919414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f919b000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9194150200 0x7f9194157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f919b000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f919416c5e0 con 0x7f91940c9f20 2024-09-17T05:36:35.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f919b000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f919416c460 con 0x7f91940aec80 2024-09-17T05:36:35.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f919b000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f919416c760 con 0x7f9194150200 2024-09-17T05:36:35.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f9199000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9194150200 0x7f9194157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f9199000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9194150200 0x7f9194157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57344/0 (socket says 172.21.15.44:57344) 2024-09-17T05:36:35.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7f9199000640 1 -- 172.21.15.44:0/2379011438 learned_addr learned my addr 172.21.15.44:0/2379011438 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.954+0000 7fc2a7c00640 1 -- start start 2024-09-17T05:36:35.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80517c0 con 0x7f81d8005c60 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8051640 con 0x7f81d8034390 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e7e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f81d8051940 con 0x7f81d8034e30 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81d8005c60 0x7f81d80d7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81d8005c60 0x7f81d80d7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49164/0 (socket says 172.21.15.44:49164) 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e4a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 0x7f81d80e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e5400640 1 -- 172.21.15.44:0/3967614841 learned_addr learned my addr 172.21.15.44:0/3967614841 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e5e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81d8034e30 0x7f81d80ea420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb44407f570 con 0x7fb44407ca10 2024-09-17T05:36:35.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f79700bf070 con 0x7f79780ceaa0 2024-09-17T05:36:35.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e4a00640 1 -- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81d8034e30 msgr2=0x7f81d80ea420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e4a00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81d8034e30 0x7f81d80ea420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e4a00640 1 -- 172.21.15.44:0/3967614841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81d8005c60 msgr2=0x7f81d80d7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e4a00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81d8005c60 0x7f81d80d7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e4a00640 1 -- 172.21.15.44:0/3967614841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d80dc5d0 con 0x7f81d8034390 2024-09-17T05:36:35.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e5400640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81d8005c60 0x7f81d80d7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:35.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f89e7000640 1 Processor -- start 2024-09-17T05:36:35.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e4a00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 0x7f81d80e9ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00b410 tx=0x7f81cc00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f796e000640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7958073200 0x7f7958075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f797012e2f0 con 0x7f79780ceaa0 2024-09-17T05:36:35.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc015020 con 0x7f81d8034390 2024-09-17T05:36:35.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81cc011920 con 0x7f81d8034390 2024-09-17T05:36:35.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f89e7000640 1 -- start start 2024-09-17T05:36:35.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f9199000640 1 -- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91940aec80 msgr2=0x7f91940c8320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:36:35.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f9199000640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91940aec80 0x7f91940c8320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f9199000640 1 -- 172.21.15.44:0/2379011438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91940c9f20 msgr2=0x7f919414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f9199000640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91940c9f20 0x7f919414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f9199000640 1 -- 172.21.15.44:0/2379011438 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91941f96f0 con 0x7f9194150200 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f9199000640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9194150200 0x7f9194157e50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f918c00b540 tx=0x7f918c00ba00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c004b30 con 0x7f9194150200 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f918c004cd0 con 0x7f9194150200 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c00a8c0 con 0x7f9194150200 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91941f99d0 con 0x7f9194150200 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f7975e00640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7958073200 0x7f7958075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f796e000640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f795807c9d0 0x7f795807ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7970004860 con 0x7f795807c9d0 2024-09-17T05:36:35.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f797012e6e0 con 0x7f79780ceaa0 2024-09-17T05:36:35.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91941f9f90 con 0x7f9194150200 2024-09-17T05:36:35.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc011d70 con 0x7f81d8034390 2024-09-17T05:36:35.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f7975400640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f795807c9d0 0x7f795807ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d8050620 con 0x7f81d8034390 2024-09-17T05:36:35.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f7975e00640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7958073200 0x7f7958075710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7968007fd0 tx=0x7f7968009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.958+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d80508c0 con 0x7f81d8034390 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9194150610 con 0x7f9194150200 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 0x7fc2a009ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2a00b2e70 0x7fc2a01e9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a01f5020 0x7fc2a009b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0070f40 con 0x7fc2a00b2e70 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a015ac60 con 0x7fc2a01f5020 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a00710c0 con 0x7fc288003ab0 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc29fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2a00b2e70 0x7fc2a01e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 0x7fc2a009ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc29fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2a00b2e70 0x7fc2a01e9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49168/0 (socket says 172.21.15.44:49168) 2024-09-17T05:36:35.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 0x7fc2a009ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57372/0 (socket says 172.21.15.44:57372) 2024-09-17T05:36:35.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc29fe00640 1 -- 172.21.15.44:0/2248920270 learned_addr learned my addr 172.21.15.44:0/2248920270 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81d8051f20 con 0x7f81d8034390 2024-09-17T05:36:35.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5c00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a01f5020 0x7fc2a009b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 -- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a01f5020 msgr2=0x7fc2a009b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a01f5020 0x7fc2a009b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 -- 172.21.15.44:0/2248920270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2a00b2e70 msgr2=0x7fc2a01e9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2a00b2e70 0x7fc2a01e9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 -- 172.21.15.44:0/2248920270 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a01e9e80 con 0x7fc288003ab0 2024-09-17T05:36:35.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fde69000640 1 Processor -- start 2024-09-17T05:36:35.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fde69000640 1 -- start start 2024-09-17T05:36:35.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc29fe00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2a00b2e70 0x7fc2a01e9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:35.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a5200640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 0x7fc2a009ad30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c600 tx=0x7fc294001c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294001630 con 0x7fc288003ab0 2024-09-17T05:36:35.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2940060d0 con 0x7fc288003ab0 2024-09-17T05:36:35.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294003600 con 0x7fc288003ab0 2024-09-17T05:36:35.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89e7000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89e006e390 0x7f89e01fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f7975400640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f795807c9d0 0x7f795807ee60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a00b5a40 con 0x7fc288003ab0 2024-09-17T05:36:35.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a01e9140 con 0x7fc288003ab0 2024-09-17T05:36:35.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89e7000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89e00b5880 0x7f89e01545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89e7000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89e00ce130 0x7f89e015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89e7000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0070c70 con 0x7f89e00b5880 2024-09-17T05:36:35.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89e7000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f89e0070af0 con 0x7f89e00ce130 2024-09-17T05:36:35.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89e7000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f89e0070df0 con 0x7f89e006e390 2024-09-17T05:36:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89e006e390 0x7f89e01fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89e00b5880 0x7f89e01545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89dfe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89e006e390 0x7f89e01fadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57380/0 (socket says 172.21.15.44:57380) 2024-09-17T05:36:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89dfe00640 1 -- 172.21.15.44:0/173411346 learned_addr learned my addr 172.21.15.44:0/173411346 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.962+0000 7f89e5000640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89e00ce130 0x7f89e015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f81cc018020 con 0x7f81d8034390 2024-09-17T05:36:35.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde69000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640711c0 0x7fde6414d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde69000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde640b4e80 0x7fde641fa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f89df400640 1 -- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89e006e390 msgr2=0x7f89e01fadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f89df400640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89e006e390 0x7f89e01fadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f89df400640 1 -- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89e00ce130 msgr2=0x7f89e015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f89df400640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89e00ce130 0x7f89e015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f89df400640 1 -- 172.21.15.44:0/173411346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e00c5b70 con 0x7f89e00b5880 2024-09-17T05:36:35.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde63400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640711c0 0x7fde6414d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde69000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6415a7a0 0x7fde640b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde69000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde64169a40 con 0x7fde640b4e80 2024-09-17T05:36:35.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7970004860 con 0x7f795807c9d0 2024-09-17T05:36:35.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde69000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fde641698c0 con 0x7fde6415a7a0 2024-09-17T05:36:35.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde69000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fde64169bc0 con 0x7fde640711c0 2024-09-17T05:36:35.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde63400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640711c0 0x7fde6414d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57386/0 (socket says 172.21.15.44:57386) 2024-09-17T05:36:35.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde63400640 1 -- 172.21.15.44:0/2747776027 learned_addr learned my addr 172.21.15.44:0/2747776027 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:35.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81dd600640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f81c00732d0 0x7f81c00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f81cc094a80 con 0x7f81d8034390 2024-09-17T05:36:35.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde63e00640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6415a7a0 0x7fde640b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81e5400640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f81c00732d0 0x7f81c00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81dd600640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7f81c007ca90 0x7f81c007ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81c007f5f0 con 0x7f81c007ca90 2024-09-17T05:36:35.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f81cc094e70 con 0x7f81d8034390 2024-09-17T05:36:35.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f918c00aa60 con 0x7f9194150200 2024-09-17T05:36:35.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f918be00640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9174073200 0x7f9174075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f89dfe00640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f89e006e390 0x7f89e01fadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:35.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fde62a00640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde640b4e80 0x7fde641fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81e5e00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7f81c007ca90 0x7f81c007ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f89df400640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89e00b5880 0x7f89e01545a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f89e0072900 tx=0x7f89cc00eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc2a00b5f60 con 0x7fc288003ab0 2024-09-17T05:36:35.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc2940037a0 con 0x7fc288003ab0 2024-09-17T05:36:35.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.966+0000 7f81e5400640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f81c00732d0 0x7f81c00757e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81e0075700 tx=0x7f81e0096f70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f81e5e00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7f81c007ca90 0x7f81c007ef20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00ca10 con 0x7f89e00b5880 2024-09-17T05:36:35.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f918c09cd10 con 0x7f9194150200 2024-09-17T05:36:35.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f9193e00640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9174073200 0x7f9174075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc29cc00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc280073200 0x7fc280075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde63400640 1 -- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6415a7a0 msgr2=0x7fde640b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde63400640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6415a7a0 0x7fde640b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde63400640 1 -- 172.21.15.44:0/2747776027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde640b4e80 msgr2=0x7fde641fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde63400640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde640b4e80 0x7fde641fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde63400640 1 -- 172.21.15.44:0/2747776027 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde640008e0 con 0x7fde640711c0 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde63e00640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6415a7a0 0x7fde640b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde63400640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640711c0 0x7fde6414d560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde5001af40 tx=0x7fde50005700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde500bb070 con 0x7fde640711c0 2024-09-17T05:36:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde50004340 con 0x7fde640711c0 2024-09-17T05:36:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde500b2040 con 0x7fde640711c0 2024-09-17T05:36:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f918be00640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7f917407c940 0x7f917407edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f917407f4a0 con 0x7f917407c940 2024-09-17T05:36:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f918c0a2320 con 0x7f9194150200 2024-09-17T05:36:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc29fe00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc280073200 0x7fc280075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89cc00cca0 con 0x7f89e00b5880 2024-09-17T05:36:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc010690 con 0x7f89e00b5880 2024-09-17T05:36:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6414daa0 con 0x7fde640711c0 2024-09-17T05:36:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6415aef0 con 0x7fde640711c0 2024-09-17T05:36:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc2940b4020 con 0x7fc288003ab0 2024-09-17T05:36:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde640d0240 con 0x7fde640711c0 2024-09-17T05:36:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e009cf40 con 0x7f89e00b5880 2024-09-17T05:36:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e009d500 con 0x7f89e00b5880 2024-09-17T05:36:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc29cc00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fc28007c9c0 0x7fc28007ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f9193e00640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9174073200 0x7f9174075710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91840af000 tx=0x7f918401b130 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f9193400640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7f917407c940 0x7f917407edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc29fe00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc280073200 0x7fc280075710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2a01ea310 tx=0x7fc28c006b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89e006de50 con 0x7f89e00b5880 2024-09-17T05:36:35.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc2a5c00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fc28007c9c0 0x7fc28007ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc28007f520 con 0x7fc28007c9c0 2024-09-17T05:36:35.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc2941305d0 con 0x7fc288003ab0 2024-09-17T05:36:35.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.974+0000 7f9193400640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7f917407c940 0x7f917407edd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.970+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81c007f5f0 con 0x7f81c007ca90 2024-09-17T05:36:35.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.974+0000 7fc2a5c00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fc28007c9c0 0x7fc28007ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.974+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f917407f4a0 con 0x7f917407c940 2024-09-17T05:36:35.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.974+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fde50003860 con 0x7fde640711c0 2024-09-17T05:36:35.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fde5b400640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fde5012e5d0 con 0x7fde640711c0 2024-09-17T05:36:35.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fde5b400640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fde4407c940 0x7fde4407edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde500a58f0 con 0x7fde4407c940 2024-09-17T05:36:35.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fde5012e980 con 0x7fde640711c0 2024-09-17T05:36:35.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc28007f520 con 0x7fc28007c9c0 2024-09-17T05:36:35.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fde62a00640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7fde63e00640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fde4407c940 0x7fde4407edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89cc010830 con 0x7f89e00b5880 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.978+0000 7f89d7e00640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89c0073200 0x7f89c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f89cc095880 con 0x7f89e00b5880 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89d7e00640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7f89c007c940 0x7f89c007edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89dfe00640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89c0073200 0x7f89c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89c007f4a0 con 0x7f89c007c940 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89cc095d10 con 0x7f89e00b5880 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89e5000640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7f89c007c940 0x7f89c007edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89dfe00640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89c0073200 0x7f89c0075710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89d00058d0 tx=0x7f89d000b410 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7fde62a00640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde54000f70 tx=0x7fde54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7fde63e00640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fde4407c940 0x7fde4407edd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89e5000640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7f89c007c940 0x7f89c007edd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde500a58f0 con 0x7fde4407c940 2024-09-17T05:36:36.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.982+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f89c007f4a0 con 0x7f89c007c940 2024-09-17T05:36:36.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.986+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8100002de0 con 0x7f810c07d670 2024-09-17T05:36:36.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.986+0000 7f8129600640 1 -- 172.21.15.44:0/2485633118 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8100002de0 con 0x7f810c07d670 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7f810c07d670 msgr2=0x7f810c07fb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7f810c07d670 0x7f810c07fb60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073250 msgr2=0x7f810c075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f810c073250 0x7f810c075760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f812001c550 tx=0x7f812001af60 comp rx=0 tx=0).stop 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 msgr2=0x7f812c2058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 --2- 172.21.15.44:0/2485633118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c155800 0x7f812c2058e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f812400be20 tx=0x7f812400bf10 comp rx=0 tx=0).stop 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f8132000640 1 -- 172.21.15.44:0/2485633118 reap_dead start 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 shutdown_connections 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 >> 172.21.15.44:0/2485633118 conn(0x7f812c0b2c40 msgr2=0x7f812c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 shutdown_connections 2024-09-17T05:36:36.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7f811ea00640 1 -- 172.21.15.44:0/2485633118 wait complete. 2024-09-17T05:36:36.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4680b1770 con 0x7fb44407ca10 2024-09-17T05:36:36.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7fb45e000640 1 -- 172.21.15.44:0/1677653977 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4680b1770 con 0x7fb44407ca10 2024-09-17T05:36:36.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7fb44407ca10 msgr2=0x7fb44407eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.990+0000 7fb467200640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7fb44407ca10 0x7fb44407eea0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb444073250 msgr2=0x7fb444075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb444073250 0x7fb444075760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4500099b0 tx=0x7fb450009190 comp rx=0 tx=0).stop 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb468155890 msgr2=0x7fb4680ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 --2- 172.21.15.44:0/1677653977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb468155890 0x7fb4680ce1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb458000f70 tx=0x7fb45800c820 comp rx=0 tx=0).stop 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb466800640 1 -- 172.21.15.44:0/1677653977 reap_dead start 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 shutdown_connections 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 >> 172.21.15.44:0/1677653977 conn(0x7fb4680732e0 msgr2=0x7fb468074da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 shutdown_connections 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7fb467200640 1 -- 172.21.15.44:0/1677653977 wait complete. 2024-09-17T05:36:36.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f81d80e8c70 con 0x7f81c007ca90 2024-09-17T05:36:36.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7978205c50 con 0x7f795807c9d0 2024-09-17T05:36:36.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.994+0000 7f81dd600640 1 -- 172.21.15.44:0/3967614841 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f81d80e8c70 con 0x7f81c007ca90 2024-09-17T05:36:36.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7f81c007ca90 msgr2=0x7f81c007ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7f81c007ca90 0x7f81c007ef20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f81c00732d0 msgr2=0x7f81c00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f81c00732d0 0x7f81c00757e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f81e0075700 tx=0x7f81e0096f70 comp rx=0 tx=0).stop 2024-09-17T05:36:36.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 msgr2=0x7f81d80e9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 --2- 172.21.15.44:0/3967614841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81d8034390 0x7f81d80e9ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00b410 tx=0x7f81cc00b810 comp rx=0 tx=0).stop 2024-09-17T05:36:36.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e5e00640 1 -- 172.21.15.44:0/3967614841 reap_dead start 2024-09-17T05:36:36.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 shutdown_connections 2024-09-17T05:36:36.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 >> 172.21.15.44:0/3967614841 conn(0x7f81d801d9b0 msgr2=0x7f81d80da2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 shutdown_connections 2024-09-17T05:36:36.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f81e7e00640 1 -- 172.21.15.44:0/3967614841 wait complete. 2024-09-17T05:36:36.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:35.998+0000 7f796e000640 1 -- 172.21.15.44:0/3609054542 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7978205c50 con 0x7f795807c9d0 2024-09-17T05:36:36.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f795807c9d0 msgr2=0x7f795807ee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f795807c9d0 0x7f795807ee60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7958073200 msgr2=0x7f7958075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7958073200 0x7f7958075710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7968007fd0 tx=0x7f7968009040 comp rx=0 tx=0).stop 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780ceaa0 msgr2=0x7f7978157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 --2- 172.21.15.44:0/3609054542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79780ceaa0 0x7f7978157720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f797001c580 tx=0x7f79700a5750 comp rx=0 tx=0).stop 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7976800640 1 -- 172.21.15.44:0/3609054542 reap_dead start 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 shutdown_connections 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 >> 172.21.15.44:0/3609054542 conn(0x7f797806fb90 msgr2=0x7f7978154890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 shutdown_connections 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f7977200640 1 -- 172.21.15.44:0/3609054542 wait complete. 2024-09-17T05:36:36.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91941f94a0 con 0x7f917407c940 2024-09-17T05:36:36.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde64155250 con 0x7fde4407c940 2024-09-17T05:36:36.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.006+0000 7fde5b400640 1 -- 172.21.15.44:0/2747776027 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fde64155250 con 0x7fde4407c940 2024-09-17T05:36:36.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f918be00640 1 -- 172.21.15.44:0/2379011438 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f91941f94a0 con 0x7f917407c940 2024-09-17T05:36:36.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc2a006df70 con 0x7fc28007c9c0 2024-09-17T05:36:36.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fde4407c940 msgr2=0x7fde4407edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fde4407c940 0x7fde4407edd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc29cc00640 1 -- 172.21.15.44:0/2248920270 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc2a006df70 con 0x7fc28007c9c0 2024-09-17T05:36:36.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 msgr2=0x7fde44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde54000f70 tx=0x7fde54009040 comp rx=0 tx=0).stop 2024-09-17T05:36:36.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640711c0 msgr2=0x7fde6414d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 --2- 172.21.15.44:0/2747776027 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde640711c0 0x7fde6414d560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde5001af40 tx=0x7fde50005700 comp rx=0 tx=0).stop 2024-09-17T05:36:36.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7f917407c940 msgr2=0x7f917407edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7f917407c940 0x7f917407edd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f89e00c5920 con 0x7f89c007c940 2024-09-17T05:36:36.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde63e00640 1 -- 172.21.15.44:0/2747776027 reap_dead start 2024-09-17T05:36:36.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 shutdown_connections 2024-09-17T05:36:36.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 >> 172.21.15.44:0/2747776027 conn(0x7fde6406fb90 msgr2=0x7fde641544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9174073200 msgr2=0x7f9174075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9174073200 0x7f9174075710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91840af000 tx=0x7f918401b130 comp rx=0 tx=0).stop 2024-09-17T05:36:36.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9194150200 msgr2=0x7f9194157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 --2- 172.21.15.44:0/2379011438 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9194150200 0x7f9194157e50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f918c00b540 tx=0x7f918c00ba00 comp rx=0 tx=0).stop 2024-09-17T05:36:36.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 shutdown_connections 2024-09-17T05:36:36.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f9199000640 1 -- 172.21.15.44:0/2379011438 reap_dead start 2024-09-17T05:36:36.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 shutdown_connections 2024-09-17T05:36:36.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 >> 172.21.15.44:0/2379011438 conn(0x7f91940d1120 msgr2=0x7f919406d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fde69000640 1 -- 172.21.15.44:0/2747776027 wait complete. 2024-09-17T05:36:36.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 shutdown_connections 2024-09-17T05:36:36.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f919b000640 1 -- 172.21.15.44:0/2379011438 wait complete. 2024-09-17T05:36:36.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f89d7e00640 1 -- 172.21.15.44:0/173411346 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f89e00c5920 con 0x7f89c007c940 2024-09-17T05:36:36.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fc28007c9c0 msgr2=0x7fc28007ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fc28007c9c0 0x7fc28007ee50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc280073200 msgr2=0x7fc280075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc280073200 0x7fc280075710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2a01ea310 tx=0x7fc28c006b80 comp rx=0 tx=0).stop 2024-09-17T05:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 msgr2=0x7fc2a009ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 --2- 172.21.15.44:0/2248920270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc288003ab0 0x7fc2a009ad30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c600 tx=0x7fc294001c70 comp rx=0 tx=0).stop 2024-09-17T05:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a5c00640 1 -- 172.21.15.44:0/2248920270 reap_dead start 2024-09-17T05:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 shutdown_connections 2024-09-17T05:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 >> 172.21.15.44:0/2248920270 conn(0x7fc2a00ccaa0 msgr2=0x7fc2a00b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 shutdown_connections 2024-09-17T05:36:36.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7fc2a7c00640 1 -- 172.21.15.44:0/2248920270 wait complete. 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7f89c007c940 msgr2=0x7f89c007edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.010+0000 7f89e7000640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7f89c007c940 0x7f89c007edd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89c0073200 msgr2=0x7f89c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89c0073200 0x7f89c0075710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f89d00058d0 tx=0x7f89d000b410 comp rx=0 tx=0).stop 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89e00b5880 msgr2=0x7f89e01545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 --2- 172.21.15.44:0/173411346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f89e00b5880 0x7f89e01545a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f89e0072900 tx=0x7f89cc00eac0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e5000640 1 -- 172.21.15.44:0/173411346 reap_dead start 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 shutdown_connections 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 >> 172.21.15.44:0/173411346 conn(0x7f89e00ccaa0 msgr2=0x7f89e015e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 shutdown_connections 2024-09-17T05:36:36.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.014+0000 7f89e7000640 1 -- 172.21.15.44:0/173411346 wait complete. 2024-09-17T05:36:36.031 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-09-17T05:36:36.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T05:36:36.032 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-09-17T05:36:36.033 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T05:36:36.043 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-09-17T05:36:36.043 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T05:36:36.049 INFO:teuthology.orchestra.run.smithi044.stdout:64424509448 2024-09-17T05:36:36.050 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T05:36:36.055 INFO:teuthology.orchestra.run.smithi044.stdout:64424509447 2024-09-17T05:36:36.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T05:36:36.057 INFO:teuthology.orchestra.run.smithi044.stdout:64424509447 2024-09-17T05:36:36.057 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T05:36:36.060 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2024-09-17T05:36:36.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T05:36:36.063 INFO:teuthology.orchestra.run.smithi044.stdout:64424509448 2024-09-17T05:36:36.063 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T05:36:36.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 -- 172.21.15.44:0/1845995965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c0343c0 msgr2=0x7f956c0dfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 --2- 172.21.15.44:0/1845995965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c0343c0 0x7f956c0dfea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f956c0e4ab0 tx=0x7f956001c6e0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 -- 172.21.15.44:0/1845995965 shutdown_connections 2024-09-17T05:36:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 --2- 172.21.15.44:0/1845995965 >> v2:172.21.15.44:3300/0 conn(0x7f956c034e60 0x7f956c035270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 --2- 172.21.15.44:0/1845995965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c0343c0 0x7f956c0dfea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 -- 172.21.15.44:0/1845995965 >> 172.21.15.44:0/1845995965 conn(0x7f956c01d9e0 msgr2=0x7f956c0396a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 -- 172.21.15.44:0/1845995965 shutdown_connections 2024-09-17T05:36:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.326+0000 7f957a600640 1 -- 172.21.15.44:0/1845995965 wait complete. 2024-09-17T05:36:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 -- 172.21.15.44:0/1436129872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 msgr2=0x7f468c0d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 --2- 172.21.15.44:0/1436129872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 0x7f468c0d02d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f468c06f6f0 tx=0x7f467c01c640 comp rx=0 tx=0).stop 2024-09-17T05:36:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 -- 172.21.15.44:0/1436129872 shutdown_connections 2024-09-17T05:36:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 --2- 172.21.15.44:0/1436129872 >> v2:172.21.15.86:3300/0 conn(0x7f468c159240 0x7f468c162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 --2- 172.21.15.44:0/1436129872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f468c0d0810 0x7f468c158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 --2- 172.21.15.44:0/1436129872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 0x7f468c0d02d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 -- 172.21.15.44:0/1436129872 >> 172.21.15.44:0/1436129872 conn(0x7f468c0b4300 msgr2=0x7f468c0d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 -- 172.21.15.44:0/1436129872 shutdown_connections 2024-09-17T05:36:36.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f4691000640 1 -- 172.21.15.44:0/1436129872 wait complete. 2024-09-17T05:36:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f957a600640 1 Processor -- start 2024-09-17T05:36:36.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.330+0000 7f957a600640 1 -- start start 2024-09-17T05:36:36.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f4691000640 1 Processor -- start 2024-09-17T05:36:36.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f4691000640 1 -- start start 2024-09-17T05:36:36.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f957a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f956c005c90 0x7f956c182a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f957a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f956c0343c0 0x7f956c0d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f957a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c034e60 0x7f956c0db680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f957a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f956c034c70 con 0x7f956c005c90 2024-09-17T05:36:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f957a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f956c054be0 con 0x7f956c034e60 2024-09-17T05:36:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f957a600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f956c0067b0 con 0x7f956c0343c0 2024-09-17T05:36:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f9572a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f956c0343c0 0x7f956c0d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f9572a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f956c0343c0 0x7f956c0d8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57432/0 (socket says 172.21.15.44:57432) 2024-09-17T05:36:36.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f9572a00640 1 -- 172.21.15.44:0/700255269 learned_addr learned my addr 172.21.15.44:0/700255269 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f9573e00640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c034e60 0x7f956c0db680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.334+0000 7f9573400640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f956c005c90 0x7f956c182a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f4691000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 0x7f468c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f4691000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f468c159240 0x7f468c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9572a00640 1 -- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c034e60 msgr2=0x7f956c0db680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9572a00640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c034e60 0x7f956c0db680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9572a00640 1 -- 172.21.15.44:0/700255269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f956c005c90 msgr2=0x7f956c182a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9572a00640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f956c005c90 0x7f956c182a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9572a00640 1 -- 172.21.15.44:0/700255269 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956c182f40 con 0x7f956c0343c0 2024-09-17T05:36:36.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f4691000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f468c15a380 0x7f468c15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f4691000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0b2670 con 0x7f468c06e370 2024-09-17T05:36:36.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f468c159240 0x7f468c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7fa9dae00640 1 -- 172.21.15.44:0/2082396322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40cef20 msgr2=0x7fa9d4072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7fa9dae00640 1 --2- 172.21.15.44:0/2082396322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40cef20 0x7fa9d4072e50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009cb0 tx=0x7fa9c401f600 comp rx=0 tx=0).stop 2024-09-17T05:36:36.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f468c159240 0x7f468c15c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:45924/0 (socket says 172.21.15.44:45924) 2024-09-17T05:36:36.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468aa00640 1 -- 172.21.15.44:0/2914639059 learned_addr learned my addr 172.21.15.44:0/2914639059 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0b24f0 con 0x7f468c159240 2024-09-17T05:36:36.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468be00640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f468c15a380 0x7f468c15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f468c0b27f0 con 0x7f468c15a380 2024-09-17T05:36:36.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7fa9dae00640 1 -- 172.21.15.44:0/2082396322 shutdown_connections 2024-09-17T05:36:36.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7fa9dae00640 1 --2- 172.21.15.44:0/2082396322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40cef20 0x7fa9d4072e50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7fa9dae00640 1 -- 172.21.15.44:0/2082396322 >> 172.21.15.44:0/2082396322 conn(0x7fa9d40ccaa0 msgr2=0x7fa9d40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9572a00640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f956c0343c0 0x7f956c0d8d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f956800a930 tx=0x7f956800adf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468b400640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 0x7f468c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9567400640 1 -- 172.21.15.44:0/700255269 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568007a70 con 0x7f956c0343c0 2024-09-17T05:36:36.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9567400640 1 -- 172.21.15.44:0/700255269 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9568007c10 con 0x7f956c0343c0 2024-09-17T05:36:36.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f9567400640 1 -- 172.21.15.44:0/700255269 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568004020 con 0x7f956c0343c0 2024-09-17T05:36:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468be00640 1 -- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f468c159240 msgr2=0x7f468c15c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468be00640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f468c159240 0x7f468c15c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468be00640 1 -- 172.21.15.44:0/2914639059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 msgr2=0x7f468c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468be00640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 0x7f468c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468be00640 1 -- 172.21.15.44:0/2914639059 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c15acd0 con 0x7f468c15a380 2024-09-17T05:36:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956c0d9c90 con 0x7f956c0343c0 2024-09-17T05:36:36.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f468be00640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f468c15a380 0x7f468c15a790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f468c0d20d0 tx=0x7f4684009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.338+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f956c0d8280 con 0x7f956c0343c0 2024-09-17T05:36:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7fa9dae00640 1 -- 172.21.15.44:0/2082396322 shutdown_connections 2024-09-17T05:36:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7fa9dae00640 1 -- 172.21.15.44:0/2082396322 wait complete. 2024-09-17T05:36:36.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f4683400640 1 -- 172.21.15.44:0/2914639059 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684019070 con 0x7f468c15a380 2024-09-17T05:36:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 -- 172.21.15.44:0/2565370286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 msgr2=0x7f587c151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 --2- 172.21.15.44:0/2565370286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 0x7f587c151070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f587c06f0e0 tx=0x7f587401d830 comp rx=0 tx=0).stop 2024-09-17T05:36:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 -- 172.21.15.44:0/2565370286 shutdown_connections 2024-09-17T05:36:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 --2- 172.21.15.44:0/2565370286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 0x7f587c151070 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 --2- 172.21.15.44:0/2565370286 >> v2:172.21.15.44:3300/0 conn(0x7f587c0700e0 0x7f587c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 -- 172.21.15.44:0/2565370286 >> 172.21.15.44:0/2565370286 conn(0x7f587c06ce40 msgr2=0x7f587c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956c0d9a00 con 0x7f956c0343c0 2024-09-17T05:36:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 -- 172.21.15.44:0/2565370286 shutdown_connections 2024-09-17T05:36:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f5881400640 1 -- 172.21.15.44:0/2565370286 wait complete. 2024-09-17T05:36:36.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f9567400640 1 -- 172.21.15.44:0/700255269 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f956801b020 con 0x7f956c0343c0 2024-09-17T05:36:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f4683400640 1 -- 172.21.15.44:0/2914639059 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4684014440 con 0x7f468c15a380 2024-09-17T05:36:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c2005d0 con 0x7f468c15a380 2024-09-17T05:36:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f4683400640 1 -- 172.21.15.44:0/2914639059 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46840148b0 con 0x7f468c15a380 2024-09-17T05:36:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f9567400640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9554073200 0x7f9554075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.342+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c200d20 con 0x7f468c15a380 2024-09-17T05:36:36.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 Processor -- start 2024-09-17T05:36:36.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f9567400640 1 -- 172.21.15.44:0/700255269 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9568093ed0 con 0x7f956c0343c0 2024-09-17T05:36:36.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 -- start start 2024-09-17T05:36:36.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 -- 172.21.15.44:0/691184374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f006de50 msgr2=0x7f23f006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 --2- 172.21.15.44:0/691184374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f006de50 0x7f23f006e260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009900 tx=0x7f23dc01c690 comp rx=0 tx=0).stop 2024-09-17T05:36:36.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 -- 172.21.15.44:0/691184374 shutdown_connections 2024-09-17T05:36:36.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c0b2d90 con 0x7f468c15a380 2024-09-17T05:36:36.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 --2- 172.21.15.44:0/691184374 >> v2:172.21.15.86:3300/0 conn(0x7f23f00cb470 0x7f23f00cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 --2- 172.21.15.44:0/691184374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f006de50 0x7f23f006e260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 -- 172.21.15.44:0/691184374 >> 172.21.15.44:0/691184374 conn(0x7f23f00ccaa0 msgr2=0x7f23f00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f9573400640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9554073200 0x7f9554075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 -- 172.21.15.44:0/691184374 shutdown_connections 2024-09-17T05:36:36.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f23f6c00640 1 -- 172.21.15.44:0/691184374 wait complete. 2024-09-17T05:36:36.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7fa9dae00640 1 Processor -- start 2024-09-17T05:36:36.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7fa9dae00640 1 -- start start 2024-09-17T05:36:36.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f9573400640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9554073200 0x7f9554075710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95600af000 tx=0x7f956001af20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f587c0cf7f0 0x7f587c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 0x7f587c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c14bd40 0x7f587c06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f587be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f587c0cf7f0 0x7f587c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f587c0b2fd0 con 0x7f587c0cf7f0 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f587c0b2e50 con 0x7f587c15b420 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5881400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f587c0b3150 con 0x7f587c14bd40 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f587be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f587c0cf7f0 0x7f587c153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49238/0 (socket says 172.21.15.44:49238) 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f587be00640 1 -- 172.21.15.44:0/4132016309 learned_addr learned my addr 172.21.15.44:0/4132016309 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5880a00640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c14bd40 0x7f587c06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.346+0000 7f5873400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 0x7f587c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f587be00640 1 -- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c14bd40 msgr2=0x7f587c06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f587be00640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c14bd40 0x7f587c06d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f587be00640 1 -- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 msgr2=0x7f587c14d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f587be00640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 0x7f587c14d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f587be00640 1 -- 172.21.15.44:0/4132016309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c14ccc0 con 0x7f587c0cf7f0 2024-09-17T05:36:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9dae00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9d406de50 0x7fa9d41fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9dae00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40ce080 0x7fa9d40a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9dae00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9d40cef20 0x7fa9d40a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9dae00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d40710c0 con 0x7fa9d40cef20 2024-09-17T05:36:36.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9dae00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d4070f40 con 0x7fa9d406de50 2024-09-17T05:36:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9dae00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d41663a0 con 0x7fa9d40ce080 2024-09-17T05:36:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40ce080 0x7fa9d40a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9d3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9d406de50 0x7fa9d41fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40ce080 0x7fa9d40a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57484/0 (socket says 172.21.15.44:57484) 2024-09-17T05:36:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 -- 172.21.15.44:0/1145306518 learned_addr learned my addr 172.21.15.44:0/1145306518 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f23f6c00640 1 Processor -- start 2024-09-17T05:36:36.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f23f6c00640 1 -- start start 2024-09-17T05:36:36.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 -- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9d406de50 msgr2=0x7fa9d41fd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9d406de50 0x7fa9d41fd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 -- 172.21.15.44:0/1145306518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9d40cef20 msgr2=0x7fa9d40a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9d8e00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9d40cef20 0x7fa9d40a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f587be00640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f587c0cf7f0 0x7f587c153e90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f586c00cbf0 tx=0x7f586c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9d40cef20 0x7fa9d40a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9cb400640 1 -- 172.21.15.44:0/1145306518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d415b6d0 con 0x7fa9d40ce080 2024-09-17T05:36:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7fa9d8e00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9d40cef20 0x7fa9d40a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f5878c00640 1 -- 172.21.15.44:0/4132016309 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c016020 con 0x7f587c0cf7f0 2024-09-17T05:36:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f5878c00640 1 -- 172.21.15.44:0/4132016309 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f586c00aae0 con 0x7f587c0cf7f0 2024-09-17T05:36:36.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f5878c00640 1 -- 172.21.15.44:0/4132016309 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586c012420 con 0x7f587c0cf7f0 2024-09-17T05:36:36.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f9567400640 1 -- 172.21.15.44:0/700255269 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f956805eba0 con 0x7f956c0343c0 2024-09-17T05:36:36.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c14c420 con 0x7f587c0cf7f0 2024-09-17T05:36:36.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.350+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c14c9e0 con 0x7f587c0cf7f0 2024-09-17T05:36:36.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7fa9cb400640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40ce080 0x7fa9d40a0280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c390 tx=0x7fa9bc00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23f6c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23f006de50 0x7f23f009f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f18bb200640 1 -- 172.21.15.44:0/2092761482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1898003a10 msgr2=0x7f1898003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f18bb200640 1 --2- 172.21.15.44:0/2092761482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1898003a10 0x7f1898003e60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18a4007de0 tx=0x7f18a401ce90 comp rx=0 tx=0).stop 2024-09-17T05:36:36.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23f6c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f0072e50 0x7f23f00c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f4683400640 1 -- 172.21.15.44:0/2914639059 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f468401c070 con 0x7f468c15a380 2024-09-17T05:36:36.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587c15aee0 con 0x7f587c0cf7f0 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23f6c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f00cb470 0x7f23f00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23f6c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23f00ce1f0 con 0x7f23f006de50 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23f6c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f23f00ce070 con 0x7f23f0072e50 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23f6c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f23f00ce370 con 0x7f23f00cb470 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23f006de50 0x7f23f009f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23ef400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f0072e50 0x7f23f00c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23f006de50 0x7f23f009f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49254/0 (socket says 172.21.15.44:49254) 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23efe00640 1 -- 172.21.15.44:0/1695595453 learned_addr learned my addr 172.21.15.44:0/1695595453 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23f4c00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f00cb470 0x7f23f00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f4683400640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f466c073250 0x7f466c075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f18bb200640 1 -- 172.21.15.44:0/2092761482 shutdown_connections 2024-09-17T05:36:36.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f18bb200640 1 --2- 172.21.15.44:0/2092761482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1898003a10 0x7f1898003e60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f18bb200640 1 -- 172.21.15.44:0/2092761482 >> 172.21.15.44:0/2092761482 conn(0x7f18b406ff60 msgr2=0x7f18b4070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23ef400640 1 -- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f00cb470 msgr2=0x7f23f00c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23ef400640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f00cb470 0x7f23f00c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23ef400640 1 -- 172.21.15.44:0/1695595453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23f006de50 msgr2=0x7f23f009f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23ef400640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23f006de50 0x7f23f009f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23ef400640 1 -- 172.21.15.44:0/1695595453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f0151ac0 con 0x7f23f0072e50 2024-09-17T05:36:36.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f18bb200640 1 -- 172.21.15.44:0/2092761482 shutdown_connections 2024-09-17T05:36:36.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f18bb200640 1 -- 172.21.15.44:0/2092761482 wait complete. 2024-09-17T05:36:36.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23ef400640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f0072e50 0x7f23f00c2c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23f00741f0 tx=0x7f23dc0a8590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f4683400640 1 -- 172.21.15.44:0/2914639059 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4684094be0 con 0x7f468c15a380 2024-09-17T05:36:36.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f468b400640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f466c073250 0x7f466c075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f468b400640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f466c073250 0x7f466c075760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f467c0af000 tx=0x7f467c01ae80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f7111200640 1 -- 172.21.15.44:0/1349625401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0707e0 msgr2=0x7f710c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f7111200640 1 --2- 172.21.15.44:0/1349625401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0707e0 0x7f710c070bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7104009b40 tx=0x7f710401c9f0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23e7e00640 1 -- 172.21.15.44:0/1695595453 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0042f0 con 0x7f23f0072e50 2024-09-17T05:36:36.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23e7e00640 1 -- 172.21.15.44:0/1695595453 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23dc0044b0 con 0x7f23f0072e50 2024-09-17T05:36:36.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f23e7e00640 1 -- 172.21.15.44:0/1695595453 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc003860 con 0x7f23f0072e50 2024-09-17T05:36:36.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f00c70d0 con 0x7f23f0072e50 2024-09-17T05:36:36.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f00c7690 con 0x7f23f0072e50 2024-09-17T05:36:36.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.354+0000 7f5878c00640 1 -- 172.21.15.44:0/4132016309 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f586c019020 con 0x7f587c0cf7f0 2024-09-17T05:36:36.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f5878c00640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5858073250 0x7f5858075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 -- 172.21.15.44:0/2181907787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c155800 msgr2=0x7f1b7c15f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 --2- 172.21.15.44:0/2181907787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c155800 0x7f1b7c15f7b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009900 tx=0x7f1b6c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f5878c00640 1 -- 172.21.15.44:0/4132016309 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f586c094390 con 0x7f587c0cf7f0 2024-09-17T05:36:36.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f0151810 con 0x7f23f0072e50 2024-09-17T05:36:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f7111200640 1 -- 172.21.15.44:0/1349625401 shutdown_connections 2024-09-17T05:36:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f7111200640 1 --2- 172.21.15.44:0/1349625401 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0707e0 0x7f710c070bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f7111200640 1 -- 172.21.15.44:0/1349625401 >> 172.21.15.44:0/1349625401 conn(0x7f710c0ccaa0 msgr2=0x7f710c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7fa9d0c00640 1 -- 172.21.15.44:0/1145306518 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc017070 con 0x7fa9d40ce080 2024-09-17T05:36:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7fa9d0c00640 1 -- 172.21.15.44:0/1145306518 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9bc0053c0 con 0x7fa9d40ce080 2024-09-17T05:36:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7fa9d0c00640 1 -- 172.21.15.44:0/1145306518 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc003840 con 0x7fa9d40ce080 2024-09-17T05:36:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 -- 172.21.15.44:0/2181907787 shutdown_connections 2024-09-17T05:36:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 --2- 172.21.15.44:0/2181907787 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b7c0711c0 0x7f1b7c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 --2- 172.21.15.44:0/2181907787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c155800 0x7f1b7c15f7b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 -- 172.21.15.44:0/2181907787 >> 172.21.15.44:0/2181907787 conn(0x7f1b7c0b2d20 msgr2=0x7f1b7c0b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f5873400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5858073250 0x7f5858075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f4683400640 1 -- 172.21.15.44:0/2914639059 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f468c15acd0 con 0x7f468c15a380 2024-09-17T05:36:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f7111200640 1 -- 172.21.15.44:0/1349625401 shutdown_connections 2024-09-17T05:36:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d409f150 con 0x7fa9d40ce080 2024-09-17T05:36:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d409f710 con 0x7fa9d40ce080 2024-09-17T05:36:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 -- 172.21.15.44:0/2181907787 shutdown_connections 2024-09-17T05:36:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f1b80a00640 1 -- 172.21.15.44:0/2181907787 wait complete. 2024-09-17T05:36:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f18bb200640 1 Processor -- start 2024-09-17T05:36:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f18bb200640 1 -- start start 2024-09-17T05:36:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.358+0000 7f7111200640 1 -- 172.21.15.44:0/1349625401 wait complete. 2024-09-17T05:36:36.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d4166910 con 0x7fa9d40ce080 2024-09-17T05:36:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f5873400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5858073250 0x7f5858075760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f587c1f9430 tx=0x7f5864009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f23e7e00640 1 -- 172.21.15.44:0/1695595453 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f23dc003a00 con 0x7f23f0072e50 2024-09-17T05:36:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f23e7e00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f23d0073200 0x7f23d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f23e7e00640 1 -- 172.21.15.44:0/1695595453 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f23dc12e850 con 0x7f23f0072e50 2024-09-17T05:36:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7fa9d0c00640 1 -- 172.21.15.44:0/1145306518 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa9bc01a070 con 0x7fa9d40ce080 2024-09-17T05:36:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f1b80a00640 1 Processor -- start 2024-09-17T05:36:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f23efe00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f23d0073200 0x7f23d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f1b80a00640 1 -- start start 2024-09-17T05:36:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.362+0000 7f7111200640 1 Processor -- start 2024-09-17T05:36:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f23e7e00640 1 -- 172.21.15.44:0/1695595453 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f23dc0ac030 con 0x7f23f0072e50 2024-09-17T05:36:36.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f5878c00640 1 -- 172.21.15.44:0/4132016309 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f586c020030 con 0x7f587c0cf7f0 2024-09-17T05:36:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7fa9d0c00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa9b00732d0 0x7fa9b00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7fa9d0c00640 1 -- 172.21.15.44:0/1145306518 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa9bc093740 con 0x7fa9d40ce080 2024-09-17T05:36:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7111200640 1 -- start start 2024-09-17T05:36:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7111200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710c0707e0 0x7f710c15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7111200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0b5880 0x7f710c15c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7111200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f710c158590 0x7f710c0c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7111200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f710c16ad30 con 0x7f710c0b5880 2024-09-17T05:36:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7111200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f710c16abb0 con 0x7f710c0707e0 2024-09-17T05:36:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7111200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f710c16aeb0 con 0x7f710c158590 2024-09-17T05:36:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f1b80a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b7c06df50 0x7f1b7c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f1b80a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c0711c0 0x7f1b7c201300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18bb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1898003a10 0x7f18b4145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18bb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18b413c8d0 0x7f18b4140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18bb200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18b413ce20 0x7f18b41413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18bb200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f18b415edc0 con 0x7f18b413c8d0 2024-09-17T05:36:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18bb200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18b415ec40 con 0x7f1898003a10 2024-09-17T05:36:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18bb200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f18b40716d0 con 0x7f18b413ce20 2024-09-17T05:36:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7fa9d3e00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa9b00732d0 0x7fa9b00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7109e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710c0707e0 0x7f710c15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18b3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1898003a10 0x7f18b4145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18b3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1898003a10 0x7f18b4145bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:45978/0 (socket says 172.21.15.44:45978) 2024-09-17T05:36:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18b3e00640 1 -- 172.21.15.44:0/800484378 learned_addr learned my addr 172.21.15.44:0/800484378 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f710a800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f710c158590 0x7f710c0c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7109e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710c0707e0 0x7f710c15bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:45984/0 (socket says 172.21.15.44:45984) 2024-09-17T05:36:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7109e00640 1 -- 172.21.15.44:0/1451631662 learned_addr learned my addr 172.21.15.44:0/1451631662 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f23efe00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f23d0073200 0x7f23d0075710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009a00 tx=0x7f23e0009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f1b80a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b7c155800 0x7f1b7c1fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b7c06df50 0x7f1b7c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c0711c0 0x7f1b7c201300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b80a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c169090 con 0x7f1b7c06df50 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b80a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c168f10 con 0x7f1b7c0711c0 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b79e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c0711c0 0x7f1b7c201300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:45998/0 (socket says 172.21.15.44:45998) 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b79e00640 1 -- 172.21.15.44:0/1938222702 learned_addr learned my addr 172.21.15.44:0/1938222702 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c169210 con 0x7f1b7c155800 2024-09-17T05:36:36.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b7b200640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b7c155800 0x7f1b7c1fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f18b9200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18b413ce20 0x7f18b41413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3400640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18b413c8d0 0x7f18b4140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7fa9d3e00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa9b00732d0 0x7fa9b00757e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40b3000 tx=0x7fa9c401de40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.366+0000 7f7109400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0b5880 0x7f710c15c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f7109e00640 1 -- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f710c158590 msgr2=0x7f710c0c08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f7109e00640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f710c158590 0x7f710c0c08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f7109e00640 1 -- 172.21.15.44:0/1451631662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0b5880 msgr2=0x7f710c15c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f710a800640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f710c158590 0x7f710c0c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f7109e00640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0b5880 0x7f710c15c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b7b200640 1 -- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c0711c0 msgr2=0x7f1b7c201300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b7b200640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c0711c0 0x7f1b7c201300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b7b200640 1 -- 172.21.15.44:0/1938222702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b7c06df50 msgr2=0x7f1b7c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b7b200640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b7c06df50 0x7f1b7c154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b7b200640 1 -- 172.21.15.44:0/1938222702 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c15a5e0 con 0x7f1b7c155800 2024-09-17T05:36:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f7109e00640 1 -- 172.21.15.44:0/1451631662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c09cf50 con 0x7f710c0707e0 2024-09-17T05:36:36.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7fa9d0c00640 1 -- 172.21.15.44:0/1145306518 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa9bc05de40 con 0x7fa9d40ce080 2024-09-17T05:36:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b7b200640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b7c155800 0x7f1b7c1fcb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400c700 tx=0x7f1b7400cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f7109400640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0b5880 0x7f710c15c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3400640 1 -- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18b413ce20 msgr2=0x7f18b41413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f7109e00640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710c0707e0 0x7f710c15bb00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c480 tx=0x7f70fc00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3400640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18b413ce20 0x7f18b41413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3400640 1 -- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1898003a10 msgr2=0x7f18b4145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3400640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1898003a10 0x7f18b4145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3400640 1 -- 172.21.15.44:0/800484378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b413f260 con 0x7f18b413c8d0 2024-09-17T05:36:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b9200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18b413ce20 0x7f18b41413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:36.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3e00640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1898003a10 0x7f18b4145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b72a00640 1 -- 172.21.15.44:0/1938222702 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74003b80 con 0x7f1b7c155800 2024-09-17T05:36:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b72a00640 1 -- 172.21.15.44:0/1938222702 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b74003d20 con 0x7f1b7c155800 2024-09-17T05:36:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b72a00640 1 -- 172.21.15.44:0/1938222702 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74005330 con 0x7f1b7c155800 2024-09-17T05:36:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c15a8c0 con 0x7f1b7c155800 2024-09-17T05:36:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c161560 con 0x7f1b7c155800 2024-09-17T05:36:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.370+0000 7f18b3400640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18b413c8d0 0x7f18b4140eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c3e0 tx=0x7f18a000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f18abe00640 1 -- 172.21.15.44:0/800484378 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011790 con 0x7f18b413c8d0 2024-09-17T05:36:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f7102000640 1 -- 172.21.15.44:0/1451631662 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0052d0 con 0x7f710c0707e0 2024-09-17T05:36:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f18abe00640 1 -- 172.21.15.44:0/800484378 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18a0017070 con 0x7f18b413c8d0 2024-09-17T05:36:36.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f18abe00640 1 -- 172.21.15.44:0/800484378 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0011d00 con 0x7f18b413c8d0 2024-09-17T05:36:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f7102000640 1 -- 172.21.15.44:0/1451631662 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70fc005470 con 0x7f710c0707e0 2024-09-17T05:36:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f7102000640 1 -- 172.21.15.44:0/1451631662 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc012870 con 0x7f710c0707e0 2024-09-17T05:36:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b413f540 con 0x7f18b413c8d0 2024-09-17T05:36:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b40b0fa0 con 0x7f18b413c8d0 2024-09-17T05:36:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c09d230 con 0x7f710c0707e0 2024-09-17T05:36:36.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c09d7f0 con 0x7f710c0707e0 2024-09-17T05:36:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.374+0000 7f1b72a00640 1 -- 172.21.15.44:0/1938222702 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1b740054d0 con 0x7f1b7c155800 2024-09-17T05:36:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b7c1617c0 con 0x7f1b7c155800 2024-09-17T05:36:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f1b72a00640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b5c073250 0x7f1b5c075760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f1b72a00640 1 -- 172.21.15.44:0/1938222702 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1b74013e10 con 0x7f1b7c155800 2024-09-17T05:36:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f1b7a800640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b5c073250 0x7f1b5c075760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f1b7a800640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b5c073250 0x7f1b5c075760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0af000 tx=0x7f1b6c01b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f18abe00640 1 -- 172.21.15.44:0/800484378 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f18a0005020 con 0x7f18b413c8d0 2024-09-17T05:36:36.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f18abe00640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f18940732d0 0x7f18940757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.378+0000 7f18abe00640 1 -- 172.21.15.44:0/800484378 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f18a0094070 con 0x7f18b413c8d0 2024-09-17T05:36:36.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.382+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c070bf0 con 0x7f710c0707e0 2024-09-17T05:36:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.382+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c0052a0 con 0x7f18b413c8d0 2024-09-17T05:36:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.382+0000 7f18b3e00640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f18940732d0 0x7f18940757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.382+0000 7f7102000640 1 -- 172.21.15.44:0/1451631662 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f70fc003600 con 0x7f710c0707e0 2024-09-17T05:36:36.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.382+0000 7f1b72a00640 1 -- 172.21.15.44:0/1938222702 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1b7c071b10 con 0x7f1b7c155800 2024-09-17T05:36:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.382+0000 7f18b3e00640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f18940732d0 0x7f18940757e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f18a4004b00 tx=0x7f18a40a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.386+0000 7f7102000640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f70ec073300 0x7f70ec075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.386+0000 7f7102000640 1 -- 172.21.15.44:0/1451631662 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f70fc093d50 con 0x7f710c0707e0 2024-09-17T05:36:36.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.386+0000 7f7102000640 1 -- 172.21.15.44:0/1451631662 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f70fc020060 con 0x7f710c0707e0 2024-09-17T05:36:36.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.386+0000 7f7109400640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f70ec073300 0x7f70ec075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.394+0000 7f7109400640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f70ec073300 0x7f70ec075810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f710c158b90 tx=0x7f70f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.394+0000 7f18abe00640 1 -- 172.21.15.44:0/800484378 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f18a0021020 con 0x7f18b413c8d0 2024-09-17T05:36:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.730+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f956c0dfea0 con 0x7f956c0343c0 2024-09-17T05:36:36.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.730+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f468c0b8080 con 0x7f468c15a380 2024-09-17T05:36:36.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.734+0000 7f9567400640 1 -- 172.21.15.44:0/700255269 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f956805e4a0 con 0x7f956c0343c0 2024-09-17T05:36:36.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.734+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f23f006e260 con 0x7f23f0072e50 2024-09-17T05:36:36.734 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-09-17T05:36:36.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.734+0000 7f4683400640 1 -- 172.21.15.44:0/2914639059 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f468405f3e0 con 0x7f468c15a380 2024-09-17T05:36:36.735 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-09-17T05:36:36.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.734+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f587c0cddd0 con 0x7f587c0cf7f0 2024-09-17T05:36:36.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f23e7e00640 1 -- 172.21.15.44:0/1695595453 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23f006e7a0 con 0x7f23f0072e50 2024-09-17T05:36:36.738 INFO:teuthology.orchestra.run.smithi044.stdout:64424509448 2024-09-17T05:36:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9554073200 msgr2=0x7f9554075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9554073200 0x7f9554075710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95600af000 tx=0x7f956001af20 comp rx=0 tx=0).stop 2024-09-17T05:36:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f956c0343c0 msgr2=0x7f956c0d8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f956c0343c0 0x7f956c0d8d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f956800a930 tx=0x7f956800adf0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f5878c00640 1 -- 172.21.15.44:0/4132016309 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f586c020030 con 0x7f587c0cf7f0 2024-09-17T05:36:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 shutdown_connections 2024-09-17T05:36:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9554073200 0x7f9554075710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f956c034e60 0x7f956c0db680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f956c0343c0 0x7f956c0d8d60 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f956800a930 tx=0x7f956800adf0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 --2- 172.21.15.44:0/700255269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f956c005c90 0x7f956c182a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 >> 172.21.15.44:0/700255269 conn(0x7f956c01d9e0 msgr2=0x7f956c050320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 shutdown_connections 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f957a600640 1 -- 172.21.15.44:0/700255269 wait complete. 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f466c073250 msgr2=0x7f466c075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f466c073250 0x7f466c075760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f467c0af000 tx=0x7f467c01ae80 comp rx=0 tx=0).stop 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f468c15a380 msgr2=0x7f468c15a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f468c15a380 0x7f468c15a790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f468c0d20d0 tx=0x7f4684009ef0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 shutdown_connections 2024-09-17T05:36:36.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f468c15a380 0x7f468c15a790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f466c073250 0x7f466c075760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f468c159240 0x7f468c15c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 --2- 172.21.15.44:0/2914639059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f468c06e370 0x7f468c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 >> 172.21.15.44:0/2914639059 conn(0x7f468c0b4300 msgr2=0x7f468c15e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 shutdown_connections 2024-09-17T05:36:36.743 INFO:teuthology.orchestra.run.smithi044.stdout:64424509448 2024-09-17T05:36:36.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.738+0000 7f4691000640 1 -- 172.21.15.44:0/2914639059 wait complete. 2024-09-17T05:36:36.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa9d4074bd0 con 0x7fa9d40ce080 2024-09-17T05:36:36.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7fa9d0c00640 1 -- 172.21.15.44:0/1145306518 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9bc062870 con 0x7fa9d40ce080 2024-09-17T05:36:36.744 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-09-17T05:36:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5858073250 msgr2=0x7f5858075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5858073250 0x7f5858075760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f587c1f9430 tx=0x7f5864009060 comp rx=0 tx=0).stop 2024-09-17T05:36:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f587c0cf7f0 msgr2=0x7f587c153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f587c0cf7f0 0x7f587c153e90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f586c00cbf0 tx=0x7f586c00cce0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f23d0073200 msgr2=0x7f23d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f23d0073200 0x7f23d0075710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009a00 tx=0x7f23e0009110 comp rx=0 tx=0).stop 2024-09-17T05:36:36.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f0072e50 msgr2=0x7f23f00c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f0072e50 0x7f23f00c2c70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f23f00741f0 tx=0x7f23dc0a8590 comp rx=0 tx=0).stop 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 shutdown_connections 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f587c14bd40 0x7f587c06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5858073250 0x7f5858075760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f587c15b420 0x7f587c14d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 --2- 172.21.15.44:0/4132016309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f587c0cf7f0 0x7f587c153e90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 >> 172.21.15.44:0/4132016309 conn(0x7f587c06ce40 msgr2=0x7f587c0ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 shutdown_connections 2024-09-17T05:36:36.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f5881400640 1 -- 172.21.15.44:0/4132016309 wait complete. 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 shutdown_connections 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f23f00cb470 0x7f23f00c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f23d0073200 0x7f23d0075710 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23f0072e50 0x7f23f00c2c70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 --2- 172.21.15.44:0/1695595453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f23f006de50 0x7f23f009f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 >> 172.21.15.44:0/1695595453 conn(0x7f23f00ccaa0 msgr2=0x7f23f0155230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa9b00732d0 msgr2=0x7fa9b00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7fa9dae00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa9b00732d0 0x7fa9b00757e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40b3000 tx=0x7fa9c401de40 comp rx=0 tx=0).stop 2024-09-17T05:36:36.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40ce080 msgr2=0x7fa9d40a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 shutdown_connections 2024-09-17T05:36:36.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7f23f6c00640 1 -- 172.21.15.44:0/1695595453 wait complete. 2024-09-17T05:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.742+0000 7fa9dae00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40ce080 0x7fa9d40a0280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c390 tx=0x7fa9bc00c850 comp rx=0 tx=0).stop 2024-09-17T05:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.746+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 shutdown_connections 2024-09-17T05:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.746+0000 7fa9dae00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9d40cef20 0x7fa9d40a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.746+0000 7fa9dae00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa9d40ce080 0x7fa9d40a0280 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.746+0000 7fa9dae00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa9b00732d0 0x7fa9b00757e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.746+0000 7fa9dae00640 1 --2- 172.21.15.44:0/1145306518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9d406de50 0x7fa9d41fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.746+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 >> 172.21.15.44:0/1145306518 conn(0x7fa9d40ccaa0 msgr2=0x7fa9d406ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.750+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 shutdown_connections 2024-09-17T05:36:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.750+0000 7fa9dae00640 1 -- 172.21.15.44:0/1145306518 wait complete. 2024-09-17T05:36:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.750+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1b7c0715d0 con 0x7f1b7c155800 2024-09-17T05:36:36.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.750+0000 7f1b72a00640 1 -- 172.21.15.44:0/1938222702 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b740631f0 con 0x7f1b7c155800 2024-09-17T05:36:36.752 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-09-17T05:36:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f710c070480 con 0x7f710c0707e0 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b5c073250 msgr2=0x7f1b5c075760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b5c073250 0x7f1b5c075760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0af000 tx=0x7f1b6c01b120 comp rx=0 tx=0).stop 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b7c155800 msgr2=0x7f1b7c1fcb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b7c155800 0x7f1b7c1fcb30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400c700 tx=0x7f1b7400cbc0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 shutdown_connections 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1b7c155800 0x7f1b7c1fcb30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b5c073250 0x7f1b5c075760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b7c0711c0 0x7f1b7c201300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 --2- 172.21.15.44:0/1938222702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b7c06df50 0x7f1b7c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.754+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 >> 172.21.15.44:0/1938222702 conn(0x7f1b7c0b2d20 msgr2=0x7f1b7c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.758+0000 7f7102000640 1 -- 172.21.15.44:0/1451631662 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70fc05eb30 con 0x7f710c0707e0 2024-09-17T05:36:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.758+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 shutdown_connections 2024-09-17T05:36:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.758+0000 7f1b80a00640 1 -- 172.21.15.44:0/1938222702 wait complete. 2024-09-17T05:36:36.761 INFO:teuthology.orchestra.run.smithi044.stdout:55834574857 2024-09-17T05:36:36.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f70ec073300 msgr2=0x7f70ec075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f70ec073300 0x7f70ec075810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f710c158b90 tx=0x7f70f8009040 comp rx=0 tx=0).stop 2024-09-17T05:36:36.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710c0707e0 msgr2=0x7f710c15bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710c0707e0 0x7f710c15bb00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c480 tx=0x7f70fc00c940 comp rx=0 tx=0).stop 2024-09-17T05:36:36.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 shutdown_connections 2024-09-17T05:36:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f710c158590 0x7f710c0c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f710c0b5880 0x7f710c15c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f70ec073300 0x7f70ec075810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 --2- 172.21.15.44:0/1451631662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f710c0707e0 0x7f710c15bb00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 >> 172.21.15.44:0/1451631662 conn(0x7f710c0ccaa0 msgr2=0x7f710c072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 shutdown_connections 2024-09-17T05:36:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.762+0000 7f7111200640 1 -- 172.21.15.44:0/1451631662 wait complete. 2024-09-17T05:36:36.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.770+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f188c005590 con 0x7f18b413c8d0 2024-09-17T05:36:36.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.774+0000 7f18abe00640 1 -- 172.21.15.44:0/800484378 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18a0081020 con 0x7f18b413c8d0 2024-09-17T05:36:36.774 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-09-17T05:36:36.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f18940732d0 msgr2=0x7f18940757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f18940732d0 0x7f18940757e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f18a4004b00 tx=0x7f18a40a7040 comp rx=0 tx=0).stop 2024-09-17T05:36:36.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18b413c8d0 msgr2=0x7f18b4140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18b413c8d0 0x7f18b4140eb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c3e0 tx=0x7f18a000c8a0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 shutdown_connections 2024-09-17T05:36:36.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18b413ce20 0x7f18b41413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18b413c8d0 0x7f18b4140eb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f18940732d0 0x7f18940757e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 --2- 172.21.15.44:0/800484378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1898003a10 0x7f18b4145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 >> 172.21.15.44:0/800484378 conn(0x7f18b406ff60 msgr2=0x7f18b40af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.0 2024-09-17T05:36:36.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 shutdown_connections 2024-09-17T05:36:36.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:36.782+0000 7f18bb200640 1 -- 172.21.15.44:0/800484378 wait complete. 2024-09-17T05:36:36.786 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.1 2024-09-17T05:36:36.787 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.2 2024-09-17T05:36:36.791 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.4 2024-09-17T05:36:36.792 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.7 2024-09-17T05:36:36.795 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.5 2024-09-17T05:36:36.800 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-09-17T05:36:36.803 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.3 2024-09-17T05:36:36.811 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:36.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:36:36.812 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:37.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 -- 172.21.15.44:0/4119223584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f815d560 msgr2=0x7f26f815a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 --2- 172.21.15.44:0/4119223584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f815d560 0x7f26f815a080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f26f8161170 tx=0x7f26ec01c7a0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 -- 172.21.15.44:0/4119223584 shutdown_connections 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 --2- 172.21.15.44:0/4119223584 >> v2:172.21.15.86:3300/0 conn(0x7f26f80cc1e0 0x7f26f806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 --2- 172.21.15.44:0/4119223584 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26f806ce40 0x7f26f80cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 --2- 172.21.15.44:0/4119223584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f815d560 0x7f26f815a080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 -- 172.21.15.44:0/4119223584 >> 172.21.15.44:0/4119223584 conn(0x7f26f80cd930 msgr2=0x7f26f80cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 -- 172.21.15.44:0/4119223584 shutdown_connections 2024-09-17T05:36:37.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 -- 172.21.15.44:0/4119223584 wait complete. 2024-09-17T05:36:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 Processor -- start 2024-09-17T05:36:37.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.014+0000 7f2700600640 1 -- start start 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f806ce40 0x7f26f814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26f80cc1e0 0x7f26f80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f815d560 0x7f26f81fc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8160760 con 0x7f26f806ce40 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81605e0 con 0x7f26f815d560 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f26f81608e0 con 0x7f26f80cc1e0 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f806ce40 0x7f26f814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f806ce40 0x7f26f814f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49304/0 (socket says 172.21.15.44:49304) 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 -- 172.21.15.44:0/2774579717 learned_addr learned my addr 172.21.15.44:0/2774579717 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fd200640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26f80cc1e0 0x7f26f80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fe600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f815d560 0x7f26f81fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 -- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26f80cc1e0 msgr2=0x7f26f80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26f80cc1e0 0x7f26f80cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 -- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f815d560 msgr2=0x7f26f81fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f815d560 0x7f26f81fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 -- 172.21.15.44:0/2774579717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f80cfff0 con 0x7f26f806ce40 2024-09-17T05:36:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fe600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f815d560 0x7f26f81fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26fdc00640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f806ce40 0x7f26f814f420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f26ec01d040 tx=0x7f26ec0a6470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26f5600640 1 -- 172.21.15.44:0/2774579717 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0ac070 con 0x7f26f806ce40 2024-09-17T05:36:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26f5600640 1 -- 172.21.15.44:0/2774579717 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26ec004320 con 0x7f26f806ce40 2024-09-17T05:36:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f80d02d0 con 0x7f26f806ce40 2024-09-17T05:36:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f26f5600640 1 -- 172.21.15.44:0/2774579717 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0044d0 con 0x7f26f806ce40 2024-09-17T05:36:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f80ce760 con 0x7f26f806ce40 2024-09-17T05:36:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.018+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f8160dd0 con 0x7f26f806ce40 2024-09-17T05:36:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.022+0000 7f26f5600640 1 -- 172.21.15.44:0/2774579717 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f26ec0af070 con 0x7f26f806ce40 2024-09-17T05:36:37.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.022+0000 7f26f5600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f26d8073200 0x7f26d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.022+0000 7f26f5600640 1 -- 172.21.15.44:0/2774579717 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f26ec12e690 con 0x7f26f806ce40 2024-09-17T05:36:37.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.022+0000 7f26fd200640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f26d8073200 0x7f26d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.022+0000 7f26fd200640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f26d8073200 0x7f26d8075710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f26f8151c30 tx=0x7f26e400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.026+0000 7f26f5600640 1 -- 172.21.15.44:0/2774579717 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f26ec0164b0 con 0x7f26f806ce40 2024-09-17T05:36:37.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.198+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26f8151980 con 0x7f26d8073200 2024-09-17T05:36:37.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.206+0000 7f26f5600640 1 -- 172.21.15.44:0/2774579717 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7f26f8151980 con 0x7f26d8073200 2024-09-17T05:36:37.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:37.213 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:36:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f26d8073200 msgr2=0x7f26d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f26d8073200 0x7f26d8075710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f26f8151c30 tx=0x7f26e400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f806ce40 msgr2=0x7f26f814f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f806ce40 0x7f26f814f420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f26ec01d040 tx=0x7f26ec0a6470 comp rx=0 tx=0).stop 2024-09-17T05:36:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 shutdown_connections 2024-09-17T05:36:37.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f26d8073200 0x7f26d8075710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f815d560 0x7f26f81fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f26f80cc1e0 0x7f26f80cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 --2- 172.21.15.44:0/2774579717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26f806ce40 0x7f26f814f420 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 >> 172.21.15.44:0/2774579717 conn(0x7f26f80cd930 msgr2=0x7f26f8150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 shutdown_connections 2024-09-17T05:36:37.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.210+0000 7f2700600640 1 -- 172.21.15.44:0/2774579717 wait complete. 2024-09-17T05:36:37.232 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-17T05:36:36.262410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219556,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755164,"statfs":{"total":773094113280,"available":772869287936,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003926"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344741+0000","last_change":"2024-09-17T05:36:16.322687+0000","last_active":"2024-09-17T05:36:22.344741+0000","last_peered":"2024-09-17T05:36:22.344741+0000","last_clean":"2024-09-17T05:36:22.344741+0000","last_became_active":"2024-09-17T05:36:16.322327+0000","last_became_peered":"2024-09-17T05:36:16.322327+0000","last_unstale":"2024-09-17T05:36:22.344741+0000","last_undegraded":"2024-09-17T05:36:22.344741+0000","last_fullsized":"2024-09-17T05:36:22.344741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528771+0000","last_change":"2024-09-17T05:36:17.346577+0000","last_active":"2024-09-17T05:36:23.528771+0000","last_peered":"2024-09-17T05:36:23.528771+0000","last_clean":"2024-09-17T05:36:23.528771+0000","last_became_active":"2024-09-17T05:36:17.346190+0000","last_became_peered":"2024-09-17T05:36:17.346190+0000","last_unstale":"2024-09-17T05:36:23.528771+0000","last_undegraded":"2024-09-17T05:36:23.528771+0000","last_fullsized":"2024-09-17T05:36:23.528771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528503+0000","last_change":"2024-09-17T05:36:21.378187+0000","last_active":"2024-09-17T05:36:23.528503+0000","last_peered":"2024-09-17T05:36:23.528503+0000","last_clean":"2024-09-17T05:36:23.528503+0000","last_became_active":"2024-09-17T05:36:21.377733+0000","last_became_peered":"2024-09-17T05:36:21.377733+0000","last_unstale":"2024-09-17T05:36:23.528503+0000","last_undegraded":"2024-09-17T05:36:23.528503+0000","last_fullsized":"2024-09-17T05:36:23.528503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:33.577546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528970+0000","last_change":"2024-09-17T05:36:16.318233+0000","last_active":"2024-09-17T05:36:23.528970+0000","last_peered":"2024-09-17T05:36:23.528970+0000","last_clean":"2024-09-17T05:36:23.528970+0000","last_became_active":"2024-09-17T05:36:16.316897+0000","last_became_peered":"2024-09-17T05:36:16.316897+0000","last_unstale":"2024-09-17T05:36:23.528970+0000","last_undegraded":"2024-09-17T05:36:23.528970+0000","last_fullsized":"2024-09-17T05:36:23.528970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528763+0000","last_change":"2024-09-17T05:36:17.337382+0000","last_active":"2024-09-17T05:36:23.528763+0000","last_peered":"2024-09-17T05:36:23.528763+0000","last_clean":"2024-09-17T05:36:23.528763+0000","last_became_active":"2024-09-17T05:36:17.330732+0000","last_became_peered":"2024-09-17T05:36:17.330732+0000","last_unstale":"2024-09-17T05:36:23.528763+0000","last_undegraded":"2024-09-17T05:36:23.528763+0000","last_fullsized":"2024-09-17T05:36:23.528763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:20.100003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340737+0000","last_change":"2024-09-17T05:36:21.371771+0000","last_active":"2024-09-17T05:36:22.340737+0000","last_peered":"2024-09-17T05:36:22.340737+0000","last_clean":"2024-09-17T05:36:22.340737+0000","last_became_active":"2024-09-17T05:36:21.370880+0000","last_became_peered":"2024-09-17T05:36:21.370880+0000","last_unstale":"2024-09-17T05:36:22.340737+0000","last_undegraded":"2024-09-17T05:36:22.340737+0000","last_fullsized":"2024-09-17T05:36:22.340737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:14.478542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715355+0000","last_change":"2024-09-17T05:36:16.327231+0000","last_active":"2024-09-17T05:36:22.715355+0000","last_peered":"2024-09-17T05:36:22.715355+0000","last_clean":"2024-09-17T05:36:22.715355+0000","last_became_active":"2024-09-17T05:36:16.326856+0000","last_became_peered":"2024-09-17T05:36:16.326856+0000","last_unstale":"2024-09-17T05:36:22.715355+0000","last_undegraded":"2024-09-17T05:36:22.715355+0000","last_fullsized":"2024-09-17T05:36:22.715355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:29.442629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527139+0000","last_change":"2024-09-17T05:36:17.331749+0000","last_active":"2024-09-17T05:36:23.527139+0000","last_peered":"2024-09-17T05:36:23.527139+0000","last_clean":"2024-09-17T05:36:23.527139+0000","last_became_active":"2024-09-17T05:36:17.329815+0000","last_became_peered":"2024-09-17T05:36:17.329815+0000","last_unstale":"2024-09-17T05:36:23.527139+0000","last_undegraded":"2024-09-17T05:36:23.527139+0000","last_fullsized":"2024-09-17T05:36:23.527139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:13.966029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341080+0000","last_change":"2024-09-17T05:36:21.372497+0000","last_active":"2024-09-17T05:36:22.341080+0000","last_peered":"2024-09-17T05:36:22.341080+0000","last_clean":"2024-09-17T05:36:22.341080+0000","last_became_active":"2024-09-17T05:36:21.372038+0000","last_became_peered":"2024-09-17T05:36:21.372038+0000","last_unstale":"2024-09-17T05:36:22.341080+0000","last_undegraded":"2024-09-17T05:36:22.341080+0000","last_fullsized":"2024-09-17T05:36:22.341080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715174+0000","last_change":"2024-09-17T05:36:16.328078+0000","last_active":"2024-09-17T05:36:22.715174+0000","last_peered":"2024-09-17T05:36:22.715174+0000","last_clean":"2024-09-17T05:36:22.715174+0000","last_became_active":"2024-09-17T05:36:16.327672+0000","last_became_peered":"2024-09-17T05:36:16.327672+0000","last_unstale":"2024-09-17T05:36:22.715174+0000","last_undegraded":"2024-09-17T05:36:22.715174+0000","last_fullsized":"2024-09-17T05:36:22.715174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981888+0000","last_change":"2024-09-17T05:36:17.316048+0000","last_active":"2024-09-17T05:36:22.981888+0000","last_peered":"2024-09-17T05:36:22.981888+0000","last_clean":"2024-09-17T05:36:22.981888+0000","last_became_active":"2024-09-17T05:36:17.315721+0000","last_became_peered":"2024-09-17T05:36:17.315721+0000","last_unstale":"2024-09-17T05:36:22.981888+0000","last_undegraded":"2024-09-17T05:36:22.981888+0000","last_fullsized":"2024-09-17T05:36:22.981888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:00.464476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340720+0000","last_change":"2024-09-17T05:36:21.373595+0000","last_active":"2024-09-17T05:36:22.340720+0000","last_peered":"2024-09-17T05:36:22.340720+0000","last_clean":"2024-09-17T05:36:22.340720+0000","last_became_active":"2024-09-17T05:36:21.372679+0000","last_became_peered":"2024-09-17T05:36:21.372679+0000","last_unstale":"2024-09-17T05:36:22.340720+0000","last_undegraded":"2024-09-17T05:36:22.340720+0000","last_fullsized":"2024-09-17T05:36:22.340720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:10.401214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981418+0000","last_change":"2024-09-17T05:36:17.308500+0000","last_active":"2024-09-17T05:36:22.981418+0000","last_peered":"2024-09-17T05:36:22.981418+0000","last_clean":"2024-09-17T05:36:22.981418+0000","last_became_active":"2024-09-17T05:36:17.303262+0000","last_became_peered":"2024-09-17T05:36:17.303262+0000","last_unstale":"2024-09-17T05:36:22.981418+0000","last_undegraded":"2024-09-17T05:36:22.981418+0000","last_fullsized":"2024-09-17T05:36:22.981418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:16.966266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981661+0000","last_change":"2024-09-17T05:36:16.333433+0000","last_active":"2024-09-17T05:36:22.981661+0000","last_peered":"2024-09-17T05:36:22.981661+0000","last_clean":"2024-09-17T05:36:22.981661+0000","last_became_active":"2024-09-17T05:36:16.328517+0000","last_became_peered":"2024-09-17T05:36:16.328517+0000","last_unstale":"2024-09-17T05:36:22.981661+0000","last_undegraded":"2024-09-17T05:36:22.981661+0000","last_fullsized":"2024-09-17T05:36:22.981661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:43.294722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981779+0000","last_change":"2024-09-17T05:36:21.377118+0000","last_active":"2024-09-17T05:36:22.981779+0000","last_peered":"2024-09-17T05:36:22.981779+0000","last_clean":"2024-09-17T05:36:22.981779+0000","last_became_active":"2024-09-17T05:36:21.376379+0000","last_became_peered":"2024-09-17T05:36:21.376379+0000","last_unstale":"2024-09-17T05:36:22.981779+0000","last_undegraded":"2024-09-17T05:36:22.981779+0000","last_fullsized":"2024-09-17T05:36:22.981779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:22.735617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529100+0000","last_change":"2024-09-17T05:36:17.344836+0000","last_active":"2024-09-17T05:36:23.529100+0000","last_peered":"2024-09-17T05:36:23.529100+0000","last_clean":"2024-09-17T05:36:23.529100+0000","last_became_active":"2024-09-17T05:36:17.343959+0000","last_became_peered":"2024-09-17T05:36:17.343959+0000","last_unstale":"2024-09-17T05:36:23.529100+0000","last_undegraded":"2024-09-17T05:36:23.529100+0000","last_fullsized":"2024-09-17T05:36:23.529100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343968+0000","last_change":"2024-09-17T05:36:16.321265+0000","last_active":"2024-09-17T05:36:22.343968+0000","last_peered":"2024-09-17T05:36:22.343968+0000","last_clean":"2024-09-17T05:36:22.343968+0000","last_became_active":"2024-09-17T05:36:16.320994+0000","last_became_peered":"2024-09-17T05:36:16.320994+0000","last_unstale":"2024-09-17T05:36:22.343968+0000","last_undegraded":"2024-09-17T05:36:22.343968+0000","last_fullsized":"2024-09-17T05:36:22.343968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:12.139048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714749+0000","last_change":"2024-09-17T05:36:21.363951+0000","last_active":"2024-09-17T05:36:22.714749+0000","last_peered":"2024-09-17T05:36:22.714749+0000","last_clean":"2024-09-17T05:36:22.714749+0000","last_became_active":"2024-09-17T05:36:21.363462+0000","last_became_peered":"2024-09-17T05:36:21.363462+0000","last_unstale":"2024-09-17T05:36:22.714749+0000","last_undegraded":"2024-09-17T05:36:22.714749+0000","last_fullsized":"2024-09-17T05:36:22.714749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:35.701351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342422+0000","last_change":"2024-09-17T05:36:17.337740+0000","last_active":"2024-09-17T05:36:22.342422+0000","last_peered":"2024-09-17T05:36:22.342422+0000","last_clean":"2024-09-17T05:36:22.342422+0000","last_became_active":"2024-09-17T05:36:17.332701+0000","last_became_peered":"2024-09-17T05:36:17.332701+0000","last_unstale":"2024-09-17T05:36:22.342422+0000","last_undegraded":"2024-09-17T05:36:22.342422+0000","last_fullsized":"2024-09-17T05:36:22.342422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:58.266096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342734+0000","last_change":"2024-09-17T05:36:16.316754+0000","last_active":"2024-09-17T05:36:22.342734+0000","last_peered":"2024-09-17T05:36:22.342734+0000","last_clean":"2024-09-17T05:36:22.342734+0000","last_became_active":"2024-09-17T05:36:16.316437+0000","last_became_peered":"2024-09-17T05:36:16.316437+0000","last_unstale":"2024-09-17T05:36:22.342734+0000","last_undegraded":"2024-09-17T05:36:22.342734+0000","last_fullsized":"2024-09-17T05:36:22.342734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529269+0000","last_change":"2024-09-17T05:36:21.387657+0000","last_active":"2024-09-17T05:36:23.529269+0000","last_peered":"2024-09-17T05:36:23.529269+0000","last_clean":"2024-09-17T05:36:23.529269+0000","last_became_active":"2024-09-17T05:36:21.387055+0000","last_became_peered":"2024-09-17T05:36:21.387055+0000","last_unstale":"2024-09-17T05:36:23.529269+0000","last_undegraded":"2024-09-17T05:36:23.529269+0000","last_fullsized":"2024-09-17T05:36:23.529269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:32.937859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981203+0000","last_change":"2024-09-17T05:36:17.322184+0000","last_active":"2024-09-17T05:36:22.981203+0000","last_peered":"2024-09-17T05:36:22.981203+0000","last_clean":"2024-09-17T05:36:22.981203+0000","last_became_active":"2024-09-17T05:36:17.320864+0000","last_became_peered":"2024-09-17T05:36:17.320864+0000","last_unstale":"2024-09-17T05:36:22.981203+0000","last_undegraded":"2024-09-17T05:36:22.981203+0000","last_fullsized":"2024-09-17T05:36:22.981203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714387+0000","last_change":"2024-09-17T05:36:16.317147+0000","last_active":"2024-09-17T05:36:22.714387+0000","last_peered":"2024-09-17T05:36:22.714387+0000","last_clean":"2024-09-17T05:36:22.714387+0000","last_became_active":"2024-09-17T05:36:16.316600+0000","last_became_peered":"2024-09-17T05:36:16.316600+0000","last_unstale":"2024-09-17T05:36:22.714387+0000","last_undegraded":"2024-09-17T05:36:22.714387+0000","last_fullsized":"2024-09-17T05:36:22.714387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341697+0000","last_change":"2024-09-17T05:36:21.366149+0000","last_active":"2024-09-17T05:36:22.341697+0000","last_peered":"2024-09-17T05:36:22.341697+0000","last_clean":"2024-09-17T05:36:22.341697+0000","last_became_active":"2024-09-17T05:36:21.365665+0000","last_became_peered":"2024-09-17T05:36:21.365665+0000","last_unstale":"2024-09-17T05:36:22.341697+0000","last_undegraded":"2024-09-17T05:36:22.341697+0000","last_fullsized":"2024-09-17T05:36:22.341697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:04.721488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344454+0000","last_change":"2024-09-17T05:36:17.334934+0000","last_active":"2024-09-17T05:36:22.344454+0000","last_peered":"2024-09-17T05:36:22.344454+0000","last_clean":"2024-09-17T05:36:22.344454+0000","last_became_active":"2024-09-17T05:36:17.334132+0000","last_became_peered":"2024-09-17T05:36:17.334132+0000","last_unstale":"2024-09-17T05:36:22.344454+0000","last_undegraded":"2024-09-17T05:36:22.344454+0000","last_fullsized":"2024-09-17T05:36:22.344454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982376+0000","last_change":"2024-09-17T05:36:16.325337+0000","last_active":"2024-09-17T05:36:22.982376+0000","last_peered":"2024-09-17T05:36:22.982376+0000","last_clean":"2024-09-17T05:36:22.982376+0000","last_became_active":"2024-09-17T05:36:16.322984+0000","last_became_peered":"2024-09-17T05:36:16.322984+0000","last_unstale":"2024-09-17T05:36:22.982376+0000","last_undegraded":"2024-09-17T05:36:22.982376+0000","last_fullsized":"2024-09-17T05:36:22.982376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:06.046560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341200+0000","last_change":"2024-09-17T05:36:21.358756+0000","last_active":"2024-09-17T05:36:22.341200+0000","last_peered":"2024-09-17T05:36:22.341200+0000","last_clean":"2024-09-17T05:36:22.341200+0000","last_became_active":"2024-09-17T05:36:21.358225+0000","last_became_peered":"2024-09-17T05:36:21.358225+0000","last_unstale":"2024-09-17T05:36:22.341200+0000","last_undegraded":"2024-09-17T05:36:22.341200+0000","last_fullsized":"2024-09-17T05:36:22.341200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:10.794511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344614+0000","last_change":"2024-09-17T05:36:17.321481+0000","last_active":"2024-09-17T05:36:22.344614+0000","last_peered":"2024-09-17T05:36:22.344614+0000","last_clean":"2024-09-17T05:36:22.344614+0000","last_became_active":"2024-09-17T05:36:17.321132+0000","last_became_peered":"2024-09-17T05:36:17.321132+0000","last_unstale":"2024-09-17T05:36:22.344614+0000","last_undegraded":"2024-09-17T05:36:22.344614+0000","last_fullsized":"2024-09-17T05:36:22.344614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344664+0000","last_change":"2024-09-17T05:36:16.314881+0000","last_active":"2024-09-17T05:36:22.344664+0000","last_peered":"2024-09-17T05:36:22.344664+0000","last_clean":"2024-09-17T05:36:22.344664+0000","last_became_active":"2024-09-17T05:36:16.314473+0000","last_became_peered":"2024-09-17T05:36:16.314473+0000","last_unstale":"2024-09-17T05:36:22.344664+0000","last_undegraded":"2024-09-17T05:36:22.344664+0000","last_fullsized":"2024-09-17T05:36:22.344664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:34.851574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342176+0000","last_change":"2024-09-17T05:36:21.359463+0000","last_active":"2024-09-17T05:36:22.342176+0000","last_peered":"2024-09-17T05:36:22.342176+0000","last_clean":"2024-09-17T05:36:22.342176+0000","last_became_active":"2024-09-17T05:36:21.358945+0000","last_became_peered":"2024-09-17T05:36:21.358945+0000","last_unstale":"2024-09-17T05:36:22.342176+0000","last_undegraded":"2024-09-17T05:36:22.342176+0000","last_fullsized":"2024-09-17T05:36:22.342176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:16.789795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343353+0000","last_change":"2024-09-17T05:36:17.352141+0000","last_active":"2024-09-17T05:36:22.343353+0000","last_peered":"2024-09-17T05:36:22.343353+0000","last_clean":"2024-09-17T05:36:22.343353+0000","last_became_active":"2024-09-17T05:36:17.351766+0000","last_became_peered":"2024-09-17T05:36:17.351766+0000","last_unstale":"2024-09-17T05:36:22.343353+0000","last_undegraded":"2024-09-17T05:36:22.343353+0000","last_fullsized":"2024-09-17T05:36:22.343353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:50.090463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982180+0000","last_change":"2024-09-17T05:36:16.321568+0000","last_active":"2024-09-17T05:36:22.982180+0000","last_peered":"2024-09-17T05:36:22.982180+0000","last_clean":"2024-09-17T05:36:22.982180+0000","last_became_active":"2024-09-17T05:36:16.321260+0000","last_became_peered":"2024-09-17T05:36:16.321260+0000","last_unstale":"2024-09-17T05:36:22.982180+0000","last_undegraded":"2024-09-17T05:36:22.982180+0000","last_fullsized":"2024-09-17T05:36:22.982180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:57.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342554+0000","last_change":"2024-09-17T05:36:21.368740+0000","last_active":"2024-09-17T05:36:22.342554+0000","last_peered":"2024-09-17T05:36:22.342554+0000","last_clean":"2024-09-17T05:36:22.342554+0000","last_became_active":"2024-09-17T05:36:21.367320+0000","last_became_peered":"2024-09-17T05:36:21.367320+0000","last_unstale":"2024-09-17T05:36:22.342554+0000","last_undegraded":"2024-09-17T05:36:22.342554+0000","last_fullsized":"2024-09-17T05:36:22.342554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:31.367750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340925+0000","last_change":"2024-09-17T05:36:17.324299+0000","last_active":"2024-09-17T05:36:22.340925+0000","last_peered":"2024-09-17T05:36:22.340925+0000","last_clean":"2024-09-17T05:36:22.340925+0000","last_became_active":"2024-09-17T05:36:17.323941+0000","last_became_peered":"2024-09-17T05:36:17.323941+0000","last_unstale":"2024-09-17T05:36:22.340925+0000","last_undegraded":"2024-09-17T05:36:22.340925+0000","last_fullsized":"2024-09-17T05:36:22.340925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528295+0000","last_change":"2024-09-17T05:36:16.318757+0000","last_active":"2024-09-17T05:36:23.528295+0000","last_peered":"2024-09-17T05:36:23.528295+0000","last_clean":"2024-09-17T05:36:23.528295+0000","last_became_active":"2024-09-17T05:36:16.318452+0000","last_became_peered":"2024-09-17T05:36:16.318452+0000","last_unstale":"2024-09-17T05:36:23.528295+0000","last_undegraded":"2024-09-17T05:36:23.528295+0000","last_fullsized":"2024-09-17T05:36:23.528295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342943+0000","last_change":"2024-09-17T05:36:21.374533+0000","last_active":"2024-09-17T05:36:22.342943+0000","last_peered":"2024-09-17T05:36:22.342943+0000","last_clean":"2024-09-17T05:36:22.342943+0000","last_became_active":"2024-09-17T05:36:21.373222+0000","last_became_peered":"2024-09-17T05:36:21.373222+0000","last_unstale":"2024-09-17T05:36:22.342943+0000","last_undegraded":"2024-09-17T05:36:22.342943+0000","last_fullsized":"2024-09-17T05:36:22.342943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:51.191726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714674+0000","last_change":"2024-09-17T05:36:17.336498+0000","last_active":"2024-09-17T05:36:22.714674+0000","last_peered":"2024-09-17T05:36:22.714674+0000","last_clean":"2024-09-17T05:36:22.714674+0000","last_became_active":"2024-09-17T05:36:17.335606+0000","last_became_peered":"2024-09-17T05:36:17.335606+0000","last_unstale":"2024-09-17T05:36:22.714674+0000","last_undegraded":"2024-09-17T05:36:22.714674+0000","last_fullsized":"2024-09-17T05:36:22.714674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981647+0000","last_change":"2024-09-17T05:36:16.307663+0000","last_active":"2024-09-17T05:36:22.981647+0000","last_peered":"2024-09-17T05:36:22.981647+0000","last_clean":"2024-09-17T05:36:22.981647+0000","last_became_active":"2024-09-17T05:36:16.307264+0000","last_became_peered":"2024-09-17T05:36:16.307264+0000","last_unstale":"2024-09-17T05:36:22.981647+0000","last_undegraded":"2024-09-17T05:36:22.981647+0000","last_fullsized":"2024-09-17T05:36:22.981647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:19.042460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343190+0000","last_change":"2024-09-17T05:36:21.372969+0000","last_active":"2024-09-17T05:36:22.343190+0000","last_peered":"2024-09-17T05:36:22.343190+0000","last_clean":"2024-09-17T05:36:22.343190+0000","last_became_active":"2024-09-17T05:36:21.368548+0000","last_became_peered":"2024-09-17T05:36:21.368548+0000","last_unstale":"2024-09-17T05:36:22.343190+0000","last_undegraded":"2024-09-17T05:36:22.343190+0000","last_fullsized":"2024-09-17T05:36:22.343190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.206523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527667+0000","last_change":"2024-09-17T05:36:17.328522+0000","last_active":"2024-09-17T05:36:23.527667+0000","last_peered":"2024-09-17T05:36:23.527667+0000","last_clean":"2024-09-17T05:36:23.527667+0000","last_became_active":"2024-09-17T05:36:17.327985+0000","last_became_peered":"2024-09-17T05:36:17.327985+0000","last_unstale":"2024-09-17T05:36:23.527667+0000","last_undegraded":"2024-09-17T05:36:23.527667+0000","last_fullsized":"2024-09-17T05:36:23.527667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528925+0000","last_change":"2024-09-17T05:36:16.316486+0000","last_active":"2024-09-17T05:36:23.528925+0000","last_peered":"2024-09-17T05:36:23.528925+0000","last_clean":"2024-09-17T05:36:23.528925+0000","last_became_active":"2024-09-17T05:36:16.316098+0000","last_became_peered":"2024-09-17T05:36:16.316098+0000","last_unstale":"2024-09-17T05:36:23.528925+0000","last_undegraded":"2024-09-17T05:36:23.528925+0000","last_fullsized":"2024-09-17T05:36:23.528925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343972+0000","last_change":"2024-09-17T05:36:21.369648+0000","last_active":"2024-09-17T05:36:22.343972+0000","last_peered":"2024-09-17T05:36:22.343972+0000","last_clean":"2024-09-17T05:36:22.343972+0000","last_became_active":"2024-09-17T05:36:21.366772+0000","last_became_peered":"2024-09-17T05:36:21.366772+0000","last_unstale":"2024-09-17T05:36:22.343972+0000","last_undegraded":"2024-09-17T05:36:22.343972+0000","last_fullsized":"2024-09-17T05:36:22.343972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:06.404204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342292+0000","last_change":"2024-09-17T05:36:17.340972+0000","last_active":"2024-09-17T05:36:22.342292+0000","last_peered":"2024-09-17T05:36:22.342292+0000","last_clean":"2024-09-17T05:36:22.342292+0000","last_became_active":"2024-09-17T05:36:17.340593+0000","last_became_peered":"2024-09-17T05:36:17.340593+0000","last_unstale":"2024-09-17T05:36:22.342292+0000","last_undegraded":"2024-09-17T05:36:22.342292+0000","last_fullsized":"2024-09-17T05:36:22.342292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:44.722774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981430+0000","last_change":"2024-09-17T05:36:16.335220+0000","last_active":"2024-09-17T05:36:22.981430+0000","last_peered":"2024-09-17T05:36:22.981430+0000","last_clean":"2024-09-17T05:36:22.981430+0000","last_became_active":"2024-09-17T05:36:16.334710+0000","last_became_peered":"2024-09-17T05:36:16.334710+0000","last_unstale":"2024-09-17T05:36:22.981430+0000","last_undegraded":"2024-09-17T05:36:22.981430+0000","last_fullsized":"2024-09-17T05:36:22.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:26.451376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528550+0000","last_change":"2024-09-17T05:36:21.375167+0000","last_active":"2024-09-17T05:36:23.528550+0000","last_peered":"2024-09-17T05:36:23.528550+0000","last_clean":"2024-09-17T05:36:23.528550+0000","last_became_active":"2024-09-17T05:36:21.374539+0000","last_became_peered":"2024-09-17T05:36:21.374539+0000","last_unstale":"2024-09-17T05:36:23.528550+0000","last_undegraded":"2024-09-17T05:36:23.528550+0000","last_fullsized":"2024-09-17T05:36:23.528550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:34.823660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343374+0000","last_change":"2024-09-17T05:36:17.334660+0000","last_active":"2024-09-17T05:36:22.343374+0000","last_peered":"2024-09-17T05:36:22.343374+0000","last_clean":"2024-09-17T05:36:22.343374+0000","last_became_active":"2024-09-17T05:36:17.334310+0000","last_became_peered":"2024-09-17T05:36:17.334310+0000","last_unstale":"2024-09-17T05:36:22.343374+0000","last_undegraded":"2024-09-17T05:36:22.343374+0000","last_fullsized":"2024-09-17T05:36:22.343374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981696+0000","last_change":"2024-09-17T05:36:16.328867+0000","last_active":"2024-09-17T05:36:22.981696+0000","last_peered":"2024-09-17T05:36:22.981696+0000","last_clean":"2024-09-17T05:36:22.981696+0000","last_became_active":"2024-09-17T05:36:16.328108+0000","last_became_peered":"2024-09-17T05:36:16.328108+0000","last_unstale":"2024-09-17T05:36:22.981696+0000","last_undegraded":"2024-09-17T05:36:22.981696+0000","last_fullsized":"2024-09-17T05:36:22.981696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526996+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:36:23.526996+0000","last_peered":"2024-09-17T05:36:23.526996+0000","last_clean":"2024-09-17T05:36:23.526996+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:36:23.526996+0000","last_undegraded":"2024-09-17T05:36:23.526996+0000","last_fullsized":"2024-09-17T05:36:23.526996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982083+0000","last_change":"2024-09-17T05:36:21.383242+0000","last_active":"2024-09-17T05:36:22.982083+0000","last_peered":"2024-09-17T05:36:22.982083+0000","last_clean":"2024-09-17T05:36:22.982083+0000","last_became_active":"2024-09-17T05:36:21.382738+0000","last_became_peered":"2024-09-17T05:36:21.382738+0000","last_unstale":"2024-09-17T05:36:22.982083+0000","last_undegraded":"2024-09-17T05:36:22.982083+0000","last_fullsized":"2024-09-17T05:36:22.982083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.889971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982006+0000","last_change":"2024-09-17T05:36:17.310411+0000","last_active":"2024-09-17T05:36:22.982006+0000","last_peered":"2024-09-17T05:36:22.982006+0000","last_clean":"2024-09-17T05:36:22.982006+0000","last_became_active":"2024-09-17T05:36:17.310092+0000","last_became_peered":"2024-09-17T05:36:17.310092+0000","last_unstale":"2024-09-17T05:36:22.982006+0000","last_undegraded":"2024-09-17T05:36:22.982006+0000","last_fullsized":"2024-09-17T05:36:22.982006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:30.785518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343432+0000","last_change":"2024-09-17T05:36:16.322081+0000","last_active":"2024-09-17T05:36:22.343432+0000","last_peered":"2024-09-17T05:36:22.343432+0000","last_clean":"2024-09-17T05:36:22.343432+0000","last_became_active":"2024-09-17T05:36:16.321784+0000","last_became_peered":"2024-09-17T05:36:16.321784+0000","last_unstale":"2024-09-17T05:36:22.343432+0000","last_undegraded":"2024-09-17T05:36:22.343432+0000","last_fullsized":"2024-09-17T05:36:22.343432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:00.321077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340797+0000","last_change":"2024-09-17T05:36:21.373176+0000","last_active":"2024-09-17T05:36:22.340797+0000","last_peered":"2024-09-17T05:36:22.340797+0000","last_clean":"2024-09-17T05:36:22.340797+0000","last_became_active":"2024-09-17T05:36:21.372030+0000","last_became_peered":"2024-09-17T05:36:21.372030+0000","last_unstale":"2024-09-17T05:36:22.340797+0000","last_undegraded":"2024-09-17T05:36:22.340797+0000","last_fullsized":"2024-09-17T05:36:22.340797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:42.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715087+0000","last_change":"2024-09-17T05:36:17.329006+0000","last_active":"2024-09-17T05:36:22.715087+0000","last_peered":"2024-09-17T05:36:22.715087+0000","last_clean":"2024-09-17T05:36:22.715087+0000","last_became_active":"2024-09-17T05:36:17.328683+0000","last_became_peered":"2024-09-17T05:36:17.328683+0000","last_unstale":"2024-09-17T05:36:22.715087+0000","last_undegraded":"2024-09-17T05:36:22.715087+0000","last_fullsized":"2024-09-17T05:36:22.715087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529439+0000","last_change":"2024-09-17T05:36:16.321759+0000","last_active":"2024-09-17T05:36:23.529439+0000","last_peered":"2024-09-17T05:36:23.529439+0000","last_clean":"2024-09-17T05:36:23.529439+0000","last_became_active":"2024-09-17T05:36:16.321356+0000","last_became_peered":"2024-09-17T05:36:16.321356+0000","last_unstale":"2024-09-17T05:36:23.529439+0000","last_undegraded":"2024-09-17T05:36:23.529439+0000","last_fullsized":"2024-09-17T05:36:23.529439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528292+0000","last_change":"2024-09-17T05:36:21.379637+0000","last_active":"2024-09-17T05:36:23.528292+0000","last_peered":"2024-09-17T05:36:23.528292+0000","last_clean":"2024-09-17T05:36:23.528292+0000","last_became_active":"2024-09-17T05:36:21.379220+0000","last_became_peered":"2024-09-17T05:36:21.379220+0000","last_unstale":"2024-09-17T05:36:23.528292+0000","last_undegraded":"2024-09-17T05:36:23.528292+0000","last_fullsized":"2024-09-17T05:36:23.528292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:11.229153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715278+0000","last_change":"2024-09-17T05:36:17.326522+0000","last_active":"2024-09-17T05:36:22.715278+0000","last_peered":"2024-09-17T05:36:22.715278+0000","last_clean":"2024-09-17T05:36:22.715278+0000","last_became_active":"2024-09-17T05:36:17.326199+0000","last_became_peered":"2024-09-17T05:36:17.326199+0000","last_unstale":"2024-09-17T05:36:22.715278+0000","last_undegraded":"2024-09-17T05:36:22.715278+0000","last_fullsized":"2024-09-17T05:36:22.715278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344595+0000","last_change":"2024-09-17T05:36:16.319960+0000","last_active":"2024-09-17T05:36:22.344595+0000","last_peered":"2024-09-17T05:36:22.344595+0000","last_clean":"2024-09-17T05:36:22.344595+0000","last_became_active":"2024-09-17T05:36:16.319686+0000","last_became_peered":"2024-09-17T05:36:16.319686+0000","last_unstale":"2024-09-17T05:36:22.344595+0000","last_undegraded":"2024-09-17T05:36:22.344595+0000","last_fullsized":"2024-09-17T05:36:22.344595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981056+0000","last_change":"2024-09-17T05:36:21.377298+0000","last_active":"2024-09-17T05:36:22.981056+0000","last_peered":"2024-09-17T05:36:22.981056+0000","last_clean":"2024-09-17T05:36:22.981056+0000","last_became_active":"2024-09-17T05:36:21.375463+0000","last_became_peered":"2024-09-17T05:36:21.375463+0000","last_unstale":"2024-09-17T05:36:22.981056+0000","last_undegraded":"2024-09-17T05:36:22.981056+0000","last_fullsized":"2024-09-17T05:36:22.981056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:39.055127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341881+0000","last_change":"2024-09-17T05:36:17.340442+0000","last_active":"2024-09-17T05:36:22.341881+0000","last_peered":"2024-09-17T05:36:22.341881+0000","last_clean":"2024-09-17T05:36:22.341881+0000","last_became_active":"2024-09-17T05:36:17.339752+0000","last_became_peered":"2024-09-17T05:36:17.339752+0000","last_unstale":"2024-09-17T05:36:22.341881+0000","last_undegraded":"2024-09-17T05:36:22.341881+0000","last_fullsized":"2024-09-17T05:36:22.341881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:22.275599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715407+0000","last_change":"2024-09-17T05:36:16.331663+0000","last_active":"2024-09-17T05:36:22.715407+0000","last_peered":"2024-09-17T05:36:22.715407+0000","last_clean":"2024-09-17T05:36:22.715407+0000","last_became_active":"2024-09-17T05:36:16.331428+0000","last_became_peered":"2024-09-17T05:36:16.331428+0000","last_unstale":"2024-09-17T05:36:22.715407+0000","last_undegraded":"2024-09-17T05:36:22.715407+0000","last_fullsized":"2024-09-17T05:36:22.715407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:50.759005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526933+0000","last_change":"2024-09-17T05:36:21.356148+0000","last_active":"2024-09-17T05:36:23.526933+0000","last_peered":"2024-09-17T05:36:23.526933+0000","last_clean":"2024-09-17T05:36:23.526933+0000","last_became_active":"2024-09-17T05:36:21.354594+0000","last_became_peered":"2024-09-17T05:36:21.354594+0000","last_unstale":"2024-09-17T05:36:23.526933+0000","last_undegraded":"2024-09-17T05:36:23.526933+0000","last_fullsized":"2024-09-17T05:36:23.526933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:46.831413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981160+0000","last_change":"2024-09-17T05:36:17.340510+0000","last_active":"2024-09-17T05:36:22.981160+0000","last_peered":"2024-09-17T05:36:22.981160+0000","last_clean":"2024-09-17T05:36:22.981160+0000","last_became_active":"2024-09-17T05:36:17.340124+0000","last_became_peered":"2024-09-17T05:36:17.340124+0000","last_unstale":"2024-09-17T05:36:22.981160+0000","last_undegraded":"2024-09-17T05:36:22.981160+0000","last_fullsized":"2024-09-17T05:36:22.981160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342894+0000","last_change":"2024-09-17T05:36:16.307077+0000","last_active":"2024-09-17T05:36:22.342894+0000","last_peered":"2024-09-17T05:36:22.342894+0000","last_clean":"2024-09-17T05:36:22.342894+0000","last_became_active":"2024-09-17T05:36:16.306568+0000","last_became_peered":"2024-09-17T05:36:16.306568+0000","last_unstale":"2024-09-17T05:36:22.342894+0000","last_undegraded":"2024-09-17T05:36:22.342894+0000","last_fullsized":"2024-09-17T05:36:22.342894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528731+0000","last_change":"2024-09-17T05:36:21.365391+0000","last_active":"2024-09-17T05:36:23.528731+0000","last_peered":"2024-09-17T05:36:23.528731+0000","last_clean":"2024-09-17T05:36:23.528731+0000","last_became_active":"2024-09-17T05:36:21.364791+0000","last_became_peered":"2024-09-17T05:36:21.364791+0000","last_unstale":"2024-09-17T05:36:23.528731+0000","last_undegraded":"2024-09-17T05:36:23.528731+0000","last_fullsized":"2024-09-17T05:36:23.528731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:04.502618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526809+0000","last_change":"2024-09-17T05:36:17.335760+0000","last_active":"2024-09-17T05:36:23.526809+0000","last_peered":"2024-09-17T05:36:23.526809+0000","last_clean":"2024-09-17T05:36:23.526809+0000","last_became_active":"2024-09-17T05:36:17.335388+0000","last_became_peered":"2024-09-17T05:36:17.335388+0000","last_unstale":"2024-09-17T05:36:23.526809+0000","last_undegraded":"2024-09-17T05:36:23.526809+0000","last_fullsized":"2024-09-17T05:36:23.526809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:27.462285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714588+0000","last_change":"2024-09-17T05:36:16.329939+0000","last_active":"2024-09-17T05:36:22.714588+0000","last_peered":"2024-09-17T05:36:22.714588+0000","last_clean":"2024-09-17T05:36:22.714588+0000","last_became_active":"2024-09-17T05:36:16.329632+0000","last_became_peered":"2024-09-17T05:36:16.329632+0000","last_unstale":"2024-09-17T05:36:22.714588+0000","last_undegraded":"2024-09-17T05:36:22.714588+0000","last_fullsized":"2024-09-17T05:36:22.714588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528745+0000","last_change":"2024-09-17T05:36:21.365043+0000","last_active":"2024-09-17T05:36:23.528745+0000","last_peered":"2024-09-17T05:36:23.528745+0000","last_clean":"2024-09-17T05:36:23.528745+0000","last_became_active":"2024-09-17T05:36:21.364610+0000","last_became_peered":"2024-09-17T05:36:21.364610+0000","last_unstale":"2024-09-17T05:36:23.528745+0000","last_undegraded":"2024-09-17T05:36:23.528745+0000","last_fullsized":"2024-09-17T05:36:23.528745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:55.108229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981556+0000","last_change":"2024-09-17T05:36:17.315566+0000","last_active":"2024-09-17T05:36:22.981556+0000","last_peered":"2024-09-17T05:36:22.981556+0000","last_clean":"2024-09-17T05:36:22.981556+0000","last_became_active":"2024-09-17T05:36:17.315280+0000","last_became_peered":"2024-09-17T05:36:17.315280+0000","last_unstale":"2024-09-17T05:36:22.981556+0000","last_undegraded":"2024-09-17T05:36:22.981556+0000","last_fullsized":"2024-09-17T05:36:22.981556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:07.191011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981531+0000","last_change":"2024-09-17T05:36:16.305788+0000","last_active":"2024-09-17T05:36:22.981531+0000","last_peered":"2024-09-17T05:36:22.981531+0000","last_clean":"2024-09-17T05:36:22.981531+0000","last_became_active":"2024-09-17T05:36:16.305404+0000","last_became_peered":"2024-09-17T05:36:16.305404+0000","last_unstale":"2024-09-17T05:36:22.981531+0000","last_undegraded":"2024-09-17T05:36:22.981531+0000","last_fullsized":"2024-09-17T05:36:22.981531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:55.852770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342770+0000","last_change":"2024-09-17T05:36:21.362271+0000","last_active":"2024-09-17T05:36:22.342770+0000","last_peered":"2024-09-17T05:36:22.342770+0000","last_clean":"2024-09-17T05:36:22.342770+0000","last_became_active":"2024-09-17T05:36:21.361775+0000","last_became_peered":"2024-09-17T05:36:21.361775+0000","last_unstale":"2024-09-17T05:36:22.342770+0000","last_undegraded":"2024-09-17T05:36:22.342770+0000","last_fullsized":"2024-09-17T05:36:22.342770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.770468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343845+0000","last_change":"2024-09-17T05:36:17.335234+0000","last_active":"2024-09-17T05:36:22.343845+0000","last_peered":"2024-09-17T05:36:22.343845+0000","last_clean":"2024-09-17T05:36:22.343845+0000","last_became_active":"2024-09-17T05:36:17.334898+0000","last_became_peered":"2024-09-17T05:36:17.334898+0000","last_unstale":"2024-09-17T05:36:22.343845+0000","last_undegraded":"2024-09-17T05:36:22.343845+0000","last_fullsized":"2024-09-17T05:36:22.343845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:29.554952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529339+0000","last_change":"2024-09-17T05:36:16.321488+0000","last_active":"2024-09-17T05:36:23.529339+0000","last_peered":"2024-09-17T05:36:23.529339+0000","last_clean":"2024-09-17T05:36:23.529339+0000","last_became_active":"2024-09-17T05:36:16.321104+0000","last_became_peered":"2024-09-17T05:36:16.321104+0000","last_unstale":"2024-09-17T05:36:23.529339+0000","last_undegraded":"2024-09-17T05:36:23.529339+0000","last_fullsized":"2024-09-17T05:36:23.529339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:51.739528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981857+0000","last_change":"2024-09-17T05:36:21.369908+0000","last_active":"2024-09-17T05:36:22.981857+0000","last_peered":"2024-09-17T05:36:22.981857+0000","last_clean":"2024-09-17T05:36:22.981857+0000","last_became_active":"2024-09-17T05:36:21.369460+0000","last_became_peered":"2024-09-17T05:36:21.369460+0000","last_unstale":"2024-09-17T05:36:22.981857+0000","last_undegraded":"2024-09-17T05:36:22.981857+0000","last_fullsized":"2024-09-17T05:36:22.981857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:57.419038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715227+0000","last_change":"2024-09-17T05:36:17.325334+0000","last_active":"2024-09-17T05:36:22.715227+0000","last_peered":"2024-09-17T05:36:22.715227+0000","last_clean":"2024-09-17T05:36:22.715227+0000","last_became_active":"2024-09-17T05:36:17.324663+0000","last_became_peered":"2024-09-17T05:36:17.324663+0000","last_unstale":"2024-09-17T05:36:22.715227+0000","last_undegraded":"2024-09-17T05:36:22.715227+0000","last_fullsized":"2024-09-17T05:36:22.715227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:28.454347+0000","last_change":"2024-09-17T05:36:16.313188+0000","last_active":"2024-09-17T05:36:28.454347+0000","last_peered":"2024-09-17T05:36:28.454347+0000","last_clean":"2024-09-17T05:36:28.454347+0000","last_became_active":"2024-09-17T05:36:16.312743+0000","last_became_peered":"2024-09-17T05:36:16.312743+0000","last_unstale":"2024-09-17T05:36:28.454347+0000","last_undegraded":"2024-09-17T05:36:28.454347+0000","last_fullsized":"2024-09-17T05:36:28.454347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:01.199020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343072+0000","last_change":"2024-09-17T05:36:21.364603+0000","last_active":"2024-09-17T05:36:22.343072+0000","last_peered":"2024-09-17T05:36:22.343072+0000","last_clean":"2024-09-17T05:36:22.343072+0000","last_became_active":"2024-09-17T05:36:21.359803+0000","last_became_peered":"2024-09-17T05:36:21.359803+0000","last_unstale":"2024-09-17T05:36:22.343072+0000","last_undegraded":"2024-09-17T05:36:22.343072+0000","last_fullsized":"2024-09-17T05:36:22.343072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:31.234403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981683+0000","last_change":"2024-09-17T05:36:17.333946+0000","last_active":"2024-09-17T05:36:22.981683+0000","last_peered":"2024-09-17T05:36:22.981683+0000","last_clean":"2024-09-17T05:36:22.981683+0000","last_became_active":"2024-09-17T05:36:17.333733+0000","last_became_peered":"2024-09-17T05:36:17.333733+0000","last_unstale":"2024-09-17T05:36:22.981683+0000","last_undegraded":"2024-09-17T05:36:22.981683+0000","last_fullsized":"2024-09-17T05:36:22.981683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:32.104558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529814+0000","last_change":"2024-09-17T05:36:16.312691+0000","last_active":"2024-09-17T05:36:23.529814+0000","last_peered":"2024-09-17T05:36:23.529814+0000","last_clean":"2024-09-17T05:36:23.529814+0000","last_became_active":"2024-09-17T05:36:16.312304+0000","last_became_peered":"2024-09-17T05:36:16.312304+0000","last_unstale":"2024-09-17T05:36:23.529814+0000","last_undegraded":"2024-09-17T05:36:23.529814+0000","last_fullsized":"2024-09-17T05:36:23.529814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341396+0000","last_change":"2024-09-17T05:36:21.375235+0000","last_active":"2024-09-17T05:36:22.341396+0000","last_peered":"2024-09-17T05:36:22.341396+0000","last_clean":"2024-09-17T05:36:22.341396+0000","last_became_active":"2024-09-17T05:36:21.374507+0000","last_became_peered":"2024-09-17T05:36:21.374507+0000","last_unstale":"2024-09-17T05:36:22.341396+0000","last_undegraded":"2024-09-17T05:36:22.341396+0000","last_fullsized":"2024-09-17T05:36:22.341396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:35.263335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528891+0000","last_change":"2024-09-17T05:36:17.338094+0000","last_active":"2024-09-17T05:36:23.528891+0000","last_peered":"2024-09-17T05:36:23.528891+0000","last_clean":"2024-09-17T05:36:23.528891+0000","last_became_active":"2024-09-17T05:36:17.337765+0000","last_became_peered":"2024-09-17T05:36:17.337765+0000","last_unstale":"2024-09-17T05:36:23.528891+0000","last_undegraded":"2024-09-17T05:36:23.528891+0000","last_fullsized":"2024-09-17T05:36:23.528891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715086+0000","last_change":"2024-09-17T05:36:16.327589+0000","last_active":"2024-09-17T05:36:22.715086+0000","last_peered":"2024-09-17T05:36:22.715086+0000","last_clean":"2024-09-17T05:36:22.715086+0000","last_became_active":"2024-09-17T05:36:16.327204+0000","last_became_peered":"2024-09-17T05:36:16.327204+0000","last_unstale":"2024-09-17T05:36:22.715086+0000","last_undegraded":"2024-09-17T05:36:22.715086+0000","last_fullsized":"2024-09-17T05:36:22.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527788+0000","last_change":"2024-09-17T05:36:21.387662+0000","last_active":"2024-09-17T05:36:23.527788+0000","last_peered":"2024-09-17T05:36:23.527788+0000","last_clean":"2024-09-17T05:36:23.527788+0000","last_became_active":"2024-09-17T05:36:21.387130+0000","last_became_peered":"2024-09-17T05:36:21.387130+0000","last_unstale":"2024-09-17T05:36:23.527788+0000","last_undegraded":"2024-09-17T05:36:23.527788+0000","last_fullsized":"2024-09-17T05:36:23.527788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:02.304238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341833+0000","last_change":"2024-09-17T05:36:17.340549+0000","last_active":"2024-09-17T05:36:22.341833+0000","last_peered":"2024-09-17T05:36:22.341833+0000","last_clean":"2024-09-17T05:36:22.341833+0000","last_became_active":"2024-09-17T05:36:17.339625+0000","last_became_peered":"2024-09-17T05:36:17.339625+0000","last_unstale":"2024-09-17T05:36:22.341833+0000","last_undegraded":"2024-09-17T05:36:22.341833+0000","last_fullsized":"2024-09-17T05:36:22.341833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:25.066974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527645+0000","last_change":"2024-09-17T05:36:16.298680+0000","last_active":"2024-09-17T05:36:23.527645+0000","last_peered":"2024-09-17T05:36:23.527645+0000","last_clean":"2024-09-17T05:36:23.527645+0000","last_became_active":"2024-09-17T05:36:16.298036+0000","last_became_peered":"2024-09-17T05:36:16.298036+0000","last_unstale":"2024-09-17T05:36:23.527645+0000","last_undegraded":"2024-09-17T05:36:23.527645+0000","last_fullsized":"2024-09-17T05:36:23.527645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:23.083593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342660+0000","last_change":"2024-09-17T05:36:21.368736+0000","last_active":"2024-09-17T05:36:22.342660+0000","last_peered":"2024-09-17T05:36:22.342660+0000","last_clean":"2024-09-17T05:36:22.342660+0000","last_became_active":"2024-09-17T05:36:21.367445+0000","last_became_peered":"2024-09-17T05:36:21.367445+0000","last_unstale":"2024-09-17T05:36:22.342660+0000","last_undegraded":"2024-09-17T05:36:22.342660+0000","last_fullsized":"2024-09-17T05:36:22.342660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:05.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344488+0000","last_change":"2024-09-17T05:36:21.363851+0000","last_active":"2024-09-17T05:36:22.344488+0000","last_peered":"2024-09-17T05:36:22.344488+0000","last_clean":"2024-09-17T05:36:22.344488+0000","last_became_active":"2024-09-17T05:36:21.363389+0000","last_became_peered":"2024-09-17T05:36:21.363389+0000","last_unstale":"2024-09-17T05:36:22.344488+0000","last_undegraded":"2024-09-17T05:36:22.344488+0000","last_fullsized":"2024-09-17T05:36:22.344488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:30.627064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342621+0000","last_change":"2024-09-17T05:36:17.327105+0000","last_active":"2024-09-17T05:36:22.342621+0000","last_peered":"2024-09-17T05:36:22.342621+0000","last_clean":"2024-09-17T05:36:22.342621+0000","last_became_active":"2024-09-17T05:36:17.326723+0000","last_became_peered":"2024-09-17T05:36:17.326723+0000","last_unstale":"2024-09-17T05:36:22.342621+0000","last_undegraded":"2024-09-17T05:36:22.342621+0000","last_fullsized":"2024-09-17T05:36:22.342621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:28.899717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981380+0000","last_change":"2024-09-17T05:36:16.333855+0000","last_active":"2024-09-17T05:36:22.981380+0000","last_peered":"2024-09-17T05:36:22.981380+0000","last_clean":"2024-09-17T05:36:22.981380+0000","last_became_active":"2024-09-17T05:36:16.327526+0000","last_became_peered":"2024-09-17T05:36:16.327526+0000","last_unstale":"2024-09-17T05:36:22.981380+0000","last_undegraded":"2024-09-17T05:36:22.981380+0000","last_fullsized":"2024-09-17T05:36:22.981380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982107+0000","last_change":"2024-09-17T05:36:21.382312+0000","last_active":"2024-09-17T05:36:22.982107+0000","last_peered":"2024-09-17T05:36:22.982107+0000","last_clean":"2024-09-17T05:36:22.982107+0000","last_became_active":"2024-09-17T05:36:21.381775+0000","last_became_peered":"2024-09-17T05:36:21.381775+0000","last_unstale":"2024-09-17T05:36:22.982107+0000","last_undegraded":"2024-09-17T05:36:22.982107+0000","last_fullsized":"2024-09-17T05:36:22.982107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:54.623675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527876+0000","last_change":"2024-09-17T05:36:17.336803+0000","last_active":"2024-09-17T05:36:23.527876+0000","last_peered":"2024-09-17T05:36:23.527876+0000","last_clean":"2024-09-17T05:36:23.527876+0000","last_became_active":"2024-09-17T05:36:17.336509+0000","last_became_peered":"2024-09-17T05:36:17.336509+0000","last_unstale":"2024-09-17T05:36:23.527876+0000","last_undegraded":"2024-09-17T05:36:23.527876+0000","last_fullsized":"2024-09-17T05:36:23.527876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342443+0000","last_change":"2024-09-17T05:36:16.319485+0000","last_active":"2024-09-17T05:36:22.342443+0000","last_peered":"2024-09-17T05:36:22.342443+0000","last_clean":"2024-09-17T05:36:22.342443+0000","last_became_active":"2024-09-17T05:36:16.319042+0000","last_became_peered":"2024-09-17T05:36:16.319042+0000","last_unstale":"2024-09-17T05:36:22.342443+0000","last_undegraded":"2024-09-17T05:36:22.342443+0000","last_fullsized":"2024-09-17T05:36:22.342443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.491679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981509+0000","last_change":"2024-09-17T05:36:16.323135+0000","last_active":"2024-09-17T05:36:22.981509+0000","last_peered":"2024-09-17T05:36:22.981509+0000","last_clean":"2024-09-17T05:36:22.981509+0000","last_became_active":"2024-09-17T05:36:16.322812+0000","last_became_peered":"2024-09-17T05:36:16.322812+0000","last_unstale":"2024-09-17T05:36:22.981509+0000","last_undegraded":"2024-09-17T05:36:22.981509+0000","last_fullsized":"2024-09-17T05:36:22.981509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:12.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343453+0000","last_change":"2024-09-17T05:36:17.323771+0000","last_active":"2024-09-17T05:36:22.343453+0000","last_peered":"2024-09-17T05:36:22.343453+0000","last_clean":"2024-09-17T05:36:22.343453+0000","last_became_active":"2024-09-17T05:36:17.323383+0000","last_became_peered":"2024-09-17T05:36:17.323383+0000","last_unstale":"2024-09-17T05:36:22.343453+0000","last_undegraded":"2024-09-17T05:36:22.343453+0000","last_fullsized":"2024-09-17T05:36:22.343453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343969+0000","last_change":"2024-09-17T05:36:21.364040+0000","last_active":"2024-09-17T05:36:22.343969+0000","last_peered":"2024-09-17T05:36:22.343969+0000","last_clean":"2024-09-17T05:36:22.343969+0000","last_became_active":"2024-09-17T05:36:21.363341+0000","last_became_peered":"2024-09-17T05:36:21.363341+0000","last_unstale":"2024-09-17T05:36:22.343969+0000","last_undegraded":"2024-09-17T05:36:22.343969+0000","last_fullsized":"2024-09-17T05:36:22.343969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:02.548547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528352+0000","last_change":"2024-09-17T05:36:16.316663+0000","last_active":"2024-09-17T05:36:23.528352+0000","last_peered":"2024-09-17T05:36:23.528352+0000","last_clean":"2024-09-17T05:36:23.528352+0000","last_became_active":"2024-09-17T05:36:16.316362+0000","last_became_peered":"2024-09-17T05:36:16.316362+0000","last_unstale":"2024-09-17T05:36:23.528352+0000","last_undegraded":"2024-09-17T05:36:23.528352+0000","last_fullsized":"2024-09-17T05:36:23.528352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526808+0000","last_change":"2024-09-17T05:36:17.310831+0000","last_active":"2024-09-17T05:36:23.526808+0000","last_peered":"2024-09-17T05:36:23.526808+0000","last_clean":"2024-09-17T05:36:23.526808+0000","last_became_active":"2024-09-17T05:36:17.309876+0000","last_became_peered":"2024-09-17T05:36:17.309876+0000","last_unstale":"2024-09-17T05:36:23.526808+0000","last_undegraded":"2024-09-17T05:36:23.526808+0000","last_fullsized":"2024-09-17T05:36:23.526808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:07.057468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529654+0000","last_change":"2024-09-17T05:36:21.379986+0000","last_active":"2024-09-17T05:36:23.529654+0000","last_peered":"2024-09-17T05:36:23.529654+0000","last_clean":"2024-09-17T05:36:23.529654+0000","last_became_active":"2024-09-17T05:36:21.379475+0000","last_became_peered":"2024-09-17T05:36:21.379475+0000","last_unstale":"2024-09-17T05:36:23.529654+0000","last_undegraded":"2024-09-17T05:36:23.529654+0000","last_fullsized":"2024-09-17T05:36:23.529654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:00.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341151+0000","last_change":"2024-09-17T05:36:17.321338+0000","last_active":"2024-09-17T05:36:22.341151+0000","last_peered":"2024-09-17T05:36:22.341151+0000","last_clean":"2024-09-17T05:36:22.341151+0000","last_became_active":"2024-09-17T05:36:17.320935+0000","last_became_peered":"2024-09-17T05:36:17.320935+0000","last_unstale":"2024-09-17T05:36:22.341151+0000","last_undegraded":"2024-09-17T05:36:22.341151+0000","last_fullsized":"2024-09-17T05:36:22.341151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528779+0000","last_change":"2024-09-17T05:36:17.344784+0000","last_active":"2024-09-17T05:36:23.528779+0000","last_peered":"2024-09-17T05:36:23.528779+0000","last_clean":"2024-09-17T05:36:23.528779+0000","last_became_active":"2024-09-17T05:36:17.344318+0000","last_became_peered":"2024-09-17T05:36:17.344318+0000","last_unstale":"2024-09-17T05:36:23.528779+0000","last_undegraded":"2024-09-17T05:36:23.528779+0000","last_fullsized":"2024-09-17T05:36:23.528779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981361+0000","last_change":"2024-09-17T05:36:17.330884+0000","last_active":"2024-09-17T05:36:22.981361+0000","last_peered":"2024-09-17T05:36:22.981361+0000","last_clean":"2024-09-17T05:36:22.981361+0000","last_became_active":"2024-09-17T05:36:17.330452+0000","last_became_peered":"2024-09-17T05:36:17.330452+0000","last_unstale":"2024-09-17T05:36:22.981361+0000","last_undegraded":"2024-09-17T05:36:22.981361+0000","last_fullsized":"2024-09-17T05:36:22.981361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:29.774698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528209+0000","last_change":"2024-09-17T05:36:17.328894+0000","last_active":"2024-09-17T05:36:23.528209+0000","last_peered":"2024-09-17T05:36:23.528209+0000","last_clean":"2024-09-17T05:36:23.528209+0000","last_became_active":"2024-09-17T05:36:17.327780+0000","last_became_peered":"2024-09-17T05:36:17.327780+0000","last_unstale":"2024-09-17T05:36:23.528209+0000","last_undegraded":"2024-09-17T05:36:23.528209+0000","last_fullsized":"2024-09-17T05:36:23.528209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343281+0000","last_change":"2024-09-17T05:36:17.332587+0000","last_active":"2024-09-17T05:36:22.343281+0000","last_peered":"2024-09-17T05:36:22.343281+0000","last_clean":"2024-09-17T05:36:22.343281+0000","last_became_active":"2024-09-17T05:36:17.332288+0000","last_became_peered":"2024-09-17T05:36:17.332288+0000","last_unstale":"2024-09-17T05:36:22.343281+0000","last_undegraded":"2024-09-17T05:36:22.343281+0000","last_fullsized":"2024-09-17T05:36:22.343281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:06.339627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343457+0000","last_change":"2024-09-17T05:36:17.332485+0000","last_active":"2024-09-17T05:36:22.343457+0000","last_peered":"2024-09-17T05:36:22.343457+0000","last_clean":"2024-09-17T05:36:22.343457+0000","last_became_active":"2024-09-17T05:36:17.332115+0000","last_became_peered":"2024-09-17T05:36:17.332115+0000","last_unstale":"2024-09-17T05:36:22.343457+0000","last_undegraded":"2024-09-17T05:36:22.343457+0000","last_fullsized":"2024-09-17T05:36:22.343457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:05.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341705+0000","last_change":"2024-09-17T05:36:17.340797+0000","last_active":"2024-09-17T05:36:22.341705+0000","last_peered":"2024-09-17T05:36:22.341705+0000","last_clean":"2024-09-17T05:36:22.341705+0000","last_became_active":"2024-09-17T05:36:17.340122+0000","last_became_peered":"2024-09-17T05:36:17.340122+0000","last_unstale":"2024-09-17T05:36:22.341705+0000","last_undegraded":"2024-09-17T05:36:22.341705+0000","last_fullsized":"2024-09-17T05:36:22.341705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:46.074621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528625+0000","last_change":"2024-09-17T05:36:17.346906+0000","last_active":"2024-09-17T05:36:23.528625+0000","last_peered":"2024-09-17T05:36:23.528625+0000","last_clean":"2024-09-17T05:36:23.528625+0000","last_became_active":"2024-09-17T05:36:17.340932+0000","last_became_peered":"2024-09-17T05:36:17.340932+0000","last_unstale":"2024-09-17T05:36:23.528625+0000","last_undegraded":"2024-09-17T05:36:23.528625+0000","last_fullsized":"2024-09-17T05:36:23.528625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981266+0000","last_change":"2024-09-17T05:36:17.346011+0000","last_active":"2024-09-17T05:36:22.981266+0000","last_peered":"2024-09-17T05:36:22.981266+0000","last_clean":"2024-09-17T05:36:22.981266+0000","last_became_active":"2024-09-17T05:36:17.345659+0000","last_became_peered":"2024-09-17T05:36:17.345659+0000","last_unstale":"2024-09-17T05:36:22.981266+0000","last_undegraded":"2024-09-17T05:36:22.981266+0000","last_fullsized":"2024-09-17T05:36:22.981266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527926+0000","last_change":"2024-09-17T05:36:17.339568+0000","last_active":"2024-09-17T05:36:23.527926+0000","last_peered":"2024-09-17T05:36:23.527926+0000","last_clean":"2024-09-17T05:36:23.527926+0000","last_became_active":"2024-09-17T05:36:17.339206+0000","last_became_peered":"2024-09-17T05:36:17.339206+0000","last_unstale":"2024-09-17T05:36:23.527926+0000","last_undegraded":"2024-09-17T05:36:23.527926+0000","last_fullsized":"2024-09-17T05:36:23.527926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526829+0000","last_change":"2024-09-17T05:36:17.319470+0000","last_active":"2024-09-17T05:36:23.526829+0000","last_peered":"2024-09-17T05:36:23.526829+0000","last_clean":"2024-09-17T05:36:23.526829+0000","last_became_active":"2024-09-17T05:36:17.319072+0000","last_became_peered":"2024-09-17T05:36:17.319072+0000","last_unstale":"2024-09-17T05:36:23.526829+0000","last_undegraded":"2024-09-17T05:36:23.526829+0000","last_fullsized":"2024-09-17T05:36:23.526829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:44.305630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343303+0000","last_change":"2024-09-17T05:36:17.335377+0000","last_active":"2024-09-17T05:36:22.343303+0000","last_peered":"2024-09-17T05:36:22.343303+0000","last_clean":"2024-09-17T05:36:22.343303+0000","last_became_active":"2024-09-17T05:36:17.335031+0000","last_became_peered":"2024-09-17T05:36:17.335031+0000","last_unstale":"2024-09-17T05:36:22.343303+0000","last_undegraded":"2024-09-17T05:36:22.343303+0000","last_fullsized":"2024-09-17T05:36:22.343303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:29.539404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715039+0000","last_change":"2024-09-17T05:36:17.326013+0000","last_active":"2024-09-17T05:36:22.715039+0000","last_peered":"2024-09-17T05:36:22.715039+0000","last_clean":"2024-09-17T05:36:22.715039+0000","last_became_active":"2024-09-17T05:36:17.325380+0000","last_became_peered":"2024-09-17T05:36:17.325380+0000","last_unstale":"2024-09-17T05:36:22.715039+0000","last_undegraded":"2024-09-17T05:36:22.715039+0000","last_fullsized":"2024-09-17T05:36:22.715039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982122+0000","last_change":"2024-09-17T05:36:17.322938+0000","last_active":"2024-09-17T05:36:22.982122+0000","last_peered":"2024-09-17T05:36:22.982122+0000","last_clean":"2024-09-17T05:36:22.982122+0000","last_became_active":"2024-09-17T05:36:17.322588+0000","last_became_peered":"2024-09-17T05:36:17.322588+0000","last_unstale":"2024-09-17T05:36:22.982122+0000","last_undegraded":"2024-09-17T05:36:22.982122+0000","last_fullsized":"2024-09-17T05:36:22.982122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:51.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529825+0000","last_change":"2024-09-17T05:36:17.347278+0000","last_active":"2024-09-17T05:36:23.529825+0000","last_peered":"2024-09-17T05:36:23.529825+0000","last_clean":"2024-09-17T05:36:23.529825+0000","last_became_active":"2024-09-17T05:36:17.346983+0000","last_became_peered":"2024-09-17T05:36:17.346983+0000","last_unstale":"2024-09-17T05:36:23.529825+0000","last_undegraded":"2024-09-17T05:36:23.529825+0000","last_fullsized":"2024-09-17T05:36:23.529825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982334+0000","last_change":"2024-09-17T05:36:17.328660+0000","last_active":"2024-09-17T05:36:22.982334+0000","last_peered":"2024-09-17T05:36:22.982334+0000","last_clean":"2024-09-17T05:36:22.982334+0000","last_became_active":"2024-09-17T05:36:17.324799+0000","last_became_peered":"2024-09-17T05:36:17.324799+0000","last_unstale":"2024-09-17T05:36:22.982334+0000","last_undegraded":"2024-09-17T05:36:22.982334+0000","last_fullsized":"2024-09-17T05:36:22.982334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:25.124191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981321+0000","last_change":"2024-09-17T05:36:17.323989+0000","last_active":"2024-09-17T05:36:22.981321+0000","last_peered":"2024-09-17T05:36:22.981321+0000","last_clean":"2024-09-17T05:36:22.981321+0000","last_became_active":"2024-09-17T05:36:17.321569+0000","last_became_peered":"2024-09-17T05:36:17.321569+0000","last_unstale":"2024-09-17T05:36:22.981321+0000","last_undegraded":"2024-09-17T05:36:22.981321+0000","last_fullsized":"2024-09-17T05:36:22.981321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527794+0000","last_change":"2024-09-17T05:36:17.329281+0000","last_active":"2024-09-17T05:36:23.527794+0000","last_peered":"2024-09-17T05:36:23.527794+0000","last_clean":"2024-09-17T05:36:23.527794+0000","last_became_active":"2024-09-17T05:36:17.328142+0000","last_became_peered":"2024-09-17T05:36:17.328142+0000","last_unstale":"2024-09-17T05:36:23.527794+0000","last_undegraded":"2024-09-17T05:36:23.527794+0000","last_fullsized":"2024-09-17T05:36:23.527794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343704+0000","last_change":"2024-09-17T05:36:17.331419+0000","last_active":"2024-09-17T05:36:22.343704+0000","last_peered":"2024-09-17T05:36:22.343704+0000","last_clean":"2024-09-17T05:36:22.343704+0000","last_became_active":"2024-09-17T05:36:17.330949+0000","last_became_peered":"2024-09-17T05:36:17.330949+0000","last_unstale":"2024-09-17T05:36:22.343704+0000","last_undegraded":"2024-09-17T05:36:22.343704+0000","last_fullsized":"2024-09-17T05:36:22.343704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:01.895132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342869+0000","last_change":"2024-09-17T05:36:17.337108+0000","last_active":"2024-09-17T05:36:22.342869+0000","last_peered":"2024-09-17T05:36:22.342869+0000","last_clean":"2024-09-17T05:36:22.342869+0000","last_became_active":"2024-09-17T05:36:17.330031+0000","last_became_peered":"2024-09-17T05:36:17.330031+0000","last_unstale":"2024-09-17T05:36:22.342869+0000","last_undegraded":"2024-09-17T05:36:22.342869+0000","last_fullsized":"2024-09-17T05:36:22.342869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:20.371899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714967+0000","last_change":"2024-09-17T05:36:17.326415+0000","last_active":"2024-09-17T05:36:22.714967+0000","last_peered":"2024-09-17T05:36:22.714967+0000","last_clean":"2024-09-17T05:36:22.714967+0000","last_became_active":"2024-09-17T05:36:17.325865+0000","last_became_peered":"2024-09-17T05:36:17.325865+0000","last_unstale":"2024-09-17T05:36:22.714967+0000","last_undegraded":"2024-09-17T05:36:22.714967+0000","last_fullsized":"2024-09-17T05:36:22.714967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715119+0000","last_change":"2024-09-17T05:36:17.324996+0000","last_active":"2024-09-17T05:36:22.715119+0000","last_peered":"2024-09-17T05:36:22.715119+0000","last_clean":"2024-09-17T05:36:22.715119+0000","last_became_active":"2024-09-17T05:36:17.324236+0000","last_became_peered":"2024-09-17T05:36:17.324236+0000","last_unstale":"2024-09-17T05:36:22.715119+0000","last_undegraded":"2024-09-17T05:36:22.715119+0000","last_fullsized":"2024-09-17T05:36:22.715119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714911+0000","last_change":"2024-09-17T05:36:17.344886+0000","last_active":"2024-09-17T05:36:22.714911+0000","last_peered":"2024-09-17T05:36:22.714911+0000","last_clean":"2024-09-17T05:36:22.714911+0000","last_became_active":"2024-09-17T05:36:17.344366+0000","last_became_peered":"2024-09-17T05:36:17.344366+0000","last_unstale":"2024-09-17T05:36:22.714911+0000","last_undegraded":"2024-09-17T05:36:22.714911+0000","last_fullsized":"2024-09-17T05:36:22.714911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:31.225193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527631+0000","last_change":"2024-09-17T05:36:17.315032+0000","last_active":"2024-09-17T05:36:23.527631+0000","last_peered":"2024-09-17T05:36:23.527631+0000","last_clean":"2024-09-17T05:36:23.527631+0000","last_became_active":"2024-09-17T05:36:17.313444+0000","last_became_peered":"2024-09-17T05:36:17.313444+0000","last_unstale":"2024-09-17T05:36:23.527631+0000","last_undegraded":"2024-09-17T05:36:23.527631+0000","last_fullsized":"2024-09-17T05:36:23.527631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:54.948931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527661+0000","last_change":"2024-09-17T05:36:17.334347+0000","last_active":"2024-09-17T05:36:23.527661+0000","last_peered":"2024-09-17T05:36:23.527661+0000","last_clean":"2024-09-17T05:36:23.527661+0000","last_became_active":"2024-09-17T05:36:17.328605+0000","last_became_peered":"2024-09-17T05:36:17.328605+0000","last_unstale":"2024-09-17T05:36:23.527661+0000","last_undegraded":"2024-09-17T05:36:23.527661+0000","last_fullsized":"2024-09-17T05:36:23.527661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714540+0000","last_change":"2024-09-17T05:36:17.317414+0000","last_active":"2024-09-17T05:36:22.714540+0000","last_peered":"2024-09-17T05:36:22.714540+0000","last_clean":"2024-09-17T05:36:22.714540+0000","last_became_active":"2024-09-17T05:36:17.316995+0000","last_became_peered":"2024-09-17T05:36:17.316995+0000","last_unstale":"2024-09-17T05:36:22.714540+0000","last_undegraded":"2024-09-17T05:36:22.714540+0000","last_fullsized":"2024-09-17T05:36:22.714540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341035+0000","last_change":"2024-09-17T05:36:17.338794+0000","last_active":"2024-09-17T05:36:22.341035+0000","last_peered":"2024-09-17T05:36:22.341035+0000","last_clean":"2024-09-17T05:36:22.341035+0000","last_became_active":"2024-09-17T05:36:17.338484+0000","last_became_peered":"2024-09-17T05:36:17.338484+0000","last_unstale":"2024-09-17T05:36:22.341035+0000","last_undegraded":"2024-09-17T05:36:22.341035+0000","last_fullsized":"2024-09-17T05:36:22.341035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:11.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714807+0000","last_change":"2024-09-17T05:36:17.338013+0000","last_active":"2024-09-17T05:36:22.714807+0000","last_peered":"2024-09-17T05:36:22.714807+0000","last_clean":"2024-09-17T05:36:22.714807+0000","last_became_active":"2024-09-17T05:36:17.336108+0000","last_became_peered":"2024-09-17T05:36:17.336108+0000","last_unstale":"2024-09-17T05:36:22.714807+0000","last_undegraded":"2024-09-17T05:36:22.714807+0000","last_fullsized":"2024-09-17T05:36:22.714807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340824+0000","last_change":"2024-09-17T05:36:17.338178+0000","last_active":"2024-09-17T05:36:22.340824+0000","last_peered":"2024-09-17T05:36:22.340824+0000","last_clean":"2024-09-17T05:36:22.340824+0000","last_became_active":"2024-09-17T05:36:17.332226+0000","last_became_peered":"2024-09-17T05:36:17.332226+0000","last_unstale":"2024-09-17T05:36:22.340824+0000","last_undegraded":"2024-09-17T05:36:22.340824+0000","last_fullsized":"2024-09-17T05:36:22.340824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529229+0000","last_change":"2024-09-17T05:36:17.339093+0000","last_active":"2024-09-17T05:36:23.529229+0000","last_peered":"2024-09-17T05:36:23.529229+0000","last_clean":"2024-09-17T05:36:23.529229+0000","last_became_active":"2024-09-17T05:36:17.338568+0000","last_became_peered":"2024-09-17T05:36:17.338568+0000","last_unstale":"2024-09-17T05:36:23.529229+0000","last_undegraded":"2024-09-17T05:36:23.529229+0000","last_fullsized":"2024-09-17T05:36:23.529229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528481+0000","last_change":"2024-09-17T05:36:17.339579+0000","last_active":"2024-09-17T05:36:23.528481+0000","last_peered":"2024-09-17T05:36:23.528481+0000","last_clean":"2024-09-17T05:36:23.528481+0000","last_became_active":"2024-09-17T05:36:17.339156+0000","last_became_peered":"2024-09-17T05:36:17.339156+0000","last_unstale":"2024-09-17T05:36:23.528481+0000","last_undegraded":"2024-09-17T05:36:23.528481+0000","last_fullsized":"2024-09-17T05:36:23.528481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715225+0000","last_change":"2024-09-17T05:36:17.334244+0000","last_active":"2024-09-17T05:36:22.715225+0000","last_peered":"2024-09-17T05:36:22.715225+0000","last_clean":"2024-09-17T05:36:22.715225+0000","last_became_active":"2024-09-17T05:36:17.333913+0000","last_became_peered":"2024-09-17T05:36:17.333913+0000","last_unstale":"2024-09-17T05:36:22.715225+0000","last_undegraded":"2024-09-17T05:36:22.715225+0000","last_fullsized":"2024-09-17T05:36:22.715225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:37.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:37.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 -- 172.21.15.44:0/675041691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc880cb470 msgr2=0x7fbc880cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 --2- 172.21.15.44:0/675041691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc880cb470 0x7fbc880cb880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009c80 tx=0x7fbc8001cb30 comp rx=0 tx=0).stop 2024-09-17T05:36:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 -- 172.21.15.44:0/675041691 shutdown_connections 2024-09-17T05:36:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 --2- 172.21.15.44:0/675041691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc880cb470 0x7fbc880cb880 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 --2- 172.21.15.44:0/675041691 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc8806de50 0x7fbc8806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 -- 172.21.15.44:0/675041691 >> 172.21.15.44:0/675041691 conn(0x7fbc880ccaa0 msgr2=0x7fbc880cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 -- 172.21.15.44:0/675041691 shutdown_connections 2024-09-17T05:36:37.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 -- 172.21.15.44:0/675041691 wait complete. 2024-09-17T05:36:37.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 Processor -- start 2024-09-17T05:36:37.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.438+0000 7fbc8f000640 1 -- start start 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc8806de50 0x7fbc880c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc88072e50 0x7fbc8815b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc880cb470 0x7fbc8815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbc88168ff0 con 0x7fbc8806de50 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbc88168e70 con 0x7fbc880cb470 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbc88169170 con 0x7fbc88072e50 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc8806de50 0x7fbc880c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc8806de50 0x7fbc880c2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49320/0 (socket says 172.21.15.44:49320) 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 -- 172.21.15.44:0/1439442662 learned_addr learned my addr 172.21.15.44:0/1439442662 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8d000640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc880cb470 0x7fbc8815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc7fe00640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc88072e50 0x7fbc8815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 -- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc88072e50 msgr2=0x7fbc8815b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc88072e50 0x7fbc8815b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 -- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc880cb470 msgr2=0x7fbc8815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc880cb470 0x7fbc8815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 -- 172.21.15.44:0/1439442662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc880b40a0 con 0x7fbc8806de50 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc87e00640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc8806de50 0x7fbc880c2e70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800b440 tx=0x7fbc7800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc84c00640 1 -- 172.21.15.44:0/1439442662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78015020 con 0x7fbc8806de50 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc84c00640 1 -- 172.21.15.44:0/1439442662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc78011980 con 0x7fbc8806de50 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc84c00640 1 -- 172.21.15.44:0/1439442662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78011dd0 con 0x7fbc8806de50 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc880b4380 con 0x7fbc8806de50 2024-09-17T05:36:37.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc880b4940 con 0x7fbc8806de50 2024-09-17T05:36:37.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.442+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc8806e260 con 0x7fbc8806de50 2024-09-17T05:36:37.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.446+0000 7fbc84c00640 1 -- 172.21.15.44:0/1439442662 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbc78018020 con 0x7fbc8806de50 2024-09-17T05:36:37.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.446+0000 7fbc84c00640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc64073230 0x7fbc64075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.446+0000 7fbc84c00640 1 -- 172.21.15.44:0/1439442662 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbc78094400 con 0x7fbc8806de50 2024-09-17T05:36:37.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.446+0000 7fbc7fe00640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc64073230 0x7fbc64075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.446+0000 7fbc7fe00640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc64073230 0x7fbc64075740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc8809f070 tx=0x7fbc70005d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.450+0000 7fbc84c00640 1 -- 172.21.15.44:0/1439442662 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbc7801f030 con 0x7fbc8806de50 2024-09-17T05:36:37.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.622+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc880b5fa0 con 0x7fbc64073230 2024-09-17T05:36:37.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.630+0000 7fbc84c00640 1 -- 172.21.15.44:0/1439442662 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332519 (secure 0 0 0) 0x7fbc880b5fa0 con 0x7fbc64073230 2024-09-17T05:36:37.633 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:37.635 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:36:37.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc64073230 msgr2=0x7fbc64075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc64073230 0x7fbc64075740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc8809f070 tx=0x7fbc70005d90 comp rx=0 tx=0).stop 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc8806de50 msgr2=0x7fbc880c2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc8806de50 0x7fbc880c2e70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800b440 tx=0x7fbc7800b900 comp rx=0 tx=0).stop 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 shutdown_connections 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc64073230 0x7fbc64075740 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc880cb470 0x7fbc8815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc88072e50 0x7fbc8815b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 --2- 172.21.15.44:0/1439442662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc8806de50 0x7fbc880c2e70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 >> 172.21.15.44:0/1439442662 conn(0x7fbc880ccaa0 msgr2=0x7fbc880b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 shutdown_connections 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.634+0000 7fbc8f000640 1 -- 172.21.15.44:0/1439442662 wait complete. 2024-09-17T05:36:37.654 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-17T05:36:36.262410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219556,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755164,"statfs":{"total":773094113280,"available":772869287936,"internally_reserved":0,"allocated":3416064,"data_stored":2037168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003926"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344741+0000","last_change":"2024-09-17T05:36:16.322687+0000","last_active":"2024-09-17T05:36:22.344741+0000","last_peered":"2024-09-17T05:36:22.344741+0000","last_clean":"2024-09-17T05:36:22.344741+0000","last_became_active":"2024-09-17T05:36:16.322327+0000","last_became_peered":"2024-09-17T05:36:16.322327+0000","last_unstale":"2024-09-17T05:36:22.344741+0000","last_undegraded":"2024-09-17T05:36:22.344741+0000","last_fullsized":"2024-09-17T05:36:22.344741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528771+0000","last_change":"2024-09-17T05:36:17.346577+0000","last_active":"2024-09-17T05:36:23.528771+0000","last_peered":"2024-09-17T05:36:23.528771+0000","last_clean":"2024-09-17T05:36:23.528771+0000","last_became_active":"2024-09-17T05:36:17.346190+0000","last_became_peered":"2024-09-17T05:36:17.346190+0000","last_unstale":"2024-09-17T05:36:23.528771+0000","last_undegraded":"2024-09-17T05:36:23.528771+0000","last_fullsized":"2024-09-17T05:36:23.528771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528503+0000","last_change":"2024-09-17T05:36:21.378187+0000","last_active":"2024-09-17T05:36:23.528503+0000","last_peered":"2024-09-17T05:36:23.528503+0000","last_clean":"2024-09-17T05:36:23.528503+0000","last_became_active":"2024-09-17T05:36:21.377733+0000","last_became_peered":"2024-09-17T05:36:21.377733+0000","last_unstale":"2024-09-17T05:36:23.528503+0000","last_undegraded":"2024-09-17T05:36:23.528503+0000","last_fullsized":"2024-09-17T05:36:23.528503+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:33.577546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528970+0000","last_change":"2024-09-17T05:36:16.318233+0000","last_active":"2024-09-17T05:36:23.528970+0000","last_peered":"2024-09-17T05:36:23.528970+0000","last_clean":"2024-09-17T05:36:23.528970+0000","last_became_active":"2024-09-17T05:36:16.316897+0000","last_became_peered":"2024-09-17T05:36:16.316897+0000","last_unstale":"2024-09-17T05:36:23.528970+0000","last_undegraded":"2024-09-17T05:36:23.528970+0000","last_fullsized":"2024-09-17T05:36:23.528970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528763+0000","last_change":"2024-09-17T05:36:17.337382+0000","last_active":"2024-09-17T05:36:23.528763+0000","last_peered":"2024-09-17T05:36:23.528763+0000","last_clean":"2024-09-17T05:36:23.528763+0000","last_became_active":"2024-09-17T05:36:17.330732+0000","last_became_peered":"2024-09-17T05:36:17.330732+0000","last_unstale":"2024-09-17T05:36:23.528763+0000","last_undegraded":"2024-09-17T05:36:23.528763+0000","last_fullsized":"2024-09-17T05:36:23.528763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:20.100003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340737+0000","last_change":"2024-09-17T05:36:21.371771+0000","last_active":"2024-09-17T05:36:22.340737+0000","last_peered":"2024-09-17T05:36:22.340737+0000","last_clean":"2024-09-17T05:36:22.340737+0000","last_became_active":"2024-09-17T05:36:21.370880+0000","last_became_peered":"2024-09-17T05:36:21.370880+0000","last_unstale":"2024-09-17T05:36:22.340737+0000","last_undegraded":"2024-09-17T05:36:22.340737+0000","last_fullsized":"2024-09-17T05:36:22.340737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:14.478542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715355+0000","last_change":"2024-09-17T05:36:16.327231+0000","last_active":"2024-09-17T05:36:22.715355+0000","last_peered":"2024-09-17T05:36:22.715355+0000","last_clean":"2024-09-17T05:36:22.715355+0000","last_became_active":"2024-09-17T05:36:16.326856+0000","last_became_peered":"2024-09-17T05:36:16.326856+0000","last_unstale":"2024-09-17T05:36:22.715355+0000","last_undegraded":"2024-09-17T05:36:22.715355+0000","last_fullsized":"2024-09-17T05:36:22.715355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:29.442629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527139+0000","last_change":"2024-09-17T05:36:17.331749+0000","last_active":"2024-09-17T05:36:23.527139+0000","last_peered":"2024-09-17T05:36:23.527139+0000","last_clean":"2024-09-17T05:36:23.527139+0000","last_became_active":"2024-09-17T05:36:17.329815+0000","last_became_peered":"2024-09-17T05:36:17.329815+0000","last_unstale":"2024-09-17T05:36:23.527139+0000","last_undegraded":"2024-09-17T05:36:23.527139+0000","last_fullsized":"2024-09-17T05:36:23.527139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:13.966029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341080+0000","last_change":"2024-09-17T05:36:21.372497+0000","last_active":"2024-09-17T05:36:22.341080+0000","last_peered":"2024-09-17T05:36:22.341080+0000","last_clean":"2024-09-17T05:36:22.341080+0000","last_became_active":"2024-09-17T05:36:21.372038+0000","last_became_peered":"2024-09-17T05:36:21.372038+0000","last_unstale":"2024-09-17T05:36:22.341080+0000","last_undegraded":"2024-09-17T05:36:22.341080+0000","last_fullsized":"2024-09-17T05:36:22.341080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:15.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715174+0000","last_change":"2024-09-17T05:36:16.328078+0000","last_active":"2024-09-17T05:36:22.715174+0000","last_peered":"2024-09-17T05:36:22.715174+0000","last_clean":"2024-09-17T05:36:22.715174+0000","last_became_active":"2024-09-17T05:36:16.327672+0000","last_became_peered":"2024-09-17T05:36:16.327672+0000","last_unstale":"2024-09-17T05:36:22.715174+0000","last_undegraded":"2024-09-17T05:36:22.715174+0000","last_fullsized":"2024-09-17T05:36:22.715174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981888+0000","last_change":"2024-09-17T05:36:17.316048+0000","last_active":"2024-09-17T05:36:22.981888+0000","last_peered":"2024-09-17T05:36:22.981888+0000","last_clean":"2024-09-17T05:36:22.981888+0000","last_became_active":"2024-09-17T05:36:17.315721+0000","last_became_peered":"2024-09-17T05:36:17.315721+0000","last_unstale":"2024-09-17T05:36:22.981888+0000","last_undegraded":"2024-09-17T05:36:22.981888+0000","last_fullsized":"2024-09-17T05:36:22.981888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:00.464476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340720+0000","last_change":"2024-09-17T05:36:21.373595+0000","last_active":"2024-09-17T05:36:22.340720+0000","last_peered":"2024-09-17T05:36:22.340720+0000","last_clean":"2024-09-17T05:36:22.340720+0000","last_became_active":"2024-09-17T05:36:21.372679+0000","last_became_peered":"2024-09-17T05:36:21.372679+0000","last_unstale":"2024-09-17T05:36:22.340720+0000","last_undegraded":"2024-09-17T05:36:22.340720+0000","last_fullsized":"2024-09-17T05:36:22.340720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:10.401214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981418+0000","last_change":"2024-09-17T05:36:17.308500+0000","last_active":"2024-09-17T05:36:22.981418+0000","last_peered":"2024-09-17T05:36:22.981418+0000","last_clean":"2024-09-17T05:36:22.981418+0000","last_became_active":"2024-09-17T05:36:17.303262+0000","last_became_peered":"2024-09-17T05:36:17.303262+0000","last_unstale":"2024-09-17T05:36:22.981418+0000","last_undegraded":"2024-09-17T05:36:22.981418+0000","last_fullsized":"2024-09-17T05:36:22.981418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:16.966266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981661+0000","last_change":"2024-09-17T05:36:16.333433+0000","last_active":"2024-09-17T05:36:22.981661+0000","last_peered":"2024-09-17T05:36:22.981661+0000","last_clean":"2024-09-17T05:36:22.981661+0000","last_became_active":"2024-09-17T05:36:16.328517+0000","last_became_peered":"2024-09-17T05:36:16.328517+0000","last_unstale":"2024-09-17T05:36:22.981661+0000","last_undegraded":"2024-09-17T05:36:22.981661+0000","last_fullsized":"2024-09-17T05:36:22.981661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:43.294722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981779+0000","last_change":"2024-09-17T05:36:21.377118+0000","last_active":"2024-09-17T05:36:22.981779+0000","last_peered":"2024-09-17T05:36:22.981779+0000","last_clean":"2024-09-17T05:36:22.981779+0000","last_became_active":"2024-09-17T05:36:21.376379+0000","last_became_peered":"2024-09-17T05:36:21.376379+0000","last_unstale":"2024-09-17T05:36:22.981779+0000","last_undegraded":"2024-09-17T05:36:22.981779+0000","last_fullsized":"2024-09-17T05:36:22.981779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:22.735617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529100+0000","last_change":"2024-09-17T05:36:17.344836+0000","last_active":"2024-09-17T05:36:23.529100+0000","last_peered":"2024-09-17T05:36:23.529100+0000","last_clean":"2024-09-17T05:36:23.529100+0000","last_became_active":"2024-09-17T05:36:17.343959+0000","last_became_peered":"2024-09-17T05:36:17.343959+0000","last_unstale":"2024-09-17T05:36:23.529100+0000","last_undegraded":"2024-09-17T05:36:23.529100+0000","last_fullsized":"2024-09-17T05:36:23.529100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343968+0000","last_change":"2024-09-17T05:36:16.321265+0000","last_active":"2024-09-17T05:36:22.343968+0000","last_peered":"2024-09-17T05:36:22.343968+0000","last_clean":"2024-09-17T05:36:22.343968+0000","last_became_active":"2024-09-17T05:36:16.320994+0000","last_became_peered":"2024-09-17T05:36:16.320994+0000","last_unstale":"2024-09-17T05:36:22.343968+0000","last_undegraded":"2024-09-17T05:36:22.343968+0000","last_fullsized":"2024-09-17T05:36:22.343968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:12.139048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714749+0000","last_change":"2024-09-17T05:36:21.363951+0000","last_active":"2024-09-17T05:36:22.714749+0000","last_peered":"2024-09-17T05:36:22.714749+0000","last_clean":"2024-09-17T05:36:22.714749+0000","last_became_active":"2024-09-17T05:36:21.363462+0000","last_became_peered":"2024-09-17T05:36:21.363462+0000","last_unstale":"2024-09-17T05:36:22.714749+0000","last_undegraded":"2024-09-17T05:36:22.714749+0000","last_fullsized":"2024-09-17T05:36:22.714749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:35.701351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342422+0000","last_change":"2024-09-17T05:36:17.337740+0000","last_active":"2024-09-17T05:36:22.342422+0000","last_peered":"2024-09-17T05:36:22.342422+0000","last_clean":"2024-09-17T05:36:22.342422+0000","last_became_active":"2024-09-17T05:36:17.332701+0000","last_became_peered":"2024-09-17T05:36:17.332701+0000","last_unstale":"2024-09-17T05:36:22.342422+0000","last_undegraded":"2024-09-17T05:36:22.342422+0000","last_fullsized":"2024-09-17T05:36:22.342422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:58.266096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342734+0000","last_change":"2024-09-17T05:36:16.316754+0000","last_active":"2024-09-17T05:36:22.342734+0000","last_peered":"2024-09-17T05:36:22.342734+0000","last_clean":"2024-09-17T05:36:22.342734+0000","last_became_active":"2024-09-17T05:36:16.316437+0000","last_became_peered":"2024-09-17T05:36:16.316437+0000","last_unstale":"2024-09-17T05:36:22.342734+0000","last_undegraded":"2024-09-17T05:36:22.342734+0000","last_fullsized":"2024-09-17T05:36:22.342734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529269+0000","last_change":"2024-09-17T05:36:21.387657+0000","last_active":"2024-09-17T05:36:23.529269+0000","last_peered":"2024-09-17T05:36:23.529269+0000","last_clean":"2024-09-17T05:36:23.529269+0000","last_became_active":"2024-09-17T05:36:21.387055+0000","last_became_peered":"2024-09-17T05:36:21.387055+0000","last_unstale":"2024-09-17T05:36:23.529269+0000","last_undegraded":"2024-09-17T05:36:23.529269+0000","last_fullsized":"2024-09-17T05:36:23.529269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:32.937859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981203+0000","last_change":"2024-09-17T05:36:17.322184+0000","last_active":"2024-09-17T05:36:22.981203+0000","last_peered":"2024-09-17T05:36:22.981203+0000","last_clean":"2024-09-17T05:36:22.981203+0000","last_became_active":"2024-09-17T05:36:17.320864+0000","last_became_peered":"2024-09-17T05:36:17.320864+0000","last_unstale":"2024-09-17T05:36:22.981203+0000","last_undegraded":"2024-09-17T05:36:22.981203+0000","last_fullsized":"2024-09-17T05:36:22.981203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714387+0000","last_change":"2024-09-17T05:36:16.317147+0000","last_active":"2024-09-17T05:36:22.714387+0000","last_peered":"2024-09-17T05:36:22.714387+0000","last_clean":"2024-09-17T05:36:22.714387+0000","last_became_active":"2024-09-17T05:36:16.316600+0000","last_became_peered":"2024-09-17T05:36:16.316600+0000","last_unstale":"2024-09-17T05:36:22.714387+0000","last_undegraded":"2024-09-17T05:36:22.714387+0000","last_fullsized":"2024-09-17T05:36:22.714387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341697+0000","last_change":"2024-09-17T05:36:21.366149+0000","last_active":"2024-09-17T05:36:22.341697+0000","last_peered":"2024-09-17T05:36:22.341697+0000","last_clean":"2024-09-17T05:36:22.341697+0000","last_became_active":"2024-09-17T05:36:21.365665+0000","last_became_peered":"2024-09-17T05:36:21.365665+0000","last_unstale":"2024-09-17T05:36:22.341697+0000","last_undegraded":"2024-09-17T05:36:22.341697+0000","last_fullsized":"2024-09-17T05:36:22.341697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:04.721488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344454+0000","last_change":"2024-09-17T05:36:17.334934+0000","last_active":"2024-09-17T05:36:22.344454+0000","last_peered":"2024-09-17T05:36:22.344454+0000","last_clean":"2024-09-17T05:36:22.344454+0000","last_became_active":"2024-09-17T05:36:17.334132+0000","last_became_peered":"2024-09-17T05:36:17.334132+0000","last_unstale":"2024-09-17T05:36:22.344454+0000","last_undegraded":"2024-09-17T05:36:22.344454+0000","last_fullsized":"2024-09-17T05:36:22.344454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982376+0000","last_change":"2024-09-17T05:36:16.325337+0000","last_active":"2024-09-17T05:36:22.982376+0000","last_peered":"2024-09-17T05:36:22.982376+0000","last_clean":"2024-09-17T05:36:22.982376+0000","last_became_active":"2024-09-17T05:36:16.322984+0000","last_became_peered":"2024-09-17T05:36:16.322984+0000","last_unstale":"2024-09-17T05:36:22.982376+0000","last_undegraded":"2024-09-17T05:36:22.982376+0000","last_fullsized":"2024-09-17T05:36:22.982376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:06.046560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341200+0000","last_change":"2024-09-17T05:36:21.358756+0000","last_active":"2024-09-17T05:36:22.341200+0000","last_peered":"2024-09-17T05:36:22.341200+0000","last_clean":"2024-09-17T05:36:22.341200+0000","last_became_active":"2024-09-17T05:36:21.358225+0000","last_became_peered":"2024-09-17T05:36:21.358225+0000","last_unstale":"2024-09-17T05:36:22.341200+0000","last_undegraded":"2024-09-17T05:36:22.341200+0000","last_fullsized":"2024-09-17T05:36:22.341200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:10.794511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344614+0000","last_change":"2024-09-17T05:36:17.321481+0000","last_active":"2024-09-17T05:36:22.344614+0000","last_peered":"2024-09-17T05:36:22.344614+0000","last_clean":"2024-09-17T05:36:22.344614+0000","last_became_active":"2024-09-17T05:36:17.321132+0000","last_became_peered":"2024-09-17T05:36:17.321132+0000","last_unstale":"2024-09-17T05:36:22.344614+0000","last_undegraded":"2024-09-17T05:36:22.344614+0000","last_fullsized":"2024-09-17T05:36:22.344614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344664+0000","last_change":"2024-09-17T05:36:16.314881+0000","last_active":"2024-09-17T05:36:22.344664+0000","last_peered":"2024-09-17T05:36:22.344664+0000","last_clean":"2024-09-17T05:36:22.344664+0000","last_became_active":"2024-09-17T05:36:16.314473+0000","last_became_peered":"2024-09-17T05:36:16.314473+0000","last_unstale":"2024-09-17T05:36:22.344664+0000","last_undegraded":"2024-09-17T05:36:22.344664+0000","last_fullsized":"2024-09-17T05:36:22.344664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:34.851574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342176+0000","last_change":"2024-09-17T05:36:21.359463+0000","last_active":"2024-09-17T05:36:22.342176+0000","last_peered":"2024-09-17T05:36:22.342176+0000","last_clean":"2024-09-17T05:36:22.342176+0000","last_became_active":"2024-09-17T05:36:21.358945+0000","last_became_peered":"2024-09-17T05:36:21.358945+0000","last_unstale":"2024-09-17T05:36:22.342176+0000","last_undegraded":"2024-09-17T05:36:22.342176+0000","last_fullsized":"2024-09-17T05:36:22.342176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:16.789795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343353+0000","last_change":"2024-09-17T05:36:17.352141+0000","last_active":"2024-09-17T05:36:22.343353+0000","last_peered":"2024-09-17T05:36:22.343353+0000","last_clean":"2024-09-17T05:36:22.343353+0000","last_became_active":"2024-09-17T05:36:17.351766+0000","last_became_peered":"2024-09-17T05:36:17.351766+0000","last_unstale":"2024-09-17T05:36:22.343353+0000","last_undegraded":"2024-09-17T05:36:22.343353+0000","last_fullsized":"2024-09-17T05:36:22.343353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:50.090463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982180+0000","last_change":"2024-09-17T05:36:16.321568+0000","last_active":"2024-09-17T05:36:22.982180+0000","last_peered":"2024-09-17T05:36:22.982180+0000","last_clean":"2024-09-17T05:36:22.982180+0000","last_became_active":"2024-09-17T05:36:16.321260+0000","last_became_peered":"2024-09-17T05:36:16.321260+0000","last_unstale":"2024-09-17T05:36:22.982180+0000","last_undegraded":"2024-09-17T05:36:22.982180+0000","last_fullsized":"2024-09-17T05:36:22.982180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:57.255187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342554+0000","last_change":"2024-09-17T05:36:21.368740+0000","last_active":"2024-09-17T05:36:22.342554+0000","last_peered":"2024-09-17T05:36:22.342554+0000","last_clean":"2024-09-17T05:36:22.342554+0000","last_became_active":"2024-09-17T05:36:21.367320+0000","last_became_peered":"2024-09-17T05:36:21.367320+0000","last_unstale":"2024-09-17T05:36:22.342554+0000","last_undegraded":"2024-09-17T05:36:22.342554+0000","last_fullsized":"2024-09-17T05:36:22.342554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:31.367750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340925+0000","last_change":"2024-09-17T05:36:17.324299+0000","last_active":"2024-09-17T05:36:22.340925+0000","last_peered":"2024-09-17T05:36:22.340925+0000","last_clean":"2024-09-17T05:36:22.340925+0000","last_became_active":"2024-09-17T05:36:17.323941+0000","last_became_peered":"2024-09-17T05:36:17.323941+0000","last_unstale":"2024-09-17T05:36:22.340925+0000","last_undegraded":"2024-09-17T05:36:22.340925+0000","last_fullsized":"2024-09-17T05:36:22.340925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:30.453537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528295+0000","last_change":"2024-09-17T05:36:16.318757+0000","last_active":"2024-09-17T05:36:23.528295+0000","last_peered":"2024-09-17T05:36:23.528295+0000","last_clean":"2024-09-17T05:36:23.528295+0000","last_became_active":"2024-09-17T05:36:16.318452+0000","last_became_peered":"2024-09-17T05:36:16.318452+0000","last_unstale":"2024-09-17T05:36:23.528295+0000","last_undegraded":"2024-09-17T05:36:23.528295+0000","last_fullsized":"2024-09-17T05:36:23.528295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342943+0000","last_change":"2024-09-17T05:36:21.374533+0000","last_active":"2024-09-17T05:36:22.342943+0000","last_peered":"2024-09-17T05:36:22.342943+0000","last_clean":"2024-09-17T05:36:22.342943+0000","last_became_active":"2024-09-17T05:36:21.373222+0000","last_became_peered":"2024-09-17T05:36:21.373222+0000","last_unstale":"2024-09-17T05:36:22.342943+0000","last_undegraded":"2024-09-17T05:36:22.342943+0000","last_fullsized":"2024-09-17T05:36:22.342943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:51.191726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714674+0000","last_change":"2024-09-17T05:36:17.336498+0000","last_active":"2024-09-17T05:36:22.714674+0000","last_peered":"2024-09-17T05:36:22.714674+0000","last_clean":"2024-09-17T05:36:22.714674+0000","last_became_active":"2024-09-17T05:36:17.335606+0000","last_became_peered":"2024-09-17T05:36:17.335606+0000","last_unstale":"2024-09-17T05:36:22.714674+0000","last_undegraded":"2024-09-17T05:36:22.714674+0000","last_fullsized":"2024-09-17T05:36:22.714674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981647+0000","last_change":"2024-09-17T05:36:16.307663+0000","last_active":"2024-09-17T05:36:22.981647+0000","last_peered":"2024-09-17T05:36:22.981647+0000","last_clean":"2024-09-17T05:36:22.981647+0000","last_became_active":"2024-09-17T05:36:16.307264+0000","last_became_peered":"2024-09-17T05:36:16.307264+0000","last_unstale":"2024-09-17T05:36:22.981647+0000","last_undegraded":"2024-09-17T05:36:22.981647+0000","last_fullsized":"2024-09-17T05:36:22.981647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:19.042460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343190+0000","last_change":"2024-09-17T05:36:21.372969+0000","last_active":"2024-09-17T05:36:22.343190+0000","last_peered":"2024-09-17T05:36:22.343190+0000","last_clean":"2024-09-17T05:36:22.343190+0000","last_became_active":"2024-09-17T05:36:21.368548+0000","last_became_peered":"2024-09-17T05:36:21.368548+0000","last_unstale":"2024-09-17T05:36:22.343190+0000","last_undegraded":"2024-09-17T05:36:22.343190+0000","last_fullsized":"2024-09-17T05:36:22.343190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:44.206523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527667+0000","last_change":"2024-09-17T05:36:17.328522+0000","last_active":"2024-09-17T05:36:23.527667+0000","last_peered":"2024-09-17T05:36:23.527667+0000","last_clean":"2024-09-17T05:36:23.527667+0000","last_became_active":"2024-09-17T05:36:17.327985+0000","last_became_peered":"2024-09-17T05:36:17.327985+0000","last_unstale":"2024-09-17T05:36:23.527667+0000","last_undegraded":"2024-09-17T05:36:23.527667+0000","last_fullsized":"2024-09-17T05:36:23.527667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528925+0000","last_change":"2024-09-17T05:36:16.316486+0000","last_active":"2024-09-17T05:36:23.528925+0000","last_peered":"2024-09-17T05:36:23.528925+0000","last_clean":"2024-09-17T05:36:23.528925+0000","last_became_active":"2024-09-17T05:36:16.316098+0000","last_became_peered":"2024-09-17T05:36:16.316098+0000","last_unstale":"2024-09-17T05:36:23.528925+0000","last_undegraded":"2024-09-17T05:36:23.528925+0000","last_fullsized":"2024-09-17T05:36:23.528925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343972+0000","last_change":"2024-09-17T05:36:21.369648+0000","last_active":"2024-09-17T05:36:22.343972+0000","last_peered":"2024-09-17T05:36:22.343972+0000","last_clean":"2024-09-17T05:36:22.343972+0000","last_became_active":"2024-09-17T05:36:21.366772+0000","last_became_peered":"2024-09-17T05:36:21.366772+0000","last_unstale":"2024-09-17T05:36:22.343972+0000","last_undegraded":"2024-09-17T05:36:22.343972+0000","last_fullsized":"2024-09-17T05:36:22.343972+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:06.404204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342292+0000","last_change":"2024-09-17T05:36:17.340972+0000","last_active":"2024-09-17T05:36:22.342292+0000","last_peered":"2024-09-17T05:36:22.342292+0000","last_clean":"2024-09-17T05:36:22.342292+0000","last_became_active":"2024-09-17T05:36:17.340593+0000","last_became_peered":"2024-09-17T05:36:17.340593+0000","last_unstale":"2024-09-17T05:36:22.342292+0000","last_undegraded":"2024-09-17T05:36:22.342292+0000","last_fullsized":"2024-09-17T05:36:22.342292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:44.722774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981430+0000","last_change":"2024-09-17T05:36:16.335220+0000","last_active":"2024-09-17T05:36:22.981430+0000","last_peered":"2024-09-17T05:36:22.981430+0000","last_clean":"2024-09-17T05:36:22.981430+0000","last_became_active":"2024-09-17T05:36:16.334710+0000","last_became_peered":"2024-09-17T05:36:16.334710+0000","last_unstale":"2024-09-17T05:36:22.981430+0000","last_undegraded":"2024-09-17T05:36:22.981430+0000","last_fullsized":"2024-09-17T05:36:22.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:26.451376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528550+0000","last_change":"2024-09-17T05:36:21.375167+0000","last_active":"2024-09-17T05:36:23.528550+0000","last_peered":"2024-09-17T05:36:23.528550+0000","last_clean":"2024-09-17T05:36:23.528550+0000","last_became_active":"2024-09-17T05:36:21.374539+0000","last_became_peered":"2024-09-17T05:36:21.374539+0000","last_unstale":"2024-09-17T05:36:23.528550+0000","last_undegraded":"2024-09-17T05:36:23.528550+0000","last_fullsized":"2024-09-17T05:36:23.528550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:34.823660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343374+0000","last_change":"2024-09-17T05:36:17.334660+0000","last_active":"2024-09-17T05:36:22.343374+0000","last_peered":"2024-09-17T05:36:22.343374+0000","last_clean":"2024-09-17T05:36:22.343374+0000","last_became_active":"2024-09-17T05:36:17.334310+0000","last_became_peered":"2024-09-17T05:36:17.334310+0000","last_unstale":"2024-09-17T05:36:22.343374+0000","last_undegraded":"2024-09-17T05:36:22.343374+0000","last_fullsized":"2024-09-17T05:36:22.343374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:56.571809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981696+0000","last_change":"2024-09-17T05:36:16.328867+0000","last_active":"2024-09-17T05:36:22.981696+0000","last_peered":"2024-09-17T05:36:22.981696+0000","last_clean":"2024-09-17T05:36:22.981696+0000","last_became_active":"2024-09-17T05:36:16.328108+0000","last_became_peered":"2024-09-17T05:36:16.328108+0000","last_unstale":"2024-09-17T05:36:22.981696+0000","last_undegraded":"2024-09-17T05:36:22.981696+0000","last_fullsized":"2024-09-17T05:36:22.981696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526996+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:36:23.526996+0000","last_peered":"2024-09-17T05:36:23.526996+0000","last_clean":"2024-09-17T05:36:23.526996+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:36:23.526996+0000","last_undegraded":"2024-09-17T05:36:23.526996+0000","last_fullsized":"2024-09-17T05:36:23.526996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982083+0000","last_change":"2024-09-17T05:36:21.383242+0000","last_active":"2024-09-17T05:36:22.982083+0000","last_peered":"2024-09-17T05:36:22.982083+0000","last_clean":"2024-09-17T05:36:22.982083+0000","last_became_active":"2024-09-17T05:36:21.382738+0000","last_became_peered":"2024-09-17T05:36:21.382738+0000","last_unstale":"2024-09-17T05:36:22.982083+0000","last_undegraded":"2024-09-17T05:36:22.982083+0000","last_fullsized":"2024-09-17T05:36:22.982083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.889971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982006+0000","last_change":"2024-09-17T05:36:17.310411+0000","last_active":"2024-09-17T05:36:22.982006+0000","last_peered":"2024-09-17T05:36:22.982006+0000","last_clean":"2024-09-17T05:36:22.982006+0000","last_became_active":"2024-09-17T05:36:17.310092+0000","last_became_peered":"2024-09-17T05:36:17.310092+0000","last_unstale":"2024-09-17T05:36:22.982006+0000","last_undegraded":"2024-09-17T05:36:22.982006+0000","last_fullsized":"2024-09-17T05:36:22.982006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:30.785518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343432+0000","last_change":"2024-09-17T05:36:16.322081+0000","last_active":"2024-09-17T05:36:22.343432+0000","last_peered":"2024-09-17T05:36:22.343432+0000","last_clean":"2024-09-17T05:36:22.343432+0000","last_became_active":"2024-09-17T05:36:16.321784+0000","last_became_peered":"2024-09-17T05:36:16.321784+0000","last_unstale":"2024-09-17T05:36:22.343432+0000","last_undegraded":"2024-09-17T05:36:22.343432+0000","last_fullsized":"2024-09-17T05:36:22.343432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:00.321077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340797+0000","last_change":"2024-09-17T05:36:21.373176+0000","last_active":"2024-09-17T05:36:22.340797+0000","last_peered":"2024-09-17T05:36:22.340797+0000","last_clean":"2024-09-17T05:36:22.340797+0000","last_became_active":"2024-09-17T05:36:21.372030+0000","last_became_peered":"2024-09-17T05:36:21.372030+0000","last_unstale":"2024-09-17T05:36:22.340797+0000","last_undegraded":"2024-09-17T05:36:22.340797+0000","last_fullsized":"2024-09-17T05:36:22.340797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:42.503816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715087+0000","last_change":"2024-09-17T05:36:17.329006+0000","last_active":"2024-09-17T05:36:22.715087+0000","last_peered":"2024-09-17T05:36:22.715087+0000","last_clean":"2024-09-17T05:36:22.715087+0000","last_became_active":"2024-09-17T05:36:17.328683+0000","last_became_peered":"2024-09-17T05:36:17.328683+0000","last_unstale":"2024-09-17T05:36:22.715087+0000","last_undegraded":"2024-09-17T05:36:22.715087+0000","last_fullsized":"2024-09-17T05:36:22.715087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529439+0000","last_change":"2024-09-17T05:36:16.321759+0000","last_active":"2024-09-17T05:36:23.529439+0000","last_peered":"2024-09-17T05:36:23.529439+0000","last_clean":"2024-09-17T05:36:23.529439+0000","last_became_active":"2024-09-17T05:36:16.321356+0000","last_became_peered":"2024-09-17T05:36:16.321356+0000","last_unstale":"2024-09-17T05:36:23.529439+0000","last_undegraded":"2024-09-17T05:36:23.529439+0000","last_fullsized":"2024-09-17T05:36:23.529439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:44.911266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528292+0000","last_change":"2024-09-17T05:36:21.379637+0000","last_active":"2024-09-17T05:36:23.528292+0000","last_peered":"2024-09-17T05:36:23.528292+0000","last_clean":"2024-09-17T05:36:23.528292+0000","last_became_active":"2024-09-17T05:36:21.379220+0000","last_became_peered":"2024-09-17T05:36:21.379220+0000","last_unstale":"2024-09-17T05:36:23.528292+0000","last_undegraded":"2024-09-17T05:36:23.528292+0000","last_fullsized":"2024-09-17T05:36:23.528292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:11.229153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715278+0000","last_change":"2024-09-17T05:36:17.326522+0000","last_active":"2024-09-17T05:36:22.715278+0000","last_peered":"2024-09-17T05:36:22.715278+0000","last_clean":"2024-09-17T05:36:22.715278+0000","last_became_active":"2024-09-17T05:36:17.326199+0000","last_became_peered":"2024-09-17T05:36:17.326199+0000","last_unstale":"2024-09-17T05:36:22.715278+0000","last_undegraded":"2024-09-17T05:36:22.715278+0000","last_fullsized":"2024-09-17T05:36:22.715278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344595+0000","last_change":"2024-09-17T05:36:16.319960+0000","last_active":"2024-09-17T05:36:22.344595+0000","last_peered":"2024-09-17T05:36:22.344595+0000","last_clean":"2024-09-17T05:36:22.344595+0000","last_became_active":"2024-09-17T05:36:16.319686+0000","last_became_peered":"2024-09-17T05:36:16.319686+0000","last_unstale":"2024-09-17T05:36:22.344595+0000","last_undegraded":"2024-09-17T05:36:22.344595+0000","last_fullsized":"2024-09-17T05:36:22.344595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981056+0000","last_change":"2024-09-17T05:36:21.377298+0000","last_active":"2024-09-17T05:36:22.981056+0000","last_peered":"2024-09-17T05:36:22.981056+0000","last_clean":"2024-09-17T05:36:22.981056+0000","last_became_active":"2024-09-17T05:36:21.375463+0000","last_became_peered":"2024-09-17T05:36:21.375463+0000","last_unstale":"2024-09-17T05:36:22.981056+0000","last_undegraded":"2024-09-17T05:36:22.981056+0000","last_fullsized":"2024-09-17T05:36:22.981056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:39.055127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341881+0000","last_change":"2024-09-17T05:36:17.340442+0000","last_active":"2024-09-17T05:36:22.341881+0000","last_peered":"2024-09-17T05:36:22.341881+0000","last_clean":"2024-09-17T05:36:22.341881+0000","last_became_active":"2024-09-17T05:36:17.339752+0000","last_became_peered":"2024-09-17T05:36:17.339752+0000","last_unstale":"2024-09-17T05:36:22.341881+0000","last_undegraded":"2024-09-17T05:36:22.341881+0000","last_fullsized":"2024-09-17T05:36:22.341881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:22.275599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715407+0000","last_change":"2024-09-17T05:36:16.331663+0000","last_active":"2024-09-17T05:36:22.715407+0000","last_peered":"2024-09-17T05:36:22.715407+0000","last_clean":"2024-09-17T05:36:22.715407+0000","last_became_active":"2024-09-17T05:36:16.331428+0000","last_became_peered":"2024-09-17T05:36:16.331428+0000","last_unstale":"2024-09-17T05:36:22.715407+0000","last_undegraded":"2024-09-17T05:36:22.715407+0000","last_fullsized":"2024-09-17T05:36:22.715407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:50.759005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526933+0000","last_change":"2024-09-17T05:36:21.356148+0000","last_active":"2024-09-17T05:36:23.526933+0000","last_peered":"2024-09-17T05:36:23.526933+0000","last_clean":"2024-09-17T05:36:23.526933+0000","last_became_active":"2024-09-17T05:36:21.354594+0000","last_became_peered":"2024-09-17T05:36:21.354594+0000","last_unstale":"2024-09-17T05:36:23.526933+0000","last_undegraded":"2024-09-17T05:36:23.526933+0000","last_fullsized":"2024-09-17T05:36:23.526933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:46.831413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981160+0000","last_change":"2024-09-17T05:36:17.340510+0000","last_active":"2024-09-17T05:36:22.981160+0000","last_peered":"2024-09-17T05:36:22.981160+0000","last_clean":"2024-09-17T05:36:22.981160+0000","last_became_active":"2024-09-17T05:36:17.340124+0000","last_became_peered":"2024-09-17T05:36:17.340124+0000","last_unstale":"2024-09-17T05:36:22.981160+0000","last_undegraded":"2024-09-17T05:36:22.981160+0000","last_fullsized":"2024-09-17T05:36:22.981160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342894+0000","last_change":"2024-09-17T05:36:16.307077+0000","last_active":"2024-09-17T05:36:22.342894+0000","last_peered":"2024-09-17T05:36:22.342894+0000","last_clean":"2024-09-17T05:36:22.342894+0000","last_became_active":"2024-09-17T05:36:16.306568+0000","last_became_peered":"2024-09-17T05:36:16.306568+0000","last_unstale":"2024-09-17T05:36:22.342894+0000","last_undegraded":"2024-09-17T05:36:22.342894+0000","last_fullsized":"2024-09-17T05:36:22.342894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528731+0000","last_change":"2024-09-17T05:36:21.365391+0000","last_active":"2024-09-17T05:36:23.528731+0000","last_peered":"2024-09-17T05:36:23.528731+0000","last_clean":"2024-09-17T05:36:23.528731+0000","last_became_active":"2024-09-17T05:36:21.364791+0000","last_became_peered":"2024-09-17T05:36:21.364791+0000","last_unstale":"2024-09-17T05:36:23.528731+0000","last_undegraded":"2024-09-17T05:36:23.528731+0000","last_fullsized":"2024-09-17T05:36:23.528731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:04.502618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526809+0000","last_change":"2024-09-17T05:36:17.335760+0000","last_active":"2024-09-17T05:36:23.526809+0000","last_peered":"2024-09-17T05:36:23.526809+0000","last_clean":"2024-09-17T05:36:23.526809+0000","last_became_active":"2024-09-17T05:36:17.335388+0000","last_became_peered":"2024-09-17T05:36:17.335388+0000","last_unstale":"2024-09-17T05:36:23.526809+0000","last_undegraded":"2024-09-17T05:36:23.526809+0000","last_fullsized":"2024-09-17T05:36:23.526809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:27.462285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714588+0000","last_change":"2024-09-17T05:36:16.329939+0000","last_active":"2024-09-17T05:36:22.714588+0000","last_peered":"2024-09-17T05:36:22.714588+0000","last_clean":"2024-09-17T05:36:22.714588+0000","last_became_active":"2024-09-17T05:36:16.329632+0000","last_became_peered":"2024-09-17T05:36:16.329632+0000","last_unstale":"2024-09-17T05:36:22.714588+0000","last_undegraded":"2024-09-17T05:36:22.714588+0000","last_fullsized":"2024-09-17T05:36:22.714588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:14.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528745+0000","last_change":"2024-09-17T05:36:21.365043+0000","last_active":"2024-09-17T05:36:23.528745+0000","last_peered":"2024-09-17T05:36:23.528745+0000","last_clean":"2024-09-17T05:36:23.528745+0000","last_became_active":"2024-09-17T05:36:21.364610+0000","last_became_peered":"2024-09-17T05:36:21.364610+0000","last_unstale":"2024-09-17T05:36:23.528745+0000","last_undegraded":"2024-09-17T05:36:23.528745+0000","last_fullsized":"2024-09-17T05:36:23.528745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:55.108229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981556+0000","last_change":"2024-09-17T05:36:17.315566+0000","last_active":"2024-09-17T05:36:22.981556+0000","last_peered":"2024-09-17T05:36:22.981556+0000","last_clean":"2024-09-17T05:36:22.981556+0000","last_became_active":"2024-09-17T05:36:17.315280+0000","last_became_peered":"2024-09-17T05:36:17.315280+0000","last_unstale":"2024-09-17T05:36:22.981556+0000","last_undegraded":"2024-09-17T05:36:22.981556+0000","last_fullsized":"2024-09-17T05:36:22.981556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:07.191011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981531+0000","last_change":"2024-09-17T05:36:16.305788+0000","last_active":"2024-09-17T05:36:22.981531+0000","last_peered":"2024-09-17T05:36:22.981531+0000","last_clean":"2024-09-17T05:36:22.981531+0000","last_became_active":"2024-09-17T05:36:16.305404+0000","last_became_peered":"2024-09-17T05:36:16.305404+0000","last_unstale":"2024-09-17T05:36:22.981531+0000","last_undegraded":"2024-09-17T05:36:22.981531+0000","last_fullsized":"2024-09-17T05:36:22.981531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:55.852770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342770+0000","last_change":"2024-09-17T05:36:21.362271+0000","last_active":"2024-09-17T05:36:22.342770+0000","last_peered":"2024-09-17T05:36:22.342770+0000","last_clean":"2024-09-17T05:36:22.342770+0000","last_became_active":"2024-09-17T05:36:21.361775+0000","last_became_peered":"2024-09-17T05:36:21.361775+0000","last_unstale":"2024-09-17T05:36:22.342770+0000","last_undegraded":"2024-09-17T05:36:22.342770+0000","last_fullsized":"2024-09-17T05:36:22.342770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:48.770468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343845+0000","last_change":"2024-09-17T05:36:17.335234+0000","last_active":"2024-09-17T05:36:22.343845+0000","last_peered":"2024-09-17T05:36:22.343845+0000","last_clean":"2024-09-17T05:36:22.343845+0000","last_became_active":"2024-09-17T05:36:17.334898+0000","last_became_peered":"2024-09-17T05:36:17.334898+0000","last_unstale":"2024-09-17T05:36:22.343845+0000","last_undegraded":"2024-09-17T05:36:22.343845+0000","last_fullsized":"2024-09-17T05:36:22.343845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:29.554952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529339+0000","last_change":"2024-09-17T05:36:16.321488+0000","last_active":"2024-09-17T05:36:23.529339+0000","last_peered":"2024-09-17T05:36:23.529339+0000","last_clean":"2024-09-17T05:36:23.529339+0000","last_became_active":"2024-09-17T05:36:16.321104+0000","last_became_peered":"2024-09-17T05:36:16.321104+0000","last_unstale":"2024-09-17T05:36:23.529339+0000","last_undegraded":"2024-09-17T05:36:23.529339+0000","last_fullsized":"2024-09-17T05:36:23.529339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:51.739528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981857+0000","last_change":"2024-09-17T05:36:21.369908+0000","last_active":"2024-09-17T05:36:22.981857+0000","last_peered":"2024-09-17T05:36:22.981857+0000","last_clean":"2024-09-17T05:36:22.981857+0000","last_became_active":"2024-09-17T05:36:21.369460+0000","last_became_peered":"2024-09-17T05:36:21.369460+0000","last_unstale":"2024-09-17T05:36:22.981857+0000","last_undegraded":"2024-09-17T05:36:22.981857+0000","last_fullsized":"2024-09-17T05:36:22.981857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:57.419038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715227+0000","last_change":"2024-09-17T05:36:17.325334+0000","last_active":"2024-09-17T05:36:22.715227+0000","last_peered":"2024-09-17T05:36:22.715227+0000","last_clean":"2024-09-17T05:36:22.715227+0000","last_became_active":"2024-09-17T05:36:17.324663+0000","last_became_peered":"2024-09-17T05:36:17.324663+0000","last_unstale":"2024-09-17T05:36:22.715227+0000","last_undegraded":"2024-09-17T05:36:22.715227+0000","last_fullsized":"2024-09-17T05:36:22.715227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:28.454347+0000","last_change":"2024-09-17T05:36:16.313188+0000","last_active":"2024-09-17T05:36:28.454347+0000","last_peered":"2024-09-17T05:36:28.454347+0000","last_clean":"2024-09-17T05:36:28.454347+0000","last_became_active":"2024-09-17T05:36:16.312743+0000","last_became_peered":"2024-09-17T05:36:16.312743+0000","last_unstale":"2024-09-17T05:36:28.454347+0000","last_undegraded":"2024-09-17T05:36:28.454347+0000","last_fullsized":"2024-09-17T05:36:28.454347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:01.199020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343072+0000","last_change":"2024-09-17T05:36:21.364603+0000","last_active":"2024-09-17T05:36:22.343072+0000","last_peered":"2024-09-17T05:36:22.343072+0000","last_clean":"2024-09-17T05:36:22.343072+0000","last_became_active":"2024-09-17T05:36:21.359803+0000","last_became_peered":"2024-09-17T05:36:21.359803+0000","last_unstale":"2024-09-17T05:36:22.343072+0000","last_undegraded":"2024-09-17T05:36:22.343072+0000","last_fullsized":"2024-09-17T05:36:22.343072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:31.234403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981683+0000","last_change":"2024-09-17T05:36:17.333946+0000","last_active":"2024-09-17T05:36:22.981683+0000","last_peered":"2024-09-17T05:36:22.981683+0000","last_clean":"2024-09-17T05:36:22.981683+0000","last_became_active":"2024-09-17T05:36:17.333733+0000","last_became_peered":"2024-09-17T05:36:17.333733+0000","last_unstale":"2024-09-17T05:36:22.981683+0000","last_undegraded":"2024-09-17T05:36:22.981683+0000","last_fullsized":"2024-09-17T05:36:22.981683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:32.104558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529814+0000","last_change":"2024-09-17T05:36:16.312691+0000","last_active":"2024-09-17T05:36:23.529814+0000","last_peered":"2024-09-17T05:36:23.529814+0000","last_clean":"2024-09-17T05:36:23.529814+0000","last_became_active":"2024-09-17T05:36:16.312304+0000","last_became_peered":"2024-09-17T05:36:16.312304+0000","last_unstale":"2024-09-17T05:36:23.529814+0000","last_undegraded":"2024-09-17T05:36:23.529814+0000","last_fullsized":"2024-09-17T05:36:23.529814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:07.526016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341396+0000","last_change":"2024-09-17T05:36:21.375235+0000","last_active":"2024-09-17T05:36:22.341396+0000","last_peered":"2024-09-17T05:36:22.341396+0000","last_clean":"2024-09-17T05:36:22.341396+0000","last_became_active":"2024-09-17T05:36:21.374507+0000","last_became_peered":"2024-09-17T05:36:21.374507+0000","last_unstale":"2024-09-17T05:36:22.341396+0000","last_undegraded":"2024-09-17T05:36:22.341396+0000","last_fullsized":"2024-09-17T05:36:22.341396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:35.263335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528891+0000","last_change":"2024-09-17T05:36:17.338094+0000","last_active":"2024-09-17T05:36:23.528891+0000","last_peered":"2024-09-17T05:36:23.528891+0000","last_clean":"2024-09-17T05:36:23.528891+0000","last_became_active":"2024-09-17T05:36:17.337765+0000","last_became_peered":"2024-09-17T05:36:17.337765+0000","last_unstale":"2024-09-17T05:36:23.528891+0000","last_undegraded":"2024-09-17T05:36:23.528891+0000","last_fullsized":"2024-09-17T05:36:23.528891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:16.524665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715086+0000","last_change":"2024-09-17T05:36:16.327589+0000","last_active":"2024-09-17T05:36:22.715086+0000","last_peered":"2024-09-17T05:36:22.715086+0000","last_clean":"2024-09-17T05:36:22.715086+0000","last_became_active":"2024-09-17T05:36:16.327204+0000","last_became_peered":"2024-09-17T05:36:16.327204+0000","last_unstale":"2024-09-17T05:36:22.715086+0000","last_undegraded":"2024-09-17T05:36:22.715086+0000","last_fullsized":"2024-09-17T05:36:22.715086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:10.343253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527788+0000","last_change":"2024-09-17T05:36:21.387662+0000","last_active":"2024-09-17T05:36:23.527788+0000","last_peered":"2024-09-17T05:36:23.527788+0000","last_clean":"2024-09-17T05:36:23.527788+0000","last_became_active":"2024-09-17T05:36:21.387130+0000","last_became_peered":"2024-09-17T05:36:21.387130+0000","last_unstale":"2024-09-17T05:36:23.527788+0000","last_undegraded":"2024-09-17T05:36:23.527788+0000","last_fullsized":"2024-09-17T05:36:23.527788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:02.304238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341833+0000","last_change":"2024-09-17T05:36:17.340549+0000","last_active":"2024-09-17T05:36:22.341833+0000","last_peered":"2024-09-17T05:36:22.341833+0000","last_clean":"2024-09-17T05:36:22.341833+0000","last_became_active":"2024-09-17T05:36:17.339625+0000","last_became_peered":"2024-09-17T05:36:17.339625+0000","last_unstale":"2024-09-17T05:36:22.341833+0000","last_undegraded":"2024-09-17T05:36:22.341833+0000","last_fullsized":"2024-09-17T05:36:22.341833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:25.066974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527645+0000","last_change":"2024-09-17T05:36:16.298680+0000","last_active":"2024-09-17T05:36:23.527645+0000","last_peered":"2024-09-17T05:36:23.527645+0000","last_clean":"2024-09-17T05:36:23.527645+0000","last_became_active":"2024-09-17T05:36:16.298036+0000","last_became_peered":"2024-09-17T05:36:16.298036+0000","last_unstale":"2024-09-17T05:36:23.527645+0000","last_undegraded":"2024-09-17T05:36:23.527645+0000","last_fullsized":"2024-09-17T05:36:23.527645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:23.083593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342660+0000","last_change":"2024-09-17T05:36:21.368736+0000","last_active":"2024-09-17T05:36:22.342660+0000","last_peered":"2024-09-17T05:36:22.342660+0000","last_clean":"2024-09-17T05:36:22.342660+0000","last_became_active":"2024-09-17T05:36:21.367445+0000","last_became_peered":"2024-09-17T05:36:21.367445+0000","last_unstale":"2024-09-17T05:36:22.342660+0000","last_undegraded":"2024-09-17T05:36:22.342660+0000","last_fullsized":"2024-09-17T05:36:22.342660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:05.057621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.344488+0000","last_change":"2024-09-17T05:36:21.363851+0000","last_active":"2024-09-17T05:36:22.344488+0000","last_peered":"2024-09-17T05:36:22.344488+0000","last_clean":"2024-09-17T05:36:22.344488+0000","last_became_active":"2024-09-17T05:36:21.363389+0000","last_became_peered":"2024-09-17T05:36:21.363389+0000","last_unstale":"2024-09-17T05:36:22.344488+0000","last_undegraded":"2024-09-17T05:36:22.344488+0000","last_fullsized":"2024-09-17T05:36:22.344488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:30.627064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342621+0000","last_change":"2024-09-17T05:36:17.327105+0000","last_active":"2024-09-17T05:36:22.342621+0000","last_peered":"2024-09-17T05:36:22.342621+0000","last_clean":"2024-09-17T05:36:22.342621+0000","last_became_active":"2024-09-17T05:36:17.326723+0000","last_became_peered":"2024-09-17T05:36:17.326723+0000","last_unstale":"2024-09-17T05:36:22.342621+0000","last_undegraded":"2024-09-17T05:36:22.342621+0000","last_fullsized":"2024-09-17T05:36:22.342621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:28.899717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981380+0000","last_change":"2024-09-17T05:36:16.333855+0000","last_active":"2024-09-17T05:36:22.981380+0000","last_peered":"2024-09-17T05:36:22.981380+0000","last_clean":"2024-09-17T05:36:22.981380+0000","last_became_active":"2024-09-17T05:36:16.327526+0000","last_became_peered":"2024-09-17T05:36:16.327526+0000","last_unstale":"2024-09-17T05:36:22.981380+0000","last_undegraded":"2024-09-17T05:36:22.981380+0000","last_fullsized":"2024-09-17T05:36:22.981380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:19.710459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982107+0000","last_change":"2024-09-17T05:36:21.382312+0000","last_active":"2024-09-17T05:36:22.982107+0000","last_peered":"2024-09-17T05:36:22.982107+0000","last_clean":"2024-09-17T05:36:22.982107+0000","last_became_active":"2024-09-17T05:36:21.381775+0000","last_became_peered":"2024-09-17T05:36:21.381775+0000","last_unstale":"2024-09-17T05:36:22.982107+0000","last_undegraded":"2024-09-17T05:36:22.982107+0000","last_fullsized":"2024-09-17T05:36:22.982107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:54.623675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527876+0000","last_change":"2024-09-17T05:36:17.336803+0000","last_active":"2024-09-17T05:36:23.527876+0000","last_peered":"2024-09-17T05:36:23.527876+0000","last_clean":"2024-09-17T05:36:23.527876+0000","last_became_active":"2024-09-17T05:36:17.336509+0000","last_became_peered":"2024-09-17T05:36:17.336509+0000","last_unstale":"2024-09-17T05:36:23.527876+0000","last_undegraded":"2024-09-17T05:36:23.527876+0000","last_fullsized":"2024-09-17T05:36:23.527876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:06.756369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342443+0000","last_change":"2024-09-17T05:36:16.319485+0000","last_active":"2024-09-17T05:36:22.342443+0000","last_peered":"2024-09-17T05:36:22.342443+0000","last_clean":"2024-09-17T05:36:22.342443+0000","last_became_active":"2024-09-17T05:36:16.319042+0000","last_became_peered":"2024-09-17T05:36:16.319042+0000","last_unstale":"2024-09-17T05:36:22.342443+0000","last_undegraded":"2024-09-17T05:36:22.342443+0000","last_fullsized":"2024-09-17T05:36:22.342443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.491679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981509+0000","last_change":"2024-09-17T05:36:16.323135+0000","last_active":"2024-09-17T05:36:22.981509+0000","last_peered":"2024-09-17T05:36:22.981509+0000","last_clean":"2024-09-17T05:36:22.981509+0000","last_became_active":"2024-09-17T05:36:16.322812+0000","last_became_peered":"2024-09-17T05:36:16.322812+0000","last_unstale":"2024-09-17T05:36:22.981509+0000","last_undegraded":"2024-09-17T05:36:22.981509+0000","last_fullsized":"2024-09-17T05:36:22.981509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:12.955121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343453+0000","last_change":"2024-09-17T05:36:17.323771+0000","last_active":"2024-09-17T05:36:22.343453+0000","last_peered":"2024-09-17T05:36:22.343453+0000","last_clean":"2024-09-17T05:36:22.343453+0000","last_became_active":"2024-09-17T05:36:17.323383+0000","last_became_peered":"2024-09-17T05:36:17.323383+0000","last_unstale":"2024-09-17T05:36:22.343453+0000","last_undegraded":"2024-09-17T05:36:22.343453+0000","last_fullsized":"2024-09-17T05:36:22.343453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343969+0000","last_change":"2024-09-17T05:36:21.364040+0000","last_active":"2024-09-17T05:36:22.343969+0000","last_peered":"2024-09-17T05:36:22.343969+0000","last_clean":"2024-09-17T05:36:22.343969+0000","last_became_active":"2024-09-17T05:36:21.363341+0000","last_became_peered":"2024-09-17T05:36:21.363341+0000","last_unstale":"2024-09-17T05:36:22.343969+0000","last_undegraded":"2024-09-17T05:36:22.343969+0000","last_fullsized":"2024-09-17T05:36:22.343969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:02.548547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528352+0000","last_change":"2024-09-17T05:36:16.316663+0000","last_active":"2024-09-17T05:36:23.528352+0000","last_peered":"2024-09-17T05:36:23.528352+0000","last_clean":"2024-09-17T05:36:23.528352+0000","last_became_active":"2024-09-17T05:36:16.316362+0000","last_became_peered":"2024-09-17T05:36:16.316362+0000","last_unstale":"2024-09-17T05:36:23.528352+0000","last_undegraded":"2024-09-17T05:36:23.528352+0000","last_fullsized":"2024-09-17T05:36:23.528352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:15.269427+0000","last_clean_scrub_stamp":"2024-09-17T05:36:15.269427+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:47.803867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526808+0000","last_change":"2024-09-17T05:36:17.310831+0000","last_active":"2024-09-17T05:36:23.526808+0000","last_peered":"2024-09-17T05:36:23.526808+0000","last_clean":"2024-09-17T05:36:23.526808+0000","last_became_active":"2024-09-17T05:36:17.309876+0000","last_became_peered":"2024-09-17T05:36:17.309876+0000","last_unstale":"2024-09-17T05:36:23.526808+0000","last_undegraded":"2024-09-17T05:36:23.526808+0000","last_fullsized":"2024-09-17T05:36:23.526808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:07.057468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529654+0000","last_change":"2024-09-17T05:36:21.379986+0000","last_active":"2024-09-17T05:36:23.529654+0000","last_peered":"2024-09-17T05:36:23.529654+0000","last_clean":"2024-09-17T05:36:23.529654+0000","last_became_active":"2024-09-17T05:36:21.379475+0000","last_became_peered":"2024-09-17T05:36:21.379475+0000","last_unstale":"2024-09-17T05:36:23.529654+0000","last_undegraded":"2024-09-17T05:36:23.529654+0000","last_fullsized":"2024-09-17T05:36:23.529654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:20.318478+0000","last_clean_scrub_stamp":"2024-09-17T05:36:20.318478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:00.609951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341151+0000","last_change":"2024-09-17T05:36:17.321338+0000","last_active":"2024-09-17T05:36:22.341151+0000","last_peered":"2024-09-17T05:36:22.341151+0000","last_clean":"2024-09-17T05:36:22.341151+0000","last_became_active":"2024-09-17T05:36:17.320935+0000","last_became_peered":"2024-09-17T05:36:17.320935+0000","last_unstale":"2024-09-17T05:36:22.341151+0000","last_undegraded":"2024-09-17T05:36:22.341151+0000","last_fullsized":"2024-09-17T05:36:22.341151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528779+0000","last_change":"2024-09-17T05:36:17.344784+0000","last_active":"2024-09-17T05:36:23.528779+0000","last_peered":"2024-09-17T05:36:23.528779+0000","last_clean":"2024-09-17T05:36:23.528779+0000","last_became_active":"2024-09-17T05:36:17.344318+0000","last_became_peered":"2024-09-17T05:36:17.344318+0000","last_unstale":"2024-09-17T05:36:23.528779+0000","last_undegraded":"2024-09-17T05:36:23.528779+0000","last_fullsized":"2024-09-17T05:36:23.528779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:20.721368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981361+0000","last_change":"2024-09-17T05:36:17.330884+0000","last_active":"2024-09-17T05:36:22.981361+0000","last_peered":"2024-09-17T05:36:22.981361+0000","last_clean":"2024-09-17T05:36:22.981361+0000","last_became_active":"2024-09-17T05:36:17.330452+0000","last_became_peered":"2024-09-17T05:36:17.330452+0000","last_unstale":"2024-09-17T05:36:22.981361+0000","last_undegraded":"2024-09-17T05:36:22.981361+0000","last_fullsized":"2024-09-17T05:36:22.981361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:29.774698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528209+0000","last_change":"2024-09-17T05:36:17.328894+0000","last_active":"2024-09-17T05:36:23.528209+0000","last_peered":"2024-09-17T05:36:23.528209+0000","last_clean":"2024-09-17T05:36:23.528209+0000","last_became_active":"2024-09-17T05:36:17.327780+0000","last_became_peered":"2024-09-17T05:36:17.327780+0000","last_unstale":"2024-09-17T05:36:23.528209+0000","last_undegraded":"2024-09-17T05:36:23.528209+0000","last_fullsized":"2024-09-17T05:36:23.528209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:06.363072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343281+0000","last_change":"2024-09-17T05:36:17.332587+0000","last_active":"2024-09-17T05:36:22.343281+0000","last_peered":"2024-09-17T05:36:22.343281+0000","last_clean":"2024-09-17T05:36:22.343281+0000","last_became_active":"2024-09-17T05:36:17.332288+0000","last_became_peered":"2024-09-17T05:36:17.332288+0000","last_unstale":"2024-09-17T05:36:22.343281+0000","last_undegraded":"2024-09-17T05:36:22.343281+0000","last_fullsized":"2024-09-17T05:36:22.343281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:06.339627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343457+0000","last_change":"2024-09-17T05:36:17.332485+0000","last_active":"2024-09-17T05:36:22.343457+0000","last_peered":"2024-09-17T05:36:22.343457+0000","last_clean":"2024-09-17T05:36:22.343457+0000","last_became_active":"2024-09-17T05:36:17.332115+0000","last_became_peered":"2024-09-17T05:36:17.332115+0000","last_unstale":"2024-09-17T05:36:22.343457+0000","last_undegraded":"2024-09-17T05:36:22.343457+0000","last_fullsized":"2024-09-17T05:36:22.343457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:05.038834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341705+0000","last_change":"2024-09-17T05:36:17.340797+0000","last_active":"2024-09-17T05:36:22.341705+0000","last_peered":"2024-09-17T05:36:22.341705+0000","last_clean":"2024-09-17T05:36:22.341705+0000","last_became_active":"2024-09-17T05:36:17.340122+0000","last_became_peered":"2024-09-17T05:36:17.340122+0000","last_unstale":"2024-09-17T05:36:22.341705+0000","last_undegraded":"2024-09-17T05:36:22.341705+0000","last_fullsized":"2024-09-17T05:36:22.341705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:46.074621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528625+0000","last_change":"2024-09-17T05:36:17.346906+0000","last_active":"2024-09-17T05:36:23.528625+0000","last_peered":"2024-09-17T05:36:23.528625+0000","last_clean":"2024-09-17T05:36:23.528625+0000","last_became_active":"2024-09-17T05:36:17.340932+0000","last_became_peered":"2024-09-17T05:36:17.340932+0000","last_unstale":"2024-09-17T05:36:23.528625+0000","last_undegraded":"2024-09-17T05:36:23.528625+0000","last_fullsized":"2024-09-17T05:36:23.528625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981266+0000","last_change":"2024-09-17T05:36:17.346011+0000","last_active":"2024-09-17T05:36:22.981266+0000","last_peered":"2024-09-17T05:36:22.981266+0000","last_clean":"2024-09-17T05:36:22.981266+0000","last_became_active":"2024-09-17T05:36:17.345659+0000","last_became_peered":"2024-09-17T05:36:17.345659+0000","last_unstale":"2024-09-17T05:36:22.981266+0000","last_undegraded":"2024-09-17T05:36:22.981266+0000","last_fullsized":"2024-09-17T05:36:22.981266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.001476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527926+0000","last_change":"2024-09-17T05:36:17.339568+0000","last_active":"2024-09-17T05:36:23.527926+0000","last_peered":"2024-09-17T05:36:23.527926+0000","last_clean":"2024-09-17T05:36:23.527926+0000","last_became_active":"2024-09-17T05:36:17.339206+0000","last_became_peered":"2024-09-17T05:36:17.339206+0000","last_unstale":"2024-09-17T05:36:23.527926+0000","last_undegraded":"2024-09-17T05:36:23.527926+0000","last_fullsized":"2024-09-17T05:36:23.527926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:21.834161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.526829+0000","last_change":"2024-09-17T05:36:17.319470+0000","last_active":"2024-09-17T05:36:23.526829+0000","last_peered":"2024-09-17T05:36:23.526829+0000","last_clean":"2024-09-17T05:36:23.526829+0000","last_became_active":"2024-09-17T05:36:17.319072+0000","last_became_peered":"2024-09-17T05:36:17.319072+0000","last_unstale":"2024-09-17T05:36:23.526829+0000","last_undegraded":"2024-09-17T05:36:23.526829+0000","last_fullsized":"2024-09-17T05:36:23.526829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:44.305630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343303+0000","last_change":"2024-09-17T05:36:17.335377+0000","last_active":"2024-09-17T05:36:22.343303+0000","last_peered":"2024-09-17T05:36:22.343303+0000","last_clean":"2024-09-17T05:36:22.343303+0000","last_became_active":"2024-09-17T05:36:17.335031+0000","last_became_peered":"2024-09-17T05:36:17.335031+0000","last_unstale":"2024-09-17T05:36:22.343303+0000","last_undegraded":"2024-09-17T05:36:22.343303+0000","last_fullsized":"2024-09-17T05:36:22.343303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:29.539404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715039+0000","last_change":"2024-09-17T05:36:17.326013+0000","last_active":"2024-09-17T05:36:22.715039+0000","last_peered":"2024-09-17T05:36:22.715039+0000","last_clean":"2024-09-17T05:36:22.715039+0000","last_became_active":"2024-09-17T05:36:17.325380+0000","last_became_peered":"2024-09-17T05:36:17.325380+0000","last_unstale":"2024-09-17T05:36:22.715039+0000","last_undegraded":"2024-09-17T05:36:22.715039+0000","last_fullsized":"2024-09-17T05:36:22.715039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982122+0000","last_change":"2024-09-17T05:36:17.322938+0000","last_active":"2024-09-17T05:36:22.982122+0000","last_peered":"2024-09-17T05:36:22.982122+0000","last_clean":"2024-09-17T05:36:22.982122+0000","last_became_active":"2024-09-17T05:36:17.322588+0000","last_became_peered":"2024-09-17T05:36:17.322588+0000","last_unstale":"2024-09-17T05:36:22.982122+0000","last_undegraded":"2024-09-17T05:36:22.982122+0000","last_fullsized":"2024-09-17T05:36:22.982122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:51.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529825+0000","last_change":"2024-09-17T05:36:17.347278+0000","last_active":"2024-09-17T05:36:23.529825+0000","last_peered":"2024-09-17T05:36:23.529825+0000","last_clean":"2024-09-17T05:36:23.529825+0000","last_became_active":"2024-09-17T05:36:17.346983+0000","last_became_peered":"2024-09-17T05:36:17.346983+0000","last_unstale":"2024-09-17T05:36:23.529825+0000","last_undegraded":"2024-09-17T05:36:23.529825+0000","last_fullsized":"2024-09-17T05:36:23.529825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.982334+0000","last_change":"2024-09-17T05:36:17.328660+0000","last_active":"2024-09-17T05:36:22.982334+0000","last_peered":"2024-09-17T05:36:22.982334+0000","last_clean":"2024-09-17T05:36:22.982334+0000","last_became_active":"2024-09-17T05:36:17.324799+0000","last_became_peered":"2024-09-17T05:36:17.324799+0000","last_unstale":"2024-09-17T05:36:22.982334+0000","last_undegraded":"2024-09-17T05:36:22.982334+0000","last_fullsized":"2024-09-17T05:36:22.982334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:25.124191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.981321+0000","last_change":"2024-09-17T05:36:17.323989+0000","last_active":"2024-09-17T05:36:22.981321+0000","last_peered":"2024-09-17T05:36:22.981321+0000","last_clean":"2024-09-17T05:36:22.981321+0000","last_became_active":"2024-09-17T05:36:17.321569+0000","last_became_peered":"2024-09-17T05:36:17.321569+0000","last_unstale":"2024-09-17T05:36:22.981321+0000","last_undegraded":"2024-09-17T05:36:22.981321+0000","last_fullsized":"2024-09-17T05:36:22.981321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527794+0000","last_change":"2024-09-17T05:36:17.329281+0000","last_active":"2024-09-17T05:36:23.527794+0000","last_peered":"2024-09-17T05:36:23.527794+0000","last_clean":"2024-09-17T05:36:23.527794+0000","last_became_active":"2024-09-17T05:36:17.328142+0000","last_became_peered":"2024-09-17T05:36:17.328142+0000","last_unstale":"2024-09-17T05:36:23.527794+0000","last_undegraded":"2024-09-17T05:36:23.527794+0000","last_fullsized":"2024-09-17T05:36:23.527794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.343704+0000","last_change":"2024-09-17T05:36:17.331419+0000","last_active":"2024-09-17T05:36:22.343704+0000","last_peered":"2024-09-17T05:36:22.343704+0000","last_clean":"2024-09-17T05:36:22.343704+0000","last_became_active":"2024-09-17T05:36:17.330949+0000","last_became_peered":"2024-09-17T05:36:17.330949+0000","last_unstale":"2024-09-17T05:36:22.343704+0000","last_undegraded":"2024-09-17T05:36:22.343704+0000","last_fullsized":"2024-09-17T05:36:22.343704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:01.895132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.342869+0000","last_change":"2024-09-17T05:36:17.337108+0000","last_active":"2024-09-17T05:36:22.342869+0000","last_peered":"2024-09-17T05:36:22.342869+0000","last_clean":"2024-09-17T05:36:22.342869+0000","last_became_active":"2024-09-17T05:36:17.330031+0000","last_became_peered":"2024-09-17T05:36:17.330031+0000","last_unstale":"2024-09-17T05:36:22.342869+0000","last_undegraded":"2024-09-17T05:36:22.342869+0000","last_fullsized":"2024-09-17T05:36:22.342869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:20.371899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714967+0000","last_change":"2024-09-17T05:36:17.326415+0000","last_active":"2024-09-17T05:36:22.714967+0000","last_peered":"2024-09-17T05:36:22.714967+0000","last_clean":"2024-09-17T05:36:22.714967+0000","last_became_active":"2024-09-17T05:36:17.325865+0000","last_became_peered":"2024-09-17T05:36:17.325865+0000","last_unstale":"2024-09-17T05:36:22.714967+0000","last_undegraded":"2024-09-17T05:36:22.714967+0000","last_fullsized":"2024-09-17T05:36:22.714967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:38.465674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715119+0000","last_change":"2024-09-17T05:36:17.324996+0000","last_active":"2024-09-17T05:36:22.715119+0000","last_peered":"2024-09-17T05:36:22.715119+0000","last_clean":"2024-09-17T05:36:22.715119+0000","last_became_active":"2024-09-17T05:36:17.324236+0000","last_became_peered":"2024-09-17T05:36:17.324236+0000","last_unstale":"2024-09-17T05:36:22.715119+0000","last_undegraded":"2024-09-17T05:36:22.715119+0000","last_fullsized":"2024-09-17T05:36:22.715119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:11.313385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714911+0000","last_change":"2024-09-17T05:36:17.344886+0000","last_active":"2024-09-17T05:36:22.714911+0000","last_peered":"2024-09-17T05:36:22.714911+0000","last_clean":"2024-09-17T05:36:22.714911+0000","last_became_active":"2024-09-17T05:36:17.344366+0000","last_became_peered":"2024-09-17T05:36:17.344366+0000","last_unstale":"2024-09-17T05:36:22.714911+0000","last_undegraded":"2024-09-17T05:36:22.714911+0000","last_fullsized":"2024-09-17T05:36:22.714911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:31.225193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527631+0000","last_change":"2024-09-17T05:36:17.315032+0000","last_active":"2024-09-17T05:36:23.527631+0000","last_peered":"2024-09-17T05:36:23.527631+0000","last_clean":"2024-09-17T05:36:23.527631+0000","last_became_active":"2024-09-17T05:36:17.313444+0000","last_became_peered":"2024-09-17T05:36:17.313444+0000","last_unstale":"2024-09-17T05:36:23.527631+0000","last_undegraded":"2024-09-17T05:36:23.527631+0000","last_fullsized":"2024-09-17T05:36:23.527631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:54.948931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.527661+0000","last_change":"2024-09-17T05:36:17.334347+0000","last_active":"2024-09-17T05:36:23.527661+0000","last_peered":"2024-09-17T05:36:23.527661+0000","last_clean":"2024-09-17T05:36:23.527661+0000","last_became_active":"2024-09-17T05:36:17.328605+0000","last_became_peered":"2024-09-17T05:36:17.328605+0000","last_unstale":"2024-09-17T05:36:23.527661+0000","last_undegraded":"2024-09-17T05:36:23.527661+0000","last_fullsized":"2024-09-17T05:36:23.527661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:15.839007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714540+0000","last_change":"2024-09-17T05:36:17.317414+0000","last_active":"2024-09-17T05:36:22.714540+0000","last_peered":"2024-09-17T05:36:22.714540+0000","last_clean":"2024-09-17T05:36:22.714540+0000","last_became_active":"2024-09-17T05:36:17.316995+0000","last_became_peered":"2024-09-17T05:36:17.316995+0000","last_unstale":"2024-09-17T05:36:22.714540+0000","last_undegraded":"2024-09-17T05:36:22.714540+0000","last_fullsized":"2024-09-17T05:36:22.714540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.341035+0000","last_change":"2024-09-17T05:36:17.338794+0000","last_active":"2024-09-17T05:36:22.341035+0000","last_peered":"2024-09-17T05:36:22.341035+0000","last_clean":"2024-09-17T05:36:22.341035+0000","last_became_active":"2024-09-17T05:36:17.338484+0000","last_became_peered":"2024-09-17T05:36:17.338484+0000","last_unstale":"2024-09-17T05:36:22.341035+0000","last_undegraded":"2024-09-17T05:36:22.341035+0000","last_fullsized":"2024-09-17T05:36:22.341035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:11.354162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.714807+0000","last_change":"2024-09-17T05:36:17.338013+0000","last_active":"2024-09-17T05:36:22.714807+0000","last_peered":"2024-09-17T05:36:22.714807+0000","last_clean":"2024-09-17T05:36:22.714807+0000","last_became_active":"2024-09-17T05:36:17.336108+0000","last_became_peered":"2024-09-17T05:36:17.336108+0000","last_unstale":"2024-09-17T05:36:22.714807+0000","last_undegraded":"2024-09-17T05:36:22.714807+0000","last_fullsized":"2024-09-17T05:36:22.714807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:52.598217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.340824+0000","last_change":"2024-09-17T05:36:17.338178+0000","last_active":"2024-09-17T05:36:22.340824+0000","last_peered":"2024-09-17T05:36:22.340824+0000","last_clean":"2024-09-17T05:36:22.340824+0000","last_became_active":"2024-09-17T05:36:17.332226+0000","last_became_peered":"2024-09-17T05:36:17.332226+0000","last_unstale":"2024-09-17T05:36:22.340824+0000","last_undegraded":"2024-09-17T05:36:22.340824+0000","last_fullsized":"2024-09-17T05:36:22.340824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:51.769914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.529229+0000","last_change":"2024-09-17T05:36:17.339093+0000","last_active":"2024-09-17T05:36:23.529229+0000","last_peered":"2024-09-17T05:36:23.529229+0000","last_clean":"2024-09-17T05:36:23.529229+0000","last_became_active":"2024-09-17T05:36:17.338568+0000","last_became_peered":"2024-09-17T05:36:17.338568+0000","last_unstale":"2024-09-17T05:36:23.529229+0000","last_undegraded":"2024-09-17T05:36:23.529229+0000","last_fullsized":"2024-09-17T05:36:23.529229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:05.999368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:23.528481+0000","last_change":"2024-09-17T05:36:17.339579+0000","last_active":"2024-09-17T05:36:23.528481+0000","last_peered":"2024-09-17T05:36:23.528481+0000","last_clean":"2024-09-17T05:36:23.528481+0000","last_became_active":"2024-09-17T05:36:17.339156+0000","last_became_peered":"2024-09-17T05:36:17.339156+0000","last_unstale":"2024-09-17T05:36:23.528481+0000","last_undegraded":"2024-09-17T05:36:23.528481+0000","last_fullsized":"2024-09-17T05:36:23.528481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:00.683346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-17T05:36:22.715225+0000","last_change":"2024-09-17T05:36:17.334244+0000","last_active":"2024-09-17T05:36:22.715225+0000","last_peered":"2024-09-17T05:36:22.715225+0000","last_clean":"2024-09-17T05:36:22.715225+0000","last_became_active":"2024-09-17T05:36:17.333913+0000","last_became_peered":"2024-09-17T05:36:17.333913+0000","last_unstale":"2024-09-17T05:36:22.715225+0000","last_undegraded":"2024-09-17T05:36:22.715225+0000","last_fullsized":"2024-09-17T05:36:22.715225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.280336+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.280336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:13.329874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":106018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":696354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":110408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":106476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":109736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":696332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":105894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:37.659 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:36:37.659 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T05:36:37.659 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T05:36:37.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:36:37.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.854+0000 7f3d87800640 1 -- 172.21.15.44:0/3794426455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800d1d00 msgr2=0x7f3d800cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.854+0000 7f3d87800640 1 --2- 172.21.15.44:0/3794426455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800d1d00 0x7f3d800cf070 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009840 tx=0x7f3d6801c5f0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.854+0000 7f3d87800640 1 -- 172.21.15.44:0/3794426455 shutdown_connections 2024-09-17T05:36:37.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.854+0000 7f3d87800640 1 --2- 172.21.15.44:0/3794426455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800d1d00 0x7f3d800cf070 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.854+0000 7f3d87800640 1 -- 172.21.15.44:0/3794426455 >> 172.21.15.44:0/3794426455 conn(0x7f3d800b4240 msgr2=0x7f3d800b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 -- 172.21.15.44:0/3794426455 shutdown_connections 2024-09-17T05:36:37.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 -- 172.21.15.44:0/3794426455 wait complete. 2024-09-17T05:36:37.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 Processor -- start 2024-09-17T05:36:37.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 -- start start 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800cf5b0 0x7f3d8014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d800d18f0 0x7f3d800b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d800d1d00 0x7f3d800b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8016aff0 con 0x7f3d800cf5b0 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8016ae70 con 0x7f3d800d18f0 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d87800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8016b170 con 0x7f3d800d1d00 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.858+0000 7f3d84e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800cf5b0 0x7f3d8014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800cf5b0 0x7f3d8014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49346/0 (socket says 172.21.15.44:49346) 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 -- 172.21.15.44:0/2165455695 learned_addr learned my addr 172.21.15.44:0/2165455695 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d77e00640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d800d18f0 0x7f3d800b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d85800640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d800d1d00 0x7f3d800b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 -- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d800d1d00 msgr2=0x7f3d800b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d800d1d00 0x7f3d800b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 -- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d800d18f0 msgr2=0x7f3d800b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d800d18f0 0x7f3d800b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 -- 172.21.15.44:0/2165455695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d80167670 con 0x7f3d800cf5b0 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d77e00640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d800d18f0 0x7f3d800b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d84e00640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800cf5b0 0x7f3d8014f720 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c730 tx=0x7f3d7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d7d600640 1 -- 172.21.15.44:0/2165455695 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70017070 con 0x7f3d800cf5b0 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d7d600640 1 -- 172.21.15.44:0/2165455695 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d7000ce40 con 0x7f3d800cf5b0 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d7d600640 1 -- 172.21.15.44:0/2165455695 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7000a8a0 con 0x7f3d800cf5b0 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d800b5390 con 0x7f3d800cf5b0 2024-09-17T05:36:37.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d80153f10 con 0x7f3d800cf5b0 2024-09-17T05:36:37.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d800cf070 con 0x7f3d800cf5b0 2024-09-17T05:36:37.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.862+0000 7f3d7d600640 1 -- 172.21.15.44:0/2165455695 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3d7001a070 con 0x7f3d800cf5b0 2024-09-17T05:36:37.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.866+0000 7f3d7d600640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d5c073200 0x7f3d5c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.866+0000 7f3d7d600640 1 -- 172.21.15.44:0/2165455695 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3d70093bc0 con 0x7f3d800cf5b0 2024-09-17T05:36:37.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.866+0000 7f3d77e00640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d5c073200 0x7f3d5c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.866+0000 7f3d77e00640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d5c073200 0x7f3d5c075710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3d680af000 tx=0x7f3d6801ae30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:37.870+0000 7f3d7d600640 1 -- 172.21.15.44:0/2165455695 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3d800cf9c0 con 0x7f3d800cf5b0 2024-09-17T05:36:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.078+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d800b1e90 con 0x7f3d800cf5b0 2024-09-17T05:36:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.078+0000 7f3d7d600640 1 -- 172.21.15.44:0/2165455695 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3d7005e920 con 0x7f3d800cf5b0 2024-09-17T05:36:38.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:38.081 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:36:38.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d5c073200 msgr2=0x7f3d5c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d5c073200 0x7f3d5c075710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3d680af000 tx=0x7f3d6801ae30 comp rx=0 tx=0).stop 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800cf5b0 msgr2=0x7f3d8014f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800cf5b0 0x7f3d8014f720 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c730 tx=0x7f3d7000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 shutdown_connections 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d800d1d00 0x7f3d800b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d5c073200 0x7f3d5c075710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d800d18f0 0x7f3d800b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 --2- 172.21.15.44:0/2165455695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d800cf5b0 0x7f3d8014f720 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 >> 172.21.15.44:0/2165455695 conn(0x7f3d800b4240 msgr2=0x7f3d80152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 shutdown_connections 2024-09-17T05:36:38.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.082+0000 7f3d87800640 1 -- 172.21.15.44:0/2165455695 wait complete. 2024-09-17T05:36:38.103 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T05:36:38.103 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:38.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.258+0000 7f8129c00640 1 -- 172.21.15.44:0/4272811408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 msgr2=0x7f812406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.258+0000 7f8129c00640 1 --2- 172.21.15.44:0/4272811408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f812406e160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8114009840 tx=0x7f811401c700 comp rx=0 tx=0).stop 2024-09-17T05:36:38.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- 172.21.15.44:0/4272811408 shutdown_connections 2024-09-17T05:36:38.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 --2- 172.21.15.44:0/4272811408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81240cecf0 0x7f81240cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 --2- 172.21.15.44:0/4272811408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f812406e160 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- 172.21.15.44:0/4272811408 >> 172.21.15.44:0/4272811408 conn(0x7f81240d1120 msgr2=0x7f81240d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- 172.21.15.44:0/4272811408 shutdown_connections 2024-09-17T05:36:38.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- 172.21.15.44:0/4272811408 wait complete. 2024-09-17T05:36:38.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 Processor -- start 2024-09-17T05:36:38.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- start start 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f81240c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81240ae3e0 0x7f8124156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81240cecf0 0x7f8124157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8124168e40 con 0x7f8124072190 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8124168cc0 con 0x7f81240ae3e0 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8129c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8124168fc0 con 0x7f81240cecf0 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.262+0000 7f8122a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f81240c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f81240c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49366/0 (socket says 172.21.15.44:49366) 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 -- 172.21.15.44:0/1187965853 learned_addr learned my addr 172.21.15.44:0/1187965853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:38.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122000640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81240ae3e0 0x7f8124156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8123400640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81240cecf0 0x7f8124157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 -- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81240cecf0 msgr2=0x7f8124157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81240cecf0 0x7f8124157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 -- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81240ae3e0 msgr2=0x7f8124156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81240ae3e0 0x7f8124156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 -- 172.21.15.44:0/1187965853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81240c7700 con 0x7f8124072190 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122000640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81240ae3e0 0x7f8124156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:38.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8122a00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f81240c71c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f811401adb0 tx=0x7f81140a7f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f811aa00640 1 -- 172.21.15.44:0/1187965853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81140043c0 con 0x7f8124072190 2024-09-17T05:36:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f811aa00640 1 -- 172.21.15.44:0/1187965853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81140bd070 con 0x7f8124072190 2024-09-17T05:36:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f811aa00640 1 -- 172.21.15.44:0/1187965853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114003840 con 0x7f8124072190 2024-09-17T05:36:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81241592d0 con 0x7f8124072190 2024-09-17T05:36:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8124159890 con 0x7f8124072190 2024-09-17T05:36:38.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812406e160 con 0x7f8124072190 2024-09-17T05:36:38.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.266+0000 7f811aa00640 1 -- 172.21.15.44:0/1187965853 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f81140039e0 con 0x7f8124072190 2024-09-17T05:36:38.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.270+0000 7f811aa00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8104073200 0x7f8104075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.270+0000 7f811aa00640 1 -- 172.21.15.44:0/1187965853 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f811412f720 con 0x7f8124072190 2024-09-17T05:36:38.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.270+0000 7f8122000640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8104073200 0x7f8104075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.270+0000 7f8122000640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8104073200 0x7f8104075710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8110005fd0 tx=0x7f8110005f20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.274+0000 7f811aa00640 1 -- 172.21.15.44:0/1187965853 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8114016410 con 0x7f8124072190 2024-09-17T05:36:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.482+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81240d1db0 con 0x7f8124072190 2024-09-17T05:36:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.482+0000 7f811aa00640 1 -- 172.21.15.44:0/1187965853 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f81140fa400 con 0x7f8124072190 2024-09-17T05:36:38.485 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:38.485 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:38.485 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8104073200 msgr2=0x7f8104075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8104073200 0x7f8104075710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8110005fd0 tx=0x7f8110005f20 comp rx=0 tx=0).stop 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 msgr2=0x7f81240c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f81240c71c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f811401adb0 tx=0x7f81140a7f70 comp rx=0 tx=0).stop 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 shutdown_connections 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81240cecf0 0x7f8124157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8104073200 0x7f8104075710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81240ae3e0 0x7f8124156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 --2- 172.21.15.44:0/1187965853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8124072190 0x7f81240c71c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 >> 172.21.15.44:0/1187965853 conn(0x7f81240d1120 msgr2=0x7f812415a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 shutdown_connections 2024-09-17T05:36:38.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.486+0000 7f8129c00640 1 -- 172.21.15.44:0/1187965853 wait complete. 2024-09-17T05:36:38.507 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:38.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.662+0000 7f46f4600640 1 -- 172.21.15.44:0/2184417711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 msgr2=0x7f46ec0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.662+0000 7f46f4600640 1 --2- 172.21.15.44:0/2184417711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec0cf070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0d3350 tx=0x7f46d801c5e0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.662+0000 7f46f4600640 1 -- 172.21.15.44:0/2184417711 shutdown_connections 2024-09-17T05:36:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.662+0000 7f46f4600640 1 --2- 172.21.15.44:0/2184417711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec0cf070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.662+0000 7f46f4600640 1 --2- 172.21.15.44:0/2184417711 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46ec0d18f0 0x7f46ec0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.662+0000 7f46f4600640 1 -- 172.21.15.44:0/2184417711 >> 172.21.15.44:0/2184417711 conn(0x7f46ec0b4240 msgr2=0x7f46ec0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.666+0000 7f46f4600640 1 -- 172.21.15.44:0/2184417711 shutdown_connections 2024-09-17T05:36:38.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.666+0000 7f46f4600640 1 -- 172.21.15.44:0/2184417711 wait complete. 2024-09-17T05:36:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.666+0000 7f46f4600640 1 Processor -- start 2024-09-17T05:36:38.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.666+0000 7f46f4600640 1 -- start start 2024-09-17T05:36:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.666+0000 7f46f4600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46ec0cf5b0 0x7f46ec15f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.666+0000 7f46f4600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46ec0d18f0 0x7f46ec1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.666+0000 7f46f4600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec1f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f4600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec169ed0 con 0x7f46ec0d1d00 2024-09-17T05:36:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f4600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec169d50 con 0x7f46ec0d18f0 2024-09-17T05:36:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f4600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec16a050 con 0x7f46ec0cf5b0 2024-09-17T05:36:38.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec1f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f1c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46ec0cf5b0 0x7f46ec15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec1f93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49384/0 (socket says 172.21.15.44:49384) 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 -- 172.21.15.44:0/1611079756 learned_addr learned my addr 172.21.15.44:0/1611079756 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f1200640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46ec0d18f0 0x7f46ec1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 -- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46ec0cf5b0 msgr2=0x7f46ec15f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46ec0cf5b0 0x7f46ec15f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 -- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46ec0d18f0 msgr2=0x7f46ec1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46ec0d18f0 0x7f46ec1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 -- 172.21.15.44:0/1611079756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec1f8f00 con 0x7f46ec0d1d00 2024-09-17T05:36:38.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f2600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec1f93b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f46e400ba10 tx=0x7f46e400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46e9600640 1 -- 172.21.15.44:0/1611079756 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4019070 con 0x7f46ec0d1d00 2024-09-17T05:36:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46e9600640 1 -- 172.21.15.44:0/1611079756 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46e400cc30 con 0x7f46ec0d1d00 2024-09-17T05:36:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46e9600640 1 -- 172.21.15.44:0/1611079756 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e400ce60 con 0x7f46ec0d1d00 2024-09-17T05:36:38.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec15f780 con 0x7f46ec0d1d00 2024-09-17T05:36:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec1fcca0 con 0x7f46ec0d1d00 2024-09-17T05:36:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec1fc730 con 0x7f46ec0d1d00 2024-09-17T05:36:38.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.670+0000 7f46e9600640 1 -- 172.21.15.44:0/1611079756 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f46e401c070 con 0x7f46ec0d1d00 2024-09-17T05:36:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.674+0000 7f46e9600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46cc073200 0x7f46cc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.674+0000 7f46e9600640 1 -- 172.21.15.44:0/1611079756 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f46e4094230 con 0x7f46ec0d1d00 2024-09-17T05:36:38.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.674+0000 7f46f1c00640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46cc073200 0x7f46cc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.674+0000 7f46f1c00640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46cc073200 0x7f46cc075710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46e000ab40 tx=0x7f46e000a250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.678+0000 7f46e9600640 1 -- 172.21.15.44:0/1611079756 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f46e405e820 con 0x7f46ec0d1d00 2024-09-17T05:36:38.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.886+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46ec0b1be0 con 0x7f46ec0d1d00 2024-09-17T05:36:38.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.886+0000 7f46e9600640 1 -- 172.21.15.44:0/1611079756 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f46e4063250 con 0x7f46ec0d1d00 2024-09-17T05:36:38.889 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:38.889 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:38.890 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:38.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46cc073200 msgr2=0x7f46cc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46cc073200 0x7f46cc075710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46e000ab40 tx=0x7f46e000a250 comp rx=0 tx=0).stop 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 msgr2=0x7f46ec1f93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec1f93b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f46e400ba10 tx=0x7f46e400bed0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 shutdown_connections 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46ec0d1d00 0x7f46ec1f93b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46cc073200 0x7f46cc075710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46ec0d18f0 0x7f46ec1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 --2- 172.21.15.44:0/1611079756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46ec0cf5b0 0x7f46ec15f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 >> 172.21.15.44:0/1611079756 conn(0x7f46ec0b4240 msgr2=0x7f46ec15a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 shutdown_connections 2024-09-17T05:36:38.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:38.890+0000 7f46f4600640 1 -- 172.21.15.44:0/1611079756 wait complete. 2024-09-17T05:36:38.912 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:39.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 -- 172.21.15.44:0/2299307354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 msgr2=0x7ff06806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 --2- 172.21.15.44:0/2299307354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff06806df50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0680b0420 tx=0x7ff05001c830 comp rx=0 tx=0).stop 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 -- 172.21.15.44:0/2299307354 shutdown_connections 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 --2- 172.21.15.44:0/2299307354 >> v2:172.21.15.86:3300/0 conn(0x7ff06806e490 0x7ff068151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 --2- 172.21.15.44:0/2299307354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff06806df50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 --2- 172.21.15.44:0/2299307354 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff068070e00 0x7ff068071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 -- 172.21.15.44:0/2299307354 >> 172.21.15.44:0/2299307354 conn(0x7ff0680cd930 msgr2=0x7ff0680cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 -- 172.21.15.44:0/2299307354 shutdown_connections 2024-09-17T05:36:39.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 -- 172.21.15.44:0/2299307354 wait complete. 2024-09-17T05:36:39.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.070+0000 7ff06ea00640 1 Processor -- start 2024-09-17T05:36:39.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 -- start start 2024-09-17T05:36:39.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06806e490 0x7ff0681fc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff068070e00 0x7ff0680b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff0680b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680cecc0 con 0x7ff0680ccb60 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680ceb40 con 0x7ff068070e00 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff0680cee40 con 0x7ff06806e490 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff0680b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff0680b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48198/0 (socket says 172.21.15.44:48198) 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 -- 172.21.15.44:0/196763212 learned_addr learned my addr 172.21.15.44:0/196763212 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff05f400640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff068070e00 0x7ff0680b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff067e00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06806e490 0x7ff0681fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 -- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06806e490 msgr2=0x7ff0681fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06806e490 0x7ff0681fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 -- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff068070e00 msgr2=0x7ff0680b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff068070e00 0x7ff0680b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 -- 172.21.15.44:0/196763212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0681f8fe0 con 0x7ff0680ccb60 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ca00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff0680b5cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff06000e970 tx=0x7ff06000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff064c00640 1 -- 172.21.15.44:0/196763212 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060004d30 con 0x7ff0680ccb60 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff064c00640 1 -- 172.21.15.44:0/196763212 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff06000cac0 con 0x7ff0680ccb60 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff064c00640 1 -- 172.21.15.44:0/196763212 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060005020 con 0x7ff0680ccb60 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0681f92c0 con 0x7ff0680ccb60 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06815c9a0 con 0x7ff0680ccb60 2024-09-17T05:36:39.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.074+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff068071c60 con 0x7ff0680ccb60 2024-09-17T05:36:39.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.078+0000 7ff064c00640 1 -- 172.21.15.44:0/196763212 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff0600051c0 con 0x7ff0680ccb60 2024-09-17T05:36:39.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.078+0000 7ff064c00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff044073230 0x7ff044075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.078+0000 7ff064c00640 1 -- 172.21.15.44:0/196763212 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff060094e00 con 0x7ff0680ccb60 2024-09-17T05:36:39.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.078+0000 7ff067e00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff044073230 0x7ff044075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.078+0000 7ff067e00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff044073230 0x7ff044075740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0580045b0 tx=0x7ff05800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.082+0000 7ff064c00640 1 -- 172.21.15.44:0/196763212 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff060016030 con 0x7ff0680ccb60 2024-09-17T05:36:39.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.262+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff068071620 con 0x7ff0680ccb60 2024-09-17T05:36:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.262+0000 7ff064c00640 1 -- 172.21.15.44:0/196763212 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7ff06005f480 con 0x7ff0680ccb60 2024-09-17T05:36:39.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:39.264 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.262+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff044073230 msgr2=0x7ff044075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.262+0000 7ff06ea00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff044073230 0x7ff044075740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0580045b0 tx=0x7ff05800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 msgr2=0x7ff0680b5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff0680b5cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff06000e970 tx=0x7ff06000ee30 comp rx=0 tx=0).stop 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 shutdown_connections 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0680ccb60 0x7ff0680b5cb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff044073230 0x7ff044075740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff068070e00 0x7ff0680b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 --2- 172.21.15.44:0/196763212 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff06806e490 0x7ff0681fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 >> 172.21.15.44:0/196763212 conn(0x7ff0680cd930 msgr2=0x7ff0681514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 shutdown_connections 2024-09-17T05:36:39.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.266+0000 7ff06ea00640 1 -- 172.21.15.44:0/196763212 wait complete. 2024-09-17T05:36:39.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2354440789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 msgr2=0x7fb0c0004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2354440789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0c0004090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc001860 tx=0x7fb0cc01c890 comp rx=0 tx=0).stop 2024-09-17T05:36:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2354440789 shutdown_connections 2024-09-17T05:36:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2354440789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0c0004090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2354440789 >> 172.21.15.44:0/2354440789 conn(0x7fb0dc0b4240 msgr2=0x7fb0dc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2354440789 shutdown_connections 2024-09-17T05:36:39.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2354440789 wait complete. 2024-09-17T05:36:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 Processor -- start 2024-09-17T05:36:39.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.446+0000 7fb0e3c00640 1 -- start start 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0dc1f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0dc06f4e0 0x7fb0dc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc1ec3d0 0x7fb0dc1ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc15d9f0 con 0x7fb0c0003c40 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc15d870 con 0x7fb0dc1ec3d0 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc1527f0 con 0x7fb0dc06f4e0 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0dc1f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0dc1f8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48224/0 (socket says 172.21.15.44:48224) 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 -- 172.21.15.44:0/2752606365 learned_addr learned my addr 172.21.15.44:0/2752606365 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1c00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc1ec3d0 0x7fb0dc1ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0d3e00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0dc06f4e0 0x7fb0dc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 -- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0dc06f4e0 msgr2=0x7fb0dc06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0dc06f4e0 0x7fb0dc06f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 -- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc1ec3d0 msgr2=0x7fb0dc1ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc1ec3d0 0x7fb0dc1ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 -- 172.21.15.44:0/2752606365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc1ecd20 con 0x7fb0c0003c40 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0d3e00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0dc06f4e0 0x7fb0dc06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e1200640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0dc1f8b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc005040 tx=0x7fb0cc0a5c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0d9600640 1 -- 172.21.15.44:0/2752606365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0068d0 con 0x7fb0c0003c40 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0d9600640 1 -- 172.21.15.44:0/2752606365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0cc0038f0 con 0x7fb0c0003c40 2024-09-17T05:36:39.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc1fc910 con 0x7fb0c0003c40 2024-09-17T05:36:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0d9600640 1 -- 172.21.15.44:0/2752606365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc001480 con 0x7fb0c0003c40 2024-09-17T05:36:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc1fced0 con 0x7fb0c0003c40 2024-09-17T05:36:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc0d0680 con 0x7fb0c0003c40 2024-09-17T05:36:39.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.450+0000 7fb0d9600640 1 -- 172.21.15.44:0/2752606365 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb0cc006150 con 0x7fb0c0003c40 2024-09-17T05:36:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.454+0000 7fb0d9600640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0b8073200 0x7fb0b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.454+0000 7fb0d9600640 1 -- 172.21.15.44:0/2752606365 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb0cc12eae0 con 0x7fb0c0003c40 2024-09-17T05:36:39.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.454+0000 7fb0d3e00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0b8073200 0x7fb0b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.454+0000 7fb0d3e00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0b8073200 0x7fb0b8075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0b81f0 tx=0x7fb0c40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.458+0000 7fb0d9600640 1 -- 172.21.15.44:0/2752606365 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb0dc1ecd20 con 0x7fb0c0003c40 2024-09-17T05:36:39.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.670+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0dc0b4800 con 0x7fb0c0003c40 2024-09-17T05:36:39.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.670+0000 7fb0d9600640 1 -- 172.21.15.44:0/2752606365 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7fb0cc016670 con 0x7fb0c0003c40 2024-09-17T05:36:39.673 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:39.673 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:39.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0b8073200 msgr2=0x7fb0b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0b8073200 0x7fb0b8075710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0b81f0 tx=0x7fb0c40091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 msgr2=0x7fb0dc1f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0dc1f8b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc005040 tx=0x7fb0cc0a5c00 comp rx=0 tx=0).stop 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 shutdown_connections 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0b8073200 0x7fb0b8075710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc1ec3d0 0x7fb0dc1ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0dc06f4e0 0x7fb0dc06f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 --2- 172.21.15.44:0/2752606365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0c0003c40 0x7fb0dc1f8b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 >> 172.21.15.44:0/2752606365 conn(0x7fb0dc0b4240 msgr2=0x7fb0dc15b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 shutdown_connections 2024-09-17T05:36:39.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:39.674+0000 7fb0e3c00640 1 -- 172.21.15.44:0/2752606365 wait complete. 2024-09-17T05:36:40.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:36:16.743512+0000', 'modified': '2024-09-17T05:36:31.794598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4414}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4414': {'gid': 4414, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.86:6835/2118333120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 2118333120}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 2118333120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4414, 'qdb_cluster': [4414]} 2024-09-17T05:36:40.098 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:36:40.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 -- 172.21.15.44:0/75860245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 msgr2=0x7f1cc80cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 --2- 172.21.15.44:0/75860245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc80cec50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009840 tx=0x7f1cb801c820 comp rx=0 tx=0).stop 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 -- 172.21.15.44:0/75860245 shutdown_connections 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 --2- 172.21.15.44:0/75860245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc815bd30 0x7f1cc80cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 --2- 172.21.15.44:0/75860245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc80cec50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 -- 172.21.15.44:0/75860245 >> 172.21.15.44:0/75860245 conn(0x7f1cc80ccaa0 msgr2=0x7f1cc80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 -- 172.21.15.44:0/75860245 shutdown_connections 2024-09-17T05:36:40.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.258+0000 7f1cccc00640 1 -- 172.21.15.44:0/75860245 wait complete. 2024-09-17T05:36:40.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 Processor -- start 2024-09-17T05:36:40.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 -- start start 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc8157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc80cb040 0x7f1cc80b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cc815bd30 0x7f1cc80a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc8165c50 con 0x7f1cc80cac30 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc815f760 con 0x7f1cc815bd30 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cccc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc8165dd0 con 0x7f1cc80cb040 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc8157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc8157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48250/0 (socket says 172.21.15.44:48250) 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cc5e00640 1 -- 172.21.15.44:0/973534364 learned_addr learned my addr 172.21.15.44:0/973534364 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cbd400640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc80cb040 0x7f1cc80b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cc6800640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cc815bd30 0x7f1cc80a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cc5e00640 1 -- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc80cb040 msgr2=0x7f1cc80b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc80cb040 0x7f1cc80b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.262+0000 7f1cc5e00640 1 -- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cc815bd30 msgr2=0x7f1cc80a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cc815bd30 0x7f1cc80a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cc5e00640 1 -- 172.21.15.44:0/973534364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc8157770 con 0x7f1cc80cac30 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cc6800640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cc815bd30 0x7f1cc80a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc8157230 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009790 tx=0x7f1cb8005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cbea00640 1 -- 172.21.15.44:0/973534364 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80b2040 con 0x7f1cc80cac30 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cbea00640 1 -- 172.21.15.44:0/973534364 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cb8004330 con 0x7f1cc80cac30 2024-09-17T05:36:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc80b33b0 con 0x7f1cc80cac30 2024-09-17T05:36:40.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cbea00640 1 -- 172.21.15.44:0/973534364 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8003840 con 0x7f1cc80cac30 2024-09-17T05:36:40.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc815e310 con 0x7f1cc80cac30 2024-09-17T05:36:40.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.266+0000 7f1cbea00640 1 -- 172.21.15.44:0/973534364 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1cb80bd060 con 0x7f1cc80cac30 2024-09-17T05:36:40.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbea00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ca4073230 0x7f1ca4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbea00640 1 -- 172.21.15.44:0/973534364 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1cb812d950 con 0x7f1cc80cac30 2024-09-17T05:36:40.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ca4073230 0x7f1ca4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 Processor -- start 2024-09-17T05:36:40.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 -- start start 2024-09-17T05:36:40.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ca4073230 0x7f1ca4075740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8167370 tx=0x7f1cb0007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d4dca460 0x5623d530b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d530bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51a3ca0 0x5623d530c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623d51e0410 con 0x5623d51ba950 2024-09-17T05:36:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5623d511db40 con 0x5623d51a3ca0 2024-09-17T05:36:40.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5623d510cf70 con 0x5623d4dca460 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d530bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d530bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48258/0 (socket says 172.21.15.44:48258) 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 -- 172.21.15.44:0/1164346025 learned_addr learned my addr 172.21.15.44:0/1164346025 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d4dca460 0x5623d530b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cc6800640 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51a3ca0 0x5623d530c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 -- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d4dca460 msgr2=0x5623d530b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d4dca460 0x5623d530b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 -- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51a3ca0 msgr2=0x5623d530c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51a3ca0 0x5623d530c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 -- 172.21.15.44:0/1164346025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d50d45b0 con 0x5623d51ba950 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cc6800640 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51a3ca0 0x5623d530c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d530bbe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8070f20 tx=0x7f1cb0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7626356bb46376a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cb6600640 1 -- 172.21.15.44:0/1164346025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb001b050 con 0x5623d51ba950 2024-09-17T05:36:40.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cb6600640 1 -- 172.21.15.44:0/1164346025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cb0025070 con 0x5623d51ba950 2024-09-17T05:36:40.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.270+0000 7f1cb6600640 1 -- 172.21.15.44:0/1164346025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0020440 con 0x5623d51ba950 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1164346025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 msgr2=0x5623d530bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d530bbe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8070f20 tx=0x7f1cb0012000 comp rx=0 tx=0).stop 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1164346025 shutdown_connections 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51a3ca0 0x5623d530c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d530bbe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1164346025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d4dca460 0x5623d530b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1164346025 >> 172.21.15.44:0/1164346025 conn(0x5623d5290d90 msgr2=0x5623d52c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1164346025 shutdown_connections 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1164346025 wait complete. 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- start start 2024-09-17T05:36:40.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 Processor -- start 2024-09-17T05:36:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d5312920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51a3ca0 0x5623d5312e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51ba950 0x5623d53133a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623d50a75f0 con 0x5623d51a3ca0 2024-09-17T05:36:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5623d5110d80 con 0x5623d4dca460 2024-09-17T05:36:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5623d50b3520 con 0x5623d51ba950 2024-09-17T05:36:40.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.274+0000 7f1cd42dd000 10 client.0 _ll_register_callbacks cb 0x5623d50b7830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51a3ca0 0x5623d5312e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51a3ca0 0x5623d5312e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48264/0 (socket says 172.21.15.44:48264) 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 -- 172.21.15.44:0/1692553632 learned_addr learned my addr 172.21.15.44:0/1692553632 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d5312920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cc6800640 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51ba950 0x5623d53133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 -- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51ba950 msgr2=0x5623d53133a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51ba950 0x5623d53133a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 -- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 msgr2=0x5623d5312920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d5312920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 -- 172.21.15.44:0/1692553632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623d50ab190 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51a3ca0 0x5623d5312e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0000f70 tx=0x7f1cb0020670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cf86bbf3f17d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 1 -- 172.21.15.44:0/1692553632 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb002d070 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 1 -- 172.21.15.44:0/1692553632 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1cb0006d70 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5623d50a5110 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 1 -- 172.21.15.44:0/1692553632 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1cb0038050 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 10 client.4758 fetch_fsmap learned FSMap version 9 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5623d5191f10 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 1 -- 172.21.15.44:0/1692553632 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5623d50a5110 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 1 -- 172.21.15.44:0/1692553632 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f1cb003b020 con 0x5623d51a3ca0 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 10 client.4758 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 10 client.4758 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:36:40.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 20 client.4758 populate_metadata read hostname 'smithi044' 2024-09-17T05:36:40.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4daf7d0 0x5623d531cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 4 client.4758 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:36:40.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 --> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623d511fa90 con 0x5623d4daf7d0 2024-09-17T05:36:40.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4daf7d0 0x5623d531cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4daf7d0 0x5623d531cd00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5a5b922efa7c858 server_cookie=76e1e1a773c5b31b in_seq=0 out_seq=0 2024-09-17T05:36:40.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 10 client.4758 ms_handle_connect on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:40.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 1 -- 172.21.15.44:0/1692553632 <== mds.0 v2:172.21.15.86:6834/2118333120 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623d511fa90 con 0x5623d4daf7d0 2024-09-17T05:36:40.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1caaa00640 10 client.4758 handle_command_reply: tid=0 2024-09-17T05:36:40.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.278+0000 7f1cd42dd000 1 client.4758 shutdown 2024-09-17T05:36:40.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51a3ca0 msgr2=0x5623d5312e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51a3ca0 0x5623d5312e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0000f70 tx=0x7f1cb0020670 comp rx=0 tx=0).stop 2024-09-17T05:36:40.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 shutdown_connections 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4daf7d0 0x5623d531cd00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51ba950 0x5623d53133a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51a3ca0 0x5623d5312e60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1692553632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d5312920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1caaa00640 0 client.4758 ms_handle_reset on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 >> 172.21.15.44:0/1692553632 conn(0x5623d5290d90 msgr2=0x5623d52c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 shutdown_connections 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1692553632 wait complete. 2024-09-17T05:36:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.282+0000 7f1cd42dd000 20 client.4758 trim_cache size 0 max 16384 2024-09-17T05:36:40.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 Processor -- start 2024-09-17T05:36:40.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- start start 2024-09-17T05:36:40.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d4dca460 0x5623d537d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d537db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51ba950 0x5623d537e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc8206490 con 0x5623d4dca460 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc8205490 con 0x5623d51ba950 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc82048a0 con 0x5623d51a3ca0 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d4dca460 0x5623d537d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d4dca460 0x5623d537d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48266/0 (socket says 172.21.15.44:48266) 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 -- 172.21.15.44:0/4077514694 learned_addr learned my addr 172.21.15.44:0/4077514694 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cbd400640 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d537db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc6800640 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51ba950 0x5623d537e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 -- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 msgr2=0x5623d537db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d537db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 -- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51ba950 msgr2=0x5623d537e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51ba950 0x5623d537e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 -- 172.21.15.44:0/4077514694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623d5168db0 con 0x5623d4dca460 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d4dca460 0x5623d537d630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cb801cd90 tx=0x7f1cb80b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e52002a99ccee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cb5c00640 1 -- 172.21.15.44:0/4077514694 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80a5840 con 0x5623d4dca460 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cb5c00640 1 -- 172.21.15.44:0/4077514694 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cb80f7a30 con 0x5623d4dca460 2024-09-17T05:36:40.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cb5c00640 1 -- 172.21.15.44:0/4077514694 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80f8620 con 0x5623d4dca460 2024-09-17T05:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- 172.21.15.44:0/4077514694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d4dca460 msgr2=0x5623d537d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d4dca460 0x5623d537d630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1cb801cd90 tx=0x7f1cb80b8040 comp rx=0 tx=0).stop 2024-09-17T05:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- 172.21.15.44:0/4077514694 shutdown_connections 2024-09-17T05:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d51ba950 0x5623d537e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d537db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/4077514694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d4dca460 0x5623d537d630 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- 172.21.15.44:0/4077514694 >> 172.21.15.44:0/4077514694 conn(0x5623d5290d90 msgr2=0x5623d52bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- 172.21.15.44:0/4077514694 shutdown_connections 2024-09-17T05:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.302+0000 7f1cd42dd000 1 -- 172.21.15.44:0/4077514694 wait complete. 2024-09-17T05:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 -- start start 2024-09-17T05:36:40.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 Processor -- start 2024-09-17T05:36:40.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d533c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d533c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d533cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5623d50d8ee0 con 0x5623d51ba950 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5623d51cc750 con 0x5623d4dca460 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5623d5191a80 con 0x5623d51a3ca0 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 10 client.0 _ll_register_callbacks cb 0x7f1cb000fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d533cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d533c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d533c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:58608/0 (socket says 172.21.15.44:58608) 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 -- 172.21.15.44:0/1085833731 learned_addr learned my addr 172.21.15.44:0/1085833731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d533c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 -- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 msgr2=0x5623d533c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d533c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 -- 172.21.15.44:0/1085833731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 msgr2=0x5623d533cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d533cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 -- 172.21.15.44:0/1085833731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623d50d3ab0 con 0x5623d4dca460 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cc5e00640 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d533c260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1cb812ba70 tx=0x7f1cb80a55d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17791c23c2a1113 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1caaa00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1caaa00640 1 -- 172.21.15.44:0/1085833731 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80f8620 con 0x5623d4dca460 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1caaa00640 1 -- 172.21.15.44:0/1085833731 <== mon.1 v2:172.21.15.86:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1cb8101420 con 0x5623d4dca460 2024-09-17T05:36:40.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cb80f7a30 con 0x5623d4dca460 2024-09-17T05:36:40.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1caaa00640 1 -- 172.21.15.44:0/1085833731 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1cb80f7f20 con 0x5623d4dca460 2024-09-17T05:36:40.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 10 client.4750 fetch_fsmap learned FSMap version 9 2024-09-17T05:36:40.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.306+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5623d50b2070 con 0x5623d4dca460 2024-09-17T05:36:40.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1caaa00640 1 -- 172.21.15.44:0/1085833731 <== mon.1 v2:172.21.15.86:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cb80f7a30 con 0x5623d4dca460 2024-09-17T05:36:40.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1caaa00640 1 -- 172.21.15.44:0/1085833731 <== mon.1 v2:172.21.15.86:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f1cb80b5070 con 0x5623d4dca460 2024-09-17T05:36:40.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 10 client.4750 fetch_fsmap finished waiting for FSMap version 9 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 10 client.4750 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 20 client.4750 populate_metadata read hostname 'smithi044' 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4d9d830 0x5623d533d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 4 client.4750 mds_command: new command op to 4414 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 --> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] -- command(tid 0: {"prefix": "status"}) -- 0x5623d511b540 con 0x5623d4d9d830 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4d9d830 0x5623d533d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cbd400640 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4d9d830 0x5623d533d610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e15614562f57192 server_cookie=f37081cc70f4f675 in_seq=0 out_seq=0 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1caaa00640 10 client.4750 ms_handle_connect on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1caaa00640 1 -- 172.21.15.44:0/1085833731 <== mds.0 v2:172.21.15.86:6834/2118333120 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x5623d511b540 con 0x5623d4d9d830 2024-09-17T05:36:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1caaa00640 10 client.4750 handle_command_reply: tid=0 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 client.4750 shutdown 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 msgr2=0x5623d533c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d533c260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1cb812ba70 tx=0x7f1cb80a55d0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 shutdown_connections 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5623d51ba950 0x5623d533cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:6834/2118333120,v1:172.21.15.86:6835/2118333120] conn(0x5623d4d9d830 0x5623d533d610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5623d51a3ca0 0x5623d533c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 --2- 172.21.15.44:0/1085833731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5623d4dca460 0x5623d533c260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 >> 172.21.15.44:0/1085833731 conn(0x5623d5290d90 msgr2=0x5623d531c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1caaa00640 0 client.4750 ms_handle_reset on v2:172.21.15.86:6834/2118333120 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 shutdown_connections 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 1 -- 172.21.15.44:0/1085833731 wait complete. 2024-09-17T05:36:40.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cd42dd000 20 client.4750 trim_cache size 0 max 16384 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4414, 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 23.01931124, 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 9, 2024-09-17T05:36:40.315 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 26, 2024-09-17T05:36:40.316 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 26, 2024-09-17T05:36:40.316 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 28.795032743 2024-09-17T05:36:40.316 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:36:40.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ca4073230 msgr2=0x7f1ca4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ca4073230 0x7f1ca4075740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8167370 tx=0x7f1cb0007ec0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 msgr2=0x7f1cc8157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc8157230 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009790 tx=0x7f1cb8005ca0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 shutdown_connections 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ca4073230 0x7f1ca4075740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cc815bd30 0x7f1cc80a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1cc80cb040 0x7f1cc80b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 --2- 172.21.15.44:0/973534364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1cc80cac30 0x7f1cc8157230 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 >> 172.21.15.44:0/973534364 conn(0x7f1cc80ccaa0 msgr2=0x7f1cc815ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 shutdown_connections 2024-09-17T05:36:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:40.310+0000 7f1cccc00640 1 -- 172.21.15.44:0/973534364 wait complete. 2024-09-17T05:36:40.333 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T05:36:40.346 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T05:36:40.346 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T05:36:40.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:40.346 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:36:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-17T05:36:40.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:40.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-17T05:36:40.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:40.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-09-17T05:36:41.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.008 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:36:41.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.018 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-09-17T05:36:41.084 INFO:teuthology.orchestra.run.smithi044.stderr:Cannot find device "ceph-brx" 2024-09-17T05:36:41.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:36:41.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.086 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-17T05:36:41.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.097 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2024-09-17T05:36:41.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:36:41.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.166 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-17T05:36:41.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.221 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-17T05:36:41.292 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2024-09-17T05:36:41.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:36:41.294 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T05:36:41.294 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:36:41.294 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:41.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:41.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 -- 172.21.15.44:0/2479617506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 msgr2=0x7fc7e8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 --2- 172.21.15.44:0/2479617506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 0x7fc7e8003e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8000b3290 tx=0x7fc7f401d2a0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc806800640 1 -- 172.21.15.44:0/2479617506 reap_dead start 2024-09-17T05:36:41.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 -- 172.21.15.44:0/2479617506 shutdown_connections 2024-09-17T05:36:41.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 -- 172.21.15.44:0/2479617506 >> 172.21.15.44:0/2479617506 conn(0x7fc8000b4240 msgr2=0x7fc8000b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:41.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 -- 172.21.15.44:0/2479617506 shutdown_connections 2024-09-17T05:36:41.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 -- 172.21.15.44:0/2479617506 wait complete. 2024-09-17T05:36:41.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 Processor -- start 2024-09-17T05:36:41.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.462+0000 7fc808800640 1 -- start start 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 0x7fc8001fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80014a090 0x7fc80014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8001f8cc0 0x7fc8001f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8001678d0 con 0x7fc7e8003a10 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc800167750 con 0x7fc8001f8cc0 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc800167a50 con 0x7fc80014a090 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 0x7fc8001fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 0x7fc8001fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48304/0 (socket says 172.21.15.44:48304) 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 -- 172.21.15.44:0/2821513308 learned_addr learned my addr 172.21.15.44:0/2821513308 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc806800640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8001f8cc0 0x7fc8001f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805400640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80014a090 0x7fc80014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 -- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80014a090 msgr2=0x7fc80014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80014a090 0x7fc80014a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 -- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8001f8cc0 msgr2=0x7fc8001f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8001f8cc0 0x7fc8001f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 -- 172.21.15.44:0/2821513308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8001f9e80 con 0x7fc7e8003a10 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805400640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80014a090 0x7fc80014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:41.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc805e00640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 0x7fc8001fb9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40af040 tx=0x7fc7f40adeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:41.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc7fa000640 1 -- 172.21.15.44:0/2821513308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40b1040 con 0x7fc7e8003a10 2024-09-17T05:36:41.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc7fa000640 1 -- 172.21.15.44:0/2821513308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7f40be070 con 0x7fc7e8003a10 2024-09-17T05:36:41.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc7fa000640 1 -- 172.21.15.44:0/2821513308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4005330 con 0x7fc7e8003a10 2024-09-17T05:36:41.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80014ae00 con 0x7fc7e8003a10 2024-09-17T05:36:41.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc800164830 con 0x7fc7e8003a10 2024-09-17T05:36:41.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.466+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8000cf070 con 0x7fc7e8003a10 2024-09-17T05:36:41.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.470+0000 7fc7fa000640 1 -- 172.21.15.44:0/2821513308 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc7f40054d0 con 0x7fc7e8003a10 2024-09-17T05:36:41.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.470+0000 7fc7fa000640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.470+0000 7fc7fa000640 1 -- 172.21.15.44:0/2821513308 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc7f412ff70 con 0x7fc7e8003a10 2024-09-17T05:36:41.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.470+0000 7fc805400640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.470+0000 7fc805400640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0005ec0 tx=0x7fc7f00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:41.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.474+0000 7fc7fa000640 1 -- 172.21.15.44:0/2821513308 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc7f4016fe0 con 0x7fc7e8003a10 2024-09-17T05:36:41.681 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:41.684 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.686+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc8000d1110 con 0x7fc7e8003a10 2024-09-17T05:36:41.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc7fa000640 1 -- 172.21.15.44:0/2821513308 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fc7f40face0 con 0x7fc7e8003a10 2024-09-17T05:36:41.689 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 msgr2=0x7fc7e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0005ec0 tx=0x7fc7f00091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 msgr2=0x7fc8001fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 0x7fc8001fb9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40af040 tx=0x7fc7f40adeb0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 shutdown_connections 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8001f8cc0 0x7fc8001f90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80014a090 0x7fc80014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 --2- 172.21.15.44:0/2821513308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7e8003a10 0x7fc8001fb9f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 >> 172.21.15.44:0/2821513308 conn(0x7fc8000b4240 msgr2=0x7fc8000b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:41.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 shutdown_connections 2024-09-17T05:36:41.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41.690+0000 7fc808800640 1 -- 172.21.15.44:0/2821513308 wait complete. 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:41.711 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:41.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.712 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:36:41.780 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:36:41.781 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42404sec preferred_lft 42404sec 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:36:41.782 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:41.783 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:41.783 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:41.783 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:41.784 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:36:41.784 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:41.784 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:41.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:36:41.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-09-17T05:36:41.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-09-17T05:36:41.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:36:41.784 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:41.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:41.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.939 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:41.958 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:36:41.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:41.961 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:36:42.015 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:36:42.015 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:42.015 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:36:42.015 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:42.015 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:36:42.015 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:42.016 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:42.016 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:42.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:36:42.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:36:42.016 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:36:42.016 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:42.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:42.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:42.153 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:36:42.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:42.162 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-09-17T05:36:42.213 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:42.213 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:42.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:36:42.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T05:36:42.214 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:42.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:42.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:42.342 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T05:36:42.342 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:42.342 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:42.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T05:36:42.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:36:42.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T05:36:42.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T05:36:42.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T05:36:42.343 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:42.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:42.485 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:42.485 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:42.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:36:42.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:36:42.485 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:42.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:42.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:42.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:42.571 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:42.581 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:42.581 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:42.581 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:42.636 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:36:42.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:42.636 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:36:42.739 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:36:42.739 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:36:42.739 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:36:43.380 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:36:43.380 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:36:43.380 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:36:43.380 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:43.380 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:43.395 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:36:43.395 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:36:43.395 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:36:43.396 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:43.396 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:43.396 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:36:43.396 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:36:43.396 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:36:43.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:36:43.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:43.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:43.420 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:43.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:43.521 INFO:teuthology.orchestra.run.smithi044.stdout:client4616 2024-09-17T05:36:43.521 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:43.521 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:43.530 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:43.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:43.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:43.634 INFO:teuthology.orchestra.run.smithi044.stdout:client4616 2024-09-17T05:36:43.635 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:43.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:43.735 INFO:teuthology.orchestra.run.smithi044.stdout:client4616 2024-09-17T05:36:43.735 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/416ea1ed-afce-4e18-8956-62d00ca75710.client4616/status') 2024-09-17T05:36:43.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:43.836 INFO:teuthology.orchestra.run.smithi044.stdout:instance: client.4616 (3)172.21.15.44:0/3586417932 2024-09-17T05:36:43.836 INFO:teuthology.orchestra.run.smithi044.stdout:blocklisted: false 2024-09-17T05:36:43.837 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records in 2024-09-17T05:36:43.837 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records out 2024-09-17T05:36:43.837 INFO:teuthology.orchestra.run.smithi044.stderr:70 bytes copied, 5.6301e-05 s, 1.2 MB/s 2024-09-17T05:36:43.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:43.845 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T05:36:43.845 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:36:43.845 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:36:43.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 -- 172.21.15.44:0/1039769855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 msgr2=0x7fab9c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 --2- 172.21.15.44:0/1039769855 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 0x7fab9c005230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c530 tx=0x7fabb001d220 comp rx=0 tx=0).stop 2024-09-17T05:36:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabb7400640 1 -- 172.21.15.44:0/1039769855 reap_dead start 2024-09-17T05:36:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 -- 172.21.15.44:0/1039769855 shutdown_connections 2024-09-17T05:36:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 -- 172.21.15.44:0/1039769855 >> 172.21.15.44:0/1039769855 conn(0x7fabb80ccaa0 msgr2=0x7fabb80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 -- 172.21.15.44:0/1039769855 shutdown_connections 2024-09-17T05:36:44.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 -- 172.21.15.44:0/1039769855 wait complete. 2024-09-17T05:36:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 Processor -- start 2024-09-17T05:36:44.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.006+0000 7fabbde00640 1 -- start start 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 0x7fabb815d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabb80c4f60 0x7fabb80c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabb80c58b0 0x7fabb81f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80cbf90 con 0x7fab9c004da0 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fabb815ed00 con 0x7fabb80c4f60 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fabb80cc110 con 0x7fabb80c58b0 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 0x7fabb815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 0x7fabb815d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48322/0 (socket says 172.21.15.44:48322) 2024-09-17T05:36:44.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 -- 172.21.15.44:0/1160398498 learned_addr learned my addr 172.21.15.44:0/1160398498 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabafe00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabb80c4f60 0x7fabb80c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb7400640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabb80c58b0 0x7fabb81f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 -- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabb80c58b0 msgr2=0x7fabb81f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabb80c58b0 0x7fabb81f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 -- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabb80c4f60 msgr2=0x7fabb80c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabb80c4f60 0x7fabb80c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 -- 172.21.15.44:0/1160398498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb815ddc0 con 0x7fab9c004da0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabb6a00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 0x7fabb815d880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faba8011ab0 tx=0x7faba8011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabaf400640 1 -- 172.21.15.44:0/1160398498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba801e070 con 0x7fab9c004da0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabaf400640 1 -- 172.21.15.44:0/1160398498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba800fc70 con 0x7fab9c004da0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabaf400640 1 -- 172.21.15.44:0/1160398498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8019670 con 0x7fab9c004da0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb80a0840 con 0x7fab9c004da0 2024-09-17T05:36:44.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb80a0e00 con 0x7fab9c004da0 2024-09-17T05:36:44.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.010+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb80c4ba0 con 0x7fab9c004da0 2024-09-17T05:36:44.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.014+0000 7fabaf400640 1 -- 172.21.15.44:0/1160398498 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faba8021070 con 0x7fab9c004da0 2024-09-17T05:36:44.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.014+0000 7fabaf400640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab94073200 0x7fab94075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.014+0000 7fabaf400640 1 -- 172.21.15.44:0/1160398498 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faba8094ee0 con 0x7fab9c004da0 2024-09-17T05:36:44.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.014+0000 7fabafe00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab94073200 0x7fab94075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.014+0000 7fabafe00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab94073200 0x7fab94075710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fabb80c2cf0 tx=0x7faba0006b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:44.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.018+0000 7fabaf400640 1 -- 172.21.15.44:0/1160398498 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faba800fe60 con 0x7fab9c004da0 2024-09-17T05:36:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fabb80cc620 con 0x7fab9c004da0 2024-09-17T05:36:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabaf400640 1 -- 172.21.15.44:0/1160398498 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7faba805f4d0 con 0x7fab9c004da0 2024-09-17T05:36:44.231 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab94073200 msgr2=0x7fab94075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab94073200 0x7fab94075710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fabb80c2cf0 tx=0x7faba0006b20 comp rx=0 tx=0).stop 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 msgr2=0x7fabb815d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 0x7fabb815d880 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faba8011ab0 tx=0x7faba8011f70 comp rx=0 tx=0).stop 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 shutdown_connections 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabb80c58b0 0x7fabb81f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab94073200 0x7fab94075710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabb80c4f60 0x7fabb80c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 --2- 172.21.15.44:0/1160398498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fab9c004da0 0x7fabb815d880 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 >> 172.21.15.44:0/1160398498 conn(0x7fabb80ccaa0 msgr2=0x7fabb8159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 shutdown_connections 2024-09-17T05:36:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44.230+0000 7fabbde00640 1 -- 172.21.15.44:0/1160398498 wait complete. 2024-09-17T05:36:44.252 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:44.253 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:36:44.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:44.253 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:44.263 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42401sec preferred_lft 42401sec 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:36:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-17T05:36:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:44.267 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:44.327 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:36:44.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:44.329 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:36:44.386 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:36:44.386 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:44.386 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:36:44.387 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:44.387 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:36:44.387 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:44.387 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:44.387 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:44.387 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:36:44.387 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:36:44.387 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:36:44.387 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:44.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:44.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:44.526 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:36:44.535 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:36:44.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:44.536 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-09-17T05:36:44.585 INFO:teuthology.orchestra.run.smithi044.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T05:36:44.586 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:44.586 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:44.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:36:44.586 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T05:36:44.586 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:44.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:44.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:44.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:44.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:36:44.735 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:44.735 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:44.735 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:44.735 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.735 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:44.736 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.736 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:44.736 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether aa:d8:b2:79:2e:01 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:36:44.736 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:36:44.736 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.736 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::a8d8:b2ff:fe79:2e01/64 scope link 2024-09-17T05:36:44.736 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:44.737 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:36:44.805 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:44.805 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether aa:d8:b2:79:2e:01 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.806 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::a8d8:b2ff:fe79:2e01/64 scope link 2024-09-17T05:36:44.807 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:44.808 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T05:36:44.808 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:44.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:44.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:44.993 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:44.993 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:36:44.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.1 up 2024-09-17T05:36:44.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:36:44.993 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:36:45.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:45.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:45.117 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:45.117 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T05:36:45.126 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:36:45.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:45.127 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:36:45.181 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:36:45.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:45.181 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:36:45.291 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:36:45.291 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T05:36:45.291 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:36:45.310 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:36:45.310 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T05:36:45.310 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:36:45.310 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:45.310 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:45.321 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T05:36:45.321 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T05:36:45.321 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:36:45.321 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:45.321 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:45.322 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:36:45.322 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:36:45.322 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:36:45.325 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:36:45.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:45.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:36:45.345 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:45.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:45.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:45.447 INFO:teuthology.orchestra.run.smithi044.stdout:client4779 2024-09-17T05:36:45.447 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:45.447 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:45.457 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:45.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:45.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:45.554 INFO:teuthology.orchestra.run.smithi044.stdout:client4779 2024-09-17T05:36:45.554 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:45.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:45.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:45.613 INFO:teuthology.orchestra.run.smithi044.stdout:client4779 2024-09-17T05:36:45.613 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/416ea1ed-afce-4e18-8956-62d00ca75710.client4779/status') 2024-09-17T05:36:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:45.673 INFO:teuthology.orchestra.run.smithi044.stdout:instance: client.4779 (3)192.168.0.2:0/2153887825 2024-09-17T05:36:45.674 INFO:teuthology.orchestra.run.smithi044.stdout:blocklisted: false 2024-09-17T05:36:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records in 2024-09-17T05:36:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records out 2024-09-17T05:36:45.674 INFO:teuthology.orchestra.run.smithi044.stderr:69 bytes copied, 7.2237e-05 s, 955 kB/s 2024-09-17T05:36:45.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:45.682 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T05:36:45.682 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:36:45.682 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:45.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 -- 172.21.15.44:0/598503974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc40cb470 msgr2=0x7f0dc40cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 --2- 172.21.15.44:0/598503974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc40cb470 0x7f0dc40cb880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009bc0 tx=0x7f0dbc01cb30 comp rx=0 tx=0).stop 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 -- 172.21.15.44:0/598503974 shutdown_connections 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 --2- 172.21.15.44:0/598503974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc40cb470 0x7f0dc40cb880 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 --2- 172.21.15.44:0/598503974 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dc4072e50 0x7f0dc415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 -- 172.21.15.44:0/598503974 >> 172.21.15.44:0/598503974 conn(0x7f0dc40ccaa0 msgr2=0x7f0dc40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 -- 172.21.15.44:0/598503974 shutdown_connections 2024-09-17T05:36:45.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 -- 172.21.15.44:0/598503974 wait complete. 2024-09-17T05:36:45.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 Processor -- start 2024-09-17T05:36:45.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.842+0000 7f0dcb800640 1 -- start start 2024-09-17T05:36:45.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc406de50 0x7f0dc40c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc4072e50 0x7f0dc41f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dc40cb470 0x7f0dc40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4168fc0 con 0x7f0dc406de50 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4168e40 con 0x7f0dc4072e50 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc4169140 con 0x7f0dc40cb470 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc406de50 0x7f0dc40c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc406de50 0x7f0dc40c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48336/0 (socket says 172.21.15.44:48336) 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 -- 172.21.15.44:0/3287375018 learned_addr learned my addr 172.21.15.44:0/3287375018 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 -- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dc40cb470 msgr2=0x7f0dc40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dc40cb470 0x7f0dc40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 -- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc4072e50 msgr2=0x7f0dc41f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc4072e50 0x7f0dc41f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 -- 172.21.15.44:0/3287375018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc4164650 con 0x7f0dc406de50 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc8e00640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc406de50 0x7f0dc40c9af0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0db800e7f0 tx=0x7f0db800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc0c00640 1 -- 172.21.15.44:0/3287375018 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db800ccc0 con 0x7f0dc406de50 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc0c00640 1 -- 172.21.15.44:0/3287375018 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0db800ce80 con 0x7f0dc406de50 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc0c00640 1 -- 172.21.15.44:0/3287375018 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8005280 con 0x7f0dc406de50 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc4155b30 con 0x7f0dc406de50 2024-09-17T05:36:45.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc4154b10 con 0x7f0dc406de50 2024-09-17T05:36:45.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc40cb880 con 0x7f0dc406de50 2024-09-17T05:36:45.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.846+0000 7f0dc0c00640 1 -- 172.21.15.44:0/3287375018 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0db8005420 con 0x7f0dc406de50 2024-09-17T05:36:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.850+0000 7f0dc0c00640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0da4073200 0x7f0da4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.850+0000 7f0dc0c00640 1 -- 172.21.15.44:0/3287375018 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0db80954a0 con 0x7f0dc406de50 2024-09-17T05:36:45.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.850+0000 7f0dc3e00640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0da4073200 0x7f0da4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:45.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.850+0000 7f0dc3e00640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0da4073200 0x7f0da4075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0db0007fd0 tx=0x7f0db0007940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:45.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:45.850+0000 7f0dc0c00640 1 -- 172.21.15.44:0/3287375018 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0db8060160 con 0x7f0dc406de50 2024-09-17T05:36:46.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.062+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0dc40b5fa0 con 0x7f0dc406de50 2024-09-17T05:36:46.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.062+0000 7f0dc0c00640 1 -- 172.21.15.44:0/3287375018 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f0db805fa60 con 0x7f0dc406de50 2024-09-17T05:36:46.064 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T05:36:46.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0da4073200 msgr2=0x7f0da4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0da4073200 0x7f0da4075710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0db0007fd0 tx=0x7f0db0007940 comp rx=0 tx=0).stop 2024-09-17T05:36:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc406de50 msgr2=0x7f0dc40c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc406de50 0x7f0dc40c9af0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0db800e7f0 tx=0x7f0db800ecb0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 shutdown_connections 2024-09-17T05:36:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dc40cb470 0x7f0dc40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0da4073200 0x7f0da4075710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc4072e50 0x7f0dc41f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 --2- 172.21.15.44:0/3287375018 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dc406de50 0x7f0dc40c9af0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 >> 172.21.15.44:0/3287375018 conn(0x7f0dc40ccaa0 msgr2=0x7f0dc40b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:46.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 shutdown_connections 2024-09-17T05:36:46.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:46.066+0000 7f0dcb800640 1 -- 172.21.15.44:0/3287375018 wait complete. 2024-09-17T05:36:46.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:36:46.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:46.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-09-17T05:36:46.087 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:36:46.087 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:46.087 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:36:46.087 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:36:46.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:46.088 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:36:46.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:46.088 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-09-17T05:36:46.098 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42404sec preferred_lft 42404sec 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 02:42:46:1e:0a:3e brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:46.099 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:46.100 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:36:46.101 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:46.101 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:46.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:36:46.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-09-17T05:36:46.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-09-17T05:36:46.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:36:46.101 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:46.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:46.259 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:46.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:46.267 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:46.285 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-17T05:36:46.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:46.288 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-09-17T05:36:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-09-17T05:36:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:36:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:36:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:36:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:46.371 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:36:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:46.372 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:46.372 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:46.372 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:46.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:36:46.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:36:46.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:36:46.372 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:46.458 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:46.500 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:46.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:46.507 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-17T05:36:46.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:46.516 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-09-17T05:36:46.568 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:46.568 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:46.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:36:46.568 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T05:36:46.568 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:46.657 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:46.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:46.694 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T05:36:46.695 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:46.741 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:46.846 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:46.853 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:46.853 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:46.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-09-17T05:36:46.853 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:36:46.853 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:46.898 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:46.928 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:46.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:46.935 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:46.988 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:36:46.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:46.989 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:47.039 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:36:47.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:47.039 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:36:47.140 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:36:47.140 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T05:36:47.140 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-09-17T05:36:47.782 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:36:47.782 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T05:36:47.782 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-09-17T05:36:47.782 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:47.782 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:36:47.795 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:36:47.799 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:36:47.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:47.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:47.819 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:47.910 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:47.926 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:47.932 INFO:teuthology.orchestra.run.smithi086.stdout:client4628 2024-09-17T05:36:47.933 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:47.933 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:47.941 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:48.029 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:48.032 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:48.039 INFO:teuthology.orchestra.run.smithi086.stdout:client4628 2024-09-17T05:36:48.039 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:48.085 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:48.089 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:48.095 INFO:teuthology.orchestra.run.smithi086.stdout:client4628 2024-09-17T05:36:48.096 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/416ea1ed-afce-4e18-8956-62d00ca75710.client4628/status') 2024-09-17T05:36:48.142 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:48.154 INFO:teuthology.orchestra.run.smithi086.stdout:instance: client.4628 (3)192.168.0.1:0/3170304568 2024-09-17T05:36:48.154 INFO:teuthology.orchestra.run.smithi086.stdout:blocklisted: false 2024-09-17T05:36:48.154 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records in 2024-09-17T05:36:48.155 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records out 2024-09-17T05:36:48.155 INFO:teuthology.orchestra.run.smithi086.stderr:69 bytes copied, 6.5328e-05 s, 1.1 MB/s 2024-09-17T05:36:48.155 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:48.162 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T05:36:48.162 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:36:48.162 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:36:48.162 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:48.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 -- 172.21.15.44:0/4221434509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0b1fc0 msgr2=0x7efd9c0b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 --2- 172.21.15.44:0/4221434509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0b1fc0 0x7efd9c0b23d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efd9c073dc0 tx=0x7efd9401cc40 comp rx=0 tx=0).stop 2024-09-17T05:36:48.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 -- 172.21.15.44:0/4221434509 shutdown_connections 2024-09-17T05:36:48.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 --2- 172.21.15.44:0/4221434509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c0b1fc0 0x7efd9c0b23d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 --2- 172.21.15.44:0/4221434509 >> v2:172.21.15.86:3300/0 conn(0x7efd9c0c7370 0x7efd9c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 -- 172.21.15.44:0/4221434509 >> 172.21.15.44:0/4221434509 conn(0x7efd9c0ceaa0 msgr2=0x7efd9c0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:48.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 -- 172.21.15.44:0/4221434509 shutdown_connections 2024-09-17T05:36:48.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.334+0000 7efda1000640 1 -- 172.21.15.44:0/4221434509 wait complete. 2024-09-17T05:36:48.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 Processor -- start 2024-09-17T05:36:48.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 -- start start 2024-09-17T05:36:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd9c0b1fc0 0x7efd9c13f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd9c0c7370 0x7efd9c1fa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c160060 0x7efd9c13e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c169e90 con 0x7efd9c160060 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c169d10 con 0x7efd9c0b1fc0 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c16a010 con 0x7efd9c0c7370 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c160060 0x7efd9c13e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c160060 0x7efd9c13e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48356/0 (socket says 172.21.15.44:48356) 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 -- 172.21.15.44:0/2459422955 learned_addr learned my addr 172.21.15.44:0/2459422955 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9b400640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd9c0b1fc0 0x7efd9c13f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9aa00640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd9c0c7370 0x7efd9c1fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 -- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd9c0c7370 msgr2=0x7efd9c1fa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd9c0c7370 0x7efd9c1fa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 -- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd9c0b1fc0 msgr2=0x7efd9c13f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd9c0b1fc0 0x7efd9c13f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 -- 172.21.15.44:0/2459422955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c1fabe0 con 0x7efd9c160060 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd9be00640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c160060 0x7efd9c13e840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd9401b2f0 tx=0x7efd94003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd93400640 1 -- 172.21.15.44:0/2459422955 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940bb070 con 0x7efd9c160060 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd93400640 1 -- 172.21.15.44:0/2459422955 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd94004e00 con 0x7efd9c160060 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c1faec0 con 0x7efd9c160060 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efd93400640 1 -- 172.21.15.44:0/2459422955 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd940b2040 con 0x7efd9c160060 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.338+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c150500 con 0x7efd9c160060 2024-09-17T05:36:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.342+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c150010 con 0x7efd9c160060 2024-09-17T05:36:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.342+0000 7efd93400640 1 -- 172.21.15.44:0/2459422955 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd940be070 con 0x7efd9c160060 2024-09-17T05:36:48.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.342+0000 7efd93400640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd7c073200 0x7efd7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.342+0000 7efd93400640 1 -- 172.21.15.44:0/2459422955 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd9412e2f0 con 0x7efd9c160060 2024-09-17T05:36:48.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.342+0000 7efd9b400640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd7c073200 0x7efd7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.342+0000 7efd9b400640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd7c073200 0x7efd7c075710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00bb50 tx=0x7efd8c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.346+0000 7efd93400640 1 -- 172.21.15.44:0/2459422955 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efd94016950 con 0x7efd9c160060 2024-09-17T05:36:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efd9c0b23d0 con 0x7efd9c160060 2024-09-17T05:36:48.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efd93400640 1 -- 172.21.15.44:0/2459422955 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7efd940f88e0 con 0x7efd9c160060 2024-09-17T05:36:48.562 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-17T05:36:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd7c073200 msgr2=0x7efd7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd7c073200 0x7efd7c075710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00bb50 tx=0x7efd8c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c160060 msgr2=0x7efd9c13e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c160060 0x7efd9c13e840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efd9401b2f0 tx=0x7efd94003f60 comp rx=0 tx=0).stop 2024-09-17T05:36:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 shutdown_connections 2024-09-17T05:36:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd9c160060 0x7efd9c13e840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd9c0c7370 0x7efd9c1fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd7c073200 0x7efd7c075710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 --2- 172.21.15.44:0/2459422955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd9c0b1fc0 0x7efd9c13f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 >> 172.21.15.44:0/2459422955 conn(0x7efd9c0ceaa0 msgr2=0x7efd9c15cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 shutdown_connections 2024-09-17T05:36:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:48.562+0000 7efda1000640 1 -- 172.21.15.44:0/2459422955 wait complete. 2024-09-17T05:36:48.585 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:36:48.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:48.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-09-17T05:36:48.585 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T05:36:48.586 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:36:48.586 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:36:48.586 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:36:48.586 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:48.586 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:36:48.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:48.587 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:48.596 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42401sec preferred_lft 42401sec 2024-09-17T05:36:48.597 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 02:42:46:1e:0a:3e brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:48.598 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-09-17T05:36:48.599 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:48.599 INFO:teuthology.orchestra.run.smithi086.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:48.599 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:36:48.599 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-17T05:36:48.599 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:48.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:48.600 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:48.661 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-17T05:36:48.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:48.663 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:48.715 INFO:teuthology.orchestra.run.smithi086.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:48.716 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:48.716 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:48.716 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:48.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:36:48.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:36:48.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:36:48.716 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:48.842 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:48.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:48.848 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-17T05:36:48.857 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:36:48.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:48.858 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-09-17T05:36:48.907 INFO:teuthology.orchestra.run.smithi086.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T05:36:48.908 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:48.908 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:48.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:36:48.908 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T05:36:48.908 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:49.001 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:49.031 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:49.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:49.038 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:36:49.057 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 96:d0:1c:b0:29:84 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::94d0:1cff:feb0:2984/64 scope link 2024-09-17T05:36:49.058 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:49.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 96:d0:1c:b0:29:84 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::94d0:1cff:feb0:2984/64 scope link 2024-09-17T05:36:49.123 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:49.125 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T05:36:49.125 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:49.125 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:49.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T05:36:49.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:36:49.125 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T05:36:49.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T05:36:49.126 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T05:36:49.126 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:49.213 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:49.298 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:49.304 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:49.304 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-09-17T05:36:49.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.1 up 2024-09-17T05:36:49.305 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:36:49.305 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-09-17T05:36:49.354 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:49.383 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:49.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:49.390 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T05:36:49.444 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:36:49.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:49.444 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:36:49.495 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:36:49.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:49.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:36:49.599 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:36:49.599 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T05:36:49.599 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-09-17T05:36:49.616 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:36:49.617 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T05:36:49.617 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-09-17T05:36:49.617 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:49.617 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:49.626 INFO:teuthology.orchestra.run.smithi086.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T05:36:49.626 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T05:36:49.626 INFO:teuthology.orchestra.run.smithi086.stdout:invalid new device string format 2024-09-17T05:36:49.626 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:36:49.627 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:36:49.627 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:36:49.627 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:36:49.627 INFO:teuthology.orchestra.run.smithi086.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:36:49.630 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:36:49.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:49.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:36:49.649 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:49.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:49.745 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:49.752 INFO:teuthology.orchestra.run.smithi086.stdout:client4771 2024-09-17T05:36:49.752 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:49.752 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:49.761 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:49.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:49.857 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:49.863 INFO:teuthology.orchestra.run.smithi086.stdout:client4771 2024-09-17T05:36:49.863 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:49.909 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:49.912 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:49.918 INFO:teuthology.orchestra.run.smithi086.stdout:client4771 2024-09-17T05:36:49.918 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/416ea1ed-afce-4e18-8956-62d00ca75710.client4771/status') 2024-09-17T05:36:50.005 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:50.017 INFO:teuthology.orchestra.run.smithi086.stdout:instance: client.4771 (3)192.168.0.2:0/3560756009 2024-09-17T05:36:50.018 INFO:teuthology.orchestra.run.smithi086.stdout:blocklisted: false 2024-09-17T05:36:50.018 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records in 2024-09-17T05:36:50.018 INFO:teuthology.orchestra.run.smithi086.stderr:0+1 records out 2024-09-17T05:36:50.018 INFO:teuthology.orchestra.run.smithi086.stderr:69 bytes copied, 4.9647e-05 s, 1.4 MB/s 2024-09-17T05:36:50.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-17T05:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:50.025 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T05:36:50.072 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-17T05:36:50.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:50.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 -- 172.21.15.44:0/972383489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d18f0 msgr2=0x7fb0f40b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/972383489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d18f0 0x7fb0f40b1be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009870 tx=0x7fb0e401c6c0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 -- 172.21.15.44:0/972383489 shutdown_connections 2024-09-17T05:36:50.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/972383489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d18f0 0x7fb0f40b1be0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 -- 172.21.15.44:0/972383489 >> 172.21.15.44:0/972383489 conn(0x7fb0f40b4240 msgr2=0x7fb0f40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:50.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 -- 172.21.15.44:0/972383489 shutdown_connections 2024-09-17T05:36:50.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 -- 172.21.15.44:0/972383489 wait complete. 2024-09-17T05:36:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.234+0000 7fb0f9e00640 1 Processor -- start 2024-09-17T05:36:50.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 -- start start 2024-09-17T05:36:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f40d18f0 0x7fb0f40cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d1d00 0x7fb0f415e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f40b59c0 0x7fb0f415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f416b0a0 con 0x7fb0f40b59c0 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f416af20 con 0x7fb0f40d18f0 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f416b220 con 0x7fb0f40d1d00 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f40d18f0 0x7fb0f40cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d1d00 0x7fb0f415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f40d18f0 0x7fb0f40cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:33158/0 (socket says 172.21.15.44:33158) 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2a00640 1 -- 172.21.15.44:0/4132834510 learned_addr learned my addr 172.21.15.44:0/4132834510 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f3400640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f40b59c0 0x7fb0f415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2000640 1 -- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f40d18f0 msgr2=0x7fb0f40cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2000640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f40d18f0 0x7fb0f40cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2000640 1 -- 172.21.15.44:0/4132834510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f40b59c0 msgr2=0x7fb0f415e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2000640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f40b59c0 0x7fb0f415e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2000640 1 -- 172.21.15.44:0/4132834510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f4156620 con 0x7fb0f40d1d00 2024-09-17T05:36:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f2000640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d1d00 0x7fb0f415e470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40cfc60 tx=0x7fb0e000c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0eb400640 1 -- 172.21.15.44:0/4132834510 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0012830 con 0x7fb0f40d1d00 2024-09-17T05:36:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0eb400640 1 -- 172.21.15.44:0/4132834510 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0e0017070 con 0x7fb0f40d1d00 2024-09-17T05:36:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0eb400640 1 -- 172.21.15.44:0/4132834510 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0012de0 con 0x7fb0f40d1d00 2024-09-17T05:36:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f4156900 con 0x7fb0f40d1d00 2024-09-17T05:36:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.238+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f4156ec0 con 0x7fb0f40d1d00 2024-09-17T05:36:50.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.242+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f4157b60 con 0x7fb0f40d1d00 2024-09-17T05:36:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.242+0000 7fb0eb400640 1 -- 172.21.15.44:0/4132834510 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb0e001c460 con 0x7fb0f40d1d00 2024-09-17T05:36:50.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.242+0000 7fb0eb400640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0d4073230 0x7fb0d4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.242+0000 7fb0eb400640 1 -- 172.21.15.44:0/4132834510 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb0e00942c0 con 0x7fb0f40d1d00 2024-09-17T05:36:50.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.242+0000 7fb0f2a00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0d4073230 0x7fb0d4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.242+0000 7fb0f2a00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0d4073230 0x7fb0d4075740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401ad70 tx=0x7fb0e401af00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:50.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.246+0000 7fb0eb400640 1 -- 172.21.15.44:0/4132834510 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb0e005e950 con 0x7fb0f40d1d00 2024-09-17T05:36:50.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.422+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0f41563b0 con 0x7fb0f40d1d00 2024-09-17T05:36:50.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0eb400640 1 -- 172.21.15.44:0/4132834510 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18554 (secure 0 0 0) 0x7fb0e0063380 con 0x7fb0f40d1d00 2024-09-17T05:36:50.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:50.427 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:21.773791+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0d4073230 msgr2=0x7fb0d4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0d4073230 0x7fb0d4075740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb0e401ad70 tx=0x7fb0e401af00 comp rx=0 tx=0).stop 2024-09-17T05:36:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d1d00 msgr2=0x7fb0f415e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d1d00 0x7fb0f415e470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40cfc60 tx=0x7fb0e000c9b0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 shutdown_connections 2024-09-17T05:36:50.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0f40b59c0 0x7fb0f415e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0f40d1d00 0x7fb0f415e470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0d4073230 0x7fb0d4075740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 --2- 172.21.15.44:0/4132834510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f40d18f0 0x7fb0f40cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 >> 172.21.15.44:0/4132834510 conn(0x7fb0f40b4240 msgr2=0x7fb0f40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 shutdown_connections 2024-09-17T05:36:50.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.426+0000 7fb0f9e00640 1 -- 172.21.15.44:0/4132834510 wait complete. 2024-09-17T05:36:50.449 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:36:06.284181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T05:36:14.702770+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T05:36:15.678933+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-17T05:36:19.330357+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-17T05:36:50.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:36:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 -- 172.21.15.44:0/2243731954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 msgr2=0x7f53dc15ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 --2- 172.21.15.44:0/2243731954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc15ce30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53dc072370 tx=0x7f53d401ccf0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 -- 172.21.15.44:0/2243731954 shutdown_connections 2024-09-17T05:36:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 --2- 172.21.15.44:0/2243731954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc15ce30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 --2- 172.21.15.44:0/2243731954 >> v2:172.21.15.86:3300/0 conn(0x7f53dc160060 0x7f53dc160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 --2- 172.21.15.44:0/2243731954 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53dc0c7370 0x7f53dc0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 -- 172.21.15.44:0/2243731954 >> 172.21.15.44:0/2243731954 conn(0x7f53dc0ceaa0 msgr2=0x7f53dc0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 -- 172.21.15.44:0/2243731954 shutdown_connections 2024-09-17T05:36:50.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.610+0000 7f53e0e00640 1 -- 172.21.15.44:0/2243731954 wait complete. 2024-09-17T05:36:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 Processor -- start 2024-09-17T05:36:50.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 -- start start 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53dc0c7370 0x7f53dc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc1f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53dc160060 0x7f53dc151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc0b2cf0 con 0x7f53dc15ca20 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc0b2b70 con 0x7f53dc0c7370 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53e0e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f53dc0b2e70 con 0x7f53dc160060 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc1f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc1f9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43882/0 (socket says 172.21.15.44:43882) 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53d2a00640 1 -- 172.21.15.44:0/3243238966 learned_addr learned my addr 172.21.15.44:0/3243238966 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53db400640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53dc0c7370 0x7f53dc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.614+0000 7f53dbe00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53dc160060 0x7f53dc151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d2a00640 1 -- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53dc160060 msgr2=0x7f53dc151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d2a00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53dc160060 0x7f53dc151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d2a00640 1 -- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53dc0c7370 msgr2=0x7f53dc06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d2a00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53dc0c7370 0x7f53dc06eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d2a00640 1 -- 172.21.15.44:0/3243238966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc151e90 con 0x7f53dc15ca20 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53db400640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53dc0c7370 0x7f53dc06eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53dbe00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53dc160060 0x7f53dc151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:50.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d2a00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc1f9480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53c400e770 tx=0x7f53c400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d3e00640 1 -- 172.21.15.44:0/3243238966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c400ccc0 con 0x7f53dc15ca20 2024-09-17T05:36:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d3e00640 1 -- 172.21.15.44:0/3243238966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53c400ee80 con 0x7f53dc15ca20 2024-09-17T05:36:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc06fca0 con 0x7f53dc15ca20 2024-09-17T05:36:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d3e00640 1 -- 172.21.15.44:0/3243238966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c400ce60 con 0x7f53dc15ca20 2024-09-17T05:36:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc06e360 con 0x7f53dc15ca20 2024-09-17T05:36:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc15ce30 con 0x7f53dc15ca20 2024-09-17T05:36:50.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.618+0000 7f53d3e00640 1 -- 172.21.15.44:0/3243238966 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f53c4004260 con 0x7f53dc15ca20 2024-09-17T05:36:50.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.622+0000 7f53d3e00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53b8073200 0x7f53b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.622+0000 7f53d3e00640 1 -- 172.21.15.44:0/3243238966 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f53c4094e30 con 0x7f53dc15ca20 2024-09-17T05:36:50.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.622+0000 7f53db400640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53b8073200 0x7f53b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.622+0000 7f53db400640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53b8073200 0x7f53b8075710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009b10 tx=0x7f53cc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:50.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.626+0000 7f53d3e00640 1 -- 172.21.15.44:0/3243238966 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f53c405fb90 con 0x7f53dc15ca20 2024-09-17T05:36:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f53dc0ce470 con 0x7f53dc15ca20 2024-09-17T05:36:50.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53d3e00640 1 -- 172.21.15.44:0/3243238966 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f53c405f490 con 0x7f53dc15ca20 2024-09-17T05:36:50.803 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53b8073200 msgr2=0x7f53b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53b8073200 0x7f53b8075710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009b10 tx=0x7f53cc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 msgr2=0x7f53dc1f9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc1f9480 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53c400e770 tx=0x7f53c400ec30 comp rx=0 tx=0).stop 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 shutdown_connections 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53dc160060 0x7f53dc151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53dc15ca20 0x7f53dc1f9480 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53b8073200 0x7f53b8075710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 --2- 172.21.15.44:0/3243238966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53dc0c7370 0x7f53dc06eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 >> 172.21.15.44:0/3243238966 conn(0x7f53dc0ceaa0 msgr2=0x7f53dc068f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:50.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 shutdown_connections 2024-09-17T05:36:50.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.802+0000 7f53e0e00640 1 -- 172.21.15.44:0/3243238966 wait complete. 2024-09-17T05:36:50.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T05:36:50.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.986+0000 7f2af1400640 1 -- 172.21.15.44:0/4141177473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 msgr2=0x7f2aec0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.986+0000 7f2af1400640 1 --2- 172.21.15.44:0/4141177473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b1be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009840 tx=0x7f2adc01c760 comp rx=0 tx=0).stop 2024-09-17T05:36:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 -- 172.21.15.44:0/4141177473 shutdown_connections 2024-09-17T05:36:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 --2- 172.21.15.44:0/4141177473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b1be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 -- 172.21.15.44:0/4141177473 >> 172.21.15.44:0/4141177473 conn(0x7f2aec0b4240 msgr2=0x7f2aec0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 -- 172.21.15.44:0/4141177473 shutdown_connections 2024-09-17T05:36:50.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 -- 172.21.15.44:0/4141177473 wait complete. 2024-09-17T05:36:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 Processor -- start 2024-09-17T05:36:50.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 -- start start 2024-09-17T05:36:50.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0d1d00 0x7f2aec1fac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.990+0000 7f2af1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec159110 0x7f2aec0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2af1400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec16b0a0 con 0x7f2aec0d18f0 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2af1400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec16af20 con 0x7f2aec159110 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2af1400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec16b220 con 0x7f2aec0d1d00 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43894/0 (socket says 172.21.15.44:43894) 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 -- 172.21.15.44:0/1520710352 learned_addr learned my addr 172.21.15.44:0/1520710352 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2ae3e00640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0d1d00 0x7f2aec1fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aeb200640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec159110 0x7f2aec0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 -- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0d1d00 msgr2=0x7f2aec1fac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0d1d00 0x7f2aec1fac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 -- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec159110 msgr2=0x7f2aec0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec159110 0x7f2aec0cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 -- 172.21.15.44:0/1520710352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec158070 con 0x7f2aec0d18f0 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2aea800640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b7c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009790 tx=0x7f2adc0a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1520710352 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc0b2040 con 0x7f2aec0d18f0 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1520710352 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2adc004430 con 0x7f2aec0d18f0 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1520710352 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc005280 con 0x7f2aec0d18f0 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec158350 con 0x7f2aec0d18f0 2024-09-17T05:36:50.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec158910 con 0x7f2aec0d18f0 2024-09-17T05:36:50.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec157dd0 con 0x7f2aec0d18f0 2024-09-17T05:36:50.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.994+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1520710352 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2adc005420 con 0x7f2aec0d18f0 2024-09-17T05:36:50.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.998+0000 7f2ae2a00640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073200 0x7f2ac8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.998+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1520710352 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2adc12e080 con 0x7f2aec0d18f0 2024-09-17T05:36:50.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.998+0000 7f2ae3e00640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073200 0x7f2ac8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:50.998+0000 7f2ae3e00640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073200 0x7f2ac8075710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0719c0 tx=0x7f2ad4007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:51.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.002+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1520710352 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2aec157dd0 con 0x7f2aec0d18f0 2024-09-17T05:36:51.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2aec0b1be0 con 0x7f2aec0d18f0 2024-09-17T05:36:51.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1520710352 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2adc0bc060 con 0x7f2aec0d18f0 2024-09-17T05:36:51.178 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-17T05:36:51.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073200 msgr2=0x7f2ac8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073200 0x7f2ac8075710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0719c0 tx=0x7f2ad4007ea0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 msgr2=0x7f2aec0b7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b7c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009790 tx=0x7f2adc0a5640 comp rx=0 tx=0).stop 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 shutdown_connections 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073200 0x7f2ac8075710 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec159110 0x7f2aec0cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0d1d00 0x7f2aec1fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 --2- 172.21.15.44:0/1520710352 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d18f0 0x7f2aec0b7c90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 >> 172.21.15.44:0/1520710352 conn(0x7f2aec0b4240 msgr2=0x7f2aec152670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 shutdown_connections 2024-09-17T05:36:51.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.178+0000 7f2af1400640 1 -- 172.21.15.44:0/1520710352 wait complete. 2024-09-17T05:36:51.201 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T05:36:51.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 -- 172.21.15.44:0/2059850850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 msgr2=0x7f6fb8144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 --2- 172.21.15.44:0/2059850850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8144f60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009900 tx=0x7f6fac01c8b0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 -- 172.21.15.44:0/2059850850 shutdown_connections 2024-09-17T05:36:51.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 --2- 172.21.15.44:0/2059850850 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fb806f0e0 0x7f6fb806f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 --2- 172.21.15.44:0/2059850850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8144f60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 -- 172.21.15.44:0/2059850850 >> 172.21.15.44:0/2059850850 conn(0x7f6fb806ce40 msgr2=0x7f6fb806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:51.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 -- 172.21.15.44:0/2059850850 shutdown_connections 2024-09-17T05:36:51.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.362+0000 7f6fbee00640 1 -- 172.21.15.44:0/2059850850 wait complete. 2024-09-17T05:36:51.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 Processor -- start 2024-09-17T05:36:51.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 -- start start 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb806f0e0 0x7f6fb815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fb815ff20 0x7f6fb80b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8169f80 con 0x7f6fb81455b0 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8169e00 con 0x7f6fb806f0e0 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb816a100 con 0x7f6fb815ff20 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbda00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb806f0e0 0x7f6fb815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43910/0 (socket says 172.21.15.44:43910) 2024-09-17T05:36:51.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 -- 172.21.15.44:0/3552649054 learned_addr learned my addr 172.21.15.44:0/3552649054 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:51.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbe400640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fb815ff20 0x7f6fb80b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 -- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fb815ff20 msgr2=0x7f6fb80b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fb815ff20 0x7f6fb80b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 -- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb806f0e0 msgr2=0x7f6fb815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb806f0e0 0x7f6fb815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 -- 172.21.15.44:0/3552649054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb8165790 con 0x7f6fb81455b0 2024-09-17T05:36:51.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbd000640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8157460 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e7f0 tx=0x7f6fa400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:51.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fb5600640 1 -- 172.21.15.44:0/3552649054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400ccc0 con 0x7f6fb81455b0 2024-09-17T05:36:51.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fb5600640 1 -- 172.21.15.44:0/3552649054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fa400ce80 con 0x7f6fb81455b0 2024-09-17T05:36:51.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fb5600640 1 -- 172.21.15.44:0/3552649054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4005280 con 0x7f6fb81455b0 2024-09-17T05:36:51.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb8165a70 con 0x7f6fb81455b0 2024-09-17T05:36:51.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.366+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb80b4830 con 0x7f6fb81455b0 2024-09-17T05:36:51.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.370+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb806f4f0 con 0x7f6fb81455b0 2024-09-17T05:36:51.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.370+0000 7f6fb5600640 1 -- 172.21.15.44:0/3552649054 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6fa4005420 con 0x7f6fb81455b0 2024-09-17T05:36:51.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.370+0000 7f6fb5600640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f98073200 0x7f6f98075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.370+0000 7f6fb5600640 1 -- 172.21.15.44:0/3552649054 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6fa4094d70 con 0x7f6fb81455b0 2024-09-17T05:36:51.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.370+0000 7f6fbda00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f98073200 0x7f6f98075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.370+0000 7f6fbda00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f98073200 0x7f6f98075710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0af000 tx=0x7f6fac01b0f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:51.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.374+0000 7f6fb5600640 1 -- 172.21.15.44:0/3552649054 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6fa405f480 con 0x7f6fb81455b0 2024-09-17T05:36:51.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6fb80b45c0 con 0x7f6fb81455b0 2024-09-17T05:36:51.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fb5600640 1 -- 172.21.15.44:0/3552649054 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f6fa4063eb0 con 0x7f6fb81455b0 2024-09-17T05:36:51.551 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-09-17T05:36:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f98073200 msgr2=0x7f6f98075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f98073200 0x7f6f98075710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0af000 tx=0x7f6fac01b0f0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 msgr2=0x7f6fb8157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8157460 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e7f0 tx=0x7f6fa400ecb0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 shutdown_connections 2024-09-17T05:36:51.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fb815ff20 0x7f6fb80b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb81455b0 0x7f6fb8157460 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f98073200 0x7f6f98075710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 --2- 172.21.15.44:0/3552649054 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb806f0e0 0x7f6fb815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.550+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 >> 172.21.15.44:0/3552649054 conn(0x7f6fb806ce40 msgr2=0x7f6fb8160330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:51.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.554+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 shutdown_connections 2024-09-17T05:36:51.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.554+0000 7f6fbee00640 1 -- 172.21.15.44:0/3552649054 wait complete. 2024-09-17T05:36:51.573 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-17T05:36:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 -- 172.21.15.44:0/3715478562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 msgr2=0x7fbe8006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 --2- 172.21.15.44:0/3715478562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe8006e260 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009840 tx=0x7fbe6801c790 comp rx=0 tx=0).stop 2024-09-17T05:36:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 -- 172.21.15.44:0/3715478562 shutdown_connections 2024-09-17T05:36:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 --2- 172.21.15.44:0/3715478562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe800cb470 0x7fbe800cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 --2- 172.21.15.44:0/3715478562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe8006e260 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 -- 172.21.15.44:0/3715478562 >> 172.21.15.44:0/3715478562 conn(0x7fbe800ccaa0 msgr2=0x7fbe800cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 -- 172.21.15.44:0/3715478562 shutdown_connections 2024-09-17T05:36:51.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.734+0000 7fbe85c00640 1 -- 172.21.15.44:0/3715478562 wait complete. 2024-09-17T05:36:51.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 Processor -- start 2024-09-17T05:36:51.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 -- start start 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe800c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe80072e50 0x7fbe801f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe800cb470 0x7fbe800cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80168f70 con 0x7fbe8006de50 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe80168df0 con 0x7fbe800cb470 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbe801690f0 con 0x7fbe80072e50 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe800c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe800c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43926/0 (socket says 172.21.15.44:43926) 2024-09-17T05:36:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 -- 172.21.15.44:0/843307205 learned_addr learned my addr 172.21.15.44:0/843307205 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:51.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 -- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe80072e50 msgr2=0x7fbe801f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe80072e50 0x7fbe801f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 -- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe800cb470 msgr2=0x7fbe800cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe800cb470 0x7fbe800cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 -- 172.21.15.44:0/843307205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe801f8010 con 0x7fbe8006de50 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe7ea00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe800c6630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000c730 tx=0x7fbe7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe76a00640 1 -- 172.21.15.44:0/843307205 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70016020 con 0x7fbe8006de50 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe76a00640 1 -- 172.21.15.44:0/843307205 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe7000a950 con 0x7fbe8006de50 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe800c6b70 con 0x7fbe8006de50 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe76a00640 1 -- 172.21.15.44:0/843307205 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000ada0 con 0x7fbe8006de50 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.738+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe800c3bf0 con 0x7fbe8006de50 2024-09-17T05:36:51.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.742+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8006e260 con 0x7fbe8006de50 2024-09-17T05:36:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.742+0000 7fbe76a00640 1 -- 172.21.15.44:0/843307205 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbe70019020 con 0x7fbe8006de50 2024-09-17T05:36:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.742+0000 7fbe76a00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbe5c073200 0x7fbe5c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.742+0000 7fbe76a00640 1 -- 172.21.15.44:0/843307205 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbe700944d0 con 0x7fbe8006de50 2024-09-17T05:36:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.742+0000 7fbe77e00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbe5c073200 0x7fbe5c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.742+0000 7fbe77e00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbe5c073200 0x7fbe5c075710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe680af000 tx=0x7fbe68019530 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.746+0000 7fbe76a00640 1 -- 172.21.15.44:0/843307205 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbe70020020 con 0x7fbe8006de50 2024-09-17T05:36:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbe800b5fa0 con 0x7fbe8006de50 2024-09-17T05:36:51.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe76a00640 1 -- 172.21.15.44:0/843307205 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fbe8006e7a0 con 0x7fbe8006de50 2024-09-17T05:36:51.927 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbe5c073200 msgr2=0x7fbe5c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbe5c073200 0x7fbe5c075710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbe680af000 tx=0x7fbe68019530 comp rx=0 tx=0).stop 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 msgr2=0x7fbe800c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe800c6630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000c730 tx=0x7fbe7000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 shutdown_connections 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbe5c073200 0x7fbe5c075710 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe800cb470 0x7fbe800cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbe80072e50 0x7fbe801f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 --2- 172.21.15.44:0/843307205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe8006de50 0x7fbe800c6630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 >> 172.21.15.44:0/843307205 conn(0x7fbe800ccaa0 msgr2=0x7fbe800aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 shutdown_connections 2024-09-17T05:36:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:51.926+0000 7fbe85c00640 1 -- 172.21.15.44:0/843307205 wait complete. 2024-09-17T05:36:51.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-09-17T05:36:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 -- 172.21.15.44:0/1643830089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c06de50 msgr2=0x7ff83c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 --2- 172.21.15.44:0/1643830089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c06de50 0x7ff83c06e260 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff824009840 tx=0x7ff82401c790 comp rx=0 tx=0).stop 2024-09-17T05:36:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 -- 172.21.15.44:0/1643830089 shutdown_connections 2024-09-17T05:36:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 --2- 172.21.15.44:0/1643830089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c06de50 0x7ff83c06e260 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 -- 172.21.15.44:0/1643830089 >> 172.21.15.44:0/1643830089 conn(0x7ff83c0ccaa0 msgr2=0x7ff83c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 -- 172.21.15.44:0/1643830089 shutdown_connections 2024-09-17T05:36:52.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 -- 172.21.15.44:0/1643830089 wait complete. 2024-09-17T05:36:52.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 Processor -- start 2024-09-17T05:36:52.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.106+0000 7ff841200640 1 -- start start 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff83c06de50 0x7ff83c14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c072e50 0x7ff83c148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff83c0cb470 0x7ff83c148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c169fc0 con 0x7ff83c072e50 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff83c169e40 con 0x7ff83c06de50 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff83c16a140 con 0x7ff83c0cb470 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c072e50 0x7ff83c148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c072e50 0x7ff83c148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43950/0 (socket says 172.21.15.44:43950) 2024-09-17T05:36:52.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 -- 172.21.15.44:0/3695983867 learned_addr learned my addr 172.21.15.44:0/3695983867 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff83a800640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff83c0cb470 0x7ff83c148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff839e00640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff83c06de50 0x7ff83c14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 -- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff83c0cb470 msgr2=0x7ff83c148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff83c0cb470 0x7ff83c148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 -- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff83c06de50 msgr2=0x7ff83c14c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff83c06de50 0x7ff83c14c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 -- 172.21.15.44:0/3695983867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff83c09d8f0 con 0x7ff83c072e50 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff831400640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c072e50 0x7ff83c148780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff824009790 tx=0x7ff8240a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff832a00640 1 -- 172.21.15.44:0/3695983867 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8240bb070 con 0x7ff83c072e50 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff832a00640 1 -- 172.21.15.44:0/3695983867 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff824004430 con 0x7ff83c072e50 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff832a00640 1 -- 172.21.15.44:0/3695983867 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8240b2040 con 0x7ff83c072e50 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff83c09cd70 con 0x7ff83c072e50 2024-09-17T05:36:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff83c09d330 con 0x7ff83c072e50 2024-09-17T05:36:52.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.110+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff83c06e260 con 0x7ff83c072e50 2024-09-17T05:36:52.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.114+0000 7ff832a00640 1 -- 172.21.15.44:0/3695983867 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff824005290 con 0x7ff83c072e50 2024-09-17T05:36:52.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.114+0000 7ff832a00640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff818073200 0x7ff818075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.114+0000 7ff832a00640 1 -- 172.21.15.44:0/3695983867 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff82412dea0 con 0x7ff83c072e50 2024-09-17T05:36:52.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.114+0000 7ff839e00640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff818073200 0x7ff818075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.114+0000 7ff839e00640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff818073200 0x7ff818075710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00b810 tx=0x7ff82c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.118+0000 7ff832a00640 1 -- 172.21.15.44:0/3695983867 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff8240f1db0 con 0x7ff83c072e50 2024-09-17T05:36:52.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.350+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7ff83c0b5fa0 con 0x7ff83c072e50 2024-09-17T05:36:52.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.478+0000 7ff832a00640 1 -- 172.21.15.44:0/3695983867 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v57) ==== 145+0+0 (secure 0 0 0) 0x7ff824016410 con 0x7ff83c072e50 2024-09-17T05:36:52.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff818073200 msgr2=0x7ff818075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff818073200 0x7ff818075710 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00b810 tx=0x7ff82c008040 comp rx=0 tx=0).stop 2024-09-17T05:36:52.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c072e50 msgr2=0x7ff83c148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c072e50 0x7ff83c148780 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff824009790 tx=0x7ff8240a5670 comp rx=0 tx=0).stop 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 shutdown_connections 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff83c0cb470 0x7ff83c148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff83c072e50 0x7ff83c148780 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff818073200 0x7ff818075710 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 --2- 172.21.15.44:0/3695983867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff83c06de50 0x7ff83c14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 >> 172.21.15.44:0/3695983867 conn(0x7ff83c0ccaa0 msgr2=0x7ff83c0b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 shutdown_connections 2024-09-17T05:36:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.482+0000 7ff841200640 1 -- 172.21.15.44:0/3695983867 wait complete. 2024-09-17T05:36:52.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:36:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.658+0000 7f15dac00640 1 -- 172.21.15.44:0/1613128187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cdd60 msgr2=0x7f15d415e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.658+0000 7f15dac00640 1 --2- 172.21.15.44:0/1613128187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cdd60 0x7f15d415e7d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009840 tx=0x7f15c401c790 comp rx=0 tx=0).stop 2024-09-17T05:36:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.658+0000 7f15dac00640 1 -- 172.21.15.44:0/1613128187 shutdown_connections 2024-09-17T05:36:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.658+0000 7f15dac00640 1 --2- 172.21.15.44:0/1613128187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cdd60 0x7f15d415e7d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.658+0000 7f15dac00640 1 -- 172.21.15.44:0/1613128187 >> 172.21.15.44:0/1613128187 conn(0x7f15d40b4240 msgr2=0x7f15d40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.658+0000 7f15dac00640 1 -- 172.21.15.44:0/1613128187 shutdown_connections 2024-09-17T05:36:52.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.658+0000 7f15dac00640 1 -- 172.21.15.44:0/1613128187 wait complete. 2024-09-17T05:36:52.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 Processor -- start 2024-09-17T05:36:52.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 -- start start 2024-09-17T05:36:52.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cc8a0 0x7f15d415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15d40cdd60 0x7f15d41613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d40cefc0 0x7f15d4153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15d416d430 con 0x7f15d40cc8a0 2024-09-17T05:36:52.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f15d416d2b0 con 0x7f15d40cefc0 2024-09-17T05:36:52.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15dac00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f15d416d5b0 con 0x7f15d40cdd60 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15d3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cc8a0 0x7f15d415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15d3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cc8a0 0x7f15d415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43982/0 (socket says 172.21.15.44:43982) 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15d3e00640 1 -- 172.21.15.44:0/2460898105 learned_addr learned my addr 172.21.15.44:0/2460898105 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15cb400640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15d40cdd60 0x7f15d41613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.662+0000 7f15d8c00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d40cefc0 0x7f15d4153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d3e00640 1 -- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15d40cdd60 msgr2=0x7f15d41613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d3e00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15d40cdd60 0x7f15d41613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d3e00640 1 -- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d40cefc0 msgr2=0x7f15d4153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d3e00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d40cefc0 0x7f15d4153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d3e00640 1 -- 172.21.15.44:0/2460898105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41536a0 con 0x7f15d40cc8a0 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d3e00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cc8a0 0x7f15d415b510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009790 tx=0x7f15c4005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d0c00640 1 -- 172.21.15.44:0/2460898105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40b2040 con 0x7f15d40cc8a0 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d0c00640 1 -- 172.21.15.44:0/2460898105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15c40043e0 con 0x7f15d40cc8a0 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d0c00640 1 -- 172.21.15.44:0/2460898105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40052d0 con 0x7f15d40cc8a0 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d4161d40 con 0x7f15d40cc8a0 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d415ad10 con 0x7f15d40cc8a0 2024-09-17T05:36:52.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d40b49d0 con 0x7f15d40cc8a0 2024-09-17T05:36:52.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.666+0000 7f15d0c00640 1 -- 172.21.15.44:0/2460898105 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f15c4005470 con 0x7f15d40cc8a0 2024-09-17T05:36:52.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.670+0000 7f15d0c00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15b0073200 0x7f15b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.670+0000 7f15d0c00640 1 -- 172.21.15.44:0/2460898105 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f15c412de50 con 0x7f15d40cc8a0 2024-09-17T05:36:52.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.670+0000 7f15cb400640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15b0073200 0x7f15b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.670+0000 7f15cb400640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15b0073200 0x7f15b0075710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f15d41f68c0 tx=0x7f15bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.674+0000 7f15d0c00640 1 -- 172.21.15.44:0/2460898105 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f15c4016410 con 0x7f15d40cc8a0 2024-09-17T05:36:52.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.846+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f15d406ade0 con 0x7f15d40cc8a0 2024-09-17T05:36:52.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.846+0000 7f15d0c00640 1 -- 172.21.15.44:0/2460898105 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f15c40f8bc0 con 0x7f15d40cc8a0 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3062.155679 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3184.697297 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3313.522676 2024-09-17T05:36:52.849 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3406.954625 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4320.207875 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.313189 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7119.006184 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4437.685284 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:36:52.850 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:36:52.851 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:36:52.851 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:36:52.851 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:36:52.851 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:36:52.851 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:36:52.851 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15b0073200 msgr2=0x7f15b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15b0073200 0x7f15b0075710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f15d41f68c0 tx=0x7f15bc009040 comp rx=0 tx=0).stop 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cc8a0 msgr2=0x7f15d415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cc8a0 0x7f15d415b510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009790 tx=0x7f15c4005db0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 shutdown_connections 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15b0073200 0x7f15b0075710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d40cefc0 0x7f15d4153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f15d40cdd60 0x7f15d41613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 --2- 172.21.15.44:0/2460898105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15d40cc8a0 0x7f15d415b510 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 >> 172.21.15.44:0/2460898105 conn(0x7f15d40b4240 msgr2=0x7f15d4159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 shutdown_connections 2024-09-17T05:36:52.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:52.850+0000 7f15dac00640 1 -- 172.21.15.44:0/2460898105 wait complete. 2024-09-17T05:36:52.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 -- 172.21.15.44:0/3401292699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 msgr2=0x7fc3dc0b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 --2- 172.21.15.44:0/3401292699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc0b23d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009bc0 tx=0x7fc3d401ca40 comp rx=0 tx=0).stop 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 -- 172.21.15.44:0/3401292699 shutdown_connections 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 --2- 172.21.15.44:0/3401292699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc0b23d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 --2- 172.21.15.44:0/3401292699 >> v2:172.21.15.86:3300/0 conn(0x7fc3dc0c7370 0x7fc3dc0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 -- 172.21.15.44:0/3401292699 >> 172.21.15.44:0/3401292699 conn(0x7fc3dc0ceaa0 msgr2=0x7fc3dc0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 -- 172.21.15.44:0/3401292699 shutdown_connections 2024-09-17T05:36:53.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.030+0000 7fc3e2800640 1 -- 172.21.15.44:0/3401292699 wait complete. 2024-09-17T05:36:53.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 Processor -- start 2024-09-17T05:36:53.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 -- start start 2024-09-17T05:36:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3dc0c7370 0x7fc3dc13d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3dc160060 0x7fc3dc141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc169e90 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc169d10 con 0x7fc3dc0c7370 2024-09-17T05:36:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc3dc16a010 con 0x7fc3dc160060 2024-09-17T05:36:53.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44000/0 (socket says 172.21.15.44:44000) 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 -- 172.21.15.44:0/850082756 learned_addr learned my addr 172.21.15.44:0/850082756 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e0a00640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3dc0c7370 0x7fc3dc13d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1e00640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3dc160060 0x7fc3dc141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 -- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3dc160060 msgr2=0x7fc3dc141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3dc160060 0x7fc3dc141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 -- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3dc0c7370 msgr2=0x7fc3dc13d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3dc0c7370 0x7fc3dc13d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 -- 172.21.15.44:0/850082756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc1f98a0 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e1400640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc141730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00058d0 tx=0x7fc3d000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3d9600640 1 -- 172.21.15.44:0/850082756 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0017070 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3d9600640 1 -- 172.21.15.44:0/850082756 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3d0009d20 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc144100 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3d9600640 1 -- 172.21.15.44:0/850082756 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00106c0 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.034+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc1446c0 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.038+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3dc0b23d0 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.038+0000 7fc3d9600640 1 -- 172.21.15.44:0/850082756 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc3d001a070 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.038+0000 7fc3d9600640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc3bc073230 0x7fc3bc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.038+0000 7fc3d9600640 1 -- 172.21.15.44:0/850082756 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc3d00947b0 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.038+0000 7fc3e0a00640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc3bc073230 0x7fc3bc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.038+0000 7fc3e0a00640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc3bc073230 0x7fc3bc075740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0700b0 tx=0x7fc3c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.042+0000 7fc3d9600640 1 -- 172.21.15.44:0/850082756 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc3d005f3f0 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.218+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc3dc0cf860 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.222+0000 7fc3d9600640 1 -- 172.21.15.44:0/850082756 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fc3d005ecf0 con 0x7fc3dc0b1fc0 2024-09-17T05:36:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc3bc073230 msgr2=0x7fc3bc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc3bc073230 0x7fc3bc075740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0700b0 tx=0x7fc3c8009040 comp rx=0 tx=0).stop 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 msgr2=0x7fc3dc141730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc141730 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00058d0 tx=0x7fc3d000dde0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 shutdown_connections 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3dc160060 0x7fc3dc141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc3bc073230 0x7fc3bc075740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3dc0c7370 0x7fc3dc13d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 --2- 172.21.15.44:0/850082756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3dc0b1fc0 0x7fc3dc141730 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 >> 172.21.15.44:0/850082756 conn(0x7fc3dc0ceaa0 msgr2=0x7fc3dc160470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 shutdown_connections 2024-09-17T05:36:53.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.226+0000 7fc3e2800640 1 -- 172.21.15.44:0/850082756 wait complete. 2024-09-17T05:36:53.246 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:36:53.246 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:53.332 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:53.419 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:36:53.419 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:53.420 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:53.428 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:53.428 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:53.477 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:53.477 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:53.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 -- 172.21.15.44:0/534521956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 msgr2=0x7f5a7c071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 --2- 172.21.15.44:0/534521956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c071c60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009900 tx=0x7f5a6c01c670 comp rx=0 tx=0).stop 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 -- 172.21.15.44:0/534521956 shutdown_connections 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 --2- 172.21.15.44:0/534521956 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a7c0ccb60 0x7f5a7c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 --2- 172.21.15.44:0/534521956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c071c60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 -- 172.21.15.44:0/534521956 >> 172.21.15.44:0/534521956 conn(0x7f5a7c0cd930 msgr2=0x7f5a7c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 -- 172.21.15.44:0/534521956 shutdown_connections 2024-09-17T05:36:53.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 -- 172.21.15.44:0/534521956 wait complete. 2024-09-17T05:36:53.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.730+0000 7f5a80c00640 1 Processor -- start 2024-09-17T05:36:53.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 -- start start 2024-09-17T05:36:53.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a7c06e490 0x7f5a7c1fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a7c0ccb60 0x7f5a7c1f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c15c3a0 con 0x7f5a7c070e00 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c15c220 con 0x7f5a7c0ccb60 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c15c520 con 0x7f5a7c06e490 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c14d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44012/0 (socket says 172.21.15.44:44012) 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 -- 172.21.15.44:0/3798328623 learned_addr learned my addr 172.21.15.44:0/3798328623 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a79e00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a7c06e490 0x7f5a7c1fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a7a800640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a7c0ccb60 0x7f5a7c1f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 -- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a7c06e490 msgr2=0x7f5a7c1fcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a7c06e490 0x7f5a7c1fcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 -- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a7c0ccb60 msgr2=0x7f5a7c1f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a7c0ccb60 0x7f5a7c1f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 -- 172.21.15.44:0/3798328623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c14ea30 con 0x7f5a7c070e00 2024-09-17T05:36:53.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a73e00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c14d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400ca20 tx=0x7f5a6400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:53.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a72000640 1 -- 172.21.15.44:0/3798328623 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64007c70 con 0x7f5a7c070e00 2024-09-17T05:36:53.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a72000640 1 -- 172.21.15.44:0/3798328623 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a6400f450 con 0x7f5a7c070e00 2024-09-17T05:36:53.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a72000640 1 -- 172.21.15.44:0/3798328623 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400f8a0 con 0x7f5a7c070e00 2024-09-17T05:36:53.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c14ecd0 con 0x7f5a7c070e00 2024-09-17T05:36:53.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c1f8e10 con 0x7f5a7c070e00 2024-09-17T05:36:53.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.734+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c15b040 con 0x7f5a7c070e00 2024-09-17T05:36:53.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.738+0000 7f5a72000640 1 -- 172.21.15.44:0/3798328623 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5a6400fa40 con 0x7f5a7c070e00 2024-09-17T05:36:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.738+0000 7f5a72000640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a58073200 0x7f5a58075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.738+0000 7f5a72000640 1 -- 172.21.15.44:0/3798328623 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5a64094de0 con 0x7f5a7c070e00 2024-09-17T05:36:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.738+0000 7f5a79e00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a58073200 0x7f5a58075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.738+0000 7f5a79e00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a58073200 0x7f5a58075710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0ae000 tx=0x7f5a6c01aeb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.742+0000 7f5a72000640 1 -- 172.21.15.44:0/3798328623 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f5a64014030 con 0x7f5a7c070e00 2024-09-17T05:36:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.926+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5a7c071c60 con 0x7f5a7c070e00 2024-09-17T05:36:53.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a72000640 1 -- 172.21.15.44:0/3798328623 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f5a6405f9a0 con 0x7f5a7c070e00 2024-09-17T05:36:53.930 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a58073200 msgr2=0x7f5a58075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a58073200 0x7f5a58075710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0ae000 tx=0x7f5a6c01aeb0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 msgr2=0x7f5a7c14d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c14d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400ca20 tx=0x7f5a6400cee0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 shutdown_connections 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a58073200 0x7f5a58075710 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a7c0ccb60 0x7f5a7c1f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a7c070e00 0x7f5a7c14d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 --2- 172.21.15.44:0/3798328623 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a7c06e490 0x7f5a7c1fcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 >> 172.21.15.44:0/3798328623 conn(0x7f5a7c0cd930 msgr2=0x7f5a7c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:53.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 shutdown_connections 2024-09-17T05:36:53.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:53.930+0000 7f5a80c00640 1 -- 172.21.15.44:0/3798328623 wait complete. 2024-09-17T05:36:53.952 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:36:53.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:53.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T05:36:53.997 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:36:53.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:53.997 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:36:54.049 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:54.050 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:54.059 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:54.059 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:54.110 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:54.111 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:54.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:54.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.318+0000 7f05da400640 1 -- 172.21.15.44:0/1448972084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 msgr2=0x7f05d40c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.318+0000 7f05da400640 1 --2- 172.21.15.44:0/1448972084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d40c9ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f05d406cfc0 tx=0x7f05bc01c820 comp rx=0 tx=0).stop 2024-09-17T05:36:54.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.318+0000 7f05da400640 1 -- 172.21.15.44:0/1448972084 shutdown_connections 2024-09-17T05:36:54.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.318+0000 7f05da400640 1 --2- 172.21.15.44:0/1448972084 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d40c9ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.318+0000 7f05da400640 1 -- 172.21.15.44:0/1448972084 >> 172.21.15.44:0/1448972084 conn(0x7f05d40cd930 msgr2=0x7f05d40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.318+0000 7f05da400640 1 -- 172.21.15.44:0/1448972084 shutdown_connections 2024-09-17T05:36:54.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.318+0000 7f05da400640 1 -- 172.21.15.44:0/1448972084 wait complete. 2024-09-17T05:36:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 Processor -- start 2024-09-17T05:36:54.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 -- start start 2024-09-17T05:36:54.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d406d5b0 0x7f05d40b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05d40d00b0 0x7f05d415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f05d416d140 con 0x7f05d40c9be0 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05d416cfc0 con 0x7f05d406d5b0 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05da400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f05d416d2c0 con 0x7f05d40d00b0 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d415cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44042/0 (socket says 172.21.15.44:44042) 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05caa00640 1 -- 172.21.15.44:0/3873962244 learned_addr learned my addr 172.21.15.44:0/3873962244 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.322+0000 7f05d3400640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d406d5b0 0x7f05d40b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05d3e00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05d40d00b0 0x7f05d415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05caa00640 1 -- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05d40d00b0 msgr2=0x7f05d415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05caa00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05d40d00b0 0x7f05d415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05caa00640 1 -- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d406d5b0 msgr2=0x7f05d40b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05caa00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d406d5b0 0x7f05d40b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05caa00640 1 -- 172.21.15.44:0/3873962244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4074550 con 0x7f05d40c9be0 2024-09-17T05:36:54.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05d3e00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05d40d00b0 0x7f05d415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:54.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05caa00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d415cd30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f05bc000c10 tx=0x7f05bc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:54.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05cbe00640 1 -- 172.21.15.44:0/3873962244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0bb070 con 0x7f05d40c9be0 2024-09-17T05:36:54.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05cbe00640 1 -- 172.21.15.44:0/3873962244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05bc005030 con 0x7f05d40c9be0 2024-09-17T05:36:54.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05cbe00640 1 -- 172.21.15.44:0/3873962244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0b2040 con 0x7f05d40c9be0 2024-09-17T05:36:54.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05da400640 1 -- 172.21.15.44:0/3873962244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d41f9210 con 0x7f05d40c9be0 2024-09-17T05:36:54.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05da400640 1 -- 172.21.15.44:0/3873962244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d41f97d0 con 0x7f05d40c9be0 2024-09-17T05:36:54.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.326+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d40c9ff0 con 0x7f05d40c9be0 2024-09-17T05:36:54.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.330+0000 7f05cbe00640 1 -- 172.21.15.44:0/3873962244 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f05bc0053e0 con 0x7f05d40c9be0 2024-09-17T05:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.330+0000 7f05cbe00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f05b0073200 0x7f05b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.330+0000 7f05cbe00640 1 -- 172.21.15.44:0/3873962244 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f05bc12e420 con 0x7f05d40c9be0 2024-09-17T05:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.330+0000 7f05d3400640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f05b0073200 0x7f05b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.330+0000 7f05d3400640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f05b0073200 0x7f05b0075710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05c40046c0 tx=0x7f05c4007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:54.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.334+0000 7f05cbe00640 1 -- 172.21.15.44:0/3873962244 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f05bc0c5020 con 0x7f05d40c9be0 2024-09-17T05:36:54.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.518+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05d406de90 con 0x7f05d40c9be0 2024-09-17T05:36:54.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.518+0000 7f05cbe00640 1 -- 172.21.15.44:0/3873962244 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f05bc016410 con 0x7f05d40c9be0 2024-09-17T05:36:54.521 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f05b0073200 msgr2=0x7f05b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f05b0073200 0x7f05b0075710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05c40046c0 tx=0x7f05c4007ea0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 msgr2=0x7f05d415cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d415cd30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f05bc000c10 tx=0x7f05bc004040 comp rx=0 tx=0).stop 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 shutdown_connections 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05d40d00b0 0x7f05d415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f05d40c9be0 0x7f05d415cd30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f05b0073200 0x7f05b0075710 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 --2- 172.21.15.44:0/3873962244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d406d5b0 0x7f05d40b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 >> 172.21.15.44:0/3873962244 conn(0x7f05d40cd930 msgr2=0x7f05d4073e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 shutdown_connections 2024-09-17T05:36:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.522+0000 7f05c8c00640 1 -- 172.21.15.44:0/3873962244 wait complete. 2024-09-17T05:36:54.543 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:36:54.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:54.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T05:36:54.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:36:54.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:54.582 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:36:54.647 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:54.647 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:54.656 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:54.656 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:54.705 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:36:54.705 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:54.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:54.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.958+0000 7f8054400640 1 -- 172.21.15.44:0/2527487259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 msgr2=0x7f8034004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.958+0000 7f8054400640 1 --2- 172.21.15.44:0/2527487259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f8034004c20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8038009b40 tx=0x7f803801d250 comp rx=0 tx=0).stop 2024-09-17T05:36:54.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.958+0000 7f8054400640 1 -- 172.21.15.44:0/2527487259 shutdown_connections 2024-09-17T05:36:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.958+0000 7f8054400640 1 --2- 172.21.15.44:0/2527487259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f8034004c20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.958+0000 7f8054400640 1 -- 172.21.15.44:0/2527487259 >> 172.21.15.44:0/2527487259 conn(0x7f804c0d1120 msgr2=0x7f804c0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.958+0000 7f8054400640 1 -- 172.21.15.44:0/2527487259 shutdown_connections 2024-09-17T05:36:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.958+0000 7f8054400640 1 -- 172.21.15.44:0/2527487259 wait complete. 2024-09-17T05:36:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 Processor -- start 2024-09-17T05:36:54.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 -- start start 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f804c0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f804c0b6c40 0x7f804c1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f804c15d870 0x7f804c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f804c15f8e0 con 0x7f8034004810 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f804c15f760 con 0x7f804c15d870 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8054400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f804c15fa60 con 0x7f804c0b6c40 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f804c0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f804c0b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44064/0 (socket says 172.21.15.44:44064) 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 -- 172.21.15.44:0/2987792164 learned_addr learned my addr 172.21.15.44:0/2987792164 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8052400640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f804c15d870 0x7f804c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051000640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f804c0b6c40 0x7f804c1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 -- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f804c0b6c40 msgr2=0x7f804c1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f804c0b6c40 0x7f804c1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 -- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f804c15d870 msgr2=0x7f804c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f804c15d870 0x7f804c15dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051a00640 1 -- 172.21.15.44:0/2987792164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804c15e1c0 con 0x7f8034004810 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.962+0000 7f8051000640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f804c0b6c40 0x7f804c1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8051a00640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f804c0b50f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8040004da0 tx=0x7f8040001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8049600640 1 -- 172.21.15.44:0/2987792164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040001d50 con 0x7f8034004810 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8049600640 1 -- 172.21.15.44:0/2987792164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8040016070 con 0x7f8034004810 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804c0b57b0 con 0x7f8034004810 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8049600640 1 -- 172.21.15.44:0/2987792164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040010b20 con 0x7f8034004810 2024-09-17T05:36:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f804c15b640 con 0x7f8034004810 2024-09-17T05:36:54.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f804c0b5980 con 0x7f8034004810 2024-09-17T05:36:54.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8049600640 1 -- 172.21.15.44:0/2987792164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8040010cc0 con 0x7f8034004810 2024-09-17T05:36:54.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8049600640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f802c073200 0x7f802c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.966+0000 7f8049600640 1 -- 172.21.15.44:0/2987792164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8040095750 con 0x7f8034004810 2024-09-17T05:36:54.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.970+0000 7f8051000640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f802c073200 0x7f802c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.970+0000 7f8051000640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f802c073200 0x7f802c075710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80380ad000 tx=0x7f8038019ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:54.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:54.970+0000 7f8049600640 1 -- 172.21.15.44:0/2987792164 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f804c15e1c0 con 0x7f8034004810 2024-09-17T05:36:55.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.154+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f804c15ff30 con 0x7f8034004810 2024-09-17T05:36:55.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.154+0000 7f8049600640 1 -- 172.21.15.44:0/2987792164 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f8040060510 con 0x7f8034004810 2024-09-17T05:36:55.157 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:36:55.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f802c073200 msgr2=0x7f802c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f802c073200 0x7f802c075710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f80380ad000 tx=0x7f8038019ff0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 msgr2=0x7f804c0b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f804c0b50f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8040004da0 tx=0x7f8040001640 comp rx=0 tx=0).stop 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 shutdown_connections 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f802c073200 0x7f802c075710 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f804c15d870 0x7f804c15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f804c0b6c40 0x7f804c1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 --2- 172.21.15.44:0/2987792164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8034004810 0x7f804c0b50f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 >> 172.21.15.44:0/2987792164 conn(0x7f804c0d1120 msgr2=0x7f804c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 shutdown_connections 2024-09-17T05:36:55.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.158+0000 7f8054400640 1 -- 172.21.15.44:0/2987792164 wait complete. 2024-09-17T05:36:55.180 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T05:36:55.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:55.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T05:36:55.203 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:36:55.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:55.203 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T05:36:55.257 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:55.258 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:55.267 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:55.267 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:55.316 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:36:55.316 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:55.368 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:55.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 -- 172.21.15.44:0/2113840792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0d18f0 msgr2=0x7f96dc0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 --2- 172.21.15.44:0/2113840792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0d18f0 0x7f96dc0b1be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009840 tx=0x7f96cc01c760 comp rx=0 tx=0).stop 2024-09-17T05:36:55.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 -- 172.21.15.44:0/2113840792 shutdown_connections 2024-09-17T05:36:55.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 --2- 172.21.15.44:0/2113840792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96dc0d1d00 0x7f96dc0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 --2- 172.21.15.44:0/2113840792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0d18f0 0x7f96dc0b1be0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 -- 172.21.15.44:0/2113840792 >> 172.21.15.44:0/2113840792 conn(0x7f96dc0b4240 msgr2=0x7f96dc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 -- 172.21.15.44:0/2113840792 shutdown_connections 2024-09-17T05:36:55.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.526+0000 7f96e0c00640 1 -- 172.21.15.44:0/2113840792 wait complete. 2024-09-17T05:36:55.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 Processor -- start 2024-09-17T05:36:55.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 -- start start 2024-09-17T05:36:55.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96dc0cf5b0 0x7f96dc14e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0d18f0 0x7f96dc1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96dc0d1d00 0x7f96dc15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc169e80 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc169d00 con 0x7f96dc0d18f0 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc16a000 con 0x7f96dc0d1d00 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96dc0cf5b0 0x7f96dc14e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96dc0cf5b0 0x7f96dc14e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44070/0 (socket says 172.21.15.44:44070) 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 -- 172.21.15.44:0/3095271798 learned_addr learned my addr 172.21.15.44:0/3095271798 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 -- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96dc0d1d00 msgr2=0x7f96dc15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96dc0d1d00 0x7f96dc15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 -- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0d18f0 msgr2=0x7f96dc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0d18f0 0x7f96dc1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 -- 172.21.15.44:0/3095271798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc1fc380 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d9e00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96dc0cf5b0 0x7f96dc14e6a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96cc01cc40 tx=0x7f96cc005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d2000640 1 -- 172.21.15.44:0/3095271798 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0b2040 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d2000640 1 -- 172.21.15.44:0/3095271798 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96cc004040 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc1fc660 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96d2000640 1 -- 172.21.15.44:0/3095271798 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0043f0 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.530+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc1fcc20 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.534+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc1542e0 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.534+0000 7f96d2000640 1 -- 172.21.15.44:0/3095271798 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f96cc0bd030 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.534+0000 7f96d2000640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f96bc073200 0x7f96bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.534+0000 7f96d2000640 1 -- 172.21.15.44:0/3095271798 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f96cc12e170 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.534+0000 7f96d9400640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f96bc073200 0x7f96bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.538+0000 7f96d9400640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f96bc073200 0x7f96bc075710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96c80058d0 tx=0x7f96c8005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.538+0000 7f96d2000640 1 -- 172.21.15.44:0/3095271798 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f96cc0c4020 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.722+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96dc155330 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96d2000640 1 -- 172.21.15.44:0/3095271798 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f96cc016410 con 0x7f96dc0cf5b0 2024-09-17T05:36:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:36:55.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f96bc073200 msgr2=0x7f96bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f96bc073200 0x7f96bc075710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96c80058d0 tx=0x7f96c8005860 comp rx=0 tx=0).stop 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96dc0cf5b0 msgr2=0x7f96dc14e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96dc0cf5b0 0x7f96dc14e6a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f96cc01cc40 tx=0x7f96cc005760 comp rx=0 tx=0).stop 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 shutdown_connections 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f96dc0d1d00 0x7f96dc15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f96bc073200 0x7f96bc075710 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96dc0d18f0 0x7f96dc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 --2- 172.21.15.44:0/3095271798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96dc0cf5b0 0x7f96dc14e6a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 >> 172.21.15.44:0/3095271798 conn(0x7f96dc0b4240 msgr2=0x7f96dc068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 shutdown_connections 2024-09-17T05:36:55.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.726+0000 7f96e0c00640 1 -- 172.21.15.44:0/3095271798 wait complete. 2024-09-17T05:36:55.748 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T05:36:55.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:55.748 DEBUG:teuthology.orchestra.run.smithi086:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T05:36:55.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:36:55.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:55.774 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T05:36:55.825 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:36:55.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 -- 172.21.15.44:0/3805134700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4208070610 msgr2=0x7f4208070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 --2- 172.21.15.44:0/3805134700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4208070610 0x7f4208070a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4200009c80 tx=0x7f420001cda0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 -- 172.21.15.44:0/3805134700 shutdown_connections 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 --2- 172.21.15.44:0/3805134700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4208070610 0x7f4208070a20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 --2- 172.21.15.44:0/3805134700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f420806e560 0x7f42080700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 -- 172.21.15.44:0/3805134700 >> 172.21.15.44:0/3805134700 conn(0x7f42080ccaa0 msgr2=0x7f42080cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 -- 172.21.15.44:0/3805134700 shutdown_connections 2024-09-17T05:36:55.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.982+0000 7f420f400640 1 -- 172.21.15.44:0/3805134700 wait complete. 2024-09-17T05:36:55.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 Processor -- start 2024-09-17T05:36:55.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 -- start start 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4208070610 0x7f42080c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42080b5880 0x7f420809f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42081fc4d0 0x7f42081fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4208169f40 con 0x7f42081fc4d0 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4208169dc0 con 0x7f4208070610 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f420816a0c0 con 0x7f42080b5880 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42081fc4d0 0x7f42081fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42081fc4d0 0x7f42081fc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44092/0 (socket says 172.21.15.44:44092) 2024-09-17T05:36:55.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 -- 172.21.15.44:0/4175048642 learned_addr learned my addr 172.21.15.44:0/4175048642 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420ca00640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4208070610 0x7f42080c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f4207e00640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42080b5880 0x7f420809f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 -- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42080b5880 msgr2=0x7f420809f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42080b5880 0x7f420809f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 -- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4208070610 msgr2=0x7f42080c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4208070610 0x7f42080c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 -- 172.21.15.44:0/4175048642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42081fce20 con 0x7f42081fc4d0 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420d400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42081fc4d0 0x7f42081fc8e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f420001b450 tx=0x7f4200009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f4204c00640 1 -- 172.21.15.44:0/4175048642 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42000bb070 con 0x7f42081fc4d0 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f4204c00640 1 -- 172.21.15.44:0/4175048642 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4200004c50 con 0x7f42081fc4d0 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42080a00c0 con 0x7f42081fc4d0 2024-09-17T05:36:55.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.986+0000 7f4204c00640 1 -- 172.21.15.44:0/4175048642 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42000b2040 con 0x7f42081fc4d0 2024-09-17T05:36:55.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.990+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42080a0680 con 0x7f42081fc4d0 2024-09-17T05:36:55.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.990+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f420809fe30 con 0x7f42081fc4d0 2024-09-17T05:36:55.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.990+0000 7f4204c00640 1 -- 172.21.15.44:0/4175048642 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f42000be070 con 0x7f42081fc4d0 2024-09-17T05:36:55.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.990+0000 7f4204c00640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f41e8073230 0x7f41e8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.990+0000 7f4204c00640 1 -- 172.21.15.44:0/4175048642 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f420012e0f0 con 0x7f42081fc4d0 2024-09-17T05:36:55.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.994+0000 7f420ca00640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f41e8073230 0x7f41e8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.994+0000 7f420ca00640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f41e8073230 0x7f41e8075740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f41fc001650 tx=0x7f41fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:55.998+0000 7f4204c00640 1 -- 172.21.15.44:0/4175048642 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4200016990 con 0x7f42081fc4d0 2024-09-17T05:36:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.206+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42080700d0 con 0x7f42081fc4d0 2024-09-17T05:36:56.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.206+0000 7f4204c00640 1 -- 172.21.15.44:0/4175048642 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f42000f8dc0 con 0x7f42081fc4d0 2024-09-17T05:36:56.209 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:56.209 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:56.209 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f41e8073230 msgr2=0x7f41e8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f41e8073230 0x7f41e8075740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f41fc001650 tx=0x7f41fc009040 comp rx=0 tx=0).stop 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42081fc4d0 msgr2=0x7f42081fc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42081fc4d0 0x7f42081fc8e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f420001b450 tx=0x7f4200009350 comp rx=0 tx=0).stop 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 shutdown_connections 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42081fc4d0 0x7f42081fc8e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42080b5880 0x7f420809f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f41e8073230 0x7f41e8075740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 --2- 172.21.15.44:0/4175048642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4208070610 0x7f42080c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 >> 172.21.15.44:0/4175048642 conn(0x7f42080ccaa0 msgr2=0x7f420815f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 shutdown_connections 2024-09-17T05:36:56.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.210+0000 7f420f400640 1 -- 172.21.15.44:0/4175048642 wait complete. 2024-09-17T05:36:56.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:56.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 -- 172.21.15.44:0/98656577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8094072e50 msgr2=0x7f809415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 --2- 172.21.15.44:0/98656577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8094072e50 0x7f809415e990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f80940cb0b0 tx=0x7f808401c650 comp rx=0 tx=0).stop 2024-09-17T05:36:56.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 -- 172.21.15.44:0/98656577 shutdown_connections 2024-09-17T05:36:56.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 --2- 172.21.15.44:0/98656577 >> v2:172.21.15.86:3300/0 conn(0x7f809406de50 0x7f809406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 --2- 172.21.15.44:0/98656577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8094072e50 0x7f809415e990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 -- 172.21.15.44:0/98656577 >> 172.21.15.44:0/98656577 conn(0x7f80940ccaa0 msgr2=0x7f80940cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 -- 172.21.15.44:0/98656577 shutdown_connections 2024-09-17T05:36:56.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.390+0000 7f809a600640 1 -- 172.21.15.44:0/98656577 wait complete. 2024-09-17T05:36:56.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 Processor -- start 2024-09-17T05:36:56.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 -- start start 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809406de50 0x7f8094156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8094072e50 0x7f8094156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80940ced00 0x7f80940c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8094169410 con 0x7f809406de50 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8094169290 con 0x7f80940ced00 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8094169590 con 0x7f8094072e50 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809406de50 0x7f8094156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809406de50 0x7f8094156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44098/0 (socket says 172.21.15.44:44098) 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 -- 172.21.15.44:0/4069779559 learned_addr learned my addr 172.21.15.44:0/4069779559 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 -- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8094072e50 msgr2=0x7f8094156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8094072e50 0x7f8094156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 -- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80940ced00 msgr2=0x7f80940c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093e00640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80940ced00 0x7f80940c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80940ced00 0x7f80940c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 -- 172.21.15.44:0/4069779559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80940c9cc0 con 0x7f809406de50 2024-09-17T05:36:56.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093e00640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80940ced00 0x7f80940c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f8093400640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809406de50 0x7f8094156730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f808401cb30 tx=0x7f80840a86c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f808b400640 1 -- 172.21.15.44:0/4069779559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084004340 con 0x7f809406de50 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f808b400640 1 -- 172.21.15.44:0/4069779559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8084005030 con 0x7f809406de50 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809415d970 con 0x7f809406de50 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f808b400640 1 -- 172.21.15.44:0/4069779559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084005480 con 0x7f809406de50 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.394+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80940c85a0 con 0x7f809406de50 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.398+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80940c7050 con 0x7f809406de50 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.398+0000 7f808b400640 1 -- 172.21.15.44:0/4069779559 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f80840a6040 con 0x7f809406de50 2024-09-17T05:36:56.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.398+0000 7f808b400640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8070073200 0x7f8070075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.398+0000 7f808b400640 1 -- 172.21.15.44:0/4069779559 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f808412e5a0 con 0x7f809406de50 2024-09-17T05:36:56.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.398+0000 7f808be00640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8070073200 0x7f8070075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.402+0000 7f808be00640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8070073200 0x7f8070075710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f80941550c0 tx=0x7f807c005be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.402+0000 7f808b400640 1 -- 172.21.15.44:0/4069779559 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f80840be060 con 0x7f809406de50 2024-09-17T05:36:56.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.614+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80940c8800 con 0x7f809406de50 2024-09-17T05:36:56.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.614+0000 7f808b400640 1 -- 172.21.15.44:0/4069779559 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f80840ac030 con 0x7f809406de50 2024-09-17T05:36:56.617 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:56.617 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:56.617 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:56.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8070073200 msgr2=0x7f8070075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8070073200 0x7f8070075710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f80941550c0 tx=0x7f807c005be0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809406de50 msgr2=0x7f8094156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809406de50 0x7f8094156730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f808401cb30 tx=0x7f80840a86c0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 shutdown_connections 2024-09-17T05:36:56.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8070073200 0x7f8070075710 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80940ced00 0x7f80940c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8094072e50 0x7f8094156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 --2- 172.21.15.44:0/4069779559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f809406de50 0x7f8094156730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 >> 172.21.15.44:0/4069779559 conn(0x7f80940ccaa0 msgr2=0x7f809406fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 shutdown_connections 2024-09-17T05:36:56.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.618+0000 7f809a600640 1 -- 172.21.15.44:0/4069779559 wait complete. 2024-09-17T05:36:56.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:56.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.794+0000 7f2779200640 1 -- 172.21.15.44:0/3016502077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d1d00 msgr2=0x7f27740cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.794+0000 7f2779200640 1 --2- 172.21.15.44:0/3016502077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d1d00 0x7f27740cf070 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f27740d2110 tx=0x7f275c01c800 comp rx=0 tx=0).stop 2024-09-17T05:36:56.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.794+0000 7f2779200640 1 -- 172.21.15.44:0/3016502077 shutdown_connections 2024-09-17T05:36:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.794+0000 7f2779200640 1 --2- 172.21.15.44:0/3016502077 >> v2:172.21.15.86:3300/0 conn(0x7f27740cf5b0 0x7f277415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.794+0000 7f2779200640 1 --2- 172.21.15.44:0/3016502077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d1d00 0x7f27740cf070 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.794+0000 7f2779200640 1 -- 172.21.15.44:0/3016502077 >> 172.21.15.44:0/3016502077 conn(0x7f27740b4240 msgr2=0x7f27740b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.794+0000 7f2779200640 1 -- 172.21.15.44:0/3016502077 shutdown_connections 2024-09-17T05:36:56.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 -- 172.21.15.44:0/3016502077 wait complete. 2024-09-17T05:36:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 Processor -- start 2024-09-17T05:36:56.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 -- start start 2024-09-17T05:36:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27740cf5b0 0x7f27741fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d18f0 0x7f27740b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27740d1d00 0x7f277415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2774169e80 con 0x7f27740d18f0 2024-09-17T05:36:56.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2774169d00 con 0x7f27740d1d00 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2779200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f277416a000 con 0x7f27740cf5b0 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2769400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d18f0 0x7f27740b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2769400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d18f0 0x7f27740b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44114/0 (socket says 172.21.15.44:44114) 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.798+0000 7f2769400640 1 -- 172.21.15.44:0/558216904 learned_addr learned my addr 172.21.15.44:0/558216904 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2771e00640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27740cf5b0 0x7f27741fa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2772800640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27740d1d00 0x7f277415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2769400640 1 -- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27740cf5b0 msgr2=0x7f27741fa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2769400640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27740cf5b0 0x7f27741fa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2769400640 1 -- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27740d1d00 msgr2=0x7f277415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2769400640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27740d1d00 0x7f277415e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2769400640 1 -- 172.21.15.44:0/558216904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27741fae30 con 0x7f27740d18f0 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2769400640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d18f0 0x7f27740b5ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f275c0b0040 tx=0x7f275c0a5820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f276aa00640 1 -- 172.21.15.44:0/558216904 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c0bb070 con 0x7f27740d18f0 2024-09-17T05:36:56.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f276aa00640 1 -- 172.21.15.44:0/558216904 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f275c0044b0 con 0x7f27740d18f0 2024-09-17T05:36:56.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f276aa00640 1 -- 172.21.15.44:0/558216904 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c0b2040 con 0x7f27740d18f0 2024-09-17T05:36:56.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27741f6c90 con 0x7f27740d18f0 2024-09-17T05:36:56.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27741f7250 con 0x7f27740d18f0 2024-09-17T05:36:56.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277415d060 con 0x7f27740d18f0 2024-09-17T05:36:56.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.802+0000 7f276aa00640 1 -- 172.21.15.44:0/558216904 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f275c005290 con 0x7f27740d18f0 2024-09-17T05:36:56.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.806+0000 7f276aa00640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2750073200 0x7f2750075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.806+0000 7f276aa00640 1 -- 172.21.15.44:0/558216904 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f275c12ded0 con 0x7f27740d18f0 2024-09-17T05:36:56.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.806+0000 7f2771e00640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2750073200 0x7f2750075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.806+0000 7f2771e00640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2750073200 0x7f2750075710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2764007fd0 tx=0x7f2764009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.810+0000 7f276aa00640 1 -- 172.21.15.44:0/558216904 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f27741fae30 con 0x7f27740d18f0 2024-09-17T05:36:56.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.986+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2774070c10 con 0x7f27740d18f0 2024-09-17T05:36:56.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f276aa00640 1 -- 172.21.15.44:0/558216904 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18649 (secure 0 0 0) 0x7f275c0164b0 con 0x7f27740d18f0 2024-09-17T05:36:56.990 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:56.991 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:56.493616+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:56.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2750073200 msgr2=0x7f2750075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2750073200 0x7f2750075710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2764007fd0 tx=0x7f2764009040 comp rx=0 tx=0).stop 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d18f0 msgr2=0x7f27740b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d18f0 0x7f27740b5ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f275c0b0040 tx=0x7f275c0a5820 comp rx=0 tx=0).stop 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 shutdown_connections 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2750073200 0x7f2750075710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27740d1d00 0x7f277415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27740d18f0 0x7f27740b5ba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 --2- 172.21.15.44:0/558216904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27740cf5b0 0x7f27741fa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 >> 172.21.15.44:0/558216904 conn(0x7f27740b4240 msgr2=0x7f27740b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 shutdown_connections 2024-09-17T05:36:56.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:56.990+0000 7f2779200640 1 -- 172.21.15.44:0/558216904 wait complete. 2024-09-17T05:36:57.013 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:36:57.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.170+0000 7efd4a000640 1 -- 172.21.15.44:0/1416989196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 msgr2=0x7efd28004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.170+0000 7efd4a000640 1 --2- 172.21.15.44:0/1416989196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd28004090 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efd34001860 tx=0x7efd3401c8a0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.170+0000 7efd4a000640 1 -- 172.21.15.44:0/1416989196 shutdown_connections 2024-09-17T05:36:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.170+0000 7efd4a000640 1 --2- 172.21.15.44:0/1416989196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd28004090 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.170+0000 7efd4a000640 1 -- 172.21.15.44:0/1416989196 >> 172.21.15.44:0/1416989196 conn(0x7efd440ccaa0 msgr2=0x7efd440cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.170+0000 7efd4a000640 1 -- 172.21.15.44:0/1416989196 shutdown_connections 2024-09-17T05:36:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.170+0000 7efd4a000640 1 -- 172.21.15.44:0/1416989196 wait complete. 2024-09-17T05:36:57.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 Processor -- start 2024-09-17T05:36:57.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 -- start start 2024-09-17T05:36:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd44159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd4409ede0 0x7efd441f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd441f6750 0x7efd4409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd4406e1e0 con 0x7efd28003c40 2024-09-17T05:36:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd4406e060 con 0x7efd4409ede0 2024-09-17T05:36:57.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efd4406e360 con 0x7efd441f6750 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd44159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd44159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44120/0 (socket says 172.21.15.44:44120) 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 -- 172.21.15.44:0/981033145 learned_addr learned my addr 172.21.15.44:0/981033145 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd3be00640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd4409ede0 0x7efd441f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43e00640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd441f6750 0x7efd4409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 -- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd441f6750 msgr2=0x7efd4409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd441f6750 0x7efd4409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 -- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd4409ede0 msgr2=0x7efd441f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd4409ede0 0x7efd441f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 -- 172.21.15.44:0/981033145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4415a480 con 0x7efd28003c40 2024-09-17T05:36:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd43400640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd44159f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd34005040 tx=0x7efd34003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd3b400640 1 -- 172.21.15.44:0/981033145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd340068d0 con 0x7efd28003c40 2024-09-17T05:36:57.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd3b400640 1 -- 172.21.15.44:0/981033145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd340b4030 con 0x7efd28003c40 2024-09-17T05:36:57.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4409cff0 con 0x7efd28003c40 2024-09-17T05:36:57.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd3b400640 1 -- 172.21.15.44:0/981033145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34001480 con 0x7efd28003c40 2024-09-17T05:36:57.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.174+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4409e300 con 0x7efd28003c40 2024-09-17T05:36:57.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.178+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd440cdbd0 con 0x7efd28003c40 2024-09-17T05:36:57.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.178+0000 7efd3b400640 1 -- 172.21.15.44:0/981033145 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd34006260 con 0x7efd28003c40 2024-09-17T05:36:57.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.178+0000 7efd3b400640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd20073230 0x7efd20075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.178+0000 7efd3b400640 1 -- 172.21.15.44:0/981033145 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7efd3412e450 con 0x7efd28003c40 2024-09-17T05:36:57.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.178+0000 7efd3be00640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd20073230 0x7efd20075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.178+0000 7efd3be00640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd20073230 0x7efd20075740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd440ca610 tx=0x7efd2c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.182+0000 7efd3b400640 1 -- 172.21.15.44:0/981033145 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efd34016650 con 0x7efd28003c40 2024-09-17T05:36:57.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd440c9ee0 con 0x7efd28003c40 2024-09-17T05:36:57.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd3b400640 1 -- 172.21.15.44:0/981033145 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7efd340f8c40 con 0x7efd28003c40 2024-09-17T05:36:57.398 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:57.398 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:57.398 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:57.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd20073230 msgr2=0x7efd20075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd20073230 0x7efd20075740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efd440ca610 tx=0x7efd2c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 msgr2=0x7efd44159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd44159f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efd34005040 tx=0x7efd34003be0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 shutdown_connections 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd441f6750 0x7efd4409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efd20073230 0x7efd20075740 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd4409ede0 0x7efd441f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 --2- 172.21.15.44:0/981033145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd28003c40 0x7efd44159f40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 >> 172.21.15.44:0/981033145 conn(0x7efd440ccaa0 msgr2=0x7efd440b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 shutdown_connections 2024-09-17T05:36:57.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.398+0000 7efd4a000640 1 -- 172.21.15.44:0/981033145 wait complete. 2024-09-17T05:36:57.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:57.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.582+0000 7fc97c800640 1 -- 172.21.15.44:0/3665287844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c0039f0 msgr2=0x7fc95c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.582+0000 7fc97c800640 1 --2- 172.21.15.44:0/3665287844 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc95c0039f0 0x7fc95c003e20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc968001770 tx=0x7fc96801c880 comp rx=0 tx=0).stop 2024-09-17T05:36:57.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.582+0000 7fc97a800640 1 -- 172.21.15.44:0/3665287844 reap_dead start 2024-09-17T05:36:57.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.582+0000 7fc97c800640 1 -- 172.21.15.44:0/3665287844 shutdown_connections 2024-09-17T05:36:57.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.582+0000 7fc97c800640 1 -- 172.21.15.44:0/3665287844 >> 172.21.15.44:0/3665287844 conn(0x7fc9740ccaa0 msgr2=0x7fc9740cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.582+0000 7fc97c800640 1 -- 172.21.15.44:0/3665287844 shutdown_connections 2024-09-17T05:36:57.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.582+0000 7fc97c800640 1 -- 172.21.15.44:0/3665287844 wait complete. 2024-09-17T05:36:57.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 Processor -- start 2024-09-17T05:36:57.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 -- start start 2024-09-17T05:36:57.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc95c0039f0 0x7fc9740c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9740b5840 0x7fc9740b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9740b4870 0x7fc9740b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc974167630 con 0x7fc9740b4870 2024-09-17T05:36:57.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741674b0 con 0x7fc95c0039f0 2024-09-17T05:36:57.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97c800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc9741677b0 con 0x7fc9740b5840 2024-09-17T05:36:57.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9740b4870 0x7fc9740b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9740b4870 0x7fc9740b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44142/0 (socket says 172.21.15.44:44142) 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 -- 172.21.15.44:0/458430924 learned_addr learned my addr 172.21.15.44:0/458430924 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc979e00640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc95c0039f0 0x7fc9740c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc979400640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9740b5840 0x7fc9740b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 -- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9740b5840 msgr2=0x7fc9740b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9740b5840 0x7fc9740b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 -- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc95c0039f0 msgr2=0x7fc9740c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc95c0039f0 0x7fc9740c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.586+0000 7fc97a800640 1 -- 172.21.15.44:0/458430924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9740b0d70 con 0x7fc9740b4870 2024-09-17T05:36:57.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc97a800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9740b4870 0x7fc9740b4c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9740ca7d0 tx=0x7fc97000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc96e000640 1 -- 172.21.15.44:0/458430924 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970004b30 con 0x7fc9740b4870 2024-09-17T05:36:57.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc96e000640 1 -- 172.21.15.44:0/458430924 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc970004cd0 con 0x7fc9740b4870 2024-09-17T05:36:57.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc96e000640 1 -- 172.21.15.44:0/458430924 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970003be0 con 0x7fc9740b4870 2024-09-17T05:36:57.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9740c7680 con 0x7fc9740b4870 2024-09-17T05:36:57.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9740c9a50 con 0x7fc9740b4870 2024-09-17T05:36:57.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97415e990 con 0x7fc9740b4870 2024-09-17T05:36:57.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.590+0000 7fc96e000640 1 -- 172.21.15.44:0/458430924 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc970004030 con 0x7fc9740b4870 2024-09-17T05:36:57.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.594+0000 7fc96e000640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc958073230 0x7fc958075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.594+0000 7fc96e000640 1 -- 172.21.15.44:0/458430924 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7fc9700949d0 con 0x7fc9740b4870 2024-09-17T05:36:57.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.594+0000 7fc979e00640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc958073230 0x7fc958075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.594+0000 7fc979e00640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc958073230 0x7fc958075740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc968005000 tx=0x7fc968019620 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.598+0000 7fc96e000640 1 -- 172.21.15.44:0/458430924 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc97005ef90 con 0x7fc9740b4870 2024-09-17T05:36:57.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.806+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc974157050 con 0x7fc9740b4870 2024-09-17T05:36:57.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.806+0000 7fc96e000640 1 -- 172.21.15.44:0/458430924 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7fc9700639c0 con 0x7fc9740b4870 2024-09-17T05:36:57.808 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:57.808 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"btime":"2024-09-17T05:36:32:377550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3228431256","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3228431256},{"type":"v1","addr":"172.21.15.44:6834","nonce":3228431256}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4352,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3466175872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3466175872},{"type":"v1","addr":"172.21.15.86:6837","nonce":3466175872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4399,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/985338312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":985338312},{"type":"v1","addr":"172.21.15.44:6835","nonce":985338312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:16.743512+0000","modified":"2024-09-17T05:36:31.794598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4414},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4414":{"gid":4414,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.86:6835/2118333120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2118333120},{"type":"v1","addr":"172.21.15.86:6835","nonce":2118333120}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4414,"qdb_cluster":[4414]},"id":1}]} 2024-09-17T05:36:57.809 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-09-17T05:36:57.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc958073230 msgr2=0x7fc958075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc958073230 0x7fc958075740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc968005000 tx=0x7fc968019620 comp rx=0 tx=0).stop 2024-09-17T05:36:57.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9740b4870 msgr2=0x7fc9740b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9740b4870 0x7fc9740b4c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc9740ca7d0 tx=0x7fc97000f3c0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 shutdown_connections 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9740b4870 0x7fc9740b4c80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9740b5840 0x7fc9740b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc958073230 0x7fc958075740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 --2- 172.21.15.44:0/458430924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc95c0039f0 0x7fc9740c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 >> 172.21.15.44:0/458430924 conn(0x7fc9740ccaa0 msgr2=0x7fc9740cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 shutdown_connections 2024-09-17T05:36:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.810+0000 7fc97c800640 1 -- 172.21.15.44:0/458430924 wait complete. 2024-09-17T05:36:57.832 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 -- 172.21.15.44:0/1123427327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f635806de50 msgr2=0x7f635806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 --2- 172.21.15.44:0/1123427327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f635806de50 0x7f635806e260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f63580ca7b0 tx=0x7f634401c770 comp rx=0 tx=0).stop 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 -- 172.21.15.44:0/1123427327 shutdown_connections 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 --2- 172.21.15.44:0/1123427327 >> v2:172.21.15.86:3300/0 conn(0x7f63580cb470 0x7f63580cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 --2- 172.21.15.44:0/1123427327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f635806de50 0x7f635806e260 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 -- 172.21.15.44:0/1123427327 >> 172.21.15.44:0/1123427327 conn(0x7f63580ccaa0 msgr2=0x7f63580cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 -- 172.21.15.44:0/1123427327 shutdown_connections 2024-09-17T05:36:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 -- 172.21.15.44:0/1123427327 wait complete. 2024-09-17T05:36:57.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 Processor -- start 2024-09-17T05:36:57.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.990+0000 7f635d400640 1 -- start start 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f635806de50 0x7f63580c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6358072e50 0x7f63580aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63580cb470 0x7f63580aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6358168ed0 con 0x7f6358072e50 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6358168d50 con 0x7f63580cb470 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6358169050 con 0x7f635806de50 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6358072e50 0x7f63580aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6358072e50 0x7f63580aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44152/0 (socket says 172.21.15.44:44152) 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 -- 172.21.15.44:0/802285267 learned_addr learned my addr 172.21.15.44:0/802285267 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:57.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6357200640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63580cb470 0x7f63580aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6356800640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f635806de50 0x7f63580c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 -- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f635806de50 msgr2=0x7f63580c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f635806de50 0x7f63580c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 -- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63580cb470 msgr2=0x7f63580aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63580cb470 0x7f63580aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 -- 172.21.15.44:0/802285267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63581f9930 con 0x7f6358072e50 2024-09-17T05:36:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6356800640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f635806de50 0x7f63580c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f6355e00640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6358072e50 0x7f63580aea90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6344009790 tx=0x7f63440a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f634ea00640 1 -- 172.21.15.44:0/802285267 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440bb070 con 0x7f6358072e50 2024-09-17T05:36:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f634ea00640 1 -- 172.21.15.44:0/802285267 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6344004470 con 0x7f6358072e50 2024-09-17T05:36:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6358156ff0 con 0x7f6358072e50 2024-09-17T05:36:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f634ea00640 1 -- 172.21.15.44:0/802285267 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440b2040 con 0x7f6358072e50 2024-09-17T05:36:57.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635809e7f0 con 0x7f6358072e50 2024-09-17T05:36:57.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.994+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635806e260 con 0x7f6358072e50 2024-09-17T05:36:57.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.998+0000 7f634ea00640 1 -- 172.21.15.44:0/802285267 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f63440be070 con 0x7f6358072e50 2024-09-17T05:36:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.998+0000 7f634ea00640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6338073200 0x7f6338075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.998+0000 7f634ea00640 1 -- 172.21.15.44:0/802285267 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f634412df00 con 0x7f6358072e50 2024-09-17T05:36:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.998+0000 7f6356800640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6338073200 0x7f6338075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:57.998+0000 7f6356800640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6338073200 0x7f6338075710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6348000f70 tx=0x7f6348009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.002+0000 7f634ea00640 1 -- 172.21.15.44:0/802285267 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f63440f2db0 con 0x7f6358072e50 2024-09-17T05:36:58.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63580b5fa0 con 0x7f6358072e50 2024-09-17T05:36:58.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f634ea00640 1 -- 172.21.15.44:0/802285267 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18649 (secure 0 0 0) 0x7f63440163f0 con 0x7f6358072e50 2024-09-17T05:36:58.183 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:36:58.183 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":28,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:36:57.500382+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:14.702770+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:15.678933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-17T05:36:19.330357+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":0,"to":7}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6338073200 msgr2=0x7f6338075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6338073200 0x7f6338075710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6348000f70 tx=0x7f6348009040 comp rx=0 tx=0).stop 2024-09-17T05:36:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6358072e50 msgr2=0x7f63580aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6358072e50 0x7f63580aea90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6344009790 tx=0x7f63440a55c0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 shutdown_connections 2024-09-17T05:36:58.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6338073200 0x7f6338075710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63580cb470 0x7f63580aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6358072e50 0x7f63580aea90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 --2- 172.21.15.44:0/802285267 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f635806de50 0x7f63580c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 >> 172.21.15.44:0/802285267 conn(0x7f63580ccaa0 msgr2=0x7f63581578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 shutdown_connections 2024-09-17T05:36:58.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.182+0000 7f635d400640 1 -- 172.21.15.44:0/802285267 wait complete. 2024-09-17T05:36:58.208 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:36:58.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 -- 172.21.15.44:0/3767452103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68200ce300 msgr2=0x7f6820167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 --2- 172.21.15.44:0/3767452103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68200ce300 0x7f6820167120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f682006ace0 tx=0x7f681c01cd80 comp rx=0 tx=0).stop 2024-09-17T05:36:58.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 -- 172.21.15.44:0/3767452103 shutdown_connections 2024-09-17T05:36:58.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 --2- 172.21.15.44:0/3767452103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68200ce300 0x7f6820167120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 --2- 172.21.15.44:0/3767452103 >> v2:172.21.15.86:3300/0 conn(0x7f68200b5880 0x7f682006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 -- 172.21.15.44:0/3767452103 >> 172.21.15.44:0/3767452103 conn(0x7f68200ccaa0 msgr2=0x7f68200cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 -- 172.21.15.44:0/3767452103 shutdown_connections 2024-09-17T05:36:58.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.366+0000 7f6828800640 1 -- 172.21.15.44:0/3767452103 wait complete. 2024-09-17T05:36:58.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 Processor -- start 2024-09-17T05:36:58.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 -- start start 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f682006e390 0x7f68201592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68200b5880 0x7f682009c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68200ce300 0x7f682009c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f682016a000 con 0x7f682006e390 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6820169e80 con 0x7f68200b5880 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6828800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f682016a180 con 0x7f68200ce300 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f682006e390 0x7f68201592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f682006e390 0x7f68201592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44170/0 (socket says 172.21.15.44:44170) 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 -- 172.21.15.44:0/256085749 learned_addr learned my addr 172.21.15.44:0/256085749 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825400640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68200b5880 0x7f682009c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6826800640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68200ce300 0x7f682009c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 -- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68200ce300 msgr2=0x7f682009c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68200ce300 0x7f682009c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 -- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68200b5880 msgr2=0x7f682009c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68200b5880 0x7f682009c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.370+0000 7f6825e00640 1 -- 172.21.15.44:0/256085749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6820159b20 con 0x7f682006e390 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f6825e00640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f682006e390 0x7f68201592f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f681400d750 tx=0x7f681400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f681a000640 1 -- 172.21.15.44:0/256085749 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814017070 con 0x7f682006e390 2024-09-17T05:36:58.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f681a000640 1 -- 172.21.15.44:0/256085749 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6814009d20 con 0x7f682006e390 2024-09-17T05:36:58.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f681a000640 1 -- 172.21.15.44:0/256085749 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814005280 con 0x7f682006e390 2024-09-17T05:36:58.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682009bc80 con 0x7f682006e390 2024-09-17T05:36:58.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682009d4d0 con 0x7f682006e390 2024-09-17T05:36:58.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682009d730 con 0x7f682006e390 2024-09-17T05:36:58.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f681a000640 1 -- 172.21.15.44:0/256085749 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6814005420 con 0x7f682006e390 2024-09-17T05:36:58.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f681a000640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6804073230 0x7f6804075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.374+0000 7f681a000640 1 -- 172.21.15.44:0/256085749 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6590+0+0 (secure 0 0 0) 0x7f6814094600 con 0x7f682006e390 2024-09-17T05:36:58.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.378+0000 7f6825400640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6804073230 0x7f6804075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.378+0000 7f6825400640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6804073230 0x7f6804075740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68200aee30 tx=0x7f6810009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.382+0000 7f681a000640 1 -- 172.21.15.44:0/256085749 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f681400de60 con 0x7f682006e390 2024-09-17T05:36:58.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.590+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f682006de50 con 0x7f682006e390 2024-09-17T05:36:58.592 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:36:58.590+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:36:58.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.594+0000 7f681a000640 1 -- 172.21.15.44:0/256085749 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f681405f3b0 con 0x7f682006e390 2024-09-17T05:36:58.596 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6804073230 msgr2=0x7f6804075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6804073230 0x7f6804075740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68200aee30 tx=0x7f6810009040 comp rx=0 tx=0).stop 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f682006e390 msgr2=0x7f68201592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f682006e390 0x7f68201592f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f681400d750 tx=0x7f681400dc10 comp rx=0 tx=0).stop 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 shutdown_connections 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f68200ce300 0x7f682009c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6804073230 0x7f6804075740 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68200b5880 0x7f682009c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 --2- 172.21.15.44:0/256085749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f682006e390 0x7f68201592f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 >> 172.21.15.44:0/256085749 conn(0x7f68200ccaa0 msgr2=0x7f682015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 shutdown_connections 2024-09-17T05:36:58.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.598+0000 7f6828800640 1 -- 172.21.15.44:0/256085749 wait complete. 2024-09-17T05:36:58.609 INFO:tasks.ceph.mds.d.smithi086.stderr: -4450> 2024-09-17T05:36:22.260+0000 7f9625a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:36:58.620 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:36:58.730 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.778+0000 7fa41a400640 1 -- 172.21.15.44:0/3390089959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140cf400 msgr2=0x7fa41406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.778+0000 7fa41a400640 1 --2- 172.21.15.44:0/3390089959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140cf400 0x7fa41406e160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc009840 tx=0x7fa3fc01c700 comp rx=0 tx=0).stop 2024-09-17T05:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.778+0000 7fa41a400640 1 -- 172.21.15.44:0/3390089959 shutdown_connections 2024-09-17T05:36:58.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.778+0000 7fa41a400640 1 --2- 172.21.15.44:0/3390089959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140cf400 0x7fa41406e160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.778+0000 7fa41a400640 1 -- 172.21.15.44:0/3390089959 >> 172.21.15.44:0/3390089959 conn(0x7fa4140d1120 msgr2=0x7fa4140d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.778+0000 7fa41a400640 1 -- 172.21.15.44:0/3390089959 shutdown_connections 2024-09-17T05:36:58.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.778+0000 7fa41a400640 1 -- 172.21.15.44:0/3390089959 wait complete. 2024-09-17T05:36:58.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 Processor -- start 2024-09-17T05:36:58.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 -- start start 2024-09-17T05:36:58.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa414072190 0x7fa4141fa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa41415f0e0 0x7fa414166a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140c81d0 0x7fa4140c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa414169fe0 con 0x7fa4140c81d0 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa414169e60 con 0x7fa41415f0e0 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa41a400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa41416a160 con 0x7fa414072190 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa413e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140c81d0 0x7fa4140c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa413e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140c81d0 0x7fa4140c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44200/0 (socket says 172.21.15.44:44200) 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.782+0000 7fa413e00640 1 -- 172.21.15.44:0/1397274904 learned_addr learned my addr 172.21.15.44:0/1397274904 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa40be00640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa41415f0e0 0x7fa414166a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa413400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa414072190 0x7fa4141fa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa413e00640 1 -- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa414072190 msgr2=0x7fa4141fa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa413e00640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa414072190 0x7fa4141fa8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa413e00640 1 -- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa41415f0e0 msgr2=0x7fa414166a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa413e00640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa41415f0e0 0x7fa414166a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa413e00640 1 -- 172.21.15.44:0/1397274904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4141f69d0 con 0x7fa4140c81d0 2024-09-17T05:36:58.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa413e00640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140c81d0 0x7fa4140c85e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00cad0 tx=0x7fa40c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa40b400640 1 -- 172.21.15.44:0/1397274904 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c016020 con 0x7fa4140c81d0 2024-09-17T05:36:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa40b400640 1 -- 172.21.15.44:0/1397274904 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa40c00a950 con 0x7fa4140c81d0 2024-09-17T05:36:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa40b400640 1 -- 172.21.15.44:0/1397274904 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c00ada0 con 0x7fa4140c81d0 2024-09-17T05:36:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4140c8b20 con 0x7fa4140c81d0 2024-09-17T05:36:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4141f6f20 con 0x7fa4140c81d0 2024-09-17T05:36:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa41406e160 con 0x7fa4140c81d0 2024-09-17T05:36:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.786+0000 7fa40b400640 1 -- 172.21.15.44:0/1397274904 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa40c019020 con 0x7fa4140c81d0 2024-09-17T05:36:58.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.790+0000 7fa40b400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa3f0073200 0x7fa3f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.790+0000 7fa40b400640 1 -- 172.21.15.44:0/1397274904 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7fa40c094750 con 0x7fa4140c81d0 2024-09-17T05:36:58.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.790+0000 7fa413400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa3f0073200 0x7fa3f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.790+0000 7fa413400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa3f0073200 0x7fa3f0075710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa404007fd0 tx=0x7fa404009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:58.794+0000 7fa40b400640 1 -- 172.21.15.44:0/1397274904 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa40c020020 con 0x7fa4140c81d0 2024-09-17T05:36:59.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.002+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa4140c7f80 con 0x7fa4140c81d0 2024-09-17T05:36:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.598+0000 7fa40b400640 1 -- 172.21.15.44:0/1397274904 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fa4140c8b20 con 0x7fa4140c81d0 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa3f0073200 msgr2=0x7fa3f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa3f0073200 0x7fa3f0075710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa404007fd0 tx=0x7fa404009040 comp rx=0 tx=0).stop 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140c81d0 msgr2=0x7fa4140c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140c81d0 0x7fa4140c85e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00cad0 tx=0x7fa40c00cbc0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 shutdown_connections 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4140c81d0 0x7fa4140c85e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa3f0073200 0x7fa3f0075710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa41415f0e0 0x7fa414166a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 --2- 172.21.15.44:0/1397274904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa414072190 0x7fa4141fa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 >> 172.21.15.44:0/1397274904 conn(0x7fa4140d1120 msgr2=0x7fa414070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 shutdown_connections 2024-09-17T05:36:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.602+0000 7fa41a400640 1 -- 172.21.15.44:0/1397274904 wait complete. 2024-09-17T05:36:59.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:36:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 -- 172.21.15.44:0/1255837176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a80ccd30 msgr2=0x7fe1a81641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 --2- 172.21.15.44:0/1255837176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a80ccd30 0x7fe1a81641d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80c9030 tx=0x7fe19001c890 comp rx=0 tx=0).stop 2024-09-17T05:36:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 -- 172.21.15.44:0/1255837176 shutdown_connections 2024-09-17T05:36:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 --2- 172.21.15.44:0/1255837176 >> v2:172.21.15.86:3300/0 conn(0x7fe1a8070570 0x7fe1a8166720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 --2- 172.21.15.44:0/1255837176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a80ccd30 0x7fe1a81641d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 -- 172.21.15.44:0/1255837176 >> 172.21.15.44:0/1255837176 conn(0x7fe1a80cea50 msgr2=0x7fe1a80cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:59.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 -- 172.21.15.44:0/1255837176 shutdown_connections 2024-09-17T05:36:59.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.790+0000 7fe1aca00640 1 -- 172.21.15.44:0/1255837176 wait complete. 2024-09-17T05:36:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 Processor -- start 2024-09-17T05:36:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 -- start start 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a8070160 0x7fe1a8151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8070570 0x7fe1a80b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a806eff0 0x7fe1a80b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a81699a0 con 0x7fe1a8070570 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8169820 con 0x7fe1a806eff0 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1aca00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a8169b20 con 0x7fe1a8070160 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe19fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8070570 0x7fe1a80b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe19fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8070570 0x7fe1a80b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42110/0 (socket says 172.21.15.44:42110) 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe19fe00640 1 -- 172.21.15.44:0/944736970 learned_addr learned my addr 172.21.15.44:0/944736970 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:36:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1a6800640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a8070160 0x7fe1a8151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.794+0000 7fe1a7200640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a806eff0 0x7fe1a80b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19fe00640 1 -- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a8070160 msgr2=0x7fe1a8151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19fe00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a8070160 0x7fe1a8151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19fe00640 1 -- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a806eff0 msgr2=0x7fe1a80b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19fe00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a806eff0 0x7fe1a80b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19fe00640 1 -- 172.21.15.44:0/944736970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a806df50 con 0x7fe1a8070570 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe1a6800640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a8070160 0x7fe1a8151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19fe00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8070570 0x7fe1a80b6450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1900194a0 tx=0x7fe190004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19ea00640 1 -- 172.21.15.44:0/944736970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1900bc070 con 0x7fe1a8070570 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19ea00640 1 -- 172.21.15.44:0/944736970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe190005320 con 0x7fe1a8070570 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a806e230 con 0x7fe1a8070570 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19ea00640 1 -- 172.21.15.44:0/944736970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1900b2040 con 0x7fe1a8070570 2024-09-17T05:36:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a806e7f0 con 0x7fe1a8070570 2024-09-17T05:36:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a8072020 con 0x7fe1a8070570 2024-09-17T05:36:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.798+0000 7fe19ea00640 1 -- 172.21.15.44:0/944736970 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe1900046d0 con 0x7fe1a8070570 2024-09-17T05:36:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.802+0000 7fe19ea00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.802+0000 7fe19ea00640 1 -- 172.21.15.44:0/944736970 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6676+0+0 (secure 0 0 0) 0x7fe19012e410 con 0x7fe1a8070570 2024-09-17T05:36:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.802+0000 7fe1a6800640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.802+0000 7fe1a6800640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1980016b0 tx=0x7fe198009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.806+0000 7fe19ea00640 1 -- 172.21.15.44:0/944736970 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe1900164b0 con 0x7fe1a8070570 2024-09-17T05:36:59.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:36:59.978+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1a80cc600 con 0x7fe1a8070570 2024-09-17T05:37:00.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.606+0000 7fe19ea00640 1 -- 172.21.15.44:0/944736970 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fe1900f8fc0 con 0x7fe1a8070570 2024-09-17T05:37:00.606 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:37:00.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.606+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 msgr2=0x7fe184075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.606+0000 7fe1aca00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe1980016b0 tx=0x7fe198009040 comp rx=0 tx=0).stop 2024-09-17T05:37:00.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.606+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8070570 msgr2=0x7fe1a80b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.606+0000 7fe1aca00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8070570 0x7fe1a80b6450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1900194a0 tx=0x7fe190004600 comp rx=0 tx=0).stop 2024-09-17T05:37:00.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 shutdown_connections 2024-09-17T05:37:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe184073200 0x7fe184075710 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a806eff0 0x7fe1a80b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe1a8070570 0x7fe1a80b6450 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 --2- 172.21.15.44:0/944736970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe1a8070160 0x7fe1a8151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 >> 172.21.15.44:0/944736970 conn(0x7fe1a80cea50 msgr2=0x7fe1a815b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 shutdown_connections 2024-09-17T05:37:00.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.610+0000 7fe1aca00640 1 -- 172.21.15.44:0/944736970 wait complete. 2024-09-17T05:37:00.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:37:00.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 -- 172.21.15.44:0/1072058743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9740ccf10 msgr2=0x7fb97415d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 --2- 172.21.15.44:0/1072058743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9740ccf10 0x7fb97415d440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009840 tx=0x7fb95c01c7f0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 -- 172.21.15.44:0/1072058743 shutdown_connections 2024-09-17T05:37:00.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 --2- 172.21.15.44:0/1072058743 >> v2:172.21.15.86:3300/0 conn(0x7fb97415d980 0x7fb97415dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 --2- 172.21.15.44:0/1072058743 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9740ccf10 0x7fb97415d440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 -- 172.21.15.44:0/1072058743 >> 172.21.15.44:0/1072058743 conn(0x7fb9740cec30 msgr2=0x7fb9740cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:00.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 -- 172.21.15.44:0/1072058743 shutdown_connections 2024-09-17T05:37:00.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 -- 172.21.15.44:0/1072058743 wait complete. 2024-09-17T05:37:00.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 Processor -- start 2024-09-17T05:37:00.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.802+0000 7fb978c00640 1 -- start start 2024-09-17T05:37:00.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb974156980 0x7fb974150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97415d980 0x7fb97414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb974150fb0 0x7fb97414c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb974169a20 con 0x7fb974156980 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb9741698a0 con 0x7fb974150fb0 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb974169ba0 con 0x7fb97415d980 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb974156980 0x7fb974150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb974156980 0x7fb974150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42118/0 (socket says 172.21.15.44:42118) 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 -- 172.21.15.44:0/3017873121 learned_addr learned my addr 172.21.15.44:0/3017873121 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb96be00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97415d980 0x7fb97414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb972800640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb974150fb0 0x7fb97414c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 -- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97415d980 msgr2=0x7fb97414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97415d980 0x7fb97414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 -- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb974150fb0 msgr2=0x7fb97414c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb974150fb0 0x7fb97414c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 -- 172.21.15.44:0/3017873121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9740cb4a0 con 0x7fb974156980 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb971e00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb974156980 0x7fb974150a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c400 tx=0x7fb96400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb96a000640 1 -- 172.21.15.44:0/3017873121 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964017070 con 0x7fb974156980 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb96a000640 1 -- 172.21.15.44:0/3017873121 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb964003600 con 0x7fb974156980 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97406fd10 con 0x7fb974156980 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb96a000640 1 -- 172.21.15.44:0/3017873121 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964003a50 con 0x7fb974156980 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb97406e050 con 0x7fb974156980 2024-09-17T05:37:00.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.806+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb97406fb00 con 0x7fb974156980 2024-09-17T05:37:00.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.810+0000 7fb96a000640 1 -- 172.21.15.44:0/3017873121 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb96401a070 con 0x7fb974156980 2024-09-17T05:37:00.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.810+0000 7fb96a000640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb950073200 0x7fb950075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.810+0000 7fb96a000640 1 -- 172.21.15.44:0/3017873121 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6238+0+0 (secure 0 0 0) 0x7fb964093820 con 0x7fb974156980 2024-09-17T05:37:00.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.810+0000 7fb96be00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb950073200 0x7fb950075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.810+0000 7fb96be00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb950073200 0x7fb950075710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0af000 tx=0x7fb95c01b030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:00.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.814+0000 7fb96a000640 1 -- 172.21.15.44:0/3017873121 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb96405e510 con 0x7fb974156980 2024-09-17T05:37:00.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:00.990+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb97415d440 con 0x7fb974156980 2024-09-17T05:37:01.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.610+0000 7fb96a000640 1 -- 172.21.15.44:0/3017873121 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7fb96405de10 con 0x7fb974156980 2024-09-17T05:37:01.613 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:37:01.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb950073200 msgr2=0x7fb950075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb950073200 0x7fb950075710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0af000 tx=0x7fb95c01b030 comp rx=0 tx=0).stop 2024-09-17T05:37:01.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb974156980 msgr2=0x7fb974150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb974156980 0x7fb974150a70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c400 tx=0x7fb96400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 shutdown_connections 2024-09-17T05:37:01.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb950073200 0x7fb950075710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb974150fb0 0x7fb97414c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb97415d980 0x7fb97414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 --2- 172.21.15.44:0/3017873121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb974156980 0x7fb974150a70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 >> 172.21.15.44:0/3017873121 conn(0x7fb9740cec30 msgr2=0x7fb974072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:01.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 shutdown_connections 2024-09-17T05:37:01.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.622+0000 7fb978c00640 1 -- 172.21.15.44:0/3017873121 wait complete. 2024-09-17T05:37:01.646 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-17T05:37:01.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 -- 172.21.15.44:0/1783770513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a40702b0 msgr2=0x7f28a40d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 --2- 172.21.15.44:0/1783770513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a40702b0 0x7f28a40d05a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2894009900 tx=0x7f289401c8a0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 -- 172.21.15.44:0/1783770513 shutdown_connections 2024-09-17T05:37:01.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 --2- 172.21.15.44:0/1783770513 >> v2:172.21.15.86:3300/0 conn(0x7f28a40d0ae0 0x7f28a415ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 --2- 172.21.15.44:0/1783770513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a40702b0 0x7f28a40d05a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 -- 172.21.15.44:0/1783770513 >> 172.21.15.44:0/1783770513 conn(0x7f28a40b35f0 msgr2=0x7f28a40b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:01.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 -- 172.21.15.44:0/1783770513 shutdown_connections 2024-09-17T05:37:01.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 -- 172.21.15.44:0/1783770513 wait complete. 2024-09-17T05:37:01.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 Processor -- start 2024-09-17T05:37:01.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.810+0000 7f28a9400640 1 -- start start 2024-09-17T05:37:01.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28a40702b0 0x7f28a41fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a40d0ae0 0x7f28a414e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a415d230 0x7f28a414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4169b90 con 0x7f28a415d230 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f28a4169a10 con 0x7f28a40d0ae0 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f28a4169d10 con 0x7f28a40702b0 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a415d230 0x7f28a414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a415d230 0x7f28a414b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42146/0 (socket says 172.21.15.44:42146) 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 -- 172.21.15.44:0/1377205930 learned_addr learned my addr 172.21.15.44:0/1377205930 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f2899e00640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a40d0ae0 0x7f28a414e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a2800640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28a40702b0 0x7f28a41fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 -- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28a40702b0 msgr2=0x7f28a41fca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28a40702b0 0x7f28a41fca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 -- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a40d0ae0 msgr2=0x7f28a414e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a40d0ae0 0x7f28a414e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 -- 172.21.15.44:0/1377205930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a414e9b0 con 0x7f28a415d230 2024-09-17T05:37:01.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a3200640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a415d230 0x7f28a414b490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c760 tx=0x7f289c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f289b400640 1 -- 172.21.15.44:0/1377205930 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c003b80 con 0x7f28a415d230 2024-09-17T05:37:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f289b400640 1 -- 172.21.15.44:0/1377205930 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f289c003d20 con 0x7f28a415d230 2024-09-17T05:37:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f289b400640 1 -- 172.21.15.44:0/1377205930 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c00aab0 con 0x7f28a415d230 2024-09-17T05:37:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a414ec90 con 0x7f28a415d230 2024-09-17T05:37:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a41fc270 con 0x7f28a415d230 2024-09-17T05:37:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.814+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a414e700 con 0x7f28a415d230 2024-09-17T05:37:01.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.818+0000 7f289b400640 1 -- 172.21.15.44:0/1377205930 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f289c00ac50 con 0x7f28a415d230 2024-09-17T05:37:01.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.818+0000 7f289b400640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2880073230 0x7f2880075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.818+0000 7f289b400640 1 -- 172.21.15.44:0/1377205930 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5795+0+0 (secure 0 0 0) 0x7f289c093eb0 con 0x7f28a415d230 2024-09-17T05:37:01.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.818+0000 7f28a2800640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2880073230 0x7f2880075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.818+0000 7f28a2800640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2880073230 0x7f2880075740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28940af000 tx=0x7f2894019640 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:01.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.822+0000 7f289b400640 1 -- 172.21.15.44:0/1377205930 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f28a40d0ef0 con 0x7f28a415d230 2024-09-17T05:37:01.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:01.998+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f28a40d05a0 con 0x7f28a415d230 2024-09-17T05:37:02.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.618+0000 7f289b400640 1 -- 172.21.15.44:0/1377205930 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f289c05e8a0 con 0x7f28a415d230 2024-09-17T05:37:02.619 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' removed 2024-09-17T05:37:02.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2880073230 msgr2=0x7f2880075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2880073230 0x7f2880075740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f28940af000 tx=0x7f2894019640 comp rx=0 tx=0).stop 2024-09-17T05:37:02.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a415d230 msgr2=0x7f28a414b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a415d230 0x7f28a414b490 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f289c00c760 tx=0x7f289c00cc20 comp rx=0 tx=0).stop 2024-09-17T05:37:02.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 shutdown_connections 2024-09-17T05:37:02.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28a415d230 0x7f28a414b490 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2880073230 0x7f2880075740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28a40d0ae0 0x7f28a414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 --2- 172.21.15.44:0/1377205930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28a40702b0 0x7f28a41fca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 >> 172.21.15.44:0/1377205930 conn(0x7f28a40b35f0 msgr2=0x7f28a40743b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:02.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 shutdown_connections 2024-09-17T05:37:02.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.626+0000 7f28a9400640 1 -- 172.21.15.44:0/1377205930 wait complete. 2024-09-17T05:37:02.649 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:37:02.649 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:37:02.649 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:37:02.649 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:02.649 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:37:02.649 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:37:02.649 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:37:02.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:02.650 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:37:02.650 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:37:02.650 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:37:02.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:02.650 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:37:02.650 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:37:02.651 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:37:02.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:02.662 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:37:02.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:37:02.664 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:37:02.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:37:02.668 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:37:02.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:37:02.675 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:37:02.676 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:37:02.707 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:37:02.707 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:02.709 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:37:02.709 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:02.718 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:37:02.718 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:02.721 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:37:02.721 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:02.721 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:37:02.807 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:37:02.807 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:37:02.821 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:37:02.824 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:37:02.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.886+0000 7f91e7800640 1 -- 172.21.15.44:0/1679129887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d18f0 msgr2=0x7f91e00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.886+0000 7f91e7800640 1 --2- 172.21.15.44:0/1679129887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d18f0 0x7f91e00b1be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009840 tx=0x7f91d001c760 comp rx=0 tx=0).stop 2024-09-17T05:37:02.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.886+0000 7f91e7800640 1 -- 172.21.15.44:0/1679129887 shutdown_connections 2024-09-17T05:37:02.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.886+0000 7f91e7800640 1 --2- 172.21.15.44:0/1679129887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d18f0 0x7f91e00b1be0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.886+0000 7f91e7800640 1 -- 172.21.15.44:0/1679129887 >> 172.21.15.44:0/1679129887 conn(0x7f91e00b4240 msgr2=0x7f91e00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:02.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.886+0000 7f91e7800640 1 -- 172.21.15.44:0/1679129887 shutdown_connections 2024-09-17T05:37:02.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.886+0000 7f91e7800640 1 -- 172.21.15.44:0/1679129887 wait complete. 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 Processor -- start 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 -- start start 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e00d18f0 0x7f91e00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d1d00 0x7f91e0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e0155190 0x7f91e01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91e016aff0 con 0x7f91e00d18f0 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91e016ae70 con 0x7f91e00d1d00 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f91e016b170 con 0x7f91e0155190 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e00d18f0 0x7f91e00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e00d18f0 0x7f91e00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42164/0 (socket says 172.21.15.44:42164) 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 -- 172.21.15.44:0/1541660291 learned_addr learned my addr 172.21.15.44:0/1541660291 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91d7e00640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d1d00 0x7f91e0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e5800640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e0155190 0x7f91e01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 -- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e0155190 msgr2=0x7f91e01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e0155190 0x7f91e01555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 -- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d1d00 msgr2=0x7f91e0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d1d00 0x7f91e0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 -- 172.21.15.44:0/1541660291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e0159e40 con 0x7f91e00d18f0 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91d7e00640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d1d00 0x7f91e0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e4e00640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e00d18f0 0x7f91e00cb940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91d001cc40 tx=0x7f91d0005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91dd600640 1 -- 172.21.15.44:0/1541660291 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d00bb070 con 0x7f91e00d18f0 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91dd600640 1 -- 172.21.15.44:0/1541660291 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91d0004330 con 0x7f91e00d18f0 2024-09-17T05:37:02.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91dd600640 1 -- 172.21.15.44:0/1541660291 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d00b2040 con 0x7f91e00d18f0 2024-09-17T05:37:02.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e01541b0 con 0x7f91e00d18f0 2024-09-17T05:37:02.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.890+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e0154450 con 0x7f91e00d18f0 2024-09-17T05:37:02.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.894+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e00b1be0 con 0x7f91e00d18f0 2024-09-17T05:37:02.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.894+0000 7f91dd600640 1 -- 172.21.15.44:0/1541660291 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f91d0005230 con 0x7f91e00d18f0 2024-09-17T05:37:02.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.894+0000 7f91dd600640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f91bc073230 0x7f91bc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.894+0000 7f91dd600640 1 -- 172.21.15.44:0/1541660291 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7f91d012e0a0 con 0x7f91e00d18f0 2024-09-17T05:37:02.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.894+0000 7f91d7e00640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f91bc073230 0x7f91bc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.898+0000 7f91d7e00640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f91bc073230 0x7f91bc075740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f91c8000f70 tx=0x7f91c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:02.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:02.898+0000 7f91dd600640 1 -- 172.21.15.44:0/1541660291 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f91d0016410 con 0x7f91e00d18f0 2024-09-17T05:37:03.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.086+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f91e00cc620 con 0x7f91e00d18f0 2024-09-17T05:37:03.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.634+0000 7f91dd600640 1 -- 172.21.15.44:0/1541660291 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7f91d00f8ce0 con 0x7f91e00d18f0 2024-09-17T05:37:03.636 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-17T05:37:03.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f91bc073230 msgr2=0x7f91bc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f91bc073230 0x7f91bc075740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f91c8000f70 tx=0x7f91c8009040 comp rx=0 tx=0).stop 2024-09-17T05:37:03.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e00d18f0 msgr2=0x7f91e00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e00d18f0 0x7f91e00cb940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91d001cc40 tx=0x7f91d0005ca0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 shutdown_connections 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91e0155190 0x7f91e01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f91bc073230 0x7f91bc075740 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91e00d1d00 0x7f91e0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 --2- 172.21.15.44:0/1541660291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91e00d18f0 0x7f91e00cb940 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 >> 172.21.15.44:0/1541660291 conn(0x7f91e00b4240 msgr2=0x7f91e0070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 shutdown_connections 2024-09-17T05:37:03.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.638+0000 7f91e7800640 1 -- 172.21.15.44:0/1541660291 wait complete. 2024-09-17T05:37:03.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:37:03.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 -- 172.21.15.44:0/3806995016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24240cc3b0 msgr2=0x7f242406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 --2- 172.21.15.44:0/3806995016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24240cc3b0 0x7f242406fe80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f241c009bc0 tx=0x7f241c01cae0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 -- 172.21.15.44:0/3806995016 shutdown_connections 2024-09-17T05:37:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 --2- 172.21.15.44:0/3806995016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24240cc3b0 0x7f242406fe80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 --2- 172.21.15.44:0/3806995016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f242415d560 0x7f242415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 -- 172.21.15.44:0/3806995016 >> 172.21.15.44:0/3806995016 conn(0x7f24240cd930 msgr2=0x7f24240cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 -- 172.21.15.44:0/3806995016 shutdown_connections 2024-09-17T05:37:03.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.826+0000 7f242bc00640 1 -- 172.21.15.44:0/3806995016 wait complete. 2024-09-17T05:37:03.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 Processor -- start 2024-09-17T05:37:03.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 -- start start 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f242406ce40 0x7f24241fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f242415d560 0x7f242414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24240b6200 0x7f2424165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2424169b10 con 0x7f24240b6200 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2424169990 con 0x7f242406ce40 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f242bc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2424169c90 con 0x7f242415d560 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24240b6200 0x7f2424165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24240b6200 0x7f2424165610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42166/0 (socket says 172.21.15.44:42166) 2024-09-17T05:37:03.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 -- 172.21.15.44:0/1271958452 learned_addr learned my addr 172.21.15.44:0/1271958452 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429200640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f242406ce40 0x7f24241fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2423e00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f242415d560 0x7f242414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 -- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f242415d560 msgr2=0x7f242414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f242415d560 0x7f242414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 -- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f242406ce40 msgr2=0x7f24241fc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f242406ce40 0x7f24241fc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 -- 172.21.15.44:0/1271958452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24240b67a0 con 0x7f24240b6200 2024-09-17T05:37:03.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.830+0000 7f2429c00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24240b6200 0x7f2424165610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f241c0b0040 tx=0x7f241c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f2420c00640 1 -- 172.21.15.44:0/1271958452 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c0b2040 con 0x7f24240b6200 2024-09-17T05:37:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f2420c00640 1 -- 172.21.15.44:0/1271958452 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f241c0bb070 con 0x7f24240b6200 2024-09-17T05:37:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24241528c0 con 0x7f24240b6200 2024-09-17T05:37:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f2420c00640 1 -- 172.21.15.44:0/1271958452 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c004040 con 0x7f24240b6200 2024-09-17T05:37:03.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24241fc600 con 0x7f24240b6200 2024-09-17T05:37:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242406fe80 con 0x7f24240b6200 2024-09-17T05:37:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f2420c00640 1 -- 172.21.15.44:0/1271958452 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f241c0041e0 con 0x7f24240b6200 2024-09-17T05:37:03.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f2420c00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2404073200 0x7f2404075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.834+0000 7f2420c00640 1 -- 172.21.15.44:0/1271958452 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f241c12e5d0 con 0x7f24240b6200 2024-09-17T05:37:03.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.838+0000 7f2429200640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2404073200 0x7f2404075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.838+0000 7f2429200640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2404073200 0x7f2404075710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2418009b40 tx=0x7f24180091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:03.842+0000 7f2420c00640 1 -- 172.21.15.44:0/1271958452 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f241c016790 con 0x7f24240b6200 2024-09-17T05:37:04.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.074+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f24240ce080 con 0x7f24240b6200 2024-09-17T05:37:04.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.074+0000 7f2420c00640 1 -- 172.21.15.44:0/1271958452 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f241c0f9160 con 0x7f24240b6200 2024-09-17T05:37:04.076 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw==", 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.077 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow==", 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.078 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ==", 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA==", 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.079 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw==", 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.080 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA==", 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-17T05:37:04.081 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg==", 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q==", 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.082 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg==", 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-17T05:37:04.083 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew==", 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-17T05:37:04.084 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA==", 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw==", 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:04.085 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow==", 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.086 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ==", 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw==", 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A==", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:37:04.088 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQARFelmev8SKhAAoaY75HymG92N8LNMMAUl6g==", 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.089 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mds", 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2FelmcGNJOBAA189FRwJe14dEdeY5tY0n7w==", 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2FelmjXZJOBAAYDmP8syu50kMtco7Qh/oSw==", 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.090 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-osd", 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2Felm04ZJOBAAiDzilmziOWVeH3JGMYzb6Q==", 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2FelmTpZJOBAAysmV8W+Q1y70LqgFg4/HBQ==", 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2FelmOKdJOBAAlTPEXw8C4mbx6D0meSFkJg==", 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQA2FelmY7lJOBAAmU3PkrvaNo55lsVr1DQIYw==", 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.092 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA==", 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-17T05:37:04.093 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw==", 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:37:04.094 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2404073200 msgr2=0x7f2404075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2404073200 0x7f2404075710 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2418009b40 tx=0x7f24180091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24240b6200 msgr2=0x7f2424165610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24240b6200 0x7f2424165610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f241c0b0040 tx=0x7f241c009310 comp rx=0 tx=0).stop 2024-09-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 shutdown_connections 2024-09-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24240b6200 0x7f2424165610 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f242415d560 0x7f242414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2404073200 0x7f2404075710 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 --2- 172.21.15.44:0/1271958452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f242406ce40 0x7f24241fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 >> 172.21.15.44:0/1271958452 conn(0x7f24240cd930 msgr2=0x7f242415be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 shutdown_connections 2024-09-17T05:37:04.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.078+0000 7f242bc00640 1 -- 172.21.15.44:0/1271958452 wait complete. 2024-09-17T05:37:04.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T05:37:04.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.254+0000 7f7d03a00640 1 -- 172.21.15.44:0/1229880308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0cf780 msgr2=0x7f7cfc15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.254+0000 7f7d03a00640 1 --2- 172.21.15.44:0/1229880308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0cf780 0x7f7cfc15d060 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009bc0 tx=0x7f7cf401cae0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.254+0000 7f7d03a00640 1 -- 172.21.15.44:0/1229880308 shutdown_connections 2024-09-17T05:37:04.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.254+0000 7f7d03a00640 1 --2- 172.21.15.44:0/1229880308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0cf780 0x7f7cfc15d060 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.254+0000 7f7d03a00640 1 -- 172.21.15.44:0/1229880308 >> 172.21.15.44:0/1229880308 conn(0x7f7cfc0b4240 msgr2=0x7f7cfc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 -- 172.21.15.44:0/1229880308 shutdown_connections 2024-09-17T05:37:04.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 -- 172.21.15.44:0/1229880308 wait complete. 2024-09-17T05:37:04.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 Processor -- start 2024-09-17T05:37:04.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 -- start start 2024-09-17T05:37:04.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cfc0d18f0 0x7f7cfc06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0d1d00 0x7f7cfc1f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cfc150db0 0x7f7cfc1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc16af40 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc16adc0 con 0x7f7cfc150db0 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.258+0000 7f7d03a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc16b0c0 con 0x7f7cfc0d18f0 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0d1d00 0x7f7cfc1f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0d1d00 0x7f7cfc1f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42186/0 (socket says 172.21.15.44:42186) 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 -- 172.21.15.44:0/3981509360 learned_addr learned my addr 172.21.15.44:0/3981509360 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7d01000640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cfc0d18f0 0x7f7cfc06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7d01a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cfc150db0 0x7f7cfc1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 -- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cfc0d18f0 msgr2=0x7f7cfc06fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cfc0d18f0 0x7f7cfc06fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 -- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cfc150db0 msgr2=0x7f7cfc1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cfc150db0 0x7f7cfc1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 -- 172.21.15.44:0/3981509360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc151700 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7d01a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cfc150db0 0x7f7cfc1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cfbe00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0d1d00 0x7f7cfc1f8820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c3f0 tx=0x7f7ce800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cf8c00640 1 -- 172.21.15.44:0/3981509360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8017070 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cf8c00640 1 -- 172.21.15.44:0/3981509360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce80053c0 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc06ee80 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cf8c00640 1 -- 172.21.15.44:0/3981509360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8003860 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc06e8c0 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc06e350 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.262+0000 7f7cf8c00640 1 -- 172.21.15.44:0/3981509360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7ce801a070 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.266+0000 7f7cf8c00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7cdc073200 0x7f7cdc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.266+0000 7f7cf8c00640 1 -- 172.21.15.44:0/3981509360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f7ce8093460 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.266+0000 7f7d01000640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7cdc073200 0x7f7cdc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.266+0000 7f7d01000640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7cdc073200 0x7f7cdc075710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00046c0 tx=0x7f7cf0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:04.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.270+0000 7f7cf8c00640 1 -- 172.21.15.44:0/3981509360 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7cfc151700 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.506+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f7cfc15d060 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7cf8c00640 1 -- 172.21.15.44:0/3981509360 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f7ce8001090 con 0x7f7cfc0d1d00 2024-09-17T05:37:04.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7cdc073200 msgr2=0x7f7cdc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7cdc073200 0x7f7cdc075710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00046c0 tx=0x7f7cf0009040 comp rx=0 tx=0).stop 2024-09-17T05:37:04.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0d1d00 msgr2=0x7f7cfc1f8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0d1d00 0x7f7cfc1f8820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c3f0 tx=0x7f7ce800c8b0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 shutdown_connections 2024-09-17T05:37:04.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7cdc073200 0x7f7cdc075710 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7cfc150db0 0x7f7cfc1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7cfc0d1d00 0x7f7cfc1f8820 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 --2- 172.21.15.44:0/3981509360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7cfc0d18f0 0x7f7cfc06fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 >> 172.21.15.44:0/3981509360 conn(0x7f7cfc0b4240 msgr2=0x7f7cfc151de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 shutdown_connections 2024-09-17T05:37:04.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.510+0000 7f7d03a00640 1 -- 172.21.15.44:0/3981509360 wait complete. 2024-09-17T05:37:04.532 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T05:37:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 -- 172.21.15.44:0/2860112142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 msgr2=0x7f16a00cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 --2- 172.21.15.44:0/2860112142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 0x7f16a00cb880 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1698009bc0 tx=0x7f169801cb10 comp rx=0 tx=0).stop 2024-09-17T05:37:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 -- 172.21.15.44:0/2860112142 shutdown_connections 2024-09-17T05:37:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 --2- 172.21.15.44:0/2860112142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 0x7f16a00cb880 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 --2- 172.21.15.44:0/2860112142 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a0072e50 0x7f16a015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 -- 172.21.15.44:0/2860112142 >> 172.21.15.44:0/2860112142 conn(0x7f16a00ccaa0 msgr2=0x7f16a00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 -- 172.21.15.44:0/2860112142 shutdown_connections 2024-09-17T05:37:04.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 -- 172.21.15.44:0/2860112142 wait complete. 2024-09-17T05:37:04.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 Processor -- start 2024-09-17T05:37:04.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.694+0000 7f16a7a00640 1 -- start start 2024-09-17T05:37:04.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a006de50 0x7f16a01fc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a0072e50 0x7f16a01fc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 0x7f16a015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0168fc0 con 0x7f16a0072e50 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0168e40 con 0x7f16a00cb470 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f16a0169140 con 0x7f16a006de50 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a0072e50 0x7f16a01fc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a5000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a006de50 0x7f16a01fc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a5000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a006de50 0x7f16a01fc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:58782/0 (socket says 172.21.15.44:58782) 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a0072e50 0x7f16a01fc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42194/0 (socket says 172.21.15.44:42194) 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a5000640 1 -- 172.21.15.44:0/506283858 learned_addr learned my addr 172.21.15.44:0/506283858 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a5a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 0x7f16a015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 -- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a006de50 msgr2=0x7f16a01fc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a006de50 0x7f16a01fc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 -- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 msgr2=0x7f16a015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 0x7f16a015bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 -- 172.21.15.44:0/506283858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a01fd250 con 0x7f16a0072e50 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a5a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 0x7f16a015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169fe00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a0072e50 0x7f16a01fc930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f16a00c7020 tx=0x7f168c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169cc00640 1 -- 172.21.15.44:0/506283858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c011790 con 0x7f16a0072e50 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169cc00640 1 -- 172.21.15.44:0/506283858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f168c017070 con 0x7f16a0072e50 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f169cc00640 1 -- 172.21.15.44:0/506283858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c011d20 con 0x7f16a0072e50 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a015eb10 con 0x7f16a0072e50 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a015cf80 con 0x7f16a0072e50 2024-09-17T05:37:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.698+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a00b5fa0 con 0x7f16a0072e50 2024-09-17T05:37:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.702+0000 7f169cc00640 1 -- 172.21.15.44:0/506283858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f168c01c460 con 0x7f16a0072e50 2024-09-17T05:37:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.702+0000 7f169cc00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1680073230 0x7f1680075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.702+0000 7f169cc00640 1 -- 172.21.15.44:0/506283858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f168c093940 con 0x7f16a0072e50 2024-09-17T05:37:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.702+0000 7f16a5000640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1680073230 0x7f1680075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.702+0000 7f16a5000640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1680073230 0x7f1680075740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1694009680 tx=0x7f16940091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:04.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.706+0000 7f169cc00640 1 -- 172.21.15.44:0/506283858 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f168c021020 con 0x7f16a0072e50 2024-09-17T05:37:04.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.938+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f16a00afc80 con 0x7f16a0072e50 2024-09-17T05:37:04.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.942+0000 7f169cc00640 1 -- 172.21.15.44:0/506283858 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f168c05e4c0 con 0x7f16a0072e50 2024-09-17T05:37:04.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1680073230 msgr2=0x7f1680075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1680073230 0x7f1680075740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1694009680 tx=0x7f16940091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a0072e50 msgr2=0x7f16a01fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a0072e50 0x7f16a01fc930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f16a00c7020 tx=0x7f168c00c820 comp rx=0 tx=0).stop 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 shutdown_connections 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1680073230 0x7f1680075740 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16a00cb470 0x7f16a015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16a0072e50 0x7f16a01fc930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 --2- 172.21.15.44:0/506283858 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16a006de50 0x7f16a01fc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 >> 172.21.15.44:0/506283858 conn(0x7f16a00ccaa0 msgr2=0x7f16a0155370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 shutdown_connections 2024-09-17T05:37:04.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:04.946+0000 7f16a7a00640 1 -- 172.21.15.44:0/506283858 wait complete. 2024-09-17T05:37:04.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T05:37:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 -- 172.21.15.44:0/3229730346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 msgr2=0x7f1e2c072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 --2- 172.21.15.44:0/3229730346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 0x7f1e2c072e50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0074e0 tx=0x7f1e1c01fd60 comp rx=0 tx=0).stop 2024-09-17T05:37:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 -- 172.21.15.44:0/3229730346 shutdown_connections 2024-09-17T05:37:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 --2- 172.21.15.44:0/3229730346 >> v2:172.21.15.86:3300/0 conn(0x7f1e2c06de50 0x7f1e2c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 --2- 172.21.15.44:0/3229730346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 0x7f1e2c072e50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 -- 172.21.15.44:0/3229730346 >> 172.21.15.44:0/3229730346 conn(0x7f1e2c0ccaa0 msgr2=0x7f1e2c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 -- 172.21.15.44:0/3229730346 shutdown_connections 2024-09-17T05:37:05.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 -- 172.21.15.44:0/3229730346 wait complete. 2024-09-17T05:37:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 Processor -- start 2024-09-17T05:37:05.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.126+0000 7f1e32600640 1 -- start start 2024-09-17T05:37:05.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e2c06de50 0x7f1e2c0c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0ce080 0x7f1e2c0c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 0x7f1e2c0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c0cf7b0 con 0x7f1e2c0ce080 2024-09-17T05:37:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c0cf630 con 0x7f1e2c06de50 2024-09-17T05:37:05.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2c070f40 con 0x7f1e2c0cef20 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e23e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0ce080 0x7f1e2c0c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e2c06de50 0x7f1e2c0c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e23e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0ce080 0x7f1e2c0c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42198/0 (socket says 172.21.15.44:42198) 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e2c06de50 0x7f1e2c0c3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:39954/0 (socket says 172.21.15.44:39954) 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e23e00640 1 -- 172.21.15.44:0/244666329 learned_addr learned my addr 172.21.15.44:0/244666329 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2be00640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 0x7f1e2c0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 -- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 msgr2=0x7f1e2c0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 0x7f1e2c0c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 -- 172.21.15.44:0/244666329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0ce080 msgr2=0x7f1e2c0c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0ce080 0x7f1e2c0c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 -- 172.21.15.44:0/244666329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2c1f73f0 con 0x7f1e2c06de50 2024-09-17T05:37:05.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e2b400640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e2c06de50 0x7f1e2c0c3210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0af000 tx=0x7f1e1c005e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e23400640 1 -- 172.21.15.44:0/244666329 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c004040 con 0x7f1e2c06de50 2024-09-17T05:37:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e23400640 1 -- 172.21.15.44:0/244666329 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e1c0042f0 con 0x7f1e2c06de50 2024-09-17T05:37:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e23400640 1 -- 172.21.15.44:0/244666329 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c003860 con 0x7f1e2c06de50 2024-09-17T05:37:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2c1f76d0 con 0x7f1e2c06de50 2024-09-17T05:37:05.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2c1f7c90 con 0x7f1e2c06de50 2024-09-17T05:37:05.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.130+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e2c06e260 con 0x7f1e2c06de50 2024-09-17T05:37:05.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.134+0000 7f1e23400640 1 -- 172.21.15.44:0/244666329 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1e1c0c3020 con 0x7f1e2c06de50 2024-09-17T05:37:05.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.134+0000 7f1e23400640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e08073200 0x7f1e08075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.134+0000 7f1e23400640 1 -- 172.21.15.44:0/244666329 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f1e1c131c90 con 0x7f1e2c06de50 2024-09-17T05:37:05.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.134+0000 7f1e23e00640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e08073200 0x7f1e08075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.134+0000 7f1e23e00640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e08073200 0x7f1e08075710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c155b20 tx=0x7f1e140091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.138+0000 7f1e23400640 1 -- 172.21.15.44:0/244666329 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1e1c0198c0 con 0x7f1e2c06de50 2024-09-17T05:37:05.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.374+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f1e2c0af7c0 con 0x7f1e2c06de50 2024-09-17T05:37:05.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.382+0000 7f1e23400640 1 -- 172.21.15.44:0/244666329 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f1e1c0fc800 con 0x7f1e2c06de50 2024-09-17T05:37:05.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e08073200 msgr2=0x7f1e08075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e08073200 0x7f1e08075710 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c155b20 tx=0x7f1e140091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e2c06de50 msgr2=0x7f1e2c0c3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e2c06de50 0x7f1e2c0c3210 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0af000 tx=0x7f1e1c005e70 comp rx=0 tx=0).stop 2024-09-17T05:37:05.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 shutdown_connections 2024-09-17T05:37:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1e2c0cef20 0x7f1e2c0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e2c0ce080 0x7f1e2c0c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1e08073200 0x7f1e08075710 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 --2- 172.21.15.44:0/244666329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e2c06de50 0x7f1e2c0c3210 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 >> 172.21.15.44:0/244666329 conn(0x7f1e2c0ccaa0 msgr2=0x7f1e2c074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 shutdown_connections 2024-09-17T05:37:05.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.386+0000 7f1e32600640 1 -- 172.21.15.44:0/244666329 wait complete. 2024-09-17T05:37:05.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T05:37:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 -- 172.21.15.44:0/1423432158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 msgr2=0x7f6860166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 --2- 172.21.15.44:0/1423432158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 0x7f6860166480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6858009bc0 tx=0x7f685801ca30 comp rx=0 tx=0).stop 2024-09-17T05:37:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 -- 172.21.15.44:0/1423432158 shutdown_connections 2024-09-17T05:37:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 --2- 172.21.15.44:0/1423432158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 0x7f6860166480 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 -- 172.21.15.44:0/1423432158 >> 172.21.15.44:0/1423432158 conn(0x7f68600ccaa0 msgr2=0x7f68600cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 -- 172.21.15.44:0/1423432158 shutdown_connections 2024-09-17T05:37:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 -- 172.21.15.44:0/1423432158 wait complete. 2024-09-17T05:37:05.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 Processor -- start 2024-09-17T05:37:05.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.566+0000 7f6865a00640 1 -- start start 2024-09-17T05:37:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f686006de50 0x7f68600b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860072e50 0x7f68600cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 0x7f68600ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6860169fe0 con 0x7f6860072e50 2024-09-17T05:37:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6860169e60 con 0x7f68600cc480 2024-09-17T05:37:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f686016a160 con 0x7f686006de50 2024-09-17T05:37:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860072e50 0x7f68600cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860072e50 0x7f68600cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42212/0 (socket says 172.21.15.44:42212) 2024-09-17T05:37:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 -- 172.21.15.44:0/3988200987 learned_addr learned my addr 172.21.15.44:0/3988200987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f685f400640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 0x7f68600ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f685ea00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f686006de50 0x7f68600b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 -- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f686006de50 msgr2=0x7f68600b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f686006de50 0x7f68600b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 -- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 msgr2=0x7f68600ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 0x7f68600ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 -- 172.21.15.44:0/3988200987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68600c2b00 con 0x7f6860072e50 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f685f400640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 0x7f68600ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6856000640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860072e50 0x7f68600cdbf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f684800c450 tx=0x7f684800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6857400640 1 -- 172.21.15.44:0/3988200987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68480052d0 con 0x7f6860072e50 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6857400640 1 -- 172.21.15.44:0/3988200987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6848005470 con 0x7f6860072e50 2024-09-17T05:37:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686009f900 con 0x7f6860072e50 2024-09-17T05:37:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6857400640 1 -- 172.21.15.44:0/3988200987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6848012870 con 0x7f6860072e50 2024-09-17T05:37:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686009fec0 con 0x7f6860072e50 2024-09-17T05:37:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.570+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686015e990 con 0x7f6860072e50 2024-09-17T05:37:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.574+0000 7f6857400640 1 -- 172.21.15.44:0/3988200987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6848003600 con 0x7f6860072e50 2024-09-17T05:37:05.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.574+0000 7f6857400640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f683c073230 0x7f683c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.574+0000 7f6857400640 1 -- 172.21.15.44:0/3988200987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f6848093aa0 con 0x7f6860072e50 2024-09-17T05:37:05.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.574+0000 7f685ea00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f683c073230 0x7f683c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.574+0000 7f685ea00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f683c073230 0x7f683c075740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6850001870 tx=0x7f68500016a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.578+0000 7f6857400640 1 -- 172.21.15.44:0/3988200987 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f684805e590 con 0x7f6860072e50 2024-09-17T05:37:05.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.818+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f68600b5fa0 con 0x7f6860072e50 2024-09-17T05:37:05.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6857400640 1 -- 172.21.15.44:0/3988200987 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f6848062fc0 con 0x7f6860072e50 2024-09-17T05:37:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f683c073230 msgr2=0x7f683c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f683c073230 0x7f683c075740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6850001870 tx=0x7f68500016a0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860072e50 msgr2=0x7f68600cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860072e50 0x7f68600cdbf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f684800c450 tx=0x7f684800c910 comp rx=0 tx=0).stop 2024-09-17T05:37:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 shutdown_connections 2024-09-17T05:37:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f683c073230 0x7f683c075740 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68600cc480 0x7f68600ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6860072e50 0x7f68600cdbf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 --2- 172.21.15.44:0/3988200987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f686006de50 0x7f68600b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 >> 172.21.15.44:0/3988200987 conn(0x7f68600ccaa0 msgr2=0x7f686006f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.822+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 shutdown_connections 2024-09-17T05:37:05.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:05.826+0000 7f6865a00640 1 -- 172.21.15.44:0/3988200987 wait complete. 2024-09-17T05:37:05.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T05:37:06.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.002+0000 7f7bdbe00640 1 -- 172.21.15.44:0/3474035467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 msgr2=0x7f7bdc0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.002+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/3474035467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0cca30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009900 tx=0x7f7bcc01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- 172.21.15.44:0/3474035467 shutdown_connections 2024-09-17T05:37:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/3474035467 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bdc0ce340 0x7f7bdc0ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/3474035467 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0cca30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- 172.21.15.44:0/3474035467 >> 172.21.15.44:0/3474035467 conn(0x7f7bdc073690 msgr2=0x7f7bdc073aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- 172.21.15.44:0/3474035467 shutdown_connections 2024-09-17T05:37:06.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- 172.21.15.44:0/3474035467 wait complete. 2024-09-17T05:37:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 Processor -- start 2024-09-17T05:37:06.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- start start 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bdc0ce340 0x7f7bdc14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bdc15bd30 0x7f7bdc15a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc15c140 con 0x7f7bdc0cff50 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc071040 con 0x7f7bdc15bd30 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.006+0000 7f7bdbe00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc15c2c0 con 0x7f7bdc0ce340 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42230/0 (socket says 172.21.15.44:42230) 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 -- 172.21.15.44:0/1213426105 learned_addr learned my addr 172.21.15.44:0/1213426105 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bdaa00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bdc0ce340 0x7f7bdc14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bdb400640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bdc15bd30 0x7f7bdc15a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 -- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bdc0ce340 msgr2=0x7f7bdc14d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bdc0ce340 0x7f7bdc14d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 -- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bdc15bd30 msgr2=0x7f7bdc15a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bdc15bd30 0x7f7bdc15a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 -- 172.21.15.44:0/1213426105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc1593c0 con 0x7f7bdc0cff50 2024-09-17T05:37:06.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bda000640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0aee90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800d6a0 tx=0x7f7bc800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bd3400640 1 -- 172.21.15.44:0/1213426105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8017070 con 0x7f7bdc0cff50 2024-09-17T05:37:06.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bd3400640 1 -- 172.21.15.44:0/1213426105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bc8005310 con 0x7f7bdc0cff50 2024-09-17T05:37:06.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bd3400640 1 -- 172.21.15.44:0/1213426105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8009820 con 0x7f7bdc0cff50 2024-09-17T05:37:06.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc1596a0 con 0x7f7bdc0cff50 2024-09-17T05:37:06.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc159c60 con 0x7f7bdc0cff50 2024-09-17T05:37:06.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc0ce750 con 0x7f7bdc0cff50 2024-09-17T05:37:06.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.010+0000 7f7bd3400640 1 -- 172.21.15.44:0/1213426105 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7bc80099c0 con 0x7f7bdc0cff50 2024-09-17T05:37:06.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.014+0000 7f7bd3400640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7bbc073200 0x7f7bbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.014+0000 7f7bd3400640 1 -- 172.21.15.44:0/1213426105 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f7bc8094110 con 0x7f7bdc0cff50 2024-09-17T05:37:06.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.014+0000 7f7bdaa00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7bbc073200 0x7f7bbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.014+0000 7f7bdaa00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7bbc073200 0x7f7bbc075710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0af000 tx=0x7f7bcc01b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.018+0000 7f7bd3400640 1 -- 172.21.15.44:0/1213426105 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7bc805ec90 con 0x7f7bdc0cff50 2024-09-17T05:37:06.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.254+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f7bdc0cd2e0 con 0x7f7bdc0cff50 2024-09-17T05:37:06.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.254+0000 7f7bd3400640 1 -- 172.21.15.44:0/1213426105 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f7bc80636c0 con 0x7f7bdc0cff50 2024-09-17T05:37:06.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7bbc073200 msgr2=0x7f7bbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7bbc073200 0x7f7bbc075710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0af000 tx=0x7f7bcc01b120 comp rx=0 tx=0).stop 2024-09-17T05:37:06.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 msgr2=0x7f7bdc0aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0aee90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800d6a0 tx=0x7f7bc800db60 comp rx=0 tx=0).stop 2024-09-17T05:37:06.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 shutdown_connections 2024-09-17T05:37:06.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7bbc073200 0x7f7bbc075710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7bdc15bd30 0x7f7bdc15a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bdc0cff50 0x7f7bdc0aee90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 --2- 172.21.15.44:0/1213426105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7bdc0ce340 0x7f7bdc14d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 >> 172.21.15.44:0/1213426105 conn(0x7f7bdc073690 msgr2=0x7f7bdc0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 shutdown_connections 2024-09-17T05:37:06.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.258+0000 7f7bdbe00640 1 -- 172.21.15.44:0/1213426105 wait complete. 2024-09-17T05:37:06.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T05:37:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 -- 172.21.15.44:0/2521634017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00d1d00 msgr2=0x7f3af00cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 --2- 172.21.15.44:0/2521634017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00d1d00 0x7f3af00cf070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3af0073b70 tx=0x7f3ad801c800 comp rx=0 tx=0).stop 2024-09-17T05:37:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 -- 172.21.15.44:0/2521634017 shutdown_connections 2024-09-17T05:37:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 --2- 172.21.15.44:0/2521634017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00d1d00 0x7f3af00cf070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 --2- 172.21.15.44:0/2521634017 >> v2:172.21.15.86:3300/0 conn(0x7f3af00d18f0 0x7f3af00b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 -- 172.21.15.44:0/2521634017 >> 172.21.15.44:0/2521634017 conn(0x7f3af00b4240 msgr2=0x7f3af00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 -- 172.21.15.44:0/2521634017 shutdown_connections 2024-09-17T05:37:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.438+0000 7f3af7200640 1 -- 172.21.15.44:0/2521634017 wait complete. 2024-09-17T05:37:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 Processor -- start 2024-09-17T05:37:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 -- start start 2024-09-17T05:37:06.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00cf5b0 0x7f3af00cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3af00d18f0 0x7f3af01fc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d1d00 0x7f3af01567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3af0169e80 con 0x7f3af00cf5b0 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3af0169d00 con 0x7f3af00d1d00 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3af016a000 con 0x7f3af00d18f0 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00cf5b0 0x7f3af00cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00cf5b0 0x7f3af00cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42248/0 (socket says 172.21.15.44:42248) 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 -- 172.21.15.44:0/3237675564 learned_addr learned my addr 172.21.15.44:0/3237675564 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af5200640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d1d00 0x7f3af01567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3ae7400640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3af00d18f0 0x7f3af01fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 -- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3af00d18f0 msgr2=0x7f3af01fc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3af00d18f0 0x7f3af01fc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 -- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d1d00 msgr2=0x7f3af01567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d1d00 0x7f3af01567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 -- 172.21.15.44:0/3237675564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af01fcfd0 con 0x7f3af00cf5b0 2024-09-17T05:37:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3ae7400640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3af00d18f0 0x7f3af01fc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aefe00640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00cf5b0 0x7f3af00cc0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000e7c0 tx=0x7f3ae000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aecc00640 1 -- 172.21.15.44:0/3237675564 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000ccc0 con 0x7f3af00cf5b0 2024-09-17T05:37:06.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aecc00640 1 -- 172.21.15.44:0/3237675564 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ae000ce80 con 0x7f3af00cf5b0 2024-09-17T05:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3aecc00640 1 -- 172.21.15.44:0/3237675564 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0005280 con 0x7f3af00cf5b0 2024-09-17T05:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af00b6330 con 0x7f3af00cf5b0 2024-09-17T05:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.442+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af00b68f0 con 0x7f3af00cf5b0 2024-09-17T05:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.446+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af00d13f0 con 0x7f3af00cf5b0 2024-09-17T05:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.446+0000 7f3aecc00640 1 -- 172.21.15.44:0/3237675564 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3ae0005420 con 0x7f3af00cf5b0 2024-09-17T05:37:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.446+0000 7f3aecc00640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3acc073230 0x7f3acc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.446+0000 7f3aecc00640 1 -- 172.21.15.44:0/3237675564 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f3ae0094b40 con 0x7f3af00cf5b0 2024-09-17T05:37:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.446+0000 7f3ae7400640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3acc073230 0x7f3acc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.450+0000 7f3ae7400640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3acc073230 0x7f3acc075740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80af000 tx=0x7f3ad801b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.450+0000 7f3aecc00640 1 -- 172.21.15.44:0/3237675564 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3ae005fc80 con 0x7f3af00cf5b0 2024-09-17T05:37:06.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.690+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3af015c4e0 con 0x7f3af00cf5b0 2024-09-17T05:37:06.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3aecc00640 1 -- 172.21.15.44:0/3237675564 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f3ae005f580 con 0x7f3af00cf5b0 2024-09-17T05:37:06.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3acc073230 msgr2=0x7f3acc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3acc073230 0x7f3acc075740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80af000 tx=0x7f3ad801b040 comp rx=0 tx=0).stop 2024-09-17T05:37:06.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00cf5b0 msgr2=0x7f3af00cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00cf5b0 0x7f3af00cc0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000e7c0 tx=0x7f3ae000ec80 comp rx=0 tx=0).stop 2024-09-17T05:37:06.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 shutdown_connections 2024-09-17T05:37:06.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3acc073230 0x7f3acc075740 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3af00d1d00 0x7f3af01567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3af00d18f0 0x7f3af01fc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 --2- 172.21.15.44:0/3237675564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3af00cf5b0 0x7f3af00cc0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 >> 172.21.15.44:0/3237675564 conn(0x7f3af00b4240 msgr2=0x7f3af0068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 shutdown_connections 2024-09-17T05:37:06.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.694+0000 7f3af7200640 1 -- 172.21.15.44:0/3237675564 wait complete. 2024-09-17T05:37:06.716 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:37:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.874+0000 7f3cca400640 1 -- 172.21.15.44:0/1052126478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 msgr2=0x7f3ca8004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.874+0000 7f3cca400640 1 --2- 172.21.15.44:0/1052126478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 0x7f3ca8004070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4001860 tx=0x7f3cb401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.874+0000 7f3cc3e00640 1 -- 172.21.15.44:0/1052126478 reap_dead start 2024-09-17T05:37:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.874+0000 7f3cca400640 1 -- 172.21.15.44:0/1052126478 shutdown_connections 2024-09-17T05:37:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.874+0000 7f3cca400640 1 -- 172.21.15.44:0/1052126478 >> 172.21.15.44:0/1052126478 conn(0x7f3cc40ccaa0 msgr2=0x7f3cc40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.874+0000 7f3cca400640 1 -- 172.21.15.44:0/1052126478 shutdown_connections 2024-09-17T05:37:06.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.874+0000 7f3cca400640 1 -- 172.21.15.44:0/1052126478 wait complete. 2024-09-17T05:37:06.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 Processor -- start 2024-09-17T05:37:06.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 -- start start 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 0x7f3cc415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3cc4165ea0 0x7f3cc41551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc40aefa0 0x7f3cc4155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4167f20 con 0x7f3ca8003c20 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc4167da0 con 0x7f3cc40aefa0 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc41680a0 con 0x7f3cc4165ea0 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 0x7f3cc415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 0x7f3cc415d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42270/0 (socket says 172.21.15.44:42270) 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 -- 172.21.15.44:0/1762313193 learned_addr learned my addr 172.21.15.44:0/1762313193 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cbbe00640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3cc4165ea0 0x7f3cc41551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3e00640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc40aefa0 0x7f3cc4155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 -- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3cc4165ea0 msgr2=0x7f3cc41551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3cc4165ea0 0x7f3cc41551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 -- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc40aefa0 msgr2=0x7f3cc4155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc40aefa0 0x7f3cc4155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 -- 172.21.15.44:0/1762313193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc40cfb40 con 0x7f3ca8003c20 2024-09-17T05:37:06.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cc3400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 0x7f3cc415d7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3cb401afe0 tx=0x7f3cb40a5cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cbb400640 1 -- 172.21.15.44:0/1762313193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4001480 con 0x7f3ca8003c20 2024-09-17T05:37:06.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cbb400640 1 -- 172.21.15.44:0/1762313193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb40b4030 con 0x7f3ca8003c20 2024-09-17T05:37:06.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc41602e0 con 0x7f3ca8003c20 2024-09-17T05:37:06.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cbb400640 1 -- 172.21.15.44:0/1762313193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40068d0 con 0x7f3ca8003c20 2024-09-17T05:37:06.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.878+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc4160580 con 0x7f3ca8003c20 2024-09-17T05:37:06.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.882+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc415e990 con 0x7f3ca8003c20 2024-09-17T05:37:06.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.882+0000 7f3cbb400640 1 -- 172.21.15.44:0/1762313193 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3cb4003b50 con 0x7f3ca8003c20 2024-09-17T05:37:06.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.882+0000 7f3cbb400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ca0073230 0x7f3ca0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.882+0000 7f3cbb400640 1 -- 172.21.15.44:0/1762313193 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f3cb412e1a0 con 0x7f3ca8003c20 2024-09-17T05:37:06.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.882+0000 7f3cbbe00640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ca0073230 0x7f3ca0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.886+0000 7f3cbbe00640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ca0073230 0x7f3ca0075740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40cfd50 tx=0x7f3cac0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:06.886+0000 7f3cbb400640 1 -- 172.21.15.44:0/1762313193 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3cb4016690 con 0x7f3ca8003c20 2024-09-17T05:37:07.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.062+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3cc40b5fa0 con 0x7f3ca8003c20 2024-09-17T05:37:07.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.062+0000 7f3cbb400640 1 -- 172.21.15.44:0/1762313193 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7f3cb40f9510 con 0x7f3ca8003c20 2024-09-17T05:37:07.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:07.064 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:37:07.064 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:07.065 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:37:07.065 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:37:07.065 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:07.065 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:37:07.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ca0073230 msgr2=0x7f3ca0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ca0073230 0x7f3ca0075740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40cfd50 tx=0x7f3cac0091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 msgr2=0x7f3cc415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 0x7f3cc415d7f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3cb401afe0 tx=0x7f3cb40a5cd0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 shutdown_connections 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ca0073230 0x7f3ca0075740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cc40aefa0 0x7f3cc4155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3cc4165ea0 0x7f3cc41551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 --2- 172.21.15.44:0/1762313193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ca8003c20 0x7f3cc415d7f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 >> 172.21.15.44:0/1762313193 conn(0x7f3cc40ccaa0 msgr2=0x7f3cc4155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 shutdown_connections 2024-09-17T05:37:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.066+0000 7f3cca400640 1 -- 172.21.15.44:0/1762313193 wait complete. 2024-09-17T05:37:07.087 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:37:07.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:37:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 -- 172.21.15.44:0/241015877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c164030 msgr2=0x7fca9c166450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 --2- 172.21.15.44:0/241015877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c164030 0x7fca9c166450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca94009c80 tx=0x7fca9401cda0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 -- 172.21.15.44:0/241015877 shutdown_connections 2024-09-17T05:37:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 --2- 172.21.15.44:0/241015877 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c164030 0x7fca9c166450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 --2- 172.21.15.44:0/241015877 >> v2:172.21.15.86:3300/0 conn(0x7fca9c0d05a0 0x7fca9c0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 -- 172.21.15.44:0/241015877 >> 172.21.15.44:0/241015877 conn(0x7fca9c0cec40 msgr2=0x7fca9c0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 -- 172.21.15.44:0/241015877 shutdown_connections 2024-09-17T05:37:07.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 -- 172.21.15.44:0/241015877 wait complete. 2024-09-17T05:37:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 Processor -- start 2024-09-17T05:37:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.250+0000 7fcaa4200640 1 -- start start 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c0b31d0 0x7fca9c06fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c0d05a0 0x7fca9c1f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9c164030 0x7fca9c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c169810 con 0x7fca9c164030 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c169690 con 0x7fca9c0b31d0 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fca9c169990 con 0x7fca9c0d05a0 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9c164030 0x7fca9c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9c164030 0x7fca9c15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42272/0 (socket says 172.21.15.44:42272) 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 -- 172.21.15.44:0/178337687 learned_addr learned my addr 172.21.15.44:0/178337687 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa0e00640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c0d05a0 0x7fca9c1f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa1800640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c0b31d0 0x7fca9c06fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 -- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c0d05a0 msgr2=0x7fca9c1f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c0d05a0 0x7fca9c1f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 -- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c0b31d0 msgr2=0x7fca9c06fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c0b31d0 0x7fca9c06fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 -- 172.21.15.44:0/178337687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c157be0 con 0x7fca9c164030 2024-09-17T05:37:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa2200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9c164030 0x7fca9c15b0d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fca9401c810 tx=0x7fca94003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fca99600640 1 -- 172.21.15.44:0/178337687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca940b2040 con 0x7fca9c164030 2024-09-17T05:37:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fca99600640 1 -- 172.21.15.44:0/178337687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca94004040 con 0x7fca9c164030 2024-09-17T05:37:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fca99600640 1 -- 172.21.15.44:0/178337687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca940043f0 con 0x7fca9c164030 2024-09-17T05:37:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c06e540 con 0x7fca9c164030 2024-09-17T05:37:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c06eb00 con 0x7fca9c164030 2024-09-17T05:37:07.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.254+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9c0c7040 con 0x7fca9c164030 2024-09-17T05:37:07.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.258+0000 7fca99600640 1 -- 172.21.15.44:0/178337687 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fca940bd030 con 0x7fca9c164030 2024-09-17T05:37:07.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.258+0000 7fca99600640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca7c073230 0x7fca7c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.258+0000 7fca99600640 1 -- 172.21.15.44:0/178337687 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fca9412df50 con 0x7fca9c164030 2024-09-17T05:37:07.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.258+0000 7fcaa1800640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca7c073230 0x7fca7c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.258+0000 7fcaa1800640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca7c073230 0x7fca7c075740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca90001780 tx=0x7fca90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.262+0000 7fca99600640 1 -- 172.21.15.44:0/178337687 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fca940c4020 con 0x7fca9c164030 2024-09-17T05:37:07.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:07.438+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fca9c071250 con 0x7fca9c164030 2024-09-17T05:37:08.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.258+0000 7fca99600640 1 -- 172.21.15.44:0/178337687 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7fca9c157be0 con 0x7fca9c164030 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:37:08.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca7c073230 msgr2=0x7fca7c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca7c073230 0x7fca7c075740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca90001780 tx=0x7fca90009040 comp rx=0 tx=0).stop 2024-09-17T05:37:08.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9c164030 msgr2=0x7fca9c15b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9c164030 0x7fca9c15b0d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fca9401c810 tx=0x7fca94003f40 comp rx=0 tx=0).stop 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 shutdown_connections 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca9c164030 0x7fca9c15b0d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca9c0d05a0 0x7fca9c1f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca7c073230 0x7fca7c075740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 --2- 172.21.15.44:0/178337687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c0b31d0 0x7fca9c06fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 >> 172.21.15.44:0/178337687 conn(0x7fca9c0cec40 msgr2=0x7fca9c072dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 shutdown_connections 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.262+0000 7fcaa4200640 1 -- 172.21.15.44:0/178337687 wait complete. 2024-09-17T05:37:08.293 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 -- 172.21.15.44:0/3884466505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc06de50 msgr2=0x7f50bc06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 --2- 172.21.15.44:0/3884466505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc06de50 0x7f50bc06e260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009840 tx=0x7f50a401c790 comp rx=0 tx=0).stop 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 -- 172.21.15.44:0/3884466505 shutdown_connections 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 --2- 172.21.15.44:0/3884466505 >> v2:172.21.15.86:3300/0 conn(0x7f50bc0cb470 0x7f50bc0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 --2- 172.21.15.44:0/3884466505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc06de50 0x7f50bc06e260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 -- 172.21.15.44:0/3884466505 >> 172.21.15.44:0/3884466505 conn(0x7f50bc0ccaa0 msgr2=0x7f50bc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 -- 172.21.15.44:0/3884466505 shutdown_connections 2024-09-17T05:37:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 -- 172.21.15.44:0/3884466505 wait complete. 2024-09-17T05:37:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 Processor -- start 2024-09-17T05:37:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.462+0000 7f50c1200640 1 -- start start 2024-09-17T05:37:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc06de50 0x7f50bc0cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc072e50 0x7f50bc09f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50bc0cb470 0x7f50bc09f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc168f20 con 0x7f50bc0cb470 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc168da0 con 0x7f50bc06de50 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f50bc1690a0 con 0x7f50bc072e50 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50bc0cb470 0x7f50bc09f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50bc0cb470 0x7f50bc09f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42274/0 (socket says 172.21.15.44:42274) 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 -- 172.21.15.44:0/2097349563 learned_addr learned my addr 172.21.15.44:0/2097349563 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50b9e00640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc06de50 0x7f50bc0cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50b3e00640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc072e50 0x7f50bc09f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 -- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc072e50 msgr2=0x7f50bc09f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc072e50 0x7f50bc09f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 -- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc06de50 msgr2=0x7f50bc0cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc06de50 0x7f50bc0cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 -- 172.21.15.44:0/2097349563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc0cad80 con 0x7f50bc0cb470 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50ba800640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50bc0cb470 0x7f50bc09f950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50b400efc0 tx=0x7f50b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50b2000640 1 -- 172.21.15.44:0/2097349563 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b401b070 con 0x7f50bc0cb470 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc157fc0 con 0x7f50bc0cb470 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50b2000640 1 -- 172.21.15.44:0/2097349563 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b400b630 con 0x7f50bc0cb470 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50b2000640 1 -- 172.21.15.44:0/2097349563 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b400ba80 con 0x7f50bc0cb470 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc153d20 con 0x7f50bc0cb470 2024-09-17T05:37:08.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.466+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50bc158230 con 0x7f50bc0cb470 2024-09-17T05:37:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.470+0000 7f50b2000640 1 -- 172.21.15.44:0/2097349563 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f50b401e070 con 0x7f50bc0cb470 2024-09-17T05:37:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.470+0000 7f50b2000640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5098073230 0x7f5098075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.470+0000 7f50b2000640 1 -- 172.21.15.44:0/2097349563 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7f50b4094c10 con 0x7f50bc0cb470 2024-09-17T05:37:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.470+0000 7f50b9e00640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5098073230 0x7f5098075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.470+0000 7f50b9e00640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5098073230 0x7f5098075740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50ac007fd0 tx=0x7f50ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.474+0000 7f50b2000640 1 -- 172.21.15.44:0/2097349563 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f50b405f590 con 0x7f50bc0cb470 2024-09-17T05:37:08.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:08.650+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f50bc06e260 con 0x7f50bc0cb470 2024-09-17T05:37:09.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.266+0000 7f50b2000640 1 -- 172.21.15.44:0/2097349563 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7f50b4063fc0 con 0x7f50bc0cb470 2024-09-17T05:37:09.268 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:37:09.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5098073230 msgr2=0x7f5098075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5098073230 0x7f5098075740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50ac007fd0 tx=0x7f50ac009040 comp rx=0 tx=0).stop 2024-09-17T05:37:09.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50bc0cb470 msgr2=0x7f50bc09f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50bc0cb470 0x7f50bc09f950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50b400efc0 tx=0x7f50b400c800 comp rx=0 tx=0).stop 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 shutdown_connections 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50bc0cb470 0x7f50bc09f950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50bc072e50 0x7f50bc09f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5098073230 0x7f5098075740 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 --2- 172.21.15.44:0/2097349563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc06de50 0x7f50bc0cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 >> 172.21.15.44:0/2097349563 conn(0x7f50bc0ccaa0 msgr2=0x7f50bc0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 shutdown_connections 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.270+0000 7f50c1200640 1 -- 172.21.15.44:0/2097349563 wait complete. 2024-09-17T05:37:09.311 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:37:09.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 -- 172.21.15.44:0/972145273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb40cb470 msgr2=0x7fcbb40cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/972145273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb40cb470 0x7fcbb40cb880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40cb0b0 tx=0x7fcbac01ccf0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 -- 172.21.15.44:0/972145273 shutdown_connections 2024-09-17T05:37:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/972145273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb40cb470 0x7fcbb40cb880 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/972145273 >> v2:172.21.15.86:3300/0 conn(0x7fcbb406de50 0x7fcbb406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 -- 172.21.15.44:0/972145273 >> 172.21.15.44:0/972145273 conn(0x7fcbb40ccaa0 msgr2=0x7fcbb40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 -- 172.21.15.44:0/972145273 shutdown_connections 2024-09-17T05:37:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 -- 172.21.15.44:0/972145273 wait complete. 2024-09-17T05:37:09.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 Processor -- start 2024-09-17T05:37:09.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.474+0000 7fcbb8a00640 1 -- start start 2024-09-17T05:37:09.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbb406de50 0x7fcbb41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb4072e50 0x7fcbb4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbb40cb470 0x7fcbb4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb4168e30 con 0x7fcbb4072e50 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb4168cb0 con 0x7fcbb40cb470 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb4168fb0 con 0x7fcbb406de50 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb4072e50 0x7fcbb4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb4072e50 0x7fcbb4157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51778/0 (socket says 172.21.15.44:51778) 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 -- 172.21.15.44:0/846053991 learned_addr learned my addr 172.21.15.44:0/846053991 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb1e00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbb406de50 0x7fcbb41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb2800640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbb40cb470 0x7fcbb4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 -- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbb406de50 msgr2=0x7fcbb41536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbb406de50 0x7fcbb41536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 -- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbb40cb470 msgr2=0x7fcbb4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbb40cb470 0x7fcbb4157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 -- 172.21.15.44:0/846053991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb4156460 con 0x7fcbb4072e50 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbabe00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb4072e50 0x7fcbb4157850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00d750 tx=0x7fcb9c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbaa000640 1 -- 172.21.15.44:0/846053991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c017070 con 0x7fcbb4072e50 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbaa000640 1 -- 172.21.15.44:0/846053991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb9c009d20 con 0x7fcbb4072e50 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb4165200 con 0x7fcbb4072e50 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbaa000640 1 -- 172.21.15.44:0/846053991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c005280 con 0x7fcbb4072e50 2024-09-17T05:37:09.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb41657c0 con 0x7fcbb4072e50 2024-09-17T05:37:09.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.478+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb4155fa0 con 0x7fcbb4072e50 2024-09-17T05:37:09.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.482+0000 7fcbaa000640 1 -- 172.21.15.44:0/846053991 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcb9c005420 con 0x7fcbb4072e50 2024-09-17T05:37:09.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.482+0000 7fcbaa000640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb90073200 0x7fcb90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.482+0000 7fcbaa000640 1 -- 172.21.15.44:0/846053991 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7fcb9c094840 con 0x7fcbb4072e50 2024-09-17T05:37:09.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.482+0000 7fcbb1e00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb90073200 0x7fcb90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.482+0000 7fcbb1e00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb90073200 0x7fcb90075710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcba4007fd0 tx=0x7fcba4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:09.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.486+0000 7fcbaa000640 1 -- 172.21.15.44:0/846053991 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcb9c00de60 con 0x7fcbb4072e50 2024-09-17T05:37:09.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:09.698+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcbb406e260 con 0x7fcbb4072e50 2024-09-17T05:37:10.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.270+0000 7fcbaa000640 1 -- 172.21.15.44:0/846053991 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fcb9c05f150 con 0x7fcbb4072e50 2024-09-17T05:37:10.270 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 5 and data pool 6 2024-09-17T05:37:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.274+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb90073200 msgr2=0x7fcb90075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.274+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb90073200 0x7fcb90075710 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcba4007fd0 tx=0x7fcba4009040 comp rx=0 tx=0).stop 2024-09-17T05:37:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.274+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb4072e50 msgr2=0x7fcbb4157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.274+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb4072e50 0x7fcbb4157850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00d750 tx=0x7fcb9c00dc10 comp rx=0 tx=0).stop 2024-09-17T05:37:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 shutdown_connections 2024-09-17T05:37:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb90073200 0x7fcb90075710 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbb40cb470 0x7fcbb4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbb4072e50 0x7fcbb4157850 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 --2- 172.21.15.44:0/846053991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbb406de50 0x7fcbb41536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 >> 172.21.15.44:0/846053991 conn(0x7fcbb40ccaa0 msgr2=0x7fcbb415f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:10.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 shutdown_connections 2024-09-17T05:37:10.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.278+0000 7fcbb8a00640 1 -- 172.21.15.44:0/846053991 wait complete. 2024-09-17T05:37:10.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:10.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 -- 172.21.15.44:0/3924185330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cb040 msgr2=0x7f55580cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 --2- 172.21.15.44:0/3924185330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cb040 0x7f55580cf190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5550009bc0 tx=0x7f555001cba0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 -- 172.21.15.44:0/3924185330 shutdown_connections 2024-09-17T05:37:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 --2- 172.21.15.44:0/3924185330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cb040 0x7f55580cf190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 --2- 172.21.15.44:0/3924185330 >> v2:172.21.15.86:3300/0 conn(0x7f55580cac30 0x7f55580cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 -- 172.21.15.44:0/3924185330 >> 172.21.15.44:0/3924185330 conn(0x7f55580ccaa0 msgr2=0x7f55580cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 -- 172.21.15.44:0/3924185330 shutdown_connections 2024-09-17T05:37:10.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 -- 172.21.15.44:0/3924185330 wait complete. 2024-09-17T05:37:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 Processor -- start 2024-09-17T05:37:10.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.498+0000 7f555d400640 1 -- start start 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cac30 0x7f5558164120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55580cb040 0x7f5558164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f555815be30 0x7f5558164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5558168cd0 con 0x7f555815be30 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5558168b50 con 0x7f55580cb040 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5558168e50 con 0x7f55580cac30 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f555815be30 0x7f5558164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f555815be30 0x7f5558164fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51780/0 (socket says 172.21.15.44:51780) 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 -- 172.21.15.44:0/2922417775 learned_addr learned my addr 172.21.15.44:0/2922417775 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:10.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f554fe00640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55580cb040 0x7f5558164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5556800640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cac30 0x7f5558164120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 -- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cac30 msgr2=0x7f5558164120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cac30 0x7f5558164120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 -- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55580cb040 msgr2=0x7f5558164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55580cb040 0x7f5558164a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 -- 172.21.15.44:0/2922417775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555806ede0 con 0x7f555815be30 2024-09-17T05:37:10.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f554fe00640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55580cb040 0x7f5558164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f5557200640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f555815be30 0x7f5558164fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f555001c610 tx=0x7f5550003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f554ea00640 1 -- 172.21.15.44:0/2922417775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500b2040 con 0x7f555815be30 2024-09-17T05:37:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f554ea00640 1 -- 172.21.15.44:0/2922417775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55500bb070 con 0x7f555815be30 2024-09-17T05:37:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f554ea00640 1 -- 172.21.15.44:0/2922417775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550004370 con 0x7f555815be30 2024-09-17T05:37:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555806f0c0 con 0x7f555815be30 2024-09-17T05:37:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555815b9e0 con 0x7f555815be30 2024-09-17T05:37:10.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.502+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555806de50 con 0x7f555815be30 2024-09-17T05:37:10.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.506+0000 7f554ea00640 1 -- 172.21.15.44:0/2922417775 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f55500a5d10 con 0x7f555815be30 2024-09-17T05:37:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.506+0000 7f554ea00640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5534073230 0x7f5534075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.506+0000 7f554ea00640 1 -- 172.21.15.44:0/2922417775 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f555012e8f0 con 0x7f555815be30 2024-09-17T05:37:10.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.506+0000 7f5556800640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5534073230 0x7f5534075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.506+0000 7f5556800640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5534073230 0x7f5534075740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5548001640 tx=0x7f5548009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:10.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.510+0000 7f554ea00640 1 -- 172.21.15.44:0/2922417775 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f5550016790 con 0x7f555815be30 2024-09-17T05:37:10.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.686+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55580b5fa0 con 0x7f555815be30 2024-09-17T05:37:10.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.686+0000 7f554ea00640 1 -- 172.21.15.44:0/2922417775 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16967 (secure 0 0 0) 0x7f55500f9800 con 0x7f555815be30 2024-09-17T05:37:10.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:10.687 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:09.701504+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:07.452522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:08.662975+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:10.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5534073230 msgr2=0x7f5534075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5534073230 0x7f5534075740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5548001640 tx=0x7f5548009040 comp rx=0 tx=0).stop 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f555815be30 msgr2=0x7f5558164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f555815be30 0x7f5558164fb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f555001c610 tx=0x7f5550003f40 comp rx=0 tx=0).stop 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 shutdown_connections 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f555815be30 0x7f5558164fb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5534073230 0x7f5534075740 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55580cb040 0x7f5558164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 --2- 172.21.15.44:0/2922417775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f55580cac30 0x7f5558164120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 >> 172.21.15.44:0/2922417775 conn(0x7f55580ccaa0 msgr2=0x7f55580cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 shutdown_connections 2024-09-17T05:37:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.690+0000 7f555d400640 1 -- 172.21.15.44:0/2922417775 wait complete. 2024-09-17T05:37:10.710 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 -- 172.21.15.44:0/1883298647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c072e50 msgr2=0x7f485c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 --2- 172.21.15.44:0/1883298647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c072e50 0x7f485c15e990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f484c009840 tx=0x7f484c01c790 comp rx=0 tx=0).stop 2024-09-17T05:37:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 -- 172.21.15.44:0/1883298647 shutdown_connections 2024-09-17T05:37:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 --2- 172.21.15.44:0/1883298647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f485c0cb470 0x7f485c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 --2- 172.21.15.44:0/1883298647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c072e50 0x7f485c15e990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 -- 172.21.15.44:0/1883298647 >> 172.21.15.44:0/1883298647 conn(0x7f485c0ccaa0 msgr2=0x7f485c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:10.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 -- 172.21.15.44:0/1883298647 shutdown_connections 2024-09-17T05:37:10.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.866+0000 7f4861600640 1 -- 172.21.15.44:0/1883298647 wait complete. 2024-09-17T05:37:10.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 Processor -- start 2024-09-17T05:37:10.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 -- start start 2024-09-17T05:37:10.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f485c06de50 0x7f485c1fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f485c072e50 0x7f485c070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c0cb470 0x7f485c0706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f485c168f70 con 0x7f485c0cb470 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f485c168df0 con 0x7f485c072e50 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f4861600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f485c1690f0 con 0x7f485c06de50 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f485b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c0cb470 0x7f485c0706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f485b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c0cb470 0x7f485c0706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51796/0 (socket says 172.21.15.44:51796) 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.870+0000 7f485b400640 1 -- 172.21.15.44:0/3006159132 learned_addr learned my addr 172.21.15.44:0/3006159132 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f485aa00640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f485c06de50 0x7f485c1fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4853e00640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f485c072e50 0x7f485c070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f485b400640 1 -- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f485c06de50 msgr2=0x7f485c1fbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f485b400640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f485c06de50 0x7f485c1fbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f485b400640 1 -- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f485c072e50 msgr2=0x7f485c070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f485b400640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f485c072e50 0x7f485c070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f485b400640 1 -- 172.21.15.44:0/3006159132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c09d4f0 con 0x7f485c0cb470 2024-09-17T05:37:10.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f485b400640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c0cb470 0x7f485c0706d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f485400d9d0 tx=0x7f485400de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:10.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4852a00640 1 -- 172.21.15.44:0/3006159132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854017070 con 0x7f485c0cb470 2024-09-17T05:37:10.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4852a00640 1 -- 172.21.15.44:0/3006159132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4854010460 con 0x7f485c0cb470 2024-09-17T05:37:10.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c09abe0 con 0x7f485c0cb470 2024-09-17T05:37:10.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4852a00640 1 -- 172.21.15.44:0/3006159132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485400be60 con 0x7f485c0cb470 2024-09-17T05:37:10.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c09ae80 con 0x7f485c0cb470 2024-09-17T05:37:10.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f485c0cb880 con 0x7f485c0cb470 2024-09-17T05:37:10.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.874+0000 7f4852a00640 1 -- 172.21.15.44:0/3006159132 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f48540108b0 con 0x7f485c0cb470 2024-09-17T05:37:10.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.878+0000 7f4852a00640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4838073200 0x7f4838075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.878+0000 7f4852a00640 1 -- 172.21.15.44:0/3006159132 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4854094ad0 con 0x7f485c0cb470 2024-09-17T05:37:10.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.878+0000 7f485aa00640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4838073200 0x7f4838075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.878+0000 7f485aa00640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4838073200 0x7f4838075710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f484c0af000 tx=0x7f484c01afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:10.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:10.882+0000 7f4852a00640 1 -- 172.21.15.44:0/3006159132 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f485405f270 con 0x7f485c0cb470 2024-09-17T05:37:11.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f485c09d6c0 con 0x7f485c0cb470 2024-09-17T05:37:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4852a00640 1 -- 172.21.15.44:0/3006159132 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16967 (secure 0 0 0) 0x7f4854063ca0 con 0x7f485c0cb470 2024-09-17T05:37:11.063 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:11.063 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:09.701504+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:07.452522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:08.662975+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4838073200 msgr2=0x7f4838075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4838073200 0x7f4838075710 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f484c0af000 tx=0x7f484c01afd0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c0cb470 msgr2=0x7f485c0706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c0cb470 0x7f485c0706d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f485400d9d0 tx=0x7f485400de90 comp rx=0 tx=0).stop 2024-09-17T05:37:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 shutdown_connections 2024-09-17T05:37:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f485c0cb470 0x7f485c0706d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4838073200 0x7f4838075710 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f485c072e50 0x7f485c070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 --2- 172.21.15.44:0/3006159132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f485c06de50 0x7f485c1fbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 >> 172.21.15.44:0/3006159132 conn(0x7f485c0ccaa0 msgr2=0x7f485c155220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:11.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.062+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 shutdown_connections 2024-09-17T05:37:11.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.066+0000 7f4861600640 1 -- 172.21.15.44:0/3006159132 wait complete. 2024-09-17T05:37:11.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:37:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 -- 172.21.15.44:0/583313152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c0cb470 msgr2=0x7ff48c0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 --2- 172.21.15.44:0/583313152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c0cb470 0x7ff48c0cb880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff48c06ace0 tx=0x7ff48401ccf0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 -- 172.21.15.44:0/583313152 shutdown_connections 2024-09-17T05:37:11.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 --2- 172.21.15.44:0/583313152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c0cb470 0x7ff48c0cb880 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 --2- 172.21.15.44:0/583313152 >> v2:172.21.15.86:3300/0 conn(0x7ff48c072e50 0x7ff48c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 -- 172.21.15.44:0/583313152 >> 172.21.15.44:0/583313152 conn(0x7ff48c0ccaa0 msgr2=0x7ff48c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:11.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 -- 172.21.15.44:0/583313152 shutdown_connections 2024-09-17T05:37:11.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 -- 172.21.15.44:0/583313152 wait complete. 2024-09-17T05:37:11.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 Processor -- start 2024-09-17T05:37:11.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.246+0000 7ff491800640 1 -- start start 2024-09-17T05:37:11.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff48c06de50 0x7ff48c0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c072e50 0x7ff48c1f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb470 0x7ff48c15c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c168f20 con 0x7ff48c072e50 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c168da0 con 0x7ff48c0cb470 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c1690a0 con 0x7ff48c06de50 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c072e50 0x7ff48c1f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c072e50 0x7ff48c1f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51808/0 (socket says 172.21.15.44:51808) 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 -- 172.21.15.44:0/3439210466 learned_addr learned my addr 172.21.15.44:0/3439210466 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff48aa00640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff48c06de50 0x7ff48c0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff48b400640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb470 0x7ff48c15c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 -- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff48c06de50 msgr2=0x7ff48c0c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff48c06de50 0x7ff48c0c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 -- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb470 msgr2=0x7ff48c15c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb470 0x7ff48c15c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 -- 172.21.15.44:0/3439210466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c1f8f90 con 0x7ff48c072e50 2024-09-17T05:37:11.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff482000640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c072e50 0x7ff48c1f8a50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff47400c3c0 tx=0x7ff47400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:11.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff483400640 1 -- 172.21.15.44:0/3439210466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474017070 con 0x7ff48c072e50 2024-09-17T05:37:11.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff483400640 1 -- 172.21.15.44:0/3439210466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4740053c0 con 0x7ff48c072e50 2024-09-17T05:37:11.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c156370 con 0x7ff48c072e50 2024-09-17T05:37:11.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff483400640 1 -- 172.21.15.44:0/3439210466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474003860 con 0x7ff48c072e50 2024-09-17T05:37:11.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c0c85d0 con 0x7ff48c072e50 2024-09-17T05:37:11.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.250+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c15e990 con 0x7ff48c072e50 2024-09-17T05:37:11.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.254+0000 7ff483400640 1 -- 172.21.15.44:0/3439210466 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff47401a070 con 0x7ff48c072e50 2024-09-17T05:37:11.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.254+0000 7ff483400640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff468073230 0x7ff468075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.254+0000 7ff483400640 1 -- 172.21.15.44:0/3439210466 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff474093670 con 0x7ff48c072e50 2024-09-17T05:37:11.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.254+0000 7ff48aa00640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff468073230 0x7ff468075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.254+0000 7ff48aa00640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff468073230 0x7ff468075740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00bb50 tx=0x7ff47c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.258+0000 7ff483400640 1 -- 172.21.15.44:0/3439210466 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff48c1f8f90 con 0x7ff48c072e50 2024-09-17T05:37:11.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:11.474+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff48c0b5fa0 con 0x7ff48c072e50 2024-09-17T05:37:11.738 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:11.741 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:12.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.298+0000 7ff483400640 1 -- 172.21.15.44:0/3439210466 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7ff47405df30 con 0x7ff48c072e50 2024-09-17T05:37:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff468073230 msgr2=0x7ff468075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff468073230 0x7ff468075740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00bb50 tx=0x7ff47c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c072e50 msgr2=0x7ff48c1f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c072e50 0x7ff48c1f8a50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff47400c3c0 tx=0x7ff47400c880 comp rx=0 tx=0).stop 2024-09-17T05:37:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 shutdown_connections 2024-09-17T05:37:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff468073230 0x7ff468075740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff48c0cb470 0x7ff48c15c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c072e50 0x7ff48c1f8a50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 --2- 172.21.15.44:0/3439210466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff48c06de50 0x7ff48c0c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 >> 172.21.15.44:0/3439210466 conn(0x7ff48c0ccaa0 msgr2=0x7ff48c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 shutdown_connections 2024-09-17T05:37:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.302+0000 7ff491800640 1 -- 172.21.15.44:0/3439210466 wait complete. 2024-09-17T05:37:12.324 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:37:12.324 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:37:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 -- 172.21.15.44:0/3419391369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640b5880 msgr2=0x7f476406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 --2- 172.21.15.44:0/3419391369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640b5880 0x7f476406de50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4764072340 tx=0x7f475801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 -- 172.21.15.44:0/3419391369 shutdown_connections 2024-09-17T05:37:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 --2- 172.21.15.44:0/3419391369 >> v2:172.21.15.86:3300/0 conn(0x7f476406e390 0x7f47640cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 --2- 172.21.15.44:0/3419391369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640b5880 0x7f476406de50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 -- 172.21.15.44:0/3419391369 >> 172.21.15.44:0/3419391369 conn(0x7f47640ccaa0 msgr2=0x7f47640cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 -- 172.21.15.44:0/3419391369 shutdown_connections 2024-09-17T05:37:12.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 -- 172.21.15.44:0/3419391369 wait complete. 2024-09-17T05:37:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 Processor -- start 2024-09-17T05:37:12.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.490+0000 7f476c400640 1 -- start start 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f476406e390 0x7f47640a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47640b5880 0x7f47640b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640ce130 0x7f47640b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f476416a2c0 con 0x7f47640ce130 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f476416a140 con 0x7f47640b5880 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f476416a440 con 0x7f476406e390 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640ce130 0x7f47640b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640ce130 0x7f47640b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51822/0 (socket says 172.21.15.44:51822) 2024-09-17T05:37:12.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 -- 172.21.15.44:0/1610786513 learned_addr learned my addr 172.21.15.44:0/1610786513 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f4769000640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47640b5880 0x7f47640b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f4769a00640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f476406e390 0x7f47640a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 -- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f476406e390 msgr2=0x7f47640a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f476406e390 0x7f47640a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 -- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47640b5880 msgr2=0x7f47640b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47640b5880 0x7f47640b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 -- 172.21.15.44:0/1610786513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4764146560 con 0x7f47640ce130 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476a400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640ce130 0x7f47640b33b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c790 tx=0x7f475c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f4761600640 1 -- 172.21.15.44:0/1610786513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c003b80 con 0x7f47640ce130 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f4761600640 1 -- 172.21.15.44:0/1610786513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f475c003d20 con 0x7f47640ce130 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47641467d0 con 0x7f47640ce130 2024-09-17T05:37:12.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f4761600640 1 -- 172.21.15.44:0/1610786513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c00aab0 con 0x7f47640ce130 2024-09-17T05:37:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4764146d90 con 0x7f47640ce130 2024-09-17T05:37:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.494+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47640af680 con 0x7f47640ce130 2024-09-17T05:37:12.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.498+0000 7f4761600640 1 -- 172.21.15.44:0/1610786513 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f475c00ac50 con 0x7f47640ce130 2024-09-17T05:37:12.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.498+0000 7f4761600640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4744073230 0x7f4744075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:12.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.498+0000 7f4761600640 1 -- 172.21.15.44:0/1610786513 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f475c094130 con 0x7f47640ce130 2024-09-17T05:37:12.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.498+0000 7f4769a00640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4744073230 0x7f4744075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:12.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.498+0000 7f4769a00640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4744073230 0x7f4744075740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47580af000 tx=0x7f475801b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:12.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.502+0000 7f4761600640 1 -- 172.21.15.44:0/1610786513 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f47640af680 con 0x7f47640ce130 2024-09-17T05:37:12.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:12.710+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f47640cdbf0 con 0x7f47640ce130 2024-09-17T05:37:13.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.306+0000 7f4761600640 1 -- 172.21.15.44:0/1610786513 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f476406e7a0 con 0x7f47640ce130 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4744073230 msgr2=0x7f4744075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4744073230 0x7f4744075740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47580af000 tx=0x7f475801b100 comp rx=0 tx=0).stop 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640ce130 msgr2=0x7f47640b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640ce130 0x7f47640b33b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c790 tx=0x7f475c00cc50 comp rx=0 tx=0).stop 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 shutdown_connections 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47640ce130 0x7f47640b33b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4744073230 0x7f4744075740 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47640b5880 0x7f47640b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 --2- 172.21.15.44:0/1610786513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f476406e390 0x7f47640a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 >> 172.21.15.44:0/1610786513 conn(0x7f47640ccaa0 msgr2=0x7f476415f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 shutdown_connections 2024-09-17T05:37:13.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.310+0000 7f476c400640 1 -- 172.21.15.44:0/1610786513 wait complete. 2024-09-17T05:37:13.335 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:37:13.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:13.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 -- 172.21.15.44:0/2787211409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec072e50 msgr2=0x7f35ec15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 --2- 172.21.15.44:0/2787211409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec072e50 0x7f35ec15e990 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009900 tx=0x7f35e001c850 comp rx=0 tx=0).stop 2024-09-17T05:37:13.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 -- 172.21.15.44:0/2787211409 shutdown_connections 2024-09-17T05:37:13.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 --2- 172.21.15.44:0/2787211409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec0cb470 0x7f35ec0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 --2- 172.21.15.44:0/2787211409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec072e50 0x7f35ec15e990 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 -- 172.21.15.44:0/2787211409 >> 172.21.15.44:0/2787211409 conn(0x7f35ec0ccaa0 msgr2=0x7f35ec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:13.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 -- 172.21.15.44:0/2787211409 shutdown_connections 2024-09-17T05:37:13.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.498+0000 7f35f3600640 1 -- 172.21.15.44:0/2787211409 wait complete. 2024-09-17T05:37:13.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 Processor -- start 2024-09-17T05:37:13.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 -- start start 2024-09-17T05:37:13.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec06de50 0x7f35ec0b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec072e50 0x7f35ec154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0cb470 0x7f35ec1fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec168f70 con 0x7f35ec06de50 2024-09-17T05:37:13.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec168df0 con 0x7f35ec0cb470 2024-09-17T05:37:13.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f35ec1690f0 con 0x7f35ec072e50 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec06de50 0x7f35ec0b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec06de50 0x7f35ec0b5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51834/0 (socket says 172.21.15.44:51834) 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 -- 172.21.15.44:0/3127383817 learned_addr learned my addr 172.21.15.44:0/3127383817 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35ebe00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec072e50 0x7f35ec154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 -- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec072e50 msgr2=0x7f35ec154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f1600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0cb470 0x7f35ec1fcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec072e50 0x7f35ec154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 -- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0cb470 msgr2=0x7f35ec1fcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0cb470 0x7f35ec1fcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 -- 172.21.15.44:0/3127383817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec1fda00 con 0x7f35ec06de50 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35ebe00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec072e50 0x7f35ec154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f1600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0cb470 0x7f35ec1fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f0c00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec06de50 0x7f35ec0b5830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f35e00b0040 tx=0x7f35e00a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:13.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35e8c00640 1 -- 172.21.15.44:0/3127383817 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e00b2040 con 0x7f35ec06de50 2024-09-17T05:37:13.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35e8c00640 1 -- 172.21.15.44:0/3127383817 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35e00043b0 con 0x7f35ec06de50 2024-09-17T05:37:13.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35e8c00640 1 -- 172.21.15.44:0/3127383817 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0005270 con 0x7f35ec06de50 2024-09-17T05:37:13.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec1554c0 con 0x7f35ec06de50 2024-09-17T05:37:13.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.502+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec09d460 con 0x7f35ec06de50 2024-09-17T05:37:13.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.506+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ec15e990 con 0x7f35ec06de50 2024-09-17T05:37:13.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.506+0000 7f35e8c00640 1 -- 172.21.15.44:0/3127383817 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f35e00be060 con 0x7f35ec06de50 2024-09-17T05:37:13.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.506+0000 7f35e8c00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f35cc073230 0x7f35cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.506+0000 7f35e8c00640 1 -- 172.21.15.44:0/3127383817 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f35e012d6f0 con 0x7f35ec06de50 2024-09-17T05:37:13.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.506+0000 7f35ebe00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f35cc073230 0x7f35cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.506+0000 7f35ebe00640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f35cc073230 0x7f35cc075740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35ec156b30 tx=0x7f35d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:13.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.510+0000 7f35e8c00640 1 -- 172.21.15.44:0/3127383817 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f35e00164d0 con 0x7f35ec06de50 2024-09-17T05:37:13.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.718+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35ec0b5fa0 con 0x7f35ec06de50 2024-09-17T05:37:13.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.718+0000 7f35e8c00640 1 -- 172.21.15.44:0/3127383817 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7f35e00f86f0 con 0x7f35ec06de50 2024-09-17T05:37:13.719 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:13.720 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:13.720 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:13.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f35cc073230 msgr2=0x7f35cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f35cc073230 0x7f35cc075740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35ec156b30 tx=0x7f35d8009040 comp rx=0 tx=0).stop 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec06de50 msgr2=0x7f35ec0b5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec06de50 0x7f35ec0b5830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f35e00b0040 tx=0x7f35e00a5620 comp rx=0 tx=0).stop 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 shutdown_connections 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f35cc073230 0x7f35cc075740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35ec0cb470 0x7f35ec1fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f35ec072e50 0x7f35ec154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 --2- 172.21.15.44:0/3127383817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35ec06de50 0x7f35ec0b5830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 >> 172.21.15.44:0/3127383817 conn(0x7f35ec0ccaa0 msgr2=0x7f35ec156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 shutdown_connections 2024-09-17T05:37:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.722+0000 7f35f3600640 1 -- 172.21.15.44:0/3127383817 wait complete. 2024-09-17T05:37:13.742 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:13.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 -- 172.21.15.44:0/3673388531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca006e560 msgr2=0x7faca00700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 --2- 172.21.15.44:0/3673388531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca006e560 0x7faca00700d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7faca009e100 tx=0x7fac8801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 -- 172.21.15.44:0/3673388531 shutdown_connections 2024-09-17T05:37:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 --2- 172.21.15.44:0/3673388531 >> v2:172.21.15.86:3300/0 conn(0x7faca0070610 0x7faca0070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 --2- 172.21.15.44:0/3673388531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca006e560 0x7faca00700d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 -- 172.21.15.44:0/3673388531 >> 172.21.15.44:0/3673388531 conn(0x7faca00ccaa0 msgr2=0x7faca00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 -- 172.21.15.44:0/3673388531 shutdown_connections 2024-09-17T05:37:13.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.898+0000 7faca4e00640 1 -- 172.21.15.44:0/3673388531 wait complete. 2024-09-17T05:37:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 Processor -- start 2024-09-17T05:37:13.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 -- start start 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faca0070610 0x7faca00c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca00b5880 0x7faca0159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca00735f0 0x7faca015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faca0169ee0 con 0x7faca00735f0 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faca0169d60 con 0x7faca00b5880 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7faca4e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faca016a060 con 0x7faca0070610 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca00735f0 0x7faca015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca00735f0 0x7faca015a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51858/0 (socket says 172.21.15.44:51858) 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 -- 172.21.15.44:0/434084309 learned_addr learned my addr 172.21.15.44:0/434084309 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac95400640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca00b5880 0x7faca0159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9de00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faca0070610 0x7faca00c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 -- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faca0070610 msgr2=0x7faca00c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faca0070610 0x7faca00c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 -- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca00b5880 msgr2=0x7faca0159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca00b5880 0x7faca0159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9e800640 1 -- 172.21.15.44:0/434084309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca00a05d0 con 0x7faca00735f0 2024-09-17T05:37:13.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.902+0000 7fac9de00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faca0070610 0x7faca00c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7fac9e800640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca00735f0 0x7faca015a060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac9800e940 tx=0x7fac9800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7fac96a00640 1 -- 172.21.15.44:0/434084309 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98004d30 con 0x7faca00735f0 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7fac96a00640 1 -- 172.21.15.44:0/434084309 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac9800cb20 con 0x7faca00735f0 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7fac96a00640 1 -- 172.21.15.44:0/434084309 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac98005020 con 0x7faca00735f0 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca009e370 con 0x7faca00735f0 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca009cc30 con 0x7faca00735f0 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca00700d0 con 0x7faca00735f0 2024-09-17T05:37:13.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.906+0000 7fac96a00640 1 -- 172.21.15.44:0/434084309 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fac980051c0 con 0x7faca00735f0 2024-09-17T05:37:13.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.910+0000 7fac96a00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fac7c073200 0x7fac7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:13.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.910+0000 7fac96a00640 1 -- 172.21.15.44:0/434084309 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fac98094cc0 con 0x7faca00735f0 2024-09-17T05:37:13.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.910+0000 7fac9de00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fac7c073200 0x7fac7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:13.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.910+0000 7fac9de00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fac7c073200 0x7fac7c075710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac900016b0 tx=0x7fac90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:13.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:13.914+0000 7fac96a00640 1 -- 172.21.15.44:0/434084309 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fac9809b080 con 0x7faca00735f0 2024-09-17T05:37:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.086+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faca006e620 con 0x7faca00735f0 2024-09-17T05:37:14.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.086+0000 7fac96a00640 1 -- 172.21.15.44:0/434084309 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16954 (secure 0 0 0) 0x7fac98016030 con 0x7faca00735f0 2024-09-17T05:37:14.089 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:14.089 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":40,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:11.284516+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:07.452522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:08.662975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fac7c073200 msgr2=0x7fac7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fac7c073200 0x7fac7c075710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac900016b0 tx=0x7fac90009040 comp rx=0 tx=0).stop 2024-09-17T05:37:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca00735f0 msgr2=0x7faca015a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca00735f0 0x7faca015a060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac9800e940 tx=0x7fac9800ee00 comp rx=0 tx=0).stop 2024-09-17T05:37:14.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 shutdown_connections 2024-09-17T05:37:14.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faca00735f0 0x7faca015a060 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fac7c073200 0x7fac7c075710 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faca00b5880 0x7faca0159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 --2- 172.21.15.44:0/434084309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faca0070610 0x7faca00c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 >> 172.21.15.44:0/434084309 conn(0x7faca00ccaa0 msgr2=0x7faca015e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:14.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 shutdown_connections 2024-09-17T05:37:14.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.090+0000 7faca4e00640 1 -- 172.21.15.44:0/434084309 wait complete. 2024-09-17T05:37:14.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:37:14.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.270+0000 7ff88a600640 1 -- 172.21.15.44:0/534310548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 msgr2=0x7ff88415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.270+0000 7ff88a600640 1 --2- 172.21.15.44:0/534310548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 0x7ff88415e990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff874009840 tx=0x7ff87401c6b0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.270+0000 7ff88a600640 1 -- 172.21.15.44:0/534310548 shutdown_connections 2024-09-17T05:37:14.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.270+0000 7ff88a600640 1 --2- 172.21.15.44:0/534310548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 0x7ff88415e990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.270+0000 7ff88a600640 1 -- 172.21.15.44:0/534310548 >> 172.21.15.44:0/534310548 conn(0x7ff8840ccaa0 msgr2=0x7ff8840cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.270+0000 7ff88a600640 1 -- 172.21.15.44:0/534310548 shutdown_connections 2024-09-17T05:37:14.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.270+0000 7ff88a600640 1 -- 172.21.15.44:0/534310548 wait complete. 2024-09-17T05:37:14.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 Processor -- start 2024-09-17T05:37:14.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 -- start start 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff88406de50 0x7ff8840c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 0x7ff884158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8840cb470 0x7ff8840c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff884169ee0 con 0x7ff88406de50 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff884169d60 con 0x7ff884072e50 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff88416a060 con 0x7ff8840cb470 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff88406de50 0x7ff8840c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff88406de50 0x7ff8840c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51874/0 (socket says 172.21.15.44:51874) 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 -- 172.21.15.44:0/4251675168 learned_addr learned my addr 172.21.15.44:0/4251675168 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883e00640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8840cb470 0x7ff8840c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff87be00640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 0x7ff884158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 -- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8840cb470 msgr2=0x7ff8840c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8840cb470 0x7ff8840c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 -- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 msgr2=0x7ff884158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 0x7ff884158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 -- 172.21.15.44:0/4251675168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88406f920 con 0x7ff88406de50 2024-09-17T05:37:14.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff883400640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff88406de50 0x7ff8840c5230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff874000c10 tx=0x7ff8740056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff87b400640 1 -- 172.21.15.44:0/4251675168 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874004750 con 0x7ff88406de50 2024-09-17T05:37:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff87b400640 1 -- 172.21.15.44:0/4251675168 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8740048f0 con 0x7ff88406de50 2024-09-17T05:37:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8840c5a80 con 0x7ff88406de50 2024-09-17T05:37:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff87b400640 1 -- 172.21.15.44:0/4251675168 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874004ce0 con 0x7ff88406de50 2024-09-17T05:37:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.274+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8840c6040 con 0x7ff88406de50 2024-09-17T05:37:14.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.278+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88415e990 con 0x7ff88406de50 2024-09-17T05:37:14.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.278+0000 7ff87b400640 1 -- 172.21.15.44:0/4251675168 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff8740a6500 con 0x7ff88406de50 2024-09-17T05:37:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.278+0000 7ff87b400640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff860073230 0x7ff860075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.278+0000 7ff87b400640 1 -- 172.21.15.44:0/4251675168 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff87412e360 con 0x7ff88406de50 2024-09-17T05:37:14.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.278+0000 7ff87be00640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff860073230 0x7ff860075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.282+0000 7ff87be00640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff860073230 0x7ff860075740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff88415a760 tx=0x7ff86c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:14.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.282+0000 7ff87b400640 1 -- 172.21.15.44:0/4251675168 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff8740bf060 con 0x7ff88406de50 2024-09-17T05:37:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.458+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8840b5fa0 con 0x7ff860073230 2024-09-17T05:37:14.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.462+0000 7ff87b400640 1 -- 172.21.15.44:0/4251675168 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7ff8840b5fa0 con 0x7ff860073230 2024-09-17T05:37:14.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:14.468 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff860073230 msgr2=0x7ff860075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff860073230 0x7ff860075740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff88415a760 tx=0x7ff86c009040 comp rx=0 tx=0).stop 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff88406de50 msgr2=0x7ff8840c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff88406de50 0x7ff8840c5230 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff874000c10 tx=0x7ff8740056d0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 shutdown_connections 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff8840cb470 0x7ff8840c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff860073230 0x7ff860075740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff884072e50 0x7ff884158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 --2- 172.21.15.44:0/4251675168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff88406de50 0x7ff8840c5230 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 >> 172.21.15.44:0/4251675168 conn(0x7ff8840ccaa0 msgr2=0x7ff88406fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 shutdown_connections 2024-09-17T05:37:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.466+0000 7ff88a600640 1 -- 172.21.15.44:0/4251675168 wait complete. 2024-09-17T05:37:14.487 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-17T05:37:14.272868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220888,"kb_used_data":4628,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753832,"statfs":{"total":773094113280,"available":772867923968,"internally_reserved":0,"allocated":4739072,"data_stored":2673059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001247"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313182+0000","last_change":"2024-09-17T05:37:10.302869+0000","last_active":"2024-09-17T05:37:10.313182+0000","last_peered":"2024-09-17T05:37:10.313182+0000","last_clean":"2024-09-17T05:37:10.313182+0000","last_became_active":"2024-09-17T05:37:10.302558+0000","last_became_peered":"2024-09-17T05:37:10.302558+0000","last_unstale":"2024-09-17T05:37:10.313182+0000","last_undegraded":"2024-09-17T05:37:10.313182+0000","last_fullsized":"2024-09-17T05:37:10.313182+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:47.920043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342126+0000","last_change":"2024-09-17T05:37:10.303217+0000","last_active":"2024-09-17T05:37:11.342126+0000","last_peered":"2024-09-17T05:37:11.342126+0000","last_clean":"2024-09-17T05:37:11.342126+0000","last_became_active":"2024-09-17T05:37:10.302148+0000","last_became_peered":"2024-09-17T05:37:10.302148+0000","last_unstale":"2024-09-17T05:37:11.342126+0000","last_undegraded":"2024-09-17T05:37:11.342126+0000","last_fullsized":"2024-09-17T05:37:11.342126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:57.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.322348+0000","last_change":"2024-09-17T05:37:10.319510+0000","last_active":"2024-09-17T05:37:10.322348+0000","last_peered":"2024-09-17T05:37:10.322348+0000","last_clean":"2024-09-17T05:37:10.322348+0000","last_became_active":"2024-09-17T05:37:10.319191+0000","last_became_peered":"2024-09-17T05:37:10.319191+0000","last_unstale":"2024-09-17T05:37:10.322348+0000","last_undegraded":"2024-09-17T05:37:10.322348+0000","last_fullsized":"2024-09-17T05:37:10.322348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:55.121843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313285+0000","last_change":"2024-09-17T05:37:10.304159+0000","last_active":"2024-09-17T05:37:10.313285+0000","last_peered":"2024-09-17T05:37:10.313285+0000","last_clean":"2024-09-17T05:37:10.313285+0000","last_became_active":"2024-09-17T05:37:10.303835+0000","last_became_peered":"2024-09-17T05:37:10.303835+0000","last_unstale":"2024-09-17T05:37:10.313285+0000","last_undegraded":"2024-09-17T05:37:10.313285+0000","last_fullsized":"2024-09-17T05:37:10.313285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:53.293779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.319934+0000","last_change":"2024-09-17T05:37:10.317889+0000","last_active":"2024-09-17T05:37:10.319934+0000","last_peered":"2024-09-17T05:37:10.319934+0000","last_clean":"2024-09-17T05:37:10.319934+0000","last_became_active":"2024-09-17T05:37:10.317629+0000","last_became_peered":"2024-09-17T05:37:10.317629+0000","last_unstale":"2024-09-17T05:37:10.319934+0000","last_undegraded":"2024-09-17T05:37:10.319934+0000","last_fullsized":"2024-09-17T05:37:10.319934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:28.310605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341884+0000","last_change":"2024-09-17T05:37:10.287043+0000","last_active":"2024-09-17T05:37:11.341884+0000","last_peered":"2024-09-17T05:37:11.341884+0000","last_clean":"2024-09-17T05:37:11.341884+0000","last_became_active":"2024-09-17T05:37:10.286736+0000","last_became_peered":"2024-09-17T05:37:10.286736+0000","last_unstale":"2024-09-17T05:37:11.341884+0000","last_undegraded":"2024-09-17T05:37:11.341884+0000","last_fullsized":"2024-09-17T05:37:11.341884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.748305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.310680+0000","last_change":"2024-09-17T05:37:10.306272+0000","last_active":"2024-09-17T05:37:10.310680+0000","last_peered":"2024-09-17T05:37:10.310680+0000","last_clean":"2024-09-17T05:37:10.310680+0000","last_became_active":"2024-09-17T05:37:10.305736+0000","last_became_peered":"2024-09-17T05:37:10.305736+0000","last_unstale":"2024-09-17T05:37:10.310680+0000","last_undegraded":"2024-09-17T05:37:10.310680+0000","last_fullsized":"2024-09-17T05:37:10.310680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:53.446577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314979+0000","last_change":"2024-09-17T05:37:10.309885+0000","last_active":"2024-09-17T05:37:10.314979+0000","last_peered":"2024-09-17T05:37:10.314979+0000","last_clean":"2024-09-17T05:37:10.314979+0000","last_became_active":"2024-09-17T05:37:10.309531+0000","last_became_peered":"2024-09-17T05:37:10.309531+0000","last_unstale":"2024-09-17T05:37:10.314979+0000","last_undegraded":"2024-09-17T05:37:10.314979+0000","last_fullsized":"2024-09-17T05:37:10.314979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:54.964096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.322346+0000","last_change":"2024-09-17T05:37:10.319247+0000","last_active":"2024-09-17T05:37:10.322346+0000","last_peered":"2024-09-17T05:37:10.322346+0000","last_clean":"2024-09-17T05:37:10.322346+0000","last_became_active":"2024-09-17T05:37:10.318911+0000","last_became_peered":"2024-09-17T05:37:10.318911+0000","last_unstale":"2024-09-17T05:37:10.322346+0000","last_undegraded":"2024-09-17T05:37:10.322346+0000","last_fullsized":"2024-09-17T05:37:10.322346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:49.892144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.323895+0000","last_change":"2024-09-17T05:37:10.322663+0000","last_active":"2024-09-17T05:37:10.323895+0000","last_peered":"2024-09-17T05:37:10.323895+0000","last_clean":"2024-09-17T05:37:10.323895+0000","last_became_active":"2024-09-17T05:37:10.322407+0000","last_became_peered":"2024-09-17T05:37:10.322407+0000","last_unstale":"2024-09-17T05:37:10.323895+0000","last_undegraded":"2024-09-17T05:37:10.323895+0000","last_fullsized":"2024-09-17T05:37:10.323895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:18.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.318226+0000","last_change":"2024-09-17T05:37:10.312079+0000","last_active":"2024-09-17T05:37:10.318226+0000","last_peered":"2024-09-17T05:37:10.318226+0000","last_clean":"2024-09-17T05:37:10.318226+0000","last_became_active":"2024-09-17T05:37:10.311064+0000","last_became_peered":"2024-09-17T05:37:10.311064+0000","last_unstale":"2024-09-17T05:37:10.318226+0000","last_undegraded":"2024-09-17T05:37:10.318226+0000","last_fullsized":"2024-09-17T05:37:10.318226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:20.838972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.308430+0000","last_change":"2024-09-17T05:37:10.302321+0000","last_active":"2024-09-17T05:37:10.308430+0000","last_peered":"2024-09-17T05:37:10.308430+0000","last_clean":"2024-09-17T05:37:10.308430+0000","last_became_active":"2024-09-17T05:37:10.301616+0000","last_became_peered":"2024-09-17T05:37:10.301616+0000","last_unstale":"2024-09-17T05:37:10.308430+0000","last_undegraded":"2024-09-17T05:37:10.308430+0000","last_fullsized":"2024-09-17T05:37:10.308430+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:19.571024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297921+0000","last_change":"2024-09-17T05:37:10.287977+0000","last_active":"2024-09-17T05:37:10.297921+0000","last_peered":"2024-09-17T05:37:10.297921+0000","last_clean":"2024-09-17T05:37:10.297921+0000","last_became_active":"2024-09-17T05:37:10.287754+0000","last_became_peered":"2024-09-17T05:37:10.287754+0000","last_unstale":"2024-09-17T05:37:10.297921+0000","last_undegraded":"2024-09-17T05:37:10.297921+0000","last_fullsized":"2024-09-17T05:37:10.297921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:09.948367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312104+0000","last_change":"2024-09-17T05:37:10.308739+0000","last_active":"2024-09-17T05:37:10.312104+0000","last_peered":"2024-09-17T05:37:10.312104+0000","last_clean":"2024-09-17T05:37:10.312104+0000","last_became_active":"2024-09-17T05:37:10.308274+0000","last_became_peered":"2024-09-17T05:37:10.308274+0000","last_unstale":"2024-09-17T05:37:10.312104+0000","last_undegraded":"2024-09-17T05:37:10.312104+0000","last_fullsized":"2024-09-17T05:37:10.312104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:30.538775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.320443+0000","last_change":"2024-09-17T05:37:10.308812+0000","last_active":"2024-09-17T05:37:10.320443+0000","last_peered":"2024-09-17T05:37:10.320443+0000","last_clean":"2024-09-17T05:37:10.320443+0000","last_became_active":"2024-09-17T05:37:10.308474+0000","last_became_peered":"2024-09-17T05:37:10.308474+0000","last_unstale":"2024-09-17T05:37:10.320443+0000","last_undegraded":"2024-09-17T05:37:10.320443+0000","last_fullsized":"2024-09-17T05:37:10.320443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:21.600803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297822+0000","last_change":"2024-09-17T05:37:10.287765+0000","last_active":"2024-09-17T05:37:10.297822+0000","last_peered":"2024-09-17T05:37:10.297822+0000","last_clean":"2024-09-17T05:37:10.297822+0000","last_became_active":"2024-09-17T05:37:10.287461+0000","last_became_peered":"2024-09-17T05:37:10.287461+0000","last_unstale":"2024-09-17T05:37:10.297822+0000","last_undegraded":"2024-09-17T05:37:10.297822+0000","last_fullsized":"2024-09-17T05:37:10.297822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:24.983578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325114+0000","last_change":"2024-09-17T05:37:10.320018+0000","last_active":"2024-09-17T05:37:10.325114+0000","last_peered":"2024-09-17T05:37:10.325114+0000","last_clean":"2024-09-17T05:37:10.325114+0000","last_became_active":"2024-09-17T05:37:10.319655+0000","last_became_peered":"2024-09-17T05:37:10.319655+0000","last_unstale":"2024-09-17T05:37:10.325114+0000","last_undegraded":"2024-09-17T05:37:10.325114+0000","last_fullsized":"2024-09-17T05:37:10.325114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:11.217033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325318+0000","last_change":"2024-09-17T05:37:10.323509+0000","last_active":"2024-09-17T05:37:10.325318+0000","last_peered":"2024-09-17T05:37:10.325318+0000","last_clean":"2024-09-17T05:37:10.325318+0000","last_became_active":"2024-09-17T05:37:10.321765+0000","last_became_peered":"2024-09-17T05:37:10.321765+0000","last_unstale":"2024-09-17T05:37:10.325318+0000","last_undegraded":"2024-09-17T05:37:10.325318+0000","last_fullsized":"2024-09-17T05:37:10.325318+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:06.165589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.302212+0000","last_change":"2024-09-17T05:37:10.298983+0000","last_active":"2024-09-17T05:37:10.302212+0000","last_peered":"2024-09-17T05:37:10.302212+0000","last_clean":"2024-09-17T05:37:10.302212+0000","last_became_active":"2024-09-17T05:37:10.297093+0000","last_became_peered":"2024-09-17T05:37:10.297093+0000","last_unstale":"2024-09-17T05:37:10.302212+0000","last_undegraded":"2024-09-17T05:37:10.302212+0000","last_fullsized":"2024-09-17T05:37:10.302212+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:16.251054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312190+0000","last_change":"2024-09-17T05:37:10.308027+0000","last_active":"2024-09-17T05:37:10.312190+0000","last_peered":"2024-09-17T05:37:10.312190+0000","last_clean":"2024-09-17T05:37:10.312190+0000","last_became_active":"2024-09-17T05:37:10.307833+0000","last_became_peered":"2024-09-17T05:37:10.307833+0000","last_unstale":"2024-09-17T05:37:10.312190+0000","last_undegraded":"2024-09-17T05:37:10.312190+0000","last_fullsized":"2024-09-17T05:37:10.312190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:28.882118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.317064+0000","last_change":"2024-09-17T05:37:10.304293+0000","last_active":"2024-09-17T05:37:10.317064+0000","last_peered":"2024-09-17T05:37:10.317064+0000","last_clean":"2024-09-17T05:37:10.317064+0000","last_became_active":"2024-09-17T05:37:10.303967+0000","last_became_peered":"2024-09-17T05:37:10.303967+0000","last_unstale":"2024-09-17T05:37:10.317064+0000","last_undegraded":"2024-09-17T05:37:10.317064+0000","last_fullsized":"2024-09-17T05:37:10.317064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:52.656960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324779+0000","last_change":"2024-09-17T05:37:10.317942+0000","last_active":"2024-09-17T05:37:10.324779+0000","last_peered":"2024-09-17T05:37:10.324779+0000","last_clean":"2024-09-17T05:37:10.324779+0000","last_became_active":"2024-09-17T05:37:10.311798+0000","last_became_peered":"2024-09-17T05:37:10.311798+0000","last_unstale":"2024-09-17T05:37:10.324779+0000","last_undegraded":"2024-09-17T05:37:10.324779+0000","last_fullsized":"2024-09-17T05:37:10.324779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:33.568239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.320416+0000","last_change":"2024-09-17T05:37:10.308173+0000","last_active":"2024-09-17T05:37:10.320416+0000","last_peered":"2024-09-17T05:37:10.320416+0000","last_clean":"2024-09-17T05:37:10.320416+0000","last_became_active":"2024-09-17T05:37:10.307806+0000","last_became_peered":"2024-09-17T05:37:10.307806+0000","last_unstale":"2024-09-17T05:37:10.320416+0000","last_undegraded":"2024-09-17T05:37:10.320416+0000","last_fullsized":"2024-09-17T05:37:10.320416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:35.706967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313216+0000","last_change":"2024-09-17T05:37:10.300452+0000","last_active":"2024-09-17T05:37:10.313216+0000","last_peered":"2024-09-17T05:37:10.313216+0000","last_clean":"2024-09-17T05:37:10.313216+0000","last_became_active":"2024-09-17T05:37:10.300144+0000","last_became_peered":"2024-09-17T05:37:10.300144+0000","last_unstale":"2024-09-17T05:37:10.313216+0000","last_undegraded":"2024-09-17T05:37:10.313216+0000","last_fullsized":"2024-09-17T05:37:10.313216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:41.256286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297240+0000","last_change":"2024-09-17T05:37:10.293736+0000","last_active":"2024-09-17T05:37:10.297240+0000","last_peered":"2024-09-17T05:37:10.297240+0000","last_clean":"2024-09-17T05:37:10.297240+0000","last_became_active":"2024-09-17T05:37:10.293393+0000","last_became_peered":"2024-09-17T05:37:10.293393+0000","last_unstale":"2024-09-17T05:37:10.297240+0000","last_undegraded":"2024-09-17T05:37:10.297240+0000","last_fullsized":"2024-09-17T05:37:10.297240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:10.993647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311143+0000","last_change":"2024-09-17T05:37:10.297739+0000","last_active":"2024-09-17T05:37:10.311143+0000","last_peered":"2024-09-17T05:37:10.311143+0000","last_clean":"2024-09-17T05:37:10.311143+0000","last_became_active":"2024-09-17T05:37:10.294972+0000","last_became_peered":"2024-09-17T05:37:10.294972+0000","last_unstale":"2024-09-17T05:37:10.311143+0000","last_undegraded":"2024-09-17T05:37:10.311143+0000","last_fullsized":"2024-09-17T05:37:10.311143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:05.877719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.316670+0000","last_change":"2024-09-17T05:37:10.307169+0000","last_active":"2024-09-17T05:37:10.316670+0000","last_peered":"2024-09-17T05:37:10.316670+0000","last_clean":"2024-09-17T05:37:10.316670+0000","last_became_active":"2024-09-17T05:37:10.306532+0000","last_became_peered":"2024-09-17T05:37:10.306532+0000","last_unstale":"2024-09-17T05:37:10.316670+0000","last_undegraded":"2024-09-17T05:37:10.316670+0000","last_fullsized":"2024-09-17T05:37:10.316670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:01.745851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.298059+0000","last_change":"2024-09-17T05:37:10.289841+0000","last_active":"2024-09-17T05:37:10.298059+0000","last_peered":"2024-09-17T05:37:10.298059+0000","last_clean":"2024-09-17T05:37:10.298059+0000","last_became_active":"2024-09-17T05:37:10.289553+0000","last_became_peered":"2024-09-17T05:37:10.289553+0000","last_unstale":"2024-09-17T05:37:10.298059+0000","last_undegraded":"2024-09-17T05:37:10.298059+0000","last_fullsized":"2024-09-17T05:37:10.298059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:22.756800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324696+0000","last_change":"2024-09-17T05:37:10.317277+0000","last_active":"2024-09-17T05:37:10.324696+0000","last_peered":"2024-09-17T05:37:10.324696+0000","last_clean":"2024-09-17T05:37:10.324696+0000","last_became_active":"2024-09-17T05:37:10.316953+0000","last_became_peered":"2024-09-17T05:37:10.316953+0000","last_unstale":"2024-09-17T05:37:10.324696+0000","last_undegraded":"2024-09-17T05:37:10.324696+0000","last_fullsized":"2024-09-17T05:37:10.324696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.305352+0000","last_change":"2024-09-17T05:37:10.302583+0000","last_active":"2024-09-17T05:37:10.305352+0000","last_peered":"2024-09-17T05:37:10.305352+0000","last_clean":"2024-09-17T05:37:10.305352+0000","last_became_active":"2024-09-17T05:37:10.302321+0000","last_became_peered":"2024-09-17T05:37:10.302321+0000","last_unstale":"2024-09-17T05:37:10.305352+0000","last_undegraded":"2024-09-17T05:37:10.305352+0000","last_fullsized":"2024-09-17T05:37:10.305352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:27.101156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.298185+0000","last_change":"2024-09-17T05:37:10.291822+0000","last_active":"2024-09-17T05:37:10.298185+0000","last_peered":"2024-09-17T05:37:10.298185+0000","last_clean":"2024-09-17T05:37:10.298185+0000","last_became_active":"2024-09-17T05:37:10.287439+0000","last_became_peered":"2024-09-17T05:37:10.287439+0000","last_unstale":"2024-09-17T05:37:10.298185+0000","last_undegraded":"2024-09-17T05:37:10.298185+0000","last_fullsized":"2024-09-17T05:37:10.298185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:00.173112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314324+0000","last_change":"2024-09-17T05:37:10.311426+0000","last_active":"2024-09-17T05:37:10.314324+0000","last_peered":"2024-09-17T05:37:10.314324+0000","last_clean":"2024-09-17T05:37:10.314324+0000","last_became_active":"2024-09-17T05:37:10.308330+0000","last_became_peered":"2024-09-17T05:37:10.308330+0000","last_unstale":"2024-09-17T05:37:10.314324+0000","last_undegraded":"2024-09-17T05:37:10.314324+0000","last_fullsized":"2024-09-17T05:37:10.314324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:42.185117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325127+0000","last_change":"2024-09-17T05:37:10.320214+0000","last_active":"2024-09-17T05:37:10.325127+0000","last_peered":"2024-09-17T05:37:10.325127+0000","last_clean":"2024-09-17T05:37:10.325127+0000","last_became_active":"2024-09-17T05:37:10.318837+0000","last_became_peered":"2024-09-17T05:37:10.318837+0000","last_unstale":"2024-09-17T05:37:10.325127+0000","last_undegraded":"2024-09-17T05:37:10.325127+0000","last_fullsized":"2024-09-17T05:37:10.325127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:26.216889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.302057+0000","last_change":"2024-09-17T05:37:09.291844+0000","last_active":"2024-09-17T05:37:10.302057+0000","last_peered":"2024-09-17T05:37:10.302057+0000","last_clean":"2024-09-17T05:37:10.302057+0000","last_became_active":"2024-09-17T05:37:09.291308+0000","last_became_peered":"2024-09-17T05:37:09.291308+0000","last_unstale":"2024-09-17T05:37:10.302057+0000","last_undegraded":"2024-09-17T05:37:10.302057+0000","last_fullsized":"2024-09-17T05:37:10.302057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:15.955812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341591+0000","last_change":"2024-09-17T05:37:10.312170+0000","last_active":"2024-09-17T05:37:11.341591+0000","last_peered":"2024-09-17T05:37:11.341591+0000","last_clean":"2024-09-17T05:37:11.341591+0000","last_became_active":"2024-09-17T05:37:10.311797+0000","last_became_peered":"2024-09-17T05:37:10.311797+0000","last_unstale":"2024-09-17T05:37:11.341591+0000","last_undegraded":"2024-09-17T05:37:11.341591+0000","last_fullsized":"2024-09-17T05:37:11.341591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:36.957718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342287+0000","last_change":"2024-09-17T05:37:09.298420+0000","last_active":"2024-09-17T05:37:11.342287+0000","last_peered":"2024-09-17T05:37:11.342287+0000","last_clean":"2024-09-17T05:37:11.342287+0000","last_became_active":"2024-09-17T05:37:09.298033+0000","last_became_peered":"2024-09-17T05:37:09.298033+0000","last_unstale":"2024-09-17T05:37:11.342287+0000","last_undegraded":"2024-09-17T05:37:11.342287+0000","last_fullsized":"2024-09-17T05:37:11.342287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:04.895200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324946+0000","last_change":"2024-09-17T05:37:10.318324+0000","last_active":"2024-09-17T05:37:10.324946+0000","last_peered":"2024-09-17T05:37:10.324946+0000","last_clean":"2024-09-17T05:37:10.324946+0000","last_became_active":"2024-09-17T05:37:10.317864+0000","last_became_peered":"2024-09-17T05:37:10.317864+0000","last_unstale":"2024-09-17T05:37:10.324946+0000","last_undegraded":"2024-09-17T05:37:10.324946+0000","last_fullsized":"2024-09-17T05:37:10.324946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:40.368972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314107+0000","last_change":"2024-09-17T05:37:09.298667+0000","last_active":"2024-09-17T05:37:10.314107+0000","last_peered":"2024-09-17T05:37:10.314107+0000","last_clean":"2024-09-17T05:37:10.314107+0000","last_became_active":"2024-09-17T05:37:09.297439+0000","last_became_peered":"2024-09-17T05:37:09.297439+0000","last_unstale":"2024-09-17T05:37:10.314107+0000","last_undegraded":"2024-09-17T05:37:10.314107+0000","last_fullsized":"2024-09-17T05:37:10.314107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:15.247876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342000+0000","last_change":"2024-09-17T05:37:10.310957+0000","last_active":"2024-09-17T05:37:11.342000+0000","last_peered":"2024-09-17T05:37:11.342000+0000","last_clean":"2024-09-17T05:37:11.342000+0000","last_became_active":"2024-09-17T05:37:10.310620+0000","last_became_peered":"2024-09-17T05:37:10.310620+0000","last_unstale":"2024-09-17T05:37:11.342000+0000","last_undegraded":"2024-09-17T05:37:11.342000+0000","last_fullsized":"2024-09-17T05:37:11.342000+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:50.034609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311325+0000","last_change":"2024-09-17T05:37:09.307251+0000","last_active":"2024-09-17T05:37:10.311325+0000","last_peered":"2024-09-17T05:37:10.311325+0000","last_clean":"2024-09-17T05:37:10.311325+0000","last_became_active":"2024-09-17T05:37:09.306880+0000","last_became_peered":"2024-09-17T05:37:09.306880+0000","last_unstale":"2024-09-17T05:37:10.311325+0000","last_undegraded":"2024-09-17T05:37:10.311325+0000","last_fullsized":"2024-09-17T05:37:10.311325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:22.177493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.294903+0000","last_change":"2024-09-17T05:37:10.285783+0000","last_active":"2024-09-17T05:37:10.294903+0000","last_peered":"2024-09-17T05:37:10.294903+0000","last_clean":"2024-09-17T05:37:10.294903+0000","last_became_active":"2024-09-17T05:37:10.285426+0000","last_became_peered":"2024-09-17T05:37:10.285426+0000","last_unstale":"2024-09-17T05:37:10.294903+0000","last_undegraded":"2024-09-17T05:37:10.294903+0000","last_fullsized":"2024-09-17T05:37:10.294903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:58.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.302824+0000","last_change":"2024-09-17T05:37:09.291168+0000","last_active":"2024-09-17T05:37:10.302824+0000","last_peered":"2024-09-17T05:37:10.302824+0000","last_clean":"2024-09-17T05:37:10.302824+0000","last_became_active":"2024-09-17T05:37:09.290820+0000","last_became_peered":"2024-09-17T05:37:09.290820+0000","last_unstale":"2024-09-17T05:37:10.302824+0000","last_undegraded":"2024-09-17T05:37:10.302824+0000","last_fullsized":"2024-09-17T05:37:10.302824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:27.516070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.316491+0000","last_change":"2024-09-17T05:37:10.304051+0000","last_active":"2024-09-17T05:37:10.316491+0000","last_peered":"2024-09-17T05:37:10.316491+0000","last_clean":"2024-09-17T05:37:10.316491+0000","last_became_active":"2024-09-17T05:37:10.303677+0000","last_became_peered":"2024-09-17T05:37:10.303677+0000","last_unstale":"2024-09-17T05:37:10.316491+0000","last_undegraded":"2024-09-17T05:37:10.316491+0000","last_fullsized":"2024-09-17T05:37:10.316491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:56.339588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.308796+0000","last_change":"2024-09-17T05:37:09.299825+0000","last_active":"2024-09-17T05:37:10.308796+0000","last_peered":"2024-09-17T05:37:10.308796+0000","last_clean":"2024-09-17T05:37:10.308796+0000","last_became_active":"2024-09-17T05:37:09.299475+0000","last_became_peered":"2024-09-17T05:37:09.299475+0000","last_unstale":"2024-09-17T05:37:10.308796+0000","last_undegraded":"2024-09-17T05:37:10.308796+0000","last_fullsized":"2024-09-17T05:37:10.308796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.204117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325165+0000","last_change":"2024-09-17T05:37:10.322331+0000","last_active":"2024-09-17T05:37:10.325165+0000","last_peered":"2024-09-17T05:37:10.325165+0000","last_clean":"2024-09-17T05:37:10.325165+0000","last_became_active":"2024-09-17T05:37:10.322029+0000","last_became_peered":"2024-09-17T05:37:10.322029+0000","last_unstale":"2024-09-17T05:37:10.325165+0000","last_undegraded":"2024-09-17T05:37:10.325165+0000","last_fullsized":"2024-09-17T05:37:10.325165+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:06.976978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.280056+0000","last_change":"2024-09-17T05:37:09.293573+0000","last_active":"2024-09-17T05:37:10.280056+0000","last_peered":"2024-09-17T05:37:10.280056+0000","last_clean":"2024-09-17T05:37:10.280056+0000","last_became_active":"2024-09-17T05:37:09.293164+0000","last_became_peered":"2024-09-17T05:37:09.293164+0000","last_unstale":"2024-09-17T05:37:10.280056+0000","last_undegraded":"2024-09-17T05:37:10.280056+0000","last_fullsized":"2024-09-17T05:37:10.280056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:08.830753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342497+0000","last_change":"2024-09-17T05:37:10.298355+0000","last_active":"2024-09-17T05:37:11.342497+0000","last_peered":"2024-09-17T05:37:11.342497+0000","last_clean":"2024-09-17T05:37:11.342497+0000","last_became_active":"2024-09-17T05:37:10.290858+0000","last_became_peered":"2024-09-17T05:37:10.290858+0000","last_unstale":"2024-09-17T05:37:11.342497+0000","last_undegraded":"2024-09-17T05:37:11.342497+0000","last_fullsized":"2024-09-17T05:37:11.342497+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:20.515584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.276932+0000","last_change":"2024-09-17T05:37:09.299598+0000","last_active":"2024-09-17T05:37:10.276932+0000","last_peered":"2024-09-17T05:37:10.276932+0000","last_clean":"2024-09-17T05:37:10.276932+0000","last_became_active":"2024-09-17T05:37:09.299277+0000","last_became_peered":"2024-09-17T05:37:09.299277+0000","last_unstale":"2024-09-17T05:37:10.276932+0000","last_undegraded":"2024-09-17T05:37:10.276932+0000","last_fullsized":"2024-09-17T05:37:10.276932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:08.503589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313388+0000","last_change":"2024-09-17T05:37:10.304218+0000","last_active":"2024-09-17T05:37:10.313388+0000","last_peered":"2024-09-17T05:37:10.313388+0000","last_clean":"2024-09-17T05:37:10.313388+0000","last_became_active":"2024-09-17T05:37:10.303937+0000","last_became_peered":"2024-09-17T05:37:10.303937+0000","last_unstale":"2024-09-17T05:37:10.313388+0000","last_undegraded":"2024-09-17T05:37:10.313388+0000","last_fullsized":"2024-09-17T05:37:10.313388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:36.371338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.283430+0000","last_change":"2024-09-17T05:37:09.295473+0000","last_active":"2024-09-17T05:37:10.283430+0000","last_peered":"2024-09-17T05:37:10.283430+0000","last_clean":"2024-09-17T05:37:10.283430+0000","last_became_active":"2024-09-17T05:37:09.295211+0000","last_became_peered":"2024-09-17T05:37:09.295211+0000","last_unstale":"2024-09-17T05:37:10.283430+0000","last_undegraded":"2024-09-17T05:37:10.283430+0000","last_fullsized":"2024-09-17T05:37:10.283430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:12.063061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.321697+0000","last_change":"2024-09-17T05:37:10.320345+0000","last_active":"2024-09-17T05:37:10.321697+0000","last_peered":"2024-09-17T05:37:10.321697+0000","last_clean":"2024-09-17T05:37:10.321697+0000","last_became_active":"2024-09-17T05:37:10.319946+0000","last_became_peered":"2024-09-17T05:37:10.319946+0000","last_unstale":"2024-09-17T05:37:10.321697+0000","last_undegraded":"2024-09-17T05:37:10.321697+0000","last_fullsized":"2024-09-17T05:37:10.321697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:56.339588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.300297+0000","last_change":"2024-09-17T05:37:09.303751+0000","last_active":"2024-09-17T05:37:10.300297+0000","last_peered":"2024-09-17T05:37:10.300297+0000","last_clean":"2024-09-17T05:37:10.300297+0000","last_became_active":"2024-09-17T05:37:09.303214+0000","last_became_peered":"2024-09-17T05:37:09.303214+0000","last_unstale":"2024-09-17T05:37:10.300297+0000","last_undegraded":"2024-09-17T05:37:10.300297+0000","last_fullsized":"2024-09-17T05:37:10.300297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:32.925636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313627+0000","last_change":"2024-09-17T05:37:10.308412+0000","last_active":"2024-09-17T05:37:10.313627+0000","last_peered":"2024-09-17T05:37:10.313627+0000","last_clean":"2024-09-17T05:37:10.313627+0000","last_became_active":"2024-09-17T05:37:10.308097+0000","last_became_peered":"2024-09-17T05:37:10.308097+0000","last_unstale":"2024-09-17T05:37:10.313627+0000","last_undegraded":"2024-09-17T05:37:10.313627+0000","last_fullsized":"2024-09-17T05:37:10.313627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:25.537868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.317822+0000","last_change":"2024-09-17T05:37:09.305505+0000","last_active":"2024-09-17T05:37:10.317822+0000","last_peered":"2024-09-17T05:37:10.317822+0000","last_clean":"2024-09-17T05:37:10.317822+0000","last_became_active":"2024-09-17T05:37:09.305141+0000","last_became_peered":"2024-09-17T05:37:09.305141+0000","last_unstale":"2024-09-17T05:37:10.317822+0000","last_undegraded":"2024-09-17T05:37:10.317822+0000","last_fullsized":"2024-09-17T05:37:10.317822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:28.266096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.304283+0000","last_change":"2024-09-17T05:37:10.301624+0000","last_active":"2024-09-17T05:37:10.304283+0000","last_peered":"2024-09-17T05:37:10.304283+0000","last_clean":"2024-09-17T05:37:10.304283+0000","last_became_active":"2024-09-17T05:37:10.301320+0000","last_became_peered":"2024-09-17T05:37:10.301320+0000","last_unstale":"2024-09-17T05:37:10.304283+0000","last_undegraded":"2024-09-17T05:37:10.304283+0000","last_fullsized":"2024-09-17T05:37:10.304283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:23.767620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314483+0000","last_change":"2024-09-17T05:37:09.299189+0000","last_active":"2024-09-17T05:37:10.314483+0000","last_peered":"2024-09-17T05:37:10.314483+0000","last_clean":"2024-09-17T05:37:10.314483+0000","last_became_active":"2024-09-17T05:37:09.296921+0000","last_became_peered":"2024-09-17T05:37:09.296921+0000","last_unstale":"2024-09-17T05:37:10.314483+0000","last_undegraded":"2024-09-17T05:37:10.314483+0000","last_fullsized":"2024-09-17T05:37:10.314483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:42.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.295035+0000","last_change":"2024-09-17T05:37:10.291777+0000","last_active":"2024-09-17T05:37:10.295035+0000","last_peered":"2024-09-17T05:37:10.295035+0000","last_clean":"2024-09-17T05:37:10.295035+0000","last_became_active":"2024-09-17T05:37:10.288575+0000","last_became_peered":"2024-09-17T05:37:10.288575+0000","last_unstale":"2024-09-17T05:37:10.295035+0000","last_undegraded":"2024-09-17T05:37:10.295035+0000","last_fullsized":"2024-09-17T05:37:10.295035+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:29.682828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313241+0000","last_change":"2024-09-17T05:37:09.294860+0000","last_active":"2024-09-17T05:37:10.313241+0000","last_peered":"2024-09-17T05:37:10.313241+0000","last_clean":"2024-09-17T05:37:10.313241+0000","last_became_active":"2024-09-17T05:37:09.294448+0000","last_became_peered":"2024-09-17T05:37:09.294448+0000","last_unstale":"2024-09-17T05:37:10.313241+0000","last_undegraded":"2024-09-17T05:37:10.313241+0000","last_fullsized":"2024-09-17T05:37:10.313241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:26.995909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.343218+0000","last_change":"2024-09-17T05:37:10.281888+0000","last_active":"2024-09-17T05:37:11.343218+0000","last_peered":"2024-09-17T05:37:11.343218+0000","last_clean":"2024-09-17T05:37:11.343218+0000","last_became_active":"2024-09-17T05:37:10.281547+0000","last_became_peered":"2024-09-17T05:37:10.281547+0000","last_unstale":"2024-09-17T05:37:11.343218+0000","last_undegraded":"2024-09-17T05:37:11.343218+0000","last_fullsized":"2024-09-17T05:37:11.343218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:18.069705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342109+0000","last_change":"2024-09-17T05:37:09.293431+0000","last_active":"2024-09-17T05:37:11.342109+0000","last_peered":"2024-09-17T05:37:11.342109+0000","last_clean":"2024-09-17T05:37:11.342109+0000","last_became_active":"2024-09-17T05:37:09.293087+0000","last_became_peered":"2024-09-17T05:37:09.293087+0000","last_unstale":"2024-09-17T05:37:11.342109+0000","last_undegraded":"2024-09-17T05:37:11.342109+0000","last_fullsized":"2024-09-17T05:37:11.342109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.321161+0000","last_change":"2024-09-17T05:37:10.302578+0000","last_active":"2024-09-17T05:37:10.321161+0000","last_peered":"2024-09-17T05:37:10.321161+0000","last_clean":"2024-09-17T05:37:10.321161+0000","last_became_active":"2024-09-17T05:37:10.302242+0000","last_became_peered":"2024-09-17T05:37:10.302242+0000","last_unstale":"2024-09-17T05:37:10.321161+0000","last_undegraded":"2024-09-17T05:37:10.321161+0000","last_fullsized":"2024-09-17T05:37:10.321161+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:30.538775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.295879+0000","last_change":"2024-09-17T05:37:09.298606+0000","last_active":"2024-09-17T05:37:10.295879+0000","last_peered":"2024-09-17T05:37:10.295879+0000","last_clean":"2024-09-17T05:37:10.295879+0000","last_became_active":"2024-09-17T05:37:09.297679+0000","last_became_peered":"2024-09-17T05:37:09.297679+0000","last_unstale":"2024-09-17T05:37:10.295879+0000","last_undegraded":"2024-09-17T05:37:10.295879+0000","last_fullsized":"2024-09-17T05:37:10.295879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:01.107282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311967+0000","last_change":"2024-09-17T05:37:10.308797+0000","last_active":"2024-09-17T05:37:10.311967+0000","last_peered":"2024-09-17T05:37:10.311967+0000","last_clean":"2024-09-17T05:37:10.311967+0000","last_became_active":"2024-09-17T05:37:10.308461+0000","last_became_peered":"2024-09-17T05:37:10.308461+0000","last_unstale":"2024-09-17T05:37:10.311967+0000","last_undegraded":"2024-09-17T05:37:10.311967+0000","last_fullsized":"2024-09-17T05:37:10.311967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:50.239840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.301552+0000","last_change":"2024-09-17T05:37:09.285823+0000","last_active":"2024-09-17T05:37:10.301552+0000","last_peered":"2024-09-17T05:37:10.301552+0000","last_clean":"2024-09-17T05:37:10.301552+0000","last_became_active":"2024-09-17T05:37:09.285477+0000","last_became_peered":"2024-09-17T05:37:09.285477+0000","last_unstale":"2024-09-17T05:37:10.301552+0000","last_undegraded":"2024-09-17T05:37:10.301552+0000","last_fullsized":"2024-09-17T05:37:10.301552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341748+0000","last_change":"2024-09-17T05:37:10.300170+0000","last_active":"2024-09-17T05:37:11.341748+0000","last_peered":"2024-09-17T05:37:11.341748+0000","last_clean":"2024-09-17T05:37:11.341748+0000","last_became_active":"2024-09-17T05:37:10.299846+0000","last_became_peered":"2024-09-17T05:37:10.299846+0000","last_unstale":"2024-09-17T05:37:11.341748+0000","last_undegraded":"2024-09-17T05:37:11.341748+0000","last_fullsized":"2024-09-17T05:37:11.341748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:36.804907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.310949+0000","last_change":"2024-09-17T05:37:09.304347+0000","last_active":"2024-09-17T05:37:10.310949+0000","last_peered":"2024-09-17T05:37:10.310949+0000","last_clean":"2024-09-17T05:37:10.310949+0000","last_became_active":"2024-09-17T05:37:09.303980+0000","last_became_peered":"2024-09-17T05:37:09.303980+0000","last_unstale":"2024-09-17T05:37:10.310949+0000","last_undegraded":"2024-09-17T05:37:10.310949+0000","last_fullsized":"2024-09-17T05:37:10.310949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:05.308798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312716+0000","last_change":"2024-09-17T05:37:10.309586+0000","last_active":"2024-09-17T05:37:10.312716+0000","last_peered":"2024-09-17T05:37:10.312716+0000","last_clean":"2024-09-17T05:37:10.312716+0000","last_became_active":"2024-09-17T05:37:10.309289+0000","last_became_peered":"2024-09-17T05:37:10.309289+0000","last_unstale":"2024-09-17T05:37:10.312716+0000","last_undegraded":"2024-09-17T05:37:10.312716+0000","last_fullsized":"2024-09-17T05:37:10.312716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:44.052188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.317684+0000","last_change":"2024-09-17T05:37:09.306312+0000","last_active":"2024-09-17T05:37:10.317684+0000","last_peered":"2024-09-17T05:37:10.317684+0000","last_clean":"2024-09-17T05:37:10.317684+0000","last_became_active":"2024-09-17T05:37:09.305997+0000","last_became_peered":"2024-09-17T05:37:09.305997+0000","last_unstale":"2024-09-17T05:37:10.317684+0000","last_undegraded":"2024-09-17T05:37:10.317684+0000","last_fullsized":"2024-09-17T05:37:10.317684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:33.104208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.303758+0000","last_change":"2024-09-17T05:37:10.288522+0000","last_active":"2024-09-17T05:37:10.303758+0000","last_peered":"2024-09-17T05:37:10.303758+0000","last_clean":"2024-09-17T05:37:10.303758+0000","last_became_active":"2024-09-17T05:37:10.287422+0000","last_became_peered":"2024-09-17T05:37:10.287422+0000","last_unstale":"2024-09-17T05:37:10.303758+0000","last_undegraded":"2024-09-17T05:37:10.303758+0000","last_fullsized":"2024-09-17T05:37:10.303758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:25.086660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.316704+0000","last_change":"2024-09-17T05:37:09.302465+0000","last_active":"2024-09-17T05:37:10.316704+0000","last_peered":"2024-09-17T05:37:10.316704+0000","last_clean":"2024-09-17T05:37:10.316704+0000","last_became_active":"2024-09-17T05:37:09.302137+0000","last_became_peered":"2024-09-17T05:37:09.302137+0000","last_unstale":"2024-09-17T05:37:10.316704+0000","last_undegraded":"2024-09-17T05:37:10.316704+0000","last_fullsized":"2024-09-17T05:37:10.316704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:52.998403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.299741+0000","last_change":"2024-09-17T05:37:10.294891+0000","last_active":"2024-09-17T05:37:10.299741+0000","last_peered":"2024-09-17T05:37:10.299741+0000","last_clean":"2024-09-17T05:37:10.299741+0000","last_became_active":"2024-09-17T05:37:10.292571+0000","last_became_peered":"2024-09-17T05:37:10.292571+0000","last_unstale":"2024-09-17T05:37:10.299741+0000","last_undegraded":"2024-09-17T05:37:10.299741+0000","last_fullsized":"2024-09-17T05:37:10.299741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:43.567635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.283028+0000","last_change":"2024-09-17T05:37:09.295972+0000","last_active":"2024-09-17T05:37:10.283028+0000","last_peered":"2024-09-17T05:37:10.283028+0000","last_clean":"2024-09-17T05:37:10.283028+0000","last_became_active":"2024-09-17T05:37:09.295665+0000","last_became_peered":"2024-09-17T05:37:09.295665+0000","last_unstale":"2024-09-17T05:37:10.283028+0000","last_undegraded":"2024-09-17T05:37:10.283028+0000","last_fullsized":"2024-09-17T05:37:10.283028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:45.359820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324658+0000","last_change":"2024-09-17T05:37:10.316798+0000","last_active":"2024-09-17T05:37:10.324658+0000","last_peered":"2024-09-17T05:37:10.324658+0000","last_clean":"2024-09-17T05:37:10.324658+0000","last_became_active":"2024-09-17T05:37:10.309814+0000","last_became_peered":"2024-09-17T05:37:10.309814+0000","last_unstale":"2024-09-17T05:37:10.324658+0000","last_undegraded":"2024-09-17T05:37:10.324658+0000","last_fullsized":"2024-09-17T05:37:10.324658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:46.981472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312483+0000","last_change":"2024-09-17T05:37:09.290669+0000","last_active":"2024-09-17T05:37:10.312483+0000","last_peered":"2024-09-17T05:37:10.312483+0000","last_clean":"2024-09-17T05:37:10.312483+0000","last_became_active":"2024-09-17T05:37:09.290309+0000","last_became_peered":"2024-09-17T05:37:09.290309+0000","last_unstale":"2024-09-17T05:37:10.312483+0000","last_undegraded":"2024-09-17T05:37:10.312483+0000","last_fullsized":"2024-09-17T05:37:10.312483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:08.830753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313211+0000","last_change":"2024-09-17T05:37:10.298289+0000","last_active":"2024-09-17T05:37:10.313211+0000","last_peered":"2024-09-17T05:37:10.313211+0000","last_clean":"2024-09-17T05:37:10.313211+0000","last_became_active":"2024-09-17T05:37:10.297345+0000","last_became_peered":"2024-09-17T05:37:10.297345+0000","last_unstale":"2024-09-17T05:37:10.313211+0000","last_undegraded":"2024-09-17T05:37:10.313211+0000","last_fullsized":"2024-09-17T05:37:10.313211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:10.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342015+0000","last_change":"2024-09-17T05:37:09.302345+0000","last_active":"2024-09-17T05:37:11.342015+0000","last_peered":"2024-09-17T05:37:11.342015+0000","last_clean":"2024-09-17T05:37:11.342015+0000","last_became_active":"2024-09-17T05:37:09.298055+0000","last_became_peered":"2024-09-17T05:37:09.298055+0000","last_unstale":"2024-09-17T05:37:11.342015+0000","last_undegraded":"2024-09-17T05:37:11.342015+0000","last_fullsized":"2024-09-17T05:37:11.342015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:28.595611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324797+0000","last_change":"2024-09-17T05:37:10.318355+0000","last_active":"2024-09-17T05:37:10.324797+0000","last_peered":"2024-09-17T05:37:10.324797+0000","last_clean":"2024-09-17T05:37:10.324797+0000","last_became_active":"2024-09-17T05:37:10.310973+0000","last_became_peered":"2024-09-17T05:37:10.310973+0000","last_unstale":"2024-09-17T05:37:10.324797+0000","last_undegraded":"2024-09-17T05:37:10.324797+0000","last_fullsized":"2024-09-17T05:37:10.324797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:55.962182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.276520+0000","last_change":"2024-09-17T05:37:09.300413+0000","last_active":"2024-09-17T05:37:10.276520+0000","last_peered":"2024-09-17T05:37:10.276520+0000","last_clean":"2024-09-17T05:37:10.276520+0000","last_became_active":"2024-09-17T05:37:09.300073+0000","last_became_peered":"2024-09-17T05:37:09.300073+0000","last_unstale":"2024-09-17T05:37:10.276520+0000","last_undegraded":"2024-09-17T05:37:10.276520+0000","last_fullsized":"2024-09-17T05:37:10.276520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:52.662270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313565+0000","last_change":"2024-09-17T05:37:10.306192+0000","last_active":"2024-09-17T05:37:10.313565+0000","last_peered":"2024-09-17T05:37:10.313565+0000","last_clean":"2024-09-17T05:37:10.313565+0000","last_became_active":"2024-09-17T05:37:10.305690+0000","last_became_peered":"2024-09-17T05:37:10.305690+0000","last_unstale":"2024-09-17T05:37:10.313565+0000","last_undegraded":"2024-09-17T05:37:10.313565+0000","last_fullsized":"2024-09-17T05:37:10.313565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:09.152413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341262+0000","last_change":"2024-09-17T05:37:09.295070+0000","last_active":"2024-09-17T05:37:11.341262+0000","last_peered":"2024-09-17T05:37:11.341262+0000","last_clean":"2024-09-17T05:37:11.341262+0000","last_became_active":"2024-09-17T05:37:09.294718+0000","last_became_peered":"2024-09-17T05:37:09.294718+0000","last_unstale":"2024-09-17T05:37:11.341262+0000","last_undegraded":"2024-09-17T05:37:11.341262+0000","last_fullsized":"2024-09-17T05:37:11.341262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:34.706285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311329+0000","last_change":"2024-09-17T05:37:10.307040+0000","last_active":"2024-09-17T05:37:10.311329+0000","last_peered":"2024-09-17T05:37:10.311329+0000","last_clean":"2024-09-17T05:37:10.311329+0000","last_became_active":"2024-09-17T05:37:10.306264+0000","last_became_peered":"2024-09-17T05:37:10.306264+0000","last_unstale":"2024-09-17T05:37:10.311329+0000","last_undegraded":"2024-09-17T05:37:10.311329+0000","last_fullsized":"2024-09-17T05:37:10.311329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:37.602959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.319014+0000","last_change":"2024-09-17T05:37:09.301272+0000","last_active":"2024-09-17T05:37:10.319014+0000","last_peered":"2024-09-17T05:37:10.319014+0000","last_clean":"2024-09-17T05:37:10.319014+0000","last_became_active":"2024-09-17T05:37:09.300851+0000","last_became_peered":"2024-09-17T05:37:09.300851+0000","last_unstale":"2024-09-17T05:37:10.319014+0000","last_undegraded":"2024-09-17T05:37:10.319014+0000","last_fullsized":"2024-09-17T05:37:10.319014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:20.559339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.318197+0000","last_change":"2024-09-17T05:37:10.311413+0000","last_active":"2024-09-17T05:37:10.318197+0000","last_peered":"2024-09-17T05:37:10.318197+0000","last_clean":"2024-09-17T05:37:10.318197+0000","last_became_active":"2024-09-17T05:37:10.311050+0000","last_became_peered":"2024-09-17T05:37:10.311050+0000","last_unstale":"2024-09-17T05:37:10.318197+0000","last_undegraded":"2024-09-17T05:37:10.318197+0000","last_fullsized":"2024-09-17T05:37:10.318197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:24.197322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297642+0000","last_change":"2024-09-17T05:37:09.302517+0000","last_active":"2024-09-17T05:37:10.297642+0000","last_peered":"2024-09-17T05:37:10.297642+0000","last_clean":"2024-09-17T05:37:10.297642+0000","last_became_active":"2024-09-17T05:37:09.302208+0000","last_became_peered":"2024-09-17T05:37:09.302208+0000","last_unstale":"2024-09-17T05:37:10.297642+0000","last_undegraded":"2024-09-17T05:37:10.297642+0000","last_fullsized":"2024-09-17T05:37:10.297642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:50.489329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324517+0000","last_change":"2024-09-17T05:37:10.320814+0000","last_active":"2024-09-17T05:37:10.324517+0000","last_peered":"2024-09-17T05:37:10.324517+0000","last_clean":"2024-09-17T05:37:10.324517+0000","last_became_active":"2024-09-17T05:37:10.320592+0000","last_became_peered":"2024-09-17T05:37:10.320592+0000","last_unstale":"2024-09-17T05:37:10.324517+0000","last_undegraded":"2024-09-17T05:37:10.324517+0000","last_fullsized":"2024-09-17T05:37:10.324517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.066238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297512+0000","last_change":"2024-09-17T05:37:09.298925+0000","last_active":"2024-09-17T05:37:10.297512+0000","last_peered":"2024-09-17T05:37:10.297512+0000","last_clean":"2024-09-17T05:37:10.297512+0000","last_became_active":"2024-09-17T05:37:09.298596+0000","last_became_peered":"2024-09-17T05:37:09.298596+0000","last_unstale":"2024-09-17T05:37:10.297512+0000","last_undegraded":"2024-09-17T05:37:10.297512+0000","last_fullsized":"2024-09-17T05:37:10.297512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:19.175185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314806+0000","last_change":"2024-09-17T05:37:10.313944+0000","last_active":"2024-09-17T05:37:10.314806+0000","last_peered":"2024-09-17T05:37:10.314806+0000","last_clean":"2024-09-17T05:37:10.314806+0000","last_became_active":"2024-09-17T05:37:10.313645+0000","last_became_peered":"2024-09-17T05:37:10.313645+0000","last_unstale":"2024-09-17T05:37:10.314806+0000","last_undegraded":"2024-09-17T05:37:10.314806+0000","last_fullsized":"2024-09-17T05:37:10.314806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:24.645311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.277885+0000","last_change":"2024-09-17T05:37:09.287204+0000","last_active":"2024-09-17T05:37:10.277885+0000","last_peered":"2024-09-17T05:37:10.277885+0000","last_clean":"2024-09-17T05:37:10.277885+0000","last_became_active":"2024-09-17T05:37:09.286409+0000","last_became_peered":"2024-09-17T05:37:09.286409+0000","last_unstale":"2024-09-17T05:37:10.277885+0000","last_undegraded":"2024-09-17T05:37:10.277885+0000","last_fullsized":"2024-09-17T05:37:10.277885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:10.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342549+0000","last_change":"2024-09-17T05:37:10.308966+0000","last_active":"2024-09-17T05:37:11.342549+0000","last_peered":"2024-09-17T05:37:11.342549+0000","last_clean":"2024-09-17T05:37:11.342549+0000","last_became_active":"2024-09-17T05:37:10.308588+0000","last_became_peered":"2024-09-17T05:37:10.308588+0000","last_unstale":"2024-09-17T05:37:11.342549+0000","last_undegraded":"2024-09-17T05:37:11.342549+0000","last_fullsized":"2024-09-17T05:37:11.342549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.595377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.285475+0000","last_change":"2024-09-17T05:37:09.303111+0000","last_active":"2024-09-17T05:37:10.285475+0000","last_peered":"2024-09-17T05:37:10.285475+0000","last_clean":"2024-09-17T05:37:10.285475+0000","last_became_active":"2024-09-17T05:37:09.302249+0000","last_became_peered":"2024-09-17T05:37:09.302249+0000","last_unstale":"2024-09-17T05:37:10.285475+0000","last_undegraded":"2024-09-17T05:37:10.285475+0000","last_fullsized":"2024-09-17T05:37:10.285475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:22.177493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.306890+0000","last_change":"2024-09-17T05:37:10.304387+0000","last_active":"2024-09-17T05:37:10.306890+0000","last_peered":"2024-09-17T05:37:10.306890+0000","last_clean":"2024-09-17T05:37:10.306890+0000","last_became_active":"2024-09-17T05:37:10.304050+0000","last_became_peered":"2024-09-17T05:37:10.304050+0000","last_unstale":"2024-09-17T05:37:10.306890+0000","last_undegraded":"2024-09-17T05:37:10.306890+0000","last_fullsized":"2024-09-17T05:37:10.306890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:30.398490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.296122+0000","last_change":"2024-09-17T05:37:09.296603+0000","last_active":"2024-09-17T05:37:10.296122+0000","last_peered":"2024-09-17T05:37:10.296122+0000","last_clean":"2024-09-17T05:37:10.296122+0000","last_became_active":"2024-09-17T05:37:09.296219+0000","last_became_peered":"2024-09-17T05:37:09.296219+0000","last_unstale":"2024-09-17T05:37:10.296122+0000","last_undegraded":"2024-09-17T05:37:10.296122+0000","last_fullsized":"2024-09-17T05:37:10.296122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:05.176894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311922+0000","last_change":"2024-09-17T05:37:10.294487+0000","last_active":"2024-09-17T05:37:10.311922+0000","last_peered":"2024-09-17T05:37:10.311922+0000","last_clean":"2024-09-17T05:37:10.311922+0000","last_became_active":"2024-09-17T05:37:10.294167+0000","last_became_peered":"2024-09-17T05:37:10.294167+0000","last_unstale":"2024-09-17T05:37:10.311922+0000","last_undegraded":"2024-09-17T05:37:10.311922+0000","last_fullsized":"2024-09-17T05:37:10.311922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:10.993647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.279772+0000","last_change":"2024-09-17T05:37:09.301772+0000","last_active":"2024-09-17T05:37:10.279772+0000","last_peered":"2024-09-17T05:37:10.279772+0000","last_clean":"2024-09-17T05:37:10.279772+0000","last_became_active":"2024-09-17T05:37:09.301490+0000","last_became_peered":"2024-09-17T05:37:09.301490+0000","last_unstale":"2024-09-17T05:37:10.279772+0000","last_undegraded":"2024-09-17T05:37:10.279772+0000","last_fullsized":"2024-09-17T05:37:10.279772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:45.359820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.318862+0000","last_change":"2024-09-17T05:37:10.305679+0000","last_active":"2024-09-17T05:37:10.318862+0000","last_peered":"2024-09-17T05:37:10.318862+0000","last_clean":"2024-09-17T05:37:10.318862+0000","last_became_active":"2024-09-17T05:37:10.305351+0000","last_became_peered":"2024-09-17T05:37:10.305351+0000","last_unstale":"2024-09-17T05:37:10.318862+0000","last_undegraded":"2024-09-17T05:37:10.318862+0000","last_fullsized":"2024-09-17T05:37:10.318862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:25.159557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.290905+0000","last_change":"2024-09-17T05:37:09.303368+0000","last_active":"2024-09-17T05:37:10.290905+0000","last_peered":"2024-09-17T05:37:10.290905+0000","last_clean":"2024-09-17T05:37:10.290905+0000","last_became_active":"2024-09-17T05:37:09.303009+0000","last_became_peered":"2024-09-17T05:37:09.303009+0000","last_unstale":"2024-09-17T05:37:10.290905+0000","last_undegraded":"2024-09-17T05:37:10.290905+0000","last_fullsized":"2024-09-17T05:37:10.290905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":143,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.276644+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:37:10.276644+0000","last_peered":"2024-09-17T05:37:10.276644+0000","last_clean":"2024-09-17T05:37:10.276644+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:37:10.276644+0000","last_undegraded":"2024-09-17T05:37:10.276644+0000","last_fullsized":"2024-09-17T05:37:10.276644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":188160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":771291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":180923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":180923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":190284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":778480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":450560,"data_stored":188182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:14.492 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:14.646 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:37:14.646+0000 7f7fbc200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 -- 172.21.15.44:0/2730734540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c06e390 msgr2=0x7f620c0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 --2- 172.21.15.44:0/2730734540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c06e390 0x7f620c0cdbf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f620c072de0 tx=0x7f61f401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 -- 172.21.15.44:0/2730734540 shutdown_connections 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 --2- 172.21.15.44:0/2730734540 >> v2:172.21.15.86:3300/0 conn(0x7f620c0ce130 0x7f620c0ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 --2- 172.21.15.44:0/2730734540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c06e390 0x7f620c0cdbf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 --2- 172.21.15.44:0/2730734540 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f620c0b5880 0x7f620c06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 -- 172.21.15.44:0/2730734540 >> 172.21.15.44:0/2730734540 conn(0x7f620c0ccaa0 msgr2=0x7f620c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 -- 172.21.15.44:0/2730734540 shutdown_connections 2024-09-17T05:37:14.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.686+0000 7f6211000640 1 -- 172.21.15.44:0/2730734540 wait complete. 2024-09-17T05:37:14.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 Processor -- start 2024-09-17T05:37:14.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 -- start start 2024-09-17T05:37:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f620c06e390 0x7f620c15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c0b5880 0x7f620c166790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f620c0ce130 0x7f620c09ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f620c070c70 con 0x7f620c0b5880 2024-09-17T05:37:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f620c070af0 con 0x7f620c0ce130 2024-09-17T05:37:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f620c070df0 con 0x7f620c06e390 2024-09-17T05:37:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c0b5880 0x7f620c166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c0b5880 0x7f620c166790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51878/0 (socket says 172.21.15.44:51878) 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 -- 172.21.15.44:0/1415170007 learned_addr learned my addr 172.21.15.44:0/1415170007 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6209e00640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f620c06e390 0x7f620c15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f620a800640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f620c0ce130 0x7f620c09ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 -- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f620c06e390 msgr2=0x7f620c15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f620c06e390 0x7f620c15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 -- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f620c0ce130 msgr2=0x7f620c09ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f620c0ce130 0x7f620c09ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 -- 172.21.15.44:0/1415170007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c15b1b0 con 0x7f620c0b5880 2024-09-17T05:37:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6203e00640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c0b5880 0x7f620c166790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f61f401af70 tx=0x7f61f40a5540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:14.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6202000640 1 -- 172.21.15.44:0/1415170007 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f40bb070 con 0x7f620c0b5880 2024-09-17T05:37:14.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6202000640 1 -- 172.21.15.44:0/1415170007 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61f40043b0 con 0x7f620c0b5880 2024-09-17T05:37:14.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c0cc0e0 con 0x7f620c0b5880 2024-09-17T05:37:14.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6202000640 1 -- 172.21.15.44:0/1415170007 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f40b2040 con 0x7f620c0b5880 2024-09-17T05:37:14.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.690+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c09ab70 con 0x7f620c0b5880 2024-09-17T05:37:14.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.694+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620c06de50 con 0x7f620c0b5880 2024-09-17T05:37:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.694+0000 7f6202000640 1 -- 172.21.15.44:0/1415170007 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f61f40be070 con 0x7f620c0b5880 2024-09-17T05:37:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.694+0000 7f6202000640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61e8073230 0x7f61e8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.694+0000 7f6202000640 1 -- 172.21.15.44:0/1415170007 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f61f412da30 con 0x7f620c0b5880 2024-09-17T05:37:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.694+0000 7f6209e00640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61e8073230 0x7f61e8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.698+0000 7f6209e00640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61e8073230 0x7f61e8075740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00bad0 tx=0x7f61fc00b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:14.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.698+0000 7f6202000640 1 -- 172.21.15.44:0/1415170007 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f61f40164b0 con 0x7f620c0b5880 2024-09-17T05:37:14.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.874+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f620c0a11f0 con 0x7f61e8073230 2024-09-17T05:37:14.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.878+0000 7f6202000640 1 -- 172.21.15.44:0/1415170007 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f620c0a11f0 con 0x7f61e8073230 2024-09-17T05:37:14.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:37:14.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61e8073230 msgr2=0x7f61e8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61e8073230 0x7f61e8075740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00bad0 tx=0x7f61fc00b260 comp rx=0 tx=0).stop 2024-09-17T05:37:14.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c0b5880 msgr2=0x7f620c166790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c0b5880 0x7f620c166790 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f61f401af70 tx=0x7f61f40a5540 comp rx=0 tx=0).stop 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 shutdown_connections 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61e8073230 0x7f61e8075740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f620c0ce130 0x7f620c09ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f620c0b5880 0x7f620c166790 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 --2- 172.21.15.44:0/1415170007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f620c06e390 0x7f620c15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 >> 172.21.15.44:0/1415170007 conn(0x7f620c0ccaa0 msgr2=0x7f620c15bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 shutdown_connections 2024-09-17T05:37:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:14.882+0000 7f6211000640 1 -- 172.21.15.44:0/1415170007 wait complete. 2024-09-17T05:37:14.903 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-17T05:37:14.272868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220888,"kb_used_data":4628,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753832,"statfs":{"total":773094113280,"available":772867923968,"internally_reserved":0,"allocated":4739072,"data_stored":2673059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001247"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313182+0000","last_change":"2024-09-17T05:37:10.302869+0000","last_active":"2024-09-17T05:37:10.313182+0000","last_peered":"2024-09-17T05:37:10.313182+0000","last_clean":"2024-09-17T05:37:10.313182+0000","last_became_active":"2024-09-17T05:37:10.302558+0000","last_became_peered":"2024-09-17T05:37:10.302558+0000","last_unstale":"2024-09-17T05:37:10.313182+0000","last_undegraded":"2024-09-17T05:37:10.313182+0000","last_fullsized":"2024-09-17T05:37:10.313182+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:47.920043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342126+0000","last_change":"2024-09-17T05:37:10.303217+0000","last_active":"2024-09-17T05:37:11.342126+0000","last_peered":"2024-09-17T05:37:11.342126+0000","last_clean":"2024-09-17T05:37:11.342126+0000","last_became_active":"2024-09-17T05:37:10.302148+0000","last_became_peered":"2024-09-17T05:37:10.302148+0000","last_unstale":"2024-09-17T05:37:11.342126+0000","last_undegraded":"2024-09-17T05:37:11.342126+0000","last_fullsized":"2024-09-17T05:37:11.342126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:57.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.322348+0000","last_change":"2024-09-17T05:37:10.319510+0000","last_active":"2024-09-17T05:37:10.322348+0000","last_peered":"2024-09-17T05:37:10.322348+0000","last_clean":"2024-09-17T05:37:10.322348+0000","last_became_active":"2024-09-17T05:37:10.319191+0000","last_became_peered":"2024-09-17T05:37:10.319191+0000","last_unstale":"2024-09-17T05:37:10.322348+0000","last_undegraded":"2024-09-17T05:37:10.322348+0000","last_fullsized":"2024-09-17T05:37:10.322348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:55.121843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313285+0000","last_change":"2024-09-17T05:37:10.304159+0000","last_active":"2024-09-17T05:37:10.313285+0000","last_peered":"2024-09-17T05:37:10.313285+0000","last_clean":"2024-09-17T05:37:10.313285+0000","last_became_active":"2024-09-17T05:37:10.303835+0000","last_became_peered":"2024-09-17T05:37:10.303835+0000","last_unstale":"2024-09-17T05:37:10.313285+0000","last_undegraded":"2024-09-17T05:37:10.313285+0000","last_fullsized":"2024-09-17T05:37:10.313285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:53.293779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.319934+0000","last_change":"2024-09-17T05:37:10.317889+0000","last_active":"2024-09-17T05:37:10.319934+0000","last_peered":"2024-09-17T05:37:10.319934+0000","last_clean":"2024-09-17T05:37:10.319934+0000","last_became_active":"2024-09-17T05:37:10.317629+0000","last_became_peered":"2024-09-17T05:37:10.317629+0000","last_unstale":"2024-09-17T05:37:10.319934+0000","last_undegraded":"2024-09-17T05:37:10.319934+0000","last_fullsized":"2024-09-17T05:37:10.319934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:28.310605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341884+0000","last_change":"2024-09-17T05:37:10.287043+0000","last_active":"2024-09-17T05:37:11.341884+0000","last_peered":"2024-09-17T05:37:11.341884+0000","last_clean":"2024-09-17T05:37:11.341884+0000","last_became_active":"2024-09-17T05:37:10.286736+0000","last_became_peered":"2024-09-17T05:37:10.286736+0000","last_unstale":"2024-09-17T05:37:11.341884+0000","last_undegraded":"2024-09-17T05:37:11.341884+0000","last_fullsized":"2024-09-17T05:37:11.341884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:56.748305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.310680+0000","last_change":"2024-09-17T05:37:10.306272+0000","last_active":"2024-09-17T05:37:10.310680+0000","last_peered":"2024-09-17T05:37:10.310680+0000","last_clean":"2024-09-17T05:37:10.310680+0000","last_became_active":"2024-09-17T05:37:10.305736+0000","last_became_peered":"2024-09-17T05:37:10.305736+0000","last_unstale":"2024-09-17T05:37:10.310680+0000","last_undegraded":"2024-09-17T05:37:10.310680+0000","last_fullsized":"2024-09-17T05:37:10.310680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:53.446577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314979+0000","last_change":"2024-09-17T05:37:10.309885+0000","last_active":"2024-09-17T05:37:10.314979+0000","last_peered":"2024-09-17T05:37:10.314979+0000","last_clean":"2024-09-17T05:37:10.314979+0000","last_became_active":"2024-09-17T05:37:10.309531+0000","last_became_peered":"2024-09-17T05:37:10.309531+0000","last_unstale":"2024-09-17T05:37:10.314979+0000","last_undegraded":"2024-09-17T05:37:10.314979+0000","last_fullsized":"2024-09-17T05:37:10.314979+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:45:54.964096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.322346+0000","last_change":"2024-09-17T05:37:10.319247+0000","last_active":"2024-09-17T05:37:10.322346+0000","last_peered":"2024-09-17T05:37:10.322346+0000","last_clean":"2024-09-17T05:37:10.322346+0000","last_became_active":"2024-09-17T05:37:10.318911+0000","last_became_peered":"2024-09-17T05:37:10.318911+0000","last_unstale":"2024-09-17T05:37:10.322346+0000","last_undegraded":"2024-09-17T05:37:10.322346+0000","last_fullsized":"2024-09-17T05:37:10.322346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:49.892144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.323895+0000","last_change":"2024-09-17T05:37:10.322663+0000","last_active":"2024-09-17T05:37:10.323895+0000","last_peered":"2024-09-17T05:37:10.323895+0000","last_clean":"2024-09-17T05:37:10.323895+0000","last_became_active":"2024-09-17T05:37:10.322407+0000","last_became_peered":"2024-09-17T05:37:10.322407+0000","last_unstale":"2024-09-17T05:37:10.323895+0000","last_undegraded":"2024-09-17T05:37:10.323895+0000","last_fullsized":"2024-09-17T05:37:10.323895+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:18.106293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.318226+0000","last_change":"2024-09-17T05:37:10.312079+0000","last_active":"2024-09-17T05:37:10.318226+0000","last_peered":"2024-09-17T05:37:10.318226+0000","last_clean":"2024-09-17T05:37:10.318226+0000","last_became_active":"2024-09-17T05:37:10.311064+0000","last_became_peered":"2024-09-17T05:37:10.311064+0000","last_unstale":"2024-09-17T05:37:10.318226+0000","last_undegraded":"2024-09-17T05:37:10.318226+0000","last_fullsized":"2024-09-17T05:37:10.318226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:20.838972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.308430+0000","last_change":"2024-09-17T05:37:10.302321+0000","last_active":"2024-09-17T05:37:10.308430+0000","last_peered":"2024-09-17T05:37:10.308430+0000","last_clean":"2024-09-17T05:37:10.308430+0000","last_became_active":"2024-09-17T05:37:10.301616+0000","last_became_peered":"2024-09-17T05:37:10.301616+0000","last_unstale":"2024-09-17T05:37:10.308430+0000","last_undegraded":"2024-09-17T05:37:10.308430+0000","last_fullsized":"2024-09-17T05:37:10.308430+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:19.571024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297921+0000","last_change":"2024-09-17T05:37:10.287977+0000","last_active":"2024-09-17T05:37:10.297921+0000","last_peered":"2024-09-17T05:37:10.297921+0000","last_clean":"2024-09-17T05:37:10.297921+0000","last_became_active":"2024-09-17T05:37:10.287754+0000","last_became_peered":"2024-09-17T05:37:10.287754+0000","last_unstale":"2024-09-17T05:37:10.297921+0000","last_undegraded":"2024-09-17T05:37:10.297921+0000","last_fullsized":"2024-09-17T05:37:10.297921+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:09.948367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312104+0000","last_change":"2024-09-17T05:37:10.308739+0000","last_active":"2024-09-17T05:37:10.312104+0000","last_peered":"2024-09-17T05:37:10.312104+0000","last_clean":"2024-09-17T05:37:10.312104+0000","last_became_active":"2024-09-17T05:37:10.308274+0000","last_became_peered":"2024-09-17T05:37:10.308274+0000","last_unstale":"2024-09-17T05:37:10.312104+0000","last_undegraded":"2024-09-17T05:37:10.312104+0000","last_fullsized":"2024-09-17T05:37:10.312104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:30.538775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.320443+0000","last_change":"2024-09-17T05:37:10.308812+0000","last_active":"2024-09-17T05:37:10.320443+0000","last_peered":"2024-09-17T05:37:10.320443+0000","last_clean":"2024-09-17T05:37:10.320443+0000","last_became_active":"2024-09-17T05:37:10.308474+0000","last_became_peered":"2024-09-17T05:37:10.308474+0000","last_unstale":"2024-09-17T05:37:10.320443+0000","last_undegraded":"2024-09-17T05:37:10.320443+0000","last_fullsized":"2024-09-17T05:37:10.320443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:21.600803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297822+0000","last_change":"2024-09-17T05:37:10.287765+0000","last_active":"2024-09-17T05:37:10.297822+0000","last_peered":"2024-09-17T05:37:10.297822+0000","last_clean":"2024-09-17T05:37:10.297822+0000","last_became_active":"2024-09-17T05:37:10.287461+0000","last_became_peered":"2024-09-17T05:37:10.287461+0000","last_unstale":"2024-09-17T05:37:10.297822+0000","last_undegraded":"2024-09-17T05:37:10.297822+0000","last_fullsized":"2024-09-17T05:37:10.297822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:24.983578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325114+0000","last_change":"2024-09-17T05:37:10.320018+0000","last_active":"2024-09-17T05:37:10.325114+0000","last_peered":"2024-09-17T05:37:10.325114+0000","last_clean":"2024-09-17T05:37:10.325114+0000","last_became_active":"2024-09-17T05:37:10.319655+0000","last_became_peered":"2024-09-17T05:37:10.319655+0000","last_unstale":"2024-09-17T05:37:10.325114+0000","last_undegraded":"2024-09-17T05:37:10.325114+0000","last_fullsized":"2024-09-17T05:37:10.325114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:11.217033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325318+0000","last_change":"2024-09-17T05:37:10.323509+0000","last_active":"2024-09-17T05:37:10.325318+0000","last_peered":"2024-09-17T05:37:10.325318+0000","last_clean":"2024-09-17T05:37:10.325318+0000","last_became_active":"2024-09-17T05:37:10.321765+0000","last_became_peered":"2024-09-17T05:37:10.321765+0000","last_unstale":"2024-09-17T05:37:10.325318+0000","last_undegraded":"2024-09-17T05:37:10.325318+0000","last_fullsized":"2024-09-17T05:37:10.325318+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:06.165589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.302212+0000","last_change":"2024-09-17T05:37:10.298983+0000","last_active":"2024-09-17T05:37:10.302212+0000","last_peered":"2024-09-17T05:37:10.302212+0000","last_clean":"2024-09-17T05:37:10.302212+0000","last_became_active":"2024-09-17T05:37:10.297093+0000","last_became_peered":"2024-09-17T05:37:10.297093+0000","last_unstale":"2024-09-17T05:37:10.302212+0000","last_undegraded":"2024-09-17T05:37:10.302212+0000","last_fullsized":"2024-09-17T05:37:10.302212+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:16.251054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312190+0000","last_change":"2024-09-17T05:37:10.308027+0000","last_active":"2024-09-17T05:37:10.312190+0000","last_peered":"2024-09-17T05:37:10.312190+0000","last_clean":"2024-09-17T05:37:10.312190+0000","last_became_active":"2024-09-17T05:37:10.307833+0000","last_became_peered":"2024-09-17T05:37:10.307833+0000","last_unstale":"2024-09-17T05:37:10.312190+0000","last_undegraded":"2024-09-17T05:37:10.312190+0000","last_fullsized":"2024-09-17T05:37:10.312190+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:28.882118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.317064+0000","last_change":"2024-09-17T05:37:10.304293+0000","last_active":"2024-09-17T05:37:10.317064+0000","last_peered":"2024-09-17T05:37:10.317064+0000","last_clean":"2024-09-17T05:37:10.317064+0000","last_became_active":"2024-09-17T05:37:10.303967+0000","last_became_peered":"2024-09-17T05:37:10.303967+0000","last_unstale":"2024-09-17T05:37:10.317064+0000","last_undegraded":"2024-09-17T05:37:10.317064+0000","last_fullsized":"2024-09-17T05:37:10.317064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:52.656960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324779+0000","last_change":"2024-09-17T05:37:10.317942+0000","last_active":"2024-09-17T05:37:10.324779+0000","last_peered":"2024-09-17T05:37:10.324779+0000","last_clean":"2024-09-17T05:37:10.324779+0000","last_became_active":"2024-09-17T05:37:10.311798+0000","last_became_peered":"2024-09-17T05:37:10.311798+0000","last_unstale":"2024-09-17T05:37:10.324779+0000","last_undegraded":"2024-09-17T05:37:10.324779+0000","last_fullsized":"2024-09-17T05:37:10.324779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:33.568239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.320416+0000","last_change":"2024-09-17T05:37:10.308173+0000","last_active":"2024-09-17T05:37:10.320416+0000","last_peered":"2024-09-17T05:37:10.320416+0000","last_clean":"2024-09-17T05:37:10.320416+0000","last_became_active":"2024-09-17T05:37:10.307806+0000","last_became_peered":"2024-09-17T05:37:10.307806+0000","last_unstale":"2024-09-17T05:37:10.320416+0000","last_undegraded":"2024-09-17T05:37:10.320416+0000","last_fullsized":"2024-09-17T05:37:10.320416+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:35.706967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313216+0000","last_change":"2024-09-17T05:37:10.300452+0000","last_active":"2024-09-17T05:37:10.313216+0000","last_peered":"2024-09-17T05:37:10.313216+0000","last_clean":"2024-09-17T05:37:10.313216+0000","last_became_active":"2024-09-17T05:37:10.300144+0000","last_became_peered":"2024-09-17T05:37:10.300144+0000","last_unstale":"2024-09-17T05:37:10.313216+0000","last_undegraded":"2024-09-17T05:37:10.313216+0000","last_fullsized":"2024-09-17T05:37:10.313216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:41.256286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297240+0000","last_change":"2024-09-17T05:37:10.293736+0000","last_active":"2024-09-17T05:37:10.297240+0000","last_peered":"2024-09-17T05:37:10.297240+0000","last_clean":"2024-09-17T05:37:10.297240+0000","last_became_active":"2024-09-17T05:37:10.293393+0000","last_became_peered":"2024-09-17T05:37:10.293393+0000","last_unstale":"2024-09-17T05:37:10.297240+0000","last_undegraded":"2024-09-17T05:37:10.297240+0000","last_fullsized":"2024-09-17T05:37:10.297240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:10.993647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311143+0000","last_change":"2024-09-17T05:37:10.297739+0000","last_active":"2024-09-17T05:37:10.311143+0000","last_peered":"2024-09-17T05:37:10.311143+0000","last_clean":"2024-09-17T05:37:10.311143+0000","last_became_active":"2024-09-17T05:37:10.294972+0000","last_became_peered":"2024-09-17T05:37:10.294972+0000","last_unstale":"2024-09-17T05:37:10.311143+0000","last_undegraded":"2024-09-17T05:37:10.311143+0000","last_fullsized":"2024-09-17T05:37:10.311143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:05.877719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.316670+0000","last_change":"2024-09-17T05:37:10.307169+0000","last_active":"2024-09-17T05:37:10.316670+0000","last_peered":"2024-09-17T05:37:10.316670+0000","last_clean":"2024-09-17T05:37:10.316670+0000","last_became_active":"2024-09-17T05:37:10.306532+0000","last_became_peered":"2024-09-17T05:37:10.306532+0000","last_unstale":"2024-09-17T05:37:10.316670+0000","last_undegraded":"2024-09-17T05:37:10.316670+0000","last_fullsized":"2024-09-17T05:37:10.316670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:01.745851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.298059+0000","last_change":"2024-09-17T05:37:10.289841+0000","last_active":"2024-09-17T05:37:10.298059+0000","last_peered":"2024-09-17T05:37:10.298059+0000","last_clean":"2024-09-17T05:37:10.298059+0000","last_became_active":"2024-09-17T05:37:10.289553+0000","last_became_peered":"2024-09-17T05:37:10.289553+0000","last_unstale":"2024-09-17T05:37:10.298059+0000","last_undegraded":"2024-09-17T05:37:10.298059+0000","last_fullsized":"2024-09-17T05:37:10.298059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:22.756800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324696+0000","last_change":"2024-09-17T05:37:10.317277+0000","last_active":"2024-09-17T05:37:10.324696+0000","last_peered":"2024-09-17T05:37:10.324696+0000","last_clean":"2024-09-17T05:37:10.324696+0000","last_became_active":"2024-09-17T05:37:10.316953+0000","last_became_peered":"2024-09-17T05:37:10.316953+0000","last_unstale":"2024-09-17T05:37:10.324696+0000","last_undegraded":"2024-09-17T05:37:10.324696+0000","last_fullsized":"2024-09-17T05:37:10.324696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:23.208279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.305352+0000","last_change":"2024-09-17T05:37:10.302583+0000","last_active":"2024-09-17T05:37:10.305352+0000","last_peered":"2024-09-17T05:37:10.305352+0000","last_clean":"2024-09-17T05:37:10.305352+0000","last_became_active":"2024-09-17T05:37:10.302321+0000","last_became_peered":"2024-09-17T05:37:10.302321+0000","last_unstale":"2024-09-17T05:37:10.305352+0000","last_undegraded":"2024-09-17T05:37:10.305352+0000","last_fullsized":"2024-09-17T05:37:10.305352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:27.101156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.298185+0000","last_change":"2024-09-17T05:37:10.291822+0000","last_active":"2024-09-17T05:37:10.298185+0000","last_peered":"2024-09-17T05:37:10.298185+0000","last_clean":"2024-09-17T05:37:10.298185+0000","last_became_active":"2024-09-17T05:37:10.287439+0000","last_became_peered":"2024-09-17T05:37:10.287439+0000","last_unstale":"2024-09-17T05:37:10.298185+0000","last_undegraded":"2024-09-17T05:37:10.298185+0000","last_fullsized":"2024-09-17T05:37:10.298185+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:00.173112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314324+0000","last_change":"2024-09-17T05:37:10.311426+0000","last_active":"2024-09-17T05:37:10.314324+0000","last_peered":"2024-09-17T05:37:10.314324+0000","last_clean":"2024-09-17T05:37:10.314324+0000","last_became_active":"2024-09-17T05:37:10.308330+0000","last_became_peered":"2024-09-17T05:37:10.308330+0000","last_unstale":"2024-09-17T05:37:10.314324+0000","last_undegraded":"2024-09-17T05:37:10.314324+0000","last_fullsized":"2024-09-17T05:37:10.314324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:42.185117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325127+0000","last_change":"2024-09-17T05:37:10.320214+0000","last_active":"2024-09-17T05:37:10.325127+0000","last_peered":"2024-09-17T05:37:10.325127+0000","last_clean":"2024-09-17T05:37:10.325127+0000","last_became_active":"2024-09-17T05:37:10.318837+0000","last_became_peered":"2024-09-17T05:37:10.318837+0000","last_unstale":"2024-09-17T05:37:10.325127+0000","last_undegraded":"2024-09-17T05:37:10.325127+0000","last_fullsized":"2024-09-17T05:37:10.325127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:26.216889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.302057+0000","last_change":"2024-09-17T05:37:09.291844+0000","last_active":"2024-09-17T05:37:10.302057+0000","last_peered":"2024-09-17T05:37:10.302057+0000","last_clean":"2024-09-17T05:37:10.302057+0000","last_became_active":"2024-09-17T05:37:09.291308+0000","last_became_peered":"2024-09-17T05:37:09.291308+0000","last_unstale":"2024-09-17T05:37:10.302057+0000","last_undegraded":"2024-09-17T05:37:10.302057+0000","last_fullsized":"2024-09-17T05:37:10.302057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:15.955812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341591+0000","last_change":"2024-09-17T05:37:10.312170+0000","last_active":"2024-09-17T05:37:11.341591+0000","last_peered":"2024-09-17T05:37:11.341591+0000","last_clean":"2024-09-17T05:37:11.341591+0000","last_became_active":"2024-09-17T05:37:10.311797+0000","last_became_peered":"2024-09-17T05:37:10.311797+0000","last_unstale":"2024-09-17T05:37:11.341591+0000","last_undegraded":"2024-09-17T05:37:11.341591+0000","last_fullsized":"2024-09-17T05:37:11.341591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:36.957718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342287+0000","last_change":"2024-09-17T05:37:09.298420+0000","last_active":"2024-09-17T05:37:11.342287+0000","last_peered":"2024-09-17T05:37:11.342287+0000","last_clean":"2024-09-17T05:37:11.342287+0000","last_became_active":"2024-09-17T05:37:09.298033+0000","last_became_peered":"2024-09-17T05:37:09.298033+0000","last_unstale":"2024-09-17T05:37:11.342287+0000","last_undegraded":"2024-09-17T05:37:11.342287+0000","last_fullsized":"2024-09-17T05:37:11.342287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:04.895200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324946+0000","last_change":"2024-09-17T05:37:10.318324+0000","last_active":"2024-09-17T05:37:10.324946+0000","last_peered":"2024-09-17T05:37:10.324946+0000","last_clean":"2024-09-17T05:37:10.324946+0000","last_became_active":"2024-09-17T05:37:10.317864+0000","last_became_peered":"2024-09-17T05:37:10.317864+0000","last_unstale":"2024-09-17T05:37:10.324946+0000","last_undegraded":"2024-09-17T05:37:10.324946+0000","last_fullsized":"2024-09-17T05:37:10.324946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:40.368972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314107+0000","last_change":"2024-09-17T05:37:09.298667+0000","last_active":"2024-09-17T05:37:10.314107+0000","last_peered":"2024-09-17T05:37:10.314107+0000","last_clean":"2024-09-17T05:37:10.314107+0000","last_became_active":"2024-09-17T05:37:09.297439+0000","last_became_peered":"2024-09-17T05:37:09.297439+0000","last_unstale":"2024-09-17T05:37:10.314107+0000","last_undegraded":"2024-09-17T05:37:10.314107+0000","last_fullsized":"2024-09-17T05:37:10.314107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:15.247876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342000+0000","last_change":"2024-09-17T05:37:10.310957+0000","last_active":"2024-09-17T05:37:11.342000+0000","last_peered":"2024-09-17T05:37:11.342000+0000","last_clean":"2024-09-17T05:37:11.342000+0000","last_became_active":"2024-09-17T05:37:10.310620+0000","last_became_peered":"2024-09-17T05:37:10.310620+0000","last_unstale":"2024-09-17T05:37:11.342000+0000","last_undegraded":"2024-09-17T05:37:11.342000+0000","last_fullsized":"2024-09-17T05:37:11.342000+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:50.034609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311325+0000","last_change":"2024-09-17T05:37:09.307251+0000","last_active":"2024-09-17T05:37:10.311325+0000","last_peered":"2024-09-17T05:37:10.311325+0000","last_clean":"2024-09-17T05:37:10.311325+0000","last_became_active":"2024-09-17T05:37:09.306880+0000","last_became_peered":"2024-09-17T05:37:09.306880+0000","last_unstale":"2024-09-17T05:37:10.311325+0000","last_undegraded":"2024-09-17T05:37:10.311325+0000","last_fullsized":"2024-09-17T05:37:10.311325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:22.177493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.294903+0000","last_change":"2024-09-17T05:37:10.285783+0000","last_active":"2024-09-17T05:37:10.294903+0000","last_peered":"2024-09-17T05:37:10.294903+0000","last_clean":"2024-09-17T05:37:10.294903+0000","last_became_active":"2024-09-17T05:37:10.285426+0000","last_became_peered":"2024-09-17T05:37:10.285426+0000","last_unstale":"2024-09-17T05:37:10.294903+0000","last_undegraded":"2024-09-17T05:37:10.294903+0000","last_fullsized":"2024-09-17T05:37:10.294903+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:58.987093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.302824+0000","last_change":"2024-09-17T05:37:09.291168+0000","last_active":"2024-09-17T05:37:10.302824+0000","last_peered":"2024-09-17T05:37:10.302824+0000","last_clean":"2024-09-17T05:37:10.302824+0000","last_became_active":"2024-09-17T05:37:09.290820+0000","last_became_peered":"2024-09-17T05:37:09.290820+0000","last_unstale":"2024-09-17T05:37:10.302824+0000","last_undegraded":"2024-09-17T05:37:10.302824+0000","last_fullsized":"2024-09-17T05:37:10.302824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:27.516070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.316491+0000","last_change":"2024-09-17T05:37:10.304051+0000","last_active":"2024-09-17T05:37:10.316491+0000","last_peered":"2024-09-17T05:37:10.316491+0000","last_clean":"2024-09-17T05:37:10.316491+0000","last_became_active":"2024-09-17T05:37:10.303677+0000","last_became_peered":"2024-09-17T05:37:10.303677+0000","last_unstale":"2024-09-17T05:37:10.316491+0000","last_undegraded":"2024-09-17T05:37:10.316491+0000","last_fullsized":"2024-09-17T05:37:10.316491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:56.339588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.308796+0000","last_change":"2024-09-17T05:37:09.299825+0000","last_active":"2024-09-17T05:37:10.308796+0000","last_peered":"2024-09-17T05:37:10.308796+0000","last_clean":"2024-09-17T05:37:10.308796+0000","last_became_active":"2024-09-17T05:37:09.299475+0000","last_became_peered":"2024-09-17T05:37:09.299475+0000","last_unstale":"2024-09-17T05:37:10.308796+0000","last_undegraded":"2024-09-17T05:37:10.308796+0000","last_fullsized":"2024-09-17T05:37:10.308796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:23.204117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.325165+0000","last_change":"2024-09-17T05:37:10.322331+0000","last_active":"2024-09-17T05:37:10.325165+0000","last_peered":"2024-09-17T05:37:10.325165+0000","last_clean":"2024-09-17T05:37:10.325165+0000","last_became_active":"2024-09-17T05:37:10.322029+0000","last_became_peered":"2024-09-17T05:37:10.322029+0000","last_unstale":"2024-09-17T05:37:10.325165+0000","last_undegraded":"2024-09-17T05:37:10.325165+0000","last_fullsized":"2024-09-17T05:37:10.325165+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:06.976978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.280056+0000","last_change":"2024-09-17T05:37:09.293573+0000","last_active":"2024-09-17T05:37:10.280056+0000","last_peered":"2024-09-17T05:37:10.280056+0000","last_clean":"2024-09-17T05:37:10.280056+0000","last_became_active":"2024-09-17T05:37:09.293164+0000","last_became_peered":"2024-09-17T05:37:09.293164+0000","last_unstale":"2024-09-17T05:37:10.280056+0000","last_undegraded":"2024-09-17T05:37:10.280056+0000","last_fullsized":"2024-09-17T05:37:10.280056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:08.830753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342497+0000","last_change":"2024-09-17T05:37:10.298355+0000","last_active":"2024-09-17T05:37:11.342497+0000","last_peered":"2024-09-17T05:37:11.342497+0000","last_clean":"2024-09-17T05:37:11.342497+0000","last_became_active":"2024-09-17T05:37:10.290858+0000","last_became_peered":"2024-09-17T05:37:10.290858+0000","last_unstale":"2024-09-17T05:37:11.342497+0000","last_undegraded":"2024-09-17T05:37:11.342497+0000","last_fullsized":"2024-09-17T05:37:11.342497+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:20.515584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.276932+0000","last_change":"2024-09-17T05:37:09.299598+0000","last_active":"2024-09-17T05:37:10.276932+0000","last_peered":"2024-09-17T05:37:10.276932+0000","last_clean":"2024-09-17T05:37:10.276932+0000","last_became_active":"2024-09-17T05:37:09.299277+0000","last_became_peered":"2024-09-17T05:37:09.299277+0000","last_unstale":"2024-09-17T05:37:10.276932+0000","last_undegraded":"2024-09-17T05:37:10.276932+0000","last_fullsized":"2024-09-17T05:37:10.276932+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:08.503589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313388+0000","last_change":"2024-09-17T05:37:10.304218+0000","last_active":"2024-09-17T05:37:10.313388+0000","last_peered":"2024-09-17T05:37:10.313388+0000","last_clean":"2024-09-17T05:37:10.313388+0000","last_became_active":"2024-09-17T05:37:10.303937+0000","last_became_peered":"2024-09-17T05:37:10.303937+0000","last_unstale":"2024-09-17T05:37:10.313388+0000","last_undegraded":"2024-09-17T05:37:10.313388+0000","last_fullsized":"2024-09-17T05:37:10.313388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:36.371338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.283430+0000","last_change":"2024-09-17T05:37:09.295473+0000","last_active":"2024-09-17T05:37:10.283430+0000","last_peered":"2024-09-17T05:37:10.283430+0000","last_clean":"2024-09-17T05:37:10.283430+0000","last_became_active":"2024-09-17T05:37:09.295211+0000","last_became_peered":"2024-09-17T05:37:09.295211+0000","last_unstale":"2024-09-17T05:37:10.283430+0000","last_undegraded":"2024-09-17T05:37:10.283430+0000","last_fullsized":"2024-09-17T05:37:10.283430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:12.063061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.321697+0000","last_change":"2024-09-17T05:37:10.320345+0000","last_active":"2024-09-17T05:37:10.321697+0000","last_peered":"2024-09-17T05:37:10.321697+0000","last_clean":"2024-09-17T05:37:10.321697+0000","last_became_active":"2024-09-17T05:37:10.319946+0000","last_became_peered":"2024-09-17T05:37:10.319946+0000","last_unstale":"2024-09-17T05:37:10.321697+0000","last_undegraded":"2024-09-17T05:37:10.321697+0000","last_fullsized":"2024-09-17T05:37:10.321697+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:56.339588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.300297+0000","last_change":"2024-09-17T05:37:09.303751+0000","last_active":"2024-09-17T05:37:10.300297+0000","last_peered":"2024-09-17T05:37:10.300297+0000","last_clean":"2024-09-17T05:37:10.300297+0000","last_became_active":"2024-09-17T05:37:09.303214+0000","last_became_peered":"2024-09-17T05:37:09.303214+0000","last_unstale":"2024-09-17T05:37:10.300297+0000","last_undegraded":"2024-09-17T05:37:10.300297+0000","last_fullsized":"2024-09-17T05:37:10.300297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:14:32.925636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313627+0000","last_change":"2024-09-17T05:37:10.308412+0000","last_active":"2024-09-17T05:37:10.313627+0000","last_peered":"2024-09-17T05:37:10.313627+0000","last_clean":"2024-09-17T05:37:10.313627+0000","last_became_active":"2024-09-17T05:37:10.308097+0000","last_became_peered":"2024-09-17T05:37:10.308097+0000","last_unstale":"2024-09-17T05:37:10.313627+0000","last_undegraded":"2024-09-17T05:37:10.313627+0000","last_fullsized":"2024-09-17T05:37:10.313627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:25.537868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.317822+0000","last_change":"2024-09-17T05:37:09.305505+0000","last_active":"2024-09-17T05:37:10.317822+0000","last_peered":"2024-09-17T05:37:10.317822+0000","last_clean":"2024-09-17T05:37:10.317822+0000","last_became_active":"2024-09-17T05:37:09.305141+0000","last_became_peered":"2024-09-17T05:37:09.305141+0000","last_unstale":"2024-09-17T05:37:10.317822+0000","last_undegraded":"2024-09-17T05:37:10.317822+0000","last_fullsized":"2024-09-17T05:37:10.317822+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:28.266096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.304283+0000","last_change":"2024-09-17T05:37:10.301624+0000","last_active":"2024-09-17T05:37:10.304283+0000","last_peered":"2024-09-17T05:37:10.304283+0000","last_clean":"2024-09-17T05:37:10.304283+0000","last_became_active":"2024-09-17T05:37:10.301320+0000","last_became_peered":"2024-09-17T05:37:10.301320+0000","last_unstale":"2024-09-17T05:37:10.304283+0000","last_undegraded":"2024-09-17T05:37:10.304283+0000","last_fullsized":"2024-09-17T05:37:10.304283+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:23.767620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314483+0000","last_change":"2024-09-17T05:37:09.299189+0000","last_active":"2024-09-17T05:37:10.314483+0000","last_peered":"2024-09-17T05:37:10.314483+0000","last_clean":"2024-09-17T05:37:10.314483+0000","last_became_active":"2024-09-17T05:37:09.296921+0000","last_became_peered":"2024-09-17T05:37:09.296921+0000","last_unstale":"2024-09-17T05:37:10.314483+0000","last_undegraded":"2024-09-17T05:37:10.314483+0000","last_fullsized":"2024-09-17T05:37:10.314483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:42.564457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.295035+0000","last_change":"2024-09-17T05:37:10.291777+0000","last_active":"2024-09-17T05:37:10.295035+0000","last_peered":"2024-09-17T05:37:10.295035+0000","last_clean":"2024-09-17T05:37:10.295035+0000","last_became_active":"2024-09-17T05:37:10.288575+0000","last_became_peered":"2024-09-17T05:37:10.288575+0000","last_unstale":"2024-09-17T05:37:10.295035+0000","last_undegraded":"2024-09-17T05:37:10.295035+0000","last_fullsized":"2024-09-17T05:37:10.295035+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:29.682828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313241+0000","last_change":"2024-09-17T05:37:09.294860+0000","last_active":"2024-09-17T05:37:10.313241+0000","last_peered":"2024-09-17T05:37:10.313241+0000","last_clean":"2024-09-17T05:37:10.313241+0000","last_became_active":"2024-09-17T05:37:09.294448+0000","last_became_peered":"2024-09-17T05:37:09.294448+0000","last_unstale":"2024-09-17T05:37:10.313241+0000","last_undegraded":"2024-09-17T05:37:10.313241+0000","last_fullsized":"2024-09-17T05:37:10.313241+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:26.995909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.343218+0000","last_change":"2024-09-17T05:37:10.281888+0000","last_active":"2024-09-17T05:37:11.343218+0000","last_peered":"2024-09-17T05:37:11.343218+0000","last_clean":"2024-09-17T05:37:11.343218+0000","last_became_active":"2024-09-17T05:37:10.281547+0000","last_became_peered":"2024-09-17T05:37:10.281547+0000","last_unstale":"2024-09-17T05:37:11.343218+0000","last_undegraded":"2024-09-17T05:37:11.343218+0000","last_fullsized":"2024-09-17T05:37:11.343218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:18.069705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342109+0000","last_change":"2024-09-17T05:37:09.293431+0000","last_active":"2024-09-17T05:37:11.342109+0000","last_peered":"2024-09-17T05:37:11.342109+0000","last_clean":"2024-09-17T05:37:11.342109+0000","last_became_active":"2024-09-17T05:37:09.293087+0000","last_became_peered":"2024-09-17T05:37:09.293087+0000","last_unstale":"2024-09-17T05:37:11.342109+0000","last_undegraded":"2024-09-17T05:37:11.342109+0000","last_fullsized":"2024-09-17T05:37:11.342109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:25.308866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.321161+0000","last_change":"2024-09-17T05:37:10.302578+0000","last_active":"2024-09-17T05:37:10.321161+0000","last_peered":"2024-09-17T05:37:10.321161+0000","last_clean":"2024-09-17T05:37:10.321161+0000","last_became_active":"2024-09-17T05:37:10.302242+0000","last_became_peered":"2024-09-17T05:37:10.302242+0000","last_unstale":"2024-09-17T05:37:10.321161+0000","last_undegraded":"2024-09-17T05:37:10.321161+0000","last_fullsized":"2024-09-17T05:37:10.321161+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:30.538775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.295879+0000","last_change":"2024-09-17T05:37:09.298606+0000","last_active":"2024-09-17T05:37:10.295879+0000","last_peered":"2024-09-17T05:37:10.295879+0000","last_clean":"2024-09-17T05:37:10.295879+0000","last_became_active":"2024-09-17T05:37:09.297679+0000","last_became_peered":"2024-09-17T05:37:09.297679+0000","last_unstale":"2024-09-17T05:37:10.295879+0000","last_undegraded":"2024-09-17T05:37:10.295879+0000","last_fullsized":"2024-09-17T05:37:10.295879+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:01.107282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311967+0000","last_change":"2024-09-17T05:37:10.308797+0000","last_active":"2024-09-17T05:37:10.311967+0000","last_peered":"2024-09-17T05:37:10.311967+0000","last_clean":"2024-09-17T05:37:10.311967+0000","last_became_active":"2024-09-17T05:37:10.308461+0000","last_became_peered":"2024-09-17T05:37:10.308461+0000","last_unstale":"2024-09-17T05:37:10.311967+0000","last_undegraded":"2024-09-17T05:37:10.311967+0000","last_fullsized":"2024-09-17T05:37:10.311967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:50.239840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.301552+0000","last_change":"2024-09-17T05:37:09.285823+0000","last_active":"2024-09-17T05:37:10.301552+0000","last_peered":"2024-09-17T05:37:10.301552+0000","last_clean":"2024-09-17T05:37:10.301552+0000","last_became_active":"2024-09-17T05:37:09.285477+0000","last_became_peered":"2024-09-17T05:37:09.285477+0000","last_unstale":"2024-09-17T05:37:10.301552+0000","last_undegraded":"2024-09-17T05:37:10.301552+0000","last_fullsized":"2024-09-17T05:37:10.301552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341748+0000","last_change":"2024-09-17T05:37:10.300170+0000","last_active":"2024-09-17T05:37:11.341748+0000","last_peered":"2024-09-17T05:37:11.341748+0000","last_clean":"2024-09-17T05:37:11.341748+0000","last_became_active":"2024-09-17T05:37:10.299846+0000","last_became_peered":"2024-09-17T05:37:10.299846+0000","last_unstale":"2024-09-17T05:37:11.341748+0000","last_undegraded":"2024-09-17T05:37:11.341748+0000","last_fullsized":"2024-09-17T05:37:11.341748+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:36.804907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.310949+0000","last_change":"2024-09-17T05:37:09.304347+0000","last_active":"2024-09-17T05:37:10.310949+0000","last_peered":"2024-09-17T05:37:10.310949+0000","last_clean":"2024-09-17T05:37:10.310949+0000","last_became_active":"2024-09-17T05:37:09.303980+0000","last_became_peered":"2024-09-17T05:37:09.303980+0000","last_unstale":"2024-09-17T05:37:10.310949+0000","last_undegraded":"2024-09-17T05:37:10.310949+0000","last_fullsized":"2024-09-17T05:37:10.310949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:05.308798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312716+0000","last_change":"2024-09-17T05:37:10.309586+0000","last_active":"2024-09-17T05:37:10.312716+0000","last_peered":"2024-09-17T05:37:10.312716+0000","last_clean":"2024-09-17T05:37:10.312716+0000","last_became_active":"2024-09-17T05:37:10.309289+0000","last_became_peered":"2024-09-17T05:37:10.309289+0000","last_unstale":"2024-09-17T05:37:10.312716+0000","last_undegraded":"2024-09-17T05:37:10.312716+0000","last_fullsized":"2024-09-17T05:37:10.312716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:44.052188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.317684+0000","last_change":"2024-09-17T05:37:09.306312+0000","last_active":"2024-09-17T05:37:10.317684+0000","last_peered":"2024-09-17T05:37:10.317684+0000","last_clean":"2024-09-17T05:37:10.317684+0000","last_became_active":"2024-09-17T05:37:09.305997+0000","last_became_peered":"2024-09-17T05:37:09.305997+0000","last_unstale":"2024-09-17T05:37:10.317684+0000","last_undegraded":"2024-09-17T05:37:10.317684+0000","last_fullsized":"2024-09-17T05:37:10.317684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:33.104208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.303758+0000","last_change":"2024-09-17T05:37:10.288522+0000","last_active":"2024-09-17T05:37:10.303758+0000","last_peered":"2024-09-17T05:37:10.303758+0000","last_clean":"2024-09-17T05:37:10.303758+0000","last_became_active":"2024-09-17T05:37:10.287422+0000","last_became_peered":"2024-09-17T05:37:10.287422+0000","last_unstale":"2024-09-17T05:37:10.303758+0000","last_undegraded":"2024-09-17T05:37:10.303758+0000","last_fullsized":"2024-09-17T05:37:10.303758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:25.086660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.316704+0000","last_change":"2024-09-17T05:37:09.302465+0000","last_active":"2024-09-17T05:37:10.316704+0000","last_peered":"2024-09-17T05:37:10.316704+0000","last_clean":"2024-09-17T05:37:10.316704+0000","last_became_active":"2024-09-17T05:37:09.302137+0000","last_became_peered":"2024-09-17T05:37:09.302137+0000","last_unstale":"2024-09-17T05:37:10.316704+0000","last_undegraded":"2024-09-17T05:37:10.316704+0000","last_fullsized":"2024-09-17T05:37:10.316704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:52.998403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.299741+0000","last_change":"2024-09-17T05:37:10.294891+0000","last_active":"2024-09-17T05:37:10.299741+0000","last_peered":"2024-09-17T05:37:10.299741+0000","last_clean":"2024-09-17T05:37:10.299741+0000","last_became_active":"2024-09-17T05:37:10.292571+0000","last_became_peered":"2024-09-17T05:37:10.292571+0000","last_unstale":"2024-09-17T05:37:10.299741+0000","last_undegraded":"2024-09-17T05:37:10.299741+0000","last_fullsized":"2024-09-17T05:37:10.299741+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:43.567635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.283028+0000","last_change":"2024-09-17T05:37:09.295972+0000","last_active":"2024-09-17T05:37:10.283028+0000","last_peered":"2024-09-17T05:37:10.283028+0000","last_clean":"2024-09-17T05:37:10.283028+0000","last_became_active":"2024-09-17T05:37:09.295665+0000","last_became_peered":"2024-09-17T05:37:09.295665+0000","last_unstale":"2024-09-17T05:37:10.283028+0000","last_undegraded":"2024-09-17T05:37:10.283028+0000","last_fullsized":"2024-09-17T05:37:10.283028+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:45.359820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324658+0000","last_change":"2024-09-17T05:37:10.316798+0000","last_active":"2024-09-17T05:37:10.324658+0000","last_peered":"2024-09-17T05:37:10.324658+0000","last_clean":"2024-09-17T05:37:10.324658+0000","last_became_active":"2024-09-17T05:37:10.309814+0000","last_became_peered":"2024-09-17T05:37:10.309814+0000","last_unstale":"2024-09-17T05:37:10.324658+0000","last_undegraded":"2024-09-17T05:37:10.324658+0000","last_fullsized":"2024-09-17T05:37:10.324658+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:46.981472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.312483+0000","last_change":"2024-09-17T05:37:09.290669+0000","last_active":"2024-09-17T05:37:10.312483+0000","last_peered":"2024-09-17T05:37:10.312483+0000","last_clean":"2024-09-17T05:37:10.312483+0000","last_became_active":"2024-09-17T05:37:09.290309+0000","last_became_peered":"2024-09-17T05:37:09.290309+0000","last_unstale":"2024-09-17T05:37:10.312483+0000","last_undegraded":"2024-09-17T05:37:10.312483+0000","last_fullsized":"2024-09-17T05:37:10.312483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:08.830753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313211+0000","last_change":"2024-09-17T05:37:10.298289+0000","last_active":"2024-09-17T05:37:10.313211+0000","last_peered":"2024-09-17T05:37:10.313211+0000","last_clean":"2024-09-17T05:37:10.313211+0000","last_became_active":"2024-09-17T05:37:10.297345+0000","last_became_peered":"2024-09-17T05:37:10.297345+0000","last_unstale":"2024-09-17T05:37:10.313211+0000","last_undegraded":"2024-09-17T05:37:10.313211+0000","last_fullsized":"2024-09-17T05:37:10.313211+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:10.196415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342015+0000","last_change":"2024-09-17T05:37:09.302345+0000","last_active":"2024-09-17T05:37:11.342015+0000","last_peered":"2024-09-17T05:37:11.342015+0000","last_clean":"2024-09-17T05:37:11.342015+0000","last_became_active":"2024-09-17T05:37:09.298055+0000","last_became_peered":"2024-09-17T05:37:09.298055+0000","last_unstale":"2024-09-17T05:37:11.342015+0000","last_undegraded":"2024-09-17T05:37:11.342015+0000","last_fullsized":"2024-09-17T05:37:11.342015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:28.595611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324797+0000","last_change":"2024-09-17T05:37:10.318355+0000","last_active":"2024-09-17T05:37:10.324797+0000","last_peered":"2024-09-17T05:37:10.324797+0000","last_clean":"2024-09-17T05:37:10.324797+0000","last_became_active":"2024-09-17T05:37:10.310973+0000","last_became_peered":"2024-09-17T05:37:10.310973+0000","last_unstale":"2024-09-17T05:37:10.324797+0000","last_undegraded":"2024-09-17T05:37:10.324797+0000","last_fullsized":"2024-09-17T05:37:10.324797+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:55.962182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.276520+0000","last_change":"2024-09-17T05:37:09.300413+0000","last_active":"2024-09-17T05:37:10.276520+0000","last_peered":"2024-09-17T05:37:10.276520+0000","last_clean":"2024-09-17T05:37:10.276520+0000","last_became_active":"2024-09-17T05:37:09.300073+0000","last_became_peered":"2024-09-17T05:37:09.300073+0000","last_unstale":"2024-09-17T05:37:10.276520+0000","last_undegraded":"2024-09-17T05:37:10.276520+0000","last_fullsized":"2024-09-17T05:37:10.276520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:52.662270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.313565+0000","last_change":"2024-09-17T05:37:10.306192+0000","last_active":"2024-09-17T05:37:10.313565+0000","last_peered":"2024-09-17T05:37:10.313565+0000","last_clean":"2024-09-17T05:37:10.313565+0000","last_became_active":"2024-09-17T05:37:10.305690+0000","last_became_peered":"2024-09-17T05:37:10.305690+0000","last_unstale":"2024-09-17T05:37:10.313565+0000","last_undegraded":"2024-09-17T05:37:10.313565+0000","last_fullsized":"2024-09-17T05:37:10.313565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:09.152413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.341262+0000","last_change":"2024-09-17T05:37:09.295070+0000","last_active":"2024-09-17T05:37:11.341262+0000","last_peered":"2024-09-17T05:37:11.341262+0000","last_clean":"2024-09-17T05:37:11.341262+0000","last_became_active":"2024-09-17T05:37:09.294718+0000","last_became_peered":"2024-09-17T05:37:09.294718+0000","last_unstale":"2024-09-17T05:37:11.341262+0000","last_undegraded":"2024-09-17T05:37:11.341262+0000","last_fullsized":"2024-09-17T05:37:11.341262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:34.706285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311329+0000","last_change":"2024-09-17T05:37:10.307040+0000","last_active":"2024-09-17T05:37:10.311329+0000","last_peered":"2024-09-17T05:37:10.311329+0000","last_clean":"2024-09-17T05:37:10.311329+0000","last_became_active":"2024-09-17T05:37:10.306264+0000","last_became_peered":"2024-09-17T05:37:10.306264+0000","last_unstale":"2024-09-17T05:37:10.311329+0000","last_undegraded":"2024-09-17T05:37:10.311329+0000","last_fullsized":"2024-09-17T05:37:10.311329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:37.602959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.319014+0000","last_change":"2024-09-17T05:37:09.301272+0000","last_active":"2024-09-17T05:37:10.319014+0000","last_peered":"2024-09-17T05:37:10.319014+0000","last_clean":"2024-09-17T05:37:10.319014+0000","last_became_active":"2024-09-17T05:37:09.300851+0000","last_became_peered":"2024-09-17T05:37:09.300851+0000","last_unstale":"2024-09-17T05:37:10.319014+0000","last_undegraded":"2024-09-17T05:37:10.319014+0000","last_fullsized":"2024-09-17T05:37:10.319014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:20.559339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.318197+0000","last_change":"2024-09-17T05:37:10.311413+0000","last_active":"2024-09-17T05:37:10.318197+0000","last_peered":"2024-09-17T05:37:10.318197+0000","last_clean":"2024-09-17T05:37:10.318197+0000","last_became_active":"2024-09-17T05:37:10.311050+0000","last_became_peered":"2024-09-17T05:37:10.311050+0000","last_unstale":"2024-09-17T05:37:10.318197+0000","last_undegraded":"2024-09-17T05:37:10.318197+0000","last_fullsized":"2024-09-17T05:37:10.318197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:24.197322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297642+0000","last_change":"2024-09-17T05:37:09.302517+0000","last_active":"2024-09-17T05:37:10.297642+0000","last_peered":"2024-09-17T05:37:10.297642+0000","last_clean":"2024-09-17T05:37:10.297642+0000","last_became_active":"2024-09-17T05:37:09.302208+0000","last_became_peered":"2024-09-17T05:37:09.302208+0000","last_unstale":"2024-09-17T05:37:10.297642+0000","last_undegraded":"2024-09-17T05:37:10.297642+0000","last_fullsized":"2024-09-17T05:37:10.297642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:50.489329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.324517+0000","last_change":"2024-09-17T05:37:10.320814+0000","last_active":"2024-09-17T05:37:10.324517+0000","last_peered":"2024-09-17T05:37:10.324517+0000","last_clean":"2024-09-17T05:37:10.324517+0000","last_became_active":"2024-09-17T05:37:10.320592+0000","last_became_peered":"2024-09-17T05:37:10.320592+0000","last_unstale":"2024-09-17T05:37:10.324517+0000","last_undegraded":"2024-09-17T05:37:10.324517+0000","last_fullsized":"2024-09-17T05:37:10.324517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.066238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.297512+0000","last_change":"2024-09-17T05:37:09.298925+0000","last_active":"2024-09-17T05:37:10.297512+0000","last_peered":"2024-09-17T05:37:10.297512+0000","last_clean":"2024-09-17T05:37:10.297512+0000","last_became_active":"2024-09-17T05:37:09.298596+0000","last_became_peered":"2024-09-17T05:37:09.298596+0000","last_unstale":"2024-09-17T05:37:10.297512+0000","last_undegraded":"2024-09-17T05:37:10.297512+0000","last_fullsized":"2024-09-17T05:37:10.297512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:19.175185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.314806+0000","last_change":"2024-09-17T05:37:10.313944+0000","last_active":"2024-09-17T05:37:10.314806+0000","last_peered":"2024-09-17T05:37:10.314806+0000","last_clean":"2024-09-17T05:37:10.314806+0000","last_became_active":"2024-09-17T05:37:10.313645+0000","last_became_peered":"2024-09-17T05:37:10.313645+0000","last_unstale":"2024-09-17T05:37:10.314806+0000","last_undegraded":"2024-09-17T05:37:10.314806+0000","last_fullsized":"2024-09-17T05:37:10.314806+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:24.645311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.277885+0000","last_change":"2024-09-17T05:37:09.287204+0000","last_active":"2024-09-17T05:37:10.277885+0000","last_peered":"2024-09-17T05:37:10.277885+0000","last_clean":"2024-09-17T05:37:10.277885+0000","last_became_active":"2024-09-17T05:37:09.286409+0000","last_became_peered":"2024-09-17T05:37:09.286409+0000","last_unstale":"2024-09-17T05:37:10.277885+0000","last_undegraded":"2024-09-17T05:37:10.277885+0000","last_fullsized":"2024-09-17T05:37:10.277885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:10.676399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.342549+0000","last_change":"2024-09-17T05:37:10.308966+0000","last_active":"2024-09-17T05:37:11.342549+0000","last_peered":"2024-09-17T05:37:11.342549+0000","last_clean":"2024-09-17T05:37:11.342549+0000","last_became_active":"2024-09-17T05:37:10.308588+0000","last_became_peered":"2024-09-17T05:37:10.308588+0000","last_unstale":"2024-09-17T05:37:11.342549+0000","last_undegraded":"2024-09-17T05:37:11.342549+0000","last_fullsized":"2024-09-17T05:37:11.342549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.595377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.285475+0000","last_change":"2024-09-17T05:37:09.303111+0000","last_active":"2024-09-17T05:37:10.285475+0000","last_peered":"2024-09-17T05:37:10.285475+0000","last_clean":"2024-09-17T05:37:10.285475+0000","last_became_active":"2024-09-17T05:37:09.302249+0000","last_became_peered":"2024-09-17T05:37:09.302249+0000","last_unstale":"2024-09-17T05:37:10.285475+0000","last_undegraded":"2024-09-17T05:37:10.285475+0000","last_fullsized":"2024-09-17T05:37:10.285475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:22.177493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.306890+0000","last_change":"2024-09-17T05:37:10.304387+0000","last_active":"2024-09-17T05:37:10.306890+0000","last_peered":"2024-09-17T05:37:10.306890+0000","last_clean":"2024-09-17T05:37:10.306890+0000","last_became_active":"2024-09-17T05:37:10.304050+0000","last_became_peered":"2024-09-17T05:37:10.304050+0000","last_unstale":"2024-09-17T05:37:10.306890+0000","last_undegraded":"2024-09-17T05:37:10.306890+0000","last_fullsized":"2024-09-17T05:37:10.306890+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:30.398490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.296122+0000","last_change":"2024-09-17T05:37:09.296603+0000","last_active":"2024-09-17T05:37:10.296122+0000","last_peered":"2024-09-17T05:37:10.296122+0000","last_clean":"2024-09-17T05:37:10.296122+0000","last_became_active":"2024-09-17T05:37:09.296219+0000","last_became_peered":"2024-09-17T05:37:09.296219+0000","last_unstale":"2024-09-17T05:37:10.296122+0000","last_undegraded":"2024-09-17T05:37:10.296122+0000","last_fullsized":"2024-09-17T05:37:10.296122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:05.176894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.311922+0000","last_change":"2024-09-17T05:37:10.294487+0000","last_active":"2024-09-17T05:37:10.311922+0000","last_peered":"2024-09-17T05:37:10.311922+0000","last_clean":"2024-09-17T05:37:10.311922+0000","last_became_active":"2024-09-17T05:37:10.294167+0000","last_became_peered":"2024-09-17T05:37:10.294167+0000","last_unstale":"2024-09-17T05:37:10.311922+0000","last_undegraded":"2024-09-17T05:37:10.311922+0000","last_fullsized":"2024-09-17T05:37:10.311922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:10.993647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.279772+0000","last_change":"2024-09-17T05:37:09.301772+0000","last_active":"2024-09-17T05:37:10.279772+0000","last_peered":"2024-09-17T05:37:10.279772+0000","last_clean":"2024-09-17T05:37:10.279772+0000","last_became_active":"2024-09-17T05:37:09.301490+0000","last_became_peered":"2024-09-17T05:37:09.301490+0000","last_unstale":"2024-09-17T05:37:10.279772+0000","last_undegraded":"2024-09-17T05:37:10.279772+0000","last_fullsized":"2024-09-17T05:37:10.279772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:45.359820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.318862+0000","last_change":"2024-09-17T05:37:10.305679+0000","last_active":"2024-09-17T05:37:10.318862+0000","last_peered":"2024-09-17T05:37:10.318862+0000","last_clean":"2024-09-17T05:37:10.318862+0000","last_became_active":"2024-09-17T05:37:10.305351+0000","last_became_peered":"2024-09-17T05:37:10.305351+0000","last_unstale":"2024-09-17T05:37:10.318862+0000","last_undegraded":"2024-09-17T05:37:10.318862+0000","last_fullsized":"2024-09-17T05:37:10.318862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:09.262437+0000","last_clean_scrub_stamp":"2024-09-17T05:37:09.262437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:25.159557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.290905+0000","last_change":"2024-09-17T05:37:09.303368+0000","last_active":"2024-09-17T05:37:10.290905+0000","last_peered":"2024-09-17T05:37:10.290905+0000","last_clean":"2024-09-17T05:37:10.290905+0000","last_became_active":"2024-09-17T05:37:09.303009+0000","last_became_peered":"2024-09-17T05:37:09.303009+0000","last_unstale":"2024-09-17T05:37:10.290905+0000","last_undegraded":"2024-09-17T05:37:10.290905+0000","last_fullsized":"2024-09-17T05:37:10.290905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:08.259260+0000","last_clean_scrub_stamp":"2024-09-17T05:37:08.259260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":143,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T05:37:10.276644+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:37:10.276644+0000","last_peered":"2024-09-17T05:37:10.276644+0000","last_clean":"2024-09-17T05:37:10.276644+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:37:10.276644+0000","last_undegraded":"2024-09-17T05:37:10.276644+0000","last_fullsized":"2024-09-17T05:37:10.276644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":188160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1024000,"data_stored":771291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":180923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":180923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":190284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":778480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":450560,"data_stored":188182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":458752,"data_stored":194816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:14.907 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:37:14.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 -- 172.21.15.44:0/3823827040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2006de50 msgr2=0x7fed2006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 --2- 172.21.15.44:0/3823827040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2006de50 0x7fed2006e260 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fed08009900 tx=0x7fed0801c850 comp rx=0 tx=0).stop 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 -- 172.21.15.44:0/3823827040 shutdown_connections 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 --2- 172.21.15.44:0/3823827040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed2006de50 0x7fed2006e260 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 --2- 172.21.15.44:0/3823827040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed20072e50 0x7fed2015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 -- 172.21.15.44:0/3823827040 >> 172.21.15.44:0/3823827040 conn(0x7fed200ccaa0 msgr2=0x7fed200cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 -- 172.21.15.44:0/3823827040 shutdown_connections 2024-09-17T05:37:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 -- 172.21.15.44:0/3823827040 wait complete. 2024-09-17T05:37:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 Processor -- start 2024-09-17T05:37:15.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.110+0000 7fed25600640 1 -- start start 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed2006de50 0x7fed201534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed20072e50 0x7fed20159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed200ced00 0x7fed2015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fed201694b0 con 0x7fed200ced00 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed20169330 con 0x7fed20072e50 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fed20169630 con 0x7fed2006de50 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed200ced00 0x7fed2015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed200ced00 0x7fed2015a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51884/0 (socket says 172.21.15.44:51884) 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 -- 172.21.15.44:0/1531975396 learned_addr learned my addr 172.21.15.44:0/1531975396 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1ea00640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed2006de50 0x7fed201534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed17e00640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed20072e50 0x7fed20159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 -- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed2006de50 msgr2=0x7fed201534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed2006de50 0x7fed201534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 -- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed20072e50 msgr2=0x7fed20159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed20072e50 0x7fed20159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 -- 172.21.15.44:0/1531975396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed200a0a70 con 0x7fed200ced00 2024-09-17T05:37:15.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed1f400640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed200ced00 0x7fed2015a1d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c790 tx=0x7fed1800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed16a00640 1 -- 172.21.15.44:0/1531975396 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed18003b80 con 0x7fed200ced00 2024-09-17T05:37:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed16a00640 1 -- 172.21.15.44:0/1531975396 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed18003d20 con 0x7fed200ced00 2024-09-17T05:37:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed16a00640 1 -- 172.21.15.44:0/1531975396 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1800aa50 con 0x7fed200ced00 2024-09-17T05:37:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed200a04b0 con 0x7fed200ced00 2024-09-17T05:37:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed200c8470 con 0x7fed200ced00 2024-09-17T05:37:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2006e260 con 0x7fed200ced00 2024-09-17T05:37:15.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.114+0000 7fed16a00640 1 -- 172.21.15.44:0/1531975396 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fed1800abf0 con 0x7fed200ced00 2024-09-17T05:37:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.118+0000 7fed16a00640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fecfc073230 0x7fecfc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.118+0000 7fed16a00640 1 -- 172.21.15.44:0/1531975396 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fed18093fc0 con 0x7fed200ced00 2024-09-17T05:37:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.118+0000 7fed1ea00640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fecfc073230 0x7fecfc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.118+0000 7fed1ea00640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fecfc073230 0x7fecfc075740 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed10009b40 tx=0x7fed100091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.122+0000 7fed16a00640 1 -- 172.21.15.44:0/1531975396 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fed2006e7a0 con 0x7fed200ced00 2024-09-17T05:37:15.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.362+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fed200a0d40 con 0x7fed200ced00 2024-09-17T05:37:15.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.366+0000 7fed16a00640 1 -- 172.21.15.44:0/1531975396 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fed1805e7f0 con 0x7fed200ced00 2024-09-17T05:37:15.367 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:37:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:37:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-09-17T05:37:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-09-17T05:37:15.367 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:37:15.368 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-17T05:37:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fecfc073230 msgr2=0x7fecfc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fecfc073230 0x7fecfc075740 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fed10009b40 tx=0x7fed100091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed200ced00 msgr2=0x7fed2015a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed200ced00 0x7fed2015a1d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed1800c790 tx=0x7fed1800cc50 comp rx=0 tx=0).stop 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 shutdown_connections 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fed200ced00 0x7fed2015a1d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fecfc073230 0x7fecfc075740 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed20072e50 0x7fed20159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 --2- 172.21.15.44:0/1531975396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fed2006de50 0x7fed201534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 >> 172.21.15.44:0/1531975396 conn(0x7fed200ccaa0 msgr2=0x7fed20154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 shutdown_connections 2024-09-17T05:37:15.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.370+0000 7fed25600640 1 -- 172.21.15.44:0/1531975396 wait complete. 2024-09-17T05:37:15.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:15.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 -- 172.21.15.44:0/3403514122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70070e00 msgr2=0x7f2b70071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 --2- 172.21.15.44:0/3403514122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70070e00 0x7f2b70071c60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009900 tx=0x7f2b6001c850 comp rx=0 tx=0).stop 2024-09-17T05:37:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 -- 172.21.15.44:0/3403514122 shutdown_connections 2024-09-17T05:37:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 --2- 172.21.15.44:0/3403514122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b7006e660 0x7f2b70151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 --2- 172.21.15.44:0/3403514122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70070e00 0x7f2b70071c60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 -- 172.21.15.44:0/3403514122 >> 172.21.15.44:0/3403514122 conn(0x7f2b700cd930 msgr2=0x7f2b700cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 -- 172.21.15.44:0/3403514122 shutdown_connections 2024-09-17T05:37:15.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.546+0000 7f2b76000640 1 -- 172.21.15.44:0/3403514122 wait complete. 2024-09-17T05:37:15.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 Processor -- start 2024-09-17T05:37:15.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 -- start start 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b70070e00 0x7f2b70136df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b700ccb60 0x7f2b70147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70150610 0x7f2b70150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7015c5c0 con 0x7f2b70150610 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7015c440 con 0x7f2b700ccb60 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2b7015c740 con 0x7f2b70070e00 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70150610 0x7f2b70150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70150610 0x7f2b70150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51908/0 (socket says 172.21.15.44:51908) 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 -- 172.21.15.44:0/366534916 learned_addr learned my addr 172.21.15.44:0/366534916 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b67e00640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b700ccb60 0x7f2b70147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6f400640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b70070e00 0x7f2b70136df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 -- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b70070e00 msgr2=0x7f2b70136df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b70070e00 0x7f2b70136df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 -- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b700ccb60 msgr2=0x7f2b70147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b700ccb60 0x7f2b70147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 -- 172.21.15.44:0/366534916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b70137330 con 0x7f2b70150610 2024-09-17T05:37:15.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6f400640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b70070e00 0x7f2b70136df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b6fe00640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70150610 0x7f2b70150a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800b9e0 tx=0x7f2b6800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b67400640 1 -- 172.21.15.44:0/366534916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68019070 con 0x7f2b70150610 2024-09-17T05:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b67400640 1 -- 172.21.15.44:0/366534916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b6800cc30 con 0x7f2b70150610 2024-09-17T05:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b67400640 1 -- 172.21.15.44:0/366534916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b680146a0 con 0x7f2b70150610 2024-09-17T05:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b70150f60 con 0x7f2b70150610 2024-09-17T05:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.550+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b7014ba50 con 0x7f2b70150610 2024-09-17T05:37:15.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.554+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b70151b00 con 0x7f2b70150610 2024-09-17T05:37:15.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.554+0000 7f2b67400640 1 -- 172.21.15.44:0/366534916 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2b6801c070 con 0x7f2b70150610 2024-09-17T05:37:15.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.554+0000 7f2b67400640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2b4c073230 0x7f2b4c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.554+0000 7f2b67400640 1 -- 172.21.15.44:0/366534916 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2b680940c0 con 0x7f2b70150610 2024-09-17T05:37:15.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.554+0000 7f2b6f400640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2b4c073230 0x7f2b4c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.554+0000 7f2b6f400640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2b4c073230 0x7f2b4c075740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b600ae000 tx=0x7f2b6001b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.558+0000 7f2b67400640 1 -- 172.21.15.44:0/366534916 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2b70150f60 con 0x7f2b70150610 2024-09-17T05:37:15.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b70150140 con 0x7f2b70150610 2024-09-17T05:37:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b67400640 1 -- 172.21.15.44:0/366534916 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7f2b70137330 con 0x7f2b70150610 2024-09-17T05:37:15.770 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:15.770 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:15.770 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2b4c073230 msgr2=0x7f2b4c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2b4c073230 0x7f2b4c075740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b600ae000 tx=0x7f2b6001b090 comp rx=0 tx=0).stop 2024-09-17T05:37:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70150610 msgr2=0x7f2b70150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70150610 0x7f2b70150a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800b9e0 tx=0x7f2b6800bea0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 shutdown_connections 2024-09-17T05:37:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b70150610 0x7f2b70150a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2b4c073230 0x7f2b4c075740 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b700ccb60 0x7f2b70147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 --2- 172.21.15.44:0/366534916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2b70070e00 0x7f2b70136df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 >> 172.21.15.44:0/366534916 conn(0x7f2b700cd930 msgr2=0x7f2b700cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 shutdown_connections 2024-09-17T05:37:15.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:15.770+0000 7f2b76000640 1 -- 172.21.15.44:0/366534916 wait complete. 2024-09-17T05:37:16.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:37:09.701448+0000', 'modified': '2024-09-17T05:37:12.713928+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4974}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4974': {'gid': 4974, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/3983247436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 3983247436}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3983247436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4974, 'qdb_cluster': [4974]} 2024-09-17T05:37:16.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:37:16.196 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:37:16.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 -- 172.21.15.44:0/1067904777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 msgr2=0x7efe9c0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 --2- 172.21.15.44:0/1067904777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c0cdbf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efe84009840 tx=0x7efe8401c820 comp rx=0 tx=0).stop 2024-09-17T05:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 -- 172.21.15.44:0/1067904777 shutdown_connections 2024-09-17T05:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 --2- 172.21.15.44:0/1067904777 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c0cdbf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 --2- 172.21.15.44:0/1067904777 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe9c0b5880 0x7efe9c06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 -- 172.21.15.44:0/1067904777 >> 172.21.15.44:0/1067904777 conn(0x7efe9c0ccaa0 msgr2=0x7efe9c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 -- 172.21.15.44:0/1067904777 shutdown_connections 2024-09-17T05:37:16.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 -- 172.21.15.44:0/1067904777 wait complete. 2024-09-17T05:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 Processor -- start 2024-09-17T05:37:16.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.362+0000 7efea2000640 1 -- start start 2024-09-17T05:37:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe9c0b5880 0x7efe9c1f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe9c0ce130 0x7efe9c157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c16a350 con 0x7efe9c06e390 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c074750 con 0x7efe9c0ce130 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c16a4d0 con 0x7efe9c0b5880 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51920/0 (socket says 172.21.15.44:51920) 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 -- 172.21.15.44:0/1165325325 learned_addr learned my addr 172.21.15.44:0/1165325325 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe92a00640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe9c0b5880 0x7efe9c1f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9be00640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe9c0ce130 0x7efe9c157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 -- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe9c0b5880 msgr2=0x7efe9c1f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe9c0b5880 0x7efe9c1f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 -- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe9c0ce130 msgr2=0x7efe9c157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe9c0ce130 0x7efe9c157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 -- 172.21.15.44:0/1165325325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c158e90 con 0x7efe9c06e390 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe92a00640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe9c0b5880 0x7efe9c1f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe9b400640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c158950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00eb00 tx=0x7efe8c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe93e00640 1 -- 172.21.15.44:0/1165325325 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c004b30 con 0x7efe9c06e390 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe93e00640 1 -- 172.21.15.44:0/1165325325 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe8c004cf0 con 0x7efe9c06e390 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efe93e00640 1 -- 172.21.15.44:0/1165325325 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c005280 con 0x7efe9c06e390 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c158270 con 0x7efe9c06e390 2024-09-17T05:37:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.366+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c0ca830 con 0x7efe9c06e390 2024-09-17T05:37:16.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.370+0000 7efe93e00640 1 -- 172.21.15.44:0/1165325325 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe8c005420 con 0x7efe9c06e390 2024-09-17T05:37:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.370+0000 7efea9702000 1 Processor -- start 2024-09-17T05:37:16.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.370+0000 7efea9702000 1 -- start start 2024-09-17T05:37:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.370+0000 7efe93e00640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe78073230 0x7efe78075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.370+0000 7efe93e00640 1 -- 172.21.15.44:0/1165325325 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7efe8c095180 con 0x7efe9c06e390 2024-09-17T05:37:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.370+0000 7efe9be00640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe78073230 0x7efe78075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9be00640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe78073230 0x7efe78075740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0cbcb0 tx=0x7efe94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b6c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b6cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b6d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a151a41410 con 0x55a15162b460 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a15197eb40 con 0x55a151a04ca0 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a15196df70 con 0x55a151a1b950 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b6c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b6c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51926/0 (socket says 172.21.15.44:51926) 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 -- 172.21.15.44:0/731506880 learned_addr learned my addr 172.21.15.44:0/731506880 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe92a00640 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b6cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9be00640 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b6d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 -- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 msgr2=0x55a151b6cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b6cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 -- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 msgr2=0x55a151b6d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b6d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 -- 172.21.15.44:0/731506880 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1519355b0 con 0x55a15162b460 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe9b400640 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b6c6a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00c7d0 tx=0x7efe8c05f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36920c280270b6d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe8b400640 1 -- 172.21.15.44:0/731506880 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c05f380 con 0x55a15162b460 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe8b400640 1 -- 172.21.15.44:0/731506880 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe8c05ff70 con 0x55a15162b460 2024-09-17T05:37:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efe8b400640 1 -- 172.21.15.44:0/731506880 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c069000 con 0x55a15162b460 2024-09-17T05:37:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- 172.21.15.44:0/731506880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 msgr2=0x55a151b6c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b6c6a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00c7d0 tx=0x7efe8c05f750 comp rx=0 tx=0).stop 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- 172.21.15.44:0/731506880 shutdown_connections 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b6d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b6cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 --2- 172.21.15.44:0/731506880 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b6c6a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- 172.21.15.44:0/731506880 >> 172.21.15.44:0/731506880 conn(0x55a151af1d90 msgr2=0x55a151b21690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- 172.21.15.44:0/731506880 shutdown_connections 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- 172.21.15.44:0/731506880 wait complete. 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 -- start start 2024-09-17T05:37:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.374+0000 7efea9702000 1 Processor -- start 2024-09-17T05:37:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b73920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b73e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a1519085f0 con 0x55a15162b460 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a151971d80 con 0x55a151a04ca0 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a151914520 con 0x55a151a1b950 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 10 client.0 _ll_register_callbacks cb 0x55a151918830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b73920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b73920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51942/0 (socket says 172.21.15.44:51942) 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 -- 172.21.15.44:0/1459475200 learned_addr learned my addr 172.21.15.44:0/1459475200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9be00640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe92a00640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b73e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 -- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 msgr2=0x55a151b743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 -- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 msgr2=0x55a151b73e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b73e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 -- 172.21.15.44:0/1459475200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15190c190 con 0x55a15162b460 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe92a00640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b73e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe9b400640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b73920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe8c05f800 tx=0x7efe8c069090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130e476550a9e90a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe7fe00640 1 -- 172.21.15.44:0/1459475200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c05f380 con 0x55a15162b460 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe7fe00640 1 -- 172.21.15.44:0/1459475200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7efe8c060db0 con 0x55a15162b460 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a151906110 con 0x55a15162b460 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe7fe00640 1 -- 172.21.15.44:0/1459475200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efe8c06f050 con 0x55a15162b460 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 10 client.5130 fetch_fsmap learned FSMap version 17 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a1519f2f10 con 0x55a15162b460 2024-09-17T05:37:16.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe7fe00640 1 -- 172.21.15.44:0/1459475200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a151906110 con 0x55a15162b460 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe7fe00640 1 -- 172.21.15.44:0/1459475200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7efe8c072020 con 0x55a15162b460 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 10 client.5130 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 10 client.5130 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 20 client.5130 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1516107d0 0x55a151b7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 4 client.5130 mds_command: new command op to 4974 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 --> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a151980a90 con 0x55a1516107d0 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe92a00640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1516107d0 0x55a151b7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe92a00640 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1516107d0 0x55a151b7dd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0cb0b4361784315 server_cookie=91d0959262d794f6 in_seq=0 out_seq=0 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.378+0000 7efe7fe00640 10 client.5130 ms_handle_connect on v2:172.21.15.44:6832/3983247436 2024-09-17T05:37:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efe7fe00640 1 -- 172.21.15.44:0/1459475200 <== mds.0 v2:172.21.15.44:6832/3983247436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a151980a90 con 0x55a1516107d0 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efe7fe00640 10 client.5130 handle_command_reply: tid=0 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 client.5130 shutdown 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 msgr2=0x55a151b73920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b73920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe8c05f800 tx=0x7efe8c069090 comp rx=0 tx=0).stop 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 shutdown_connections 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1516107d0 0x55a151b7dd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151b743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efe7fe00640 0 client.5130 ms_handle_reset on v2:172.21.15.44:6832/3983247436 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151b73e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 --2- 172.21.15.44:0/1459475200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151b73920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 >> 172.21.15.44:0/1459475200 conn(0x55a151af1d90 msgr2=0x55a151b28440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 shutdown_connections 2024-09-17T05:37:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 1 -- 172.21.15.44:0/1459475200 wait complete. 2024-09-17T05:37:16.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.382+0000 7efea9702000 20 client.5130 trim_cache size 0 max 16384 2024-09-17T05:37:16.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 Processor -- start 2024-09-17T05:37:16.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 -- start start 2024-09-17T05:37:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151bde840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151bded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151bdf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c2060f0 con 0x55a15162b460 2024-09-17T05:37:16.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c2050f0 con 0x55a151a04ca0 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c0c9f50 con 0x55a151a1b950 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151bde840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151bde840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51948/0 (socket says 172.21.15.44:51948) 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 -- 172.21.15.44:0/328964545 learned_addr learned my addr 172.21.15.44:0/328964545 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe92a00640 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151bded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9be00640 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151bdf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 -- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 msgr2=0x55a151bdf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151bdf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 -- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 msgr2=0x55a151bded80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151bded80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 -- 172.21.15.44:0/328964545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1519c9db0 con 0x55a15162b460 2024-09-17T05:37:16.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe9b400640 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151bde840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe8c05fa30 tx=0x7efe8c05f0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17db1e3485cbf2cc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe8aa00640 1 -- 172.21.15.44:0/328964545 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c05bec0 con 0x55a15162b460 2024-09-17T05:37:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe8aa00640 1 -- 172.21.15.44:0/328964545 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe8c069290 con 0x55a15162b460 2024-09-17T05:37:16.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efe8aa00640 1 -- 172.21.15.44:0/328964545 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c05ed30 con 0x55a15162b460 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 -- 172.21.15.44:0/328964545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 msgr2=0x55a151bde840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.402+0000 7efea9702000 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151bde840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe8c05fa30 tx=0x7efe8c05f0b0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- 172.21.15.44:0/328964545 shutdown_connections 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a151a1b950 0x55a151bdf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a04ca0 0x55a151bded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 --2- 172.21.15.44:0/328964545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a15162b460 0x55a151bde840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- 172.21.15.44:0/328964545 >> 172.21.15.44:0/328964545 conn(0x55a151af1d90 msgr2=0x55a151b20cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- 172.21.15.44:0/328964545 shutdown_connections 2024-09-17T05:37:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- 172.21.15.44:0/328964545 wait complete. 2024-09-17T05:37:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- start start 2024-09-17T05:37:16.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 Processor -- start 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a15162b460 0x55a151be23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a151a04ca0 0x55a151be2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a1b950 0x55a151be2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a151971d80 con 0x55a151a04ca0 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c204bb0 con 0x55a151a1b950 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a1519085f0 con 0x55a15162b460 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 10 client.0 _ll_register_callbacks cb 0x7efe8c085050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a151a04ca0 0x55a151be2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a151a04ca0 0x55a151be2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51950/0 (socket says 172.21.15.44:51950) 2024-09-17T05:37:16.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 -- 172.21.15.44:0/2561085393 learned_addr learned my addr 172.21.15.44:0/2561085393 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe9b400640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a15162b460 0x55a151be23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe9be00640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a1b950 0x55a151be2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 -- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a15162b460 msgr2=0x55a151be23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a15162b460 0x55a151be23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 -- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a1b950 msgr2=0x55a151be2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a1b950 0x55a151be2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 -- 172.21.15.44:0/2561085393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a151934ab0 con 0x55a151a04ca0 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe9be00640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a1b950 0x55a151be2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:16.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe92a00640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a151a04ca0 0x55a151be2910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe8401c650 tx=0x7efe8401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e5701472af47c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe7fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe7fe00640 1 -- 172.21.15.44:0/2561085393 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84004200 con 0x55a151a04ca0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efe7fe00640 1 -- 172.21.15.44:0/2561085393 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7efe840c0070 con 0x55a151a04ca0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.406+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe8c069290 con 0x55a151a04ca0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe7fe00640 1 -- 172.21.15.44:0/2561085393 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7efe840043a0 con 0x55a151a04ca0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 10 client.5136 fetch_fsmap learned FSMap version 17 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a151913070 con 0x55a151a04ca0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe7fe00640 1 -- 172.21.15.44:0/2561085393 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe8c069290 con 0x55a151a04ca0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe7fe00640 1 -- 172.21.15.44:0/2561085393 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7efe840a6980 con 0x55a151a04ca0 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 10 client.5136 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 10 client.5136 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:37:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 20 client.5136 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1515fe830 0x55a151b9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 4 client.5136 mds_command: new command op to 4974 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 --> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] -- command(tid 0: {"prefix": "status"}) -- 0x55a15197c540 con 0x55a1515fe830 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe9b400640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1515fe830 0x55a151b9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe9b400640 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1515fe830 0x55a151b9e140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c15ff108fe169e72 server_cookie=1ab74173ff77a496 in_seq=0 out_seq=0 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe7fe00640 10 client.5136 ms_handle_connect on v2:172.21.15.44:6832/3983247436 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe7fe00640 1 -- 172.21.15.44:0/2561085393 <== mds.0 v2:172.21.15.44:6832/3983247436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a15197c540 con 0x55a1515fe830 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe7fe00640 10 client.5136 handle_command_reply: tid=0 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 client.5136 shutdown 2024-09-17T05:37:16.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a151a04ca0 msgr2=0x55a151be2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a151a04ca0 0x55a151be2910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe8401c650 tx=0x7efe8401ca70 comp rx=0 tx=0).stop 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 shutdown_connections 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:6832/3983247436,v1:172.21.15.44:6835/3983247436] conn(0x55a1515fe830 0x55a151b9e140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a151a1b950 0x55a151be2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a151a04ca0 0x55a151be2910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 --2- 172.21.15.44:0/2561085393 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a15162b460 0x55a151be23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efe7fe00640 0 client.5136 ms_handle_reset on v2:172.21.15.44:6832/3983247436 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 >> 172.21.15.44:0/2561085393 conn(0x55a151af1d90 msgr2=0x55a151b21690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 shutdown_connections 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 1 -- 172.21.15.44:0/2561085393 wait complete. 2024-09-17T05:37:16.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea9702000 20 client.5136 trim_cache size 0 max 16384 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4974, 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:37:16.417 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.1400604970000003, 2024-09-17T05:37:16.418 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 17, 2024-09-17T05:37:16.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 40, 2024-09-17T05:37:16.418 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 40, 2024-09-17T05:37:16.418 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 13.599822135 2024-09-17T05:37:16.418 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe78073230 msgr2=0x7efe78075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe78073230 0x7efe78075740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0cbcb0 tx=0x7efe94009040 comp rx=0 tx=0).stop 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 msgr2=0x7efe9c158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c158950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00eb00 tx=0x7efe8c00c2d0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 shutdown_connections 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe78073230 0x7efe78075740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe9c0ce130 0x7efe9c157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe9c0b5880 0x7efe9c1f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 --2- 172.21.15.44:0/1165325325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe9c06e390 0x7efe9c158950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 >> 172.21.15.44:0/1165325325 conn(0x7efe9c0ccaa0 msgr2=0x7efe9c15dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 shutdown_connections 2024-09-17T05:37:16.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.410+0000 7efea2000640 1 -- 172.21.15.44:0/1165325325 wait complete. 2024-09-17T05:37:16.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 -- 172.21.15.44:0/1181585196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 msgr2=0x7fae8015d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 --2- 172.21.15.44:0/1181585196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 0x7fae8015d060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae78009c80 tx=0x7fae7801cc80 comp rx=0 tx=0).stop 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 -- 172.21.15.44:0/1181585196 shutdown_connections 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 --2- 172.21.15.44:0/1181585196 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 0x7fae8015d060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 --2- 172.21.15.44:0/1181585196 >> v2:172.21.15.86:3300/0 conn(0x7fae800d1d00 0x7fae800cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 -- 172.21.15.44:0/1181585196 >> 172.21.15.44:0/1181585196 conn(0x7fae800b4240 msgr2=0x7fae800b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 -- 172.21.15.44:0/1181585196 shutdown_connections 2024-09-17T05:37:16.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 -- 172.21.15.44:0/1181585196 wait complete. 2024-09-17T05:37:16.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 Processor -- start 2024-09-17T05:37:16.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.590+0000 7fae87c00640 1 -- start start 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 0x7fae801fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae800d18f0 0x7fae8014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae800d1d00 0x7fae8006f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae80169e80 con 0x7fae800d1d00 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fae80169d00 con 0x7fae800d18f0 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fae8016a000 con 0x7fae800cf5b0 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae800d1d00 0x7fae8006f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae800d1d00 0x7fae8006f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51956/0 (socket says 172.21.15.44:51956) 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 -- 172.21.15.44:0/2460988292 learned_addr learned my addr 172.21.15.44:0/2460988292 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae7fe00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae800d18f0 0x7fae8014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85200640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 0x7fae801fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 -- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 msgr2=0x7fae801fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 0x7fae801fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 -- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae800d18f0 msgr2=0x7fae8014d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae800d18f0 0x7fae8014d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 -- 172.21.15.44:0/2460988292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae80159650 con 0x7fae800d1d00 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae85c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae800d1d00 0x7fae8006f390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fae78009bd0 tx=0x7fae780092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae7cc00640 1 -- 172.21.15.44:0/2460988292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780bb070 con 0x7fae800d1d00 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae7cc00640 1 -- 172.21.15.44:0/2460988292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae78004d40 con 0x7fae800d1d00 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae800b6880 con 0x7fae800d1d00 2024-09-17T05:37:16.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae7cc00640 1 -- 172.21.15.44:0/2460988292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae780b2040 con 0x7fae800d1d00 2024-09-17T05:37:16.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae800b6e40 con 0x7fae800d1d00 2024-09-17T05:37:16.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.594+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8015d060 con 0x7fae800d1d00 2024-09-17T05:37:16.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.598+0000 7fae7cc00640 1 -- 172.21.15.44:0/2460988292 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fae78004200 con 0x7fae800d1d00 2024-09-17T05:37:16.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.598+0000 7fae7cc00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fae60073200 0x7fae60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.598+0000 7fae7cc00640 1 -- 172.21.15.44:0/2460988292 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fae7812e210 con 0x7fae800d1d00 2024-09-17T05:37:16.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.598+0000 7fae85200640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fae60073200 0x7fae60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.598+0000 7fae85200640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fae60073200 0x7fae60075710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae74007fd0 tx=0x7fae74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.602+0000 7fae7cc00640 1 -- 172.21.15.44:0/2460988292 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fae78016990 con 0x7fae800d1d00 2024-09-17T05:37:16.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.818+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fae801593a0 con 0x7fae800d1d00 2024-09-17T05:37:16.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.818+0000 7fae7cc00640 1 -- 172.21.15.44:0/2460988292 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fae780f89c0 con 0x7fae800d1d00 2024-09-17T05:37:16.819 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fae60073200 msgr2=0x7fae60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fae60073200 0x7fae60075710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae74007fd0 tx=0x7fae74009040 comp rx=0 tx=0).stop 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae800d1d00 msgr2=0x7fae8006f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae800d1d00 0x7fae8006f390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fae78009bd0 tx=0x7fae780092c0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 shutdown_connections 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae800d1d00 0x7fae8006f390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fae60073200 0x7fae60075710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae800d18f0 0x7fae8014d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 --2- 172.21.15.44:0/2460988292 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fae800cf5b0 0x7fae801fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 >> 172.21.15.44:0/2460988292 conn(0x7fae800b4240 msgr2=0x7fae80152ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 shutdown_connections 2024-09-17T05:37:16.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:16.822+0000 7fae87c00640 1 -- 172.21.15.44:0/2460988292 wait complete. 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:37:16.842 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:37:16.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:16.843 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:37:16.852 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42369sec preferred_lft 42369sec 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:37:16.853 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:37:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:37:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:37:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:37:16.855 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:16.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:16.856 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:37:16.914 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:37:16.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:16.917 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:37:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:37:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:37:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:37:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:37:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:37:16.970 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:37:16.970 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:37:16.971 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:37:16.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:37:16.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:37:16.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:37:16.971 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:37:17.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:37:17.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:17.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.112 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:37:17.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:37:17.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:37:17.166 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:37:17.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:37:17.229 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:37:17.229 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:17.281 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:37:17.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:37:17.281 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:17.332 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:37:17.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:17.434 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:37:17.435 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:37:17.452 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:17.452 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:37:17.453 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:37:17.453 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:37:17.453 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:37:17.463 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:37:17.467 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:37:17.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:17.487 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:37:17.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:37:17.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:17.594 INFO:teuthology.orchestra.run.smithi044.stdout:client4862 2024-09-17T05:37:17.594 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:17.594 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:17.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.604 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-09-17T05:37:17.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.664 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-09-17T05:37:17.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.715 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-09-17T05:37:17.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.767 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-09-17T05:37:17.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.821 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-09-17T05:37:17.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:17.878 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-09-17T05:37:17.935 INFO:teuthology.orchestra.run.smithi044.stdout:./ 2024-09-17T05:37:17.935 INFO:teuthology.orchestra.run.smithi044.stdout:./rfile 2024-09-17T05:37:17.935 INFO:teuthology.orchestra.run.smithi044.stdout:./parentdir 2024-09-17T05:37:17.935 INFO:teuthology.orchestra.run.smithi044.stdout:./parentdir/pfile 2024-09-17T05:37:17.935 INFO:teuthology.orchestra.run.smithi044.stdout:./parentdir/childdir 2024-09-17T05:37:17.935 INFO:teuthology.orchestra.run.smithi044.stdout:./parentdir/childdir/cfile 2024-09-17T05:37:17.936 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:37:17.936 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:37:17.936 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:37:17.936 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:37:17.937 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-09-17T05:37:17.937 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:37:18.046 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:37:18.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:18.055 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:37:18.055 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:37:18.056 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:37:18.056 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:37:18.056 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-09-17T05:37:18.056 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:37:18.166 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-17T05:37:18.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:18.175 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:37:18.176 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:37:18.176 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:37:18.176 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:37:18.176 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-09-17T05:37:18.176 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:37:18.282 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-17T05:37:18.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:18.292 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:37:18.292 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:37:18.292 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:37:18.292 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:37:18.292 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-09-17T05:37:18.292 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:37:18.402 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628279 2024-09-17T05:37:18.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:18.412 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:37:18.412 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:37:18.412 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:37:18.412 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:37:18.412 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-09-17T05:37:18.412 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:37:18.522 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-17T05:37:18.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:18.531 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:37:18.531 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:37:18.531 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:37:18.531 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:37:18.531 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-09-17T05:37:18.531 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:37:18.642 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628280 2024-09-17T05:37:18.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:18.652 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:18.652 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:18.701 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:18.701 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:18.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 -- 172.21.15.44:0/2314539619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 msgr2=0x7ff7100cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 --2- 172.21.15.44:0/2314539619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 0x7ff7100cec50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff704009840 tx=0x7ff70401c6b0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 -- 172.21.15.44:0/2314539619 shutdown_connections 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 --2- 172.21.15.44:0/2314539619 >> v2:172.21.15.86:3300/0 conn(0x7ff71015bd30 0x7ff7100cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 --2- 172.21.15.44:0/2314539619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 0x7ff7100cec50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 -- 172.21.15.44:0/2314539619 >> 172.21.15.44:0/2314539619 conn(0x7ff7100ccaa0 msgr2=0x7ff7100cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 -- 172.21.15.44:0/2314539619 shutdown_connections 2024-09-17T05:37:18.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.958+0000 7ff717800640 1 -- 172.21.15.44:0/2314539619 wait complete. 2024-09-17T05:37:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 Processor -- start 2024-09-17T05:37:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 -- start start 2024-09-17T05:37:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 0x7ff7100c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7100cb040 0x7ff71015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71015bd30 0x7ff71015e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff71006e1e0 con 0x7ff71015bd30 2024-09-17T05:37:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff71006e060 con 0x7ff7100cb040 2024-09-17T05:37:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff717800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff71006e360 con 0x7ff7100cac30 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff715800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71015bd30 0x7ff71015e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff715800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71015bd30 0x7ff71015e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45100/0 (socket says 172.21.15.44:45100) 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff715800640 1 -- 172.21.15.44:0/506818827 learned_addr learned my addr 172.21.15.44:0/506818827 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.962+0000 7ff714e00640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 0x7ff7100c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff70fe00640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7100cb040 0x7ff71015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff715800640 1 -- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 msgr2=0x7ff7100c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff715800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 0x7ff7100c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff715800640 1 -- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7100cb040 msgr2=0x7ff71015dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff715800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7100cb040 0x7ff71015dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff715800640 1 -- 172.21.15.44:0/506818827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71009d8c0 con 0x7ff71015bd30 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff70fe00640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7100cb040 0x7ff71015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff715800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71015bd30 0x7ff71015e000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff70800a440 tx=0x7ff7080095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff70cc00640 1 -- 172.21.15.44:0/506818827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708009e50 con 0x7ff71015bd30 2024-09-17T05:37:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff70cc00640 1 -- 172.21.15.44:0/506818827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff708003980 con 0x7ff71015bd30 2024-09-17T05:37:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7100c9ee0 con 0x7ff71015bd30 2024-09-17T05:37:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff70cc00640 1 -- 172.21.15.44:0/506818827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708003db0 con 0x7ff71015bd30 2024-09-17T05:37:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7100c9c00 con 0x7ff71015bd30 2024-09-17T05:37:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7101f74f0 con 0x7ff71015bd30 2024-09-17T05:37:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.966+0000 7ff70cc00640 1 -- 172.21.15.44:0/506818827 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff708003f50 con 0x7ff71015bd30 2024-09-17T05:37:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.970+0000 7ff70cc00640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff6f0073200 0x7ff6f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.970+0000 7ff70cc00640 1 -- 172.21.15.44:0/506818827 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7ff7080941b0 con 0x7ff71015bd30 2024-09-17T05:37:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.970+0000 7ff714e00640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff6f0073200 0x7ff6f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.970+0000 7ff714e00640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff6f0073200 0x7ff6f0075710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7040af000 tx=0x7ff70401aef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:18.974+0000 7ff70cc00640 1 -- 172.21.15.44:0/506818827 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff70805e9e0 con 0x7ff71015bd30 2024-09-17T05:37:19.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.158+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7100c9690 con 0x7ff71015bd30 2024-09-17T05:37:19.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.158+0000 7ff70cc00640 1 -- 172.21.15.44:0/506818827 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7ff708063410 con 0x7ff71015bd30 2024-09-17T05:37:19.160 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:37:19.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff6f0073200 msgr2=0x7ff6f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff6f0073200 0x7ff6f0075710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff7040af000 tx=0x7ff70401aef0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71015bd30 msgr2=0x7ff71015e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71015bd30 0x7ff71015e000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff70800a440 tx=0x7ff7080095b0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 shutdown_connections 2024-09-17T05:37:19.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff71015bd30 0x7ff71015e000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff6f0073200 0x7ff6f0075710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7100cb040 0x7ff71015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 --2- 172.21.15.44:0/506818827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7100cac30 0x7ff7100c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 >> 172.21.15.44:0/506818827 conn(0x7ff7100ccaa0 msgr2=0x7ff71015ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 shutdown_connections 2024-09-17T05:37:19.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.162+0000 7ff717800640 1 -- 172.21.15.44:0/506818827 wait complete. 2024-09-17T05:37:19.182 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:37:19.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:19.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:19.241 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:37:19.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:19.242 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:37:19.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.458+0000 7f0216200640 1 -- 172.21.15.44:0/3299649236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100cc480 msgr2=0x7f0210166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.458+0000 7f0216200640 1 --2- 172.21.15.44:0/3299649236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100cc480 0x7f0210166480 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0208009bf0 tx=0x7f020801ca70 comp rx=0 tx=0).stop 2024-09-17T05:37:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.458+0000 7f0216200640 1 -- 172.21.15.44:0/3299649236 shutdown_connections 2024-09-17T05:37:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.458+0000 7f0216200640 1 --2- 172.21.15.44:0/3299649236 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f02100cc480 0x7f0210166480 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.458+0000 7f0216200640 1 -- 172.21.15.44:0/3299649236 >> 172.21.15.44:0/3299649236 conn(0x7f02100ccaa0 msgr2=0x7f02100cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.458+0000 7f0216200640 1 -- 172.21.15.44:0/3299649236 shutdown_connections 2024-09-17T05:37:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.458+0000 7f0216200640 1 -- 172.21.15.44:0/3299649236 wait complete. 2024-09-17T05:37:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 Processor -- start 2024-09-17T05:37:19.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 -- start start 2024-09-17T05:37:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021006de50 0x7f02101fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0210072e50 0x7f0210152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100cc480 0x7f0210165a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0210169ff0 con 0x7f0210072e50 2024-09-17T05:37:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0210169e70 con 0x7f02100cc480 2024-09-17T05:37:19.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f0216200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f021016a170 con 0x7f021006de50 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0210072e50 0x7f0210152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0210072e50 0x7f0210152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45104/0 (socket says 172.21.15.44:45104) 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 -- 172.21.15.44:0/3788795519 learned_addr learned my addr 172.21.15.44:0/3788795519 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020f400640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021006de50 0x7f02101fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020fe00640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100cc480 0x7f0210165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 -- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021006de50 msgr2=0x7f02101fbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021006de50 0x7f02101fbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 -- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100cc480 msgr2=0x7f0210165a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100cc480 0x7f0210165a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.462+0000 7f020ea00640 1 -- 172.21.15.44:0/3788795519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02101fc590 con 0x7f0210072e50 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f020ea00640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0210072e50 0x7f0210152dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c400 tx=0x7f01fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0207400640 1 -- 172.21.15.44:0/3788795519 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc017070 con 0x7f0210072e50 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0207400640 1 -- 172.21.15.44:0/3788795519 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01fc005400 con 0x7f0210072e50 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0210153930 con 0x7f0210072e50 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0207400640 1 -- 172.21.15.44:0/3788795519 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc003860 con 0x7f0210072e50 2024-09-17T05:37:19.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02101599f0 con 0x7f0210072e50 2024-09-17T05:37:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021015e990 con 0x7f0210072e50 2024-09-17T05:37:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0207400640 1 -- 172.21.15.44:0/3788795519 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f01fc01a070 con 0x7f0210072e50 2024-09-17T05:37:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0207400640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f0073200 0x7f01f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f0207400640 1 -- 172.21.15.44:0/3788795519 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f01fc0936a0 con 0x7f0210072e50 2024-09-17T05:37:19.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.466+0000 7f020f400640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f0073200 0x7f01f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.470+0000 7f020f400640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f0073200 0x7f01f0075710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c10 tx=0x7f0200001730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.470+0000 7f0207400640 1 -- 172.21.15.44:0/3788795519 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f01fc05df60 con 0x7f0210072e50 2024-09-17T05:37:19.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0210153680 con 0x7f0210072e50 2024-09-17T05:37:19.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0207400640 1 -- 172.21.15.44:0/3788795519 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7f01fc062990 con 0x7f0210072e50 2024-09-17T05:37:19.683 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:19.683 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:19.683 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f0073200 msgr2=0x7f01f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f0073200 0x7f01f0075710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0200000c10 tx=0x7f0200001730 comp rx=0 tx=0).stop 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0210072e50 msgr2=0x7f0210152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0210072e50 0x7f0210152dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00c400 tx=0x7f01fc00c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 shutdown_connections 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f0073200 0x7f01f0075710 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02100cc480 0x7f0210165a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0210072e50 0x7f0210152dc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 --2- 172.21.15.44:0/3788795519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021006de50 0x7f02101fbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 >> 172.21.15.44:0/3788795519 conn(0x7f02100ccaa0 msgr2=0x7f0210157690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 shutdown_connections 2024-09-17T05:37:19.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:19.682+0000 7f0216200640 1 -- 172.21.15.44:0/3788795519 wait complete. 2024-09-17T05:37:19.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T05:37:19.891 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:37:19.891 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:37:19.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:20.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 -- 172.21.15.44:0/3844491462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb48072e50 msgr2=0x7fbb4815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3844491462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb48072e50 0x7fbb4815e990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009840 tx=0x7fbb3c01c790 comp rx=0 tx=0).stop 2024-09-17T05:37:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 -- 172.21.15.44:0/3844491462 shutdown_connections 2024-09-17T05:37:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3844491462 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4806de50 0x7fbb4806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3844491462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb48072e50 0x7fbb4815e990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 -- 172.21.15.44:0/3844491462 >> 172.21.15.44:0/3844491462 conn(0x7fbb480ccaa0 msgr2=0x7fbb480cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 -- 172.21.15.44:0/3844491462 shutdown_connections 2024-09-17T05:37:20.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 -- 172.21.15.44:0/3844491462 wait complete. 2024-09-17T05:37:20.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 Processor -- start 2024-09-17T05:37:20.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.050+0000 7fbb4f800640 1 -- start start 2024-09-17T05:37:20.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4806de50 0x7fbb4815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb48072e50 0x7fbb481fc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb480ced00 0x7fbb48157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb481694b0 con 0x7fbb48072e50 2024-09-17T05:37:20.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbb48169330 con 0x7fbb480ced00 2024-09-17T05:37:20.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbb48169630 con 0x7fbb4806de50 2024-09-17T05:37:20.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb48072e50 0x7fbb481fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb48072e50 0x7fbb481fc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45114/0 (socket says 172.21.15.44:45114) 2024-09-17T05:37:20.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 -- 172.21.15.44:0/3163035074 learned_addr learned my addr 172.21.15.44:0/3163035074 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:20.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4d800640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb480ced00 0x7fbb48157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4ce00640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4806de50 0x7fbb4815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 -- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4806de50 msgr2=0x7fbb4815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4806de50 0x7fbb4815aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 -- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb480ced00 msgr2=0x7fbb48157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb480ced00 0x7fbb48157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 -- 172.21.15.44:0/3163035074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb481659d0 con 0x7fbb48072e50 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb47e00640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb48072e50 0x7fbb481fc900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e9f0 tx=0x7fbb3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb44c00640 1 -- 172.21.15.44:0/3163035074 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400cde0 con 0x7fbb48072e50 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb44c00640 1 -- 172.21.15.44:0/3163035074 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb34004020 con 0x7fbb48072e50 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb44c00640 1 -- 172.21.15.44:0/3163035074 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34004410 con 0x7fbb48072e50 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb48165cb0 con 0x7fbb48072e50 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb481fce40 con 0x7fbb48072e50 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.054+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4806e260 con 0x7fbb48072e50 2024-09-17T05:37:20.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.058+0000 7fbb44c00640 1 -- 172.21.15.44:0/3163035074 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbb34003600 con 0x7fbb48072e50 2024-09-17T05:37:20.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.058+0000 7fbb44c00640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb28073230 0x7fbb28075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.058+0000 7fbb44c00640 1 -- 172.21.15.44:0/3163035074 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fbb34094c80 con 0x7fbb48072e50 2024-09-17T05:37:20.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.058+0000 7fbb4ce00640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb28073230 0x7fbb28075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.058+0000 7fbb4ce00640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb28073230 0x7fbb28075740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0af000 tx=0x7fbb3c01afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.062+0000 7fbb44c00640 1 -- 172.21.15.44:0/3163035074 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbb3405f430 con 0x7fbb48072e50 2024-09-17T05:37:20.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.266+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb480b1360 con 0x7fbb48072e50 2024-09-17T05:37:20.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb44c00640 1 -- 172.21.15.44:0/3163035074 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7fbb34063e60 con 0x7fbb48072e50 2024-09-17T05:37:20.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:20.269 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:20.270 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb28073230 msgr2=0x7fbb28075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb28073230 0x7fbb28075740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0af000 tx=0x7fbb3c01afd0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb48072e50 msgr2=0x7fbb481fc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb48072e50 0x7fbb481fc900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e9f0 tx=0x7fbb3400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 shutdown_connections 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb28073230 0x7fbb28075740 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb480ced00 0x7fbb48157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb48072e50 0x7fbb481fc900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 --2- 172.21.15.44:0/3163035074 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb4806de50 0x7fbb4815aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 >> 172.21.15.44:0/3163035074 conn(0x7fbb480ccaa0 msgr2=0x7fbb480b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 shutdown_connections 2024-09-17T05:37:20.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:20.270+0000 7fbb4f800640 1 -- 172.21.15.44:0/3163035074 wait complete. 2024-09-17T05:37:20.293 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-09-17T05:37:20.471 INFO:teuthology.orchestra.run.smithi044.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-09-17T05:37:20.471 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-09-17T05:37:30.472 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-09-17T05:37:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 Processor -- start 2024-09-17T05:37:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 -- start start 2024-09-17T05:37:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dba4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 0x56456dbb8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dba0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56456dac4a00 con 0x56456dc49070 2024-09-17T05:37:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56456db22f40 con 0x56456db78030 2024-09-17T05:37:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fbce4c080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56456dbbfa00 con 0x56456dbbd4a0 2024-09-17T05:37:30.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dba0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dba4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dba4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:53144/0 (socket says 172.21.15.44:53144) 2024-09-17T05:37:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dba0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40984/0 (socket says 172.21.15.44:40984) 2024-09-17T05:37:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6000640 1 -- 172.21.15.44:0/1678563590 learned_addr learned my addr 172.21.15.44:0/1678563590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb5600640 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 0x56456dbb8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 -- 172.21.15.44:0/1678563590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 msgr2=0x56456dbb8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 0x56456dbb8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 -- 172.21.15.44:0/1678563590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 msgr2=0x56456dba4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dba4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 -- 172.21.15.44:0/1678563590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456da9dc10 con 0x56456dc49070 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fb6a00640 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dba0fc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0005f60 tx=0x7f0fb0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f24ac3d24f6817 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fafe00640 1 -- 172.21.15.44:0/1678563590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0008820 con 0x56456dc49070 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fafe00640 1 -- 172.21.15.44:0/1678563590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb000f030 con 0x56456dc49070 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.542+0000 7f0fafe00640 1 -- 172.21.15.44:0/1678563590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0008d70 con 0x56456dc49070 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- 172.21.15.44:0/1678563590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 msgr2=0x56456dba0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dba0fc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0005f60 tx=0x7f0fb0005f90 comp rx=0 tx=0).stop 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- 172.21.15.44:0/1678563590 shutdown_connections 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dba0fc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 0x56456dbb8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/1678563590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dba4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- 172.21.15.44:0/1678563590 >> 172.21.15.44:0/1678563590 conn(0x56456db62d20 msgr2=0x56456dbb5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- 172.21.15.44:0/1678563590 shutdown_connections 2024-09-17T05:37:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- 172.21.15.44:0/1678563590 wait complete. 2024-09-17T05:37:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 Processor -- start 2024-09-17T05:37:30.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- start start 2024-09-17T05:37:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dc3ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 0x56456dc30ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dc466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56456dba1fd0 con 0x56456dc49070 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56456dba2270 con 0x56456db78030 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fbce4c080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56456dc42de0 con 0x56456dbbd4a0 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fb6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dc466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fb6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dc466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41000/0 (socket says 172.21.15.44:41000) 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fb6a00640 1 -- 172.21.15.44:0/3153256882 learned_addr learned my addr 172.21.15.44:0/3153256882 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fb5600640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 0x56456dc30ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.546+0000 7f0fb6000640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dc3ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fb6a00640 1 -- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 msgr2=0x56456dc30ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fb6a00640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56456dbbd4a0 0x56456dc30ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fb6a00640 1 -- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 msgr2=0x56456dc3ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fb6a00640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56456db78030 0x56456dc3ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fb6a00640 1 -- 172.21.15.44:0/3153256882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456dc3f520 con 0x56456dc49070 2024-09-17T05:37:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fb6a00640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dc466b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000acb0 tx=0x7f0fb0008850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0faea00640 1 -- 172.21.15.44:0/3153256882 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00148f0 con 0x56456dc49070 2024-09-17T05:37:30.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0faea00640 1 -- 172.21.15.44:0/3153256882 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb0021070 con 0x56456dc49070 2024-09-17T05:37:30.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56456dc3f7c0 con 0x56456dc49070 2024-09-17T05:37:30.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0faea00640 1 -- 172.21.15.44:0/3153256882 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0014e20 con 0x56456dc49070 2024-09-17T05:37:30.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456dc3fd00 con 0x56456dc49070 2024-09-17T05:37:30.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.550+0000 7f0faea00640 1 -- 172.21.15.44:0/3153256882 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0fb0026460 con 0x56456dc49070 2024-09-17T05:37:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0faea00640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f98071be0 0x7f0f980740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0faea00640 1 -- 172.21.15.44:0/3153256882 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f0fb0094940 con 0x56456dc49070 2024-09-17T05:37:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fb6000640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f98071be0 0x7f0f980740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x56456dc31010 0x56456dcef100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x56456dbbc2f0 con 0x56456dc31010 2024-09-17T05:37:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fb5600640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x56456dc31010 0x56456dcef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fb6000640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f98071be0 0x7f0f980740f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8004fd0 tx=0x7f0fa8004d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fb5600640 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x56456dc31010 0x56456dcef100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fb5600640 1 -- 172.21.15.44:0/3153256882 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f0fa40ac990 con 0x56456dc31010 2024-09-17T05:37:30.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x56456dc31010 msgr2=0x56456dcef100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x56456dc31010 0x56456dcef100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f98071be0 msgr2=0x7f0f980740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f98071be0 0x7f0f980740f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8004fd0 tx=0x7f0fa8004d70 comp rx=0 tx=0).stop 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 msgr2=0x56456dc466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 --2- 172.21.15.44:0/3153256882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56456dc49070 0x56456dc466b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000acb0 tx=0x7f0fb0008850 comp rx=0 tx=0).stop 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fb6a00640 1 -- 172.21.15.44:0/3153256882 reap_dead start 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 shutdown_connections 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 >> 172.21.15.44:0/3153256882 conn(0x56456db62d20 msgr2=0x56456dc42460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 shutdown_connections 2024-09-17T05:37:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.554+0000 7f0fbce4c080 1 -- 172.21.15.44:0/3153256882 wait complete. 2024-09-17T05:37:30.561 INFO:teuthology.orchestra.run.smithi044.stdout:mytag 2024-09-17T05:37:30.561 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-09-17T05:37:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 Processor -- start 2024-09-17T05:37:30.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 -- start start 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909c540 0x55ee890b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909b620 0x55ee88fe4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ee88f8ff40 con 0x55ee8900df70 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ee88f9cd00 con 0x55ee8909c540 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd12648080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55ee88f31a00 con 0x55ee8909b620 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd0a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd0a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41016/0 (socket says 172.21.15.44:41016) 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd0a200640 1 -- 172.21.15.44:0/3059645330 learned_addr learned my addr 172.21.15.44:0/3059645330 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.622+0000 7fdd0ac00640 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909c540 0x55ee890b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd0b600640 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909b620 0x55ee88fe4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd0a200640 1 -- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909b620 msgr2=0x55ee88fe4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd0a200640 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909b620 0x55ee88fe4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd0a200640 1 -- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909c540 msgr2=0x55ee890b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd0a200640 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909c540 0x55ee890b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd0a200640 1 -- 172.21.15.44:0/3059645330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee8909ba30 con 0x55ee8900df70 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd0a200640 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909b0e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdcf801a660 tx=0x7fdcf801a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d714f4ffe92bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd08e00640 1 -- 172.21.15.44:0/3059645330 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80a7820 con 0x55ee8900df70 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd08e00640 1 -- 172.21.15.44:0/3059645330 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcf80a7af0 con 0x55ee8900df70 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd08e00640 1 -- 172.21.15.44:0/3059645330 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80b0470 con 0x55ee8900df70 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 -- 172.21.15.44:0/3059645330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 msgr2=0x55ee8909b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909b0e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdcf801a660 tx=0x7fdcf801a7f0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 -- 172.21.15.44:0/3059645330 shutdown_connections 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909b620 0x55ee88fe4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909b0e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 --2- 172.21.15.44:0/3059645330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909c540 0x55ee890b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 -- 172.21.15.44:0/3059645330 >> 172.21.15.44:0/3059645330 conn(0x55ee88fcfd20 msgr2=0x55ee8909a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 -- 172.21.15.44:0/3059645330 shutdown_connections 2024-09-17T05:37:30.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 -- 172.21.15.44:0/3059645330 wait complete. 2024-09-17T05:37:30.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 Processor -- start 2024-09-17T05:37:30.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.626+0000 7fdd12648080 1 -- start start 2024-09-17T05:37:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909b620 0x55ee89012b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909c540 0x55ee890b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ee8900d6a0 con 0x55ee8900df70 2024-09-17T05:37:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ee8900d440 con 0x55ee8909b620 2024-09-17T05:37:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55ee8900d940 con 0x55ee8909c540 2024-09-17T05:37:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41032/0 (socket says 172.21.15.44:41032) 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 -- 172.21.15.44:0/2336336599 learned_addr learned my addr 172.21.15.44:0/2336336599 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0a200640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909b620 0x55ee89012b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0b600640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909c540 0x55ee890b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 -- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909c540 msgr2=0x55ee890b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55ee8909c540 0x55ee890b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 -- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909b620 msgr2=0x55ee89012b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ee8909b620 0x55ee89012b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 -- 172.21.15.44:0/2336336599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee89154100 con 0x55ee8900df70 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd0ac00640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909ad60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00c3b0 tx=0x7fdcfc00c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd03400640 1 -- 172.21.15.44:0/2336336599 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc018670 con 0x55ee8900df70 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd03400640 1 -- 172.21.15.44:0/2336336599 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcfc013070 con 0x55ee8900df70 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd03400640 1 -- 172.21.15.44:0/2336336599 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc018b60 con 0x55ee8900df70 2024-09-17T05:37:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee890297f0 con 0x55ee8900df70 2024-09-17T05:37:30.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.630+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee89029d30 con 0x55ee8900df70 2024-09-17T05:37:30.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd03400640 1 -- 172.21.15.44:0/2336336599 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdcfc018d00 con 0x55ee8900df70 2024-09-17T05:37:30.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd03400640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdcec071c10 0x7fdcec074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd03400640 1 -- 172.21.15.44:0/2336336599 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fdcfc093730 con 0x55ee8900df70 2024-09-17T05:37:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd0a200640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdcec071c10 0x7fdcec074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55ee89013060 0x55ee8915b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x55ee89004f70 con 0x55ee89013060 2024-09-17T05:37:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd0b600640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55ee89013060 0x55ee8915b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd0a200640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdcec071c10 0x7fdcec074120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80b8000 tx=0x7fdcf8004890 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd0b600640 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55ee89013060 0x55ee8915b9d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd0b600640 1 -- 172.21.15.44:0/2336336599 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fdd04002550 con 0x55ee89013060 2024-09-17T05:37:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55ee89013060 msgr2=0x55ee8915b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55ee89013060 0x55ee8915b9d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdcec071c10 msgr2=0x7fdcec074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdcec071c10 0x7fdcec074120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80b8000 tx=0x7fdcf8004890 comp rx=0 tx=0).stop 2024-09-17T05:37:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 msgr2=0x55ee8909ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 --2- 172.21.15.44:0/2336336599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ee8900df70 0x55ee8909ad60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00c3b0 tx=0x7fdcfc00c4a0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd0b600640 1 -- 172.21.15.44:0/2336336599 reap_dead start 2024-09-17T05:37:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 shutdown_connections 2024-09-17T05:37:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 >> 172.21.15.44:0/2336336599 conn(0x55ee88fcfd20 msgr2=0x55ee890b63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 shutdown_connections 2024-09-17T05:37:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.634+0000 7fdd12648080 1 -- 172.21.15.44:0/2336336599 wait complete. 2024-09-17T05:37:30.641 INFO:teuthology.orchestra.run.smithi044.stdout:mytag 2024-09-17T05:37:30.641 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-09-17T05:37:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.698+0000 7fdeeda60080 1 Processor -- start 2024-09-17T05:37:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.698+0000 7fdeeda60080 1 -- start start 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc70c1030 0x561bc718b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc71064a0 0x561bc70bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc7192070 0x561bc70bd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561bc70ed540 con 0x561bc7192070 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561bc700da00 con 0x561bc70c1030 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x561bc70ee380 con 0x561bc71064a0 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc7192070 0x561bc70bd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc7192070 0x561bc70bd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41050/0 (socket says 172.21.15.44:41050) 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 -- 172.21.15.44:0/473330432 learned_addr learned my addr 172.21.15.44:0/473330432 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee6c00640 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc70c1030 0x561bc718b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee6200640 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc71064a0 0x561bc70bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 -- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc71064a0 msgr2=0x561bc70bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc71064a0 0x561bc70bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 -- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc70c1030 msgr2=0x561bc718b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc70c1030 0x561bc718b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 -- 172.21.15.44:0/473330432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bc700ca20 con 0x561bc7192070 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee7600640 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc7192070 0x561bc70bd2a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdee001bd00 tx=0x7fdee0018200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7a44d6e2933f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee4e00640 1 -- 172.21.15.44:0/473330432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00af070 con 0x561bc7192070 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee4e00640 1 -- 172.21.15.44:0/473330432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdee00bc070 con 0x561bc7192070 2024-09-17T05:37:30.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdee4e00640 1 -- 172.21.15.44:0/473330432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00b6480 con 0x561bc7192070 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- 172.21.15.44:0/473330432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc7192070 msgr2=0x561bc70bd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc7192070 0x561bc70bd2a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdee001bd00 tx=0x7fdee0018200 comp rx=0 tx=0).stop 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- 172.21.15.44:0/473330432 shutdown_connections 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc7192070 0x561bc70bd2a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc71064a0 0x561bc70bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 --2- 172.21.15.44:0/473330432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc70c1030 0x561bc718b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- 172.21.15.44:0/473330432 >> 172.21.15.44:0/473330432 conn(0x561bc70abd20 msgr2=0x561bc718ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- 172.21.15.44:0/473330432 shutdown_connections 2024-09-17T05:37:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 -- 172.21.15.44:0/473330432 wait complete. 2024-09-17T05:37:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.702+0000 7fdeeda60080 1 Processor -- start 2024-09-17T05:37:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 -- start start 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc70c1030 0x561bc70ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc71064a0 0x561bc718ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc7192070 0x561bc70e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561bc70ffff0 con 0x561bc70c1030 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561bc70ff370 con 0x561bc71064a0 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x561bc718c1d0 con 0x561bc7192070 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc70c1030 0x561bc70ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc70c1030 0x561bc70ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41056/0 (socket says 172.21.15.44:41056) 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 -- 172.21.15.44:0/91144216 learned_addr learned my addr 172.21.15.44:0/91144216 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6200640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc71064a0 0x561bc718ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee7600640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc7192070 0x561bc70e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 -- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc7192070 msgr2=0x561bc70e85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561bc7192070 0x561bc70e85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 -- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc71064a0 msgr2=0x561bc718ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561bc71064a0 0x561bc718ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 -- 172.21.15.44:0/91144216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bc6fe6c10 con 0x561bc70c1030 2024-09-17T05:37:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdee6c00640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc70c1030 0x561bc70ef300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fded80044c0 tx=0x7fded800abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdedf400640 1 -- 172.21.15.44:0/91144216 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8009dc0 con 0x561bc70c1030 2024-09-17T05:37:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdedf400640 1 -- 172.21.15.44:0/91144216 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fded800ae10 con 0x561bc70c1030 2024-09-17T05:37:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bc7100ed0 con 0x561bc70c1030 2024-09-17T05:37:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdedf400640 1 -- 172.21.15.44:0/91144216 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded80086a0 con 0x561bc70c1030 2024-09-17T05:37:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.706+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bc71016b0 con 0x561bc70c1030 2024-09-17T05:37:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdedf400640 1 -- 172.21.15.44:0/91144216 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fded8008840 con 0x561bc70c1030 2024-09-17T05:37:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdedf400640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdec8071be0 0x7fdec80740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdedf400640 1 -- 172.21.15.44:0/91144216 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fded8093c30 con 0x561bc70c1030 2024-09-17T05:37:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdee6200640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdec8071be0 0x7fdec80740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdeeda60080 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x561bc70e8b10 0x561bc7226060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x561bc718c600 con 0x561bc70e8b10 2024-09-17T05:37:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdee7600640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x561bc70e8b10 0x561bc7226060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdee6200640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdec8071be0 0x7fdec80740f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fded400c6f0 tx=0x7fded400e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.710+0000 7fdee7600640 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x561bc70e8b10 0x561bc7226060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdee7600640 1 -- 172.21.15.44:0/91144216 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fdee0002050 con 0x561bc70e8b10 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x561bc70e8b10 msgr2=0x561bc7226060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x561bc70e8b10 0x561bc7226060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdec8071be0 msgr2=0x7fdec80740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdec8071be0 0x7fdec80740f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fded400c6f0 tx=0x7fded400e040 comp rx=0 tx=0).stop 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc70c1030 msgr2=0x561bc70ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 --2- 172.21.15.44:0/91144216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561bc70c1030 0x561bc70ef300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fded80044c0 tx=0x7fded800abc0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdee7600640 1 -- 172.21.15.44:0/91144216 reap_dead start 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 shutdown_connections 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 >> 172.21.15.44:0/91144216 conn(0x561bc70abd20 msgr2=0x561bc718b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 shutdown_connections 2024-09-17T05:37:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.714+0000 7fdeeda60080 1 -- 172.21.15.44:0/91144216 wait complete. 2024-09-17T05:37:30.718 INFO:teuthology.orchestra.run.smithi044.stdout:mytag 2024-09-17T05:37:30.718 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-09-17T05:37:30.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 Processor -- start 2024-09-17T05:37:30.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 -- start start 2024-09-17T05:37:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591555797f0 0x5591555eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55915557b920 0x5591555ebf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555eefb0 0x559155606240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55915547fa00 con 0x55915557b920 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5591554ddf40 con 0x5591555eefb0 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559155561790 con 0x5591555797f0 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55915557b920 0x5591555ebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55915557b920 0x5591555ebf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41068/0 (socket says 172.21.15.44:41068) 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 -- 172.21.15.44:0/3333743876 learned_addr learned my addr 172.21.15.44:0/3333743876 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3e00640 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591555797f0 0x5591555eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e4800640 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555eefb0 0x559155606240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 -- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591555797f0 msgr2=0x5591555eb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591555797f0 0x5591555eb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 -- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555eefb0 msgr2=0x559155606240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555eefb0 0x559155606240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 -- 172.21.15.44:0/3333743876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559155458c10 con 0x55915557b920 2024-09-17T05:37:30.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e3400640 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55915557b920 0x5591555ebf10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f28d0001e40 tx=0x7f28d000b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df70c9cf4de2fa2a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e2000640 1 -- 172.21.15.44:0/3333743876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0012070 con 0x55915557b920 2024-09-17T05:37:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e2000640 1 -- 172.21.15.44:0/3333743876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28d000e950 con 0x55915557b920 2024-09-17T05:37:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28e2000640 1 -- 172.21.15.44:0/3333743876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d000eda0 con 0x55915557b920 2024-09-17T05:37:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 -- 172.21.15.44:0/3333743876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55915557b920 msgr2=0x5591555ebf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55915557b920 0x5591555ebf10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f28d0001e40 tx=0x7f28d000b740 comp rx=0 tx=0).stop 2024-09-17T05:37:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 -- 172.21.15.44:0/3333743876 shutdown_connections 2024-09-17T05:37:30.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555eefb0 0x559155606240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55915557b920 0x5591555ebf10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 --2- 172.21.15.44:0/3333743876 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591555797f0 0x5591555eb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.778+0000 7f28eabd2080 1 -- 172.21.15.44:0/3333743876 >> 172.21.15.44:0/3333743876 conn(0x55915551dd20 msgr2=0x5591555ed500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 -- 172.21.15.44:0/3333743876 shutdown_connections 2024-09-17T05:37:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 -- 172.21.15.44:0/3333743876 wait complete. 2024-09-17T05:37:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 Processor -- start 2024-09-17T05:37:30.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 -- start start 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555797f0 0x5591555ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55915557b920 0x5591556a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591555eefb0 0x559155560660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559155607590 con 0x5591555eefb0 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559155531700 con 0x5591555797f0 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28eabd2080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559155530f20 con 0x55915557b920 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591555eefb0 0x559155560660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591555eefb0 0x559155560660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41076/0 (socket says 172.21.15.44:41076) 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 -- 172.21.15.44:0/2639344070 learned_addr learned my addr 172.21.15.44:0/2639344070 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e3e00640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555797f0 0x5591555ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e3400640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55915557b920 0x5591556a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 -- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55915557b920 msgr2=0x5591556a20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55915557b920 0x5591556a20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 -- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555797f0 msgr2=0x5591555ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555797f0 0x5591555ea970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 -- 172.21.15.44:0/2639344070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591556971f0 con 0x5591555eefb0 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e3e00640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591555797f0 0x5591555ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.782+0000 7f28e4800640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591555eefb0 0x559155560660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00f6f0 tx=0x7f28dc00fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e0c00640 1 -- 172.21.15.44:0/2639344070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00b9d0 con 0x5591555eefb0 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e0c00640 1 -- 172.21.15.44:0/2639344070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28dc014030 con 0x5591555eefb0 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591556a29a0 con 0x5591555eefb0 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e0c00640 1 -- 172.21.15.44:0/2639344070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc010440 con 0x5591555eefb0 2024-09-17T05:37:30.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591556a2ee0 con 0x5591555eefb0 2024-09-17T05:37:30.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e0c00640 1 -- 172.21.15.44:0/2639344070 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f28dc0105e0 con 0x5591555eefb0 2024-09-17T05:37:30.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e0c00640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28c4071be0 0x7f28c40740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e0c00640 1 -- 172.21.15.44:0/2639344070 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f28dc093e70 con 0x5591555eefb0 2024-09-17T05:37:30.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28eabd2080 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55915555e360 0x5591556a3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e3e00640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28c4071be0 0x7f28c40740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x5591556a4310 con 0x55915555e360 2024-09-17T05:37:30.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.786+0000 7f28e3400640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55915555e360 0x5591556a3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28e3e00640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28c4071be0 0x7f28c40740f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28d40ab000 tx=0x7f28d40ad040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28e3400640 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55915555e360 0x5591556a3dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28e3400640 1 -- 172.21.15.44:0/2639344070 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7f28d0014030 con 0x55915555e360 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55915555e360 msgr2=0x5591556a3dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55915555e360 0x5591556a3dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28c4071be0 msgr2=0x7f28c40740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28c4071be0 0x7f28c40740f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f28d40ab000 tx=0x7f28d40ad040 comp rx=0 tx=0).stop 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591555eefb0 msgr2=0x559155560660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 --2- 172.21.15.44:0/2639344070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591555eefb0 0x559155560660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00f6f0 tx=0x7f28dc00fbb0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28e4800640 1 -- 172.21.15.44:0/2639344070 reap_dead start 2024-09-17T05:37:30.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 shutdown_connections 2024-09-17T05:37:30.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 >> 172.21.15.44:0/2639344070 conn(0x55915551dd20 msgr2=0x5591555ed500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 shutdown_connections 2024-09-17T05:37:30.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.790+0000 7f28eabd2080 1 -- 172.21.15.44:0/2639344070 wait complete. 2024-09-17T05:37:30.795 INFO:teuthology.orchestra.run.smithi044.stdout:mytag 2024-09-17T05:37:30.795 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-09-17T05:37:30.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 Processor -- start 2024-09-17T05:37:30.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 -- start start 2024-09-17T05:37:30.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad225f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9ad22b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9ad40060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558a9abb9a00 con 0x558a9acb3c00 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558a9ac17f40 con 0x558a9acb37f0 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe64b64b080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x558a9ac98bd0 con 0x558a9ad28fb0 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9ad22b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9ad22b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41082/0 (socket says 172.21.15.44:41082) 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 -- 172.21.15.44:0/4206673720 learned_addr learned my addr 172.21.15.44:0/4206673720 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643c00640 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe644600640 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9ad40060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 -- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 msgr2=0x558a9ad40060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9ad40060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 -- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 msgr2=0x558a9ad225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad225f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 -- 172.21.15.44:0/4206673720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9ab92c10 con 0x558a9acb3c00 2024-09-17T05:37:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe644600640 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9ad40060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe643200640 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9ad22b30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe63001b0b0 tx=0x7fe630018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a37f4a7b65f0d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe641e00640 1 -- 172.21.15.44:0/4206673720 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300ba070 con 0x558a9acb3c00 2024-09-17T05:37:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe641e00640 1 -- 172.21.15.44:0/4206673720 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6300ab980 con 0x558a9acb3c00 2024-09-17T05:37:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.854+0000 7fe641e00640 1 -- 172.21.15.44:0/4206673720 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300abdb0 con 0x558a9acb3c00 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- 172.21.15.44:0/4206673720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 msgr2=0x558a9ad22b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9ad22b30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe63001b0b0 tx=0x7fe630018020 comp rx=0 tx=0).stop 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- 172.21.15.44:0/4206673720 shutdown_connections 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9ad40060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9ad22b30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 --2- 172.21.15.44:0/4206673720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- 172.21.15.44:0/4206673720 >> 172.21.15.44:0/4206673720 conn(0x558a9ac57d20 msgr2=0x558a9ad25980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- 172.21.15.44:0/4206673720 shutdown_connections 2024-09-17T05:37:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- 172.21.15.44:0/4206673720 wait complete. 2024-09-17T05:37:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 Processor -- start 2024-09-17T05:37:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- start start 2024-09-17T05:37:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad3f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9addefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9addf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558a9ad42eb0 con 0x558a9acb3c00 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558a9ad25530 con 0x558a9acb37f0 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe64b64b080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x558a9ad26700 con 0x558a9ad28fb0 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe643200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9addefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe643200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9addefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41092/0 (socket says 172.21.15.44:41092) 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe643200640 1 -- 172.21.15.44:0/3227056171 learned_addr learned my addr 172.21.15.44:0/3227056171 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe643c00640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad3f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.858+0000 7fe644600640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9addf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe643200640 1 -- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 msgr2=0x558a9addf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe643200640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558a9ad28fb0 0x558a9addf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe643200640 1 -- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 msgr2=0x558a9ad3f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe643200640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad3f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe643200640 1 -- 172.21.15.44:0/3227056171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9ad3f5a0 con 0x558a9acb3c00 2024-09-17T05:37:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe643c00640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558a9acb37f0 0x558a9ad3f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe643200640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9addefd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe63001b0b0 tx=0x7fe6300aba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe640a00640 1 -- 172.21.15.44:0/3227056171 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300ba040 con 0x558a9acb3c00 2024-09-17T05:37:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe640a00640 1 -- 172.21.15.44:0/3227056171 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6300abda0 con 0x558a9acb3c00 2024-09-17T05:37:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe640a00640 1 -- 172.21.15.44:0/3227056171 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300b56c0 con 0x558a9acb3c00 2024-09-17T05:37:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a9ac6b350 con 0x558a9acb3c00 2024-09-17T05:37:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a9ad47740 con 0x558a9acb3c00 2024-09-17T05:37:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe640a00640 1 -- 172.21.15.44:0/3227056171 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe6300c6060 con 0x558a9acb3c00 2024-09-17T05:37:30.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe640a00640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe624071be0 0x7fe6240740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.862+0000 7fe640a00640 1 -- 172.21.15.44:0/3227056171 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe63012e040 con 0x558a9acb3c00 2024-09-17T05:37:30.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe643c00640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe624071be0 0x7fe6240740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558a9ac6ae80 0x558a9ad48630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:30.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) -- 0x558a9ad48b70 con 0x558a9ac6ae80 2024-09-17T05:37:30.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe644600640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558a9ac6ae80 0x558a9ad48630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe643c00640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe624071be0 0x7fe6240740f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe63400d6e0 tx=0x7fe63400e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe644600640 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558a9ac6ae80 0x558a9ad48630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe644600640 1 -- 172.21.15.44:0/3227056171 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7fe63c011040 con 0x558a9ac6ae80 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558a9ac6ae80 msgr2=0x558a9ad48630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558a9ac6ae80 0x558a9ad48630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe624071be0 msgr2=0x7fe6240740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe624071be0 0x7fe6240740f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe63400d6e0 tx=0x7fe63400e040 comp rx=0 tx=0).stop 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 msgr2=0x558a9addefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 --2- 172.21.15.44:0/3227056171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558a9acb3c00 0x558a9addefd0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe63001b0b0 tx=0x7fe6300aba00 comp rx=0 tx=0).stop 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe644600640 1 -- 172.21.15.44:0/3227056171 reap_dead start 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 shutdown_connections 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 >> 172.21.15.44:0/3227056171 conn(0x558a9ac57d20 msgr2=0x558a9ad27070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 shutdown_connections 2024-09-17T05:37:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:30.866+0000 7fe64b64b080 1 -- 172.21.15.44:0/3227056171 wait complete. 2024-09-17T05:37:30.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:37:30.872 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:37:30.872 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:37:30.987 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:37:31.083 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:37:31.083 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:31.083 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:31.083 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:31.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:37:31.093 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:31.093 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:37:31.093 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:31.102 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:37:31.102 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:31.102 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:31.102 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:31.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:37:31.149 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:31.149 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:37:31.149 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:31.158 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:37:31.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 -- 172.21.15.44:0/2608983769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c15a080 msgr2=0x7fe05c0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 --2- 172.21.15.44:0/2608983769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c15a080 0x7fe05c0cbca0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe044009900 tx=0x7fe04401c5e0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 -- 172.21.15.44:0/2608983769 shutdown_connections 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 --2- 172.21.15.44:0/2608983769 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe05c0cc1e0 0x7fe05c06fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 --2- 172.21.15.44:0/2608983769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c15a080 0x7fe05c0cbca0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 -- 172.21.15.44:0/2608983769 >> 172.21.15.44:0/2608983769 conn(0x7fe05c0cd930 msgr2=0x7fe05c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 -- 172.21.15.44:0/2608983769 shutdown_connections 2024-09-17T05:37:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.350+0000 7fe062000640 1 -- 172.21.15.44:0/2608983769 wait complete. 2024-09-17T05:37:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 Processor -- start 2024-09-17T05:37:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 -- start start 2024-09-17T05:37:31.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c0cc1e0 0x7fe05c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe05c15a080 0x7fe05c1f9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15d560 0x7fe05c13dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c169960 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1697e0 con 0x7fe05c15d560 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe05c169ae0 con 0x7fe05c15a080 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c0cc1e0 0x7fe05c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c0cc1e0 0x7fe05c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41098/0 (socket says 172.21.15.44:41098) 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe052a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe05c15a080 0x7fe05c1f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 -- 172.21.15.44:0/1714513655 learned_addr learned my addr 172.21.15.44:0/1714513655 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:31.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05be00640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15d560 0x7fe05c13dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 -- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe05c15a080 msgr2=0x7fe05c1f9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe05c15a080 0x7fe05c1f9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 -- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15d560 msgr2=0x7fe05c13dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15d560 0x7fe05c13dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 -- 172.21.15.44:0/1714513655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c1f8cd0 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe05b400640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c0cc1e0 0x7fe05c152610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00b410 tx=0x7fe04c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:31.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe053e00640 1 -- 172.21.15.44:0/1714513655 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c015030 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe053e00640 1 -- 172.21.15.44:0/1714513655 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe04c004020 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05c13ea10 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe053e00640 1 -- 172.21.15.44:0/1714513655 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c004470 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.354+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05c150340 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.358+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05c06fe80 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.358+0000 7fe053e00640 1 -- 172.21.15.44:0/1714513655 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe04c018070 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.358+0000 7fe053e00640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe038073200 0x7fe038075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.358+0000 7fe053e00640 1 -- 172.21.15.44:0/1714513655 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe04c093ed0 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.358+0000 7fe052a00640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe038073200 0x7fe038075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.362+0000 7fe052a00640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe038073200 0x7fe038075710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe0440af000 tx=0x7fe04401ae80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:31.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.366+0000 7fe053e00640 1 -- 172.21.15.44:0/1714513655 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe04c05e670 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.578+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe05c15c3c0 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.578+0000 7fe053e00640 1 -- 172.21.15.44:0/1714513655 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7fe04c0630a0 con 0x7fe05c0cc1e0 2024-09-17T05:37:31.579 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:31.580 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:31.580 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe038073200 msgr2=0x7fe038075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe038073200 0x7fe038075710 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe0440af000 tx=0x7fe04401ae80 comp rx=0 tx=0).stop 2024-09-17T05:37:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c0cc1e0 msgr2=0x7fe05c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c0cc1e0 0x7fe05c152610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00b410 tx=0x7fe04c00b8d0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 shutdown_connections 2024-09-17T05:37:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe038073200 0x7fe038075710 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe05c15d560 0x7fe05c13dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe05c15a080 0x7fe05c1f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 --2- 172.21.15.44:0/1714513655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe05c0cc1e0 0x7fe05c152610 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 >> 172.21.15.44:0/1714513655 conn(0x7fe05c0cd930 msgr2=0x7fe05c155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:31.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 shutdown_connections 2024-09-17T05:37:31.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.582+0000 7fe062000640 1 -- 172.21.15.44:0/1714513655 wait complete. 2024-09-17T05:37:31.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 -- 172.21.15.44:0/1109695875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a806e160 msgr2=0x7fe8a815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1109695875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a806e160 0x7fe8a815f7f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009c80 tx=0x7fe8a001cc80 comp rx=0 tx=0).stop 2024-09-17T05:37:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 -- 172.21.15.44:0/1109695875 shutdown_connections 2024-09-17T05:37:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1109695875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a806e160 0x7fe8a815f7f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 -- 172.21.15.44:0/1109695875 >> 172.21.15.44:0/1109695875 conn(0x7fe8a80d1120 msgr2=0x7fe8a80d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 -- 172.21.15.44:0/1109695875 shutdown_connections 2024-09-17T05:37:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 -- 172.21.15.44:0/1109695875 wait complete. 2024-09-17T05:37:31.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 Processor -- start 2024-09-17T05:37:31.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.762+0000 7fe8adc00640 1 -- start start 2024-09-17T05:37:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8a806e160 0x7fe8a81f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a8072190 0x7fe8a8157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a80b0a80 0x7fe8a80b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8169fc0 con 0x7fe8a80b0a80 2024-09-17T05:37:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a8169e40 con 0x7fe8a8072190 2024-09-17T05:37:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a816a140 con 0x7fe8a806e160 2024-09-17T05:37:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a80b0a80 0x7fe8a80b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a80b0a80 0x7fe8a80b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41114/0 (socket says 172.21.15.44:41114) 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 -- 172.21.15.44:0/1410174510 learned_addr learned my addr 172.21.15.44:0/1410174510 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a6a00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8a806e160 0x7fe8a81f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a6000640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a8072190 0x7fe8a8157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 -- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8a806e160 msgr2=0x7fe8a81f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8a806e160 0x7fe8a81f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 -- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a8072190 msgr2=0x7fe8a8157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a8072190 0x7fe8a8157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 -- 172.21.15.44:0/1410174510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a8157890 con 0x7fe8a80b0a80 2024-09-17T05:37:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8a7400640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a80b0a80 0x7fe8a80b62f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe8a001a8b0 tx=0x7fe8a00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:31.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe89ea00640 1 -- 172.21.15.44:0/1410174510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00b2040 con 0x7fe8a80b0a80 2024-09-17T05:37:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe89ea00640 1 -- 172.21.15.44:0/1410174510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8a0004200 con 0x7fe8a80b0a80 2024-09-17T05:37:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a80b1290 con 0x7fe8a80b0a80 2024-09-17T05:37:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe89ea00640 1 -- 172.21.15.44:0/1410174510 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0004650 con 0x7fe8a80b0a80 2024-09-17T05:37:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a80b1850 con 0x7fe8a80b0a80 2024-09-17T05:37:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.766+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a80cecf0 con 0x7fe8a80b0a80 2024-09-17T05:37:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.770+0000 7fe89ea00640 1 -- 172.21.15.44:0/1410174510 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8a00ad440 con 0x7fe8a80b0a80 2024-09-17T05:37:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.770+0000 7fe89ea00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe888073200 0x7fe888075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.770+0000 7fe89ea00640 1 -- 172.21.15.44:0/1410174510 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fe8a012ea40 con 0x7fe8a80b0a80 2024-09-17T05:37:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.770+0000 7fe8a6a00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe888073200 0x7fe888075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.770+0000 7fe8a6a00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe888073200 0x7fe888075710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe898007fd0 tx=0x7fe898009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.774+0000 7fe89ea00640 1 -- 172.21.15.44:0/1410174510 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe8a0016990 con 0x7fe8a80b0a80 2024-09-17T05:37:31.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.982+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8a80d1db0 con 0x7fe8a80b0a80 2024-09-17T05:37:31.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe89ea00640 1 -- 172.21.15.44:0/1410174510 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7fe8a00f9270 con 0x7fe8a80b0a80 2024-09-17T05:37:31.986 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:31.986 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe888073200 msgr2=0x7fe888075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe888073200 0x7fe888075710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe898007fd0 tx=0x7fe898009040 comp rx=0 tx=0).stop 2024-09-17T05:37:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a80b0a80 msgr2=0x7fe8a80b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:31.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a80b0a80 0x7fe8a80b62f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe8a001a8b0 tx=0x7fe8a00093d0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 shutdown_connections 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8a80b0a80 0x7fe8a80b62f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe888073200 0x7fe888075710 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8a8072190 0x7fe8a8157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 --2- 172.21.15.44:0/1410174510 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8a806e160 0x7fe8a81f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 >> 172.21.15.44:0/1410174510 conn(0x7fe8a80d1120 msgr2=0x7fe8a815a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 shutdown_connections 2024-09-17T05:37:31.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:31.986+0000 7fe8adc00640 1 -- 172.21.15.44:0/1410174510 wait complete. 2024-09-17T05:37:32.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:32.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 -- 172.21.15.44:0/3722775051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0b5880 msgr2=0x7f644c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 --2- 172.21.15.44:0/3722775051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0b5880 0x7f644c06de50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f644c072340 tx=0x7f643c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 -- 172.21.15.44:0/3722775051 shutdown_connections 2024-09-17T05:37:32.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 --2- 172.21.15.44:0/3722775051 >> v2:172.21.15.86:3300/0 conn(0x7f644c06e390 0x7f644c0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 --2- 172.21.15.44:0/3722775051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0b5880 0x7f644c06de50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 -- 172.21.15.44:0/3722775051 >> 172.21.15.44:0/3722775051 conn(0x7f644c0ccaa0 msgr2=0x7f644c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:32.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 -- 172.21.15.44:0/3722775051 shutdown_connections 2024-09-17T05:37:32.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.166+0000 7f6451a00640 1 -- 172.21.15.44:0/3722775051 wait complete. 2024-09-17T05:37:32.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 Processor -- start 2024-09-17T05:37:32.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 -- start start 2024-09-17T05:37:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f644c06e390 0x7f644c158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f644c0b5880 0x7f644c0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0ce130 0x7f644c0c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f644c16a2c0 con 0x7f644c0ce130 2024-09-17T05:37:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f644c16a140 con 0x7f644c0b5880 2024-09-17T05:37:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f644c16a440 con 0x7f644c06e390 2024-09-17T05:37:32.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0ce130 0x7f644c0c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0ce130 0x7f644c0c4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41132/0 (socket says 172.21.15.44:41132) 2024-09-17T05:37:32.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 -- 172.21.15.44:0/1248222734 learned_addr learned my addr 172.21.15.44:0/1248222734 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:32.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6443e00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f644c0b5880 0x7f644c0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644aa00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f644c06e390 0x7f644c158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 -- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f644c06e390 msgr2=0x7f644c158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f644c06e390 0x7f644c158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 -- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f644c0b5880 msgr2=0x7f644c0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f644c0b5880 0x7f644c0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 -- 172.21.15.44:0/1248222734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c1f7010 con 0x7f644c0ce130 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f644b400640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0ce130 0x7f644c0c4090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f644400c730 tx=0x7f644400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6442a00640 1 -- 172.21.15.44:0/1248222734 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444003b80 con 0x7f644c0ce130 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6442a00640 1 -- 172.21.15.44:0/1248222734 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6444003d40 con 0x7f644c0ce130 2024-09-17T05:37:32.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c0a0060 con 0x7f644c0ce130 2024-09-17T05:37:32.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6442a00640 1 -- 172.21.15.44:0/1248222734 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64440052d0 con 0x7f644c0ce130 2024-09-17T05:37:32.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.170+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c09bd60 con 0x7f644c0ce130 2024-09-17T05:37:32.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.174+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c09fdd0 con 0x7f644c0ce130 2024-09-17T05:37:32.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.174+0000 7f6442a00640 1 -- 172.21.15.44:0/1248222734 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6444005680 con 0x7f644c0ce130 2024-09-17T05:37:32.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.174+0000 7f6442a00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6428073230 0x7f6428075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.174+0000 7f6442a00640 1 -- 172.21.15.44:0/1248222734 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f6444094270 con 0x7f644c0ce130 2024-09-17T05:37:32.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.174+0000 7f644aa00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6428073230 0x7f6428075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.178+0000 7f644aa00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6428073230 0x7f6428075740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f643c0af000 tx=0x7f643c01b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:32.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.178+0000 7f6442a00640 1 -- 172.21.15.44:0/1248222734 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f644c06e7a0 con 0x7f644c0ce130 2024-09-17T05:37:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.354+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f644c1f71e0 con 0x7f644c0ce130 2024-09-17T05:37:32.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.354+0000 7f6442a00640 1 -- 172.21.15.44:0/1248222734 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16954 (secure 0 0 0) 0x7f644405ea10 con 0x7f644c0ce130 2024-09-17T05:37:32.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:32.357 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":40,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:11.284516+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:07.452522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:08.662975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6428073230 msgr2=0x7f6428075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6428073230 0x7f6428075740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f643c0af000 tx=0x7f643c01b100 comp rx=0 tx=0).stop 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0ce130 msgr2=0x7f644c0c4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0ce130 0x7f644c0c4090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f644400c730 tx=0x7f644400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 shutdown_connections 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f644c0ce130 0x7f644c0c4090 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6428073230 0x7f6428075740 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f644c0b5880 0x7f644c0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 --2- 172.21.15.44:0/1248222734 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f644c06e390 0x7f644c158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 >> 172.21.15.44:0/1248222734 conn(0x7f644c0ccaa0 msgr2=0x7f644c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 shutdown_connections 2024-09-17T05:37:32.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.358+0000 7f6451a00640 1 -- 172.21.15.44:0/1248222734 wait complete. 2024-09-17T05:37:32.379 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:37:32.379 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:32.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 -- 172.21.15.44:0/2076998671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e40ccb60 msgr2=0x7fd0e406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 --2- 172.21.15.44:0/2076998671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e40ccb60 0x7fd0e406df50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40b0420 tx=0x7fd0cc01c830 comp rx=0 tx=0).stop 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 -- 172.21.15.44:0/2076998671 shutdown_connections 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 --2- 172.21.15.44:0/2076998671 >> v2:172.21.15.86:3300/0 conn(0x7fd0e406e490 0x7fd0e4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 --2- 172.21.15.44:0/2076998671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e40ccb60 0x7fd0e406df50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 --2- 172.21.15.44:0/2076998671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0e4070e00 0x7fd0e4071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 -- 172.21.15.44:0/2076998671 >> 172.21.15.44:0/2076998671 conn(0x7fd0e40cd930 msgr2=0x7fd0e40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 -- 172.21.15.44:0/2076998671 shutdown_connections 2024-09-17T05:37:32.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 -- 172.21.15.44:0/2076998671 wait complete. 2024-09-17T05:37:32.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 Processor -- start 2024-09-17T05:37:32.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.538+0000 7fd0eac00640 1 -- start start 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e406e490 0x7fd0e414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0e4070e00 0x7fd0e40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0e40ccb60 0x7fd0e406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e40cecc0 con 0x7fd0e406e490 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e40ceb40 con 0x7fd0e40ccb60 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e40cee40 con 0x7fd0e4070e00 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e406e490 0x7fd0e414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e406e490 0x7fd0e414afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41156/0 (socket says 172.21.15.44:41156) 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 -- 172.21.15.44:0/3714598206 learned_addr learned my addr 172.21.15.44:0/3714598206 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:32.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0dbe00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0e4070e00 0x7fd0e40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e8c00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0e40ccb60 0x7fd0e406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 -- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0e4070e00 msgr2=0x7fd0e40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0e4070e00 0x7fd0e40ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 -- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0e40ccb60 msgr2=0x7fd0e406ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0e40ccb60 0x7fd0e406ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 -- 172.21.15.44:0/3714598206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e40b3cf0 con 0x7fd0e406e490 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e8c00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0e40ccb60 0x7fd0e406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0dbe00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0e4070e00 0x7fd0e40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e3e00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e406e490 0x7fd0e414afb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400d950 tx=0x7fd0d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e0c00640 1 -- 172.21.15.44:0/3714598206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4017070 con 0x7fd0e406e490 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e0c00640 1 -- 172.21.15.44:0/3714598206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0d4009d20 con 0x7fd0e406e490 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e40b3fd0 con 0x7fd0e406e490 2024-09-17T05:37:32.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0e0c00640 1 -- 172.21.15.44:0/3714598206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40106c0 con 0x7fd0e406e490 2024-09-17T05:37:32.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e40b4590 con 0x7fd0e406e490 2024-09-17T05:37:32.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.542+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e4071c60 con 0x7fd0e406e490 2024-09-17T05:37:32.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.546+0000 7fd0e0c00640 1 -- 172.21.15.44:0/3714598206 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd0d401a070 con 0x7fd0e406e490 2024-09-17T05:37:32.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.546+0000 7fd0e0c00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0c0073230 0x7fd0c0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.546+0000 7fd0e0c00640 1 -- 172.21.15.44:0/3714598206 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fd0d4094540 con 0x7fd0e406e490 2024-09-17T05:37:32.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.546+0000 7fd0dbe00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0c0073230 0x7fd0c0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.546+0000 7fd0dbe00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0c0073230 0x7fd0c0075740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0af000 tx=0x7fd0cc01b070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:32.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.550+0000 7fd0e0c00640 1 -- 172.21.15.44:0/3714598206 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd0d405f3c0 con 0x7fd0e406e490 2024-09-17T05:37:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.758+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0e40cfc40 con 0x7fd0e406e490 2024-09-17T05:37:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.758+0000 7fd0e0c00640 1 -- 172.21.15.44:0/3714598206 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7fd0d405ecc0 con 0x7fd0e406e490 2024-09-17T05:37:32.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:32.761 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:32.761 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0c0073230 msgr2=0x7fd0c0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0c0073230 0x7fd0c0075740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc0af000 tx=0x7fd0cc01b070 comp rx=0 tx=0).stop 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e406e490 msgr2=0x7fd0e414afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e406e490 0x7fd0e414afb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400d950 tx=0x7fd0d400de10 comp rx=0 tx=0).stop 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 shutdown_connections 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0c0073230 0x7fd0c0075740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0e40ccb60 0x7fd0e406ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0e4070e00 0x7fd0e40ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 --2- 172.21.15.44:0/3714598206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e406e490 0x7fd0e414afb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 >> 172.21.15.44:0/3714598206 conn(0x7fd0e40cd930 msgr2=0x7fd0e40cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 shutdown_connections 2024-09-17T05:37:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.762+0000 7fd0eac00640 1 -- 172.21.15.44:0/3714598206 wait complete. 2024-09-17T05:37:32.783 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 -- 172.21.15.44:0/2488264963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a140cb470 msgr2=0x7f7a140cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 --2- 172.21.15.44:0/2488264963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a140cb470 0x7f7a140cb880 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a140cb0b0 tx=0x7f7a0c01caf0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 -- 172.21.15.44:0/2488264963 shutdown_connections 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 --2- 172.21.15.44:0/2488264963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a140cb470 0x7f7a140cb880 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 --2- 172.21.15.44:0/2488264963 >> v2:172.21.15.86:3300/0 conn(0x7f7a1406de50 0x7f7a1406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 -- 172.21.15.44:0/2488264963 >> 172.21.15.44:0/2488264963 conn(0x7f7a140ccaa0 msgr2=0x7f7a140cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 -- 172.21.15.44:0/2488264963 shutdown_connections 2024-09-17T05:37:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.938+0000 7f7a19000640 1 -- 172.21.15.44:0/2488264963 wait complete. 2024-09-17T05:37:32.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 Processor -- start 2024-09-17T05:37:32.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 -- start start 2024-09-17T05:37:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a1406de50 0x7f7a140aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a14072e50 0x7f7a14153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a140cb470 0x7f7a141fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14168ed0 con 0x7f7a14072e50 2024-09-17T05:37:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14168d50 con 0x7f7a140cb470 2024-09-17T05:37:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a19000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7a14169050 con 0x7f7a1406de50 2024-09-17T05:37:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a0be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a14072e50 0x7f7a14153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a0be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a14072e50 0x7f7a14153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41174/0 (socket says 172.21.15.44:41174) 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.942+0000 7f7a0be00640 1 -- 172.21.15.44:0/2060147836 learned_addr learned my addr 172.21.15.44:0/2060147836 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a11e00640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a1406de50 0x7f7a140aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a12800640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a140cb470 0x7f7a141fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0be00640 1 -- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a1406de50 msgr2=0x7f7a140aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0be00640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a1406de50 0x7f7a140aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0be00640 1 -- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a140cb470 msgr2=0x7f7a141fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0be00640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a140cb470 0x7f7a141fcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0be00640 1 -- 172.21.15.44:0/2060147836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a140af520 con 0x7f7a14072e50 2024-09-17T05:37:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0be00640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a14072e50 0x7f7a14153180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d750 tx=0x7f79fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0a000640 1 -- 172.21.15.44:0/2060147836 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc017070 con 0x7f7a14072e50 2024-09-17T05:37:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0a000640 1 -- 172.21.15.44:0/2060147836 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79fc004310 con 0x7f7a14072e50 2024-09-17T05:37:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0a000640 1 -- 172.21.15.44:0/2060147836 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00de60 con 0x7f7a14072e50 2024-09-17T05:37:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a140cf810 con 0x7f7a14072e50 2024-09-17T05:37:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a140cf250 con 0x7f7a14072e50 2024-09-17T05:37:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1406e260 con 0x7f7a14072e50 2024-09-17T05:37:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.946+0000 7f7a0a000640 1 -- 172.21.15.44:0/2060147836 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f79fc009c30 con 0x7f7a14072e50 2024-09-17T05:37:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.950+0000 7f7a0a000640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f79f0073230 0x7f79f0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.950+0000 7f7a0a000640 1 -- 172.21.15.44:0/2060147836 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f79fc094e30 con 0x7f7a14072e50 2024-09-17T05:37:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.950+0000 7f7a11e00640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f79f0073230 0x7f79f0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:32.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.950+0000 7f7a11e00640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f79f0073230 0x7f79f0075740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000f70 tx=0x7f7a04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:32.950+0000 7f7a0a000640 1 -- 172.21.15.44:0/2060147836 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f79fc020020 con 0x7f7a14072e50 2024-09-17T05:37:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.158+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a1415f770 con 0x7f7a14072e50 2024-09-17T05:37:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a0a000640 1 -- 172.21.15.44:0/2060147836 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5217 (secure 0 0 0) 0x7f79fc05fca0 con 0x7f7a14072e50 2024-09-17T05:37:33.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:33.162 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"btime":"2024-09-17T05:37:13:301234+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:09.701448+0000","modified":"2024-09-17T05:37:12.713928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4974},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4974":{"gid":4974,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3983247436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3983247436},{"type":"v1","addr":"172.21.15.44:6835","nonce":3983247436}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4974,"qdb_cluster":[4974]},"id":2}]} 2024-09-17T05:37:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f79f0073230 msgr2=0x7f79f0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f79f0073230 0x7f79f0075740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000f70 tx=0x7f7a04009040 comp rx=0 tx=0).stop 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a14072e50 msgr2=0x7f7a14153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a14072e50 0x7f7a14153180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00d750 tx=0x7f79fc00dc10 comp rx=0 tx=0).stop 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 shutdown_connections 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f79f0073230 0x7f79f0075740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a140cb470 0x7f7a141fcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a14072e50 0x7f7a14153180 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 --2- 172.21.15.44:0/2060147836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7a1406de50 0x7f7a140aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 >> 172.21.15.44:0/2060147836 conn(0x7f7a140ccaa0 msgr2=0x7f7a14154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 shutdown_connections 2024-09-17T05:37:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.162+0000 7f7a19000640 1 -- 172.21.15.44:0/2060147836 wait complete. 2024-09-17T05:37:33.184 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:33.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 -- 172.21.15.44:0/2325539522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 msgr2=0x7f9f600711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 --2- 172.21.15.44:0/2325539522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f600711c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009900 tx=0x7f9f5401c820 comp rx=0 tx=0).stop 2024-09-17T05:37:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 -- 172.21.15.44:0/2325539522 shutdown_connections 2024-09-17T05:37:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 --2- 172.21.15.44:0/2325539522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f600af170 0x7f9f600b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 --2- 172.21.15.44:0/2325539522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f600711c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 -- 172.21.15.44:0/2325539522 >> 172.21.15.44:0/2325539522 conn(0x7f9f600b2c40 msgr2=0x7f9f600b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 -- 172.21.15.44:0/2325539522 shutdown_connections 2024-09-17T05:37:33.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.342+0000 7f9f66200640 1 -- 172.21.15.44:0/2325539522 wait complete. 2024-09-17T05:37:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 Processor -- start 2024-09-17T05:37:33.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 -- start start 2024-09-17T05:37:33.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f60071700 0x7f9f601483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f600af170 0x7f9f60152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f60152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6006dbc0 con 0x7f9f6015e750 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f600b4da0 con 0x7f9f600af170 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f66200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6016bb50 con 0x7f9f60071700 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f65800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f60152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f65800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f60152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41178/0 (socket says 172.21.15.44:41178) 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f65800640 1 -- 172.21.15.44:0/3240244254 learned_addr learned my addr 172.21.15.44:0/3240244254 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f64e00640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f60071700 0x7f9f601483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f5fe00640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f600af170 0x7f9f60152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f65800640 1 -- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f60071700 msgr2=0x7f9f601483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.346+0000 7f9f65800640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f60071700 0x7f9f601483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f65800640 1 -- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f600af170 msgr2=0x7f9f60152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f65800640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f600af170 0x7f9f60152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f65800640 1 -- 172.21.15.44:0/3240244254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f60152f20 con 0x7f9f6015e750 2024-09-17T05:37:33.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f65800640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f60152770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800e910 tx=0x7f9f5800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f5cc00640 1 -- 172.21.15.44:0/3240244254 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58004d30 con 0x7f9f6015e750 2024-09-17T05:37:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f5cc00640 1 -- 172.21.15.44:0/3240244254 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f5800cb20 con 0x7f9f6015e750 2024-09-17T05:37:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f5cc00640 1 -- 172.21.15.44:0/3240244254 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58005020 con 0x7f9f6015e750 2024-09-17T05:37:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f601f8a40 con 0x7f9f6015e750 2024-09-17T05:37:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f601f9000 con 0x7f9f6015e750 2024-09-17T05:37:33.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f600711c0 con 0x7f9f6015e750 2024-09-17T05:37:33.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.350+0000 7f9f5cc00640 1 -- 172.21.15.44:0/3240244254 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9f580051c0 con 0x7f9f6015e750 2024-09-17T05:37:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.354+0000 7f9f5cc00640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f40073230 0x7f9f40075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.354+0000 7f9f5cc00640 1 -- 172.21.15.44:0/3240244254 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f9f58094dd0 con 0x7f9f6015e750 2024-09-17T05:37:33.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.354+0000 7f9f64e00640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f40073230 0x7f9f40075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.354+0000 7f9f64e00640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f40073230 0x7f9f40075740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f540af000 tx=0x7f9f5401b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:33.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.354+0000 7f9f5cc00640 1 -- 172.21.15.44:0/3240244254 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9f58016030 con 0x7f9f6015e750 2024-09-17T05:37:33.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.530+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f601f87d0 con 0x7f9f6015e750 2024-09-17T05:37:33.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f5cc00640 1 -- 172.21.15.44:0/3240244254 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16954 (secure 0 0 0) 0x7f9f5805f710 con 0x7f9f6015e750 2024-09-17T05:37:33.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:33.534 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":40,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:11.284516+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:07.452522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:08.662975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f40073230 msgr2=0x7f9f40075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f40073230 0x7f9f40075740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f540af000 tx=0x7f9f5401b060 comp rx=0 tx=0).stop 2024-09-17T05:37:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 msgr2=0x7f9f60152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f60152770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800e910 tx=0x7f9f5800edd0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 shutdown_connections 2024-09-17T05:37:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f6015e750 0x7f9f60152770 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f40073230 0x7f9f40075740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f600af170 0x7f9f60152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 --2- 172.21.15.44:0/3240244254 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f60071700 0x7f9f601483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 >> 172.21.15.44:0/3240244254 conn(0x7f9f600b2c40 msgr2=0x7f9f6015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 shutdown_connections 2024-09-17T05:37:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.534+0000 7f9f66200640 1 -- 172.21.15.44:0/3240244254 wait complete. 2024-09-17T05:37:33.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 -- 172.21.15.44:0/3788513280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2660072e50 msgr2=0x7f266015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 --2- 172.21.15.44:0/3788513280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2660072e50 0x7f266015e990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f26600af7b0 tx=0x7f265001c830 comp rx=0 tx=0).stop 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 -- 172.21.15.44:0/3788513280 shutdown_connections 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 --2- 172.21.15.44:0/3788513280 >> v2:172.21.15.86:3300/0 conn(0x7f26600cb470 0x7f26600cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 --2- 172.21.15.44:0/3788513280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2660072e50 0x7f266015e990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 -- 172.21.15.44:0/3788513280 >> 172.21.15.44:0/3788513280 conn(0x7f26600ccaa0 msgr2=0x7f26600cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 -- 172.21.15.44:0/3788513280 shutdown_connections 2024-09-17T05:37:33.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 -- 172.21.15.44:0/3788513280 wait complete. 2024-09-17T05:37:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 Processor -- start 2024-09-17T05:37:33.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.718+0000 7f2666800640 1 -- start start 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f266006de50 0x7f26600b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2660072e50 0x7f26601578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26600cb470 0x7f26601548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2660168f20 con 0x7f26600cb470 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2660168da0 con 0x7f266006de50 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f26601690a0 con 0x7f2660072e50 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26600cb470 0x7f26601548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f266006de50 0x7f26600b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26600cb470 0x7f26601548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41186/0 (socket says 172.21.15.44:41186) 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 -- 172.21.15.44:0/2760214162 learned_addr learned my addr 172.21.15.44:0/2760214162 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2657e00640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2660072e50 0x7f26601578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 -- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2660072e50 msgr2=0x7f26601578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2660072e50 0x7f26601578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 -- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f266006de50 msgr2=0x7f26600b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f266006de50 0x7f26600b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 -- 172.21.15.44:0/2760214162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26601fae00 con 0x7f26600cb470 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f265fe00640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26600cb470 0x7f26601548b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f265800d9d0 tx=0x7f265800de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2657400640 1 -- 172.21.15.44:0/2760214162 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658017070 con 0x7f26600cb470 2024-09-17T05:37:33.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2657400640 1 -- 172.21.15.44:0/2760214162 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2658010460 con 0x7f26600cb470 2024-09-17T05:37:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26601fa040 con 0x7f26600cb470 2024-09-17T05:37:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2657400640 1 -- 172.21.15.44:0/2760214162 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265800be60 con 0x7f26600cb470 2024-09-17T05:37:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26601fa600 con 0x7f26600cb470 2024-09-17T05:37:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.722+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266015e990 con 0x7f26600cb470 2024-09-17T05:37:33.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.726+0000 7f2657400640 1 -- 172.21.15.44:0/2760214162 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f26580108b0 con 0x7f26600cb470 2024-09-17T05:37:33.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.726+0000 7f2657400640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f263c073200 0x7f263c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:33.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.726+0000 7f2657400640 1 -- 172.21.15.44:0/2760214162 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f2658094980 con 0x7f26600cb470 2024-09-17T05:37:33.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.726+0000 7f265f400640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f263c073200 0x7f263c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:33.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.726+0000 7f265f400640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f263c073200 0x7f263c075710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26500af000 tx=0x7f26500a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:33.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.730+0000 7f2657400640 1 -- 172.21.15.44:0/2760214162 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f265805f1b0 con 0x7f26600cb470 2024-09-17T05:37:33.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.942+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f26601583b0 con 0x7f26600cb470 2024-09-17T05:37:33.943 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:37:33.942+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:37:33.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2657400640 1 -- 172.21.15.44:0/2760214162 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f2658063be0 con 0x7f26600cb470 2024-09-17T05:37:33.945 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:37:33.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f263c073200 msgr2=0x7f263c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f263c073200 0x7f263c075710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f26500af000 tx=0x7f26500a7040 comp rx=0 tx=0).stop 2024-09-17T05:37:33.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26600cb470 msgr2=0x7f26601548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26600cb470 0x7f26601548b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f265800d9d0 tx=0x7f265800de90 comp rx=0 tx=0).stop 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 shutdown_connections 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f26600cb470 0x7f26601548b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2660072e50 0x7f26601578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f263c073200 0x7f263c075710 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 --2- 172.21.15.44:0/2760214162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f266006de50 0x7f26600b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 >> 172.21.15.44:0/2760214162 conn(0x7f26600ccaa0 msgr2=0x7f2660155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 shutdown_connections 2024-09-17T05:37:33.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:33.946+0000 7f2666800640 1 -- 172.21.15.44:0/2760214162 wait complete. 2024-09-17T05:37:33.960 INFO:tasks.ceph.mds.a.smithi044.stderr: -7348> 2024-09-17T05:37:14.646+0000 7f7fbc200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:37:33.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:37:34.084 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:37:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.130+0000 7f61f1600640 1 -- 172.21.15.44:0/1449490611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 msgr2=0x7f61ec15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.130+0000 7f61f1600640 1 --2- 172.21.15.44:0/1449490611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 0x7f61ec15e990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0af7b0 tx=0x7f61dc01c770 comp rx=0 tx=0).stop 2024-09-17T05:37:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- 172.21.15.44:0/1449490611 shutdown_connections 2024-09-17T05:37:34.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 --2- 172.21.15.44:0/1449490611 >> v2:172.21.15.86:3300/0 conn(0x7f61ec0cb470 0x7f61ec0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 --2- 172.21.15.44:0/1449490611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 0x7f61ec15e990 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- 172.21.15.44:0/1449490611 >> 172.21.15.44:0/1449490611 conn(0x7f61ec0ccaa0 msgr2=0x7f61ec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- 172.21.15.44:0/1449490611 shutdown_connections 2024-09-17T05:37:34.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- 172.21.15.44:0/1449490611 wait complete. 2024-09-17T05:37:34.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 Processor -- start 2024-09-17T05:37:34.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- start start 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61ec06de50 0x7f61ec0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 0x7f61ec1fd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61ec0cb470 0x7f61ec1f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec168e80 con 0x7f61ec072e50 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec168d00 con 0x7f61ec06de50 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.134+0000 7f61f1600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f61ec169000 con 0x7f61ec0cb470 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61e3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 0x7f61ec1fd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61ec06de50 0x7f61ec0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:34.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61e3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 0x7f61ec1fd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41206/0 (socket says 172.21.15.44:41206) 2024-09-17T05:37:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61e3e00640 1 -- 172.21.15.44:0/4029784443 learned_addr learned my addr 172.21.15.44:0/4029784443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:34.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eb400640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61ec0cb470 0x7f61ec1f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eaa00640 1 -- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61ec0cb470 msgr2=0x7f61ec1f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eaa00640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61ec0cb470 0x7f61ec1f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eaa00640 1 -- 172.21.15.44:0/4029784443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 msgr2=0x7f61ec1fd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eaa00640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 0x7f61ec1fd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eaa00640 1 -- 172.21.15.44:0/4029784443 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec0c9f30 con 0x7f61ec06de50 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61eaa00640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61ec06de50 0x7f61ec0b2e70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0caa80 tx=0x7f61dc005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61e2a00640 1 -- 172.21.15.44:0/4029784443 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0b2040 con 0x7f61ec06de50 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61e2a00640 1 -- 172.21.15.44:0/4029784443 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61dc004130 con 0x7f61ec06de50 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61e2a00640 1 -- 172.21.15.44:0/4029784443 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc003600 con 0x7f61ec06de50 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ec0c9970 con 0x7f61ec06de50 2024-09-17T05:37:34.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ec0b34b0 con 0x7f61ec06de50 2024-09-17T05:37:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.138+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ec0cb880 con 0x7f61ec06de50 2024-09-17T05:37:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.142+0000 7f61e2a00640 1 -- 172.21.15.44:0/4029784443 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f61dc0bd060 con 0x7f61ec06de50 2024-09-17T05:37:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.142+0000 7f61e2a00640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61c8073200 0x7f61c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:34.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.142+0000 7f61e2a00640 1 -- 172.21.15.44:0/4029784443 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7f61dc12d660 con 0x7f61ec06de50 2024-09-17T05:37:34.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.142+0000 7f61e3e00640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61c8073200 0x7f61c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:34.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.142+0000 7f61e3e00640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61c8073200 0x7f61c8075710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0b5f70 tx=0x7f61d4001460 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:34.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.146+0000 7f61e2a00640 1 -- 172.21.15.44:0/4029784443 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f61dc0f0db0 con 0x7f61ec06de50 2024-09-17T05:37:34.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.354+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f61ec0b5fa0 con 0x7f61ec06de50 2024-09-17T05:37:34.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.954+0000 7f61e2a00640 1 -- 172.21.15.44:0/4029784443 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f61dc0163f0 con 0x7f61ec06de50 2024-09-17T05:37:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61c8073200 msgr2=0x7f61c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61c8073200 0x7f61c8075710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0b5f70 tx=0x7f61d4001460 comp rx=0 tx=0).stop 2024-09-17T05:37:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61ec06de50 msgr2=0x7f61ec0b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61ec06de50 0x7f61ec0b2e70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0caa80 tx=0x7f61dc005760 comp rx=0 tx=0).stop 2024-09-17T05:37:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 shutdown_connections 2024-09-17T05:37:34.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61ec0cb470 0x7f61ec1f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61ec072e50 0x7f61ec1fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f61c8073200 0x7f61c8075710 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 --2- 172.21.15.44:0/4029784443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61ec06de50 0x7f61ec0b2e70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:34.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 >> 172.21.15.44:0/4029784443 conn(0x7f61ec0ccaa0 msgr2=0x7f61ec0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:34.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 shutdown_connections 2024-09-17T05:37:34.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:34.958+0000 7f61f1600640 1 -- 172.21.15.44:0/4029784443 wait complete. 2024-09-17T05:37:34.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:37:35.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 -- 172.21.15.44:0/3629598929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd8155b10 msgr2=0x7fcbd80af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:35.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 --2- 172.21.15.44:0/3629598929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd8155b10 0x7fcbd80af4b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009900 tx=0x7fcbc801f0d0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 -- 172.21.15.44:0/3629598929 shutdown_connections 2024-09-17T05:37:35.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 --2- 172.21.15.44:0/3629598929 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd806e390 0x7fcbd80cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 --2- 172.21.15.44:0/3629598929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd8155b10 0x7fcbd80af4b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 -- 172.21.15.44:0/3629598929 >> 172.21.15.44:0/3629598929 conn(0x7fcbd80b35f0 msgr2=0x7fcbd80b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:35.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 -- 172.21.15.44:0/3629598929 shutdown_connections 2024-09-17T05:37:35.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 -- 172.21.15.44:0/3629598929 wait complete. 2024-09-17T05:37:35.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 Processor -- start 2024-09-17T05:37:35.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.146+0000 7fcbdf000640 1 -- start start 2024-09-17T05:37:35.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd806df80 0x7fcbd814aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:35.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd806e390 0x7fcbd815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:35.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8155b10 0x7fcbd815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:35.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd80ce520 con 0x7fcbd806df80 2024-09-17T05:37:35.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd806fd40 con 0x7fcbd8155b10 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd80ce6a0 con 0x7fcbd806e390 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd806df80 0x7fcbd814aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd806df80 0x7fcbd814aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41230/0 (socket says 172.21.15.44:41230) 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 -- 172.21.15.44:0/302687720 learned_addr learned my addr 172.21.15.44:0/302687720 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbcf400640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd806e390 0x7fcbd815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdd000640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8155b10 0x7fcbd815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 -- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd806e390 msgr2=0x7fcbd815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd806e390 0x7fcbd815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 -- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8155b10 msgr2=0x7fcbd815ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8155b10 0x7fcbd815ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 -- 172.21.15.44:0/302687720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd81f5b90 con 0x7fcbd806df80 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbcf400640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd806e390 0x7fcbd815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:35.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd7e00640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd806df80 0x7fcbd814aa60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009850 tx=0x7fcbc8005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:35.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd4c00640 1 -- 172.21.15.44:0/302687720 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80be070 con 0x7fcbd806df80 2024-09-17T05:37:35.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd4c00640 1 -- 172.21.15.44:0/302687720 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbc80b08e0 con 0x7fcbd806df80 2024-09-17T05:37:35.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd80af520 con 0x7fcbd806df80 2024-09-17T05:37:35.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbd4c00640 1 -- 172.21.15.44:0/302687720 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80b5040 con 0x7fcbd806df80 2024-09-17T05:37:35.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd81f6130 con 0x7fcbd806df80 2024-09-17T05:37:35.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.150+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd80cdfe0 con 0x7fcbd806df80 2024-09-17T05:37:35.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.154+0000 7fcbd4c00640 1 -- 172.21.15.44:0/302687720 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcbc80b0cf0 con 0x7fcbd806df80 2024-09-17T05:37:35.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.154+0000 7fcbd4c00640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcbb4073200 0x7fcbb4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:35.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.154+0000 7fcbd4c00640 1 -- 172.21.15.44:0/302687720 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6187+0+0 (secure 0 0 0) 0x7fcbc8131330 con 0x7fcbd806df80 2024-09-17T05:37:35.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.154+0000 7fcbcf400640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcbb4073200 0x7fcbb4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:35.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.154+0000 7fcbcf400640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcbb4073200 0x7fcbb4075710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80cc230 tx=0x7fcbc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:35.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.158+0000 7fcbd4c00640 1 -- 172.21.15.44:0/302687720 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcbc8018c30 con 0x7fcbd806df80 2024-09-17T05:37:35.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.334+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcbd80b0830 con 0x7fcbd806df80 2024-09-17T05:37:35.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.954+0000 7fcbd4c00640 1 -- 172.21.15.44:0/302687720 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7fcbc80fba90 con 0x7fcbd806df80 2024-09-17T05:37:35.956 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcbb4073200 msgr2=0x7fcbb4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcbb4073200 0x7fcbb4075710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80cc230 tx=0x7fcbc0009040 comp rx=0 tx=0).stop 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd806df80 msgr2=0x7fcbd814aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd806df80 0x7fcbd814aa60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009850 tx=0x7fcbc8005de0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 shutdown_connections 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcbb4073200 0x7fcbb4075710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbd8155b10 0x7fcbd815ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcbd806e390 0x7fcbd815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 --2- 172.21.15.44:0/302687720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcbd806df80 0x7fcbd814aa60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:35.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 >> 172.21.15.44:0/302687720 conn(0x7fcbd80b35f0 msgr2=0x7fcbd815d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:35.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 shutdown_connections 2024-09-17T05:37:35.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:35.958+0000 7fcbdf000640 1 -- 172.21.15.44:0/302687720 wait complete. 2024-09-17T05:37:35.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:37:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.146+0000 7f2cf2c00640 1 -- 172.21.15.44:0/2388080763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 msgr2=0x7f2cd0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.146+0000 7f2cf2c00640 1 --2- 172.21.15.44:0/2388080763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 0x7f2cd0004810 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009b60 tx=0x7f2cd801d270 comp rx=0 tx=0).stop 2024-09-17T05:37:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.146+0000 7f2cf0c00640 1 -- 172.21.15.44:0/2388080763 reap_dead start 2024-09-17T05:37:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.146+0000 7f2cf2c00640 1 -- 172.21.15.44:0/2388080763 shutdown_connections 2024-09-17T05:37:36.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.146+0000 7f2cf2c00640 1 -- 172.21.15.44:0/2388080763 >> 172.21.15.44:0/2388080763 conn(0x7f2cec0b35f0 msgr2=0x7f2cec0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 -- 172.21.15.44:0/2388080763 shutdown_connections 2024-09-17T05:37:36.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 -- 172.21.15.44:0/2388080763 wait complete. 2024-09-17T05:37:36.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 Processor -- start 2024-09-17T05:37:36.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 -- start start 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 0x7f2cec149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec153430 0x7f2cec1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec1f72e0 0x7f2cec0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec15c250 con 0x7f2cd0003fe0 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec0d0c10 con 0x7f2cec153430 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.150+0000 7f2cf2c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec15c3d0 con 0x7f2cec1f72e0 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 0x7f2cec149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 0x7f2cec149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41240/0 (socket says 172.21.15.44:41240) 2024-09-17T05:37:36.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 -- 172.21.15.44:0/699881192 learned_addr learned my addr 172.21.15.44:0/699881192 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cf0c00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec1f72e0 0x7f2cec0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2ceb400640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec153430 0x7f2cec1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 -- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec1f72e0 msgr2=0x7f2cec0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec1f72e0 0x7f2cec0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 -- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec153430 msgr2=0x7f2cec1f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec153430 0x7f2cec1f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 -- 172.21.15.44:0/699881192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec153b80 con 0x7f2cd0003fe0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cebe00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 0x7f2cec149710 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc011600 tx=0x7f2cdc011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2ce3e00640 1 -- 172.21.15.44:0/699881192 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc017070 con 0x7f2cd0003fe0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2ce3e00640 1 -- 172.21.15.44:0/699881192 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cdc013a10 con 0x7f2cd0003fe0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec153e60 con 0x7f2cd0003fe0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2ce3e00640 1 -- 172.21.15.44:0/699881192 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc013e60 con 0x7f2cd0003fe0 2024-09-17T05:37:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec154420 con 0x7f2cd0003fe0 2024-09-17T05:37:36.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec15c930 con 0x7f2cd0003fe0 2024-09-17T05:37:36.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.154+0000 7f2ce3e00640 1 -- 172.21.15.44:0/699881192 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2cdc00f450 con 0x7f2cd0003fe0 2024-09-17T05:37:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.158+0000 7f2ce3e00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ccc073200 0x7f2ccc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.158+0000 7f2ce3e00640 1 -- 172.21.15.44:0/699881192 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5749+0+0 (secure 0 0 0) 0x7f2cdc0981b0 con 0x7f2cd0003fe0 2024-09-17T05:37:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.158+0000 7f2ceb400640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ccc073200 0x7f2ccc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.158+0000 7f2ceb400640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ccc073200 0x7f2ccc075710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ae000 tx=0x7f2cd801a010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:36.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.162+0000 7f2ce3e00640 1 -- 172.21.15.44:0/699881192 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2cec0d0e30 con 0x7f2cd0003fe0 2024-09-17T05:37:36.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.334+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2cec06e630 con 0x7f2cd0003fe0 2024-09-17T05:37:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.958+0000 7f2ce3e00640 1 -- 172.21.15.44:0/699881192 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f2cdc062b40 con 0x7f2cd0003fe0 2024-09-17T05:37:36.958 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.958+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ccc073200 msgr2=0x7f2ccc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.958+0000 7f2cf2c00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ccc073200 0x7f2ccc075710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80ae000 tx=0x7f2cd801a010 comp rx=0 tx=0).stop 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.958+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 msgr2=0x7f2cec149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.958+0000 7f2cf2c00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 0x7f2cec149710 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc011600 tx=0x7f2cdc011a00 comp rx=0 tx=0).stop 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.962+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 shutdown_connections 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.962+0000 7f2cf2c00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec1f72e0 0x7f2cec0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.962+0000 7f2cf2c00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ccc073200 0x7f2ccc075710 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.962+0000 7f2cf2c00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec153430 0x7f2cec1f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:36.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.962+0000 7f2cf2c00640 1 --2- 172.21.15.44:0/699881192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cd0003fe0 0x7f2cec149710 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:36.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.962+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 >> 172.21.15.44:0/699881192 conn(0x7f2cec0b35f0 msgr2=0x7f2cec1517d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:36.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.966+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 shutdown_connections 2024-09-17T05:37:36.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:36.966+0000 7f2cf2c00640 1 -- 172.21.15.44:0/699881192 wait complete. 2024-09-17T05:37:36.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:37:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 -- 172.21.15.44:0/4236317216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 msgr2=0x7f48ec0ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 --2- 172.21.15.44:0/4236317216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0ce540 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f48ec06ace0 tx=0x7f48e401cd80 comp rx=0 tx=0).stop 2024-09-17T05:37:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 -- 172.21.15.44:0/4236317216 shutdown_connections 2024-09-17T05:37:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 --2- 172.21.15.44:0/4236317216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0ce540 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 --2- 172.21.15.44:0/4236317216 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec06e390 0x7f48ec0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 --2- 172.21.15.44:0/4236317216 >> v2:172.21.15.86:3300/0 conn(0x7f48ec0b5880 0x7f48ec06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 -- 172.21.15.44:0/4236317216 >> 172.21.15.44:0/4236317216 conn(0x7f48ec0ccaa0 msgr2=0x7f48ec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 -- 172.21.15.44:0/4236317216 shutdown_connections 2024-09-17T05:37:37.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 -- 172.21.15.44:0/4236317216 wait complete. 2024-09-17T05:37:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 Processor -- start 2024-09-17T05:37:37.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.154+0000 7f48f4600640 1 -- start start 2024-09-17T05:37:37.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec06e390 0x7f48ec0af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48ec0b5880 0x7f48ec1fc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec070c70 con 0x7f48ec0ce130 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec070af0 con 0x7f48ec0b5880 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f48ec070df0 con 0x7f48ec06e390 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41250/0 (socket says 172.21.15.44:41250) 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 -- 172.21.15.44:0/1238507311 learned_addr learned my addr 172.21.15.44:0/1238507311 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f1200640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48ec0b5880 0x7f48ec1fc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f1c00640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec06e390 0x7f48ec0af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 -- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec06e390 msgr2=0x7f48ec0af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec06e390 0x7f48ec0af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 -- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48ec0b5880 msgr2=0x7f48ec1fc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48ec0b5880 0x7f48ec1fc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 -- 172.21.15.44:0/1238507311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec1f9870 con 0x7f48ec0ce130 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f2600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0b2ec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009bd0 tx=0x7f48e4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48e9600640 1 -- 172.21.15.44:0/1238507311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40bb070 con 0x7f48ec0ce130 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48e9600640 1 -- 172.21.15.44:0/1238507311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48e4004b40 con 0x7f48ec0ce130 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48e9600640 1 -- 172.21.15.44:0/1238507311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e40b2040 con 0x7f48ec0ce130 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ec1f9b10 con 0x7f48ec0ce130 2024-09-17T05:37:37.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ec1fa0d0 con 0x7f48ec0ce130 2024-09-17T05:37:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.158+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ec06de50 con 0x7f48ec0ce130 2024-09-17T05:37:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.162+0000 7f48e9600640 1 -- 172.21.15.44:0/1238507311 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f48e40be070 con 0x7f48ec0ce130 2024-09-17T05:37:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.162+0000 7f48e9600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f48cc073200 0x7f48cc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.162+0000 7f48e9600640 1 -- 172.21.15.44:0/1238507311 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f48e412de50 con 0x7f48ec0ce130 2024-09-17T05:37:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.162+0000 7f48f1c00640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f48cc073200 0x7f48cc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.162+0000 7f48f1c00640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f48cc073200 0x7f48cc075710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009b40 tx=0x7f48e00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:37.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.166+0000 7f48e9600640 1 -- 172.21.15.44:0/1238507311 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f48e4016970 con 0x7f48ec0ce130 2024-09-17T05:37:37.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.338+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f48ec0b0e20 con 0x7f48ec0ce130 2024-09-17T05:37:37.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48e9600640 1 -- 172.21.15.44:0/1238507311 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f48e40f8980 con 0x7f48ec0ce130 2024-09-17T05:37:37.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f48cc073200 msgr2=0x7f48cc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f48cc073200 0x7f48cc075710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f48e0009b40 tx=0x7f48e00091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 msgr2=0x7f48ec0b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0b2ec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009bd0 tx=0x7f48e4003f60 comp rx=0 tx=0).stop 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 shutdown_connections 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f48ec0ce130 0x7f48ec0b2ec0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f48cc073200 0x7f48cc075710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48ec0b5880 0x7f48ec1fc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 --2- 172.21.15.44:0/1238507311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f48ec06e390 0x7f48ec0af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 >> 172.21.15.44:0/1238507311 conn(0x7f48ec0ccaa0 msgr2=0x7f48ec15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 shutdown_connections 2024-09-17T05:37:37.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.346+0000 7f48f4600640 1 -- 172.21.15.44:0/1238507311 wait complete. 2024-09-17T05:37:37.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-09-17T05:37:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.526+0000 7fb431a00640 1 -- 172.21.15.44:0/1003831873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb410005360 msgr2=0x7fb41000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.526+0000 7fb431a00640 1 --2- 172.21.15.44:0/1003831873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb410005360 0x7fb41000b9d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb42400c770 tx=0x7fb42401fa20 comp rx=0 tx=0).stop 2024-09-17T05:37:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.526+0000 7fb431a00640 1 -- 172.21.15.44:0/1003831873 shutdown_connections 2024-09-17T05:37:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.526+0000 7fb431a00640 1 --2- 172.21.15.44:0/1003831873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb410005360 0x7fb41000b9d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.526+0000 7fb431a00640 1 -- 172.21.15.44:0/1003831873 >> 172.21.15.44:0/1003831873 conn(0x7fb42c0cd930 msgr2=0x7fb42c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.526+0000 7fb431a00640 1 -- 172.21.15.44:0/1003831873 shutdown_connections 2024-09-17T05:37:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.526+0000 7fb431a00640 1 -- 172.21.15.44:0/1003831873 wait complete. 2024-09-17T05:37:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 Processor -- start 2024-09-17T05:37:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 -- start start 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb410005360 0x7fb42c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb42c1f6cb0 0x7fb42c1f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb42c147c30 0x7fb42c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c06e2e0 con 0x7fb42c147c30 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c06e160 con 0x7fb42c1f6cb0 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb431a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c0ccb60 con 0x7fb410005360 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb42c147c30 0x7fb42c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb42c147c30 0x7fb42c14c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41266/0 (socket says 172.21.15.44:41266) 2024-09-17T05:37:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 -- 172.21.15.44:0/1204722672 learned_addr learned my addr 172.21.15.44:0/1204722672 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42aa00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb410005360 0x7fb42c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb423e00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb42c1f6cb0 0x7fb42c1f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 -- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb410005360 msgr2=0x7fb42c14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb410005360 0x7fb42c14f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 -- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb42c1f6cb0 msgr2=0x7fb42c1f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb42c1f6cb0 0x7fb42c1f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 -- 172.21.15.44:0/1204722672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c1f74c0 con 0x7fb42c147c30 2024-09-17T05:37:37.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42aa00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb410005360 0x7fb42c14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb42b400640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb42c147c30 0x7fb42c14c860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4240202c0 tx=0x7fb4240aac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.530+0000 7fb422a00640 1 -- 172.21.15.44:0/1204722672 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4240b9020 con 0x7fb42c147c30 2024-09-17T05:37:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.534+0000 7fb422a00640 1 -- 172.21.15.44:0/1204722672 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb42400c3a0 con 0x7fb42c147c30 2024-09-17T05:37:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.534+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c1f77a0 con 0x7fb42c147c30 2024-09-17T05:37:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.534+0000 7fb422a00640 1 -- 172.21.15.44:0/1204722672 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424004e60 con 0x7fb42c147c30 2024-09-17T05:37:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.534+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c1f3ab0 con 0x7fb42c147c30 2024-09-17T05:37:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.534+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c1f7230 con 0x7fb42c147c30 2024-09-17T05:37:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.534+0000 7fb422a00640 1 -- 172.21.15.44:0/1204722672 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb4240bc070 con 0x7fb42c147c30 2024-09-17T05:37:37.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.534+0000 7fb422a00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb408073200 0x7fb408075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:37.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.538+0000 7fb422a00640 1 -- 172.21.15.44:0/1204722672 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fb424130b00 con 0x7fb42c147c30 2024-09-17T05:37:37.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.538+0000 7fb42aa00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb408073200 0x7fb408075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:37.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.538+0000 7fb42aa00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb408073200 0x7fb408075710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb41c000c10 tx=0x7fb41c006b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:37.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.542+0000 7fb422a00640 1 -- 172.21.15.44:0/1204722672 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb42c06e8a0 con 0x7fb42c147c30 2024-09-17T05:37:37.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.782+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7fb42c151b00 con 0x7fb42c147c30 2024-09-17T05:37:37.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.966+0000 7fb422a00640 1 -- 172.21.15.44:0/1204722672 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v96) ==== 142+0+0 (secure 0 0 0) 0x7fb424001e30 con 0x7fb42c147c30 2024-09-17T05:37:37.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb408073200 msgr2=0x7fb408075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb408073200 0x7fb408075710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb41c000c10 tx=0x7fb41c006b80 comp rx=0 tx=0).stop 2024-09-17T05:37:37.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb42c147c30 msgr2=0x7fb42c14c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:37.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb42c147c30 0x7fb42c14c860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4240202c0 tx=0x7fb4240aac40 comp rx=0 tx=0).stop 2024-09-17T05:37:37.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 shutdown_connections 2024-09-17T05:37:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb42c147c30 0x7fb42c14c860 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb408073200 0x7fb408075710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb42c1f6cb0 0x7fb42c1f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 --2- 172.21.15.44:0/1204722672 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb410005360 0x7fb42c14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 >> 172.21.15.44:0/1204722672 conn(0x7fb42c0cd930 msgr2=0x7fb42c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 shutdown_connections 2024-09-17T05:37:37.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:37.970+0000 7fb431a00640 1 -- 172.21.15.44:0/1204722672 wait complete. 2024-09-17T05:37:37.992 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-09-17T05:37:37.992 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-09-17T05:37:37.992 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-17T05:37:37.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:38.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 -- 172.21.15.44:0/875827132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c155800 msgr2=0x7f1f4c15eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 --2- 172.21.15.44:0/875827132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c155800 0x7f1f4c15eee0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009900 tx=0x7f1f4001c770 comp rx=0 tx=0).stop 2024-09-17T05:37:38.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 -- 172.21.15.44:0/875827132 shutdown_connections 2024-09-17T05:37:38.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 --2- 172.21.15.44:0/875827132 >> v2:172.21.15.86:3300/0 conn(0x7f1f4c0b3f40 0x7f1f4c0b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 --2- 172.21.15.44:0/875827132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c155800 0x7f1f4c15eee0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 -- 172.21.15.44:0/875827132 >> 172.21.15.44:0/875827132 conn(0x7f1f4c0b2c40 msgr2=0x7f1f4c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:38.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 -- 172.21.15.44:0/875827132 shutdown_connections 2024-09-17T05:37:38.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.150+0000 7f1f52e00640 1 -- 172.21.15.44:0/875827132 wait complete. 2024-09-17T05:37:38.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 Processor -- start 2024-09-17T05:37:38.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 -- start start 2024-09-17T05:37:38.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f4c0711c0 0x7f1f4c13c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c0b3f40 0x7f1f4c14aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4c155800 0x7f1f4c14af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c15f5a0 con 0x7f1f4c155800 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c15f420 con 0x7f1f4c0711c0 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4c0b4890 con 0x7f1f4c0b3f40 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4c155800 0x7f1f4c14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4c155800 0x7f1f4c14af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41272/0 (socket says 172.21.15.44:41272) 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 -- 172.21.15.44:0/3514463199 learned_addr learned my addr 172.21.15.44:0/3514463199 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f51a00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f4c0711c0 0x7f1f4c13c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f51000640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c0b3f40 0x7f1f4c14aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 -- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c0b3f40 msgr2=0x7f1f4c14aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c0b3f40 0x7f1f4c14aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 -- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f4c0711c0 msgr2=0x7f1f4c13c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f4c0711c0 0x7f1f4c13c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.154+0000 7f1f52400640 1 -- 172.21.15.44:0/3514463199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c14a240 con 0x7f1f4c155800 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f52400640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4c155800 0x7f1f4c14af70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400eca0 tx=0x7f1f4400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f49600640 1 -- 172.21.15.44:0/3514463199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44003b80 con 0x7f1f4c155800 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f49600640 1 -- 172.21.15.44:0/3514463199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f44003d20 con 0x7f1f4c155800 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f49600640 1 -- 172.21.15.44:0/3514463199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44004280 con 0x7f1f4c155800 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c15e310 con 0x7f1f4c155800 2024-09-17T05:37:38.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c149f60 con 0x7f1f4c155800 2024-09-17T05:37:38.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4c1f6db0 con 0x7f1f4c155800 2024-09-17T05:37:38.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f49600640 1 -- 172.21.15.44:0/3514463199 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1f44004420 con 0x7f1f4c155800 2024-09-17T05:37:38.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f49600640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1f2c073230 0x7f1f2c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.158+0000 7f1f49600640 1 -- 172.21.15.44:0/3514463199 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f1f44094d30 con 0x7f1f4c155800 2024-09-17T05:37:38.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.162+0000 7f1f51a00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1f2c073230 0x7f1f2c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.162+0000 7f1f51a00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1f2c073230 0x7f1f2c075740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f400af000 tx=0x7f1f4001afb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:38.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.166+0000 7f1f49600640 1 -- 172.21.15.44:0/3514463199 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1f4405f7d0 con 0x7f1f4c155800 2024-09-17T05:37:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.338+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f4c0b4350 con 0x7f1f4c155800 2024-09-17T05:37:38.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f49600640 1 -- 172.21.15.44:0/3514463199 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13257 (secure 0 0 0) 0x7f1f44064200 con 0x7f1f4c155800 2024-09-17T05:37:38.341 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:38.341 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":43,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:36.957781+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/3983247436":"2024-09-18T05:37:33.944605+0000","172.21.15.44:6832/3983247436":"2024-09-18T05:37:33.944605+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1f2c073230 msgr2=0x7f1f2c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1f2c073230 0x7f1f2c075740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1f400af000 tx=0x7f1f4001afb0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4c155800 msgr2=0x7f1f4c14af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4c155800 0x7f1f4c14af70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400eca0 tx=0x7f1f4400c6a0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 shutdown_connections 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f4c155800 0x7f1f4c14af70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1f4c0b3f40 0x7f1f4c14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1f2c073230 0x7f1f2c075740 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 --2- 172.21.15.44:0/3514463199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f4c0711c0 0x7f1f4c13c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 >> 172.21.15.44:0/3514463199 conn(0x7f1f4c0b2c40 msgr2=0x7f1f4c1523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 shutdown_connections 2024-09-17T05:37:38.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.342+0000 7f1f52e00640 1 -- 172.21.15.44:0/3514463199 wait complete. 2024-09-17T05:37:38.363 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:36:06.284181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:37:38.363 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:37:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 -- 172.21.15.44:0/3580322248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 msgr2=0x7fbf60166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 --2- 172.21.15.44:0/3580322248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60166480 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbf58009bc0 tx=0x7fbf5801cb10 comp rx=0 tx=0).stop 2024-09-17T05:37:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 -- 172.21.15.44:0/3580322248 shutdown_connections 2024-09-17T05:37:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 --2- 172.21.15.44:0/3580322248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60166480 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 -- 172.21.15.44:0/3580322248 >> 172.21.15.44:0/3580322248 conn(0x7fbf600ccaa0 msgr2=0x7fbf600cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 -- 172.21.15.44:0/3580322248 shutdown_connections 2024-09-17T05:37:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 -- 172.21.15.44:0/3580322248 wait complete. 2024-09-17T05:37:38.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 Processor -- start 2024-09-17T05:37:38.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.526+0000 7fbf67400640 1 -- start start 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf6006de50 0x7fbf600ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf60072e50 0x7fbf60158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60169f40 con 0x7fbf600cc480 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf60169dc0 con 0x7fbf6006de50 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6016a0c0 con 0x7fbf60072e50 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41302/0 (socket says 172.21.15.44:41302) 2024-09-17T05:37:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 -- 172.21.15.44:0/1540267792 learned_addr learned my addr 172.21.15.44:0/1540267792 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:38.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf5fe00640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf60072e50 0x7fbf60158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf64a00640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf6006de50 0x7fbf600ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 -- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf60072e50 msgr2=0x7fbf60158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf60072e50 0x7fbf60158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 -- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf6006de50 msgr2=0x7fbf600ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf6006de50 0x7fbf600ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 -- 172.21.15.44:0/1540267792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf601586f0 con 0x7fbf600cc480 2024-09-17T05:37:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf65400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60158f90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf580b0040 tx=0x7fbf58005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf5cc00640 1 -- 172.21.15.44:0/1540267792 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf580b2040 con 0x7fbf600cc480 2024-09-17T05:37:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf5cc00640 1 -- 172.21.15.44:0/1540267792 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf580041f0 con 0x7fbf600cc480 2024-09-17T05:37:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf5cc00640 1 -- 172.21.15.44:0/1540267792 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58004600 con 0x7fbf600cc480 2024-09-17T05:37:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf601fd680 con 0x7fbf600cc480 2024-09-17T05:37:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf601fa070 con 0x7fbf600cc480 2024-09-17T05:37:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.530+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf600b5fa0 con 0x7fbf600cc480 2024-09-17T05:37:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.534+0000 7fbf5cc00640 1 -- 172.21.15.44:0/1540267792 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf580bd030 con 0x7fbf600cc480 2024-09-17T05:37:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.534+0000 7fbf5cc00640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf40073230 0x7fbf40075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.534+0000 7fbf5cc00640 1 -- 172.21.15.44:0/1540267792 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fbf5812df50 con 0x7fbf600cc480 2024-09-17T05:37:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.534+0000 7fbf64a00640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf40073230 0x7fbf40075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.534+0000 7fbf64a00640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf40073230 0x7fbf40075740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf54007fd0 tx=0x7fbf54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:38.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.538+0000 7fbf5cc00640 1 -- 172.21.15.44:0/1540267792 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbf580c4060 con 0x7fbf600cc480 2024-09-17T05:37:38.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.718+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf6006e650 con 0x7fbf600cc480 2024-09-17T05:37:38.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.718+0000 7fbf5cc00640 1 -- 172.21.15.44:0/1540267792 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7fbf58016790 con 0x7fbf600cc480 2024-09-17T05:37:38.720 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-17T05:37:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf40073230 msgr2=0x7fbf40075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf40073230 0x7fbf40075740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbf54007fd0 tx=0x7fbf54009040 comp rx=0 tx=0).stop 2024-09-17T05:37:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 msgr2=0x7fbf60158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60158f90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf580b0040 tx=0x7fbf58005ae0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 shutdown_connections 2024-09-17T05:37:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf600cc480 0x7fbf60158f90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf60072e50 0x7fbf60158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf40073230 0x7fbf40075740 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 --2- 172.21.15.44:0/1540267792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf6006de50 0x7fbf600ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 >> 172.21.15.44:0/1540267792 conn(0x7fbf600ccaa0 msgr2=0x7fbf600b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 shutdown_connections 2024-09-17T05:37:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.722+0000 7fbf67400640 1 -- 172.21.15.44:0/1540267792 wait complete. 2024-09-17T05:37:38.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-09-17T05:37:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 -- 172.21.15.44:0/2314142124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 msgr2=0x7faa700cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 --2- 172.21.15.44:0/2314142124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 0x7faa700cb880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faa68009bc0 tx=0x7faa6801cb10 comp rx=0 tx=0).stop 2024-09-17T05:37:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 -- 172.21.15.44:0/2314142124 shutdown_connections 2024-09-17T05:37:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 --2- 172.21.15.44:0/2314142124 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 0x7faa700cb880 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 --2- 172.21.15.44:0/2314142124 >> v2:172.21.15.86:3300/0 conn(0x7faa70072e50 0x7faa7015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 -- 172.21.15.44:0/2314142124 >> 172.21.15.44:0/2314142124 conn(0x7faa700ccaa0 msgr2=0x7faa700cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:38.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 -- 172.21.15.44:0/2314142124 shutdown_connections 2024-09-17T05:37:38.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.902+0000 7faa76800640 1 -- 172.21.15.44:0/2314142124 wait complete. 2024-09-17T05:37:38.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 Processor -- start 2024-09-17T05:37:38.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 -- start start 2024-09-17T05:37:38.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7006de50 0x7faa701577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa70072e50 0x7faa701fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 0x7faa701f8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa70168f70 con 0x7faa7006de50 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa70168df0 con 0x7faa70072e50 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faa701690f0 con 0x7faa700cb470 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7006de50 0x7faa701577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7006de50 0x7faa701577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53796/0 (socket says 172.21.15.44:53796) 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 -- 172.21.15.44:0/3600227576 learned_addr learned my addr 172.21.15.44:0/3600227576 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6fe00640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 0x7faa701f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa67e00640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa70072e50 0x7faa701fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 -- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 msgr2=0x7faa701f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 0x7faa701f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 -- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa70072e50 msgr2=0x7faa701fc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa70072e50 0x7faa701fc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:38.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 -- 172.21.15.44:0/3600227576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa700b35e0 con 0x7faa7006de50 2024-09-17T05:37:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa67e00640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa70072e50 0x7faa701fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa6f400640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7006de50 0x7faa701577a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e9a0 tx=0x7faa6000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa67400640 1 -- 172.21.15.44:0/3600227576 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6000cd20 con 0x7faa7006de50 2024-09-17T05:37:38.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa67400640 1 -- 172.21.15.44:0/3600227576 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa60004020 con 0x7faa7006de50 2024-09-17T05:37:38.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa67400640 1 -- 172.21.15.44:0/3600227576 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60004450 con 0x7faa7006de50 2024-09-17T05:37:38.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa700b38c0 con 0x7faa7006de50 2024-09-17T05:37:38.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.906+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa701fbda0 con 0x7faa7006de50 2024-09-17T05:37:38.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.910+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa700b5fa0 con 0x7faa7006de50 2024-09-17T05:37:38.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.910+0000 7faa67400640 1 -- 172.21.15.44:0/3600227576 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa60003600 con 0x7faa7006de50 2024-09-17T05:37:38.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.910+0000 7faa67400640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa4c073230 0x7faa4c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:38.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.910+0000 7faa67400640 1 -- 172.21.15.44:0/3600227576 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7faa60094a00 con 0x7faa7006de50 2024-09-17T05:37:38.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.910+0000 7faa67e00640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa4c073230 0x7faa4c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:38.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.910+0000 7faa67e00640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa4c073230 0x7faa4c075740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faa7015b280 tx=0x7faa58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:38.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:38.914+0000 7faa67400640 1 -- 172.21.15.44:0/3600227576 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faa6005fb80 con 0x7faa7006de50 2024-09-17T05:37:39.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.154+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7faa700cb880 con 0x7faa7006de50 2024-09-17T05:37:39.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.978+0000 7faa67400640 1 -- 172.21.15.44:0/3600227576 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v98) ==== 152+0+0 (secure 0 0 0) 0x7faa6005f480 con 0x7faa7006de50 2024-09-17T05:37:39.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.978+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa4c073230 msgr2=0x7faa4c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:39.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.978+0000 7faa76800640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa4c073230 0x7faa4c075740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faa7015b280 tx=0x7faa58009040 comp rx=0 tx=0).stop 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7006de50 msgr2=0x7faa701577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7006de50 0x7faa701577a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e9a0 tx=0x7faa6000ee60 comp rx=0 tx=0).stop 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 shutdown_connections 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa700cb470 0x7faa701f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa4c073230 0x7faa4c075740 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa70072e50 0x7faa701fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 --2- 172.21.15.44:0/3600227576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa7006de50 0x7faa701577a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 >> 172.21.15.44:0/3600227576 conn(0x7faa700ccaa0 msgr2=0x7faa70159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 shutdown_connections 2024-09-17T05:37:39.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:39.982+0000 7faa76800640 1 -- 172.21.15.44:0/3600227576 wait complete. 2024-09-17T05:37:40.005 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:37:40.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 -- 172.21.15.44:0/3554036304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb110160720 msgr2=0x7fb1100ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 --2- 172.21.15.44:0/3554036304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb110160720 0x7fb1100ae0e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb108009c80 tx=0x7fb10801cda0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 -- 172.21.15.44:0/3554036304 shutdown_connections 2024-09-17T05:37:40.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 --2- 172.21.15.44:0/3554036304 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb110160720 0x7fb1100ae0e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 -- 172.21.15.44:0/3554036304 >> 172.21.15.44:0/3554036304 conn(0x7fb1100d1120 msgr2=0x7fb1100d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:40.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 -- 172.21.15.44:0/3554036304 shutdown_connections 2024-09-17T05:37:40.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 -- 172.21.15.44:0/3554036304 wait complete. 2024-09-17T05:37:40.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 Processor -- start 2024-09-17T05:37:40.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.166+0000 7fb115800640 1 -- start start 2024-09-17T05:37:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb11006dd30 0x7fb11015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb11015c430 0x7fb1100b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb11015a5b0 0x7fb11015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb11016b350 con 0x7fb11006dd30 2024-09-17T05:37:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb11016b1d0 con 0x7fb11015a5b0 2024-09-17T05:37:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb11016b4d0 con 0x7fb11015c430 2024-09-17T05:37:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb11006dd30 0x7fb11015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb11006dd30 0x7fb11015b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53820/0 (socket says 172.21.15.44:53820) 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 -- 172.21.15.44:0/1190444188 learned_addr learned my addr 172.21.15.44:0/1190444188 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb106000640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb11015c430 0x7fb1100b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10f400640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb11015a5b0 0x7fb11015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 -- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb11015c430 msgr2=0x7fb1100b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb11015c430 0x7fb1100b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 -- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb11015a5b0 msgr2=0x7fb11015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb11015a5b0 0x7fb11015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 -- 172.21.15.44:0/1190444188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11015af00 con 0x7fb11006dd30 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb106000640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb11015c430 0x7fb1100b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb10ea00640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb11006dd30 0x7fb11015b6d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c3c0 tx=0x7fb10000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb107400640 1 -- 172.21.15.44:0/1190444188 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100017070 con 0x7fb11006dd30 2024-09-17T05:37:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb107400640 1 -- 172.21.15.44:0/1190444188 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1000053c0 con 0x7fb11006dd30 2024-09-17T05:37:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb107400640 1 -- 172.21.15.44:0/1190444188 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100003860 con 0x7fb11006dd30 2024-09-17T05:37:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb110154bd0 con 0x7fb11006dd30 2024-09-17T05:37:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1100b69d0 con 0x7fb11006dd30 2024-09-17T05:37:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.170+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1100ae0e0 con 0x7fb11006dd30 2024-09-17T05:37:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.174+0000 7fb107400640 1 -- 172.21.15.44:0/1190444188 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb10001a070 con 0x7fb11006dd30 2024-09-17T05:37:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.174+0000 7fb107400640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.174+0000 7fb107400640 1 -- 172.21.15.44:0/1190444188 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7fb100093580 con 0x7fb11006dd30 2024-09-17T05:37:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.174+0000 7fb106000640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.174+0000 7fb106000640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb11015fb10 tx=0x7fb0f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.178+0000 7fb107400640 1 -- 172.21.15.44:0/1190444188 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb11015af00 con 0x7fb11006dd30 2024-09-17T05:37:40.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb1100cfa80 con 0x7fb11006dd30 2024-09-17T05:37:40.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb107400640 1 -- 172.21.15.44:0/1190444188 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+2294 (secure 0 0 0) 0x7fb10005e670 con 0x7fb11006dd30 2024-09-17T05:37:40.354 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:37:40.354 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:37:40.354 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:37:40.354 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:37:40.354 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:37:40.354 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3062.155679 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3184.697297 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3313.522676 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3406.954625 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4320.207875 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.313189 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7119.006184 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4437.685284 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:37:40.355 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:37:40.356 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:37:40.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 msgr2=0x7fb0ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb11015fb10 tx=0x7fb0f8008040 comp rx=0 tx=0).stop 2024-09-17T05:37:40.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb11006dd30 msgr2=0x7fb11015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb11006dd30 0x7fb11015b6d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb10000c3c0 tx=0x7fb10000c880 comp rx=0 tx=0).stop 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 shutdown_connections 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb11015a5b0 0x7fb11015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb11015c430 0x7fb1100b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 --2- 172.21.15.44:0/1190444188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb11006dd30 0x7fb11015b6d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 >> 172.21.15.44:0/1190444188 conn(0x7fb1100d1120 msgr2=0x7fb110155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 shutdown_connections 2024-09-17T05:37:40.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.354+0000 7fb115800640 1 -- 172.21.15.44:0/1190444188 wait complete. 2024-09-17T05:37:40.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:37:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.538+0000 7f1bc3200640 1 -- 172.21.15.44:0/3661477877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba00051b0 msgr2=0x7f1ba000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.538+0000 7f1bc3200640 1 --2- 172.21.15.44:0/3661477877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba00051b0 0x7f1ba000b9d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4001f50 tx=0x7f1bb401cc40 comp rx=0 tx=0).stop 2024-09-17T05:37:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.538+0000 7f1bc1200640 1 -- 172.21.15.44:0/3661477877 reap_dead start 2024-09-17T05:37:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.538+0000 7f1bc3200640 1 -- 172.21.15.44:0/3661477877 shutdown_connections 2024-09-17T05:37:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.538+0000 7f1bc3200640 1 -- 172.21.15.44:0/3661477877 >> 172.21.15.44:0/3661477877 conn(0x7f1bbc0ccaa0 msgr2=0x7f1bbc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.538+0000 7f1bc3200640 1 -- 172.21.15.44:0/3661477877 shutdown_connections 2024-09-17T05:37:40.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.538+0000 7f1bc3200640 1 -- 172.21.15.44:0/3661477877 wait complete. 2024-09-17T05:37:40.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 Processor -- start 2024-09-17T05:37:40.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 -- start start 2024-09-17T05:37:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ba00051b0 0x7f1bbc06e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bbc09f310 0x7f1bbc1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc1f57a0 0x7f1bbc1f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc074770 con 0x7f1bbc09f310 2024-09-17T05:37:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0745f0 con 0x7f1bbc1f57a0 2024-09-17T05:37:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc3200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc06e560 con 0x7f1ba00051b0 2024-09-17T05:37:40.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bbc09f310 0x7f1bbc1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bbc09f310 0x7f1bbc1f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53830/0 (socket says 172.21.15.44:53830) 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1966512336 learned_addr learned my addr 172.21.15.44:0/1966512336 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bbbe00640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ba00051b0 0x7f1bbc06e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bc1200640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc1f57a0 0x7f1bbc1f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ba00051b0 msgr2=0x7f1bbc06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ba00051b0 0x7f1bbc06e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc1f57a0 msgr2=0x7f1bbc1f5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc1f57a0 0x7f1bbc1f5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1966512336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc1f9650 con 0x7f1bbc09f310 2024-09-17T05:37:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.542+0000 7f1bb3e00640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bbc09f310 0x7f1bbc1f2470 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4011ae0 tx=0x7f1ba4009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bb8c00640 1 -- 172.21.15.44:0/1966512336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4004460 con 0x7f1bbc09f310 2024-09-17T05:37:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bb8c00640 1 -- 172.21.15.44:0/1966512336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ba400fa00 con 0x7f1bbc09f310 2024-09-17T05:37:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bb8c00640 1 -- 172.21.15.44:0/1966512336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400fe10 con 0x7f1bbc09f310 2024-09-17T05:37:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc0c9ac0 con 0x7f1bbc09f310 2024-09-17T05:37:40.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc1f9090 con 0x7f1bbc09f310 2024-09-17T05:37:40.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc1f8b20 con 0x7f1bbc09f310 2024-09-17T05:37:40.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bb8c00640 1 -- 172.21.15.44:0/1966512336 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1ba4005020 con 0x7f1bbc09f310 2024-09-17T05:37:40.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bb8c00640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b98073200 0x7f1b98075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:40.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bb8c00640 1 -- 172.21.15.44:0/1966512336 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f1ba4094d80 con 0x7f1bbc09f310 2024-09-17T05:37:40.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.546+0000 7f1bbbe00640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b98073200 0x7f1b98075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:40.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.550+0000 7f1bbbe00640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b98073200 0x7f1b98075710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bac001230 tx=0x7f1bac0011c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:40.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.550+0000 7f1bb8c00640 1 -- 172.21.15.44:0/1966512336 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1bbc0c9ac0 con 0x7f1bbc09f310 2024-09-17T05:37:40.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.726+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1bbc0cfca0 con 0x7f1bbc09f310 2024-09-17T05:37:40.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.730+0000 7f1bb8c00640 1 -- 172.21.15.44:0/1966512336 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f1ba405f8d0 con 0x7f1bbc09f310 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b98073200 msgr2=0x7f1b98075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b98073200 0x7f1b98075710 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1bac001230 tx=0x7f1bac0011c0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bbc09f310 msgr2=0x7f1bbc1f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bbc09f310 0x7f1bbc1f2470 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4011ae0 tx=0x7f1ba4009e10 comp rx=0 tx=0).stop 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 shutdown_connections 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1b98073200 0x7f1b98075710 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bbc1f57a0 0x7f1bbc1f5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bbc09f310 0x7f1bbc1f2470 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 --2- 172.21.15.44:0/1966512336 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ba00051b0 0x7f1bbc06e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 >> 172.21.15.44:0/1966512336 conn(0x7f1bbc0ccaa0 msgr2=0x7f1bbc072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 shutdown_connections 2024-09-17T05:37:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:40.734+0000 7f1bc3200640 1 -- 172.21.15.44:0/1966512336 wait complete. 2024-09-17T05:37:40.755 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:37:40.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:37:40.811 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:37:40.899 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:37:40.899 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:40.900 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:40.908 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:37:40.908 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:37:40.909 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:40.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:37:40.918 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:40.918 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:40.960 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:37:40.961 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:37:40.961 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:40.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:37:40.970 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:37:40.970 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:41.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 -- 172.21.15.44:0/1616618452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f454c0d1d00 msgr2=0x7f454c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 --2- 172.21.15.44:0/1616618452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f454c0d1d00 0x7f454c0cf070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4534009840 tx=0x7f453401c760 comp rx=0 tx=0).stop 2024-09-17T05:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 -- 172.21.15.44:0/1616618452 shutdown_connections 2024-09-17T05:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 --2- 172.21.15.44:0/1616618452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f454c0d1d00 0x7f454c0cf070 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 --2- 172.21.15.44:0/1616618452 >> v2:172.21.15.86:3300/0 conn(0x7f454c0d18f0 0x7f454c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 -- 172.21.15.44:0/1616618452 >> 172.21.15.44:0/1616618452 conn(0x7f454c0b4240 msgr2=0x7f454c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 -- 172.21.15.44:0/1616618452 shutdown_connections 2024-09-17T05:37:41.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.162+0000 7f4551400640 1 -- 172.21.15.44:0/1616618452 wait complete. 2024-09-17T05:37:41.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 Processor -- start 2024-09-17T05:37:41.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 -- start start 2024-09-17T05:37:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c0cf5b0 0x7f454c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c0d18f0 0x7f454c15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f454c0d1d00 0x7f454c0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f454c169e80 con 0x7f454c0cf5b0 2024-09-17T05:37:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f454c169d00 con 0x7f454c0d18f0 2024-09-17T05:37:41.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f454c16a000 con 0x7f454c0d1d00 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c0cf5b0 0x7f454c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c0cf5b0 0x7f454c157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53832/0 (socket says 172.21.15.44:53832) 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 -- 172.21.15.44:0/49563698 learned_addr learned my addr 172.21.15.44:0/49563698 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 -- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f454c0d1d00 msgr2=0x7f454c0ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f454c0d1d00 0x7f454c0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 -- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c0d18f0 msgr2=0x7f454c15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c0d18f0 0x7f454c15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 -- 172.21.15.44:0/49563698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c0cc510 con 0x7f454c0cf5b0 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f454a800640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c0cf5b0 0x7f454c157b80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f453c00e7a0 tx=0x7f453c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4542a00640 1 -- 172.21.15.44:0/49563698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c00ccc0 con 0x7f454c0cf5b0 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c0cc230 con 0x7f454c0cf5b0 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4542a00640 1 -- 172.21.15.44:0/49563698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f453c010430 con 0x7f454c0cf5b0 2024-09-17T05:37:41.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4542a00640 1 -- 172.21.15.44:0/49563698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c010860 con 0x7f454c0cf5b0 2024-09-17T05:37:41.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.166+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c15e060 con 0x7f454c0cf5b0 2024-09-17T05:37:41.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.170+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c0b1be0 con 0x7f454c0cf5b0 2024-09-17T05:37:41.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.170+0000 7f4542a00640 1 -- 172.21.15.44:0/49563698 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f453c010a00 con 0x7f454c0cf5b0 2024-09-17T05:37:41.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.170+0000 7f4542a00640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4528073200 0x7f4528075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.170+0000 7f4542a00640 1 -- 172.21.15.44:0/49563698 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f453c094bd0 con 0x7f454c0cf5b0 2024-09-17T05:37:41.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.170+0000 7f4543e00640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4528073200 0x7f4528075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:41.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.174+0000 7f4543e00640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4528073200 0x7f4528075710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f45340af000 tx=0x7f4534019500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:41.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.174+0000 7f4542a00640 1 -- 172.21.15.44:0/49563698 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f453c05fcd0 con 0x7f454c0cf5b0 2024-09-17T05:37:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f454c15c430 con 0x7f454c0cf5b0 2024-09-17T05:37:41.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4542a00640 1 -- 172.21.15.44:0/49563698 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3905 (secure 0 0 0) 0x7f453c05f5d0 con 0x7f454c0cf5b0 2024-09-17T05:37:41.387 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:41.387 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":19,"btime":"2024-09-17T05:37:34:947105+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2796700656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2796700656},{"type":"v1","addr":"172.21.15.86:6835","nonce":2796700656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/167336476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":167336476},{"type":"v1","addr":"172.21.15.86:6837","nonce":167336476}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/684375908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":684375908},{"type":"v1","addr":"172.21.15.44:6834","nonce":684375908}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5256,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1838597486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1838597486},{"type":"v1","addr":"172.21.15.44:6835","nonce":1838597486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-09-17T05:37:41.387 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 19 2024-09-17T05:37:41.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4528073200 msgr2=0x7f4528075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4528073200 0x7f4528075710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f45340af000 tx=0x7f4534019500 comp rx=0 tx=0).stop 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c0cf5b0 msgr2=0x7f454c157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c0cf5b0 0x7f454c157b80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f453c00e7a0 tx=0x7f453c00ec60 comp rx=0 tx=0).stop 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 shutdown_connections 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f454c0d1d00 0x7f454c0ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4528073200 0x7f4528075710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f454c0d18f0 0x7f454c15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 --2- 172.21.15.44:0/49563698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f454c0cf5b0 0x7f454c157b80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 >> 172.21.15.44:0/49563698 conn(0x7f454c0b4240 msgr2=0x7f454c069060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.386+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 shutdown_connections 2024-09-17T05:37:41.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.390+0000 7f4551400640 1 -- 172.21.15.44:0/49563698 wait complete. 2024-09-17T05:37:41.409 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:37:41.409 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:37:41.410 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:37:41.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:41.410 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:37:41.410 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:37:41.410 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:37:41.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:41.410 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:37:41.411 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:37:41.411 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:37:41.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:41.411 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:37:41.411 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:37:41.411 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:37:41.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:41.423 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:37:41.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:37:41.425 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:37:41.425 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:37:41.426 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:37:41.426 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:37:41.427 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:37:41.428 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:37:41.470 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:37:41.471 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:41.473 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:37:41.473 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:41.475 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:37:41.475 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:41.477 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:37:41.477 DEBUG:teuthology.parallel:result is None 2024-09-17T05:37:41.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:37:41.572 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:37:41.573 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:37:41.579 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:37:41.582 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 -- 172.21.15.44:0/1346339080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d4006e560 msgr2=0x7f9d40072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 --2- 172.21.15.44:0/1346339080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d4006e560 0x7f9d40072e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9d40072de0 tx=0x7f9d2c01f0b0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 -- 172.21.15.44:0/1346339080 shutdown_connections 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 --2- 172.21.15.44:0/1346339080 >> v2:172.21.15.86:3300/0 conn(0x7f9d400ce080 0x7f9d400ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 --2- 172.21.15.44:0/1346339080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d4006e560 0x7f9d40072e50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 -- 172.21.15.44:0/1346339080 >> 172.21.15.44:0/1346339080 conn(0x7f9d400ccaa0 msgr2=0x7f9d400cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 -- 172.21.15.44:0/1346339080 shutdown_connections 2024-09-17T05:37:41.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.642+0000 7f9d45c00640 1 -- 172.21.15.44:0/1346339080 wait complete. 2024-09-17T05:37:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 Processor -- start 2024-09-17T05:37:41.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 -- start start 2024-09-17T05:37:41.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d400ce080 0x7f9d40154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d400cef20 0x7f9d4015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d40156f60 0x7f9d40157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d400cf7f0 con 0x7f9d400cef20 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40071150 con 0x7f9d40156f60 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9d400ce9d0 con 0x7f9d400ce080 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d400cef20 0x7f9d4015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d400cef20 0x7f9d4015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53888/0 (socket says 172.21.15.44:53888) 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 -- 172.21.15.44:0/3803432758 learned_addr learned my addr 172.21.15.44:0/3803432758 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3ea00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d400ce080 0x7f9d40154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3f400640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d40156f60 0x7f9d40157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 -- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d400ce080 msgr2=0x7f9d40154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d400ce080 0x7f9d40154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 -- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d40156f60 msgr2=0x7f9d40157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d40156f60 0x7f9d40157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 -- 172.21.15.44:0/3803432758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d401578b0 con 0x7f9d400cef20 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d3e000640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d400cef20 0x7f9d4015d5d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0b3040 tx=0x7f9d2c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d36a00640 1 -- 172.21.15.44:0/3803432758 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0b5040 con 0x7f9d400cef20 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d36a00640 1 -- 172.21.15.44:0/3803432758 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d2c005340 con 0x7f9d400cef20 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d400b13c0 con 0x7f9d400cef20 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d36a00640 1 -- 172.21.15.44:0/3803432758 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0046d0 con 0x7f9d400cef20 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.646+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d40154640 con 0x7f9d400cef20 2024-09-17T05:37:41.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.650+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d40072e50 con 0x7f9d400cef20 2024-09-17T05:37:41.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.650+0000 7f9d36a00640 1 -- 172.21.15.44:0/3803432758 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9d2c004890 con 0x7f9d400cef20 2024-09-17T05:37:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.650+0000 7f9d36a00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9d20073200 0x7f9d20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.650+0000 7f9d36a00640 1 -- 172.21.15.44:0/3803432758 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5335+0+0 (secure 0 0 0) 0x7f9d2c1313d0 con 0x7f9d400cef20 2024-09-17T05:37:41.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.650+0000 7f9d3ea00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9d20073200 0x7f9d20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:41.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.654+0000 7f9d3ea00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9d20073200 0x7f9d20075710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d30007fd0 tx=0x7f9d30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:41.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.654+0000 7f9d36a00640 1 -- 172.21.15.44:0/3803432758 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9d2c0c0060 con 0x7f9d400cef20 2024-09-17T05:37:41.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:41.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:41.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:41.838+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9d40159290 con 0x7f9d400cef20 2024-09-17T05:37:42.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d36a00640 1 -- 172.21.15.44:0/3803432758 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) ==== 97+0+0 (secure 0 0 0) 0x7f9d401578b0 con 0x7f9d400cef20 2024-09-17T05:37:42.001 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9d20073200 msgr2=0x7f9d20075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9d20073200 0x7f9d20075710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d30007fd0 tx=0x7f9d30009040 comp rx=0 tx=0).stop 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d400cef20 msgr2=0x7f9d4015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d400cef20 0x7f9d4015d5d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0b3040 tx=0x7f9d2c005de0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 shutdown_connections 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9d20073200 0x7f9d20075710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d40156f60 0x7f9d40157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d400cef20 0x7f9d4015d5d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 --2- 172.21.15.44:0/3803432758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9d400ce080 0x7f9d40154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 >> 172.21.15.44:0/3803432758 conn(0x7f9d400ccaa0 msgr2=0x7f9d40159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 shutdown_connections 2024-09-17T05:37:42.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.002+0000 7f9d45c00640 1 -- 172.21.15.44:0/3803432758 wait complete. 2024-09-17T05:37:42.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:37:42.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.186+0000 7f8ff9400640 1 -- 172.21.15.44:0/3943059420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 msgr2=0x7f8ff406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 --2- 172.21.15.44:0/3943059420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff406e260 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009900 tx=0x7f8fdc01c850 comp rx=0 tx=0).stop 2024-09-17T05:37:42.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- 172.21.15.44:0/3943059420 shutdown_connections 2024-09-17T05:37:42.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 --2- 172.21.15.44:0/3943059420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff406e260 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 --2- 172.21.15.44:0/3943059420 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ff4072e50 0x7f8ff415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- 172.21.15.44:0/3943059420 >> 172.21.15.44:0/3943059420 conn(0x7f8ff40ccaa0 msgr2=0x7f8ff40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- 172.21.15.44:0/3943059420 shutdown_connections 2024-09-17T05:37:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- 172.21.15.44:0/3943059420 wait complete. 2024-09-17T05:37:42.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 Processor -- start 2024-09-17T05:37:42.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- start start 2024-09-17T05:37:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff409d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ff4072e50 0x7f8ff40b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ff40ced00 0x7f8ff40b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41694b0 con 0x7f8ff406de50 2024-09-17T05:37:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4169330 con 0x7f8ff4072e50 2024-09-17T05:37:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.190+0000 7f8ff9400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff4169630 con 0x7f8ff40ced00 2024-09-17T05:37:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff409d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff409d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53908/0 (socket says 172.21.15.44:53908) 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 -- 172.21.15.44:0/2467847431 learned_addr learned my addr 172.21.15.44:0/2467847431 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff3200640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ff40ced00 0x7f8ff40b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8fe9e00640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ff4072e50 0x7f8ff40b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 -- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ff40ced00 msgr2=0x7f8ff40b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ff40ced00 0x7f8ff40b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 -- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ff4072e50 msgr2=0x7f8ff40b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ff4072e50 0x7f8ff40b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 -- 172.21.15.44:0/2467847431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff409d760 con 0x7f8ff406de50 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff2800640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff409d220 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400d720 tx=0x7f8fe400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8feb400640 1 -- 172.21.15.44:0/2467847431 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4017070 con 0x7f8ff406de50 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8feb400640 1 -- 172.21.15.44:0/2467847431 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fe4005310 con 0x7f8ff406de50 2024-09-17T05:37:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff40c9830 con 0x7f8ff406de50 2024-09-17T05:37:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8feb400640 1 -- 172.21.15.44:0/2467847431 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40097c0 con 0x7f8ff406de50 2024-09-17T05:37:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff40c9df0 con 0x7f8ff406de50 2024-09-17T05:37:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff406e260 con 0x7f8ff406de50 2024-09-17T05:37:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.194+0000 7f8feb400640 1 -- 172.21.15.44:0/2467847431 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8fe4009960 con 0x7f8ff406de50 2024-09-17T05:37:42.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.198+0000 7f8feb400640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8fd0073230 0x7f8fd0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.198+0000 7f8feb400640 1 -- 172.21.15.44:0/2467847431 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f8fe40940a0 con 0x7f8ff406de50 2024-09-17T05:37:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.198+0000 7f8fe9e00640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8fd0073230 0x7f8fd0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.198+0000 7f8fe9e00640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8fd0073230 0x7f8fd0075740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0af000 tx=0x7f8fdc01b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.202+0000 7f8feb400640 1 -- 172.21.15.44:0/2467847431 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8fe405eb90 con 0x7f8ff406de50 2024-09-17T05:37:42.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8ff40b5fa0 con 0x7f8ff406de50 2024-09-17T05:37:42.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8feb400640 1 -- 172.21.15.44:0/2467847431 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f8fe40635c0 con 0x7f8ff406de50 2024-09-17T05:37:42.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:42.438 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:37:42.438 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-17T05:37:42.438 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.438 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-17T05:37:42.438 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw==", 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow==", 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.439 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ==", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA==", 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-17T05:37:42.441 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw==", 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA==", 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.442 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg==", 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-17T05:37:42.443 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q==", 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg==", 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.444 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew==", 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-17T05:37:42.445 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA==", 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw==", 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow==", 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ==", 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw==", 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A==", 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.449 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQARFelmev8SKhAAoaY75HymG92N8LNMMAUl6g==", 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA==", 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.450 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw==", 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:37:42.451 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:37:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8fd0073230 msgr2=0x7f8fd0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8fd0073230 0x7f8fd0075740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0af000 tx=0x7f8fdc01b090 comp rx=0 tx=0).stop 2024-09-17T05:37:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 msgr2=0x7f8ff409d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff409d220 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400d720 tx=0x7f8fe400dbe0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 shutdown_connections 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ff40ced00 0x7f8ff40b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8fd0073230 0x7f8fd0075740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ff4072e50 0x7f8ff40b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 --2- 172.21.15.44:0/2467847431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ff406de50 0x7f8ff409d220 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 >> 172.21.15.44:0/2467847431 conn(0x7f8ff40ccaa0 msgr2=0x7f8ff4157850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 shutdown_connections 2024-09-17T05:37:42.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.438+0000 7f8ff9400640 1 -- 172.21.15.44:0/2467847431 wait complete. 2024-09-17T05:37:42.461 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 -- 172.21.15.44:0/612331156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118071c60 msgr2=0x7fd11806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 --2- 172.21.15.44:0/612331156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118071c60 0x7fd11806df50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd104009900 tx=0x7fd10401c850 comp rx=0 tx=0).stop 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 -- 172.21.15.44:0/612331156 shutdown_connections 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 --2- 172.21.15.44:0/612331156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd11806e490 0x7fd118151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 --2- 172.21.15.44:0/612331156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118071c60 0x7fd11806df50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 -- 172.21.15.44:0/612331156 >> 172.21.15.44:0/612331156 conn(0x7fd1180cd930 msgr2=0x7fd1180cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 -- 172.21.15.44:0/612331156 shutdown_connections 2024-09-17T05:37:42.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.618+0000 7fd120400640 1 -- 172.21.15.44:0/612331156 wait complete. 2024-09-17T05:37:42.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 Processor -- start 2024-09-17T05:37:42.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 -- start start 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd11806e490 0x7fd1181480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118070e00 0x7fd11814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd118071c60 0x7fd11814b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd11815c450 con 0x7fd118070e00 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd11815c2d0 con 0x7fd118071c60 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd11815c5d0 con 0x7fd11806e490 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118070e00 0x7fd11814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118070e00 0x7fd11814b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53924/0 (socket says 172.21.15.44:53924) 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 -- 172.21.15.44:0/279602165 learned_addr learned my addr 172.21.15.44:0/279602165 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11da00640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd11806e490 0x7fd1181480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11e400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd118071c60 0x7fd11814b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 -- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd11806e490 msgr2=0x7fd1181480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd11806e490 0x7fd1181480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 -- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd118071c60 msgr2=0x7fd11814b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd118071c60 0x7fd11814b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 -- 172.21.15.44:0/279602165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1181558a0 con 0x7fd118070e00 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11e400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd118071c60 0x7fd11814b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd11d000640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118070e00 0x7fd11814b080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd1040b0040 tx=0x7fd1040a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd115600640 1 -- 172.21.15.44:0/279602165 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1040b2040 con 0x7fd118070e00 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd115600640 1 -- 172.21.15.44:0/279602165 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1040043b0 con 0x7fd118070e00 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd115600640 1 -- 172.21.15.44:0/279602165 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104005280 con 0x7fd118070e00 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.622+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd118155b80 con 0x7fd118070e00 2024-09-17T05:37:42.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.626+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd118148630 con 0x7fd118070e00 2024-09-17T05:37:42.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.626+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11815eb60 con 0x7fd118070e00 2024-09-17T05:37:42.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.626+0000 7fd115600640 1 -- 172.21.15.44:0/279602165 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd104005420 con 0x7fd118070e00 2024-09-17T05:37:42.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.626+0000 7fd115600640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0f8073230 0x7fd0f8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.626+0000 7fd115600640 1 -- 172.21.15.44:0/279602165 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fd1040bd070 con 0x7fd118070e00 2024-09-17T05:37:42.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.630+0000 7fd11da00640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0f8073230 0x7fd0f8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.630+0000 7fd11da00640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0f8073230 0x7fd0f8075740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd10c001650 tx=0x7fd10c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.634+0000 7fd115600640 1 -- 172.21.15.44:0/279602165 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd11815eb60 con 0x7fd118070e00 2024-09-17T05:37:42.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.810+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd11815d0d0 con 0x7fd118070e00 2024-09-17T05:37:42.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.810+0000 7fd115600640 1 -- 172.21.15.44:0/279602165 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7fd1040164d0 con 0x7fd118070e00 2024-09-17T05:37:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:42.811 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:37:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:42.812 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:37:42.812 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:37:42.812 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:42.812 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:37:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0f8073230 msgr2=0x7fd0f8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0f8073230 0x7fd0f8075740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd10c001650 tx=0x7fd10c009040 comp rx=0 tx=0).stop 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118070e00 msgr2=0x7fd11814b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118070e00 0x7fd11814b080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd1040b0040 tx=0x7fd1040a5680 comp rx=0 tx=0).stop 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 shutdown_connections 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd0f8073230 0x7fd0f8075740 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd118071c60 0x7fd11814b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd118070e00 0x7fd11814b080 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 --2- 172.21.15.44:0/279602165 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd11806e490 0x7fd1181480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 >> 172.21.15.44:0/279602165 conn(0x7fd1180cd930 msgr2=0x7fd1180cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 shutdown_connections 2024-09-17T05:37:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.814+0000 7fd120400640 1 -- 172.21.15.44:0/279602165 wait complete. 2024-09-17T05:37:42.834 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:37:42.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:37:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 -- 172.21.15.44:0/6097550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00155170 msgr2=0x7f0d000cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 --2- 172.21.15.44:0/6097550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00155170 0x7f0d000cc9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009840 tx=0x7f0cf001c790 comp rx=0 tx=0).stop 2024-09-17T05:37:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 -- 172.21.15.44:0/6097550 shutdown_connections 2024-09-17T05:37:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 --2- 172.21.15.44:0/6097550 >> v2:172.21.15.44:3300/0 conn(0x7f0d000ccee0 0x7f0d0006ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 --2- 172.21.15.44:0/6097550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d00155170 0x7f0d000cc9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 -- 172.21.15.44:0/6097550 >> 172.21.15.44:0/6097550 conn(0x7f0d000b35f0 msgr2=0x7f0d000b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 -- 172.21.15.44:0/6097550 shutdown_connections 2024-09-17T05:37:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:42.998+0000 7f0d07000640 1 -- 172.21.15.44:0/6097550 wait complete. 2024-09-17T05:37:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 Processor -- start 2024-09-17T05:37:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 -- start start 2024-09-17T05:37:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f460 0x7f0d00099960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d000ccee0 0x7f0d000adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d00155170 0x7f0d000ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00070db0 con 0x7f0d00155170 2024-09-17T05:37:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00155790 con 0x7f0d0006f460 2024-09-17T05:37:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d07000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0015bb40 con 0x7f0d000ccee0 2024-09-17T05:37:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d05000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d00155170 0x7f0d000ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d05000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d00155170 0x7f0d000ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53938/0 (socket says 172.21.15.44:53938) 2024-09-17T05:37:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0d05000640 1 -- 172.21.15.44:0/3696119326 learned_addr learned my addr 172.21.15.44:0/3696119326 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0cffe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f460 0x7f0d00099960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.002+0000 7f0cff400640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d000ccee0 0x7f0d000adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d05000640 1 -- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d000ccee0 msgr2=0x7f0d000adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d05000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d000ccee0 0x7f0d000adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d05000640 1 -- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f460 msgr2=0x7f0d00099960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d05000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f460 0x7f0d00099960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d05000640 1 -- 172.21.15.44:0/3696119326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d00099ea0 con 0x7f0d00155170 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d05000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d00155170 0x7f0d000ae520 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800cad0 tx=0x7f0cf800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0cf7e00640 1 -- 172.21.15.44:0/3696119326 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8016020 con 0x7f0d00155170 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0cf7e00640 1 -- 172.21.15.44:0/3696119326 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cf800aae0 con 0x7f0d00155170 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0cf7e00640 1 -- 172.21.15.44:0/3696119326 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800ce10 con 0x7f0d00155170 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d001f9300 con 0x7f0d00155170 2024-09-17T05:37:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d001f98c0 con 0x7f0d00155170 2024-09-17T05:37:43.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0015bfc0 con 0x7f0d00155170 2024-09-17T05:37:43.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.006+0000 7f0cf7e00640 1 -- 172.21.15.44:0/3696119326 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0cf8019020 con 0x7f0d00155170 2024-09-17T05:37:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.010+0000 7f0cf7e00640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ce0073230 0x7f0ce0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.010+0000 7f0cf7e00640 1 -- 172.21.15.44:0/3696119326 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f0cf80941d0 con 0x7f0d00155170 2024-09-17T05:37:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.010+0000 7f0cffe00640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ce0073230 0x7f0ce0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.010+0000 7f0cffe00640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ce0073230 0x7f0ce0075740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00af000 tx=0x7f0cf00b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.014+0000 7f0cf7e00640 1 -- 172.21.15.44:0/3696119326 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0cf8020020 con 0x7f0d00155170 2024-09-17T05:37:43.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:43.190+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0d000aeac0 con 0x7f0d00155170 2024-09-17T05:37:44.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.018+0000 7f0cf7e00640 1 -- 172.21.15.44:0/3696119326 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7f0d000cd2f0 con 0x7f0d00155170 2024-09-17T05:37:44.020 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:37:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ce0073230 msgr2=0x7f0ce0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ce0073230 0x7f0ce0075740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00af000 tx=0x7f0cf00b2040 comp rx=0 tx=0).stop 2024-09-17T05:37:44.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d00155170 msgr2=0x7f0d000ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d00155170 0x7f0d000ae520 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800cad0 tx=0x7f0cf800cbc0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 shutdown_connections 2024-09-17T05:37:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0d00155170 0x7f0d000ae520 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0d000ccee0 0x7f0d000adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ce0073230 0x7f0ce0075740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 --2- 172.21.15.44:0/3696119326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d0006f460 0x7f0d00099960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 >> 172.21.15.44:0/3696119326 conn(0x7f0d000b35f0 msgr2=0x7f0d0015c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:44.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 shutdown_connections 2024-09-17T05:37:44.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.022+0000 7f0d07000640 1 -- 172.21.15.44:0/3696119326 wait complete. 2024-09-17T05:37:44.051 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:37:44.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 -- 172.21.15.44:0/2500468733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708071c60 msgr2=0x7f370806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 --2- 172.21.15.44:0/2500468733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708071c60 0x7f370806df50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f36f4009900 tx=0x7f36f401c850 comp rx=0 tx=0).stop 2024-09-17T05:37:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 -- 172.21.15.44:0/2500468733 shutdown_connections 2024-09-17T05:37:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 --2- 172.21.15.44:0/2500468733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f370806e490 0x7f3708151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 --2- 172.21.15.44:0/2500468733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3708071c60 0x7f370806df50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 -- 172.21.15.44:0/2500468733 >> 172.21.15.44:0/2500468733 conn(0x7f37080cd930 msgr2=0x7f37080cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 -- 172.21.15.44:0/2500468733 shutdown_connections 2024-09-17T05:37:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 -- 172.21.15.44:0/2500468733 wait complete. 2024-09-17T05:37:44.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 Processor -- start 2024-09-17T05:37:44.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.222+0000 7f370dc00640 1 -- start start 2024-09-17T05:37:44.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370806e490 0x7f370814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:44.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3708070e00 0x7f370814d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:44.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708071c60 0x7f3708146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:44.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f370815c4f0 con 0x7f370806e490 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f370815c370 con 0x7f3708071c60 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f370815c670 con 0x7f3708070e00 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370806e490 0x7f370814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370806e490 0x7f370814cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53956/0 (socket says 172.21.15.44:53956) 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 -- 172.21.15.44:0/2942601392 learned_addr learned my addr 172.21.15.44:0/2942601392 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706000640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3708070e00 0x7f370814d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3707400640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708071c60 0x7f3708146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 -- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3708070e00 msgr2=0x7f370814d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3708070e00 0x7f370814d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 -- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708071c60 msgr2=0x7f3708146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708071c60 0x7f3708146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 -- 172.21.15.44:0/2942601392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3708051000 con 0x7f370806e490 2024-09-17T05:37:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f3706a00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370806e490 0x7f370814cb00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c3c0 tx=0x7f36f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f36fea00640 1 -- 172.21.15.44:0/2942601392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8017070 con 0x7f370806e490 2024-09-17T05:37:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f36fea00640 1 -- 172.21.15.44:0/2942601392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36f80053c0 con 0x7f370806e490 2024-09-17T05:37:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370814ddf0 con 0x7f370806e490 2024-09-17T05:37:44.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f36fea00640 1 -- 172.21.15.44:0/2942601392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8003860 con 0x7f370806e490 2024-09-17T05:37:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370814c020 con 0x7f370806e490 2024-09-17T05:37:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.226+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3708151b00 con 0x7f370806e490 2024-09-17T05:37:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.230+0000 7f36fea00640 1 -- 172.21.15.44:0/2942601392 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f36f801a070 con 0x7f370806e490 2024-09-17T05:37:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.230+0000 7f36fea00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e8073200 0x7f36e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.230+0000 7f36fea00640 1 -- 172.21.15.44:0/2942601392 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5619+0+0 (secure 0 0 0) 0x7f36f80935a0 con 0x7f370806e490 2024-09-17T05:37:44.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.230+0000 7f3706000640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e8073200 0x7f36e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:44.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.230+0000 7f3706000640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e8073200 0x7f36e8075710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f36f40af000 tx=0x7f36f401b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.234+0000 7f36fea00640 1 -- 172.21.15.44:0/2942601392 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f36f8021080 con 0x7f370806e490 2024-09-17T05:37:44.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:44.406+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f37080c9c80 con 0x7f370806e490 2024-09-17T05:37:45.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.026+0000 7f36fea00640 1 -- 172.21.15.44:0/2942601392 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7f370806e8a0 con 0x7f370806e490 2024-09-17T05:37:45.026 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:37:45.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e8073200 msgr2=0x7f36e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e8073200 0x7f36e8075710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f36f40af000 tx=0x7f36f401b090 comp rx=0 tx=0).stop 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370806e490 msgr2=0x7f370814cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370806e490 0x7f370814cb00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c3c0 tx=0x7f36f800c880 comp rx=0 tx=0).stop 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 shutdown_connections 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e8073200 0x7f36e8075710 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708071c60 0x7f3708146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3708070e00 0x7f370814d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 --2- 172.21.15.44:0/2942601392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370806e490 0x7f370814cb00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 >> 172.21.15.44:0/2942601392 conn(0x7f37080cd930 msgr2=0x7f370814b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 shutdown_connections 2024-09-17T05:37:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.030+0000 7f370dc00640 1 -- 172.21.15.44:0/2942601392 wait complete. 2024-09-17T05:37:45.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:37:45.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.234+0000 7fe822400640 1 -- 172.21.15.44:0/4178807268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe800003c20 msgr2=0x7fe800004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:45.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.234+0000 7fe822400640 1 --2- 172.21.15.44:0/4178807268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe800003c20 0x7fe800004070 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009b60 tx=0x7fe80c01d290 comp rx=0 tx=0).stop 2024-09-17T05:37:45.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.234+0000 7fe81be00640 1 -- 172.21.15.44:0/4178807268 reap_dead start 2024-09-17T05:37:45.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.234+0000 7fe822400640 1 -- 172.21.15.44:0/4178807268 shutdown_connections 2024-09-17T05:37:45.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.234+0000 7fe822400640 1 -- 172.21.15.44:0/4178807268 >> 172.21.15.44:0/4178807268 conn(0x7fe81c0cd930 msgr2=0x7fe81c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:45.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.234+0000 7fe822400640 1 -- 172.21.15.44:0/4178807268 shutdown_connections 2024-09-17T05:37:45.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.234+0000 7fe822400640 1 -- 172.21.15.44:0/4178807268 wait complete. 2024-09-17T05:37:45.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 Processor -- start 2024-09-17T05:37:45.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 -- start start 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe800003c20 0x7fe81c14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe81c1f96b0 0x7fe81c1f9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c1f9ac0 0x7fe81c1fa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c168fc0 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe81c168e40 con 0x7fe800003c20 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe822400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe81c169140 con 0x7fe81c1f96b0 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe81be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c1f9ac0 0x7fe81c1fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe81b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe800003c20 0x7fe81c14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe81be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c1f9ac0 0x7fe81c1fa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53968/0 (socket says 172.21.15.44:53968) 2024-09-17T05:37:45.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe81be00640 1 -- 172.21.15.44:0/3900749474 learned_addr learned my addr 172.21.15.44:0/3900749474 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.238+0000 7fe813e00640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe81c1f96b0 0x7fe81c1f9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe81be00640 1 -- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe81c1f96b0 msgr2=0x7fe81c1f9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe81be00640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe81c1f96b0 0x7fe81c1f9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe81be00640 1 -- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe800003c20 msgr2=0x7fe81c14b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe81be00640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe800003c20 0x7fe81c14b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe81be00640 1 -- 172.21.15.44:0/3900749474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81c15b440 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe81be00640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c1f9ac0 0x7fe81c1fa510 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0af740 tx=0x7fe81400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:45.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe813400640 1 -- 172.21.15.44:0/3900749474 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81400c9a0 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe813400640 1 -- 172.21.15.44:0/3900749474 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe814017070 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81c15b720 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe813400640 1 -- 172.21.15.44:0/3900749474 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814011460 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe81c15bce0 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe81c15c0c0 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.242+0000 7fe813400640 1 -- 172.21.15.44:0/3900749474 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe814011600 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.246+0000 7fe813400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe7f8073200 0x7fe7f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:45.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.246+0000 7fe813400640 1 -- 172.21.15.44:0/3900749474 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6001+0+0 (secure 0 0 0) 0x7fe8140951a0 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.246+0000 7fe81b400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe7f8073200 0x7fe7f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:45.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.246+0000 7fe81b400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe7f8073200 0x7fe7f8075710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0ae000 tx=0x7fe80c01a030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:45.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.246+0000 7fe813400640 1 -- 172.21.15.44:0/3900749474 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe81c15c0c0 con 0x7fe81c1f9ac0 2024-09-17T05:37:45.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:45.458+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe81c06fe80 con 0x7fe81c1f9ac0 2024-09-17T05:37:46.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe813400640 1 -- 172.21.15.44:0/3900749474 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) ==== 172+0+0 (secure 0 0 0) 0x7fe81405fab0 con 0x7fe81c1f9ac0 2024-09-17T05:37:46.029 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 7 and data pool 8 2024-09-17T05:37:46.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe7f8073200 msgr2=0x7fe7f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe7f8073200 0x7fe7f8075710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0ae000 tx=0x7fe80c01a030 comp rx=0 tx=0).stop 2024-09-17T05:37:46.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c1f9ac0 msgr2=0x7fe81c1fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c1f9ac0 0x7fe81c1fa510 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0af740 tx=0x7fe81400ed10 comp rx=0 tx=0).stop 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 shutdown_connections 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe81c1f9ac0 0x7fe81c1fa510 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe81c1f96b0 0x7fe81c1f9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe7f8073200 0x7fe7f8075710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 --2- 172.21.15.44:0/3900749474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe800003c20 0x7fe81c14b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 >> 172.21.15.44:0/3900749474 conn(0x7fe81c0cd930 msgr2=0x7fe81c15eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 shutdown_connections 2024-09-17T05:37:46.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.030+0000 7fe822400640 1 -- 172.21.15.44:0/3900749474 wait complete. 2024-09-17T05:37:46.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 -- 172.21.15.44:0/3313830505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 msgr2=0x7fdb5c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 --2- 172.21.15.44:0/3313830505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c06e260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c06ace0 tx=0x7fdb4401c770 comp rx=0 tx=0).stop 2024-09-17T05:37:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 -- 172.21.15.44:0/3313830505 shutdown_connections 2024-09-17T05:37:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 --2- 172.21.15.44:0/3313830505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c06e260 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 --2- 172.21.15.44:0/3313830505 >> v2:172.21.15.86:3300/0 conn(0x7fdb5c072e50 0x7fdb5c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 -- 172.21.15.44:0/3313830505 >> 172.21.15.44:0/3313830505 conn(0x7fdb5c0ccaa0 msgr2=0x7fdb5c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 -- 172.21.15.44:0/3313830505 shutdown_connections 2024-09-17T05:37:46.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 -- 172.21.15.44:0/3313830505 wait complete. 2024-09-17T05:37:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 Processor -- start 2024-09-17T05:37:46.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.242+0000 7fdb60e00640 1 -- start start 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c072e50 0x7fdb5c0c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0ced00 0x7fdb5c09fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c169410 con 0x7fdb5c06de50 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c169290 con 0x7fdb5c072e50 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c169590 con 0x7fdb5c0ced00 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53986/0 (socket says 172.21.15.44:53986) 2024-09-17T05:37:46.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 -- 172.21.15.44:0/254683246 learned_addr learned my addr 172.21.15.44:0/254683246 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:46.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb5a800640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0ced00 0x7fdb5c09fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 -- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0ced00 msgr2=0x7fdb5c09fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb51400640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c072e50 0x7fdb5c0c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0ced00 0x7fdb5c09fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 -- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c072e50 msgr2=0x7fdb5c0c3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c072e50 0x7fdb5c0c3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 -- 172.21.15.44:0/254683246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c159930 con 0x7fdb5c06de50 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb5a800640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0ced00 0x7fdb5c09fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb51400640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c072e50 0x7fdb5c0c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb59e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c153e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00d720 tx=0x7fdb4c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb52a00640 1 -- 172.21.15.44:0/254683246 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c017070 con 0x7fdb5c06de50 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb52a00640 1 -- 172.21.15.44:0/254683246 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb4c009d20 con 0x7fdb5c06de50 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c0b16f0 con 0x7fdb5c06de50 2024-09-17T05:37:46.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb52a00640 1 -- 172.21.15.44:0/254683246 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c005280 con 0x7fdb5c06de50 2024-09-17T05:37:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c1fd7a0 con 0x7fdb5c06de50 2024-09-17T05:37:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.246+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c06e260 con 0x7fdb5c06de50 2024-09-17T05:37:46.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.250+0000 7fdb52a00640 1 -- 172.21.15.44:0/254683246 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdb4c005420 con 0x7fdb5c06de50 2024-09-17T05:37:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.250+0000 7fdb52a00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb38073200 0x7fdb38075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.250+0000 7fdb52a00640 1 -- 172.21.15.44:0/254683246 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fdb4c094580 con 0x7fdb5c06de50 2024-09-17T05:37:46.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.250+0000 7fdb51400640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb38073200 0x7fdb38075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.250+0000 7fdb51400640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb38073200 0x7fdb38075710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb440af000 tx=0x7fdb4401afb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:46.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.254+0000 7fdb52a00640 1 -- 172.21.15.44:0/254683246 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fdb4c05f400 con 0x7fdb5c06de50 2024-09-17T05:37:46.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.430+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb5c0b5fa0 con 0x7fdb5c06de50 2024-09-17T05:37:46.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.430+0000 7fdb52a00640 1 -- 172.21.15.44:0/254683246 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16907 (secure 0 0 0) 0x7fdb4c05ed00 con 0x7fdb5c06de50 2024-09-17T05:37:46.432 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:46.432 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:45.459405+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:43.204010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:44.420003+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb38073200 msgr2=0x7fdb38075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb38073200 0x7fdb38075710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb440af000 tx=0x7fdb4401afb0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 msgr2=0x7fdb5c153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c153e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00d720 tx=0x7fdb4c00dbe0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 shutdown_connections 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb5c0ced00 0x7fdb5c09fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb38073200 0x7fdb38075710 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb5c072e50 0x7fdb5c0c3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 --2- 172.21.15.44:0/254683246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb5c06de50 0x7fdb5c153e50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 >> 172.21.15.44:0/254683246 conn(0x7fdb5c0ccaa0 msgr2=0x7fdb5c154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 shutdown_connections 2024-09-17T05:37:46.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.434+0000 7fdb60e00640 1 -- 172.21.15.44:0/254683246 wait complete. 2024-09-17T05:37:46.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.610+0000 7fb7e1200640 1 -- 172.21.15.44:0/2028595515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc0cf400 msgr2=0x7fb7dc06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.610+0000 7fb7e1200640 1 --2- 172.21.15.44:0/2028595515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc0cf400 0x7fb7dc06e160 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009840 tx=0x7fb7c401c700 comp rx=0 tx=0).stop 2024-09-17T05:37:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.610+0000 7fb7e1200640 1 -- 172.21.15.44:0/2028595515 shutdown_connections 2024-09-17T05:37:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.610+0000 7fb7e1200640 1 --2- 172.21.15.44:0/2028595515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc0cf400 0x7fb7dc06e160 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.610+0000 7fb7e1200640 1 -- 172.21.15.44:0/2028595515 >> 172.21.15.44:0/2028595515 conn(0x7fb7dc0d1120 msgr2=0x7fb7dc0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.610+0000 7fb7e1200640 1 -- 172.21.15.44:0/2028595515 shutdown_connections 2024-09-17T05:37:46.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.610+0000 7fb7e1200640 1 -- 172.21.15.44:0/2028595515 wait complete. 2024-09-17T05:37:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 Processor -- start 2024-09-17T05:37:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 -- start start 2024-09-17T05:37:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc072190 0x7fb7dc1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7dc15f0e0 0x7fb7dc155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7dc156340 0x7fb7dc165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc169fe0 con 0x7fb7dc072190 2024-09-17T05:37:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc169e60 con 0x7fb7dc15f0e0 2024-09-17T05:37:46.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7e1200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc16a160 con 0x7fb7dc156340 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.614+0000 7fb7d9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc072190 0x7fb7dc1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc072190 0x7fb7dc1550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54008/0 (socket says 172.21.15.44:54008) 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 -- 172.21.15.44:0/293131200 learned_addr learned my addr 172.21.15.44:0/293131200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d1400640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7dc15f0e0 0x7fb7dc155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7da800640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7dc156340 0x7fb7dc165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 -- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7dc156340 msgr2=0x7fb7dc165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7dc156340 0x7fb7dc165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 -- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7dc15f0e0 msgr2=0x7fb7dc155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7dc15f0e0 0x7fb7dc155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 -- 172.21.15.44:0/293131200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc156df0 con 0x7fb7dc072190 2024-09-17T05:37:46.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d1400640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7dc15f0e0 0x7fb7dc155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d9e00640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc072190 0x7fb7dc1550f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00c420 tx=0x7fb7cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:46.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d2a00640 1 -- 172.21.15.44:0/293131200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0068a0 con 0x7fb7dc072190 2024-09-17T05:37:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d2a00640 1 -- 172.21.15.44:0/293131200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7cc006b50 con 0x7fb7dc072190 2024-09-17T05:37:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc156750 con 0x7fb7dc072190 2024-09-17T05:37:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d2a00640 1 -- 172.21.15.44:0/293131200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc007020 con 0x7fb7dc072190 2024-09-17T05:37:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc1646a0 con 0x7fb7dc072190 2024-09-17T05:37:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc06e160 con 0x7fb7dc072190 2024-09-17T05:37:46.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.618+0000 7fb7d2a00640 1 -- 172.21.15.44:0/293131200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb7cc019020 con 0x7fb7dc072190 2024-09-17T05:37:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.622+0000 7fb7d2a00640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7b8073200 0x7fb7b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.622+0000 7fb7d2a00640 1 -- 172.21.15.44:0/293131200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7fb7cc093940 con 0x7fb7dc072190 2024-09-17T05:37:46.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.622+0000 7fb7d1400640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7b8073200 0x7fb7b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.622+0000 7fb7d1400640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7b8073200 0x7fb7b8075710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40af000 tx=0x7fb7c401af40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:46.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.626+0000 7fb7d2a00640 1 -- 172.21.15.44:0/293131200 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb7dc156750 con 0x7fb7dc072190 2024-09-17T05:37:46.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.802+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7dc0d1db0 con 0x7fb7dc072190 2024-09-17T05:37:46.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7d2a00640 1 -- 172.21.15.44:0/293131200 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+16907 (secure 0 0 0) 0x7fb7cc05e170 con 0x7fb7dc072190 2024-09-17T05:37:46.805 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:46.805 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":50,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:45.459405+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:43.204010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:44.420003+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:46.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7b8073200 msgr2=0x7fb7b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7b8073200 0x7fb7b8075710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40af000 tx=0x7fb7c401af40 comp rx=0 tx=0).stop 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc072190 msgr2=0x7fb7dc1550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc072190 0x7fb7dc1550f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00c420 tx=0x7fb7cc00c8e0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 shutdown_connections 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7dc156340 0x7fb7dc165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7b8073200 0x7fb7b8075710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7dc15f0e0 0x7fb7dc155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 --2- 172.21.15.44:0/293131200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7dc072190 0x7fb7dc1550f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 >> 172.21.15.44:0/293131200 conn(0x7fb7dc0d1120 msgr2=0x7fb7dc15a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 shutdown_connections 2024-09-17T05:37:46.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.806+0000 7fb7e1200640 1 -- 172.21.15.44:0/293131200 wait complete. 2024-09-17T05:37:46.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:37:46.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 -- 172.21.15.44:0/301971468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c0cb470 msgr2=0x7f4d9c0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 --2- 172.21.15.44:0/301971468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c0cb470 0x7f4d9c0cb880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009bc0 tx=0x7f4d9401cb10 comp rx=0 tx=0).stop 2024-09-17T05:37:46.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 -- 172.21.15.44:0/301971468 shutdown_connections 2024-09-17T05:37:46.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 --2- 172.21.15.44:0/301971468 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c0cb470 0x7f4d9c0cb880 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 --2- 172.21.15.44:0/301971468 >> v2:172.21.15.86:3300/0 conn(0x7f4d9c072e50 0x7f4d9c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 -- 172.21.15.44:0/301971468 >> 172.21.15.44:0/301971468 conn(0x7f4d9c0ccaa0 msgr2=0x7f4d9c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:46.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 -- 172.21.15.44:0/301971468 shutdown_connections 2024-09-17T05:37:46.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 -- 172.21.15.44:0/301971468 wait complete. 2024-09-17T05:37:46.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 Processor -- start 2024-09-17T05:37:46.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.990+0000 7f4da3400640 1 -- start start 2024-09-17T05:37:46.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d9c06de50 0x7f4d9c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c072e50 0x7f4d9c1f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9c0cb470 0x7f4d9c159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c168ed0 con 0x7f4d9c0cb470 2024-09-17T05:37:46.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c168d50 con 0x7f4d9c06de50 2024-09-17T05:37:46.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c169050 con 0x7f4d9c072e50 2024-09-17T05:37:46.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9c0cb470 0x7f4d9c159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9c0cb470 0x7f4d9c159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54014/0 (socket says 172.21.15.44:54014) 2024-09-17T05:37:46.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 -- 172.21.15.44:0/3374554234 learned_addr learned my addr 172.21.15.44:0/3374554234 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:46.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da0a00640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d9c06de50 0x7f4d9c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4d9be00640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c072e50 0x7f4d9c1f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 -- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c072e50 msgr2=0x7f4d9c1f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c072e50 0x7f4d9c1f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 -- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d9c06de50 msgr2=0x7f4d9c0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d9c06de50 0x7f4d9c0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 -- 172.21.15.44:0/3374554234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c1f98b0 con 0x7f4d9c0cb470 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da1400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9c0cb470 0x7f4d9c159b80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4d9401c580 tx=0x7f4d94003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4d98c00640 1 -- 172.21.15.44:0/3374554234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d940b2040 con 0x7f4d9c0cb470 2024-09-17T05:37:46.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4d98c00640 1 -- 172.21.15.44:0/3374554234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d940bb070 con 0x7f4d9c0cb470 2024-09-17T05:37:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c0b3080 con 0x7f4d9c0cb470 2024-09-17T05:37:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4d98c00640 1 -- 172.21.15.44:0/3374554234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d94004370 con 0x7f4d9c0cb470 2024-09-17T05:37:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c0b5c20 con 0x7f4d9c0cb470 2024-09-17T05:37:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.994+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c0b56a0 con 0x7f4d9c0cb470 2024-09-17T05:37:46.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.998+0000 7f4d98c00640 1 -- 172.21.15.44:0/3374554234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4d94004510 con 0x7f4d9c0cb470 2024-09-17T05:37:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.998+0000 7f4d98c00640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d7c073200 0x7f4d7c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.998+0000 7f4d98c00640 1 -- 172.21.15.44:0/3374554234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f4d9412eb70 con 0x7f4d9c0cb470 2024-09-17T05:37:46.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.998+0000 7f4da0a00640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d7c073200 0x7f4d7c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:47.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:46.998+0000 7f4da0a00640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d7c073200 0x7f4d7c075710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009b40 tx=0x7f4d900091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:47.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:47.002+0000 7f4d98c00640 1 -- 172.21.15.44:0/3374554234 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4d9c0b56a0 con 0x7f4d9c0cb470 2024-09-17T05:37:47.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:47.218+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4d9c0b5fa0 con 0x7f4d9c0cb470 2024-09-17T05:37:48.011 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:37:48.010+0000 7f6321600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:37:48.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.066+0000 7f4d98c00640 1 -- 172.21.15.44:0/3374554234 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f4d9c1f98b0 con 0x7f4d9c0cb470 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d7c073200 msgr2=0x7f4d7c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d7c073200 0x7f4d7c075710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009b40 tx=0x7f4d900091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9c0cb470 msgr2=0x7f4d9c159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9c0cb470 0x7f4d9c159b80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4d9401c580 tx=0x7f4d94003f40 comp rx=0 tx=0).stop 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 shutdown_connections 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d9c0cb470 0x7f4d9c159b80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d9c072e50 0x7f4d9c1f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d7c073200 0x7f4d7c075710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 --2- 172.21.15.44:0/3374554234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d9c06de50 0x7f4d9c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 >> 172.21.15.44:0/3374554234 conn(0x7f4d9c0ccaa0 msgr2=0x7f4d9c0cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:48.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 shutdown_connections 2024-09-17T05:37:48.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.070+0000 7f4da3400640 1 -- 172.21.15.44:0/3374554234 wait complete. 2024-09-17T05:37:48.093 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:37:48.093 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:37:48.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 -- 172.21.15.44:0/3403479406 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c0c7370 msgr2=0x7efe8c0c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:48.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 --2- 172.21.15.44:0/3403479406 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c0c7370 0x7efe8c0c7780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009900 tx=0x7efe7c01c850 comp rx=0 tx=0).stop 2024-09-17T05:37:48.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 -- 172.21.15.44:0/3403479406 shutdown_connections 2024-09-17T05:37:48.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 --2- 172.21.15.44:0/3403479406 >> v2:172.21.15.86:3300/0 conn(0x7efe8c0b1fc0 0x7efe8c0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 --2- 172.21.15.44:0/3403479406 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c0c7370 0x7efe8c0c7780 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 -- 172.21.15.44:0/3403479406 >> 172.21.15.44:0/3403479406 conn(0x7efe8c0ceaa0 msgr2=0x7efe8c0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:48.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 -- 172.21.15.44:0/3403479406 shutdown_connections 2024-09-17T05:37:48.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.254+0000 7efe92400640 1 -- 172.21.15.44:0/3403479406 wait complete. 2024-09-17T05:37:48.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 Processor -- start 2024-09-17T05:37:48.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 -- start start 2024-09-17T05:37:48.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe8c0b1fc0 0x7efe8c0701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:48.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c0c7370 0x7efe8c071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:48.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c160060 0x7efe8c13d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:48.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c169df0 con 0x7efe8c0c7370 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe8c169c70 con 0x7efe8c0b1fc0 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe92400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efe8c169f70 con 0x7efe8c160060 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe83e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c0c7370 0x7efe8c071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe91000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe8c0b1fc0 0x7efe8c0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe83e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c0c7370 0x7efe8c071b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54030/0 (socket says 172.21.15.44:54030) 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe83e00640 1 -- 172.21.15.44:0/4006244668 learned_addr learned my addr 172.21.15.44:0/4006244668 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.258+0000 7efe91a00640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c160060 0x7efe8c13d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe83e00640 1 -- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c160060 msgr2=0x7efe8c13d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe83e00640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c160060 0x7efe8c13d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe83e00640 1 -- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe8c0b1fc0 msgr2=0x7efe8c0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe83e00640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe8c0b1fc0 0x7efe8c0701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe83e00640 1 -- 172.21.15.44:0/4006244668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c06f410 con 0x7efe8c0c7370 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe83e00640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c0c7370 0x7efe8c071b30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c430 tx=0x7efe7400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe89600640 1 -- 172.21.15.44:0/4006244668 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74017070 con 0x7efe8c0c7370 2024-09-17T05:37:48.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8c06f6f0 con 0x7efe8c0c7370 2024-09-17T05:37:48.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe89600640 1 -- 172.21.15.44:0/4006244668 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe740053e0 con 0x7efe8c0c7370 2024-09-17T05:37:48.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe89600640 1 -- 172.21.15.44:0/4006244668 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74003860 con 0x7efe8c0c7370 2024-09-17T05:37:48.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe8c13dac0 con 0x7efe8c0c7370 2024-09-17T05:37:48.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8c0b23d0 con 0x7efe8c0c7370 2024-09-17T05:37:48.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe89600640 1 -- 172.21.15.44:0/4006244668 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe7401a070 con 0x7efe8c0c7370 2024-09-17T05:37:48.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe89600640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe68073200 0x7efe68075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:48.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.262+0000 7efe89600640 1 -- 172.21.15.44:0/4006244668 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7efe740936a0 con 0x7efe8c0c7370 2024-09-17T05:37:48.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.266+0000 7efe91000640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe68073200 0x7efe68075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:48.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.266+0000 7efe91000640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe68073200 0x7efe68075710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0af000 tx=0x7efe7c01b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:48.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.270+0000 7efe89600640 1 -- 172.21.15.44:0/4006244668 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efe7405df00 con 0x7efe8c0c7370 2024-09-17T05:37:48.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:48.478+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efe8c0ce470 con 0x7efe8c0c7370 2024-09-17T05:37:49.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.074+0000 7efe89600640 1 -- 172.21.15.44:0/4006244668 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7efe74062930 con 0x7efe8c0c7370 2024-09-17T05:37:49.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe68073200 msgr2=0x7efe68075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe68073200 0x7efe68075710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0af000 tx=0x7efe7c01b090 comp rx=0 tx=0).stop 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c0c7370 msgr2=0x7efe8c071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c0c7370 0x7efe8c071b30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efe7400c430 tx=0x7efe7400c830 comp rx=0 tx=0).stop 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 shutdown_connections 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe8c160060 0x7efe8c13d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8c0c7370 0x7efe8c071b30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe68073200 0x7efe68075710 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 --2- 172.21.15.44:0/4006244668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe8c0b1fc0 0x7efe8c0701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 >> 172.21.15.44:0/4006244668 conn(0x7efe8c0ceaa0 msgr2=0x7efe8c160570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 shutdown_connections 2024-09-17T05:37:49.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.078+0000 7efe92400640 1 -- 172.21.15.44:0/4006244668 wait complete. 2024-09-17T05:37:49.102 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:37:49.102 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:49.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.266+0000 7efcc9a00640 1 -- 172.21.15.44:0/2253008650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efca8003c20 msgr2=0x7efca8004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.266+0000 7efcc9a00640 1 --2- 172.21.15.44:0/2253008650 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efca8003c20 0x7efca8004070 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009b60 tx=0x7efcb401d260 comp rx=0 tx=0).stop 2024-09-17T05:37:49.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.266+0000 7efcc3400640 1 -- 172.21.15.44:0/2253008650 reap_dead start 2024-09-17T05:37:49.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.266+0000 7efcc9a00640 1 -- 172.21.15.44:0/2253008650 shutdown_connections 2024-09-17T05:37:49.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.266+0000 7efcc9a00640 1 -- 172.21.15.44:0/2253008650 >> 172.21.15.44:0/2253008650 conn(0x7efcc40b4240 msgr2=0x7efcc40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:49.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.266+0000 7efcc9a00640 1 -- 172.21.15.44:0/2253008650 shutdown_connections 2024-09-17T05:37:49.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.266+0000 7efcc9a00640 1 -- 172.21.15.44:0/2253008650 wait complete. 2024-09-17T05:37:49.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 Processor -- start 2024-09-17T05:37:49.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 -- start start 2024-09-17T05:37:49.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca8003c20 0x7efcc4167910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc40b7970 0x7efcc40b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efcc4154520 0x7efcc4154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4168b90 con 0x7efcc40b7970 2024-09-17T05:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4168a10 con 0x7efca8003c20 2024-09-17T05:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efcc4168d10 con 0x7efcc4154520 2024-09-17T05:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc40b7970 0x7efcc40b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc40b7970 0x7efcc40b7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60202/0 (socket says 172.21.15.44:60202) 2024-09-17T05:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 -- 172.21.15.44:0/2867735977 learned_addr learned my addr 172.21.15.44:0/2867735977 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:49.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc2a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca8003c20 0x7efcc4167910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc3400640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efcc4154520 0x7efcc4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 -- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efcc4154520 msgr2=0x7efcc4154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efcc4154520 0x7efcc4154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 -- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca8003c20 msgr2=0x7efcc4167910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca8003c20 0x7efcc4167910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 -- 172.21.15.44:0/2867735977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc4154e70 con 0x7efcc40b7970 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc2a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca8003c20 0x7efcc4167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcba000640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc40b7970 0x7efcc40b7d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efcac0068e0 tx=0x7efcac001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcbb400640 1 -- 172.21.15.44:0/2867735977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac015020 con 0x7efcc40b7970 2024-09-17T05:37:49.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcbb400640 1 -- 172.21.15.44:0/2867735977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcac011980 con 0x7efcc40b7970 2024-09-17T05:37:49.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcbb400640 1 -- 172.21.15.44:0/2867735977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac011dd0 con 0x7efcc40b7970 2024-09-17T05:37:49.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc41f7920 con 0x7efcc40b7970 2024-09-17T05:37:49.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.270+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc41f7080 con 0x7efcc40b7970 2024-09-17T05:37:49.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.274+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc415d060 con 0x7efcc40b7970 2024-09-17T05:37:49.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.274+0000 7efcbb400640 1 -- 172.21.15.44:0/2867735977 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efcac018020 con 0x7efcc40b7970 2024-09-17T05:37:49.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.274+0000 7efcbb400640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efca0073200 0x7efca0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.278+0000 7efcbb400640 1 -- 172.21.15.44:0/2867735977 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7efcac094ce0 con 0x7efcc40b7970 2024-09-17T05:37:49.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.278+0000 7efcc2a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efca0073200 0x7efca0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.278+0000 7efcc2a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efca0073200 0x7efca0075710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efcb40ae000 tx=0x7efcb401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:49.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.282+0000 7efcbb400640 1 -- 172.21.15.44:0/2867735977 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efcac01f020 con 0x7efcc40b7970 2024-09-17T05:37:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.490+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcc4158340 con 0x7efcc40b7970 2024-09-17T05:37:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcbb400640 1 -- 172.21.15.44:0/2867735977 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7efcc4154e70 con 0x7efcc40b7970 2024-09-17T05:37:49.493 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:49.493 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:37:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:37:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efca0073200 msgr2=0x7efca0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efca0073200 0x7efca0075710 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efcb40ae000 tx=0x7efcb401a000 comp rx=0 tx=0).stop 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc40b7970 msgr2=0x7efcc40b7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc40b7970 0x7efcc40b7d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efcac0068e0 tx=0x7efcac001800 comp rx=0 tx=0).stop 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 shutdown_connections 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efcc4154520 0x7efcc4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efcc40b7970 0x7efcc40b7d80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efca0073200 0x7efca0075710 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 --2- 172.21.15.44:0/2867735977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efca8003c20 0x7efcc4167910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 >> 172.21.15.44:0/2867735977 conn(0x7efcc40b4240 msgr2=0x7efcc415aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 shutdown_connections 2024-09-17T05:37:49.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.494+0000 7efcc9a00640 1 -- 172.21.15.44:0/2867735977 wait complete. 2024-09-17T05:37:49.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.674+0000 7f1138400640 1 -- 172.21.15.44:0/94643007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 msgr2=0x7f1118005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.674+0000 7f1138400640 1 --2- 172.21.15.44:0/94643007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 0x7f1118005160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1128009eb0 tx=0x7f112801d5f0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.674+0000 7f1136400640 1 -- 172.21.15.44:0/94643007 reap_dead start 2024-09-17T05:37:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.674+0000 7f1138400640 1 -- 172.21.15.44:0/94643007 shutdown_connections 2024-09-17T05:37:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.674+0000 7f1138400640 1 -- 172.21.15.44:0/94643007 >> 172.21.15.44:0/94643007 conn(0x7f11300b4240 msgr2=0x7f11300b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.674+0000 7f1138400640 1 -- 172.21.15.44:0/94643007 shutdown_connections 2024-09-17T05:37:49.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.674+0000 7f1138400640 1 -- 172.21.15.44:0/94643007 wait complete. 2024-09-17T05:37:49.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 Processor -- start 2024-09-17T05:37:49.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 -- start start 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 0x7f113014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11301504e0 0x7f11300b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f113006f300 0x7f1130152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11300cf1f0 con 0x7f1118004d50 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f11300cf070 con 0x7f11301504e0 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1138400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f11300cf370 con 0x7f113006f300 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.678+0000 7f1135a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 0x7f113014fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 0x7f113014fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60228/0 (socket says 172.21.15.44:60228) 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135a00640 1 -- 172.21.15.44:0/3287638176 learned_addr learned my addr 172.21.15.44:0/3287638176 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135000640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11301504e0 0x7f11300b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1136400640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f113006f300 0x7f1130152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135000640 1 -- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f113006f300 msgr2=0x7f1130152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135000640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f113006f300 0x7f1130152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135000640 1 -- 172.21.15.44:0/3287638176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 msgr2=0x7f113014fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135000640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 0x7f113014fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135000640 1 -- 172.21.15.44:0/3287638176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11301516b0 con 0x7f11301504e0 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135a00640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 0x7f113014fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1135000640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11301504e0 0x7f11300b6520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f111c011880 tx=0x7f111c011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f112d600640 1 -- 172.21.15.44:0/3287638176 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c00f9a0 con 0x7f11301504e0 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113014ff80 con 0x7f11301504e0 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f112d600640 1 -- 172.21.15.44:0/3287638176 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f111c00fb40 con 0x7f11301504e0 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f112d600640 1 -- 172.21.15.44:0/3287638176 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c003600 con 0x7f11301504e0 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11301513d0 con 0x7f11301504e0 2024-09-17T05:37:49.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f113015e9a0 con 0x7f11301504e0 2024-09-17T05:37:49.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.682+0000 7f112d600640 1 -- 172.21.15.44:0/3287638176 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f111c0037a0 con 0x7f11301504e0 2024-09-17T05:37:49.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.686+0000 7f112d600640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1110073230 0x7f1110075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.686+0000 7f112d600640 1 -- 172.21.15.44:0/3287638176 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f111c095760 con 0x7f11301504e0 2024-09-17T05:37:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.686+0000 7f1135a00640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1110073230 0x7f1110075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:49.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.686+0000 7f1135a00640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1110073230 0x7f1110075740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1124001440 tx=0x7f1124000fa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:49.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.690+0000 7f112d600640 1 -- 172.21.15.44:0/3287638176 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f11301516b0 con 0x7f11301504e0 2024-09-17T05:37:49.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.866+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11301502a0 con 0x7f11301504e0 2024-09-17T05:37:49.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f112d600640 1 -- 172.21.15.44:0/3287638176 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16894 (secure 0 0 0) 0x7f111c05ff90 con 0x7f11301504e0 2024-09-17T05:37:49.869 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:49.869 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:47.030728+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:43.204010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:44.420003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1110073230 msgr2=0x7f1110075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1110073230 0x7f1110075740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1124001440 tx=0x7f1124000fa0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11301504e0 msgr2=0x7f11300b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11301504e0 0x7f11300b6520 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f111c011880 tx=0x7f111c011d40 comp rx=0 tx=0).stop 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 shutdown_connections 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f113006f300 0x7f1130152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1110073230 0x7f1110075740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11301504e0 0x7f11300b6520 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 --2- 172.21.15.44:0/3287638176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1118004d50 0x7f113014fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 >> 172.21.15.44:0/3287638176 conn(0x7f11300b4240 msgr2=0x7f113015b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:49.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 shutdown_connections 2024-09-17T05:37:49.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:49.870+0000 7f1138400640 1 -- 172.21.15.44:0/3287638176 wait complete. 2024-09-17T05:37:49.892 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:37:49.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:50.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2693012230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 msgr2=0x7f9fa015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2693012230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa015e990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009900 tx=0x7f9f9001c850 comp rx=0 tx=0).stop 2024-09-17T05:37:50.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2693012230 shutdown_connections 2024-09-17T05:37:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2693012230 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa006de50 0x7f9fa006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2693012230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa015e990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2693012230 >> 172.21.15.44:0/2693012230 conn(0x7f9fa00ccaa0 msgr2=0x7f9fa00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2693012230 shutdown_connections 2024-09-17T05:37:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.050+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2693012230 wait complete. 2024-09-17T05:37:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 Processor -- start 2024-09-17T05:37:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 -- start start 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa006de50 0x7f9fa0157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa00c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa00ced00 0x7f9fa0158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0169410 con 0x7f9fa0072e50 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa0169290 con 0x7f9fa006de50 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9fa5a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa0169590 con 0x7f9fa00ced00 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9f9e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa00c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9f9e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa00c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60252/0 (socket says 172.21.15.44:60252) 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9f9e000640 1 -- 172.21.15.44:0/2556972259 learned_addr learned my addr 172.21.15.44:0/2556972259 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9f9ea00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa006de50 0x7f9fa0157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.054+0000 7f9f9f400640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa00ced00 0x7f9fa0158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f9e000640 1 -- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa00ced00 msgr2=0x7f9fa0158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f9e000640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa00ced00 0x7f9fa0158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f9e000640 1 -- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa006de50 msgr2=0x7f9fa0157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f9e000640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa006de50 0x7f9fa0157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f9e000640 1 -- 172.21.15.44:0/2556972259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa00c9f90 con 0x7f9fa0072e50 2024-09-17T05:37:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f9f400640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa00ced00 0x7f9fa0158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f9e000640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa00c72e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00d680 tx=0x7f9f8c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f96a00640 1 -- 172.21.15.44:0/2556972259 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c017070 con 0x7f9fa0072e50 2024-09-17T05:37:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f96a00640 1 -- 172.21.15.44:0/2556972259 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f8c005310 con 0x7f9fa0072e50 2024-09-17T05:37:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa01f7560 con 0x7f9fa0072e50 2024-09-17T05:37:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9f96a00640 1 -- 172.21.15.44:0/2556972259 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c009820 con 0x7f9fa0072e50 2024-09-17T05:37:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa01f7b20 con 0x7f9fa0072e50 2024-09-17T05:37:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.058+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa006e260 con 0x7f9fa0072e50 2024-09-17T05:37:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.062+0000 7f9f96a00640 1 -- 172.21.15.44:0/2556972259 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9f8c0099c0 con 0x7f9fa0072e50 2024-09-17T05:37:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.062+0000 7f9f96a00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f80073230 0x7f9f80075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.062+0000 7f9f96a00640 1 -- 172.21.15.44:0/2556972259 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f9f8c094320 con 0x7f9fa0072e50 2024-09-17T05:37:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.062+0000 7f9f9ea00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f80073230 0x7f9f80075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.062+0000 7f9f9ea00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f80073230 0x7f9f80075740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f900af000 tx=0x7f9f9001b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.066+0000 7f9f96a00640 1 -- 172.21.15.44:0/2556972259 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9f8c05ebe0 con 0x7f9fa0072e50 2024-09-17T05:37:50.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.242+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fa00b5f80 con 0x7f9f80073230 2024-09-17T05:37:50.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.246+0000 7f9f96a00640 1 -- 172.21.15.44:0/2556972259 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249153 (secure 0 0 0) 0x7f9fa00b5f80 con 0x7f9f80073230 2024-09-17T05:37:50.249 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:50.250 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:37:50.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f80073230 msgr2=0x7f9f80075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f80073230 0x7f9f80075740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f900af000 tx=0x7f9f9001b090 comp rx=0 tx=0).stop 2024-09-17T05:37:50.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 msgr2=0x7f9fa00c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa00c72e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00d680 tx=0x7f9f8c00db40 comp rx=0 tx=0).stop 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 shutdown_connections 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9fa00ced00 0x7f9fa0158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9fa0072e50 0x7f9fa00c72e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f80073230 0x7f9f80075740 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 --2- 172.21.15.44:0/2556972259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fa006de50 0x7f9fa0157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 >> 172.21.15.44:0/2556972259 conn(0x7f9fa00ccaa0 msgr2=0x7f9fa0070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 shutdown_connections 2024-09-17T05:37:50.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.250+0000 7f9fa5a00640 1 -- 172.21.15.44:0/2556972259 wait complete. 2024-09-17T05:37:50.271 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-17T05:37:48.281214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591130,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":132,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226104,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748616,"statfs":{"total":773094113280,"available":772862582784,"internally_reserved":0,"allocated":5816320,"data_stored":3189824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.261198"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697288+0000","last_change":"2024-09-17T05:37:46.072522+0000","last_active":"2024-09-17T05:37:47.697288+0000","last_peered":"2024-09-17T05:37:47.697288+0000","last_clean":"2024-09-17T05:37:47.697288+0000","last_became_active":"2024-09-17T05:37:46.072094+0000","last_became_peered":"2024-09-17T05:37:46.072094+0000","last_unstale":"2024-09-17T05:37:47.697288+0000","last_undegraded":"2024-09-17T05:37:47.697288+0000","last_fullsized":"2024-09-17T05:37:47.697288+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:14.754849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049328+0000","last_change":"2024-09-17T05:37:46.049328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049328+0000","last_undegraded":"2024-09-17T05:37:46.049328+0000","last_fullsized":"2024-09-17T05:37:46.049328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055291+0000","last_change":"2024-09-17T05:37:46.050394+0000","last_active":"2024-09-17T05:37:46.055291+0000","last_peered":"2024-09-17T05:37:46.055291+0000","last_clean":"2024-09-17T05:37:46.055291+0000","last_became_active":"2024-09-17T05:37:46.050088+0000","last_became_peered":"2024-09-17T05:37:46.050088+0000","last_unstale":"2024-09-17T05:37:46.055291+0000","last_undegraded":"2024-09-17T05:37:46.055291+0000","last_fullsized":"2024-09-17T05:37:46.055291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:20.021978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040667+0000","last_change":"2024-09-17T05:37:46.040667+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040667+0000","last_undegraded":"2024-09-17T05:37:46.040667+0000","last_fullsized":"2024-09-17T05:37:46.040667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047608+0000","last_change":"2024-09-17T05:37:46.047608+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047608+0000","last_undegraded":"2024-09-17T05:37:46.047608+0000","last_fullsized":"2024-09-17T05:37:46.047608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042278+0000","last_change":"2024-09-17T05:37:45.042278+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042278+0000","last_undegraded":"2024-09-17T05:37:45.042278+0000","last_fullsized":"2024-09-17T05:37:45.042278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039644+0000","last_change":"2024-09-17T05:37:46.039644+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039644+0000","last_undegraded":"2024-09-17T05:37:46.039644+0000","last_fullsized":"2024-09-17T05:37:46.039644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049232+0000","last_change":"2024-09-17T05:37:46.049232+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049232+0000","last_undegraded":"2024-09-17T05:37:46.049232+0000","last_fullsized":"2024-09-17T05:37:46.049232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055932+0000","last_change":"2024-09-17T05:37:46.055821+0000","last_active":"2024-09-17T05:37:46.055932+0000","last_peered":"2024-09-17T05:37:46.055932+0000","last_clean":"2024-09-17T05:37:46.055932+0000","last_became_active":"2024-09-17T05:37:46.054639+0000","last_became_peered":"2024-09-17T05:37:46.054639+0000","last_unstale":"2024-09-17T05:37:46.055932+0000","last_undegraded":"2024-09-17T05:37:46.055932+0000","last_fullsized":"2024-09-17T05:37:46.055932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:58.176243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058676+0000","last_change":"2024-09-17T05:37:46.058567+0000","last_active":"2024-09-17T05:37:46.058676+0000","last_peered":"2024-09-17T05:37:46.058676+0000","last_clean":"2024-09-17T05:37:46.058676+0000","last_became_active":"2024-09-17T05:37:46.058112+0000","last_became_peered":"2024-09-17T05:37:46.058112+0000","last_unstale":"2024-09-17T05:37:46.058676+0000","last_undegraded":"2024-09-17T05:37:46.058676+0000","last_fullsized":"2024-09-17T05:37:46.058676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:49.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696909+0000","last_change":"2024-09-17T05:37:46.048148+0000","last_active":"2024-09-17T05:37:47.696909+0000","last_peered":"2024-09-17T05:37:47.696909+0000","last_clean":"2024-09-17T05:37:47.696909+0000","last_became_active":"2024-09-17T05:37:46.047809+0000","last_became_peered":"2024-09-17T05:37:46.047809+0000","last_unstale":"2024-09-17T05:37:47.696909+0000","last_undegraded":"2024-09-17T05:37:47.696909+0000","last_fullsized":"2024-09-17T05:37:47.696909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:16.926041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043484+0000","last_change":"2024-09-17T05:37:45.043484+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043484+0000","last_undegraded":"2024-09-17T05:37:45.043484+0000","last_fullsized":"2024-09-17T05:37:45.043484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042502+0000","last_change":"2024-09-17T05:37:45.042502+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042502+0000","last_undegraded":"2024-09-17T05:37:45.042502+0000","last_fullsized":"2024-09-17T05:37:45.042502+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696453+0000","last_change":"2024-09-17T05:37:46.074957+0000","last_active":"2024-09-17T05:37:47.696453+0000","last_peered":"2024-09-17T05:37:47.696453+0000","last_clean":"2024-09-17T05:37:47.696453+0000","last_became_active":"2024-09-17T05:37:46.074636+0000","last_became_peered":"2024-09-17T05:37:46.074636+0000","last_unstale":"2024-09-17T05:37:47.696453+0000","last_undegraded":"2024-09-17T05:37:47.696453+0000","last_fullsized":"2024-09-17T05:37:47.696453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:29.802032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036682+0000","last_change":"2024-09-17T05:37:46.036682+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036682+0000","last_undegraded":"2024-09-17T05:37:46.036682+0000","last_fullsized":"2024-09-17T05:37:46.036682+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049975+0000","last_change":"2024-09-17T05:37:46.049975+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049975+0000","last_undegraded":"2024-09-17T05:37:46.049975+0000","last_fullsized":"2024-09-17T05:37:46.049975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697818+0000","last_change":"2024-09-17T05:37:46.059031+0000","last_active":"2024-09-17T05:37:47.697818+0000","last_peered":"2024-09-17T05:37:47.697818+0000","last_clean":"2024-09-17T05:37:47.697818+0000","last_became_active":"2024-09-17T05:37:46.058482+0000","last_became_peered":"2024-09-17T05:37:46.058482+0000","last_unstale":"2024-09-17T05:37:47.697818+0000","last_undegraded":"2024-09-17T05:37:47.697818+0000","last_fullsized":"2024-09-17T05:37:47.697818+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:57.156256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039922+0000","last_change":"2024-09-17T05:37:46.039922+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039922+0000","last_undegraded":"2024-09-17T05:37:46.039922+0000","last_fullsized":"2024-09-17T05:37:46.039922+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034741+0000","last_change":"2024-09-17T05:37:46.034741+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034741+0000","last_undegraded":"2024-09-17T05:37:46.034741+0000","last_fullsized":"2024-09-17T05:37:46.034741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046441+0000","last_change":"2024-09-17T05:37:46.046441+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046441+0000","last_undegraded":"2024-09-17T05:37:46.046441+0000","last_fullsized":"2024-09-17T05:37:46.046441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039359+0000","last_change":"2024-09-17T05:37:46.039359+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039359+0000","last_undegraded":"2024-09-17T05:37:46.039359+0000","last_fullsized":"2024-09-17T05:37:46.039359+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053120+0000","last_change":"2024-09-17T05:37:46.048168+0000","last_active":"2024-09-17T05:37:46.053120+0000","last_peered":"2024-09-17T05:37:46.053120+0000","last_clean":"2024-09-17T05:37:46.053120+0000","last_became_active":"2024-09-17T05:37:46.047785+0000","last_became_peered":"2024-09-17T05:37:46.047785+0000","last_unstale":"2024-09-17T05:37:46.053120+0000","last_undegraded":"2024-09-17T05:37:46.053120+0000","last_fullsized":"2024-09-17T05:37:46.053120+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:09.371434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057668+0000","last_change":"2024-09-17T05:37:46.057518+0000","last_active":"2024-09-17T05:37:46.057668+0000","last_peered":"2024-09-17T05:37:46.057668+0000","last_clean":"2024-09-17T05:37:46.057668+0000","last_became_active":"2024-09-17T05:37:46.057188+0000","last_became_peered":"2024-09-17T05:37:46.057188+0000","last_unstale":"2024-09-17T05:37:46.057668+0000","last_undegraded":"2024-09-17T05:37:46.057668+0000","last_fullsized":"2024-09-17T05:37:46.057668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:38.494638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055630+0000","last_change":"2024-09-17T05:37:46.055514+0000","last_active":"2024-09-17T05:37:46.055630+0000","last_peered":"2024-09-17T05:37:46.055630+0000","last_clean":"2024-09-17T05:37:46.055630+0000","last_became_active":"2024-09-17T05:37:46.055184+0000","last_became_peered":"2024-09-17T05:37:46.055184+0000","last_unstale":"2024-09-17T05:37:46.055630+0000","last_undegraded":"2024-09-17T05:37:46.055630+0000","last_fullsized":"2024-09-17T05:37:46.055630+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:36.128340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697508+0000","last_change":"2024-09-17T05:37:46.059902+0000","last_active":"2024-09-17T05:37:47.697508+0000","last_peered":"2024-09-17T05:37:47.697508+0000","last_clean":"2024-09-17T05:37:47.697508+0000","last_became_active":"2024-09-17T05:37:46.059620+0000","last_became_peered":"2024-09-17T05:37:46.059620+0000","last_unstale":"2024-09-17T05:37:47.697508+0000","last_undegraded":"2024-09-17T05:37:47.697508+0000","last_fullsized":"2024-09-17T05:37:47.697508+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:38.719755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035286+0000","last_change":"2024-09-17T05:37:46.035286+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035286+0000","last_undegraded":"2024-09-17T05:37:46.035286+0000","last_fullsized":"2024-09-17T05:37:46.035286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043615+0000","last_change":"2024-09-17T05:37:45.043615+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043615+0000","last_undegraded":"2024-09-17T05:37:45.043615+0000","last_fullsized":"2024-09-17T05:37:45.043615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046047+0000","last_change":"2024-09-17T05:37:46.046047+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046047+0000","last_undegraded":"2024-09-17T05:37:46.046047+0000","last_fullsized":"2024-09-17T05:37:46.046047+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696657+0000","last_change":"2024-09-17T05:37:46.069098+0000","last_active":"2024-09-17T05:37:47.696657+0000","last_peered":"2024-09-17T05:37:47.696657+0000","last_clean":"2024-09-17T05:37:47.696657+0000","last_became_active":"2024-09-17T05:37:46.068168+0000","last_became_peered":"2024-09-17T05:37:46.068168+0000","last_unstale":"2024-09-17T05:37:47.696657+0000","last_undegraded":"2024-09-17T05:37:47.696657+0000","last_fullsized":"2024-09-17T05:37:47.696657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:47.470382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045326+0000","last_change":"2024-09-17T05:37:46.040392+0000","last_active":"2024-09-17T05:37:46.045326+0000","last_peered":"2024-09-17T05:37:46.045326+0000","last_clean":"2024-09-17T05:37:46.045326+0000","last_became_active":"2024-09-17T05:37:46.040050+0000","last_became_peered":"2024-09-17T05:37:46.040050+0000","last_unstale":"2024-09-17T05:37:46.045326+0000","last_undegraded":"2024-09-17T05:37:46.045326+0000","last_fullsized":"2024-09-17T05:37:46.045326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:30.608968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052985+0000","last_change":"2024-09-17T05:37:46.046598+0000","last_active":"2024-09-17T05:37:46.052985+0000","last_peered":"2024-09-17T05:37:46.052985+0000","last_clean":"2024-09-17T05:37:46.052985+0000","last_became_active":"2024-09-17T05:37:46.045641+0000","last_became_peered":"2024-09-17T05:37:46.045641+0000","last_unstale":"2024-09-17T05:37:46.052985+0000","last_undegraded":"2024-09-17T05:37:46.052985+0000","last_fullsized":"2024-09-17T05:37:46.052985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:56.105991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.044226+0000","last_change":"2024-09-17T05:37:46.044226+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.044226+0000","last_undegraded":"2024-09-17T05:37:46.044226+0000","last_fullsized":"2024-09-17T05:37:46.044226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035350+0000","last_change":"2024-09-17T05:37:46.035350+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035350+0000","last_undegraded":"2024-09-17T05:37:46.035350+0000","last_fullsized":"2024-09-17T05:37:46.035350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056824+0000","last_change":"2024-09-17T05:37:45.050863+0000","last_active":"2024-09-17T05:37:45.056824+0000","last_peered":"2024-09-17T05:37:45.056824+0000","last_clean":"2024-09-17T05:37:45.056824+0000","last_became_active":"2024-09-17T05:37:45.050504+0000","last_became_peered":"2024-09-17T05:37:45.050504+0000","last_unstale":"2024-09-17T05:37:45.056824+0000","last_undegraded":"2024-09-17T05:37:45.056824+0000","last_fullsized":"2024-09-17T05:37:45.056824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:08.862087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.048391+0000","last_change":"2024-09-17T05:37:46.045999+0000","last_active":"2024-09-17T05:37:46.048391+0000","last_peered":"2024-09-17T05:37:46.048391+0000","last_clean":"2024-09-17T05:37:46.048391+0000","last_became_active":"2024-09-17T05:37:46.045674+0000","last_became_peered":"2024-09-17T05:37:46.045674+0000","last_unstale":"2024-09-17T05:37:46.048391+0000","last_undegraded":"2024-09-17T05:37:46.048391+0000","last_fullsized":"2024-09-17T05:37:46.048391+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:00.337771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070859+0000","last_change":"2024-09-17T05:37:45.065829+0000","last_active":"2024-09-17T05:37:45.070859+0000","last_peered":"2024-09-17T05:37:45.070859+0000","last_clean":"2024-09-17T05:37:45.070859+0000","last_became_active":"2024-09-17T05:37:45.065496+0000","last_became_peered":"2024-09-17T05:37:45.065496+0000","last_unstale":"2024-09-17T05:37:45.070859+0000","last_undegraded":"2024-09-17T05:37:45.070859+0000","last_fullsized":"2024-09-17T05:37:45.070859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.588632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036201+0000","last_change":"2024-09-17T05:37:46.036201+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036201+0000","last_undegraded":"2024-09-17T05:37:46.036201+0000","last_fullsized":"2024-09-17T05:37:46.036201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045479+0000","last_change":"2024-09-17T05:37:45.061814+0000","last_active":"2024-09-17T05:37:46.045479+0000","last_peered":"2024-09-17T05:37:46.045479+0000","last_clean":"2024-09-17T05:37:46.045479+0000","last_became_active":"2024-09-17T05:37:45.061436+0000","last_became_peered":"2024-09-17T05:37:45.061436+0000","last_unstale":"2024-09-17T05:37:46.045479+0000","last_undegraded":"2024-09-17T05:37:46.045479+0000","last_fullsized":"2024-09-17T05:37:46.045479+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:21.256652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051721+0000","last_change":"2024-09-17T05:37:46.045530+0000","last_active":"2024-09-17T05:37:46.051721+0000","last_peered":"2024-09-17T05:37:46.051721+0000","last_clean":"2024-09-17T05:37:46.051721+0000","last_became_active":"2024-09-17T05:37:46.044880+0000","last_became_peered":"2024-09-17T05:37:46.044880+0000","last_unstale":"2024-09-17T05:37:46.051721+0000","last_undegraded":"2024-09-17T05:37:46.051721+0000","last_fullsized":"2024-09-17T05:37:46.051721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:30.249849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047610+0000","last_change":"2024-09-17T05:37:45.054678+0000","last_active":"2024-09-17T05:37:46.047610+0000","last_peered":"2024-09-17T05:37:46.047610+0000","last_clean":"2024-09-17T05:37:46.047610+0000","last_became_active":"2024-09-17T05:37:45.053608+0000","last_became_peered":"2024-09-17T05:37:45.053608+0000","last_unstale":"2024-09-17T05:37:46.047610+0000","last_undegraded":"2024-09-17T05:37:46.047610+0000","last_fullsized":"2024-09-17T05:37:46.047610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039722+0000","last_change":"2024-09-17T05:37:45.039722+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039722+0000","last_undegraded":"2024-09-17T05:37:45.039722+0000","last_fullsized":"2024-09-17T05:37:45.039722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036323+0000","last_change":"2024-09-17T05:37:45.056140+0000","last_active":"2024-09-17T05:37:46.036323+0000","last_peered":"2024-09-17T05:37:46.036323+0000","last_clean":"2024-09-17T05:37:46.036323+0000","last_became_active":"2024-09-17T05:37:45.055568+0000","last_became_peered":"2024-09-17T05:37:45.055568+0000","last_unstale":"2024-09-17T05:37:46.036323+0000","last_undegraded":"2024-09-17T05:37:46.036323+0000","last_fullsized":"2024-09-17T05:37:46.036323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:29.119041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035830+0000","last_change":"2024-09-17T05:37:46.035830+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035830+0000","last_undegraded":"2024-09-17T05:37:46.035830+0000","last_fullsized":"2024-09-17T05:37:46.035830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036562+0000","last_change":"2024-09-17T05:37:45.057805+0000","last_active":"2024-09-17T05:37:46.036562+0000","last_peered":"2024-09-17T05:37:46.036562+0000","last_clean":"2024-09-17T05:37:46.036562+0000","last_became_active":"2024-09-17T05:37:45.057474+0000","last_became_peered":"2024-09-17T05:37:45.057474+0000","last_unstale":"2024-09-17T05:37:46.036562+0000","last_undegraded":"2024-09-17T05:37:46.036562+0000","last_fullsized":"2024-09-17T05:37:46.036562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:11.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.062330+0000","last_change":"2024-09-17T05:37:46.057006+0000","last_active":"2024-09-17T05:37:46.062330+0000","last_peered":"2024-09-17T05:37:46.062330+0000","last_clean":"2024-09-17T05:37:46.062330+0000","last_became_active":"2024-09-17T05:37:46.056679+0000","last_became_peered":"2024-09-17T05:37:46.056679+0000","last_unstale":"2024-09-17T05:37:46.062330+0000","last_undegraded":"2024-09-17T05:37:46.062330+0000","last_fullsized":"2024-09-17T05:37:46.062330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:16.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037442+0000","last_change":"2024-09-17T05:37:45.055516+0000","last_active":"2024-09-17T05:37:46.037442+0000","last_peered":"2024-09-17T05:37:46.037442+0000","last_clean":"2024-09-17T05:37:46.037442+0000","last_became_active":"2024-09-17T05:37:45.055191+0000","last_became_peered":"2024-09-17T05:37:45.055191+0000","last_unstale":"2024-09-17T05:37:46.037442+0000","last_undegraded":"2024-09-17T05:37:46.037442+0000","last_fullsized":"2024-09-17T05:37:46.037442+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:50.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040514+0000","last_change":"2024-09-17T05:37:46.040514+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040514+0000","last_undegraded":"2024-09-17T05:37:46.040514+0000","last_fullsized":"2024-09-17T05:37:46.040514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035127+0000","last_change":"2024-09-17T05:37:45.051689+0000","last_active":"2024-09-17T05:37:46.035127+0000","last_peered":"2024-09-17T05:37:46.035127+0000","last_clean":"2024-09-17T05:37:46.035127+0000","last_became_active":"2024-09-17T05:37:45.051347+0000","last_became_peered":"2024-09-17T05:37:45.051347+0000","last_unstale":"2024-09-17T05:37:46.035127+0000","last_undegraded":"2024-09-17T05:37:46.035127+0000","last_fullsized":"2024-09-17T05:37:46.035127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:18.596842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039438+0000","last_change":"2024-09-17T05:37:45.039438+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039438+0000","last_undegraded":"2024-09-17T05:37:45.039438+0000","last_fullsized":"2024-09-17T05:37:45.039438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040896+0000","last_change":"2024-09-17T05:37:45.052131+0000","last_active":"2024-09-17T05:37:46.040896+0000","last_peered":"2024-09-17T05:37:46.040896+0000","last_clean":"2024-09-17T05:37:46.040896+0000","last_became_active":"2024-09-17T05:37:45.051781+0000","last_became_peered":"2024-09-17T05:37:45.051781+0000","last_unstale":"2024-09-17T05:37:46.040896+0000","last_undegraded":"2024-09-17T05:37:46.040896+0000","last_fullsized":"2024-09-17T05:37:46.040896+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:29.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039328+0000","last_change":"2024-09-17T05:37:46.039328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039328+0000","last_undegraded":"2024-09-17T05:37:46.039328+0000","last_fullsized":"2024-09-17T05:37:46.039328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040265+0000","last_change":"2024-09-17T05:37:45.064805+0000","last_active":"2024-09-17T05:37:46.040265+0000","last_peered":"2024-09-17T05:37:46.040265+0000","last_clean":"2024-09-17T05:37:46.040265+0000","last_became_active":"2024-09-17T05:37:45.064425+0000","last_became_peered":"2024-09-17T05:37:45.064425+0000","last_unstale":"2024-09-17T05:37:46.040265+0000","last_undegraded":"2024-09-17T05:37:46.040265+0000","last_fullsized":"2024-09-17T05:37:46.040265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696514+0000","last_change":"2024-09-17T05:37:46.064206+0000","last_active":"2024-09-17T05:37:47.696514+0000","last_peered":"2024-09-17T05:37:47.696514+0000","last_clean":"2024-09-17T05:37:47.696514+0000","last_became_active":"2024-09-17T05:37:46.054901+0000","last_became_peered":"2024-09-17T05:37:46.054901+0000","last_unstale":"2024-09-17T05:37:47.696514+0000","last_undegraded":"2024-09-17T05:37:47.696514+0000","last_fullsized":"2024-09-17T05:37:47.696514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:00.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036261+0000","last_change":"2024-09-17T05:37:45.059681+0000","last_active":"2024-09-17T05:37:46.036261+0000","last_peered":"2024-09-17T05:37:46.036261+0000","last_clean":"2024-09-17T05:37:46.036261+0000","last_became_active":"2024-09-17T05:37:45.059319+0000","last_became_peered":"2024-09-17T05:37:45.059319+0000","last_unstale":"2024-09-17T05:37:46.036261+0000","last_undegraded":"2024-09-17T05:37:46.036261+0000","last_fullsized":"2024-09-17T05:37:46.036261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:32.941882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047638+0000","last_change":"2024-09-17T05:37:46.047638+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047638+0000","last_undegraded":"2024-09-17T05:37:46.047638+0000","last_fullsized":"2024-09-17T05:37:46.047638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'5","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045140+0000","last_change":"2024-09-17T05:37:45.055492+0000","last_active":"2024-09-17T05:37:46.045140+0000","last_peered":"2024-09-17T05:37:46.045140+0000","last_clean":"2024-09-17T05:37:46.045140+0000","last_became_active":"2024-09-17T05:37:45.054184+0000","last_became_peered":"2024-09-17T05:37:45.054184+0000","last_unstale":"2024-09-17T05:37:46.045140+0000","last_undegraded":"2024-09-17T05:37:46.045140+0000","last_fullsized":"2024-09-17T05:37:46.045140+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:33.159363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057435+0000","last_change":"2024-09-17T05:37:46.057339+0000","last_active":"2024-09-17T05:37:46.057435+0000","last_peered":"2024-09-17T05:37:46.057435+0000","last_clean":"2024-09-17T05:37:46.057435+0000","last_became_active":"2024-09-17T05:37:46.057017+0000","last_became_peered":"2024-09-17T05:37:46.057017+0000","last_unstale":"2024-09-17T05:37:46.057435+0000","last_undegraded":"2024-09-17T05:37:46.057435+0000","last_fullsized":"2024-09-17T05:37:46.057435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:23.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.071346+0000","last_change":"2024-09-17T05:37:45.069218+0000","last_active":"2024-09-17T05:37:45.071346+0000","last_peered":"2024-09-17T05:37:45.071346+0000","last_clean":"2024-09-17T05:37:45.071346+0000","last_became_active":"2024-09-17T05:37:45.068997+0000","last_became_peered":"2024-09-17T05:37:45.068997+0000","last_unstale":"2024-09-17T05:37:45.071346+0000","last_undegraded":"2024-09-17T05:37:45.071346+0000","last_fullsized":"2024-09-17T05:37:45.071346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:47.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696941+0000","last_change":"2024-09-17T05:37:46.076000+0000","last_active":"2024-09-17T05:37:47.696941+0000","last_peered":"2024-09-17T05:37:47.696941+0000","last_clean":"2024-09-17T05:37:47.696941+0000","last_became_active":"2024-09-17T05:37:46.075703+0000","last_became_peered":"2024-09-17T05:37:46.075703+0000","last_unstale":"2024-09-17T05:37:47.696941+0000","last_undegraded":"2024-09-17T05:37:47.696941+0000","last_fullsized":"2024-09-17T05:37:47.696941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:13.038600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.039483+0000","last_change":"2024-09-17T05:37:45.059842+0000","last_active":"2024-09-17T05:37:46.039483+0000","last_peered":"2024-09-17T05:37:46.039483+0000","last_clean":"2024-09-17T05:37:46.039483+0000","last_became_active":"2024-09-17T05:37:45.059402+0000","last_became_peered":"2024-09-17T05:37:45.059402+0000","last_unstale":"2024-09-17T05:37:46.039483+0000","last_undegraded":"2024-09-17T05:37:46.039483+0000","last_fullsized":"2024-09-17T05:37:46.039483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:43.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043992+0000","last_change":"2024-09-17T05:37:45.043992+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043992+0000","last_undegraded":"2024-09-17T05:37:45.043992+0000","last_fullsized":"2024-09-17T05:37:45.043992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056507+0000","last_change":"2024-09-17T05:37:45.053989+0000","last_active":"2024-09-17T05:37:45.056507+0000","last_peered":"2024-09-17T05:37:45.056507+0000","last_clean":"2024-09-17T05:37:45.056507+0000","last_became_active":"2024-09-17T05:37:45.053641+0000","last_became_peered":"2024-09-17T05:37:45.053641+0000","last_unstale":"2024-09-17T05:37:45.056507+0000","last_undegraded":"2024-09-17T05:37:45.056507+0000","last_fullsized":"2024-09-17T05:37:45.056507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:28.048481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053848+0000","last_change":"2024-09-17T05:37:46.049142+0000","last_active":"2024-09-17T05:37:46.053848+0000","last_peered":"2024-09-17T05:37:46.053848+0000","last_clean":"2024-09-17T05:37:46.053848+0000","last_became_active":"2024-09-17T05:37:46.047150+0000","last_became_peered":"2024-09-17T05:37:46.047150+0000","last_unstale":"2024-09-17T05:37:46.053848+0000","last_undegraded":"2024-09-17T05:37:46.053848+0000","last_fullsized":"2024-09-17T05:37:46.053848+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:05.829528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.050418+0000","last_change":"2024-09-17T05:37:45.066676+0000","last_active":"2024-09-17T05:37:46.050418+0000","last_peered":"2024-09-17T05:37:46.050418+0000","last_clean":"2024-09-17T05:37:46.050418+0000","last_became_active":"2024-09-17T05:37:45.065923+0000","last_became_peered":"2024-09-17T05:37:45.065923+0000","last_unstale":"2024-09-17T05:37:46.050418+0000","last_undegraded":"2024-09-17T05:37:46.050418+0000","last_fullsized":"2024-09-17T05:37:46.050418+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.741795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052777+0000","last_change":"2024-09-17T05:37:46.049677+0000","last_active":"2024-09-17T05:37:46.052777+0000","last_peered":"2024-09-17T05:37:46.052777+0000","last_clean":"2024-09-17T05:37:46.052777+0000","last_became_active":"2024-09-17T05:37:46.049320+0000","last_became_peered":"2024-09-17T05:37:46.049320+0000","last_unstale":"2024-09-17T05:37:46.052777+0000","last_undegraded":"2024-09-17T05:37:46.052777+0000","last_fullsized":"2024-09-17T05:37:46.052777+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:43.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070891+0000","last_change":"2024-09-17T05:37:45.066669+0000","last_active":"2024-09-17T05:37:45.070891+0000","last_peered":"2024-09-17T05:37:45.070891+0000","last_clean":"2024-09-17T05:37:45.070891+0000","last_became_active":"2024-09-17T05:37:45.065484+0000","last_became_peered":"2024-09-17T05:37:45.065484+0000","last_unstale":"2024-09-17T05:37:45.070891+0000","last_undegraded":"2024-09-17T05:37:45.070891+0000","last_fullsized":"2024-09-17T05:37:45.070891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:18.322336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696374+0000","last_change":"2024-09-17T05:37:46.065321+0000","last_active":"2024-09-17T05:37:47.696374+0000","last_peered":"2024-09-17T05:37:47.696374+0000","last_clean":"2024-09-17T05:37:47.696374+0000","last_became_active":"2024-09-17T05:37:46.056405+0000","last_became_peered":"2024-09-17T05:37:46.056405+0000","last_unstale":"2024-09-17T05:37:47.696374+0000","last_undegraded":"2024-09-17T05:37:47.696374+0000","last_fullsized":"2024-09-17T05:37:47.696374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.795082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.068109+0000","last_change":"2024-09-17T05:37:45.065048+0000","last_active":"2024-09-17T05:37:45.068109+0000","last_peered":"2024-09-17T05:37:45.068109+0000","last_clean":"2024-09-17T05:37:45.068109+0000","last_became_active":"2024-09-17T05:37:45.064525+0000","last_became_peered":"2024-09-17T05:37:45.064525+0000","last_unstale":"2024-09-17T05:37:45.068109+0000","last_undegraded":"2024-09-17T05:37:45.068109+0000","last_fullsized":"2024-09-17T05:37:45.068109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:21.117699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.050303+0000","last_change":"2024-09-17T05:37:46.050303+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.050303+0000","last_undegraded":"2024-09-17T05:37:46.050303+0000","last_fullsized":"2024-09-17T05:37:46.050303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040173+0000","last_change":"2024-09-17T05:37:45.054993+0000","last_active":"2024-09-17T05:37:46.040173+0000","last_peered":"2024-09-17T05:37:46.040173+0000","last_clean":"2024-09-17T05:37:46.040173+0000","last_became_active":"2024-09-17T05:37:45.054655+0000","last_became_peered":"2024-09-17T05:37:45.054655+0000","last_unstale":"2024-09-17T05:37:46.040173+0000","last_undegraded":"2024-09-17T05:37:46.040173+0000","last_fullsized":"2024-09-17T05:37:46.040173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043135+0000","last_change":"2024-09-17T05:37:45.043135+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043135+0000","last_undegraded":"2024-09-17T05:37:45.043135+0000","last_fullsized":"2024-09-17T05:37:45.043135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.049698+0000","last_change":"2024-09-17T05:37:45.061423+0000","last_active":"2024-09-17T05:37:46.049698+0000","last_peered":"2024-09-17T05:37:46.049698+0000","last_clean":"2024-09-17T05:37:46.049698+0000","last_became_active":"2024-09-17T05:37:45.061101+0000","last_became_peered":"2024-09-17T05:37:45.061101+0000","last_unstale":"2024-09-17T05:37:46.049698+0000","last_undegraded":"2024-09-17T05:37:46.049698+0000","last_fullsized":"2024-09-17T05:37:46.049698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.045646+0000","last_change":"2024-09-17T05:37:46.045646+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.045646+0000","last_undegraded":"2024-09-17T05:37:46.045646+0000","last_fullsized":"2024-09-17T05:37:46.045646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696422+0000","last_change":"2024-09-17T05:37:45.059259+0000","last_active":"2024-09-17T05:37:47.696422+0000","last_peered":"2024-09-17T05:37:47.696422+0000","last_clean":"2024-09-17T05:37:47.696422+0000","last_became_active":"2024-09-17T05:37:45.058953+0000","last_became_peered":"2024-09-17T05:37:45.058953+0000","last_unstale":"2024-09-17T05:37:47.696422+0000","last_undegraded":"2024-09-17T05:37:47.696422+0000","last_fullsized":"2024-09-17T05:37:47.696422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:43.576998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039765+0000","last_change":"2024-09-17T05:37:46.039765+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039765+0000","last_undegraded":"2024-09-17T05:37:46.039765+0000","last_fullsized":"2024-09-17T05:37:46.039765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035716+0000","last_change":"2024-09-17T05:37:45.051009+0000","last_active":"2024-09-17T05:37:46.035716+0000","last_peered":"2024-09-17T05:37:46.035716+0000","last_clean":"2024-09-17T05:37:46.035716+0000","last_became_active":"2024-09-17T05:37:45.049848+0000","last_became_peered":"2024-09-17T05:37:45.049848+0000","last_unstale":"2024-09-17T05:37:46.035716+0000","last_undegraded":"2024-09-17T05:37:46.035716+0000","last_fullsized":"2024-09-17T05:37:46.035716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.903947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696998+0000","last_change":"2024-09-17T05:37:46.057468+0000","last_active":"2024-09-17T05:37:47.696998+0000","last_peered":"2024-09-17T05:37:47.696998+0000","last_clean":"2024-09-17T05:37:47.696998+0000","last_became_active":"2024-09-17T05:37:46.057127+0000","last_became_peered":"2024-09-17T05:37:46.057127+0000","last_unstale":"2024-09-17T05:37:47.696998+0000","last_undegraded":"2024-09-17T05:37:47.696998+0000","last_fullsized":"2024-09-17T05:37:47.696998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:46.077247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044481+0000","last_change":"2024-09-17T05:37:45.060323+0000","last_active":"2024-09-17T05:37:46.044481+0000","last_peered":"2024-09-17T05:37:46.044481+0000","last_clean":"2024-09-17T05:37:46.044481+0000","last_became_active":"2024-09-17T05:37:45.059994+0000","last_became_peered":"2024-09-17T05:37:45.059994+0000","last_unstale":"2024-09-17T05:37:46.044481+0000","last_undegraded":"2024-09-17T05:37:46.044481+0000","last_fullsized":"2024-09-17T05:37:46.044481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:48.441696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042857+0000","last_change":"2024-09-17T05:37:45.042857+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042857+0000","last_undegraded":"2024-09-17T05:37:45.042857+0000","last_fullsized":"2024-09-17T05:37:45.042857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044576+0000","last_change":"2024-09-17T05:37:45.059701+0000","last_active":"2024-09-17T05:37:46.044576+0000","last_peered":"2024-09-17T05:37:46.044576+0000","last_clean":"2024-09-17T05:37:46.044576+0000","last_became_active":"2024-09-17T05:37:45.059353+0000","last_became_peered":"2024-09-17T05:37:45.059353+0000","last_unstale":"2024-09-17T05:37:46.044576+0000","last_undegraded":"2024-09-17T05:37:46.044576+0000","last_fullsized":"2024-09-17T05:37:46.044576+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:05.240575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.037570+0000","last_change":"2024-09-17T05:37:46.037570+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.037570+0000","last_undegraded":"2024-09-17T05:37:46.037570+0000","last_fullsized":"2024-09-17T05:37:46.037570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035670+0000","last_change":"2024-09-17T05:37:45.055888+0000","last_active":"2024-09-17T05:37:46.035670+0000","last_peered":"2024-09-17T05:37:46.035670+0000","last_clean":"2024-09-17T05:37:46.035670+0000","last_became_active":"2024-09-17T05:37:45.055540+0000","last_became_peered":"2024-09-17T05:37:45.055540+0000","last_unstale":"2024-09-17T05:37:46.035670+0000","last_undegraded":"2024-09-17T05:37:46.035670+0000","last_fullsized":"2024-09-17T05:37:46.035670+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:05.374513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051136+0000","last_change":"2024-09-17T05:37:46.045881+0000","last_active":"2024-09-17T05:37:46.051136+0000","last_peered":"2024-09-17T05:37:46.051136+0000","last_clean":"2024-09-17T05:37:46.051136+0000","last_became_active":"2024-09-17T05:37:46.045557+0000","last_became_peered":"2024-09-17T05:37:46.045557+0000","last_unstale":"2024-09-17T05:37:46.051136+0000","last_undegraded":"2024-09-17T05:37:46.051136+0000","last_fullsized":"2024-09-17T05:37:46.051136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:59.076270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036315+0000","last_change":"2024-09-17T05:37:45.059449+0000","last_active":"2024-09-17T05:37:46.036315+0000","last_peered":"2024-09-17T05:37:46.036315+0000","last_clean":"2024-09-17T05:37:46.036315+0000","last_became_active":"2024-09-17T05:37:45.059104+0000","last_became_peered":"2024-09-17T05:37:45.059104+0000","last_unstale":"2024-09-17T05:37:46.036315+0000","last_undegraded":"2024-09-17T05:37:46.036315+0000","last_fullsized":"2024-09-17T05:37:46.036315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:52.588122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034593+0000","last_change":"2024-09-17T05:37:46.034593+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034593+0000","last_undegraded":"2024-09-17T05:37:46.034593+0000","last_fullsized":"2024-09-17T05:37:46.034593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.034994+0000","last_change":"2024-09-17T05:37:45.054509+0000","last_active":"2024-09-17T05:37:46.034994+0000","last_peered":"2024-09-17T05:37:46.034994+0000","last_clean":"2024-09-17T05:37:46.034994+0000","last_became_active":"2024-09-17T05:37:45.053870+0000","last_became_peered":"2024-09-17T05:37:45.053870+0000","last_unstale":"2024-09-17T05:37:46.034994+0000","last_undegraded":"2024-09-17T05:37:46.034994+0000","last_fullsized":"2024-09-17T05:37:46.034994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:11.666015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.054631+0000","last_change":"2024-09-17T05:37:46.052311+0000","last_active":"2024-09-17T05:37:46.054631+0000","last_peered":"2024-09-17T05:37:46.054631+0000","last_clean":"2024-09-17T05:37:46.054631+0000","last_became_active":"2024-09-17T05:37:46.051132+0000","last_became_peered":"2024-09-17T05:37:46.051132+0000","last_unstale":"2024-09-17T05:37:46.054631+0000","last_undegraded":"2024-09-17T05:37:46.054631+0000","last_fullsized":"2024-09-17T05:37:46.054631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:01.273341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047446+0000","last_change":"2024-09-17T05:37:45.058306+0000","last_active":"2024-09-17T05:37:46.047446+0000","last_peered":"2024-09-17T05:37:46.047446+0000","last_clean":"2024-09-17T05:37:46.047446+0000","last_became_active":"2024-09-17T05:37:45.057732+0000","last_became_peered":"2024-09-17T05:37:45.057732+0000","last_unstale":"2024-09-17T05:37:46.047446+0000","last_undegraded":"2024-09-17T05:37:46.047446+0000","last_fullsized":"2024-09-17T05:37:46.047446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:05.460762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.051599+0000","last_change":"2024-09-17T05:37:46.051599+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.051599+0000","last_undegraded":"2024-09-17T05:37:46.051599+0000","last_fullsized":"2024-09-17T05:37:46.051599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035840+0000","last_change":"2024-09-17T05:37:45.056408+0000","last_active":"2024-09-17T05:37:46.035840+0000","last_peered":"2024-09-17T05:37:46.035840+0000","last_clean":"2024-09-17T05:37:46.035840+0000","last_became_active":"2024-09-17T05:37:45.055291+0000","last_became_peered":"2024-09-17T05:37:45.055291+0000","last_unstale":"2024-09-17T05:37:46.035840+0000","last_undegraded":"2024-09-17T05:37:46.035840+0000","last_fullsized":"2024-09-17T05:37:46.035840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:59.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058363+0000","last_change":"2024-09-17T05:37:46.044901+0000","last_active":"2024-09-17T05:37:46.058363+0000","last_peered":"2024-09-17T05:37:46.058363+0000","last_clean":"2024-09-17T05:37:46.058363+0000","last_became_active":"2024-09-17T05:37:46.044421+0000","last_became_peered":"2024-09-17T05:37:46.044421+0000","last_unstale":"2024-09-17T05:37:46.058363+0000","last_undegraded":"2024-09-17T05:37:46.058363+0000","last_fullsized":"2024-09-17T05:37:46.058363+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:56.386485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.048866+0000","last_change":"2024-09-17T05:37:45.041226+0000","last_active":"2024-09-17T05:37:45.048866+0000","last_peered":"2024-09-17T05:37:45.048866+0000","last_clean":"2024-09-17T05:37:45.048866+0000","last_became_active":"2024-09-17T05:37:45.040877+0000","last_became_peered":"2024-09-17T05:37:45.040877+0000","last_unstale":"2024-09-17T05:37:45.048866+0000","last_undegraded":"2024-09-17T05:37:45.048866+0000","last_fullsized":"2024-09-17T05:37:45.048866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:22.674745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043557+0000","last_change":"2024-09-17T05:37:45.043557+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043557+0000","last_undegraded":"2024-09-17T05:37:45.043557+0000","last_fullsized":"2024-09-17T05:37:45.043557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037803+0000","last_change":"2024-09-17T05:37:45.059880+0000","last_active":"2024-09-17T05:37:46.037803+0000","last_peered":"2024-09-17T05:37:46.037803+0000","last_clean":"2024-09-17T05:37:46.037803+0000","last_became_active":"2024-09-17T05:37:45.059556+0000","last_became_peered":"2024-09-17T05:37:45.059556+0000","last_unstale":"2024-09-17T05:37:46.037803+0000","last_undegraded":"2024-09-17T05:37:46.037803+0000","last_fullsized":"2024-09-17T05:37:46.037803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:11.126039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.040025+0000","last_change":"2024-09-17T05:37:45.040025+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.040025+0000","last_undegraded":"2024-09-17T05:37:45.040025+0000","last_fullsized":"2024-09-17T05:37:45.040025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045495+0000","last_change":"2024-09-17T05:37:45.058285+0000","last_active":"2024-09-17T05:37:46.045495+0000","last_peered":"2024-09-17T05:37:46.045495+0000","last_clean":"2024-09-17T05:37:46.045495+0000","last_became_active":"2024-09-17T05:37:45.056912+0000","last_became_peered":"2024-09-17T05:37:45.056912+0000","last_unstale":"2024-09-17T05:37:46.045495+0000","last_undegraded":"2024-09-17T05:37:46.045495+0000","last_fullsized":"2024-09-17T05:37:46.045495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:26.430306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":163,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037763+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:37:46.037763+0000","last_peered":"2024-09-17T05:37:46.037763+0000","last_clean":"2024-09-17T05:37:46.037763+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:37:46.037763+0000","last_undegraded":"2024-09-17T05:37:46.037763+0000","last_fullsized":"2024-09-17T05:37:46.037763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":585728,"data_stored":255602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:50.275 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:50.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 -- 172.21.15.44:0/915818907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 msgr2=0x7f33400b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 --2- 172.21.15.44:0/915818907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33400b1be0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3340073b70 tx=0x7f333001c5e0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 -- 172.21.15.44:0/915818907 shutdown_connections 2024-09-17T05:37:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 --2- 172.21.15.44:0/915818907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33400d1d00 0x7f33400cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 --2- 172.21.15.44:0/915818907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33400b1be0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 -- 172.21.15.44:0/915818907 >> 172.21.15.44:0/915818907 conn(0x7f33400b4240 msgr2=0x7f33400b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 -- 172.21.15.44:0/915818907 shutdown_connections 2024-09-17T05:37:50.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.470+0000 7f3347200640 1 -- 172.21.15.44:0/915818907 wait complete. 2024-09-17T05:37:50.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 Processor -- start 2024-09-17T05:37:50.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 -- start start 2024-09-17T05:37:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33400cf5b0 0x7f334015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33401520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33400d1d00 0x7f33400ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3340169ed0 con 0x7f33400d18f0 2024-09-17T05:37:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3340169d50 con 0x7f33400d1d00 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.474+0000 7f3347200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f334016a050 con 0x7f33400cf5b0 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33401520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33401520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60266/0 (socket says 172.21.15.44:60266) 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 -- 172.21.15.44:0/3703442831 learned_addr learned my addr 172.21.15.44:0/3703442831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f333fe00640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33400cf5b0 0x7f334015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3345200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33400d1d00 0x7f33400ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 -- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33400cf5b0 msgr2=0x7f334015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33400cf5b0 0x7f334015f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 -- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33400d1d00 msgr2=0x7f33400ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33400d1d00 0x7f33400ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 -- 172.21.15.44:0/3703442831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33401fa3c0 con 0x7f33400d18f0 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3345200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33400d1d00 0x7f33400ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3337e00640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33401520e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f332800b420 tx=0x7f332800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f333cc00640 1 -- 172.21.15.44:0/3703442831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328011830 con 0x7f33400d18f0 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f333cc00640 1 -- 172.21.15.44:0/3703442831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3328016070 con 0x7f33400d18f0 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f333cc00640 1 -- 172.21.15.44:0/3703442831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328011d60 con 0x7f33400d18f0 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33401fa6a0 con 0x7f33400d18f0 2024-09-17T05:37:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33401fac60 con 0x7f33400d18f0 2024-09-17T05:37:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33400b1be0 con 0x7f33400d18f0 2024-09-17T05:37:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.478+0000 7f333cc00640 1 -- 172.21.15.44:0/3703442831 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f332801b460 con 0x7f33400d18f0 2024-09-17T05:37:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.482+0000 7f333cc00640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f331c073200 0x7f331c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.482+0000 7f333cc00640 1 -- 172.21.15.44:0/3703442831 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f3328094050 con 0x7f33400d18f0 2024-09-17T05:37:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.482+0000 7f333fe00640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f331c073200 0x7f331c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.482+0000 7f333fe00640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f331c073200 0x7f331c075710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f33300af000 tx=0x7f33300b4040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.486+0000 7f333cc00640 1 -- 172.21.15.44:0/3703442831 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f332805eee0 con 0x7f33400d18f0 2024-09-17T05:37:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.658+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f334015c150 con 0x7f331c073200 2024-09-17T05:37:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.662+0000 7f333cc00640 1 -- 172.21.15.44:0/3703442831 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249153 (secure 0 0 0) 0x7f334015c150 con 0x7f331c073200 2024-09-17T05:37:50.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:37:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f331c073200 msgr2=0x7f331c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f331c073200 0x7f331c075710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f33300af000 tx=0x7f33300b4040 comp rx=0 tx=0).stop 2024-09-17T05:37:50.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 msgr2=0x7f33401520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33401520e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f332800b420 tx=0x7f332800b8e0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 shutdown_connections 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f331c073200 0x7f331c075710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33400d1d00 0x7f33400ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33400d18f0 0x7f33401520e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 --2- 172.21.15.44:0/3703442831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f33400cf5b0 0x7f334015f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 >> 172.21.15.44:0/3703442831 conn(0x7f33400b4240 msgr2=0x7f33400b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 shutdown_connections 2024-09-17T05:37:50.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.666+0000 7f3347200640 1 -- 172.21.15.44:0/3703442831 wait complete. 2024-09-17T05:37:50.687 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-17T05:37:50.281602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591130,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":132,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226104,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748616,"statfs":{"total":773094113280,"available":772862582784,"internally_reserved":0,"allocated":5816320,"data_stored":3189824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001587"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697288+0000","last_change":"2024-09-17T05:37:46.072522+0000","last_active":"2024-09-17T05:37:47.697288+0000","last_peered":"2024-09-17T05:37:47.697288+0000","last_clean":"2024-09-17T05:37:47.697288+0000","last_became_active":"2024-09-17T05:37:46.072094+0000","last_became_peered":"2024-09-17T05:37:46.072094+0000","last_unstale":"2024-09-17T05:37:47.697288+0000","last_undegraded":"2024-09-17T05:37:47.697288+0000","last_fullsized":"2024-09-17T05:37:47.697288+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:14.754849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049328+0000","last_change":"2024-09-17T05:37:46.049328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049328+0000","last_undegraded":"2024-09-17T05:37:46.049328+0000","last_fullsized":"2024-09-17T05:37:46.049328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055291+0000","last_change":"2024-09-17T05:37:46.050394+0000","last_active":"2024-09-17T05:37:46.055291+0000","last_peered":"2024-09-17T05:37:46.055291+0000","last_clean":"2024-09-17T05:37:46.055291+0000","last_became_active":"2024-09-17T05:37:46.050088+0000","last_became_peered":"2024-09-17T05:37:46.050088+0000","last_unstale":"2024-09-17T05:37:46.055291+0000","last_undegraded":"2024-09-17T05:37:46.055291+0000","last_fullsized":"2024-09-17T05:37:46.055291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:20.021978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040667+0000","last_change":"2024-09-17T05:37:46.040667+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040667+0000","last_undegraded":"2024-09-17T05:37:46.040667+0000","last_fullsized":"2024-09-17T05:37:46.040667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047608+0000","last_change":"2024-09-17T05:37:46.047608+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047608+0000","last_undegraded":"2024-09-17T05:37:46.047608+0000","last_fullsized":"2024-09-17T05:37:46.047608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042278+0000","last_change":"2024-09-17T05:37:45.042278+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042278+0000","last_undegraded":"2024-09-17T05:37:45.042278+0000","last_fullsized":"2024-09-17T05:37:45.042278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039644+0000","last_change":"2024-09-17T05:37:46.039644+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039644+0000","last_undegraded":"2024-09-17T05:37:46.039644+0000","last_fullsized":"2024-09-17T05:37:46.039644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049232+0000","last_change":"2024-09-17T05:37:46.049232+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049232+0000","last_undegraded":"2024-09-17T05:37:46.049232+0000","last_fullsized":"2024-09-17T05:37:46.049232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055932+0000","last_change":"2024-09-17T05:37:46.055821+0000","last_active":"2024-09-17T05:37:46.055932+0000","last_peered":"2024-09-17T05:37:46.055932+0000","last_clean":"2024-09-17T05:37:46.055932+0000","last_became_active":"2024-09-17T05:37:46.054639+0000","last_became_peered":"2024-09-17T05:37:46.054639+0000","last_unstale":"2024-09-17T05:37:46.055932+0000","last_undegraded":"2024-09-17T05:37:46.055932+0000","last_fullsized":"2024-09-17T05:37:46.055932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:58.176243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058676+0000","last_change":"2024-09-17T05:37:46.058567+0000","last_active":"2024-09-17T05:37:46.058676+0000","last_peered":"2024-09-17T05:37:46.058676+0000","last_clean":"2024-09-17T05:37:46.058676+0000","last_became_active":"2024-09-17T05:37:46.058112+0000","last_became_peered":"2024-09-17T05:37:46.058112+0000","last_unstale":"2024-09-17T05:37:46.058676+0000","last_undegraded":"2024-09-17T05:37:46.058676+0000","last_fullsized":"2024-09-17T05:37:46.058676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:49.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696909+0000","last_change":"2024-09-17T05:37:46.048148+0000","last_active":"2024-09-17T05:37:47.696909+0000","last_peered":"2024-09-17T05:37:47.696909+0000","last_clean":"2024-09-17T05:37:47.696909+0000","last_became_active":"2024-09-17T05:37:46.047809+0000","last_became_peered":"2024-09-17T05:37:46.047809+0000","last_unstale":"2024-09-17T05:37:47.696909+0000","last_undegraded":"2024-09-17T05:37:47.696909+0000","last_fullsized":"2024-09-17T05:37:47.696909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:16.926041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043484+0000","last_change":"2024-09-17T05:37:45.043484+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043484+0000","last_undegraded":"2024-09-17T05:37:45.043484+0000","last_fullsized":"2024-09-17T05:37:45.043484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042502+0000","last_change":"2024-09-17T05:37:45.042502+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042502+0000","last_undegraded":"2024-09-17T05:37:45.042502+0000","last_fullsized":"2024-09-17T05:37:45.042502+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696453+0000","last_change":"2024-09-17T05:37:46.074957+0000","last_active":"2024-09-17T05:37:47.696453+0000","last_peered":"2024-09-17T05:37:47.696453+0000","last_clean":"2024-09-17T05:37:47.696453+0000","last_became_active":"2024-09-17T05:37:46.074636+0000","last_became_peered":"2024-09-17T05:37:46.074636+0000","last_unstale":"2024-09-17T05:37:47.696453+0000","last_undegraded":"2024-09-17T05:37:47.696453+0000","last_fullsized":"2024-09-17T05:37:47.696453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:29.802032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036682+0000","last_change":"2024-09-17T05:37:46.036682+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036682+0000","last_undegraded":"2024-09-17T05:37:46.036682+0000","last_fullsized":"2024-09-17T05:37:46.036682+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049975+0000","last_change":"2024-09-17T05:37:46.049975+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049975+0000","last_undegraded":"2024-09-17T05:37:46.049975+0000","last_fullsized":"2024-09-17T05:37:46.049975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697818+0000","last_change":"2024-09-17T05:37:46.059031+0000","last_active":"2024-09-17T05:37:47.697818+0000","last_peered":"2024-09-17T05:37:47.697818+0000","last_clean":"2024-09-17T05:37:47.697818+0000","last_became_active":"2024-09-17T05:37:46.058482+0000","last_became_peered":"2024-09-17T05:37:46.058482+0000","last_unstale":"2024-09-17T05:37:47.697818+0000","last_undegraded":"2024-09-17T05:37:47.697818+0000","last_fullsized":"2024-09-17T05:37:47.697818+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:57.156256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039922+0000","last_change":"2024-09-17T05:37:46.039922+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039922+0000","last_undegraded":"2024-09-17T05:37:46.039922+0000","last_fullsized":"2024-09-17T05:37:46.039922+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034741+0000","last_change":"2024-09-17T05:37:46.034741+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034741+0000","last_undegraded":"2024-09-17T05:37:46.034741+0000","last_fullsized":"2024-09-17T05:37:46.034741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046441+0000","last_change":"2024-09-17T05:37:46.046441+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046441+0000","last_undegraded":"2024-09-17T05:37:46.046441+0000","last_fullsized":"2024-09-17T05:37:46.046441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039359+0000","last_change":"2024-09-17T05:37:46.039359+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039359+0000","last_undegraded":"2024-09-17T05:37:46.039359+0000","last_fullsized":"2024-09-17T05:37:46.039359+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053120+0000","last_change":"2024-09-17T05:37:46.048168+0000","last_active":"2024-09-17T05:37:46.053120+0000","last_peered":"2024-09-17T05:37:46.053120+0000","last_clean":"2024-09-17T05:37:46.053120+0000","last_became_active":"2024-09-17T05:37:46.047785+0000","last_became_peered":"2024-09-17T05:37:46.047785+0000","last_unstale":"2024-09-17T05:37:46.053120+0000","last_undegraded":"2024-09-17T05:37:46.053120+0000","last_fullsized":"2024-09-17T05:37:46.053120+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:09.371434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057668+0000","last_change":"2024-09-17T05:37:46.057518+0000","last_active":"2024-09-17T05:37:46.057668+0000","last_peered":"2024-09-17T05:37:46.057668+0000","last_clean":"2024-09-17T05:37:46.057668+0000","last_became_active":"2024-09-17T05:37:46.057188+0000","last_became_peered":"2024-09-17T05:37:46.057188+0000","last_unstale":"2024-09-17T05:37:46.057668+0000","last_undegraded":"2024-09-17T05:37:46.057668+0000","last_fullsized":"2024-09-17T05:37:46.057668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:38.494638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055630+0000","last_change":"2024-09-17T05:37:46.055514+0000","last_active":"2024-09-17T05:37:46.055630+0000","last_peered":"2024-09-17T05:37:46.055630+0000","last_clean":"2024-09-17T05:37:46.055630+0000","last_became_active":"2024-09-17T05:37:46.055184+0000","last_became_peered":"2024-09-17T05:37:46.055184+0000","last_unstale":"2024-09-17T05:37:46.055630+0000","last_undegraded":"2024-09-17T05:37:46.055630+0000","last_fullsized":"2024-09-17T05:37:46.055630+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:36.128340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697508+0000","last_change":"2024-09-17T05:37:46.059902+0000","last_active":"2024-09-17T05:37:47.697508+0000","last_peered":"2024-09-17T05:37:47.697508+0000","last_clean":"2024-09-17T05:37:47.697508+0000","last_became_active":"2024-09-17T05:37:46.059620+0000","last_became_peered":"2024-09-17T05:37:46.059620+0000","last_unstale":"2024-09-17T05:37:47.697508+0000","last_undegraded":"2024-09-17T05:37:47.697508+0000","last_fullsized":"2024-09-17T05:37:47.697508+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:38.719755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035286+0000","last_change":"2024-09-17T05:37:46.035286+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035286+0000","last_undegraded":"2024-09-17T05:37:46.035286+0000","last_fullsized":"2024-09-17T05:37:46.035286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043615+0000","last_change":"2024-09-17T05:37:45.043615+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043615+0000","last_undegraded":"2024-09-17T05:37:45.043615+0000","last_fullsized":"2024-09-17T05:37:45.043615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046047+0000","last_change":"2024-09-17T05:37:46.046047+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046047+0000","last_undegraded":"2024-09-17T05:37:46.046047+0000","last_fullsized":"2024-09-17T05:37:46.046047+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696657+0000","last_change":"2024-09-17T05:37:46.069098+0000","last_active":"2024-09-17T05:37:47.696657+0000","last_peered":"2024-09-17T05:37:47.696657+0000","last_clean":"2024-09-17T05:37:47.696657+0000","last_became_active":"2024-09-17T05:37:46.068168+0000","last_became_peered":"2024-09-17T05:37:46.068168+0000","last_unstale":"2024-09-17T05:37:47.696657+0000","last_undegraded":"2024-09-17T05:37:47.696657+0000","last_fullsized":"2024-09-17T05:37:47.696657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:47.470382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045326+0000","last_change":"2024-09-17T05:37:46.040392+0000","last_active":"2024-09-17T05:37:46.045326+0000","last_peered":"2024-09-17T05:37:46.045326+0000","last_clean":"2024-09-17T05:37:46.045326+0000","last_became_active":"2024-09-17T05:37:46.040050+0000","last_became_peered":"2024-09-17T05:37:46.040050+0000","last_unstale":"2024-09-17T05:37:46.045326+0000","last_undegraded":"2024-09-17T05:37:46.045326+0000","last_fullsized":"2024-09-17T05:37:46.045326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:30.608968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052985+0000","last_change":"2024-09-17T05:37:46.046598+0000","last_active":"2024-09-17T05:37:46.052985+0000","last_peered":"2024-09-17T05:37:46.052985+0000","last_clean":"2024-09-17T05:37:46.052985+0000","last_became_active":"2024-09-17T05:37:46.045641+0000","last_became_peered":"2024-09-17T05:37:46.045641+0000","last_unstale":"2024-09-17T05:37:46.052985+0000","last_undegraded":"2024-09-17T05:37:46.052985+0000","last_fullsized":"2024-09-17T05:37:46.052985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:56.105991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.044226+0000","last_change":"2024-09-17T05:37:46.044226+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.044226+0000","last_undegraded":"2024-09-17T05:37:46.044226+0000","last_fullsized":"2024-09-17T05:37:46.044226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035350+0000","last_change":"2024-09-17T05:37:46.035350+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035350+0000","last_undegraded":"2024-09-17T05:37:46.035350+0000","last_fullsized":"2024-09-17T05:37:46.035350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056824+0000","last_change":"2024-09-17T05:37:45.050863+0000","last_active":"2024-09-17T05:37:45.056824+0000","last_peered":"2024-09-17T05:37:45.056824+0000","last_clean":"2024-09-17T05:37:45.056824+0000","last_became_active":"2024-09-17T05:37:45.050504+0000","last_became_peered":"2024-09-17T05:37:45.050504+0000","last_unstale":"2024-09-17T05:37:45.056824+0000","last_undegraded":"2024-09-17T05:37:45.056824+0000","last_fullsized":"2024-09-17T05:37:45.056824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:08.862087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.048391+0000","last_change":"2024-09-17T05:37:46.045999+0000","last_active":"2024-09-17T05:37:46.048391+0000","last_peered":"2024-09-17T05:37:46.048391+0000","last_clean":"2024-09-17T05:37:46.048391+0000","last_became_active":"2024-09-17T05:37:46.045674+0000","last_became_peered":"2024-09-17T05:37:46.045674+0000","last_unstale":"2024-09-17T05:37:46.048391+0000","last_undegraded":"2024-09-17T05:37:46.048391+0000","last_fullsized":"2024-09-17T05:37:46.048391+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:00.337771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070859+0000","last_change":"2024-09-17T05:37:45.065829+0000","last_active":"2024-09-17T05:37:45.070859+0000","last_peered":"2024-09-17T05:37:45.070859+0000","last_clean":"2024-09-17T05:37:45.070859+0000","last_became_active":"2024-09-17T05:37:45.065496+0000","last_became_peered":"2024-09-17T05:37:45.065496+0000","last_unstale":"2024-09-17T05:37:45.070859+0000","last_undegraded":"2024-09-17T05:37:45.070859+0000","last_fullsized":"2024-09-17T05:37:45.070859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.588632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036201+0000","last_change":"2024-09-17T05:37:46.036201+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036201+0000","last_undegraded":"2024-09-17T05:37:46.036201+0000","last_fullsized":"2024-09-17T05:37:46.036201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045479+0000","last_change":"2024-09-17T05:37:45.061814+0000","last_active":"2024-09-17T05:37:46.045479+0000","last_peered":"2024-09-17T05:37:46.045479+0000","last_clean":"2024-09-17T05:37:46.045479+0000","last_became_active":"2024-09-17T05:37:45.061436+0000","last_became_peered":"2024-09-17T05:37:45.061436+0000","last_unstale":"2024-09-17T05:37:46.045479+0000","last_undegraded":"2024-09-17T05:37:46.045479+0000","last_fullsized":"2024-09-17T05:37:46.045479+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:21.256652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051721+0000","last_change":"2024-09-17T05:37:46.045530+0000","last_active":"2024-09-17T05:37:46.051721+0000","last_peered":"2024-09-17T05:37:46.051721+0000","last_clean":"2024-09-17T05:37:46.051721+0000","last_became_active":"2024-09-17T05:37:46.044880+0000","last_became_peered":"2024-09-17T05:37:46.044880+0000","last_unstale":"2024-09-17T05:37:46.051721+0000","last_undegraded":"2024-09-17T05:37:46.051721+0000","last_fullsized":"2024-09-17T05:37:46.051721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:30.249849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047610+0000","last_change":"2024-09-17T05:37:45.054678+0000","last_active":"2024-09-17T05:37:46.047610+0000","last_peered":"2024-09-17T05:37:46.047610+0000","last_clean":"2024-09-17T05:37:46.047610+0000","last_became_active":"2024-09-17T05:37:45.053608+0000","last_became_peered":"2024-09-17T05:37:45.053608+0000","last_unstale":"2024-09-17T05:37:46.047610+0000","last_undegraded":"2024-09-17T05:37:46.047610+0000","last_fullsized":"2024-09-17T05:37:46.047610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039722+0000","last_change":"2024-09-17T05:37:45.039722+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039722+0000","last_undegraded":"2024-09-17T05:37:45.039722+0000","last_fullsized":"2024-09-17T05:37:45.039722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036323+0000","last_change":"2024-09-17T05:37:45.056140+0000","last_active":"2024-09-17T05:37:46.036323+0000","last_peered":"2024-09-17T05:37:46.036323+0000","last_clean":"2024-09-17T05:37:46.036323+0000","last_became_active":"2024-09-17T05:37:45.055568+0000","last_became_peered":"2024-09-17T05:37:45.055568+0000","last_unstale":"2024-09-17T05:37:46.036323+0000","last_undegraded":"2024-09-17T05:37:46.036323+0000","last_fullsized":"2024-09-17T05:37:46.036323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:29.119041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035830+0000","last_change":"2024-09-17T05:37:46.035830+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035830+0000","last_undegraded":"2024-09-17T05:37:46.035830+0000","last_fullsized":"2024-09-17T05:37:46.035830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036562+0000","last_change":"2024-09-17T05:37:45.057805+0000","last_active":"2024-09-17T05:37:46.036562+0000","last_peered":"2024-09-17T05:37:46.036562+0000","last_clean":"2024-09-17T05:37:46.036562+0000","last_became_active":"2024-09-17T05:37:45.057474+0000","last_became_peered":"2024-09-17T05:37:45.057474+0000","last_unstale":"2024-09-17T05:37:46.036562+0000","last_undegraded":"2024-09-17T05:37:46.036562+0000","last_fullsized":"2024-09-17T05:37:46.036562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:11.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.062330+0000","last_change":"2024-09-17T05:37:46.057006+0000","last_active":"2024-09-17T05:37:46.062330+0000","last_peered":"2024-09-17T05:37:46.062330+0000","last_clean":"2024-09-17T05:37:46.062330+0000","last_became_active":"2024-09-17T05:37:46.056679+0000","last_became_peered":"2024-09-17T05:37:46.056679+0000","last_unstale":"2024-09-17T05:37:46.062330+0000","last_undegraded":"2024-09-17T05:37:46.062330+0000","last_fullsized":"2024-09-17T05:37:46.062330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:16.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037442+0000","last_change":"2024-09-17T05:37:45.055516+0000","last_active":"2024-09-17T05:37:46.037442+0000","last_peered":"2024-09-17T05:37:46.037442+0000","last_clean":"2024-09-17T05:37:46.037442+0000","last_became_active":"2024-09-17T05:37:45.055191+0000","last_became_peered":"2024-09-17T05:37:45.055191+0000","last_unstale":"2024-09-17T05:37:46.037442+0000","last_undegraded":"2024-09-17T05:37:46.037442+0000","last_fullsized":"2024-09-17T05:37:46.037442+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:50.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040514+0000","last_change":"2024-09-17T05:37:46.040514+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040514+0000","last_undegraded":"2024-09-17T05:37:46.040514+0000","last_fullsized":"2024-09-17T05:37:46.040514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035127+0000","last_change":"2024-09-17T05:37:45.051689+0000","last_active":"2024-09-17T05:37:46.035127+0000","last_peered":"2024-09-17T05:37:46.035127+0000","last_clean":"2024-09-17T05:37:46.035127+0000","last_became_active":"2024-09-17T05:37:45.051347+0000","last_became_peered":"2024-09-17T05:37:45.051347+0000","last_unstale":"2024-09-17T05:37:46.035127+0000","last_undegraded":"2024-09-17T05:37:46.035127+0000","last_fullsized":"2024-09-17T05:37:46.035127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:18.596842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039438+0000","last_change":"2024-09-17T05:37:45.039438+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039438+0000","last_undegraded":"2024-09-17T05:37:45.039438+0000","last_fullsized":"2024-09-17T05:37:45.039438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040896+0000","last_change":"2024-09-17T05:37:45.052131+0000","last_active":"2024-09-17T05:37:46.040896+0000","last_peered":"2024-09-17T05:37:46.040896+0000","last_clean":"2024-09-17T05:37:46.040896+0000","last_became_active":"2024-09-17T05:37:45.051781+0000","last_became_peered":"2024-09-17T05:37:45.051781+0000","last_unstale":"2024-09-17T05:37:46.040896+0000","last_undegraded":"2024-09-17T05:37:46.040896+0000","last_fullsized":"2024-09-17T05:37:46.040896+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:29.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039328+0000","last_change":"2024-09-17T05:37:46.039328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039328+0000","last_undegraded":"2024-09-17T05:37:46.039328+0000","last_fullsized":"2024-09-17T05:37:46.039328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040265+0000","last_change":"2024-09-17T05:37:45.064805+0000","last_active":"2024-09-17T05:37:46.040265+0000","last_peered":"2024-09-17T05:37:46.040265+0000","last_clean":"2024-09-17T05:37:46.040265+0000","last_became_active":"2024-09-17T05:37:45.064425+0000","last_became_peered":"2024-09-17T05:37:45.064425+0000","last_unstale":"2024-09-17T05:37:46.040265+0000","last_undegraded":"2024-09-17T05:37:46.040265+0000","last_fullsized":"2024-09-17T05:37:46.040265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696514+0000","last_change":"2024-09-17T05:37:46.064206+0000","last_active":"2024-09-17T05:37:47.696514+0000","last_peered":"2024-09-17T05:37:47.696514+0000","last_clean":"2024-09-17T05:37:47.696514+0000","last_became_active":"2024-09-17T05:37:46.054901+0000","last_became_peered":"2024-09-17T05:37:46.054901+0000","last_unstale":"2024-09-17T05:37:47.696514+0000","last_undegraded":"2024-09-17T05:37:47.696514+0000","last_fullsized":"2024-09-17T05:37:47.696514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:00.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036261+0000","last_change":"2024-09-17T05:37:45.059681+0000","last_active":"2024-09-17T05:37:46.036261+0000","last_peered":"2024-09-17T05:37:46.036261+0000","last_clean":"2024-09-17T05:37:46.036261+0000","last_became_active":"2024-09-17T05:37:45.059319+0000","last_became_peered":"2024-09-17T05:37:45.059319+0000","last_unstale":"2024-09-17T05:37:46.036261+0000","last_undegraded":"2024-09-17T05:37:46.036261+0000","last_fullsized":"2024-09-17T05:37:46.036261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:32.941882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047638+0000","last_change":"2024-09-17T05:37:46.047638+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047638+0000","last_undegraded":"2024-09-17T05:37:46.047638+0000","last_fullsized":"2024-09-17T05:37:46.047638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'5","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045140+0000","last_change":"2024-09-17T05:37:45.055492+0000","last_active":"2024-09-17T05:37:46.045140+0000","last_peered":"2024-09-17T05:37:46.045140+0000","last_clean":"2024-09-17T05:37:46.045140+0000","last_became_active":"2024-09-17T05:37:45.054184+0000","last_became_peered":"2024-09-17T05:37:45.054184+0000","last_unstale":"2024-09-17T05:37:46.045140+0000","last_undegraded":"2024-09-17T05:37:46.045140+0000","last_fullsized":"2024-09-17T05:37:46.045140+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:33.159363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057435+0000","last_change":"2024-09-17T05:37:46.057339+0000","last_active":"2024-09-17T05:37:46.057435+0000","last_peered":"2024-09-17T05:37:46.057435+0000","last_clean":"2024-09-17T05:37:46.057435+0000","last_became_active":"2024-09-17T05:37:46.057017+0000","last_became_peered":"2024-09-17T05:37:46.057017+0000","last_unstale":"2024-09-17T05:37:46.057435+0000","last_undegraded":"2024-09-17T05:37:46.057435+0000","last_fullsized":"2024-09-17T05:37:46.057435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:23.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.071346+0000","last_change":"2024-09-17T05:37:45.069218+0000","last_active":"2024-09-17T05:37:45.071346+0000","last_peered":"2024-09-17T05:37:45.071346+0000","last_clean":"2024-09-17T05:37:45.071346+0000","last_became_active":"2024-09-17T05:37:45.068997+0000","last_became_peered":"2024-09-17T05:37:45.068997+0000","last_unstale":"2024-09-17T05:37:45.071346+0000","last_undegraded":"2024-09-17T05:37:45.071346+0000","last_fullsized":"2024-09-17T05:37:45.071346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:47.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696941+0000","last_change":"2024-09-17T05:37:46.076000+0000","last_active":"2024-09-17T05:37:47.696941+0000","last_peered":"2024-09-17T05:37:47.696941+0000","last_clean":"2024-09-17T05:37:47.696941+0000","last_became_active":"2024-09-17T05:37:46.075703+0000","last_became_peered":"2024-09-17T05:37:46.075703+0000","last_unstale":"2024-09-17T05:37:47.696941+0000","last_undegraded":"2024-09-17T05:37:47.696941+0000","last_fullsized":"2024-09-17T05:37:47.696941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:13.038600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.039483+0000","last_change":"2024-09-17T05:37:45.059842+0000","last_active":"2024-09-17T05:37:46.039483+0000","last_peered":"2024-09-17T05:37:46.039483+0000","last_clean":"2024-09-17T05:37:46.039483+0000","last_became_active":"2024-09-17T05:37:45.059402+0000","last_became_peered":"2024-09-17T05:37:45.059402+0000","last_unstale":"2024-09-17T05:37:46.039483+0000","last_undegraded":"2024-09-17T05:37:46.039483+0000","last_fullsized":"2024-09-17T05:37:46.039483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:43.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043992+0000","last_change":"2024-09-17T05:37:45.043992+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043992+0000","last_undegraded":"2024-09-17T05:37:45.043992+0000","last_fullsized":"2024-09-17T05:37:45.043992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056507+0000","last_change":"2024-09-17T05:37:45.053989+0000","last_active":"2024-09-17T05:37:45.056507+0000","last_peered":"2024-09-17T05:37:45.056507+0000","last_clean":"2024-09-17T05:37:45.056507+0000","last_became_active":"2024-09-17T05:37:45.053641+0000","last_became_peered":"2024-09-17T05:37:45.053641+0000","last_unstale":"2024-09-17T05:37:45.056507+0000","last_undegraded":"2024-09-17T05:37:45.056507+0000","last_fullsized":"2024-09-17T05:37:45.056507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:28.048481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053848+0000","last_change":"2024-09-17T05:37:46.049142+0000","last_active":"2024-09-17T05:37:46.053848+0000","last_peered":"2024-09-17T05:37:46.053848+0000","last_clean":"2024-09-17T05:37:46.053848+0000","last_became_active":"2024-09-17T05:37:46.047150+0000","last_became_peered":"2024-09-17T05:37:46.047150+0000","last_unstale":"2024-09-17T05:37:46.053848+0000","last_undegraded":"2024-09-17T05:37:46.053848+0000","last_fullsized":"2024-09-17T05:37:46.053848+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:05.829528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.050418+0000","last_change":"2024-09-17T05:37:45.066676+0000","last_active":"2024-09-17T05:37:46.050418+0000","last_peered":"2024-09-17T05:37:46.050418+0000","last_clean":"2024-09-17T05:37:46.050418+0000","last_became_active":"2024-09-17T05:37:45.065923+0000","last_became_peered":"2024-09-17T05:37:45.065923+0000","last_unstale":"2024-09-17T05:37:46.050418+0000","last_undegraded":"2024-09-17T05:37:46.050418+0000","last_fullsized":"2024-09-17T05:37:46.050418+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.741795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052777+0000","last_change":"2024-09-17T05:37:46.049677+0000","last_active":"2024-09-17T05:37:46.052777+0000","last_peered":"2024-09-17T05:37:46.052777+0000","last_clean":"2024-09-17T05:37:46.052777+0000","last_became_active":"2024-09-17T05:37:46.049320+0000","last_became_peered":"2024-09-17T05:37:46.049320+0000","last_unstale":"2024-09-17T05:37:46.052777+0000","last_undegraded":"2024-09-17T05:37:46.052777+0000","last_fullsized":"2024-09-17T05:37:46.052777+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:43.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070891+0000","last_change":"2024-09-17T05:37:45.066669+0000","last_active":"2024-09-17T05:37:45.070891+0000","last_peered":"2024-09-17T05:37:45.070891+0000","last_clean":"2024-09-17T05:37:45.070891+0000","last_became_active":"2024-09-17T05:37:45.065484+0000","last_became_peered":"2024-09-17T05:37:45.065484+0000","last_unstale":"2024-09-17T05:37:45.070891+0000","last_undegraded":"2024-09-17T05:37:45.070891+0000","last_fullsized":"2024-09-17T05:37:45.070891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:18.322336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696374+0000","last_change":"2024-09-17T05:37:46.065321+0000","last_active":"2024-09-17T05:37:47.696374+0000","last_peered":"2024-09-17T05:37:47.696374+0000","last_clean":"2024-09-17T05:37:47.696374+0000","last_became_active":"2024-09-17T05:37:46.056405+0000","last_became_peered":"2024-09-17T05:37:46.056405+0000","last_unstale":"2024-09-17T05:37:47.696374+0000","last_undegraded":"2024-09-17T05:37:47.696374+0000","last_fullsized":"2024-09-17T05:37:47.696374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.795082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.068109+0000","last_change":"2024-09-17T05:37:45.065048+0000","last_active":"2024-09-17T05:37:45.068109+0000","last_peered":"2024-09-17T05:37:45.068109+0000","last_clean":"2024-09-17T05:37:45.068109+0000","last_became_active":"2024-09-17T05:37:45.064525+0000","last_became_peered":"2024-09-17T05:37:45.064525+0000","last_unstale":"2024-09-17T05:37:45.068109+0000","last_undegraded":"2024-09-17T05:37:45.068109+0000","last_fullsized":"2024-09-17T05:37:45.068109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:21.117699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.050303+0000","last_change":"2024-09-17T05:37:46.050303+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.050303+0000","last_undegraded":"2024-09-17T05:37:46.050303+0000","last_fullsized":"2024-09-17T05:37:46.050303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040173+0000","last_change":"2024-09-17T05:37:45.054993+0000","last_active":"2024-09-17T05:37:46.040173+0000","last_peered":"2024-09-17T05:37:46.040173+0000","last_clean":"2024-09-17T05:37:46.040173+0000","last_became_active":"2024-09-17T05:37:45.054655+0000","last_became_peered":"2024-09-17T05:37:45.054655+0000","last_unstale":"2024-09-17T05:37:46.040173+0000","last_undegraded":"2024-09-17T05:37:46.040173+0000","last_fullsized":"2024-09-17T05:37:46.040173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043135+0000","last_change":"2024-09-17T05:37:45.043135+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043135+0000","last_undegraded":"2024-09-17T05:37:45.043135+0000","last_fullsized":"2024-09-17T05:37:45.043135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.049698+0000","last_change":"2024-09-17T05:37:45.061423+0000","last_active":"2024-09-17T05:37:46.049698+0000","last_peered":"2024-09-17T05:37:46.049698+0000","last_clean":"2024-09-17T05:37:46.049698+0000","last_became_active":"2024-09-17T05:37:45.061101+0000","last_became_peered":"2024-09-17T05:37:45.061101+0000","last_unstale":"2024-09-17T05:37:46.049698+0000","last_undegraded":"2024-09-17T05:37:46.049698+0000","last_fullsized":"2024-09-17T05:37:46.049698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.045646+0000","last_change":"2024-09-17T05:37:46.045646+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.045646+0000","last_undegraded":"2024-09-17T05:37:46.045646+0000","last_fullsized":"2024-09-17T05:37:46.045646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696422+0000","last_change":"2024-09-17T05:37:45.059259+0000","last_active":"2024-09-17T05:37:47.696422+0000","last_peered":"2024-09-17T05:37:47.696422+0000","last_clean":"2024-09-17T05:37:47.696422+0000","last_became_active":"2024-09-17T05:37:45.058953+0000","last_became_peered":"2024-09-17T05:37:45.058953+0000","last_unstale":"2024-09-17T05:37:47.696422+0000","last_undegraded":"2024-09-17T05:37:47.696422+0000","last_fullsized":"2024-09-17T05:37:47.696422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:43.576998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039765+0000","last_change":"2024-09-17T05:37:46.039765+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039765+0000","last_undegraded":"2024-09-17T05:37:46.039765+0000","last_fullsized":"2024-09-17T05:37:46.039765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035716+0000","last_change":"2024-09-17T05:37:45.051009+0000","last_active":"2024-09-17T05:37:46.035716+0000","last_peered":"2024-09-17T05:37:46.035716+0000","last_clean":"2024-09-17T05:37:46.035716+0000","last_became_active":"2024-09-17T05:37:45.049848+0000","last_became_peered":"2024-09-17T05:37:45.049848+0000","last_unstale":"2024-09-17T05:37:46.035716+0000","last_undegraded":"2024-09-17T05:37:46.035716+0000","last_fullsized":"2024-09-17T05:37:46.035716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.903947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696998+0000","last_change":"2024-09-17T05:37:46.057468+0000","last_active":"2024-09-17T05:37:47.696998+0000","last_peered":"2024-09-17T05:37:47.696998+0000","last_clean":"2024-09-17T05:37:47.696998+0000","last_became_active":"2024-09-17T05:37:46.057127+0000","last_became_peered":"2024-09-17T05:37:46.057127+0000","last_unstale":"2024-09-17T05:37:47.696998+0000","last_undegraded":"2024-09-17T05:37:47.696998+0000","last_fullsized":"2024-09-17T05:37:47.696998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:46.077247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044481+0000","last_change":"2024-09-17T05:37:45.060323+0000","last_active":"2024-09-17T05:37:46.044481+0000","last_peered":"2024-09-17T05:37:46.044481+0000","last_clean":"2024-09-17T05:37:46.044481+0000","last_became_active":"2024-09-17T05:37:45.059994+0000","last_became_peered":"2024-09-17T05:37:45.059994+0000","last_unstale":"2024-09-17T05:37:46.044481+0000","last_undegraded":"2024-09-17T05:37:46.044481+0000","last_fullsized":"2024-09-17T05:37:46.044481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:48.441696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042857+0000","last_change":"2024-09-17T05:37:45.042857+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042857+0000","last_undegraded":"2024-09-17T05:37:45.042857+0000","last_fullsized":"2024-09-17T05:37:45.042857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044576+0000","last_change":"2024-09-17T05:37:45.059701+0000","last_active":"2024-09-17T05:37:46.044576+0000","last_peered":"2024-09-17T05:37:46.044576+0000","last_clean":"2024-09-17T05:37:46.044576+0000","last_became_active":"2024-09-17T05:37:45.059353+0000","last_became_peered":"2024-09-17T05:37:45.059353+0000","last_unstale":"2024-09-17T05:37:46.044576+0000","last_undegraded":"2024-09-17T05:37:46.044576+0000","last_fullsized":"2024-09-17T05:37:46.044576+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:05.240575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.037570+0000","last_change":"2024-09-17T05:37:46.037570+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.037570+0000","last_undegraded":"2024-09-17T05:37:46.037570+0000","last_fullsized":"2024-09-17T05:37:46.037570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035670+0000","last_change":"2024-09-17T05:37:45.055888+0000","last_active":"2024-09-17T05:37:46.035670+0000","last_peered":"2024-09-17T05:37:46.035670+0000","last_clean":"2024-09-17T05:37:46.035670+0000","last_became_active":"2024-09-17T05:37:45.055540+0000","last_became_peered":"2024-09-17T05:37:45.055540+0000","last_unstale":"2024-09-17T05:37:46.035670+0000","last_undegraded":"2024-09-17T05:37:46.035670+0000","last_fullsized":"2024-09-17T05:37:46.035670+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:05.374513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051136+0000","last_change":"2024-09-17T05:37:46.045881+0000","last_active":"2024-09-17T05:37:46.051136+0000","last_peered":"2024-09-17T05:37:46.051136+0000","last_clean":"2024-09-17T05:37:46.051136+0000","last_became_active":"2024-09-17T05:37:46.045557+0000","last_became_peered":"2024-09-17T05:37:46.045557+0000","last_unstale":"2024-09-17T05:37:46.051136+0000","last_undegraded":"2024-09-17T05:37:46.051136+0000","last_fullsized":"2024-09-17T05:37:46.051136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:59.076270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036315+0000","last_change":"2024-09-17T05:37:45.059449+0000","last_active":"2024-09-17T05:37:46.036315+0000","last_peered":"2024-09-17T05:37:46.036315+0000","last_clean":"2024-09-17T05:37:46.036315+0000","last_became_active":"2024-09-17T05:37:45.059104+0000","last_became_peered":"2024-09-17T05:37:45.059104+0000","last_unstale":"2024-09-17T05:37:46.036315+0000","last_undegraded":"2024-09-17T05:37:46.036315+0000","last_fullsized":"2024-09-17T05:37:46.036315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:52.588122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034593+0000","last_change":"2024-09-17T05:37:46.034593+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034593+0000","last_undegraded":"2024-09-17T05:37:46.034593+0000","last_fullsized":"2024-09-17T05:37:46.034593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.034994+0000","last_change":"2024-09-17T05:37:45.054509+0000","last_active":"2024-09-17T05:37:46.034994+0000","last_peered":"2024-09-17T05:37:46.034994+0000","last_clean":"2024-09-17T05:37:46.034994+0000","last_became_active":"2024-09-17T05:37:45.053870+0000","last_became_peered":"2024-09-17T05:37:45.053870+0000","last_unstale":"2024-09-17T05:37:46.034994+0000","last_undegraded":"2024-09-17T05:37:46.034994+0000","last_fullsized":"2024-09-17T05:37:46.034994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:11.666015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.054631+0000","last_change":"2024-09-17T05:37:46.052311+0000","last_active":"2024-09-17T05:37:46.054631+0000","last_peered":"2024-09-17T05:37:46.054631+0000","last_clean":"2024-09-17T05:37:46.054631+0000","last_became_active":"2024-09-17T05:37:46.051132+0000","last_became_peered":"2024-09-17T05:37:46.051132+0000","last_unstale":"2024-09-17T05:37:46.054631+0000","last_undegraded":"2024-09-17T05:37:46.054631+0000","last_fullsized":"2024-09-17T05:37:46.054631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:01.273341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047446+0000","last_change":"2024-09-17T05:37:45.058306+0000","last_active":"2024-09-17T05:37:46.047446+0000","last_peered":"2024-09-17T05:37:46.047446+0000","last_clean":"2024-09-17T05:37:46.047446+0000","last_became_active":"2024-09-17T05:37:45.057732+0000","last_became_peered":"2024-09-17T05:37:45.057732+0000","last_unstale":"2024-09-17T05:37:46.047446+0000","last_undegraded":"2024-09-17T05:37:46.047446+0000","last_fullsized":"2024-09-17T05:37:46.047446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:05.460762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.051599+0000","last_change":"2024-09-17T05:37:46.051599+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.051599+0000","last_undegraded":"2024-09-17T05:37:46.051599+0000","last_fullsized":"2024-09-17T05:37:46.051599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035840+0000","last_change":"2024-09-17T05:37:45.056408+0000","last_active":"2024-09-17T05:37:46.035840+0000","last_peered":"2024-09-17T05:37:46.035840+0000","last_clean":"2024-09-17T05:37:46.035840+0000","last_became_active":"2024-09-17T05:37:45.055291+0000","last_became_peered":"2024-09-17T05:37:45.055291+0000","last_unstale":"2024-09-17T05:37:46.035840+0000","last_undegraded":"2024-09-17T05:37:46.035840+0000","last_fullsized":"2024-09-17T05:37:46.035840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:59.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058363+0000","last_change":"2024-09-17T05:37:46.044901+0000","last_active":"2024-09-17T05:37:46.058363+0000","last_peered":"2024-09-17T05:37:46.058363+0000","last_clean":"2024-09-17T05:37:46.058363+0000","last_became_active":"2024-09-17T05:37:46.044421+0000","last_became_peered":"2024-09-17T05:37:46.044421+0000","last_unstale":"2024-09-17T05:37:46.058363+0000","last_undegraded":"2024-09-17T05:37:46.058363+0000","last_fullsized":"2024-09-17T05:37:46.058363+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:56.386485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.048866+0000","last_change":"2024-09-17T05:37:45.041226+0000","last_active":"2024-09-17T05:37:45.048866+0000","last_peered":"2024-09-17T05:37:45.048866+0000","last_clean":"2024-09-17T05:37:45.048866+0000","last_became_active":"2024-09-17T05:37:45.040877+0000","last_became_peered":"2024-09-17T05:37:45.040877+0000","last_unstale":"2024-09-17T05:37:45.048866+0000","last_undegraded":"2024-09-17T05:37:45.048866+0000","last_fullsized":"2024-09-17T05:37:45.048866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:22.674745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043557+0000","last_change":"2024-09-17T05:37:45.043557+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043557+0000","last_undegraded":"2024-09-17T05:37:45.043557+0000","last_fullsized":"2024-09-17T05:37:45.043557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037803+0000","last_change":"2024-09-17T05:37:45.059880+0000","last_active":"2024-09-17T05:37:46.037803+0000","last_peered":"2024-09-17T05:37:46.037803+0000","last_clean":"2024-09-17T05:37:46.037803+0000","last_became_active":"2024-09-17T05:37:45.059556+0000","last_became_peered":"2024-09-17T05:37:45.059556+0000","last_unstale":"2024-09-17T05:37:46.037803+0000","last_undegraded":"2024-09-17T05:37:46.037803+0000","last_fullsized":"2024-09-17T05:37:46.037803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:11.126039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.040025+0000","last_change":"2024-09-17T05:37:45.040025+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.040025+0000","last_undegraded":"2024-09-17T05:37:45.040025+0000","last_fullsized":"2024-09-17T05:37:45.040025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045495+0000","last_change":"2024-09-17T05:37:45.058285+0000","last_active":"2024-09-17T05:37:46.045495+0000","last_peered":"2024-09-17T05:37:46.045495+0000","last_clean":"2024-09-17T05:37:46.045495+0000","last_became_active":"2024-09-17T05:37:45.056912+0000","last_became_peered":"2024-09-17T05:37:45.056912+0000","last_unstale":"2024-09-17T05:37:46.045495+0000","last_undegraded":"2024-09-17T05:37:46.045495+0000","last_fullsized":"2024-09-17T05:37:46.045495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:26.430306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":163,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037763+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:37:46.037763+0000","last_peered":"2024-09-17T05:37:46.037763+0000","last_clean":"2024-09-17T05:37:46.037763+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:37:46.037763+0000","last_undegraded":"2024-09-17T05:37:46.037763+0000","last_fullsized":"2024-09-17T05:37:46.037763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":585728,"data_stored":255602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:50.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.886+0000 7f697d000640 1 -- 172.21.15.44:0/3924717803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f695c004810 msgr2=0x7f695c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.886+0000 7f697d000640 1 --2- 172.21.15.44:0/3924717803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f695c004810 0x7f695c004c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f69780c7020 tx=0x7f696001ef90 comp rx=0 tx=0).stop 2024-09-17T05:37:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.886+0000 7f6976800640 1 -- 172.21.15.44:0/3924717803 reap_dead start 2024-09-17T05:37:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.886+0000 7f697d000640 1 -- 172.21.15.44:0/3924717803 shutdown_connections 2024-09-17T05:37:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.886+0000 7f697d000640 1 -- 172.21.15.44:0/3924717803 >> 172.21.15.44:0/3924717803 conn(0x7f69780ccaa0 msgr2=0x7f69780cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.886+0000 7f697d000640 1 -- 172.21.15.44:0/3924717803 shutdown_connections 2024-09-17T05:37:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.886+0000 7f697d000640 1 -- 172.21.15.44:0/3924717803 wait complete. 2024-09-17T05:37:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 Processor -- start 2024-09-17T05:37:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 -- start start 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c004810 0x7f6978151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69781f5220 0x7f69780b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69780b4f60 0x7f69781f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f69780cbf90 con 0x7f69781f5220 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f697815ed30 con 0x7f695c004810 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f69780cc110 con 0x7f69780b4f60 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69781f5220 0x7f69780b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69781f5220 0x7f69780b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60272/0 (socket says 172.21.15.44:60272) 2024-09-17T05:37:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 -- 172.21.15.44:0/849542899 learned_addr learned my addr 172.21.15.44:0/849542899 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f6975e00640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c004810 0x7f6978151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f6976800640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69780b4f60 0x7f69781f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 -- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69780b4f60 msgr2=0x7f69781f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69780b4f60 0x7f69781f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 -- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c004810 msgr2=0x7f6978151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c004810 0x7f6978151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 -- 172.21.15.44:0/849542899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69780c6be0 con 0x7f69781f5220 2024-09-17T05:37:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f6976800640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69780b4f60 0x7f69781f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696d400640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69781f5220 0x7f69780b4a20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f696001d810 tx=0x7f6960006980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696ea00640 1 -- 172.21.15.44:0/849542899 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69600060d0 con 0x7f69781f5220 2024-09-17T05:37:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696ea00640 1 -- 172.21.15.44:0/849542899 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6960006270 con 0x7f69781f5220 2024-09-17T05:37:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69780c3c60 con 0x7f69781f5220 2024-09-17T05:37:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f696ea00640 1 -- 172.21.15.44:0/849542899 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960003600 con 0x7f69781f5220 2024-09-17T05:37:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.890+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6978151c00 con 0x7f69781f5220 2024-09-17T05:37:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.894+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69780c6950 con 0x7f69781f5220 2024-09-17T05:37:50.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.894+0000 7f696ea00640 1 -- 172.21.15.44:0/849542899 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f69600bb400 con 0x7f69781f5220 2024-09-17T05:37:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.894+0000 7f696ea00640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6954073200 0x7f6954075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.894+0000 7f696ea00640 1 -- 172.21.15.44:0/849542899 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f69601306c0 con 0x7f69781f5220 2024-09-17T05:37:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.894+0000 7f6975e00640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6954073200 0x7f6954075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:50.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.894+0000 7f6975e00640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6954073200 0x7f6954075710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6968009b20 tx=0x7f69680091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:50.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:50.898+0000 7f696ea00640 1 -- 172.21.15.44:0/849542899 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f69600c0020 con 0x7f69781f5220 2024-09-17T05:37:51.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.074+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69780b5370 con 0x7f6954073200 2024-09-17T05:37:51.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.078+0000 7f696ea00640 1 -- 172.21.15.44:0/849542899 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249153 (secure 0 0 0) 0x7f69780b5370 con 0x7f6954073200 2024-09-17T05:37:51.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:51.082 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:37:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6954073200 msgr2=0x7f6954075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6954073200 0x7f6954075710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6968009b20 tx=0x7f69680091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69781f5220 msgr2=0x7f69780b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69781f5220 0x7f69780b4a20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f696001d810 tx=0x7f6960006980 comp rx=0 tx=0).stop 2024-09-17T05:37:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 shutdown_connections 2024-09-17T05:37:51.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69780b4f60 0x7f69781f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f69781f5220 0x7f69780b4a20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6954073200 0x7f6954075710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 --2- 172.21.15.44:0/849542899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f695c004810 0x7f6978151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 >> 172.21.15.44:0/849542899 conn(0x7f69780ccaa0 msgr2=0x7f6978070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 shutdown_connections 2024-09-17T05:37:51.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.082+0000 7f697d000640 1 -- 172.21.15.44:0/849542899 wait complete. 2024-09-17T05:37:51.105 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-17T05:37:50.281602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591130,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":132,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226104,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748616,"statfs":{"total":773094113280,"available":772862582784,"internally_reserved":0,"allocated":5816320,"data_stored":3189824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001587"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697288+0000","last_change":"2024-09-17T05:37:46.072522+0000","last_active":"2024-09-17T05:37:47.697288+0000","last_peered":"2024-09-17T05:37:47.697288+0000","last_clean":"2024-09-17T05:37:47.697288+0000","last_became_active":"2024-09-17T05:37:46.072094+0000","last_became_peered":"2024-09-17T05:37:46.072094+0000","last_unstale":"2024-09-17T05:37:47.697288+0000","last_undegraded":"2024-09-17T05:37:47.697288+0000","last_fullsized":"2024-09-17T05:37:47.697288+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:14.754849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049328+0000","last_change":"2024-09-17T05:37:46.049328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049328+0000","last_undegraded":"2024-09-17T05:37:46.049328+0000","last_fullsized":"2024-09-17T05:37:46.049328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055291+0000","last_change":"2024-09-17T05:37:46.050394+0000","last_active":"2024-09-17T05:37:46.055291+0000","last_peered":"2024-09-17T05:37:46.055291+0000","last_clean":"2024-09-17T05:37:46.055291+0000","last_became_active":"2024-09-17T05:37:46.050088+0000","last_became_peered":"2024-09-17T05:37:46.050088+0000","last_unstale":"2024-09-17T05:37:46.055291+0000","last_undegraded":"2024-09-17T05:37:46.055291+0000","last_fullsized":"2024-09-17T05:37:46.055291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:20.021978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040667+0000","last_change":"2024-09-17T05:37:46.040667+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040667+0000","last_undegraded":"2024-09-17T05:37:46.040667+0000","last_fullsized":"2024-09-17T05:37:46.040667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047608+0000","last_change":"2024-09-17T05:37:46.047608+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047608+0000","last_undegraded":"2024-09-17T05:37:46.047608+0000","last_fullsized":"2024-09-17T05:37:46.047608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042278+0000","last_change":"2024-09-17T05:37:45.042278+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042278+0000","last_undegraded":"2024-09-17T05:37:45.042278+0000","last_fullsized":"2024-09-17T05:37:45.042278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039644+0000","last_change":"2024-09-17T05:37:46.039644+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039644+0000","last_undegraded":"2024-09-17T05:37:46.039644+0000","last_fullsized":"2024-09-17T05:37:46.039644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049232+0000","last_change":"2024-09-17T05:37:46.049232+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049232+0000","last_undegraded":"2024-09-17T05:37:46.049232+0000","last_fullsized":"2024-09-17T05:37:46.049232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055932+0000","last_change":"2024-09-17T05:37:46.055821+0000","last_active":"2024-09-17T05:37:46.055932+0000","last_peered":"2024-09-17T05:37:46.055932+0000","last_clean":"2024-09-17T05:37:46.055932+0000","last_became_active":"2024-09-17T05:37:46.054639+0000","last_became_peered":"2024-09-17T05:37:46.054639+0000","last_unstale":"2024-09-17T05:37:46.055932+0000","last_undegraded":"2024-09-17T05:37:46.055932+0000","last_fullsized":"2024-09-17T05:37:46.055932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:58.176243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058676+0000","last_change":"2024-09-17T05:37:46.058567+0000","last_active":"2024-09-17T05:37:46.058676+0000","last_peered":"2024-09-17T05:37:46.058676+0000","last_clean":"2024-09-17T05:37:46.058676+0000","last_became_active":"2024-09-17T05:37:46.058112+0000","last_became_peered":"2024-09-17T05:37:46.058112+0000","last_unstale":"2024-09-17T05:37:46.058676+0000","last_undegraded":"2024-09-17T05:37:46.058676+0000","last_fullsized":"2024-09-17T05:37:46.058676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:49.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696909+0000","last_change":"2024-09-17T05:37:46.048148+0000","last_active":"2024-09-17T05:37:47.696909+0000","last_peered":"2024-09-17T05:37:47.696909+0000","last_clean":"2024-09-17T05:37:47.696909+0000","last_became_active":"2024-09-17T05:37:46.047809+0000","last_became_peered":"2024-09-17T05:37:46.047809+0000","last_unstale":"2024-09-17T05:37:47.696909+0000","last_undegraded":"2024-09-17T05:37:47.696909+0000","last_fullsized":"2024-09-17T05:37:47.696909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:16.926041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043484+0000","last_change":"2024-09-17T05:37:45.043484+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043484+0000","last_undegraded":"2024-09-17T05:37:45.043484+0000","last_fullsized":"2024-09-17T05:37:45.043484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042502+0000","last_change":"2024-09-17T05:37:45.042502+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042502+0000","last_undegraded":"2024-09-17T05:37:45.042502+0000","last_fullsized":"2024-09-17T05:37:45.042502+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696453+0000","last_change":"2024-09-17T05:37:46.074957+0000","last_active":"2024-09-17T05:37:47.696453+0000","last_peered":"2024-09-17T05:37:47.696453+0000","last_clean":"2024-09-17T05:37:47.696453+0000","last_became_active":"2024-09-17T05:37:46.074636+0000","last_became_peered":"2024-09-17T05:37:46.074636+0000","last_unstale":"2024-09-17T05:37:47.696453+0000","last_undegraded":"2024-09-17T05:37:47.696453+0000","last_fullsized":"2024-09-17T05:37:47.696453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:29.802032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036682+0000","last_change":"2024-09-17T05:37:46.036682+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036682+0000","last_undegraded":"2024-09-17T05:37:46.036682+0000","last_fullsized":"2024-09-17T05:37:46.036682+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049975+0000","last_change":"2024-09-17T05:37:46.049975+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049975+0000","last_undegraded":"2024-09-17T05:37:46.049975+0000","last_fullsized":"2024-09-17T05:37:46.049975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697818+0000","last_change":"2024-09-17T05:37:46.059031+0000","last_active":"2024-09-17T05:37:47.697818+0000","last_peered":"2024-09-17T05:37:47.697818+0000","last_clean":"2024-09-17T05:37:47.697818+0000","last_became_active":"2024-09-17T05:37:46.058482+0000","last_became_peered":"2024-09-17T05:37:46.058482+0000","last_unstale":"2024-09-17T05:37:47.697818+0000","last_undegraded":"2024-09-17T05:37:47.697818+0000","last_fullsized":"2024-09-17T05:37:47.697818+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:57.156256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039922+0000","last_change":"2024-09-17T05:37:46.039922+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039922+0000","last_undegraded":"2024-09-17T05:37:46.039922+0000","last_fullsized":"2024-09-17T05:37:46.039922+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034741+0000","last_change":"2024-09-17T05:37:46.034741+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034741+0000","last_undegraded":"2024-09-17T05:37:46.034741+0000","last_fullsized":"2024-09-17T05:37:46.034741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046441+0000","last_change":"2024-09-17T05:37:46.046441+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046441+0000","last_undegraded":"2024-09-17T05:37:46.046441+0000","last_fullsized":"2024-09-17T05:37:46.046441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039359+0000","last_change":"2024-09-17T05:37:46.039359+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039359+0000","last_undegraded":"2024-09-17T05:37:46.039359+0000","last_fullsized":"2024-09-17T05:37:46.039359+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053120+0000","last_change":"2024-09-17T05:37:46.048168+0000","last_active":"2024-09-17T05:37:46.053120+0000","last_peered":"2024-09-17T05:37:46.053120+0000","last_clean":"2024-09-17T05:37:46.053120+0000","last_became_active":"2024-09-17T05:37:46.047785+0000","last_became_peered":"2024-09-17T05:37:46.047785+0000","last_unstale":"2024-09-17T05:37:46.053120+0000","last_undegraded":"2024-09-17T05:37:46.053120+0000","last_fullsized":"2024-09-17T05:37:46.053120+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:09.371434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057668+0000","last_change":"2024-09-17T05:37:46.057518+0000","last_active":"2024-09-17T05:37:46.057668+0000","last_peered":"2024-09-17T05:37:46.057668+0000","last_clean":"2024-09-17T05:37:46.057668+0000","last_became_active":"2024-09-17T05:37:46.057188+0000","last_became_peered":"2024-09-17T05:37:46.057188+0000","last_unstale":"2024-09-17T05:37:46.057668+0000","last_undegraded":"2024-09-17T05:37:46.057668+0000","last_fullsized":"2024-09-17T05:37:46.057668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:38.494638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055630+0000","last_change":"2024-09-17T05:37:46.055514+0000","last_active":"2024-09-17T05:37:46.055630+0000","last_peered":"2024-09-17T05:37:46.055630+0000","last_clean":"2024-09-17T05:37:46.055630+0000","last_became_active":"2024-09-17T05:37:46.055184+0000","last_became_peered":"2024-09-17T05:37:46.055184+0000","last_unstale":"2024-09-17T05:37:46.055630+0000","last_undegraded":"2024-09-17T05:37:46.055630+0000","last_fullsized":"2024-09-17T05:37:46.055630+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:36.128340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697508+0000","last_change":"2024-09-17T05:37:46.059902+0000","last_active":"2024-09-17T05:37:47.697508+0000","last_peered":"2024-09-17T05:37:47.697508+0000","last_clean":"2024-09-17T05:37:47.697508+0000","last_became_active":"2024-09-17T05:37:46.059620+0000","last_became_peered":"2024-09-17T05:37:46.059620+0000","last_unstale":"2024-09-17T05:37:47.697508+0000","last_undegraded":"2024-09-17T05:37:47.697508+0000","last_fullsized":"2024-09-17T05:37:47.697508+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:38.719755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035286+0000","last_change":"2024-09-17T05:37:46.035286+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035286+0000","last_undegraded":"2024-09-17T05:37:46.035286+0000","last_fullsized":"2024-09-17T05:37:46.035286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043615+0000","last_change":"2024-09-17T05:37:45.043615+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043615+0000","last_undegraded":"2024-09-17T05:37:45.043615+0000","last_fullsized":"2024-09-17T05:37:45.043615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046047+0000","last_change":"2024-09-17T05:37:46.046047+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046047+0000","last_undegraded":"2024-09-17T05:37:46.046047+0000","last_fullsized":"2024-09-17T05:37:46.046047+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696657+0000","last_change":"2024-09-17T05:37:46.069098+0000","last_active":"2024-09-17T05:37:47.696657+0000","last_peered":"2024-09-17T05:37:47.696657+0000","last_clean":"2024-09-17T05:37:47.696657+0000","last_became_active":"2024-09-17T05:37:46.068168+0000","last_became_peered":"2024-09-17T05:37:46.068168+0000","last_unstale":"2024-09-17T05:37:47.696657+0000","last_undegraded":"2024-09-17T05:37:47.696657+0000","last_fullsized":"2024-09-17T05:37:47.696657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:47.470382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045326+0000","last_change":"2024-09-17T05:37:46.040392+0000","last_active":"2024-09-17T05:37:46.045326+0000","last_peered":"2024-09-17T05:37:46.045326+0000","last_clean":"2024-09-17T05:37:46.045326+0000","last_became_active":"2024-09-17T05:37:46.040050+0000","last_became_peered":"2024-09-17T05:37:46.040050+0000","last_unstale":"2024-09-17T05:37:46.045326+0000","last_undegraded":"2024-09-17T05:37:46.045326+0000","last_fullsized":"2024-09-17T05:37:46.045326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:30.608968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052985+0000","last_change":"2024-09-17T05:37:46.046598+0000","last_active":"2024-09-17T05:37:46.052985+0000","last_peered":"2024-09-17T05:37:46.052985+0000","last_clean":"2024-09-17T05:37:46.052985+0000","last_became_active":"2024-09-17T05:37:46.045641+0000","last_became_peered":"2024-09-17T05:37:46.045641+0000","last_unstale":"2024-09-17T05:37:46.052985+0000","last_undegraded":"2024-09-17T05:37:46.052985+0000","last_fullsized":"2024-09-17T05:37:46.052985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:56.105991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.044226+0000","last_change":"2024-09-17T05:37:46.044226+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.044226+0000","last_undegraded":"2024-09-17T05:37:46.044226+0000","last_fullsized":"2024-09-17T05:37:46.044226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035350+0000","last_change":"2024-09-17T05:37:46.035350+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035350+0000","last_undegraded":"2024-09-17T05:37:46.035350+0000","last_fullsized":"2024-09-17T05:37:46.035350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056824+0000","last_change":"2024-09-17T05:37:45.050863+0000","last_active":"2024-09-17T05:37:45.056824+0000","last_peered":"2024-09-17T05:37:45.056824+0000","last_clean":"2024-09-17T05:37:45.056824+0000","last_became_active":"2024-09-17T05:37:45.050504+0000","last_became_peered":"2024-09-17T05:37:45.050504+0000","last_unstale":"2024-09-17T05:37:45.056824+0000","last_undegraded":"2024-09-17T05:37:45.056824+0000","last_fullsized":"2024-09-17T05:37:45.056824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:08.862087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.048391+0000","last_change":"2024-09-17T05:37:46.045999+0000","last_active":"2024-09-17T05:37:46.048391+0000","last_peered":"2024-09-17T05:37:46.048391+0000","last_clean":"2024-09-17T05:37:46.048391+0000","last_became_active":"2024-09-17T05:37:46.045674+0000","last_became_peered":"2024-09-17T05:37:46.045674+0000","last_unstale":"2024-09-17T05:37:46.048391+0000","last_undegraded":"2024-09-17T05:37:46.048391+0000","last_fullsized":"2024-09-17T05:37:46.048391+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:00.337771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070859+0000","last_change":"2024-09-17T05:37:45.065829+0000","last_active":"2024-09-17T05:37:45.070859+0000","last_peered":"2024-09-17T05:37:45.070859+0000","last_clean":"2024-09-17T05:37:45.070859+0000","last_became_active":"2024-09-17T05:37:45.065496+0000","last_became_peered":"2024-09-17T05:37:45.065496+0000","last_unstale":"2024-09-17T05:37:45.070859+0000","last_undegraded":"2024-09-17T05:37:45.070859+0000","last_fullsized":"2024-09-17T05:37:45.070859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.588632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036201+0000","last_change":"2024-09-17T05:37:46.036201+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036201+0000","last_undegraded":"2024-09-17T05:37:46.036201+0000","last_fullsized":"2024-09-17T05:37:46.036201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045479+0000","last_change":"2024-09-17T05:37:45.061814+0000","last_active":"2024-09-17T05:37:46.045479+0000","last_peered":"2024-09-17T05:37:46.045479+0000","last_clean":"2024-09-17T05:37:46.045479+0000","last_became_active":"2024-09-17T05:37:45.061436+0000","last_became_peered":"2024-09-17T05:37:45.061436+0000","last_unstale":"2024-09-17T05:37:46.045479+0000","last_undegraded":"2024-09-17T05:37:46.045479+0000","last_fullsized":"2024-09-17T05:37:46.045479+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:21.256652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051721+0000","last_change":"2024-09-17T05:37:46.045530+0000","last_active":"2024-09-17T05:37:46.051721+0000","last_peered":"2024-09-17T05:37:46.051721+0000","last_clean":"2024-09-17T05:37:46.051721+0000","last_became_active":"2024-09-17T05:37:46.044880+0000","last_became_peered":"2024-09-17T05:37:46.044880+0000","last_unstale":"2024-09-17T05:37:46.051721+0000","last_undegraded":"2024-09-17T05:37:46.051721+0000","last_fullsized":"2024-09-17T05:37:46.051721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:30.249849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047610+0000","last_change":"2024-09-17T05:37:45.054678+0000","last_active":"2024-09-17T05:37:46.047610+0000","last_peered":"2024-09-17T05:37:46.047610+0000","last_clean":"2024-09-17T05:37:46.047610+0000","last_became_active":"2024-09-17T05:37:45.053608+0000","last_became_peered":"2024-09-17T05:37:45.053608+0000","last_unstale":"2024-09-17T05:37:46.047610+0000","last_undegraded":"2024-09-17T05:37:46.047610+0000","last_fullsized":"2024-09-17T05:37:46.047610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039722+0000","last_change":"2024-09-17T05:37:45.039722+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039722+0000","last_undegraded":"2024-09-17T05:37:45.039722+0000","last_fullsized":"2024-09-17T05:37:45.039722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036323+0000","last_change":"2024-09-17T05:37:45.056140+0000","last_active":"2024-09-17T05:37:46.036323+0000","last_peered":"2024-09-17T05:37:46.036323+0000","last_clean":"2024-09-17T05:37:46.036323+0000","last_became_active":"2024-09-17T05:37:45.055568+0000","last_became_peered":"2024-09-17T05:37:45.055568+0000","last_unstale":"2024-09-17T05:37:46.036323+0000","last_undegraded":"2024-09-17T05:37:46.036323+0000","last_fullsized":"2024-09-17T05:37:46.036323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:29.119041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035830+0000","last_change":"2024-09-17T05:37:46.035830+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035830+0000","last_undegraded":"2024-09-17T05:37:46.035830+0000","last_fullsized":"2024-09-17T05:37:46.035830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036562+0000","last_change":"2024-09-17T05:37:45.057805+0000","last_active":"2024-09-17T05:37:46.036562+0000","last_peered":"2024-09-17T05:37:46.036562+0000","last_clean":"2024-09-17T05:37:46.036562+0000","last_became_active":"2024-09-17T05:37:45.057474+0000","last_became_peered":"2024-09-17T05:37:45.057474+0000","last_unstale":"2024-09-17T05:37:46.036562+0000","last_undegraded":"2024-09-17T05:37:46.036562+0000","last_fullsized":"2024-09-17T05:37:46.036562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:11.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.062330+0000","last_change":"2024-09-17T05:37:46.057006+0000","last_active":"2024-09-17T05:37:46.062330+0000","last_peered":"2024-09-17T05:37:46.062330+0000","last_clean":"2024-09-17T05:37:46.062330+0000","last_became_active":"2024-09-17T05:37:46.056679+0000","last_became_peered":"2024-09-17T05:37:46.056679+0000","last_unstale":"2024-09-17T05:37:46.062330+0000","last_undegraded":"2024-09-17T05:37:46.062330+0000","last_fullsized":"2024-09-17T05:37:46.062330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:16.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037442+0000","last_change":"2024-09-17T05:37:45.055516+0000","last_active":"2024-09-17T05:37:46.037442+0000","last_peered":"2024-09-17T05:37:46.037442+0000","last_clean":"2024-09-17T05:37:46.037442+0000","last_became_active":"2024-09-17T05:37:45.055191+0000","last_became_peered":"2024-09-17T05:37:45.055191+0000","last_unstale":"2024-09-17T05:37:46.037442+0000","last_undegraded":"2024-09-17T05:37:46.037442+0000","last_fullsized":"2024-09-17T05:37:46.037442+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:50.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040514+0000","last_change":"2024-09-17T05:37:46.040514+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040514+0000","last_undegraded":"2024-09-17T05:37:46.040514+0000","last_fullsized":"2024-09-17T05:37:46.040514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035127+0000","last_change":"2024-09-17T05:37:45.051689+0000","last_active":"2024-09-17T05:37:46.035127+0000","last_peered":"2024-09-17T05:37:46.035127+0000","last_clean":"2024-09-17T05:37:46.035127+0000","last_became_active":"2024-09-17T05:37:45.051347+0000","last_became_peered":"2024-09-17T05:37:45.051347+0000","last_unstale":"2024-09-17T05:37:46.035127+0000","last_undegraded":"2024-09-17T05:37:46.035127+0000","last_fullsized":"2024-09-17T05:37:46.035127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:18.596842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039438+0000","last_change":"2024-09-17T05:37:45.039438+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039438+0000","last_undegraded":"2024-09-17T05:37:45.039438+0000","last_fullsized":"2024-09-17T05:37:45.039438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040896+0000","last_change":"2024-09-17T05:37:45.052131+0000","last_active":"2024-09-17T05:37:46.040896+0000","last_peered":"2024-09-17T05:37:46.040896+0000","last_clean":"2024-09-17T05:37:46.040896+0000","last_became_active":"2024-09-17T05:37:45.051781+0000","last_became_peered":"2024-09-17T05:37:45.051781+0000","last_unstale":"2024-09-17T05:37:46.040896+0000","last_undegraded":"2024-09-17T05:37:46.040896+0000","last_fullsized":"2024-09-17T05:37:46.040896+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:29.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039328+0000","last_change":"2024-09-17T05:37:46.039328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039328+0000","last_undegraded":"2024-09-17T05:37:46.039328+0000","last_fullsized":"2024-09-17T05:37:46.039328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040265+0000","last_change":"2024-09-17T05:37:45.064805+0000","last_active":"2024-09-17T05:37:46.040265+0000","last_peered":"2024-09-17T05:37:46.040265+0000","last_clean":"2024-09-17T05:37:46.040265+0000","last_became_active":"2024-09-17T05:37:45.064425+0000","last_became_peered":"2024-09-17T05:37:45.064425+0000","last_unstale":"2024-09-17T05:37:46.040265+0000","last_undegraded":"2024-09-17T05:37:46.040265+0000","last_fullsized":"2024-09-17T05:37:46.040265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696514+0000","last_change":"2024-09-17T05:37:46.064206+0000","last_active":"2024-09-17T05:37:47.696514+0000","last_peered":"2024-09-17T05:37:47.696514+0000","last_clean":"2024-09-17T05:37:47.696514+0000","last_became_active":"2024-09-17T05:37:46.054901+0000","last_became_peered":"2024-09-17T05:37:46.054901+0000","last_unstale":"2024-09-17T05:37:47.696514+0000","last_undegraded":"2024-09-17T05:37:47.696514+0000","last_fullsized":"2024-09-17T05:37:47.696514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:00.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036261+0000","last_change":"2024-09-17T05:37:45.059681+0000","last_active":"2024-09-17T05:37:46.036261+0000","last_peered":"2024-09-17T05:37:46.036261+0000","last_clean":"2024-09-17T05:37:46.036261+0000","last_became_active":"2024-09-17T05:37:45.059319+0000","last_became_peered":"2024-09-17T05:37:45.059319+0000","last_unstale":"2024-09-17T05:37:46.036261+0000","last_undegraded":"2024-09-17T05:37:46.036261+0000","last_fullsized":"2024-09-17T05:37:46.036261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:32.941882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047638+0000","last_change":"2024-09-17T05:37:46.047638+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047638+0000","last_undegraded":"2024-09-17T05:37:46.047638+0000","last_fullsized":"2024-09-17T05:37:46.047638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'5","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045140+0000","last_change":"2024-09-17T05:37:45.055492+0000","last_active":"2024-09-17T05:37:46.045140+0000","last_peered":"2024-09-17T05:37:46.045140+0000","last_clean":"2024-09-17T05:37:46.045140+0000","last_became_active":"2024-09-17T05:37:45.054184+0000","last_became_peered":"2024-09-17T05:37:45.054184+0000","last_unstale":"2024-09-17T05:37:46.045140+0000","last_undegraded":"2024-09-17T05:37:46.045140+0000","last_fullsized":"2024-09-17T05:37:46.045140+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:33.159363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057435+0000","last_change":"2024-09-17T05:37:46.057339+0000","last_active":"2024-09-17T05:37:46.057435+0000","last_peered":"2024-09-17T05:37:46.057435+0000","last_clean":"2024-09-17T05:37:46.057435+0000","last_became_active":"2024-09-17T05:37:46.057017+0000","last_became_peered":"2024-09-17T05:37:46.057017+0000","last_unstale":"2024-09-17T05:37:46.057435+0000","last_undegraded":"2024-09-17T05:37:46.057435+0000","last_fullsized":"2024-09-17T05:37:46.057435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:23.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.071346+0000","last_change":"2024-09-17T05:37:45.069218+0000","last_active":"2024-09-17T05:37:45.071346+0000","last_peered":"2024-09-17T05:37:45.071346+0000","last_clean":"2024-09-17T05:37:45.071346+0000","last_became_active":"2024-09-17T05:37:45.068997+0000","last_became_peered":"2024-09-17T05:37:45.068997+0000","last_unstale":"2024-09-17T05:37:45.071346+0000","last_undegraded":"2024-09-17T05:37:45.071346+0000","last_fullsized":"2024-09-17T05:37:45.071346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:47.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696941+0000","last_change":"2024-09-17T05:37:46.076000+0000","last_active":"2024-09-17T05:37:47.696941+0000","last_peered":"2024-09-17T05:37:47.696941+0000","last_clean":"2024-09-17T05:37:47.696941+0000","last_became_active":"2024-09-17T05:37:46.075703+0000","last_became_peered":"2024-09-17T05:37:46.075703+0000","last_unstale":"2024-09-17T05:37:47.696941+0000","last_undegraded":"2024-09-17T05:37:47.696941+0000","last_fullsized":"2024-09-17T05:37:47.696941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:13.038600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.039483+0000","last_change":"2024-09-17T05:37:45.059842+0000","last_active":"2024-09-17T05:37:46.039483+0000","last_peered":"2024-09-17T05:37:46.039483+0000","last_clean":"2024-09-17T05:37:46.039483+0000","last_became_active":"2024-09-17T05:37:45.059402+0000","last_became_peered":"2024-09-17T05:37:45.059402+0000","last_unstale":"2024-09-17T05:37:46.039483+0000","last_undegraded":"2024-09-17T05:37:46.039483+0000","last_fullsized":"2024-09-17T05:37:46.039483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:43.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043992+0000","last_change":"2024-09-17T05:37:45.043992+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043992+0000","last_undegraded":"2024-09-17T05:37:45.043992+0000","last_fullsized":"2024-09-17T05:37:45.043992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056507+0000","last_change":"2024-09-17T05:37:45.053989+0000","last_active":"2024-09-17T05:37:45.056507+0000","last_peered":"2024-09-17T05:37:45.056507+0000","last_clean":"2024-09-17T05:37:45.056507+0000","last_became_active":"2024-09-17T05:37:45.053641+0000","last_became_peered":"2024-09-17T05:37:45.053641+0000","last_unstale":"2024-09-17T05:37:45.056507+0000","last_undegraded":"2024-09-17T05:37:45.056507+0000","last_fullsized":"2024-09-17T05:37:45.056507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:28.048481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053848+0000","last_change":"2024-09-17T05:37:46.049142+0000","last_active":"2024-09-17T05:37:46.053848+0000","last_peered":"2024-09-17T05:37:46.053848+0000","last_clean":"2024-09-17T05:37:46.053848+0000","last_became_active":"2024-09-17T05:37:46.047150+0000","last_became_peered":"2024-09-17T05:37:46.047150+0000","last_unstale":"2024-09-17T05:37:46.053848+0000","last_undegraded":"2024-09-17T05:37:46.053848+0000","last_fullsized":"2024-09-17T05:37:46.053848+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:05.829528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.050418+0000","last_change":"2024-09-17T05:37:45.066676+0000","last_active":"2024-09-17T05:37:46.050418+0000","last_peered":"2024-09-17T05:37:46.050418+0000","last_clean":"2024-09-17T05:37:46.050418+0000","last_became_active":"2024-09-17T05:37:45.065923+0000","last_became_peered":"2024-09-17T05:37:45.065923+0000","last_unstale":"2024-09-17T05:37:46.050418+0000","last_undegraded":"2024-09-17T05:37:46.050418+0000","last_fullsized":"2024-09-17T05:37:46.050418+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.741795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052777+0000","last_change":"2024-09-17T05:37:46.049677+0000","last_active":"2024-09-17T05:37:46.052777+0000","last_peered":"2024-09-17T05:37:46.052777+0000","last_clean":"2024-09-17T05:37:46.052777+0000","last_became_active":"2024-09-17T05:37:46.049320+0000","last_became_peered":"2024-09-17T05:37:46.049320+0000","last_unstale":"2024-09-17T05:37:46.052777+0000","last_undegraded":"2024-09-17T05:37:46.052777+0000","last_fullsized":"2024-09-17T05:37:46.052777+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:43.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070891+0000","last_change":"2024-09-17T05:37:45.066669+0000","last_active":"2024-09-17T05:37:45.070891+0000","last_peered":"2024-09-17T05:37:45.070891+0000","last_clean":"2024-09-17T05:37:45.070891+0000","last_became_active":"2024-09-17T05:37:45.065484+0000","last_became_peered":"2024-09-17T05:37:45.065484+0000","last_unstale":"2024-09-17T05:37:45.070891+0000","last_undegraded":"2024-09-17T05:37:45.070891+0000","last_fullsized":"2024-09-17T05:37:45.070891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:18.322336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696374+0000","last_change":"2024-09-17T05:37:46.065321+0000","last_active":"2024-09-17T05:37:47.696374+0000","last_peered":"2024-09-17T05:37:47.696374+0000","last_clean":"2024-09-17T05:37:47.696374+0000","last_became_active":"2024-09-17T05:37:46.056405+0000","last_became_peered":"2024-09-17T05:37:46.056405+0000","last_unstale":"2024-09-17T05:37:47.696374+0000","last_undegraded":"2024-09-17T05:37:47.696374+0000","last_fullsized":"2024-09-17T05:37:47.696374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.795082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.068109+0000","last_change":"2024-09-17T05:37:45.065048+0000","last_active":"2024-09-17T05:37:45.068109+0000","last_peered":"2024-09-17T05:37:45.068109+0000","last_clean":"2024-09-17T05:37:45.068109+0000","last_became_active":"2024-09-17T05:37:45.064525+0000","last_became_peered":"2024-09-17T05:37:45.064525+0000","last_unstale":"2024-09-17T05:37:45.068109+0000","last_undegraded":"2024-09-17T05:37:45.068109+0000","last_fullsized":"2024-09-17T05:37:45.068109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:21.117699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.050303+0000","last_change":"2024-09-17T05:37:46.050303+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.050303+0000","last_undegraded":"2024-09-17T05:37:46.050303+0000","last_fullsized":"2024-09-17T05:37:46.050303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040173+0000","last_change":"2024-09-17T05:37:45.054993+0000","last_active":"2024-09-17T05:37:46.040173+0000","last_peered":"2024-09-17T05:37:46.040173+0000","last_clean":"2024-09-17T05:37:46.040173+0000","last_became_active":"2024-09-17T05:37:45.054655+0000","last_became_peered":"2024-09-17T05:37:45.054655+0000","last_unstale":"2024-09-17T05:37:46.040173+0000","last_undegraded":"2024-09-17T05:37:46.040173+0000","last_fullsized":"2024-09-17T05:37:46.040173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043135+0000","last_change":"2024-09-17T05:37:45.043135+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043135+0000","last_undegraded":"2024-09-17T05:37:45.043135+0000","last_fullsized":"2024-09-17T05:37:45.043135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.049698+0000","last_change":"2024-09-17T05:37:45.061423+0000","last_active":"2024-09-17T05:37:46.049698+0000","last_peered":"2024-09-17T05:37:46.049698+0000","last_clean":"2024-09-17T05:37:46.049698+0000","last_became_active":"2024-09-17T05:37:45.061101+0000","last_became_peered":"2024-09-17T05:37:45.061101+0000","last_unstale":"2024-09-17T05:37:46.049698+0000","last_undegraded":"2024-09-17T05:37:46.049698+0000","last_fullsized":"2024-09-17T05:37:46.049698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.045646+0000","last_change":"2024-09-17T05:37:46.045646+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.045646+0000","last_undegraded":"2024-09-17T05:37:46.045646+0000","last_fullsized":"2024-09-17T05:37:46.045646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696422+0000","last_change":"2024-09-17T05:37:45.059259+0000","last_active":"2024-09-17T05:37:47.696422+0000","last_peered":"2024-09-17T05:37:47.696422+0000","last_clean":"2024-09-17T05:37:47.696422+0000","last_became_active":"2024-09-17T05:37:45.058953+0000","last_became_peered":"2024-09-17T05:37:45.058953+0000","last_unstale":"2024-09-17T05:37:47.696422+0000","last_undegraded":"2024-09-17T05:37:47.696422+0000","last_fullsized":"2024-09-17T05:37:47.696422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:43.576998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039765+0000","last_change":"2024-09-17T05:37:46.039765+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039765+0000","last_undegraded":"2024-09-17T05:37:46.039765+0000","last_fullsized":"2024-09-17T05:37:46.039765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035716+0000","last_change":"2024-09-17T05:37:45.051009+0000","last_active":"2024-09-17T05:37:46.035716+0000","last_peered":"2024-09-17T05:37:46.035716+0000","last_clean":"2024-09-17T05:37:46.035716+0000","last_became_active":"2024-09-17T05:37:45.049848+0000","last_became_peered":"2024-09-17T05:37:45.049848+0000","last_unstale":"2024-09-17T05:37:46.035716+0000","last_undegraded":"2024-09-17T05:37:46.035716+0000","last_fullsized":"2024-09-17T05:37:46.035716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.903947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696998+0000","last_change":"2024-09-17T05:37:46.057468+0000","last_active":"2024-09-17T05:37:47.696998+0000","last_peered":"2024-09-17T05:37:47.696998+0000","last_clean":"2024-09-17T05:37:47.696998+0000","last_became_active":"2024-09-17T05:37:46.057127+0000","last_became_peered":"2024-09-17T05:37:46.057127+0000","last_unstale":"2024-09-17T05:37:47.696998+0000","last_undegraded":"2024-09-17T05:37:47.696998+0000","last_fullsized":"2024-09-17T05:37:47.696998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:46.077247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044481+0000","last_change":"2024-09-17T05:37:45.060323+0000","last_active":"2024-09-17T05:37:46.044481+0000","last_peered":"2024-09-17T05:37:46.044481+0000","last_clean":"2024-09-17T05:37:46.044481+0000","last_became_active":"2024-09-17T05:37:45.059994+0000","last_became_peered":"2024-09-17T05:37:45.059994+0000","last_unstale":"2024-09-17T05:37:46.044481+0000","last_undegraded":"2024-09-17T05:37:46.044481+0000","last_fullsized":"2024-09-17T05:37:46.044481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:48.441696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042857+0000","last_change":"2024-09-17T05:37:45.042857+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042857+0000","last_undegraded":"2024-09-17T05:37:45.042857+0000","last_fullsized":"2024-09-17T05:37:45.042857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044576+0000","last_change":"2024-09-17T05:37:45.059701+0000","last_active":"2024-09-17T05:37:46.044576+0000","last_peered":"2024-09-17T05:37:46.044576+0000","last_clean":"2024-09-17T05:37:46.044576+0000","last_became_active":"2024-09-17T05:37:45.059353+0000","last_became_peered":"2024-09-17T05:37:45.059353+0000","last_unstale":"2024-09-17T05:37:46.044576+0000","last_undegraded":"2024-09-17T05:37:46.044576+0000","last_fullsized":"2024-09-17T05:37:46.044576+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:05.240575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.037570+0000","last_change":"2024-09-17T05:37:46.037570+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.037570+0000","last_undegraded":"2024-09-17T05:37:46.037570+0000","last_fullsized":"2024-09-17T05:37:46.037570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035670+0000","last_change":"2024-09-17T05:37:45.055888+0000","last_active":"2024-09-17T05:37:46.035670+0000","last_peered":"2024-09-17T05:37:46.035670+0000","last_clean":"2024-09-17T05:37:46.035670+0000","last_became_active":"2024-09-17T05:37:45.055540+0000","last_became_peered":"2024-09-17T05:37:45.055540+0000","last_unstale":"2024-09-17T05:37:46.035670+0000","last_undegraded":"2024-09-17T05:37:46.035670+0000","last_fullsized":"2024-09-17T05:37:46.035670+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:05.374513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051136+0000","last_change":"2024-09-17T05:37:46.045881+0000","last_active":"2024-09-17T05:37:46.051136+0000","last_peered":"2024-09-17T05:37:46.051136+0000","last_clean":"2024-09-17T05:37:46.051136+0000","last_became_active":"2024-09-17T05:37:46.045557+0000","last_became_peered":"2024-09-17T05:37:46.045557+0000","last_unstale":"2024-09-17T05:37:46.051136+0000","last_undegraded":"2024-09-17T05:37:46.051136+0000","last_fullsized":"2024-09-17T05:37:46.051136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:59.076270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036315+0000","last_change":"2024-09-17T05:37:45.059449+0000","last_active":"2024-09-17T05:37:46.036315+0000","last_peered":"2024-09-17T05:37:46.036315+0000","last_clean":"2024-09-17T05:37:46.036315+0000","last_became_active":"2024-09-17T05:37:45.059104+0000","last_became_peered":"2024-09-17T05:37:45.059104+0000","last_unstale":"2024-09-17T05:37:46.036315+0000","last_undegraded":"2024-09-17T05:37:46.036315+0000","last_fullsized":"2024-09-17T05:37:46.036315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:52.588122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034593+0000","last_change":"2024-09-17T05:37:46.034593+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034593+0000","last_undegraded":"2024-09-17T05:37:46.034593+0000","last_fullsized":"2024-09-17T05:37:46.034593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.034994+0000","last_change":"2024-09-17T05:37:45.054509+0000","last_active":"2024-09-17T05:37:46.034994+0000","last_peered":"2024-09-17T05:37:46.034994+0000","last_clean":"2024-09-17T05:37:46.034994+0000","last_became_active":"2024-09-17T05:37:45.053870+0000","last_became_peered":"2024-09-17T05:37:45.053870+0000","last_unstale":"2024-09-17T05:37:46.034994+0000","last_undegraded":"2024-09-17T05:37:46.034994+0000","last_fullsized":"2024-09-17T05:37:46.034994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:11.666015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.054631+0000","last_change":"2024-09-17T05:37:46.052311+0000","last_active":"2024-09-17T05:37:46.054631+0000","last_peered":"2024-09-17T05:37:46.054631+0000","last_clean":"2024-09-17T05:37:46.054631+0000","last_became_active":"2024-09-17T05:37:46.051132+0000","last_became_peered":"2024-09-17T05:37:46.051132+0000","last_unstale":"2024-09-17T05:37:46.054631+0000","last_undegraded":"2024-09-17T05:37:46.054631+0000","last_fullsized":"2024-09-17T05:37:46.054631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:01.273341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047446+0000","last_change":"2024-09-17T05:37:45.058306+0000","last_active":"2024-09-17T05:37:46.047446+0000","last_peered":"2024-09-17T05:37:46.047446+0000","last_clean":"2024-09-17T05:37:46.047446+0000","last_became_active":"2024-09-17T05:37:45.057732+0000","last_became_peered":"2024-09-17T05:37:45.057732+0000","last_unstale":"2024-09-17T05:37:46.047446+0000","last_undegraded":"2024-09-17T05:37:46.047446+0000","last_fullsized":"2024-09-17T05:37:46.047446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:05.460762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.051599+0000","last_change":"2024-09-17T05:37:46.051599+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.051599+0000","last_undegraded":"2024-09-17T05:37:46.051599+0000","last_fullsized":"2024-09-17T05:37:46.051599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035840+0000","last_change":"2024-09-17T05:37:45.056408+0000","last_active":"2024-09-17T05:37:46.035840+0000","last_peered":"2024-09-17T05:37:46.035840+0000","last_clean":"2024-09-17T05:37:46.035840+0000","last_became_active":"2024-09-17T05:37:45.055291+0000","last_became_peered":"2024-09-17T05:37:45.055291+0000","last_unstale":"2024-09-17T05:37:46.035840+0000","last_undegraded":"2024-09-17T05:37:46.035840+0000","last_fullsized":"2024-09-17T05:37:46.035840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:59.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058363+0000","last_change":"2024-09-17T05:37:46.044901+0000","last_active":"2024-09-17T05:37:46.058363+0000","last_peered":"2024-09-17T05:37:46.058363+0000","last_clean":"2024-09-17T05:37:46.058363+0000","last_became_active":"2024-09-17T05:37:46.044421+0000","last_became_peered":"2024-09-17T05:37:46.044421+0000","last_unstale":"2024-09-17T05:37:46.058363+0000","last_undegraded":"2024-09-17T05:37:46.058363+0000","last_fullsized":"2024-09-17T05:37:46.058363+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:56.386485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.048866+0000","last_change":"2024-09-17T05:37:45.041226+0000","last_active":"2024-09-17T05:37:45.048866+0000","last_peered":"2024-09-17T05:37:45.048866+0000","last_clean":"2024-09-17T05:37:45.048866+0000","last_became_active":"2024-09-17T05:37:45.040877+0000","last_became_peered":"2024-09-17T05:37:45.040877+0000","last_unstale":"2024-09-17T05:37:45.048866+0000","last_undegraded":"2024-09-17T05:37:45.048866+0000","last_fullsized":"2024-09-17T05:37:45.048866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:22.674745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043557+0000","last_change":"2024-09-17T05:37:45.043557+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043557+0000","last_undegraded":"2024-09-17T05:37:45.043557+0000","last_fullsized":"2024-09-17T05:37:45.043557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037803+0000","last_change":"2024-09-17T05:37:45.059880+0000","last_active":"2024-09-17T05:37:46.037803+0000","last_peered":"2024-09-17T05:37:46.037803+0000","last_clean":"2024-09-17T05:37:46.037803+0000","last_became_active":"2024-09-17T05:37:45.059556+0000","last_became_peered":"2024-09-17T05:37:45.059556+0000","last_unstale":"2024-09-17T05:37:46.037803+0000","last_undegraded":"2024-09-17T05:37:46.037803+0000","last_fullsized":"2024-09-17T05:37:46.037803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:11.126039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.040025+0000","last_change":"2024-09-17T05:37:45.040025+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.040025+0000","last_undegraded":"2024-09-17T05:37:45.040025+0000","last_fullsized":"2024-09-17T05:37:45.040025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045495+0000","last_change":"2024-09-17T05:37:45.058285+0000","last_active":"2024-09-17T05:37:46.045495+0000","last_peered":"2024-09-17T05:37:46.045495+0000","last_clean":"2024-09-17T05:37:46.045495+0000","last_became_active":"2024-09-17T05:37:45.056912+0000","last_became_peered":"2024-09-17T05:37:45.056912+0000","last_unstale":"2024-09-17T05:37:46.045495+0000","last_undegraded":"2024-09-17T05:37:46.045495+0000","last_fullsized":"2024-09-17T05:37:46.045495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:26.430306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":163,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037763+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:37:46.037763+0000","last_peered":"2024-09-17T05:37:46.037763+0000","last_clean":"2024-09-17T05:37:46.037763+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:37:46.037763+0000","last_undegraded":"2024-09-17T05:37:46.037763+0000","last_fullsized":"2024-09-17T05:37:46.037763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":585728,"data_stored":255602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:51.110 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-17T05:37:51.110 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.049328+0000', 'last_change': '2024-09-17T05:37:46.049328+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.049328+0000', 'last_undegraded': '2024-09-17T05:37:46.049328+0000', 'last_fullsized': '2024-09-17T05:37:46.049328+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.110 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-17T05:37:51.110 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.040667+0000', 'last_change': '2024-09-17T05:37:46.040667+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.040667+0000', 'last_undegraded': '2024-09-17T05:37:46.040667+0000', 'last_fullsized': '2024-09-17T05:37:46.040667+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.110 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-17T05:37:51.110 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.047608+0000', 'last_change': '2024-09-17T05:37:46.047608+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.047608+0000', 'last_undegraded': '2024-09-17T05:37:46.047608+0000', 'last_fullsized': '2024-09-17T05:37:46.047608+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.042278+0000', 'last_change': '2024-09-17T05:37:45.042278+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.042278+0000', 'last_undegraded': '2024-09-17T05:37:45.042278+0000', 'last_fullsized': '2024-09-17T05:37:45.042278+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.039644+0000', 'last_change': '2024-09-17T05:37:46.039644+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.039644+0000', 'last_undegraded': '2024-09-17T05:37:46.039644+0000', 'last_fullsized': '2024-09-17T05:37:46.039644+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.049232+0000', 'last_change': '2024-09-17T05:37:46.049232+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.049232+0000', 'last_undegraded': '2024-09-17T05:37:46.049232+0000', 'last_fullsized': '2024-09-17T05:37:46.049232+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': ['7', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.043484+0000', 'last_change': '2024-09-17T05:37:45.043484+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.043484+0000', 'last_undegraded': '2024-09-17T05:37:45.043484+0000', 'last_fullsized': '2024-09-17T05:37:45.043484+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.042502+0000', 'last_change': '2024-09-17T05:37:45.042502+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.042502+0000', 'last_undegraded': '2024-09-17T05:37:45.042502+0000', 'last_fullsized': '2024-09-17T05:37:45.042502+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-17T05:37:51.111 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.036682+0000', 'last_change': '2024-09-17T05:37:46.036682+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.036682+0000', 'last_undegraded': '2024-09-17T05:37:46.036682+0000', 'last_fullsized': '2024-09-17T05:37:46.036682+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.049975+0000', 'last_change': '2024-09-17T05:37:46.049975+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.049975+0000', 'last_undegraded': '2024-09-17T05:37:46.049975+0000', 'last_fullsized': '2024-09-17T05:37:46.049975+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.039922+0000', 'last_change': '2024-09-17T05:37:46.039922+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.039922+0000', 'last_undegraded': '2024-09-17T05:37:46.039922+0000', 'last_fullsized': '2024-09-17T05:37:46.039922+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.034741+0000', 'last_change': '2024-09-17T05:37:46.034741+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.034741+0000', 'last_undegraded': '2024-09-17T05:37:46.034741+0000', 'last_fullsized': '2024-09-17T05:37:46.034741+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.046441+0000', 'last_change': '2024-09-17T05:37:46.046441+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.046441+0000', 'last_undegraded': '2024-09-17T05:37:46.046441+0000', 'last_fullsized': '2024-09-17T05:37:46.046441+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': ['2', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-17T05:37:51.112 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.039359+0000', 'last_change': '2024-09-17T05:37:46.039359+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.039359+0000', 'last_undegraded': '2024-09-17T05:37:46.039359+0000', 'last_fullsized': '2024-09-17T05:37:46.039359+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.035286+0000', 'last_change': '2024-09-17T05:37:46.035286+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.035286+0000', 'last_undegraded': '2024-09-17T05:37:46.035286+0000', 'last_fullsized': '2024-09-17T05:37:46.035286+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': ['4', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.043615+0000', 'last_change': '2024-09-17T05:37:45.043615+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.043615+0000', 'last_undegraded': '2024-09-17T05:37:45.043615+0000', 'last_fullsized': '2024-09-17T05:37:45.043615+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.046047+0000', 'last_change': '2024-09-17T05:37:46.046047+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.046047+0000', 'last_undegraded': '2024-09-17T05:37:46.046047+0000', 'last_fullsized': '2024-09-17T05:37:46.046047+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': ['2', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.044226+0000', 'last_change': '2024-09-17T05:37:46.044226+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.044226+0000', 'last_undegraded': '2024-09-17T05:37:46.044226+0000', 'last_fullsized': '2024-09-17T05:37:46.044226+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': ['2', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.035350+0000', 'last_change': '2024-09-17T05:37:46.035350+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.035350+0000', 'last_undegraded': '2024-09-17T05:37:46.035350+0000', 'last_fullsized': '2024-09-17T05:37:46.035350+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-17T05:37:51.113 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.036201+0000', 'last_change': '2024-09-17T05:37:46.036201+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.036201+0000', 'last_undegraded': '2024-09-17T05:37:46.036201+0000', 'last_fullsized': '2024-09-17T05:37:46.036201+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.039722+0000', 'last_change': '2024-09-17T05:37:45.039722+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.039722+0000', 'last_undegraded': '2024-09-17T05:37:45.039722+0000', 'last_fullsized': '2024-09-17T05:37:45.039722+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.035830+0000', 'last_change': '2024-09-17T05:37:46.035830+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.035830+0000', 'last_undegraded': '2024-09-17T05:37:46.035830+0000', 'last_fullsized': '2024-09-17T05:37:46.035830+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.040514+0000', 'last_change': '2024-09-17T05:37:46.040514+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.040514+0000', 'last_undegraded': '2024-09-17T05:37:46.040514+0000', 'last_fullsized': '2024-09-17T05:37:46.040514+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.039438+0000', 'last_change': '2024-09-17T05:37:45.039438+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.039438+0000', 'last_undegraded': '2024-09-17T05:37:45.039438+0000', 'last_fullsized': '2024-09-17T05:37:45.039438+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.039328+0000', 'last_change': '2024-09-17T05:37:46.039328+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.039328+0000', 'last_undegraded': '2024-09-17T05:37:46.039328+0000', 'last_fullsized': '2024-09-17T05:37:46.039328+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-17T05:37:51.114 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.047638+0000', 'last_change': '2024-09-17T05:37:46.047638+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.047638+0000', 'last_undegraded': '2024-09-17T05:37:46.047638+0000', 'last_fullsized': '2024-09-17T05:37:46.047638+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.043992+0000', 'last_change': '2024-09-17T05:37:45.043992+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.043992+0000', 'last_undegraded': '2024-09-17T05:37:45.043992+0000', 'last_fullsized': '2024-09-17T05:37:45.043992+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.050303+0000', 'last_change': '2024-09-17T05:37:46.050303+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.050303+0000', 'last_undegraded': '2024-09-17T05:37:46.050303+0000', 'last_fullsized': '2024-09-17T05:37:46.050303+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.043135+0000', 'last_change': '2024-09-17T05:37:45.043135+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.043135+0000', 'last_undegraded': '2024-09-17T05:37:45.043135+0000', 'last_fullsized': '2024-09-17T05:37:45.043135+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.045646+0000', 'last_change': '2024-09-17T05:37:46.045646+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.045646+0000', 'last_undegraded': '2024-09-17T05:37:46.045646+0000', 'last_fullsized': '2024-09-17T05:37:46.045646+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': ['2', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.039765+0000', 'last_change': '2024-09-17T05:37:46.039765+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.039765+0000', 'last_undegraded': '2024-09-17T05:37:46.039765+0000', 'last_fullsized': '2024-09-17T05:37:46.039765+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.115 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.042857+0000', 'last_change': '2024-09-17T05:37:45.042857+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.042857+0000', 'last_undegraded': '2024-09-17T05:37:45.042857+0000', 'last_fullsized': '2024-09-17T05:37:45.042857+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.037570+0000', 'last_change': '2024-09-17T05:37:46.037570+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.037570+0000', 'last_undegraded': '2024-09-17T05:37:46.037570+0000', 'last_fullsized': '2024-09-17T05:37:46.037570+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.034593+0000', 'last_change': '2024-09-17T05:37:46.034593+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.034593+0000', 'last_undegraded': '2024-09-17T05:37:46.034593+0000', 'last_fullsized': '2024-09-17T05:37:46.034593+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 50, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:37:46.051599+0000', 'last_change': '2024-09-17T05:37:46.051599+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:46.051599+0000', 'last_undegraded': '2024-09-17T05:37:46.051599+0000', 'last_fullsized': '2024-09-17T05:37:46.051599+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': ['2', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.043557+0000', 'last_change': '2024-09-17T05:37:45.043557+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.043557+0000', 'last_undegraded': '2024-09-17T05:37:45.043557+0000', 'last_fullsized': '2024-09-17T05:37:45.043557+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-17T05:37:51.116 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:37:45.040025+0000', 'last_change': '2024-09-17T05:37:45.040025+0000', 'last_active': '2024-09-17T05:37:45.020384+0000', 'last_peered': '2024-09-17T05:37:45.020384+0000', 'last_clean': '2024-09-17T05:37:45.020384+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:37:45.040025+0000', 'last_undegraded': '2024-09-17T05:37:45.040025+0000', 'last_fullsized': '2024-09-17T05:37:45.040025+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'last_clean_scrub_stamp': '2024-09-17T05:37:45.020384+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:37:51.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:37:51.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- 172.21.15.44:0/4089471938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 msgr2=0x7f12400cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 --2- 172.21.15.44:0/4089471938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400cb880 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f124006ace0 tx=0x7f123801caf0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- 172.21.15.44:0/4089471938 shutdown_connections 2024-09-17T05:37:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 --2- 172.21.15.44:0/4089471938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400cb880 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 --2- 172.21.15.44:0/4089471938 >> v2:172.21.15.86:3300/0 conn(0x7f1240072e50 0x7f124015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- 172.21.15.44:0/4089471938 >> 172.21.15.44:0/4089471938 conn(0x7f12400ccaa0 msgr2=0x7f12400cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- 172.21.15.44:0/4089471938 shutdown_connections 2024-09-17T05:37:51.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- 172.21.15.44:0/4089471938 wait complete. 2024-09-17T05:37:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 Processor -- start 2024-09-17T05:37:51.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- start start 2024-09-17T05:37:51.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124006de50 0x7f12400b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1240072e50 0x7f124015d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1240168e80 con 0x7f12400cb470 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1240168d00 con 0x7f124006de50 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.310+0000 7f1245400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1240169000 con 0x7f1240072e50 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60290/0 (socket says 172.21.15.44:60290) 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 -- 172.21.15.44:0/590975407 learned_addr learned my addr 172.21.15.44:0/590975407 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123e800640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124006de50 0x7f12400b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1237e00640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1240072e50 0x7f124015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 -- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1240072e50 msgr2=0x7f124015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1240072e50 0x7f124015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 -- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124006de50 msgr2=0x7f12400b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124006de50 0x7f12400b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 -- 172.21.15.44:0/590975407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1240158820 con 0x7f12400cb470 2024-09-17T05:37:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123e800640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124006de50 0x7f12400b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f123f200640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400b2e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f123801c560 tx=0x7f1238009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1236a00640 1 -- 172.21.15.44:0/590975407 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380b2040 con 0x7f12400cb470 2024-09-17T05:37:51.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1236a00640 1 -- 172.21.15.44:0/590975407 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12380bb070 con 0x7f12400cb470 2024-09-17T05:37:51.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1236a00640 1 -- 172.21.15.44:0/590975407 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238004590 con 0x7f12400cb470 2024-09-17T05:37:51.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1240158b00 con 0x7f12400cb470 2024-09-17T05:37:51.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12401590c0 con 0x7f12400cb470 2024-09-17T05:37:51.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124015de40 con 0x7f12400cb470 2024-09-17T05:37:51.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.314+0000 7f1236a00640 1 -- 172.21.15.44:0/590975407 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f12380c0460 con 0x7f12400cb470 2024-09-17T05:37:51.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.318+0000 7f1236a00640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f121c073230 0x7f121c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.318+0000 7f1236a00640 1 -- 172.21.15.44:0/590975407 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f123812f830 con 0x7f12400cb470 2024-09-17T05:37:51.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.318+0000 7f123e800640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f121c073230 0x7f121c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.318+0000 7f123e800640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f121c073230 0x7f121c075740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1230005fd0 tx=0x7f1230005f20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:51.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.318+0000 7f1236a00640 1 -- 172.21.15.44:0/590975407 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f124015de40 con 0x7f12400cb470 2024-09-17T05:37:51.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.554+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f12400cb880 con 0x7f12400cb470 2024-09-17T05:37:51.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.554+0000 7f1236a00640 1 -- 172.21.15.44:0/590975407 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1607 (secure 0 0 0) 0x7f1238016770 con 0x7f12400cb470 2024-09-17T05:37:51.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:51.556 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":120,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551365,"num_in_osds":8,"osd_in_since":1726551355,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":60},{"state_name":"creating+activating","count":26},{"state_name":"creating+peering","count":11}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":591130,"bytes_used":231530496,"bytes_avail":772862582784,"bytes_total":773094113280,"inactive_pgs_ratio":0.38144329190254211,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5343}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-17T05:37:34.278229+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:37:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f121c073230 msgr2=0x7f121c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f121c073230 0x7f121c075740 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1230005fd0 tx=0x7f1230005f20 comp rx=0 tx=0).stop 2024-09-17T05:37:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 msgr2=0x7f12400b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400b2e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f123801c560 tx=0x7f1238009200 comp rx=0 tx=0).stop 2024-09-17T05:37:51.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 shutdown_connections 2024-09-17T05:37:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12400cb470 0x7f12400b2e70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1240072e50 0x7f124015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f121c073230 0x7f121c075740 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 --2- 172.21.15.44:0/590975407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124006de50 0x7f12400b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 >> 172.21.15.44:0/590975407 conn(0x7f12400ccaa0 msgr2=0x7f124009f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 shutdown_connections 2024-09-17T05:37:51.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.558+0000 7f1245400640 1 -- 172.21.15.44:0/590975407 wait complete. 2024-09-17T05:37:51.578 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:37:51.578 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 -- 172.21.15.44:0/88745443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 msgr2=0x7fde4c004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 --2- 172.21.15.44:0/88745443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 0x7fde4c004070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fde58009b10 tx=0x7fde5801d250 comp rx=0 tx=0).stop 2024-09-17T05:37:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6d000640 1 -- 172.21.15.44:0/88745443 reap_dead start 2024-09-17T05:37:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 -- 172.21.15.44:0/88745443 shutdown_connections 2024-09-17T05:37:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 -- 172.21.15.44:0/88745443 >> 172.21.15.44:0/88745443 conn(0x7fde68073ce0 msgr2=0x7fde680740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 -- 172.21.15.44:0/88745443 shutdown_connections 2024-09-17T05:37:51.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 -- 172.21.15.44:0/88745443 wait complete. 2024-09-17T05:37:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 Processor -- start 2024-09-17T05:37:51.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.738+0000 7fde6da00640 1 -- start start 2024-09-17T05:37:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 0x7fde6813d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6813a180 0x7fde6813a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde6813bf80 0x7fde6813c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde68168a10 con 0x7fde4c003c20 2024-09-17T05:37:51.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fde68168890 con 0x7fde6813a180 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fde68168b90 con 0x7fde6813bf80 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 0x7fde6813d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 0x7fde6813d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60308/0 (socket says 172.21.15.44:60308) 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 -- 172.21.15.44:0/3211138179 learned_addr learned my addr 172.21.15.44:0/3211138179 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde5fe00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6813a180 0x7fde6813a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6d000640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde6813bf80 0x7fde6813c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 -- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde6813bf80 msgr2=0x7fde6813c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde6813bf80 0x7fde6813c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 -- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6813a180 msgr2=0x7fde6813a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6813a180 0x7fde6813a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 -- 172.21.15.44:0/3211138179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6813c8d0 con 0x7fde4c003c20 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6d000640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde6813bf80 0x7fde6813c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:51.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde67e00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 0x7fde6813d910 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fde580af040 tx=0x7fde58005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde64c00640 1 -- 172.21.15.44:0/3211138179 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde580b1070 con 0x7fde4c003c20 2024-09-17T05:37:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde64c00640 1 -- 172.21.15.44:0/3211138179 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde580b2040 con 0x7fde4c003c20 2024-09-17T05:37:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde64c00640 1 -- 172.21.15.44:0/3211138179 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde580acb40 con 0x7fde4c003c20 2024-09-17T05:37:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6813e250 con 0x7fde4c003c20 2024-09-17T05:37:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6813e810 con 0x7fde4c003c20 2024-09-17T05:37:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde680cfe70 con 0x7fde4c003c20 2024-09-17T05:37:51.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.742+0000 7fde64c00640 1 -- 172.21.15.44:0/3211138179 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fde580c1060 con 0x7fde4c003c20 2024-09-17T05:37:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.746+0000 7fde64c00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.746+0000 7fde64c00640 1 -- 172.21.15.44:0/3211138179 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fde5812ed70 con 0x7fde4c003c20 2024-09-17T05:37:51.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.746+0000 7fde5fe00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:51.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.746+0000 7fde5fe00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fde50001060 tx=0x7fde500011f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:51.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.750+0000 7fde64c00640 1 -- 172.21.15.44:0/3211138179 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fde6813c8d0 con 0x7fde4c003c20 2024-09-17T05:37:51.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.918+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde681446b0 con 0x7fde44073200 2024-09-17T05:37:51.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.926+0000 7fde64c00640 1 -- 172.21.15.44:0/3211138179 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249153 (secure 0 0 0) 0x7fde681446b0 con 0x7fde44073200 2024-09-17T05:37:51.928 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:51.929 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:37:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 msgr2=0x7fde44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fde50001060 tx=0x7fde500011f0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 msgr2=0x7fde6813d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:51.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 0x7fde6813d910 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fde580af040 tx=0x7fde58005600 comp rx=0 tx=0).stop 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 shutdown_connections 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde6813bf80 0x7fde6813c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde44073200 0x7fde44075710 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde6813a180 0x7fde6813a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 --2- 172.21.15.44:0/3211138179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde4c003c20 0x7fde6813d910 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 >> 172.21.15.44:0/3211138179 conn(0x7fde68073ce0 msgr2=0x7fde6806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 shutdown_connections 2024-09-17T05:37:51.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:51.930+0000 7fde6da00640 1 -- 172.21.15.44:0/3211138179 wait complete. 2024-09-17T05:37:51.949 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-17T05:37:50.281602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591130,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":132,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226104,"kb_used_data":5680,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748616,"statfs":{"total":773094113280,"available":772862582784,"internally_reserved":0,"allocated":5816320,"data_stored":3189824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001587"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697288+0000","last_change":"2024-09-17T05:37:46.072522+0000","last_active":"2024-09-17T05:37:47.697288+0000","last_peered":"2024-09-17T05:37:47.697288+0000","last_clean":"2024-09-17T05:37:47.697288+0000","last_became_active":"2024-09-17T05:37:46.072094+0000","last_became_peered":"2024-09-17T05:37:46.072094+0000","last_unstale":"2024-09-17T05:37:47.697288+0000","last_undegraded":"2024-09-17T05:37:47.697288+0000","last_fullsized":"2024-09-17T05:37:47.697288+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:14.754849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049328+0000","last_change":"2024-09-17T05:37:46.049328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049328+0000","last_undegraded":"2024-09-17T05:37:46.049328+0000","last_fullsized":"2024-09-17T05:37:46.049328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055291+0000","last_change":"2024-09-17T05:37:46.050394+0000","last_active":"2024-09-17T05:37:46.055291+0000","last_peered":"2024-09-17T05:37:46.055291+0000","last_clean":"2024-09-17T05:37:46.055291+0000","last_became_active":"2024-09-17T05:37:46.050088+0000","last_became_peered":"2024-09-17T05:37:46.050088+0000","last_unstale":"2024-09-17T05:37:46.055291+0000","last_undegraded":"2024-09-17T05:37:46.055291+0000","last_fullsized":"2024-09-17T05:37:46.055291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:40:20.021978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040667+0000","last_change":"2024-09-17T05:37:46.040667+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040667+0000","last_undegraded":"2024-09-17T05:37:46.040667+0000","last_fullsized":"2024-09-17T05:37:46.040667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047608+0000","last_change":"2024-09-17T05:37:46.047608+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047608+0000","last_undegraded":"2024-09-17T05:37:46.047608+0000","last_fullsized":"2024-09-17T05:37:46.047608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042278+0000","last_change":"2024-09-17T05:37:45.042278+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042278+0000","last_undegraded":"2024-09-17T05:37:45.042278+0000","last_fullsized":"2024-09-17T05:37:45.042278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039644+0000","last_change":"2024-09-17T05:37:46.039644+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039644+0000","last_undegraded":"2024-09-17T05:37:46.039644+0000","last_fullsized":"2024-09-17T05:37:46.039644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049232+0000","last_change":"2024-09-17T05:37:46.049232+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049232+0000","last_undegraded":"2024-09-17T05:37:46.049232+0000","last_fullsized":"2024-09-17T05:37:46.049232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":["7","6"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055932+0000","last_change":"2024-09-17T05:37:46.055821+0000","last_active":"2024-09-17T05:37:46.055932+0000","last_peered":"2024-09-17T05:37:46.055932+0000","last_clean":"2024-09-17T05:37:46.055932+0000","last_became_active":"2024-09-17T05:37:46.054639+0000","last_became_peered":"2024-09-17T05:37:46.054639+0000","last_unstale":"2024-09-17T05:37:46.055932+0000","last_undegraded":"2024-09-17T05:37:46.055932+0000","last_fullsized":"2024-09-17T05:37:46.055932+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:58.176243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058676+0000","last_change":"2024-09-17T05:37:46.058567+0000","last_active":"2024-09-17T05:37:46.058676+0000","last_peered":"2024-09-17T05:37:46.058676+0000","last_clean":"2024-09-17T05:37:46.058676+0000","last_became_active":"2024-09-17T05:37:46.058112+0000","last_became_peered":"2024-09-17T05:37:46.058112+0000","last_unstale":"2024-09-17T05:37:46.058676+0000","last_undegraded":"2024-09-17T05:37:46.058676+0000","last_fullsized":"2024-09-17T05:37:46.058676+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:49.621091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696909+0000","last_change":"2024-09-17T05:37:46.048148+0000","last_active":"2024-09-17T05:37:47.696909+0000","last_peered":"2024-09-17T05:37:47.696909+0000","last_clean":"2024-09-17T05:37:47.696909+0000","last_became_active":"2024-09-17T05:37:46.047809+0000","last_became_peered":"2024-09-17T05:37:46.047809+0000","last_unstale":"2024-09-17T05:37:47.696909+0000","last_undegraded":"2024-09-17T05:37:47.696909+0000","last_fullsized":"2024-09-17T05:37:47.696909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:16.926041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043484+0000","last_change":"2024-09-17T05:37:45.043484+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043484+0000","last_undegraded":"2024-09-17T05:37:45.043484+0000","last_fullsized":"2024-09-17T05:37:45.043484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042502+0000","last_change":"2024-09-17T05:37:45.042502+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042502+0000","last_undegraded":"2024-09-17T05:37:45.042502+0000","last_fullsized":"2024-09-17T05:37:45.042502+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696453+0000","last_change":"2024-09-17T05:37:46.074957+0000","last_active":"2024-09-17T05:37:47.696453+0000","last_peered":"2024-09-17T05:37:47.696453+0000","last_clean":"2024-09-17T05:37:47.696453+0000","last_became_active":"2024-09-17T05:37:46.074636+0000","last_became_peered":"2024-09-17T05:37:46.074636+0000","last_unstale":"2024-09-17T05:37:47.696453+0000","last_undegraded":"2024-09-17T05:37:47.696453+0000","last_fullsized":"2024-09-17T05:37:47.696453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:29.802032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036682+0000","last_change":"2024-09-17T05:37:46.036682+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036682+0000","last_undegraded":"2024-09-17T05:37:46.036682+0000","last_fullsized":"2024-09-17T05:37:46.036682+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.049975+0000","last_change":"2024-09-17T05:37:46.049975+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.049975+0000","last_undegraded":"2024-09-17T05:37:46.049975+0000","last_fullsized":"2024-09-17T05:37:46.049975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697818+0000","last_change":"2024-09-17T05:37:46.059031+0000","last_active":"2024-09-17T05:37:47.697818+0000","last_peered":"2024-09-17T05:37:47.697818+0000","last_clean":"2024-09-17T05:37:47.697818+0000","last_became_active":"2024-09-17T05:37:46.058482+0000","last_became_peered":"2024-09-17T05:37:46.058482+0000","last_unstale":"2024-09-17T05:37:47.697818+0000","last_undegraded":"2024-09-17T05:37:47.697818+0000","last_fullsized":"2024-09-17T05:37:47.697818+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:57.156256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039922+0000","last_change":"2024-09-17T05:37:46.039922+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039922+0000","last_undegraded":"2024-09-17T05:37:46.039922+0000","last_fullsized":"2024-09-17T05:37:46.039922+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034741+0000","last_change":"2024-09-17T05:37:46.034741+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034741+0000","last_undegraded":"2024-09-17T05:37:46.034741+0000","last_fullsized":"2024-09-17T05:37:46.034741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046441+0000","last_change":"2024-09-17T05:37:46.046441+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046441+0000","last_undegraded":"2024-09-17T05:37:46.046441+0000","last_fullsized":"2024-09-17T05:37:46.046441+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":["2","0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039359+0000","last_change":"2024-09-17T05:37:46.039359+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039359+0000","last_undegraded":"2024-09-17T05:37:46.039359+0000","last_fullsized":"2024-09-17T05:37:46.039359+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053120+0000","last_change":"2024-09-17T05:37:46.048168+0000","last_active":"2024-09-17T05:37:46.053120+0000","last_peered":"2024-09-17T05:37:46.053120+0000","last_clean":"2024-09-17T05:37:46.053120+0000","last_became_active":"2024-09-17T05:37:46.047785+0000","last_became_peered":"2024-09-17T05:37:46.047785+0000","last_unstale":"2024-09-17T05:37:46.053120+0000","last_undegraded":"2024-09-17T05:37:46.053120+0000","last_fullsized":"2024-09-17T05:37:46.053120+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:09.371434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057668+0000","last_change":"2024-09-17T05:37:46.057518+0000","last_active":"2024-09-17T05:37:46.057668+0000","last_peered":"2024-09-17T05:37:46.057668+0000","last_clean":"2024-09-17T05:37:46.057668+0000","last_became_active":"2024-09-17T05:37:46.057188+0000","last_became_peered":"2024-09-17T05:37:46.057188+0000","last_unstale":"2024-09-17T05:37:46.057668+0000","last_undegraded":"2024-09-17T05:37:46.057668+0000","last_fullsized":"2024-09-17T05:37:46.057668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:38.494638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.055630+0000","last_change":"2024-09-17T05:37:46.055514+0000","last_active":"2024-09-17T05:37:46.055630+0000","last_peered":"2024-09-17T05:37:46.055630+0000","last_clean":"2024-09-17T05:37:46.055630+0000","last_became_active":"2024-09-17T05:37:46.055184+0000","last_became_peered":"2024-09-17T05:37:46.055184+0000","last_unstale":"2024-09-17T05:37:46.055630+0000","last_undegraded":"2024-09-17T05:37:46.055630+0000","last_fullsized":"2024-09-17T05:37:46.055630+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:36.128340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697508+0000","last_change":"2024-09-17T05:37:46.059902+0000","last_active":"2024-09-17T05:37:47.697508+0000","last_peered":"2024-09-17T05:37:47.697508+0000","last_clean":"2024-09-17T05:37:47.697508+0000","last_became_active":"2024-09-17T05:37:46.059620+0000","last_became_peered":"2024-09-17T05:37:46.059620+0000","last_unstale":"2024-09-17T05:37:47.697508+0000","last_undegraded":"2024-09-17T05:37:47.697508+0000","last_fullsized":"2024-09-17T05:37:47.697508+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:38.719755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035286+0000","last_change":"2024-09-17T05:37:46.035286+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035286+0000","last_undegraded":"2024-09-17T05:37:46.035286+0000","last_fullsized":"2024-09-17T05:37:46.035286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":["4","7"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043615+0000","last_change":"2024-09-17T05:37:45.043615+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043615+0000","last_undegraded":"2024-09-17T05:37:45.043615+0000","last_fullsized":"2024-09-17T05:37:45.043615+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.046047+0000","last_change":"2024-09-17T05:37:46.046047+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.046047+0000","last_undegraded":"2024-09-17T05:37:46.046047+0000","last_fullsized":"2024-09-17T05:37:46.046047+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":["2","5"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696657+0000","last_change":"2024-09-17T05:37:46.069098+0000","last_active":"2024-09-17T05:37:47.696657+0000","last_peered":"2024-09-17T05:37:47.696657+0000","last_clean":"2024-09-17T05:37:47.696657+0000","last_became_active":"2024-09-17T05:37:46.068168+0000","last_became_peered":"2024-09-17T05:37:46.068168+0000","last_unstale":"2024-09-17T05:37:47.696657+0000","last_undegraded":"2024-09-17T05:37:47.696657+0000","last_fullsized":"2024-09-17T05:37:47.696657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:47.470382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045326+0000","last_change":"2024-09-17T05:37:46.040392+0000","last_active":"2024-09-17T05:37:46.045326+0000","last_peered":"2024-09-17T05:37:46.045326+0000","last_clean":"2024-09-17T05:37:46.045326+0000","last_became_active":"2024-09-17T05:37:46.040050+0000","last_became_peered":"2024-09-17T05:37:46.040050+0000","last_unstale":"2024-09-17T05:37:46.045326+0000","last_undegraded":"2024-09-17T05:37:46.045326+0000","last_fullsized":"2024-09-17T05:37:46.045326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:30.608968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052985+0000","last_change":"2024-09-17T05:37:46.046598+0000","last_active":"2024-09-17T05:37:46.052985+0000","last_peered":"2024-09-17T05:37:46.052985+0000","last_clean":"2024-09-17T05:37:46.052985+0000","last_became_active":"2024-09-17T05:37:46.045641+0000","last_became_peered":"2024-09-17T05:37:46.045641+0000","last_unstale":"2024-09-17T05:37:46.052985+0000","last_undegraded":"2024-09-17T05:37:46.052985+0000","last_fullsized":"2024-09-17T05:37:46.052985+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:56.105991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.044226+0000","last_change":"2024-09-17T05:37:46.044226+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.044226+0000","last_undegraded":"2024-09-17T05:37:46.044226+0000","last_fullsized":"2024-09-17T05:37:46.044226+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":["2","6"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035350+0000","last_change":"2024-09-17T05:37:46.035350+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035350+0000","last_undegraded":"2024-09-17T05:37:46.035350+0000","last_fullsized":"2024-09-17T05:37:46.035350+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056824+0000","last_change":"2024-09-17T05:37:45.050863+0000","last_active":"2024-09-17T05:37:45.056824+0000","last_peered":"2024-09-17T05:37:45.056824+0000","last_clean":"2024-09-17T05:37:45.056824+0000","last_became_active":"2024-09-17T05:37:45.050504+0000","last_became_peered":"2024-09-17T05:37:45.050504+0000","last_unstale":"2024-09-17T05:37:45.056824+0000","last_undegraded":"2024-09-17T05:37:45.056824+0000","last_fullsized":"2024-09-17T05:37:45.056824+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:08.862087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.048391+0000","last_change":"2024-09-17T05:37:46.045999+0000","last_active":"2024-09-17T05:37:46.048391+0000","last_peered":"2024-09-17T05:37:46.048391+0000","last_clean":"2024-09-17T05:37:46.048391+0000","last_became_active":"2024-09-17T05:37:46.045674+0000","last_became_peered":"2024-09-17T05:37:46.045674+0000","last_unstale":"2024-09-17T05:37:46.048391+0000","last_undegraded":"2024-09-17T05:37:46.048391+0000","last_fullsized":"2024-09-17T05:37:46.048391+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:00.337771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070859+0000","last_change":"2024-09-17T05:37:45.065829+0000","last_active":"2024-09-17T05:37:45.070859+0000","last_peered":"2024-09-17T05:37:45.070859+0000","last_clean":"2024-09-17T05:37:45.070859+0000","last_became_active":"2024-09-17T05:37:45.065496+0000","last_became_peered":"2024-09-17T05:37:45.065496+0000","last_unstale":"2024-09-17T05:37:45.070859+0000","last_undegraded":"2024-09-17T05:37:45.070859+0000","last_fullsized":"2024-09-17T05:37:45.070859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:44.588632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.036201+0000","last_change":"2024-09-17T05:37:46.036201+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.036201+0000","last_undegraded":"2024-09-17T05:37:46.036201+0000","last_fullsized":"2024-09-17T05:37:46.036201+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045479+0000","last_change":"2024-09-17T05:37:45.061814+0000","last_active":"2024-09-17T05:37:46.045479+0000","last_peered":"2024-09-17T05:37:46.045479+0000","last_clean":"2024-09-17T05:37:46.045479+0000","last_became_active":"2024-09-17T05:37:45.061436+0000","last_became_peered":"2024-09-17T05:37:45.061436+0000","last_unstale":"2024-09-17T05:37:46.045479+0000","last_undegraded":"2024-09-17T05:37:46.045479+0000","last_fullsized":"2024-09-17T05:37:46.045479+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:21.256652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051721+0000","last_change":"2024-09-17T05:37:46.045530+0000","last_active":"2024-09-17T05:37:46.051721+0000","last_peered":"2024-09-17T05:37:46.051721+0000","last_clean":"2024-09-17T05:37:46.051721+0000","last_became_active":"2024-09-17T05:37:46.044880+0000","last_became_peered":"2024-09-17T05:37:46.044880+0000","last_unstale":"2024-09-17T05:37:46.051721+0000","last_undegraded":"2024-09-17T05:37:46.051721+0000","last_fullsized":"2024-09-17T05:37:46.051721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:30.249849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047610+0000","last_change":"2024-09-17T05:37:45.054678+0000","last_active":"2024-09-17T05:37:46.047610+0000","last_peered":"2024-09-17T05:37:46.047610+0000","last_clean":"2024-09-17T05:37:46.047610+0000","last_became_active":"2024-09-17T05:37:45.053608+0000","last_became_peered":"2024-09-17T05:37:45.053608+0000","last_unstale":"2024-09-17T05:37:46.047610+0000","last_undegraded":"2024-09-17T05:37:46.047610+0000","last_fullsized":"2024-09-17T05:37:46.047610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039722+0000","last_change":"2024-09-17T05:37:45.039722+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039722+0000","last_undegraded":"2024-09-17T05:37:45.039722+0000","last_fullsized":"2024-09-17T05:37:45.039722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036323+0000","last_change":"2024-09-17T05:37:45.056140+0000","last_active":"2024-09-17T05:37:46.036323+0000","last_peered":"2024-09-17T05:37:46.036323+0000","last_clean":"2024-09-17T05:37:46.036323+0000","last_became_active":"2024-09-17T05:37:45.055568+0000","last_became_peered":"2024-09-17T05:37:45.055568+0000","last_unstale":"2024-09-17T05:37:46.036323+0000","last_undegraded":"2024-09-17T05:37:46.036323+0000","last_fullsized":"2024-09-17T05:37:46.036323+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:29.119041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.035830+0000","last_change":"2024-09-17T05:37:46.035830+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.035830+0000","last_undegraded":"2024-09-17T05:37:46.035830+0000","last_fullsized":"2024-09-17T05:37:46.035830+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036562+0000","last_change":"2024-09-17T05:37:45.057805+0000","last_active":"2024-09-17T05:37:46.036562+0000","last_peered":"2024-09-17T05:37:46.036562+0000","last_clean":"2024-09-17T05:37:46.036562+0000","last_became_active":"2024-09-17T05:37:45.057474+0000","last_became_peered":"2024-09-17T05:37:45.057474+0000","last_unstale":"2024-09-17T05:37:46.036562+0000","last_undegraded":"2024-09-17T05:37:46.036562+0000","last_fullsized":"2024-09-17T05:37:46.036562+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:11.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.062330+0000","last_change":"2024-09-17T05:37:46.057006+0000","last_active":"2024-09-17T05:37:46.062330+0000","last_peered":"2024-09-17T05:37:46.062330+0000","last_clean":"2024-09-17T05:37:46.062330+0000","last_became_active":"2024-09-17T05:37:46.056679+0000","last_became_peered":"2024-09-17T05:37:46.056679+0000","last_unstale":"2024-09-17T05:37:46.062330+0000","last_undegraded":"2024-09-17T05:37:46.062330+0000","last_fullsized":"2024-09-17T05:37:46.062330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:16.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037442+0000","last_change":"2024-09-17T05:37:45.055516+0000","last_active":"2024-09-17T05:37:46.037442+0000","last_peered":"2024-09-17T05:37:46.037442+0000","last_clean":"2024-09-17T05:37:46.037442+0000","last_became_active":"2024-09-17T05:37:45.055191+0000","last_became_peered":"2024-09-17T05:37:45.055191+0000","last_unstale":"2024-09-17T05:37:46.037442+0000","last_undegraded":"2024-09-17T05:37:46.037442+0000","last_fullsized":"2024-09-17T05:37:46.037442+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:50.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.040514+0000","last_change":"2024-09-17T05:37:46.040514+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.040514+0000","last_undegraded":"2024-09-17T05:37:46.040514+0000","last_fullsized":"2024-09-17T05:37:46.040514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035127+0000","last_change":"2024-09-17T05:37:45.051689+0000","last_active":"2024-09-17T05:37:46.035127+0000","last_peered":"2024-09-17T05:37:46.035127+0000","last_clean":"2024-09-17T05:37:46.035127+0000","last_became_active":"2024-09-17T05:37:45.051347+0000","last_became_peered":"2024-09-17T05:37:45.051347+0000","last_unstale":"2024-09-17T05:37:46.035127+0000","last_undegraded":"2024-09-17T05:37:46.035127+0000","last_fullsized":"2024-09-17T05:37:46.035127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:18.596842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.039438+0000","last_change":"2024-09-17T05:37:45.039438+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.039438+0000","last_undegraded":"2024-09-17T05:37:45.039438+0000","last_fullsized":"2024-09-17T05:37:45.039438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040896+0000","last_change":"2024-09-17T05:37:45.052131+0000","last_active":"2024-09-17T05:37:46.040896+0000","last_peered":"2024-09-17T05:37:46.040896+0000","last_clean":"2024-09-17T05:37:46.040896+0000","last_became_active":"2024-09-17T05:37:45.051781+0000","last_became_peered":"2024-09-17T05:37:45.051781+0000","last_unstale":"2024-09-17T05:37:46.040896+0000","last_undegraded":"2024-09-17T05:37:46.040896+0000","last_fullsized":"2024-09-17T05:37:46.040896+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:29.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039328+0000","last_change":"2024-09-17T05:37:46.039328+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039328+0000","last_undegraded":"2024-09-17T05:37:46.039328+0000","last_fullsized":"2024-09-17T05:37:46.039328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040265+0000","last_change":"2024-09-17T05:37:45.064805+0000","last_active":"2024-09-17T05:37:46.040265+0000","last_peered":"2024-09-17T05:37:46.040265+0000","last_clean":"2024-09-17T05:37:46.040265+0000","last_became_active":"2024-09-17T05:37:45.064425+0000","last_became_peered":"2024-09-17T05:37:45.064425+0000","last_unstale":"2024-09-17T05:37:46.040265+0000","last_undegraded":"2024-09-17T05:37:46.040265+0000","last_fullsized":"2024-09-17T05:37:46.040265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696514+0000","last_change":"2024-09-17T05:37:46.064206+0000","last_active":"2024-09-17T05:37:47.696514+0000","last_peered":"2024-09-17T05:37:47.696514+0000","last_clean":"2024-09-17T05:37:47.696514+0000","last_became_active":"2024-09-17T05:37:46.054901+0000","last_became_peered":"2024-09-17T05:37:46.054901+0000","last_unstale":"2024-09-17T05:37:47.696514+0000","last_undegraded":"2024-09-17T05:37:47.696514+0000","last_fullsized":"2024-09-17T05:37:47.696514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:00.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036261+0000","last_change":"2024-09-17T05:37:45.059681+0000","last_active":"2024-09-17T05:37:46.036261+0000","last_peered":"2024-09-17T05:37:46.036261+0000","last_clean":"2024-09-17T05:37:46.036261+0000","last_became_active":"2024-09-17T05:37:45.059319+0000","last_became_peered":"2024-09-17T05:37:45.059319+0000","last_unstale":"2024-09-17T05:37:46.036261+0000","last_undegraded":"2024-09-17T05:37:46.036261+0000","last_fullsized":"2024-09-17T05:37:46.036261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:32.941882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.047638+0000","last_change":"2024-09-17T05:37:46.047638+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.047638+0000","last_undegraded":"2024-09-17T05:37:46.047638+0000","last_fullsized":"2024-09-17T05:37:46.047638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'5","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045140+0000","last_change":"2024-09-17T05:37:45.055492+0000","last_active":"2024-09-17T05:37:46.045140+0000","last_peered":"2024-09-17T05:37:46.045140+0000","last_clean":"2024-09-17T05:37:46.045140+0000","last_became_active":"2024-09-17T05:37:45.054184+0000","last_became_peered":"2024-09-17T05:37:45.054184+0000","last_unstale":"2024-09-17T05:37:46.045140+0000","last_undegraded":"2024-09-17T05:37:46.045140+0000","last_fullsized":"2024-09-17T05:37:46.045140+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:33.159363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.057435+0000","last_change":"2024-09-17T05:37:46.057339+0000","last_active":"2024-09-17T05:37:46.057435+0000","last_peered":"2024-09-17T05:37:46.057435+0000","last_clean":"2024-09-17T05:37:46.057435+0000","last_became_active":"2024-09-17T05:37:46.057017+0000","last_became_peered":"2024-09-17T05:37:46.057017+0000","last_unstale":"2024-09-17T05:37:46.057435+0000","last_undegraded":"2024-09-17T05:37:46.057435+0000","last_fullsized":"2024-09-17T05:37:46.057435+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:23.965638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.071346+0000","last_change":"2024-09-17T05:37:45.069218+0000","last_active":"2024-09-17T05:37:45.071346+0000","last_peered":"2024-09-17T05:37:45.071346+0000","last_clean":"2024-09-17T05:37:45.071346+0000","last_became_active":"2024-09-17T05:37:45.068997+0000","last_became_peered":"2024-09-17T05:37:45.068997+0000","last_unstale":"2024-09-17T05:37:45.071346+0000","last_undegraded":"2024-09-17T05:37:45.071346+0000","last_fullsized":"2024-09-17T05:37:45.071346+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:47.820940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696941+0000","last_change":"2024-09-17T05:37:46.076000+0000","last_active":"2024-09-17T05:37:47.696941+0000","last_peered":"2024-09-17T05:37:47.696941+0000","last_clean":"2024-09-17T05:37:47.696941+0000","last_became_active":"2024-09-17T05:37:46.075703+0000","last_became_peered":"2024-09-17T05:37:46.075703+0000","last_unstale":"2024-09-17T05:37:47.696941+0000","last_undegraded":"2024-09-17T05:37:47.696941+0000","last_fullsized":"2024-09-17T05:37:47.696941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:13.038600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.039483+0000","last_change":"2024-09-17T05:37:45.059842+0000","last_active":"2024-09-17T05:37:46.039483+0000","last_peered":"2024-09-17T05:37:46.039483+0000","last_clean":"2024-09-17T05:37:46.039483+0000","last_became_active":"2024-09-17T05:37:45.059402+0000","last_became_peered":"2024-09-17T05:37:45.059402+0000","last_unstale":"2024-09-17T05:37:46.039483+0000","last_undegraded":"2024-09-17T05:37:46.039483+0000","last_fullsized":"2024-09-17T05:37:46.039483+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:43.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043992+0000","last_change":"2024-09-17T05:37:45.043992+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043992+0000","last_undegraded":"2024-09-17T05:37:45.043992+0000","last_fullsized":"2024-09-17T05:37:45.043992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.056507+0000","last_change":"2024-09-17T05:37:45.053989+0000","last_active":"2024-09-17T05:37:45.056507+0000","last_peered":"2024-09-17T05:37:45.056507+0000","last_clean":"2024-09-17T05:37:45.056507+0000","last_became_active":"2024-09-17T05:37:45.053641+0000","last_became_peered":"2024-09-17T05:37:45.053641+0000","last_unstale":"2024-09-17T05:37:45.056507+0000","last_undegraded":"2024-09-17T05:37:45.056507+0000","last_fullsized":"2024-09-17T05:37:45.056507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:28.048481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.053848+0000","last_change":"2024-09-17T05:37:46.049142+0000","last_active":"2024-09-17T05:37:46.053848+0000","last_peered":"2024-09-17T05:37:46.053848+0000","last_clean":"2024-09-17T05:37:46.053848+0000","last_became_active":"2024-09-17T05:37:46.047150+0000","last_became_peered":"2024-09-17T05:37:46.047150+0000","last_unstale":"2024-09-17T05:37:46.053848+0000","last_undegraded":"2024-09-17T05:37:46.053848+0000","last_fullsized":"2024-09-17T05:37:46.053848+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:05.829528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.050418+0000","last_change":"2024-09-17T05:37:45.066676+0000","last_active":"2024-09-17T05:37:46.050418+0000","last_peered":"2024-09-17T05:37:46.050418+0000","last_clean":"2024-09-17T05:37:46.050418+0000","last_became_active":"2024-09-17T05:37:45.065923+0000","last_became_peered":"2024-09-17T05:37:45.065923+0000","last_unstale":"2024-09-17T05:37:46.050418+0000","last_undegraded":"2024-09-17T05:37:46.050418+0000","last_fullsized":"2024-09-17T05:37:46.050418+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.741795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.052777+0000","last_change":"2024-09-17T05:37:46.049677+0000","last_active":"2024-09-17T05:37:46.052777+0000","last_peered":"2024-09-17T05:37:46.052777+0000","last_clean":"2024-09-17T05:37:46.052777+0000","last_became_active":"2024-09-17T05:37:46.049320+0000","last_became_peered":"2024-09-17T05:37:46.049320+0000","last_unstale":"2024-09-17T05:37:46.052777+0000","last_undegraded":"2024-09-17T05:37:46.052777+0000","last_fullsized":"2024-09-17T05:37:46.052777+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:43.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.070891+0000","last_change":"2024-09-17T05:37:45.066669+0000","last_active":"2024-09-17T05:37:45.070891+0000","last_peered":"2024-09-17T05:37:45.070891+0000","last_clean":"2024-09-17T05:37:45.070891+0000","last_became_active":"2024-09-17T05:37:45.065484+0000","last_became_peered":"2024-09-17T05:37:45.065484+0000","last_unstale":"2024-09-17T05:37:45.070891+0000","last_undegraded":"2024-09-17T05:37:45.070891+0000","last_fullsized":"2024-09-17T05:37:45.070891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:18.322336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696374+0000","last_change":"2024-09-17T05:37:46.065321+0000","last_active":"2024-09-17T05:37:47.696374+0000","last_peered":"2024-09-17T05:37:47.696374+0000","last_clean":"2024-09-17T05:37:47.696374+0000","last_became_active":"2024-09-17T05:37:46.056405+0000","last_became_peered":"2024-09-17T05:37:46.056405+0000","last_unstale":"2024-09-17T05:37:47.696374+0000","last_undegraded":"2024-09-17T05:37:47.696374+0000","last_fullsized":"2024-09-17T05:37:47.696374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.795082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.068109+0000","last_change":"2024-09-17T05:37:45.065048+0000","last_active":"2024-09-17T05:37:45.068109+0000","last_peered":"2024-09-17T05:37:45.068109+0000","last_clean":"2024-09-17T05:37:45.068109+0000","last_became_active":"2024-09-17T05:37:45.064525+0000","last_became_peered":"2024-09-17T05:37:45.064525+0000","last_unstale":"2024-09-17T05:37:45.068109+0000","last_undegraded":"2024-09-17T05:37:45.068109+0000","last_fullsized":"2024-09-17T05:37:45.068109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:21.117699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.050303+0000","last_change":"2024-09-17T05:37:46.050303+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.050303+0000","last_undegraded":"2024-09-17T05:37:46.050303+0000","last_fullsized":"2024-09-17T05:37:46.050303+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.040173+0000","last_change":"2024-09-17T05:37:45.054993+0000","last_active":"2024-09-17T05:37:46.040173+0000","last_peered":"2024-09-17T05:37:46.040173+0000","last_clean":"2024-09-17T05:37:46.040173+0000","last_became_active":"2024-09-17T05:37:45.054655+0000","last_became_peered":"2024-09-17T05:37:45.054655+0000","last_unstale":"2024-09-17T05:37:46.040173+0000","last_undegraded":"2024-09-17T05:37:46.040173+0000","last_fullsized":"2024-09-17T05:37:46.040173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043135+0000","last_change":"2024-09-17T05:37:45.043135+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043135+0000","last_undegraded":"2024-09-17T05:37:45.043135+0000","last_fullsized":"2024-09-17T05:37:45.043135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.049698+0000","last_change":"2024-09-17T05:37:45.061423+0000","last_active":"2024-09-17T05:37:46.049698+0000","last_peered":"2024-09-17T05:37:46.049698+0000","last_clean":"2024-09-17T05:37:46.049698+0000","last_became_active":"2024-09-17T05:37:45.061101+0000","last_became_peered":"2024-09-17T05:37:45.061101+0000","last_unstale":"2024-09-17T05:37:46.049698+0000","last_undegraded":"2024-09-17T05:37:46.049698+0000","last_fullsized":"2024-09-17T05:37:46.049698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.045646+0000","last_change":"2024-09-17T05:37:46.045646+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.045646+0000","last_undegraded":"2024-09-17T05:37:46.045646+0000","last_fullsized":"2024-09-17T05:37:46.045646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":["2","3"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696422+0000","last_change":"2024-09-17T05:37:45.059259+0000","last_active":"2024-09-17T05:37:47.696422+0000","last_peered":"2024-09-17T05:37:47.696422+0000","last_clean":"2024-09-17T05:37:47.696422+0000","last_became_active":"2024-09-17T05:37:45.058953+0000","last_became_peered":"2024-09-17T05:37:45.058953+0000","last_unstale":"2024-09-17T05:37:47.696422+0000","last_undegraded":"2024-09-17T05:37:47.696422+0000","last_fullsized":"2024-09-17T05:37:47.696422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:43.576998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.039765+0000","last_change":"2024-09-17T05:37:46.039765+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.039765+0000","last_undegraded":"2024-09-17T05:37:46.039765+0000","last_fullsized":"2024-09-17T05:37:46.039765+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035716+0000","last_change":"2024-09-17T05:37:45.051009+0000","last_active":"2024-09-17T05:37:46.035716+0000","last_peered":"2024-09-17T05:37:46.035716+0000","last_clean":"2024-09-17T05:37:46.035716+0000","last_became_active":"2024-09-17T05:37:45.049848+0000","last_became_peered":"2024-09-17T05:37:45.049848+0000","last_unstale":"2024-09-17T05:37:46.035716+0000","last_undegraded":"2024-09-17T05:37:46.035716+0000","last_fullsized":"2024-09-17T05:37:46.035716+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.903947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696998+0000","last_change":"2024-09-17T05:37:46.057468+0000","last_active":"2024-09-17T05:37:47.696998+0000","last_peered":"2024-09-17T05:37:47.696998+0000","last_clean":"2024-09-17T05:37:47.696998+0000","last_became_active":"2024-09-17T05:37:46.057127+0000","last_became_peered":"2024-09-17T05:37:46.057127+0000","last_unstale":"2024-09-17T05:37:47.696998+0000","last_undegraded":"2024-09-17T05:37:47.696998+0000","last_fullsized":"2024-09-17T05:37:47.696998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:46.077247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044481+0000","last_change":"2024-09-17T05:37:45.060323+0000","last_active":"2024-09-17T05:37:46.044481+0000","last_peered":"2024-09-17T05:37:46.044481+0000","last_clean":"2024-09-17T05:37:46.044481+0000","last_became_active":"2024-09-17T05:37:45.059994+0000","last_became_peered":"2024-09-17T05:37:45.059994+0000","last_unstale":"2024-09-17T05:37:46.044481+0000","last_undegraded":"2024-09-17T05:37:46.044481+0000","last_fullsized":"2024-09-17T05:37:46.044481+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:48.441696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.042857+0000","last_change":"2024-09-17T05:37:45.042857+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.042857+0000","last_undegraded":"2024-09-17T05:37:45.042857+0000","last_fullsized":"2024-09-17T05:37:45.042857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.044576+0000","last_change":"2024-09-17T05:37:45.059701+0000","last_active":"2024-09-17T05:37:46.044576+0000","last_peered":"2024-09-17T05:37:46.044576+0000","last_clean":"2024-09-17T05:37:46.044576+0000","last_became_active":"2024-09-17T05:37:45.059353+0000","last_became_peered":"2024-09-17T05:37:45.059353+0000","last_unstale":"2024-09-17T05:37:46.044576+0000","last_undegraded":"2024-09-17T05:37:46.044576+0000","last_fullsized":"2024-09-17T05:37:46.044576+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:05.240575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.037570+0000","last_change":"2024-09-17T05:37:46.037570+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.037570+0000","last_undegraded":"2024-09-17T05:37:46.037570+0000","last_fullsized":"2024-09-17T05:37:46.037570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035670+0000","last_change":"2024-09-17T05:37:45.055888+0000","last_active":"2024-09-17T05:37:46.035670+0000","last_peered":"2024-09-17T05:37:46.035670+0000","last_clean":"2024-09-17T05:37:46.035670+0000","last_became_active":"2024-09-17T05:37:45.055540+0000","last_became_peered":"2024-09-17T05:37:45.055540+0000","last_unstale":"2024-09-17T05:37:46.035670+0000","last_undegraded":"2024-09-17T05:37:46.035670+0000","last_fullsized":"2024-09-17T05:37:46.035670+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:05.374513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.051136+0000","last_change":"2024-09-17T05:37:46.045881+0000","last_active":"2024-09-17T05:37:46.051136+0000","last_peered":"2024-09-17T05:37:46.051136+0000","last_clean":"2024-09-17T05:37:46.051136+0000","last_became_active":"2024-09-17T05:37:46.045557+0000","last_became_peered":"2024-09-17T05:37:46.045557+0000","last_unstale":"2024-09-17T05:37:46.051136+0000","last_undegraded":"2024-09-17T05:37:46.051136+0000","last_fullsized":"2024-09-17T05:37:46.051136+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:59.076270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.036315+0000","last_change":"2024-09-17T05:37:45.059449+0000","last_active":"2024-09-17T05:37:46.036315+0000","last_peered":"2024-09-17T05:37:46.036315+0000","last_clean":"2024-09-17T05:37:46.036315+0000","last_became_active":"2024-09-17T05:37:45.059104+0000","last_became_peered":"2024-09-17T05:37:45.059104+0000","last_unstale":"2024-09-17T05:37:46.036315+0000","last_undegraded":"2024-09-17T05:37:46.036315+0000","last_fullsized":"2024-09-17T05:37:46.036315+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:52.588122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.034593+0000","last_change":"2024-09-17T05:37:46.034593+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.034593+0000","last_undegraded":"2024-09-17T05:37:46.034593+0000","last_fullsized":"2024-09-17T05:37:46.034593+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.034994+0000","last_change":"2024-09-17T05:37:45.054509+0000","last_active":"2024-09-17T05:37:46.034994+0000","last_peered":"2024-09-17T05:37:46.034994+0000","last_clean":"2024-09-17T05:37:46.034994+0000","last_became_active":"2024-09-17T05:37:45.053870+0000","last_became_peered":"2024-09-17T05:37:45.053870+0000","last_unstale":"2024-09-17T05:37:46.034994+0000","last_undegraded":"2024-09-17T05:37:46.034994+0000","last_fullsized":"2024-09-17T05:37:46.034994+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:11.666015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.054631+0000","last_change":"2024-09-17T05:37:46.052311+0000","last_active":"2024-09-17T05:37:46.054631+0000","last_peered":"2024-09-17T05:37:46.054631+0000","last_clean":"2024-09-17T05:37:46.054631+0000","last_became_active":"2024-09-17T05:37:46.051132+0000","last_became_peered":"2024-09-17T05:37:46.051132+0000","last_unstale":"2024-09-17T05:37:46.054631+0000","last_undegraded":"2024-09-17T05:37:46.054631+0000","last_fullsized":"2024-09-17T05:37:46.054631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:01.273341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.047446+0000","last_change":"2024-09-17T05:37:45.058306+0000","last_active":"2024-09-17T05:37:46.047446+0000","last_peered":"2024-09-17T05:37:46.047446+0000","last_clean":"2024-09-17T05:37:46.047446+0000","last_became_active":"2024-09-17T05:37:45.057732+0000","last_became_peered":"2024-09-17T05:37:45.057732+0000","last_unstale":"2024-09-17T05:37:46.047446+0000","last_undegraded":"2024-09-17T05:37:46.047446+0000","last_fullsized":"2024-09-17T05:37:46.047446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:05.460762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":3,"reported_epoch":50,"state":"creating+activating","last_fresh":"2024-09-17T05:37:46.051599+0000","last_change":"2024-09-17T05:37:46.051599+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:46.051599+0000","last_undegraded":"2024-09-17T05:37:46.051599+0000","last_fullsized":"2024-09-17T05:37:46.051599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":["2","7"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.035840+0000","last_change":"2024-09-17T05:37:45.056408+0000","last_active":"2024-09-17T05:37:46.035840+0000","last_peered":"2024-09-17T05:37:46.035840+0000","last_clean":"2024-09-17T05:37:46.035840+0000","last_became_active":"2024-09-17T05:37:45.055291+0000","last_became_peered":"2024-09-17T05:37:45.055291+0000","last_unstale":"2024-09-17T05:37:46.035840+0000","last_undegraded":"2024-09-17T05:37:46.035840+0000","last_fullsized":"2024-09-17T05:37:46.035840+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:59.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.058363+0000","last_change":"2024-09-17T05:37:46.044901+0000","last_active":"2024-09-17T05:37:46.058363+0000","last_peered":"2024-09-17T05:37:46.058363+0000","last_clean":"2024-09-17T05:37:46.058363+0000","last_became_active":"2024-09-17T05:37:46.044421+0000","last_became_peered":"2024-09-17T05:37:46.044421+0000","last_unstale":"2024-09-17T05:37:46.058363+0000","last_undegraded":"2024-09-17T05:37:46.058363+0000","last_fullsized":"2024-09-17T05:37:46.058363+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:56.386485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-17T05:37:45.048866+0000","last_change":"2024-09-17T05:37:45.041226+0000","last_active":"2024-09-17T05:37:45.048866+0000","last_peered":"2024-09-17T05:37:45.048866+0000","last_clean":"2024-09-17T05:37:45.048866+0000","last_became_active":"2024-09-17T05:37:45.040877+0000","last_became_peered":"2024-09-17T05:37:45.040877+0000","last_unstale":"2024-09-17T05:37:45.048866+0000","last_undegraded":"2024-09-17T05:37:45.048866+0000","last_fullsized":"2024-09-17T05:37:45.048866+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:22.674745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.043557+0000","last_change":"2024-09-17T05:37:45.043557+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.043557+0000","last_undegraded":"2024-09-17T05:37:45.043557+0000","last_fullsized":"2024-09-17T05:37:45.043557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037803+0000","last_change":"2024-09-17T05:37:45.059880+0000","last_active":"2024-09-17T05:37:46.037803+0000","last_peered":"2024-09-17T05:37:46.037803+0000","last_clean":"2024-09-17T05:37:46.037803+0000","last_became_active":"2024-09-17T05:37:45.059556+0000","last_became_peered":"2024-09-17T05:37:45.059556+0000","last_unstale":"2024-09-17T05:37:46.037803+0000","last_undegraded":"2024-09-17T05:37:46.037803+0000","last_fullsized":"2024-09-17T05:37:46.037803+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:11.126039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-17T05:37:45.040025+0000","last_change":"2024-09-17T05:37:45.040025+0000","last_active":"2024-09-17T05:37:45.020384+0000","last_peered":"2024-09-17T05:37:45.020384+0000","last_clean":"2024-09-17T05:37:45.020384+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:37:45.040025+0000","last_undegraded":"2024-09-17T05:37:45.040025+0000","last_fullsized":"2024-09-17T05:37:45.040025+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.045495+0000","last_change":"2024-09-17T05:37:45.058285+0000","last_active":"2024-09-17T05:37:46.045495+0000","last_peered":"2024-09-17T05:37:46.045495+0000","last_clean":"2024-09-17T05:37:46.045495+0000","last_became_active":"2024-09-17T05:37:45.056912+0000","last_became_peered":"2024-09-17T05:37:45.056912+0000","last_unstale":"2024-09-17T05:37:46.045495+0000","last_undegraded":"2024-09-17T05:37:46.045495+0000","last_fullsized":"2024-09-17T05:37:46.045495+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:26.430306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":163,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-17T05:37:46.037763+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:37:46.037763+0000","last_peered":"2024-09-17T05:37:46.037763+0000","last_clean":"2024-09-17T05:37:46.037763+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:37:46.037763+0000","last_undegraded":"2024-09-17T05:37:46.037763+0000","last_fullsized":"2024-09-17T05:37:46.037763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":762,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":585728,"data_stored":255602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1167360,"data_stored":838803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":573440,"data_stored":248435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:55.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:55.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 -- 172.21.15.44:0/2485447980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea00cb470 msgr2=0x7fcea00cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2485447980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea00cb470 0x7fcea00cb880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fce98009c80 tx=0x7fce9801cd10 comp rx=0 tx=0).stop 2024-09-17T05:37:55.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 -- 172.21.15.44:0/2485447980 shutdown_connections 2024-09-17T05:37:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2485447980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea00cb470 0x7fcea00cb880 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2485447980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcea0072e50 0x7fcea015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 -- 172.21.15.44:0/2485447980 >> 172.21.15.44:0/2485447980 conn(0x7fcea00ccaa0 msgr2=0x7fcea00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 -- 172.21.15.44:0/2485447980 shutdown_connections 2024-09-17T05:37:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 -- 172.21.15.44:0/2485447980 wait complete. 2024-09-17T05:37:55.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 Processor -- start 2024-09-17T05:37:55.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.182+0000 7fcea7a00640 1 -- start start 2024-09-17T05:37:55.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcea006de50 0x7fcea00aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea0072e50 0x7fcea009edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcea00cb470 0x7fcea00702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcea0168fc0 con 0x7fcea0072e50 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcea0168e40 con 0x7fcea00cb470 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fcea0169140 con 0x7fcea006de50 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea0072e50 0x7fcea009edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea0072e50 0x7fcea009edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60324/0 (socket says 172.21.15.44:60324) 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 -- 172.21.15.44:0/2562511864 learned_addr learned my addr 172.21.15.44:0/2562511864 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea5000640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcea006de50 0x7fcea00aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea5a00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcea00cb470 0x7fcea00702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 -- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcea006de50 msgr2=0x7fcea00aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcea006de50 0x7fcea00aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 -- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcea00cb470 msgr2=0x7fcea00702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcea00cb470 0x7fcea00702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 -- 172.21.15.44:0/2562511864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea009f310 con 0x7fcea0072e50 2024-09-17T05:37:55.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9fe00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea0072e50 0x7fcea009edd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00b390 tx=0x7fce8c00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:55.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9cc00640 1 -- 172.21.15.44:0/2562511864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c015020 con 0x7fcea0072e50 2024-09-17T05:37:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9cc00640 1 -- 172.21.15.44:0/2562511864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce8c011920 con 0x7fcea0072e50 2024-09-17T05:37:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9cc00640 1 -- 172.21.15.44:0/2562511864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c011d70 con 0x7fcea0072e50 2024-09-17T05:37:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea00a0cf0 con 0x7fcea0072e50 2024-09-17T05:37:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea015b300 con 0x7fcea0072e50 2024-09-17T05:37:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea015e990 con 0x7fcea0072e50 2024-09-17T05:37:55.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.186+0000 7fce9cc00640 1 -- 172.21.15.44:0/2562511864 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce8c018020 con 0x7fcea0072e50 2024-09-17T05:37:55.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.190+0000 7fce9cc00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce80073200 0x7fce80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.190+0000 7fce9cc00640 1 -- 172.21.15.44:0/2562511864 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fce8c0941b0 con 0x7fcea0072e50 2024-09-17T05:37:55.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.190+0000 7fcea5000640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce80073200 0x7fce80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:55.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.190+0000 7fcea5000640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce80073200 0x7fce80075710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fce940098f0 tx=0x7fce94006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:55.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.194+0000 7fce9cc00640 1 -- 172.21.15.44:0/2562511864 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fce8c01f020 con 0x7fcea0072e50 2024-09-17T05:37:55.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.365+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcea00a0fd0 con 0x7fce80073200 2024-09-17T05:37:55.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.369+0000 7fce9cc00640 1 -- 172.21.15.44:0/2562511864 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7fce94009540 con 0x7fce80073200 2024-09-17T05:37:55.375 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce80073200 msgr2=0x7fce80075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce80073200 0x7fce80075710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fce940098f0 tx=0x7fce94006f90 comp rx=0 tx=0).stop 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea0072e50 msgr2=0x7fcea009edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea0072e50 0x7fcea009edd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00b390 tx=0x7fce8c00b850 comp rx=0 tx=0).stop 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 shutdown_connections 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce80073200 0x7fce80075710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcea00cb470 0x7fcea00702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcea0072e50 0x7fcea009edd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 --2- 172.21.15.44:0/2562511864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcea006de50 0x7fcea00aef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 >> 172.21.15.44:0/2562511864 conn(0x7fcea00ccaa0 msgr2=0x7fcea00cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 shutdown_connections 2024-09-17T05:37:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.373+0000 7fcea7a00640 1 -- 172.21.15.44:0/2562511864 wait complete. 2024-09-17T05:37:55.395 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-17T05:37:54.282576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226300,"kb_used_data":5896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748420,"statfs":{"total":773094113280,"available":772862382080,"internally_reserved":0,"allocated":6037504,"data_stored":3283908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.250993"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697288+0000","last_change":"2024-09-17T05:37:46.072522+0000","last_active":"2024-09-17T05:37:47.697288+0000","last_peered":"2024-09-17T05:37:47.697288+0000","last_clean":"2024-09-17T05:37:47.697288+0000","last_became_active":"2024-09-17T05:37:46.072094+0000","last_became_peered":"2024-09-17T05:37:46.072094+0000","last_unstale":"2024-09-17T05:37:47.697288+0000","last_undegraded":"2024-09-17T05:37:47.697288+0000","last_fullsized":"2024-09-17T05:37:47.697288+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:14.754849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697608+0000","last_change":"2024-09-17T05:37:46.069291+0000","last_active":"2024-09-17T05:37:47.697608+0000","last_peered":"2024-09-17T05:37:47.697608+0000","last_clean":"2024-09-17T05:37:47.697608+0000","last_became_active":"2024-09-17T05:37:46.068970+0000","last_became_peered":"2024-09-17T05:37:46.068970+0000","last_unstale":"2024-09-17T05:37:47.697608+0000","last_undegraded":"2024-09-17T05:37:47.697608+0000","last_fullsized":"2024-09-17T05:37:47.697608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:01.974836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036208+0000","last_change":"2024-09-17T05:37:46.050394+0000","last_active":"2024-09-17T05:37:47.036208+0000","last_peered":"2024-09-17T05:37:47.036208+0000","last_clean":"2024-09-17T05:37:47.036208+0000","last_became_active":"2024-09-17T05:37:46.050088+0000","last_became_peered":"2024-09-17T05:37:46.050088+0000","last_unstale":"2024-09-17T05:37:47.036208+0000","last_undegraded":"2024-09-17T05:37:47.036208+0000","last_fullsized":"2024-09-17T05:37:47.036208+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:08.489485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036013+0000","last_change":"2024-09-17T05:37:46.064442+0000","last_active":"2024-09-17T05:37:47.036013+0000","last_peered":"2024-09-17T05:37:47.036013+0000","last_clean":"2024-09-17T05:37:47.036013+0000","last_became_active":"2024-09-17T05:37:46.064134+0000","last_became_peered":"2024-09-17T05:37:46.064134+0000","last_unstale":"2024-09-17T05:37:47.036013+0000","last_undegraded":"2024-09-17T05:37:47.036013+0000","last_fullsized":"2024-09-17T05:37:47.036013+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:46.974979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697594+0000","last_change":"2024-09-17T05:37:46.061447+0000","last_active":"2024-09-17T05:37:47.697594+0000","last_peered":"2024-09-17T05:37:47.697594+0000","last_clean":"2024-09-17T05:37:47.697594+0000","last_became_active":"2024-09-17T05:37:46.061127+0000","last_became_peered":"2024-09-17T05:37:46.061127+0000","last_unstale":"2024-09-17T05:37:47.697594+0000","last_undegraded":"2024-09-17T05:37:47.697594+0000","last_fullsized":"2024-09-17T05:37:47.697594+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:46.974979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570760+0000","last_change":"2024-09-17T05:37:46.074738+0000","last_active":"2024-09-17T05:37:47.570760+0000","last_peered":"2024-09-17T05:37:47.570760+0000","last_clean":"2024-09-17T05:37:47.570760+0000","last_became_active":"2024-09-17T05:37:46.070767+0000","last_became_peered":"2024-09-17T05:37:46.070767+0000","last_unstale":"2024-09-17T05:37:47.570760+0000","last_undegraded":"2024-09-17T05:37:47.570760+0000","last_fullsized":"2024-09-17T05:37:47.570760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:34.162609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697534+0000","last_change":"2024-09-17T05:37:46.064118+0000","last_active":"2024-09-17T05:37:47.697534+0000","last_peered":"2024-09-17T05:37:47.697534+0000","last_clean":"2024-09-17T05:37:47.697534+0000","last_became_active":"2024-09-17T05:37:46.063803+0000","last_became_peered":"2024-09-17T05:37:46.063803+0000","last_unstale":"2024-09-17T05:37:47.697534+0000","last_undegraded":"2024-09-17T05:37:47.697534+0000","last_fullsized":"2024-09-17T05:37:47.697534+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:13.234569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570946+0000","last_change":"2024-09-17T05:37:46.075180+0000","last_active":"2024-09-17T05:37:47.570946+0000","last_peered":"2024-09-17T05:37:47.570946+0000","last_clean":"2024-09-17T05:37:47.570946+0000","last_became_active":"2024-09-17T05:37:46.074855+0000","last_became_peered":"2024-09-17T05:37:46.074855+0000","last_unstale":"2024-09-17T05:37:47.570946+0000","last_undegraded":"2024-09-17T05:37:47.570946+0000","last_fullsized":"2024-09-17T05:37:47.570946+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:06.156437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036895+0000","last_change":"2024-09-17T05:37:46.055821+0000","last_active":"2024-09-17T05:37:47.036895+0000","last_peered":"2024-09-17T05:37:47.036895+0000","last_clean":"2024-09-17T05:37:47.036895+0000","last_became_active":"2024-09-17T05:37:46.054639+0000","last_became_peered":"2024-09-17T05:37:46.054639+0000","last_unstale":"2024-09-17T05:37:47.036895+0000","last_undegraded":"2024-09-17T05:37:47.036895+0000","last_fullsized":"2024-09-17T05:37:47.036895+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:49.132652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697868+0000","last_change":"2024-09-17T05:37:46.058567+0000","last_active":"2024-09-17T05:37:47.697868+0000","last_peered":"2024-09-17T05:37:47.697868+0000","last_clean":"2024-09-17T05:37:47.697868+0000","last_became_active":"2024-09-17T05:37:46.058112+0000","last_became_peered":"2024-09-17T05:37:46.058112+0000","last_unstale":"2024-09-17T05:37:47.697868+0000","last_undegraded":"2024-09-17T05:37:47.697868+0000","last_fullsized":"2024-09-17T05:37:47.697868+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:12.669261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696909+0000","last_change":"2024-09-17T05:37:46.048148+0000","last_active":"2024-09-17T05:37:47.696909+0000","last_peered":"2024-09-17T05:37:47.696909+0000","last_clean":"2024-09-17T05:37:47.696909+0000","last_became_active":"2024-09-17T05:37:46.047809+0000","last_became_peered":"2024-09-17T05:37:46.047809+0000","last_unstale":"2024-09-17T05:37:47.696909+0000","last_undegraded":"2024-09-17T05:37:47.696909+0000","last_fullsized":"2024-09-17T05:37:47.696909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:16.926041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.571289+0000","last_change":"2024-09-17T05:37:46.080933+0000","last_active":"2024-09-17T05:37:47.571289+0000","last_peered":"2024-09-17T05:37:47.571289+0000","last_clean":"2024-09-17T05:37:47.571289+0000","last_became_active":"2024-09-17T05:37:46.080605+0000","last_became_peered":"2024-09-17T05:37:46.080605+0000","last_unstale":"2024-09-17T05:37:47.571289+0000","last_undegraded":"2024-09-17T05:37:47.571289+0000","last_fullsized":"2024-09-17T05:37:47.571289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:22.739418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570652+0000","last_change":"2024-09-17T05:37:46.079803+0000","last_active":"2024-09-17T05:37:47.570652+0000","last_peered":"2024-09-17T05:37:47.570652+0000","last_clean":"2024-09-17T05:37:47.570652+0000","last_became_active":"2024-09-17T05:37:46.078383+0000","last_became_peered":"2024-09-17T05:37:46.078383+0000","last_unstale":"2024-09-17T05:37:47.570652+0000","last_undegraded":"2024-09-17T05:37:47.570652+0000","last_fullsized":"2024-09-17T05:37:47.570652+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:09.865333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696453+0000","last_change":"2024-09-17T05:37:46.074957+0000","last_active":"2024-09-17T05:37:47.696453+0000","last_peered":"2024-09-17T05:37:47.696453+0000","last_clean":"2024-09-17T05:37:47.696453+0000","last_became_active":"2024-09-17T05:37:46.074636+0000","last_became_peered":"2024-09-17T05:37:46.074636+0000","last_unstale":"2024-09-17T05:37:47.696453+0000","last_undegraded":"2024-09-17T05:37:47.696453+0000","last_fullsized":"2024-09-17T05:37:47.696453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:29.802032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035630+0000","last_change":"2024-09-17T05:37:46.055928+0000","last_active":"2024-09-17T05:37:47.035630+0000","last_peered":"2024-09-17T05:37:47.035630+0000","last_clean":"2024-09-17T05:37:47.035630+0000","last_became_active":"2024-09-17T05:37:46.055482+0000","last_became_peered":"2024-09-17T05:37:46.055482+0000","last_unstale":"2024-09-17T05:37:47.035630+0000","last_undegraded":"2024-09-17T05:37:47.035630+0000","last_fullsized":"2024-09-17T05:37:47.035630+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:34:11.464914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570540+0000","last_change":"2024-09-17T05:37:46.080888+0000","last_active":"2024-09-17T05:37:47.570540+0000","last_peered":"2024-09-17T05:37:47.570540+0000","last_clean":"2024-09-17T05:37:47.570540+0000","last_became_active":"2024-09-17T05:37:46.080506+0000","last_became_peered":"2024-09-17T05:37:46.080506+0000","last_unstale":"2024-09-17T05:37:47.570540+0000","last_undegraded":"2024-09-17T05:37:47.570540+0000","last_fullsized":"2024-09-17T05:37:47.570540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:02.859102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697818+0000","last_change":"2024-09-17T05:37:46.059031+0000","last_active":"2024-09-17T05:37:47.697818+0000","last_peered":"2024-09-17T05:37:47.697818+0000","last_clean":"2024-09-17T05:37:47.697818+0000","last_became_active":"2024-09-17T05:37:46.058482+0000","last_became_peered":"2024-09-17T05:37:46.058482+0000","last_unstale":"2024-09-17T05:37:47.697818+0000","last_undegraded":"2024-09-17T05:37:47.697818+0000","last_fullsized":"2024-09-17T05:37:47.697818+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:57.156256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036376+0000","last_change":"2024-09-17T05:37:46.071353+0000","last_active":"2024-09-17T05:37:47.036376+0000","last_peered":"2024-09-17T05:37:47.036376+0000","last_clean":"2024-09-17T05:37:47.036376+0000","last_became_active":"2024-09-17T05:37:46.071021+0000","last_became_peered":"2024-09-17T05:37:46.071021+0000","last_unstale":"2024-09-17T05:37:47.036376+0000","last_undegraded":"2024-09-17T05:37:47.036376+0000","last_fullsized":"2024-09-17T05:37:47.036376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:58.966226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036231+0000","last_change":"2024-09-17T05:37:46.068354+0000","last_active":"2024-09-17T05:37:47.036231+0000","last_peered":"2024-09-17T05:37:47.036231+0000","last_clean":"2024-09-17T05:37:47.036231+0000","last_became_active":"2024-09-17T05:37:46.068018+0000","last_became_peered":"2024-09-17T05:37:46.068018+0000","last_unstale":"2024-09-17T05:37:47.036231+0000","last_undegraded":"2024-09-17T05:37:47.036231+0000","last_fullsized":"2024-09-17T05:37:47.036231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:01.210408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697289+0000","last_change":"2024-09-17T05:37:46.064783+0000","last_active":"2024-09-17T05:37:47.697289+0000","last_peered":"2024-09-17T05:37:47.697289+0000","last_clean":"2024-09-17T05:37:47.697289+0000","last_became_active":"2024-09-17T05:37:46.064451+0000","last_became_peered":"2024-09-17T05:37:46.064451+0000","last_unstale":"2024-09-17T05:37:47.697289+0000","last_undegraded":"2024-09-17T05:37:47.697289+0000","last_fullsized":"2024-09-17T05:37:47.697289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:22.739418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035745+0000","last_change":"2024-09-17T05:37:46.058393+0000","last_active":"2024-09-17T05:37:47.035745+0000","last_peered":"2024-09-17T05:37:47.035745+0000","last_clean":"2024-09-17T05:37:47.035745+0000","last_became_active":"2024-09-17T05:37:46.058037+0000","last_became_peered":"2024-09-17T05:37:46.058037+0000","last_unstale":"2024-09-17T05:37:47.035745+0000","last_undegraded":"2024-09-17T05:37:47.035745+0000","last_fullsized":"2024-09-17T05:37:47.035745+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:16.126918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036232+0000","last_change":"2024-09-17T05:37:46.048168+0000","last_active":"2024-09-17T05:37:47.036232+0000","last_peered":"2024-09-17T05:37:47.036232+0000","last_clean":"2024-09-17T05:37:47.036232+0000","last_became_active":"2024-09-17T05:37:46.047785+0000","last_became_peered":"2024-09-17T05:37:46.047785+0000","last_unstale":"2024-09-17T05:37:47.036232+0000","last_undegraded":"2024-09-17T05:37:47.036232+0000","last_fullsized":"2024-09-17T05:37:47.036232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:27.201131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035645+0000","last_change":"2024-09-17T05:37:46.057518+0000","last_active":"2024-09-17T05:37:47.035645+0000","last_peered":"2024-09-17T05:37:47.035645+0000","last_clean":"2024-09-17T05:37:47.035645+0000","last_became_active":"2024-09-17T05:37:46.057188+0000","last_became_peered":"2024-09-17T05:37:46.057188+0000","last_unstale":"2024-09-17T05:37:47.035645+0000","last_undegraded":"2024-09-17T05:37:47.035645+0000","last_fullsized":"2024-09-17T05:37:47.035645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:46.991754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035608+0000","last_change":"2024-09-17T05:37:46.055514+0000","last_active":"2024-09-17T05:37:47.035608+0000","last_peered":"2024-09-17T05:37:47.035608+0000","last_clean":"2024-09-17T05:37:47.035608+0000","last_became_active":"2024-09-17T05:37:46.055184+0000","last_became_peered":"2024-09-17T05:37:46.055184+0000","last_unstale":"2024-09-17T05:37:47.035608+0000","last_undegraded":"2024-09-17T05:37:47.035608+0000","last_fullsized":"2024-09-17T05:37:47.035608+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:24.314792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697508+0000","last_change":"2024-09-17T05:37:46.059902+0000","last_active":"2024-09-17T05:37:47.697508+0000","last_peered":"2024-09-17T05:37:47.697508+0000","last_clean":"2024-09-17T05:37:47.697508+0000","last_became_active":"2024-09-17T05:37:46.059620+0000","last_became_peered":"2024-09-17T05:37:46.059620+0000","last_unstale":"2024-09-17T05:37:47.697508+0000","last_undegraded":"2024-09-17T05:37:47.697508+0000","last_fullsized":"2024-09-17T05:37:47.697508+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:38.719755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036753+0000","last_change":"2024-09-17T05:37:46.074057+0000","last_active":"2024-09-17T05:37:47.036753+0000","last_peered":"2024-09-17T05:37:47.036753+0000","last_clean":"2024-09-17T05:37:47.036753+0000","last_became_active":"2024-09-17T05:37:46.073728+0000","last_became_peered":"2024-09-17T05:37:46.073728+0000","last_unstale":"2024-09-17T05:37:47.036753+0000","last_undegraded":"2024-09-17T05:37:47.036753+0000","last_fullsized":"2024-09-17T05:37:47.036753+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:25.336157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.571195+0000","last_change":"2024-09-17T05:37:46.081026+0000","last_active":"2024-09-17T05:37:47.571195+0000","last_peered":"2024-09-17T05:37:47.571195+0000","last_clean":"2024-09-17T05:37:47.571195+0000","last_became_active":"2024-09-17T05:37:46.080304+0000","last_became_peered":"2024-09-17T05:37:46.080304+0000","last_unstale":"2024-09-17T05:37:47.571195+0000","last_undegraded":"2024-09-17T05:37:47.571195+0000","last_fullsized":"2024-09-17T05:37:47.571195+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:06.464007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697362+0000","last_change":"2024-09-17T05:37:46.056084+0000","last_active":"2024-09-17T05:37:47.697362+0000","last_peered":"2024-09-17T05:37:47.697362+0000","last_clean":"2024-09-17T05:37:47.697362+0000","last_became_active":"2024-09-17T05:37:46.055756+0000","last_became_peered":"2024-09-17T05:37:46.055756+0000","last_unstale":"2024-09-17T05:37:47.697362+0000","last_undegraded":"2024-09-17T05:37:47.697362+0000","last_fullsized":"2024-09-17T05:37:47.697362+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:01.273341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696657+0000","last_change":"2024-09-17T05:37:46.069098+0000","last_active":"2024-09-17T05:37:47.696657+0000","last_peered":"2024-09-17T05:37:47.696657+0000","last_clean":"2024-09-17T05:37:47.696657+0000","last_became_active":"2024-09-17T05:37:46.068168+0000","last_became_peered":"2024-09-17T05:37:46.068168+0000","last_unstale":"2024-09-17T05:37:47.696657+0000","last_undegraded":"2024-09-17T05:37:47.696657+0000","last_fullsized":"2024-09-17T05:37:47.696657+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:47.470382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036974+0000","last_change":"2024-09-17T05:37:46.040392+0000","last_active":"2024-09-17T05:37:47.036974+0000","last_peered":"2024-09-17T05:37:47.036974+0000","last_clean":"2024-09-17T05:37:47.036974+0000","last_became_active":"2024-09-17T05:37:46.040050+0000","last_became_peered":"2024-09-17T05:37:46.040050+0000","last_unstale":"2024-09-17T05:37:47.036974+0000","last_undegraded":"2024-09-17T05:37:47.036974+0000","last_fullsized":"2024-09-17T05:37:47.036974+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:28.320150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035855+0000","last_change":"2024-09-17T05:37:46.046598+0000","last_active":"2024-09-17T05:37:47.035855+0000","last_peered":"2024-09-17T05:37:47.035855+0000","last_clean":"2024-09-17T05:37:47.035855+0000","last_became_active":"2024-09-17T05:37:46.045641+0000","last_became_peered":"2024-09-17T05:37:46.045641+0000","last_unstale":"2024-09-17T05:37:47.035855+0000","last_undegraded":"2024-09-17T05:37:47.035855+0000","last_fullsized":"2024-09-17T05:37:47.035855+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:18.408158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696628+0000","last_change":"2024-09-17T05:37:46.056518+0000","last_active":"2024-09-17T05:37:47.696628+0000","last_peered":"2024-09-17T05:37:47.696628+0000","last_clean":"2024-09-17T05:37:47.696628+0000","last_became_active":"2024-09-17T05:37:46.056190+0000","last_became_peered":"2024-09-17T05:37:46.056190+0000","last_unstale":"2024-09-17T05:37:47.696628+0000","last_undegraded":"2024-09-17T05:37:47.696628+0000","last_fullsized":"2024-09-17T05:37:47.696628+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:57.358749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035505+0000","last_change":"2024-09-17T05:37:46.075300+0000","last_active":"2024-09-17T05:37:47.035505+0000","last_peered":"2024-09-17T05:37:47.035505+0000","last_clean":"2024-09-17T05:37:47.035505+0000","last_became_active":"2024-09-17T05:37:46.073020+0000","last_became_peered":"2024-09-17T05:37:46.073020+0000","last_unstale":"2024-09-17T05:37:47.035505+0000","last_undegraded":"2024-09-17T05:37:47.035505+0000","last_fullsized":"2024-09-17T05:37:47.035505+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.005801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697045+0000","last_change":"2024-09-17T05:37:45.050863+0000","last_active":"2024-09-17T05:37:47.697045+0000","last_peered":"2024-09-17T05:37:47.697045+0000","last_clean":"2024-09-17T05:37:47.697045+0000","last_became_active":"2024-09-17T05:37:45.050504+0000","last_became_peered":"2024-09-17T05:37:45.050504+0000","last_unstale":"2024-09-17T05:37:47.697045+0000","last_undegraded":"2024-09-17T05:37:47.697045+0000","last_fullsized":"2024-09-17T05:37:47.697045+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:01.855857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035793+0000","last_change":"2024-09-17T05:37:46.045999+0000","last_active":"2024-09-17T05:37:47.035793+0000","last_peered":"2024-09-17T05:37:47.035793+0000","last_clean":"2024-09-17T05:37:47.035793+0000","last_became_active":"2024-09-17T05:37:46.045674+0000","last_became_peered":"2024-09-17T05:37:46.045674+0000","last_unstale":"2024-09-17T05:37:47.035793+0000","last_undegraded":"2024-09-17T05:37:47.035793+0000","last_fullsized":"2024-09-17T05:37:47.035793+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:03.772164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570743+0000","last_change":"2024-09-17T05:37:45.065829+0000","last_active":"2024-09-17T05:37:47.570743+0000","last_peered":"2024-09-17T05:37:47.570743+0000","last_clean":"2024-09-17T05:37:47.570743+0000","last_became_active":"2024-09-17T05:37:45.065496+0000","last_became_peered":"2024-09-17T05:37:45.065496+0000","last_unstale":"2024-09-17T05:37:47.570743+0000","last_undegraded":"2024-09-17T05:37:47.570743+0000","last_fullsized":"2024-09-17T05:37:47.570743+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:04.437530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036580+0000","last_change":"2024-09-17T05:37:46.073360+0000","last_active":"2024-09-17T05:37:47.036580+0000","last_peered":"2024-09-17T05:37:47.036580+0000","last_clean":"2024-09-17T05:37:47.036580+0000","last_became_active":"2024-09-17T05:37:46.073030+0000","last_became_peered":"2024-09-17T05:37:46.073030+0000","last_unstale":"2024-09-17T05:37:47.036580+0000","last_undegraded":"2024-09-17T05:37:47.036580+0000","last_fullsized":"2024-09-17T05:37:47.036580+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:28.115989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697789+0000","last_change":"2024-09-17T05:37:45.061814+0000","last_active":"2024-09-17T05:37:47.697789+0000","last_peered":"2024-09-17T05:37:47.697789+0000","last_clean":"2024-09-17T05:37:47.697789+0000","last_became_active":"2024-09-17T05:37:45.061436+0000","last_became_peered":"2024-09-17T05:37:45.061436+0000","last_unstale":"2024-09-17T05:37:47.697789+0000","last_undegraded":"2024-09-17T05:37:47.697789+0000","last_fullsized":"2024-09-17T05:37:47.697789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:21.256652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697232+0000","last_change":"2024-09-17T05:37:46.045530+0000","last_active":"2024-09-17T05:37:47.697232+0000","last_peered":"2024-09-17T05:37:47.697232+0000","last_clean":"2024-09-17T05:37:47.697232+0000","last_became_active":"2024-09-17T05:37:46.044880+0000","last_became_peered":"2024-09-17T05:37:46.044880+0000","last_unstale":"2024-09-17T05:37:47.697232+0000","last_undegraded":"2024-09-17T05:37:47.697232+0000","last_fullsized":"2024-09-17T05:37:47.697232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:59.247416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697579+0000","last_change":"2024-09-17T05:37:45.054678+0000","last_active":"2024-09-17T05:37:47.697579+0000","last_peered":"2024-09-17T05:37:47.697579+0000","last_clean":"2024-09-17T05:37:47.697579+0000","last_became_active":"2024-09-17T05:37:45.053608+0000","last_became_peered":"2024-09-17T05:37:45.053608+0000","last_unstale":"2024-09-17T05:37:47.697579+0000","last_undegraded":"2024-09-17T05:37:47.697579+0000","last_fullsized":"2024-09-17T05:37:47.697579+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696974+0000","last_change":"2024-09-17T05:37:46.067662+0000","last_active":"2024-09-17T05:37:47.696974+0000","last_peered":"2024-09-17T05:37:47.696974+0000","last_clean":"2024-09-17T05:37:47.696974+0000","last_became_active":"2024-09-17T05:37:46.067371+0000","last_became_peered":"2024-09-17T05:37:46.067371+0000","last_unstale":"2024-09-17T05:37:47.696974+0000","last_undegraded":"2024-09-17T05:37:47.696974+0000","last_fullsized":"2024-09-17T05:37:47.696974+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:43.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036389+0000","last_change":"2024-09-17T05:37:45.056140+0000","last_active":"2024-09-17T05:37:47.036389+0000","last_peered":"2024-09-17T05:37:47.036389+0000","last_clean":"2024-09-17T05:37:47.036389+0000","last_became_active":"2024-09-17T05:37:45.055568+0000","last_became_peered":"2024-09-17T05:37:45.055568+0000","last_unstale":"2024-09-17T05:37:47.036389+0000","last_undegraded":"2024-09-17T05:37:47.036389+0000","last_fullsized":"2024-09-17T05:37:47.036389+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:29.119041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036731+0000","last_change":"2024-09-17T05:37:46.059217+0000","last_active":"2024-09-17T05:37:47.036731+0000","last_peered":"2024-09-17T05:37:47.036731+0000","last_clean":"2024-09-17T05:37:47.036731+0000","last_became_active":"2024-09-17T05:37:46.058854+0000","last_became_peered":"2024-09-17T05:37:46.058854+0000","last_unstale":"2024-09-17T05:37:47.036731+0000","last_undegraded":"2024-09-17T05:37:47.036731+0000","last_fullsized":"2024-09-17T05:37:47.036731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:16.454326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036791+0000","last_change":"2024-09-17T05:37:45.057805+0000","last_active":"2024-09-17T05:37:47.036791+0000","last_peered":"2024-09-17T05:37:47.036791+0000","last_clean":"2024-09-17T05:37:47.036791+0000","last_became_active":"2024-09-17T05:37:45.057474+0000","last_became_peered":"2024-09-17T05:37:45.057474+0000","last_unstale":"2024-09-17T05:37:47.036791+0000","last_undegraded":"2024-09-17T05:37:47.036791+0000","last_fullsized":"2024-09-17T05:37:47.036791+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:11.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697859+0000","last_change":"2024-09-17T05:37:46.057006+0000","last_active":"2024-09-17T05:37:47.697859+0000","last_peered":"2024-09-17T05:37:47.697859+0000","last_clean":"2024-09-17T05:37:47.697859+0000","last_became_active":"2024-09-17T05:37:46.056679+0000","last_became_peered":"2024-09-17T05:37:46.056679+0000","last_unstale":"2024-09-17T05:37:47.697859+0000","last_undegraded":"2024-09-17T05:37:47.697859+0000","last_fullsized":"2024-09-17T05:37:47.697859+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:55.954227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035975+0000","last_change":"2024-09-17T05:37:45.055516+0000","last_active":"2024-09-17T05:37:47.035975+0000","last_peered":"2024-09-17T05:37:47.035975+0000","last_clean":"2024-09-17T05:37:47.035975+0000","last_became_active":"2024-09-17T05:37:45.055191+0000","last_became_peered":"2024-09-17T05:37:45.055191+0000","last_unstale":"2024-09-17T05:37:47.035975+0000","last_undegraded":"2024-09-17T05:37:47.035975+0000","last_fullsized":"2024-09-17T05:37:47.035975+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:50.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036332+0000","last_change":"2024-09-17T05:37:46.078208+0000","last_active":"2024-09-17T05:37:47.036332+0000","last_peered":"2024-09-17T05:37:47.036332+0000","last_clean":"2024-09-17T05:37:47.036332+0000","last_became_active":"2024-09-17T05:37:46.077881+0000","last_became_peered":"2024-09-17T05:37:46.077881+0000","last_unstale":"2024-09-17T05:37:47.036332+0000","last_undegraded":"2024-09-17T05:37:47.036332+0000","last_fullsized":"2024-09-17T05:37:47.036332+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:57.358749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035531+0000","last_change":"2024-09-17T05:37:45.051689+0000","last_active":"2024-09-17T05:37:47.035531+0000","last_peered":"2024-09-17T05:37:47.035531+0000","last_clean":"2024-09-17T05:37:47.035531+0000","last_became_active":"2024-09-17T05:37:45.051347+0000","last_became_peered":"2024-09-17T05:37:45.051347+0000","last_unstale":"2024-09-17T05:37:47.035531+0000","last_undegraded":"2024-09-17T05:37:47.035531+0000","last_fullsized":"2024-09-17T05:37:47.035531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:18.596842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696634+0000","last_change":"2024-09-17T05:37:46.067712+0000","last_active":"2024-09-17T05:37:47.696634+0000","last_peered":"2024-09-17T05:37:47.696634+0000","last_clean":"2024-09-17T05:37:47.696634+0000","last_became_active":"2024-09-17T05:37:46.067284+0000","last_became_peered":"2024-09-17T05:37:46.067284+0000","last_unstale":"2024-09-17T05:37:47.696634+0000","last_undegraded":"2024-09-17T05:37:47.696634+0000","last_fullsized":"2024-09-17T05:37:47.696634+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:59.076270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036521+0000","last_change":"2024-09-17T05:37:45.052131+0000","last_active":"2024-09-17T05:37:47.036521+0000","last_peered":"2024-09-17T05:37:47.036521+0000","last_clean":"2024-09-17T05:37:47.036521+0000","last_became_active":"2024-09-17T05:37:45.051781+0000","last_became_peered":"2024-09-17T05:37:45.051781+0000","last_unstale":"2024-09-17T05:37:47.036521+0000","last_undegraded":"2024-09-17T05:37:47.036521+0000","last_fullsized":"2024-09-17T05:37:47.036521+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:29.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036459+0000","last_change":"2024-09-17T05:37:46.071762+0000","last_active":"2024-09-17T05:37:47.036459+0000","last_peered":"2024-09-17T05:37:47.036459+0000","last_clean":"2024-09-17T05:37:47.036459+0000","last_became_active":"2024-09-17T05:37:46.071445+0000","last_became_peered":"2024-09-17T05:37:46.071445+0000","last_unstale":"2024-09-17T05:37:47.036459+0000","last_undegraded":"2024-09-17T05:37:47.036459+0000","last_fullsized":"2024-09-17T05:37:47.036459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:22.739418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036463+0000","last_change":"2024-09-17T05:37:45.064805+0000","last_active":"2024-09-17T05:37:47.036463+0000","last_peered":"2024-09-17T05:37:47.036463+0000","last_clean":"2024-09-17T05:37:47.036463+0000","last_became_active":"2024-09-17T05:37:45.064425+0000","last_became_peered":"2024-09-17T05:37:45.064425+0000","last_unstale":"2024-09-17T05:37:47.036463+0000","last_undegraded":"2024-09-17T05:37:47.036463+0000","last_fullsized":"2024-09-17T05:37:47.036463+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696514+0000","last_change":"2024-09-17T05:37:46.064206+0000","last_active":"2024-09-17T05:37:47.696514+0000","last_peered":"2024-09-17T05:37:47.696514+0000","last_clean":"2024-09-17T05:37:47.696514+0000","last_became_active":"2024-09-17T05:37:46.054901+0000","last_became_peered":"2024-09-17T05:37:46.054901+0000","last_unstale":"2024-09-17T05:37:47.696514+0000","last_undegraded":"2024-09-17T05:37:47.696514+0000","last_fullsized":"2024-09-17T05:37:47.696514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:00.946548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036688+0000","last_change":"2024-09-17T05:37:45.059681+0000","last_active":"2024-09-17T05:37:47.036688+0000","last_peered":"2024-09-17T05:37:47.036688+0000","last_clean":"2024-09-17T05:37:47.036688+0000","last_became_active":"2024-09-17T05:37:45.059319+0000","last_became_peered":"2024-09-17T05:37:45.059319+0000","last_unstale":"2024-09-17T05:37:47.036688+0000","last_undegraded":"2024-09-17T05:37:47.036688+0000","last_fullsized":"2024-09-17T05:37:47.036688+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:32.941882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697656+0000","last_change":"2024-09-17T05:37:46.060662+0000","last_active":"2024-09-17T05:37:47.697656+0000","last_peered":"2024-09-17T05:37:47.697656+0000","last_clean":"2024-09-17T05:37:47.697656+0000","last_became_active":"2024-09-17T05:37:46.060377+0000","last_became_peered":"2024-09-17T05:37:46.060377+0000","last_unstale":"2024-09-17T05:37:47.697656+0000","last_undegraded":"2024-09-17T05:37:47.697656+0000","last_fullsized":"2024-09-17T05:37:47.697656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:42.734925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697584+0000","last_change":"2024-09-17T05:37:45.055492+0000","last_active":"2024-09-17T05:37:47.697584+0000","last_peered":"2024-09-17T05:37:47.697584+0000","last_clean":"2024-09-17T05:37:47.697584+0000","last_became_active":"2024-09-17T05:37:45.054184+0000","last_became_peered":"2024-09-17T05:37:45.054184+0000","last_unstale":"2024-09-17T05:37:47.697584+0000","last_undegraded":"2024-09-17T05:37:47.697584+0000","last_fullsized":"2024-09-17T05:37:47.697584+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:33.159363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036099+0000","last_change":"2024-09-17T05:37:46.057339+0000","last_active":"2024-09-17T05:37:47.036099+0000","last_peered":"2024-09-17T05:37:47.036099+0000","last_clean":"2024-09-17T05:37:47.036099+0000","last_became_active":"2024-09-17T05:37:46.057017+0000","last_became_peered":"2024-09-17T05:37:46.057017+0000","last_unstale":"2024-09-17T05:37:47.036099+0000","last_undegraded":"2024-09-17T05:37:47.036099+0000","last_fullsized":"2024-09-17T05:37:47.036099+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:37:28.300036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570888+0000","last_change":"2024-09-17T05:37:45.069218+0000","last_active":"2024-09-17T05:37:47.570888+0000","last_peered":"2024-09-17T05:37:47.570888+0000","last_clean":"2024-09-17T05:37:47.570888+0000","last_became_active":"2024-09-17T05:37:45.068997+0000","last_became_peered":"2024-09-17T05:37:45.068997+0000","last_unstale":"2024-09-17T05:37:47.570888+0000","last_undegraded":"2024-09-17T05:37:47.570888+0000","last_fullsized":"2024-09-17T05:37:47.570888+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:16.010988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696941+0000","last_change":"2024-09-17T05:37:46.076000+0000","last_active":"2024-09-17T05:37:47.696941+0000","last_peered":"2024-09-17T05:37:47.696941+0000","last_clean":"2024-09-17T05:37:47.696941+0000","last_became_active":"2024-09-17T05:37:46.075703+0000","last_became_peered":"2024-09-17T05:37:46.075703+0000","last_unstale":"2024-09-17T05:37:47.696941+0000","last_undegraded":"2024-09-17T05:37:47.696941+0000","last_fullsized":"2024-09-17T05:37:47.696941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:13.038600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035721+0000","last_change":"2024-09-17T05:37:45.059842+0000","last_active":"2024-09-17T05:37:47.035721+0000","last_peered":"2024-09-17T05:37:47.035721+0000","last_clean":"2024-09-17T05:37:47.035721+0000","last_became_active":"2024-09-17T05:37:45.059402+0000","last_became_peered":"2024-09-17T05:37:45.059402+0000","last_unstale":"2024-09-17T05:37:47.035721+0000","last_undegraded":"2024-09-17T05:37:47.035721+0000","last_fullsized":"2024-09-17T05:37:47.035721+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:43.907115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.571114+0000","last_change":"2024-09-17T05:37:46.082286+0000","last_active":"2024-09-17T05:37:47.571114+0000","last_peered":"2024-09-17T05:37:47.571114+0000","last_clean":"2024-09-17T05:37:47.571114+0000","last_became_active":"2024-09-17T05:37:46.081694+0000","last_became_peered":"2024-09-17T05:37:46.081694+0000","last_unstale":"2024-09-17T05:37:47.571114+0000","last_undegraded":"2024-09-17T05:37:47.571114+0000","last_fullsized":"2024-09-17T05:37:47.571114+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:30.249849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697088+0000","last_change":"2024-09-17T05:37:45.053989+0000","last_active":"2024-09-17T05:37:47.697088+0000","last_peered":"2024-09-17T05:37:47.697088+0000","last_clean":"2024-09-17T05:37:47.697088+0000","last_became_active":"2024-09-17T05:37:45.053641+0000","last_became_peered":"2024-09-17T05:37:45.053641+0000","last_unstale":"2024-09-17T05:37:47.697088+0000","last_undegraded":"2024-09-17T05:37:47.697088+0000","last_fullsized":"2024-09-17T05:37:47.697088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:29.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036904+0000","last_change":"2024-09-17T05:37:46.049142+0000","last_active":"2024-09-17T05:37:47.036904+0000","last_peered":"2024-09-17T05:37:47.036904+0000","last_clean":"2024-09-17T05:37:47.036904+0000","last_became_active":"2024-09-17T05:37:46.047150+0000","last_became_peered":"2024-09-17T05:37:46.047150+0000","last_unstale":"2024-09-17T05:37:47.036904+0000","last_undegraded":"2024-09-17T05:37:47.036904+0000","last_fullsized":"2024-09-17T05:37:47.036904+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:13:32.857682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":23,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.571018+0000","last_change":"2024-09-17T05:37:45.066676+0000","last_active":"2024-09-17T05:37:47.571018+0000","last_peered":"2024-09-17T05:37:47.571018+0000","last_clean":"2024-09-17T05:37:47.571018+0000","last_became_active":"2024-09-17T05:37:45.065923+0000","last_became_peered":"2024-09-17T05:37:45.065923+0000","last_unstale":"2024-09-17T05:37:47.571018+0000","last_undegraded":"2024-09-17T05:37:47.571018+0000","last_fullsized":"2024-09-17T05:37:47.571018+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:16:33.741795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696977+0000","last_change":"2024-09-17T05:37:46.049677+0000","last_active":"2024-09-17T05:37:47.696977+0000","last_peered":"2024-09-17T05:37:47.696977+0000","last_clean":"2024-09-17T05:37:47.696977+0000","last_became_active":"2024-09-17T05:37:46.049320+0000","last_became_peered":"2024-09-17T05:37:46.049320+0000","last_unstale":"2024-09-17T05:37:47.696977+0000","last_undegraded":"2024-09-17T05:37:47.696977+0000","last_fullsized":"2024-09-17T05:37:47.696977+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:41.923536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.571321+0000","last_change":"2024-09-17T05:37:45.066669+0000","last_active":"2024-09-17T05:37:47.571321+0000","last_peered":"2024-09-17T05:37:47.571321+0000","last_clean":"2024-09-17T05:37:47.571321+0000","last_became_active":"2024-09-17T05:37:45.065484+0000","last_became_peered":"2024-09-17T05:37:45.065484+0000","last_unstale":"2024-09-17T05:37:47.571321+0000","last_undegraded":"2024-09-17T05:37:47.571321+0000","last_fullsized":"2024-09-17T05:37:47.571321+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:44.951117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696374+0000","last_change":"2024-09-17T05:37:46.065321+0000","last_active":"2024-09-17T05:37:47.696374+0000","last_peered":"2024-09-17T05:37:47.696374+0000","last_clean":"2024-09-17T05:37:47.696374+0000","last_became_active":"2024-09-17T05:37:46.056405+0000","last_became_peered":"2024-09-17T05:37:46.056405+0000","last_unstale":"2024-09-17T05:37:47.696374+0000","last_undegraded":"2024-09-17T05:37:47.696374+0000","last_fullsized":"2024-09-17T05:37:47.696374+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:17.795082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570895+0000","last_change":"2024-09-17T05:37:45.065048+0000","last_active":"2024-09-17T05:37:47.570895+0000","last_peered":"2024-09-17T05:37:47.570895+0000","last_clean":"2024-09-17T05:37:47.570895+0000","last_became_active":"2024-09-17T05:37:45.064525+0000","last_became_peered":"2024-09-17T05:37:45.064525+0000","last_unstale":"2024-09-17T05:37:47.570895+0000","last_undegraded":"2024-09-17T05:37:47.570895+0000","last_fullsized":"2024-09-17T05:37:47.570895+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:40.632421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697130+0000","last_change":"2024-09-17T05:37:46.073607+0000","last_active":"2024-09-17T05:37:47.697130+0000","last_peered":"2024-09-17T05:37:47.697130+0000","last_clean":"2024-09-17T05:37:47.697130+0000","last_became_active":"2024-09-17T05:37:46.073362+0000","last_became_peered":"2024-09-17T05:37:46.073362+0000","last_unstale":"2024-09-17T05:37:47.697130+0000","last_undegraded":"2024-09-17T05:37:47.697130+0000","last_fullsized":"2024-09-17T05:37:47.697130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:58.966226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036572+0000","last_change":"2024-09-17T05:37:45.054993+0000","last_active":"2024-09-17T05:37:47.036572+0000","last_peered":"2024-09-17T05:37:47.036572+0000","last_clean":"2024-09-17T05:37:47.036572+0000","last_became_active":"2024-09-17T05:37:45.054655+0000","last_became_peered":"2024-09-17T05:37:45.054655+0000","last_unstale":"2024-09-17T05:37:47.036572+0000","last_undegraded":"2024-09-17T05:37:47.036572+0000","last_fullsized":"2024-09-17T05:37:47.036572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:00.292570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.570622+0000","last_change":"2024-09-17T05:37:46.080684+0000","last_active":"2024-09-17T05:37:47.570622+0000","last_peered":"2024-09-17T05:37:47.570622+0000","last_clean":"2024-09-17T05:37:47.570622+0000","last_became_active":"2024-09-17T05:37:46.080353+0000","last_became_peered":"2024-09-17T05:37:46.080353+0000","last_unstale":"2024-09-17T05:37:47.570622+0000","last_undegraded":"2024-09-17T05:37:47.570622+0000","last_fullsized":"2024-09-17T05:37:47.570622+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:09.686761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697723+0000","last_change":"2024-09-17T05:37:45.061423+0000","last_active":"2024-09-17T05:37:47.697723+0000","last_peered":"2024-09-17T05:37:47.697723+0000","last_clean":"2024-09-17T05:37:47.697723+0000","last_became_active":"2024-09-17T05:37:45.061101+0000","last_became_peered":"2024-09-17T05:37:45.061101+0000","last_unstale":"2024-09-17T05:37:47.697723+0000","last_undegraded":"2024-09-17T05:37:47.697723+0000","last_fullsized":"2024-09-17T05:37:47.697723+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:16.939819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697819+0000","last_change":"2024-09-17T05:37:46.062566+0000","last_active":"2024-09-17T05:37:47.697819+0000","last_peered":"2024-09-17T05:37:47.697819+0000","last_clean":"2024-09-17T05:37:47.697819+0000","last_became_active":"2024-09-17T05:37:46.061994+0000","last_became_peered":"2024-09-17T05:37:46.061994+0000","last_unstale":"2024-09-17T05:37:47.697819+0000","last_undegraded":"2024-09-17T05:37:47.697819+0000","last_fullsized":"2024-09-17T05:37:47.697819+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:59.247416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696422+0000","last_change":"2024-09-17T05:37:45.059259+0000","last_active":"2024-09-17T05:37:47.696422+0000","last_peered":"2024-09-17T05:37:47.696422+0000","last_clean":"2024-09-17T05:37:47.696422+0000","last_became_active":"2024-09-17T05:37:45.058953+0000","last_became_peered":"2024-09-17T05:37:45.058953+0000","last_unstale":"2024-09-17T05:37:47.696422+0000","last_undegraded":"2024-09-17T05:37:47.696422+0000","last_fullsized":"2024-09-17T05:37:47.696422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:43.576998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036146+0000","last_change":"2024-09-17T05:37:46.059608+0000","last_active":"2024-09-17T05:37:47.036146+0000","last_peered":"2024-09-17T05:37:47.036146+0000","last_clean":"2024-09-17T05:37:47.036146+0000","last_became_active":"2024-09-17T05:37:46.059296+0000","last_became_peered":"2024-09-17T05:37:46.059296+0000","last_unstale":"2024-09-17T05:37:47.036146+0000","last_undegraded":"2024-09-17T05:37:47.036146+0000","last_fullsized":"2024-09-17T05:37:47.036146+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:01.974836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035729+0000","last_change":"2024-09-17T05:37:45.051009+0000","last_active":"2024-09-17T05:37:47.035729+0000","last_peered":"2024-09-17T05:37:47.035729+0000","last_clean":"2024-09-17T05:37:47.035729+0000","last_became_active":"2024-09-17T05:37:45.049848+0000","last_became_peered":"2024-09-17T05:37:45.049848+0000","last_unstale":"2024-09-17T05:37:47.035729+0000","last_undegraded":"2024-09-17T05:37:47.035729+0000","last_fullsized":"2024-09-17T05:37:47.035729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:24.903947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696998+0000","last_change":"2024-09-17T05:37:46.057468+0000","last_active":"2024-09-17T05:37:47.696998+0000","last_peered":"2024-09-17T05:37:47.696998+0000","last_clean":"2024-09-17T05:37:47.696998+0000","last_became_active":"2024-09-17T05:37:46.057127+0000","last_became_peered":"2024-09-17T05:37:46.057127+0000","last_unstale":"2024-09-17T05:37:47.696998+0000","last_undegraded":"2024-09-17T05:37:47.696998+0000","last_fullsized":"2024-09-17T05:37:47.696998+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:46.077247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697086+0000","last_change":"2024-09-17T05:37:45.060323+0000","last_active":"2024-09-17T05:37:47.697086+0000","last_peered":"2024-09-17T05:37:47.697086+0000","last_clean":"2024-09-17T05:37:47.697086+0000","last_became_active":"2024-09-17T05:37:45.059994+0000","last_became_peered":"2024-09-17T05:37:45.059994+0000","last_unstale":"2024-09-17T05:37:47.697086+0000","last_undegraded":"2024-09-17T05:37:47.697086+0000","last_fullsized":"2024-09-17T05:37:47.697086+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:48.441696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.571085+0000","last_change":"2024-09-17T05:37:46.076445+0000","last_active":"2024-09-17T05:37:47.571085+0000","last_peered":"2024-09-17T05:37:47.571085+0000","last_clean":"2024-09-17T05:37:47.571085+0000","last_became_active":"2024-09-17T05:37:46.076160+0000","last_became_peered":"2024-09-17T05:37:46.076160+0000","last_unstale":"2024-09-17T05:37:47.571085+0000","last_undegraded":"2024-09-17T05:37:47.571085+0000","last_fullsized":"2024-09-17T05:37:47.571085+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:00.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697192+0000","last_change":"2024-09-17T05:37:45.059701+0000","last_active":"2024-09-17T05:37:47.697192+0000","last_peered":"2024-09-17T05:37:47.697192+0000","last_clean":"2024-09-17T05:37:47.697192+0000","last_became_active":"2024-09-17T05:37:45.059353+0000","last_became_peered":"2024-09-17T05:37:45.059353+0000","last_unstale":"2024-09-17T05:37:47.697192+0000","last_undegraded":"2024-09-17T05:37:47.697192+0000","last_fullsized":"2024-09-17T05:37:47.697192+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:05.240575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035413+0000","last_change":"2024-09-17T05:37:46.052480+0000","last_active":"2024-09-17T05:37:47.035413+0000","last_peered":"2024-09-17T05:37:47.035413+0000","last_clean":"2024-09-17T05:37:47.035413+0000","last_became_active":"2024-09-17T05:37:46.052193+0000","last_became_peered":"2024-09-17T05:37:46.052193+0000","last_unstale":"2024-09-17T05:37:47.035413+0000","last_undegraded":"2024-09-17T05:37:47.035413+0000","last_fullsized":"2024-09-17T05:37:47.035413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:00.917504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036915+0000","last_change":"2024-09-17T05:37:45.055888+0000","last_active":"2024-09-17T05:37:47.036915+0000","last_peered":"2024-09-17T05:37:47.036915+0000","last_clean":"2024-09-17T05:37:47.036915+0000","last_became_active":"2024-09-17T05:37:45.055540+0000","last_became_peered":"2024-09-17T05:37:45.055540+0000","last_unstale":"2024-09-17T05:37:47.036915+0000","last_undegraded":"2024-09-17T05:37:47.036915+0000","last_fullsized":"2024-09-17T05:37:47.036915+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:05.374513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697326+0000","last_change":"2024-09-17T05:37:46.045881+0000","last_active":"2024-09-17T05:37:47.697326+0000","last_peered":"2024-09-17T05:37:47.697326+0000","last_clean":"2024-09-17T05:37:47.697326+0000","last_became_active":"2024-09-17T05:37:46.045557+0000","last_became_peered":"2024-09-17T05:37:46.045557+0000","last_unstale":"2024-09-17T05:37:47.697326+0000","last_undegraded":"2024-09-17T05:37:47.697326+0000","last_fullsized":"2024-09-17T05:37:47.697326+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:00.875995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036885+0000","last_change":"2024-09-17T05:37:45.059449+0000","last_active":"2024-09-17T05:37:47.036885+0000","last_peered":"2024-09-17T05:37:47.036885+0000","last_clean":"2024-09-17T05:37:47.036885+0000","last_became_active":"2024-09-17T05:37:45.059104+0000","last_became_peered":"2024-09-17T05:37:45.059104+0000","last_unstale":"2024-09-17T05:37:47.036885+0000","last_undegraded":"2024-09-17T05:37:47.036885+0000","last_fullsized":"2024-09-17T05:37:47.036885+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:52.588122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036589+0000","last_change":"2024-09-17T05:37:46.078393+0000","last_active":"2024-09-17T05:37:47.036589+0000","last_peered":"2024-09-17T05:37:47.036589+0000","last_clean":"2024-09-17T05:37:47.036589+0000","last_became_active":"2024-09-17T05:37:46.077942+0000","last_became_peered":"2024-09-17T05:37:46.077942+0000","last_unstale":"2024-09-17T05:37:47.036589+0000","last_undegraded":"2024-09-17T05:37:47.036589+0000","last_fullsized":"2024-09-17T05:37:47.036589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:09.799804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036231+0000","last_change":"2024-09-17T05:37:45.054509+0000","last_active":"2024-09-17T05:37:47.036231+0000","last_peered":"2024-09-17T05:37:47.036231+0000","last_clean":"2024-09-17T05:37:47.036231+0000","last_became_active":"2024-09-17T05:37:45.053870+0000","last_became_peered":"2024-09-17T05:37:45.053870+0000","last_unstale":"2024-09-17T05:37:47.036231+0000","last_undegraded":"2024-09-17T05:37:47.036231+0000","last_fullsized":"2024-09-17T05:37:47.036231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:11.666015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697524+0000","last_change":"2024-09-17T05:37:46.052311+0000","last_active":"2024-09-17T05:37:47.697524+0000","last_peered":"2024-09-17T05:37:47.697524+0000","last_clean":"2024-09-17T05:37:47.697524+0000","last_became_active":"2024-09-17T05:37:46.051132+0000","last_became_peered":"2024-09-17T05:37:46.051132+0000","last_unstale":"2024-09-17T05:37:47.697524+0000","last_undegraded":"2024-09-17T05:37:47.697524+0000","last_fullsized":"2024-09-17T05:37:47.697524+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:17.955994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697309+0000","last_change":"2024-09-17T05:37:45.058306+0000","last_active":"2024-09-17T05:37:47.697309+0000","last_peered":"2024-09-17T05:37:47.697309+0000","last_clean":"2024-09-17T05:37:47.697309+0000","last_became_active":"2024-09-17T05:37:45.057732+0000","last_became_peered":"2024-09-17T05:37:45.057732+0000","last_unstale":"2024-09-17T05:37:47.697309+0000","last_undegraded":"2024-09-17T05:37:47.697309+0000","last_fullsized":"2024-09-17T05:37:47.697309+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:05.460762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697658+0000","last_change":"2024-09-17T05:37:46.074535+0000","last_active":"2024-09-17T05:37:47.697658+0000","last_peered":"2024-09-17T05:37:47.697658+0000","last_clean":"2024-09-17T05:37:47.697658+0000","last_became_active":"2024-09-17T05:37:46.074241+0000","last_became_peered":"2024-09-17T05:37:46.074241+0000","last_unstale":"2024-09-17T05:37:47.697658+0000","last_undegraded":"2024-09-17T05:37:47.697658+0000","last_fullsized":"2024-09-17T05:37:47.697658+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:54.822858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.036138+0000","last_change":"2024-09-17T05:37:45.056408+0000","last_active":"2024-09-17T05:37:47.036138+0000","last_peered":"2024-09-17T05:37:47.036138+0000","last_clean":"2024-09-17T05:37:47.036138+0000","last_became_active":"2024-09-17T05:37:45.055291+0000","last_became_peered":"2024-09-17T05:37:45.055291+0000","last_unstale":"2024-09-17T05:37:47.036138+0000","last_undegraded":"2024-09-17T05:37:47.036138+0000","last_fullsized":"2024-09-17T05:37:47.036138+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:59.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.698138+0000","last_change":"2024-09-17T05:37:46.044901+0000","last_active":"2024-09-17T05:37:47.698138+0000","last_peered":"2024-09-17T05:37:47.698138+0000","last_clean":"2024-09-17T05:37:47.698138+0000","last_became_active":"2024-09-17T05:37:46.044421+0000","last_became_peered":"2024-09-17T05:37:46.044421+0000","last_unstale":"2024-09-17T05:37:47.698138+0000","last_undegraded":"2024-09-17T05:37:47.698138+0000","last_fullsized":"2024-09-17T05:37:47.698138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:19.600087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.697202+0000","last_change":"2024-09-17T05:37:45.041226+0000","last_active":"2024-09-17T05:37:47.697202+0000","last_peered":"2024-09-17T05:37:47.697202+0000","last_clean":"2024-09-17T05:37:47.697202+0000","last_became_active":"2024-09-17T05:37:45.040877+0000","last_became_peered":"2024-09-17T05:37:45.040877+0000","last_unstale":"2024-09-17T05:37:47.697202+0000","last_undegraded":"2024-09-17T05:37:47.697202+0000","last_fullsized":"2024-09-17T05:37:47.697202+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:29.876544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.571172+0000","last_change":"2024-09-17T05:37:46.080841+0000","last_active":"2024-09-17T05:37:47.571172+0000","last_peered":"2024-09-17T05:37:47.571172+0000","last_clean":"2024-09-17T05:37:47.571172+0000","last_became_active":"2024-09-17T05:37:46.080218+0000","last_became_peered":"2024-09-17T05:37:46.080218+0000","last_unstale":"2024-09-17T05:37:47.571172+0000","last_undegraded":"2024-09-17T05:37:47.571172+0000","last_fullsized":"2024-09-17T05:37:47.571172+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:57.358749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035371+0000","last_change":"2024-09-17T05:37:45.059880+0000","last_active":"2024-09-17T05:37:47.035371+0000","last_peered":"2024-09-17T05:37:47.035371+0000","last_clean":"2024-09-17T05:37:47.035371+0000","last_became_active":"2024-09-17T05:37:45.059556+0000","last_became_peered":"2024-09-17T05:37:45.059556+0000","last_unstale":"2024-09-17T05:37:47.035371+0000","last_undegraded":"2024-09-17T05:37:47.035371+0000","last_fullsized":"2024-09-17T05:37:47.035371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:11.126039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.696768+0000","last_change":"2024-09-17T05:37:46.073035+0000","last_active":"2024-09-17T05:37:47.696768+0000","last_peered":"2024-09-17T05:37:47.696768+0000","last_clean":"2024-09-17T05:37:47.696768+0000","last_became_active":"2024-09-17T05:37:46.072747+0000","last_became_peered":"2024-09-17T05:37:46.072747+0000","last_unstale":"2024-09-17T05:37:47.696768+0000","last_undegraded":"2024-09-17T05:37:47.696768+0000","last_fullsized":"2024-09-17T05:37:47.696768+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:45.020384+0000","last_clean_scrub_stamp":"2024-09-17T05:37:45.020384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:06.464007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.698126+0000","last_change":"2024-09-17T05:37:45.058285+0000","last_active":"2024-09-17T05:37:47.698126+0000","last_peered":"2024-09-17T05:37:47.698126+0000","last_clean":"2024-09-17T05:37:47.698126+0000","last_became_active":"2024-09-17T05:37:45.056912+0000","last_became_peered":"2024-09-17T05:37:45.056912+0000","last_unstale":"2024-09-17T05:37:47.698126+0000","last_undegraded":"2024-09-17T05:37:47.698126+0000","last_fullsized":"2024-09-17T05:37:47.698126+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:37:44.017139+0000","last_clean_scrub_stamp":"2024-09-17T05:37:44.017139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:26.430306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":165,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-17T05:37:47.035482+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:37:47.035482+0000","last_peered":"2024-09-17T05:37:47.035482+0000","last_clean":"2024-09-17T05:37:47.035482+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:37:47.035482+0000","last_undegraded":"2024-09-17T05:37:47.035482+0000","last_fullsized":"2024-09-17T05:37:47.035482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":606208,"data_stored":262350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28212,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343628,"statfs":{"total":96636764160,"available":96607875072,"internally_reserved":0,"allocated":1208320,"data_stored":854364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":618496,"data_stored":263998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":262328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1196032,"data_stored":852732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":262876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:55.400 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:37:55.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:37:55.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 -- 172.21.15.44:0/2513455713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 msgr2=0x7f32a815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 --2- 172.21.15.44:0/2513455713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a815e990 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f329c009900 tx=0x7f329c01c850 comp rx=0 tx=0).stop 2024-09-17T05:37:55.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 -- 172.21.15.44:0/2513455713 shutdown_connections 2024-09-17T05:37:55.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 --2- 172.21.15.44:0/2513455713 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32a80cb470 0x7f32a80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 --2- 172.21.15.44:0/2513455713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a815e990 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 -- 172.21.15.44:0/2513455713 >> 172.21.15.44:0/2513455713 conn(0x7f32a80ccaa0 msgr2=0x7f32a80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:55.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 -- 172.21.15.44:0/2513455713 shutdown_connections 2024-09-17T05:37:55.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 -- 172.21.15.44:0/2513455713 wait complete. 2024-09-17T05:37:55.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 Processor -- start 2024-09-17T05:37:55.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.601+0000 7f32b0600640 1 -- start start 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32a806de50 0x7f32a80b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a81fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32a80cb470 0x7f32a81faae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8168f70 con 0x7f32a8072e50 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8168df0 con 0x7f32a806de50 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f32a81690f0 con 0x7f32a80cb470 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a81fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a81fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60346/0 (socket says 172.21.15.44:60346) 2024-09-17T05:37:55.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 -- 172.21.15.44:0/3291348164 learned_addr learned my addr 172.21.15.44:0/3291348164 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:55.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 -- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32a80cb470 msgr2=0x7f32a81faae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32a80cb470 0x7f32a81faae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 -- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32a806de50 msgr2=0x7f32a80b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32a806de50 0x7f32a80b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 -- 172.21.15.44:0/3291348164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a809f860 con 0x7f32a8072e50 2024-09-17T05:37:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32ad200640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a81fa5a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f329400c3f0 tx=0x7f329400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32a5600640 1 -- 172.21.15.44:0/3291348164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294017070 con 0x7f32a8072e50 2024-09-17T05:37:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32a5600640 1 -- 172.21.15.44:0/3291348164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32940053c0 con 0x7f32a8072e50 2024-09-17T05:37:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32a5600640 1 -- 172.21.15.44:0/3291348164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294003860 con 0x7f32a8072e50 2024-09-17T05:37:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a80b59c0 con 0x7f32a8072e50 2024-09-17T05:37:55.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a815b090 con 0x7f32a8072e50 2024-09-17T05:37:55.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.605+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a81fb470 con 0x7f32a8072e50 2024-09-17T05:37:55.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.609+0000 7f32a5600640 1 -- 172.21.15.44:0/3291348164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f329401a070 con 0x7f32a8072e50 2024-09-17T05:37:55.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.609+0000 7f32a5600640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3288073230 0x7f3288075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:55.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.609+0000 7f32a5600640 1 -- 172.21.15.44:0/3291348164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f3294093760 con 0x7f32a8072e50 2024-09-17T05:37:55.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.609+0000 7f32adc00640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3288073230 0x7f3288075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:55.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.609+0000 7f32adc00640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3288073230 0x7f3288075740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f329c0af000 tx=0x7f329c0195f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:55.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.613+0000 7f32a5600640 1 -- 172.21.15.44:0/3291348164 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f329405e5f0 con 0x7f32a8072e50 2024-09-17T05:37:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.849+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f32a80b1550 con 0x7f32a8072e50 2024-09-17T05:37:55.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.853+0000 7f32a5600640 1 -- 172.21.15.44:0/3291348164 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f329405def0 con 0x7f32a8072e50 2024-09-17T05:37:55.856 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:37:55.856 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:37:55.856 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-09-17T05:37:55.856 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-09-17T05:37:55.856 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:37:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-17T05:37:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3288073230 msgr2=0x7f3288075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3288073230 0x7f3288075740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f329c0af000 tx=0x7f329c0195f0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 msgr2=0x7f32a81fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a81fa5a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f329400c3f0 tx=0x7f329400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 shutdown_connections 2024-09-17T05:37:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f32a80cb470 0x7f32a81faae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32a8072e50 0x7f32a81fa5a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3288073230 0x7f3288075740 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 --2- 172.21.15.44:0/3291348164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32a806de50 0x7f32a80b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 >> 172.21.15.44:0/3291348164 conn(0x7f32a80ccaa0 msgr2=0x7f32a8154960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 shutdown_connections 2024-09-17T05:37:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:55.857+0000 7f32b0600640 1 -- 172.21.15.44:0/3291348164 wait complete. 2024-09-17T05:37:55.878 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:56.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 -- 172.21.15.44:0/4116948806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07800cf700 msgr2=0x7f0780160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 --2- 172.21.15.44:0/4116948806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07800cf700 0x7f0780160010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0768009840 tx=0x7f076801c820 comp rx=0 tx=0).stop 2024-09-17T05:37:56.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 -- 172.21.15.44:0/4116948806 shutdown_connections 2024-09-17T05:37:56.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 --2- 172.21.15.44:0/4116948806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07800cf700 0x7f0780160010 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 --2- 172.21.15.44:0/4116948806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f078006dd30 0x7f078015c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 -- 172.21.15.44:0/4116948806 >> 172.21.15.44:0/4116948806 conn(0x7f07800d1120 msgr2=0x7f07800d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 -- 172.21.15.44:0/4116948806 shutdown_connections 2024-09-17T05:37:56.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 -- 172.21.15.44:0/4116948806 wait complete. 2024-09-17T05:37:56.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 Processor -- start 2024-09-17T05:37:56.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.037+0000 7f0785200640 1 -- start start 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078006dd30 0x7f07801fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07800cf700 0x7f07801f9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780160550 0x7f07800b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07801699c0 con 0x7f078006dd30 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0780169840 con 0x7f0780160550 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0780169b40 con 0x7f07800cf700 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078006dd30 0x7f07801fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078006dd30 0x7f07801fb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60356/0 (socket says 172.21.15.44:60356) 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 -- 172.21.15.44:0/4285660221 learned_addr learned my addr 172.21.15.44:0/4285660221 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0775400640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07800cf700 0x7f07801f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077e800640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780160550 0x7f07800b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 -- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07800cf700 msgr2=0x7f07801f9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07800cf700 0x7f07801f9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 -- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780160550 msgr2=0x7f07800b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780160550 0x7f07800b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 -- 172.21.15.44:0/4285660221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078015f120 con 0x7f078006dd30 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077e800640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780160550 0x7f07800b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:56.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f077de00640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078006dd30 0x7f07801fb7f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f077000e7f0 tx=0x7f077000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0776a00640 1 -- 172.21.15.44:0/4285660221 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077000ccc0 con 0x7f078006dd30 2024-09-17T05:37:56.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0776a00640 1 -- 172.21.15.44:0/4285660221 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f077000ce80 con 0x7f078006dd30 2024-09-17T05:37:56.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078015d9c0 con 0x7f078006dd30 2024-09-17T05:37:56.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0776a00640 1 -- 172.21.15.44:0/4285660221 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770005280 con 0x7f078006dd30 2024-09-17T05:37:56.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078015f680 con 0x7f078006dd30 2024-09-17T05:37:56.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.041+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07800b2630 con 0x7f078006dd30 2024-09-17T05:37:56.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.045+0000 7f0776a00640 1 -- 172.21.15.44:0/4285660221 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0770005420 con 0x7f078006dd30 2024-09-17T05:37:56.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.045+0000 7f0776a00640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f075c073200 0x7f075c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.045+0000 7f0776a00640 1 -- 172.21.15.44:0/4285660221 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f0770094d20 con 0x7f078006dd30 2024-09-17T05:37:56.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.045+0000 7f0775400640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f075c073200 0x7f075c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.045+0000 7f0775400640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f075c073200 0x7f075c075710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07680af000 tx=0x7f076801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.049+0000 7f0776a00640 1 -- 172.21.15.44:0/4285660221 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f078015f120 con 0x7f078006dd30 2024-09-17T05:37:56.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.261+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f078009f0a0 con 0x7f078006dd30 2024-09-17T05:37:56.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.261+0000 7f0776a00640 1 -- 172.21.15.44:0/4285660221 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7f077005fc50 con 0x7f078006dd30 2024-09-17T05:37:56.263 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:56.263 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:37:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:37:56.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f075c073200 msgr2=0x7f075c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f075c073200 0x7f075c075710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f07680af000 tx=0x7f076801b060 comp rx=0 tx=0).stop 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078006dd30 msgr2=0x7f07801fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078006dd30 0x7f07801fb7f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f077000e7f0 tx=0x7f077000ecb0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 shutdown_connections 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f075c073200 0x7f075c075710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780160550 0x7f07800b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07800cf700 0x7f07801f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 --2- 172.21.15.44:0/4285660221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078006dd30 0x7f07801fb7f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 >> 172.21.15.44:0/4285660221 conn(0x7f07800d1120 msgr2=0x7f078015a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 shutdown_connections 2024-09-17T05:37:56.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.265+0000 7f0785200640 1 -- 172.21.15.44:0/4285660221 wait complete. 2024-09-17T05:37:56.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:37:45.459363+0000', 'modified': '2024-09-17T05:37:48.480774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5343}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5343': {'gid': 5343, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/767726494', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 767726494}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 767726494}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5343, 'qdb_cluster': [5343]} 2024-09-17T05:37:56.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:37:56.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:37:56.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 -- 172.21.15.44:0/3088124897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c160060 msgr2=0x7f812c160470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 --2- 172.21.15.44:0/3088124897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c160060 0x7f812c160470 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8114009900 tx=0x7f811401c780 comp rx=0 tx=0).stop 2024-09-17T05:37:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 -- 172.21.15.44:0/3088124897 shutdown_connections 2024-09-17T05:37:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 --2- 172.21.15.44:0/3088124897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c160060 0x7f812c160470 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 --2- 172.21.15.44:0/3088124897 >> v2:172.21.15.86:3300/0 conn(0x7f812c0c7370 0x7f812c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 -- 172.21.15.44:0/3088124897 >> 172.21.15.44:0/3088124897 conn(0x7f812c0ceaa0 msgr2=0x7f812c0ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 -- 172.21.15.44:0/3088124897 shutdown_connections 2024-09-17T05:37:56.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 -- 172.21.15.44:0/3088124897 wait complete. 2024-09-17T05:37:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 Processor -- start 2024-09-17T05:37:56.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.853+0000 7f812be00640 1 -- start start 2024-09-17T05:37:56.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0c7370 0x7f812c1fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c15ca20 0x7f812c166820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c160060 0x7f812c070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f812c16a2d0 con 0x7f812c15ca20 2024-09-17T05:37:56.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f812c16a150 con 0x7f812c160060 2024-09-17T05:37:56.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f812c16a450 con 0x7f812c0c7370 2024-09-17T05:37:56.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c15ca20 0x7f812c166820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c15ca20 0x7f812c166820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60376/0 (socket says 172.21.15.44:60376) 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 -- 172.21.15.44:0/1093869829 learned_addr learned my addr 172.21.15.44:0/1093869829 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812b400640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c160060 0x7f812c070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812aa00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0c7370 0x7f812c1fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 -- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0c7370 msgr2=0x7f812c1fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0c7370 0x7f812c1fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 -- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c160060 msgr2=0x7f812c070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c160060 0x7f812c070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 -- 172.21.15.44:0/1093869829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c145b80 con 0x7f812c15ca20 2024-09-17T05:37:56.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812b400640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c160060 0x7f812c070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8123e00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c15ca20 0x7f812c166820 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8114019390 tx=0x7f8114005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8122a00640 1 -- 172.21.15.44:0/1093869829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81140b2040 con 0x7f812c15ca20 2024-09-17T05:37:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8122a00640 1 -- 172.21.15.44:0/1093869829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8114004320 con 0x7f812c15ca20 2024-09-17T05:37:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c145e60 con 0x7f812c15ca20 2024-09-17T05:37:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f8122a00640 1 -- 172.21.15.44:0/1093869829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114005280 con 0x7f812c15ca20 2024-09-17T05:37:56.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.857+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c146420 con 0x7f812c15ca20 2024-09-17T05:37:56.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.861+0000 7f8122a00640 1 -- 172.21.15.44:0/1093869829 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8114005420 con 0x7f812c15ca20 2024-09-17T05:37:56.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.861+0000 7f8122a00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8108073200 0x7f8108075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.861+0000 7f8122a00640 1 -- 172.21.15.44:0/1093869829 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f811412ded0 con 0x7f812c15ca20 2024-09-17T05:37:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.861+0000 7f812aa00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8108073200 0x7f8108075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.861+0000 7f8138f42000 1 Processor -- start 2024-09-17T05:37:56.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.861+0000 7f8138f42000 1 -- start start 2024-09-17T05:37:56.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.861+0000 7f812aa00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8108073200 0x7f8108075710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f811c009ad0 tx=0x7f811c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121085f950 0x5612109b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561210848ca0 0x5612109b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561210885410 con 0x561210848ca0 2024-09-17T05:37:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5612107c2b40 con 0x56121085f950 2024-09-17T05:37:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5612107b1f70 con 0x56121046f460 2024-09-17T05:37:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561210848ca0 0x5612109b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561210848ca0 0x5612109b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60380/0 (socket says 172.21.15.44:60380) 2024-09-17T05:37:56.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 -- 172.21.15.44:0/1858847804 learned_addr learned my addr 172.21.15.44:0/1858847804 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812aa00640 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8123e00640 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121085f950 0x5612109b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 -- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 msgr2=0x5612109b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 -- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121085f950 msgr2=0x5612109b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121085f950 0x5612109b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 -- 172.21.15.44:0/1858847804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612107795b0 con 0x561210848ca0 2024-09-17T05:37:56.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f812b400640 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561210848ca0 0x5612109b1120 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8124001c30 tx=0x7f81240020f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b07e98b7ccc9443 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f811b400640 1 -- 172.21.15.44:0/1858847804 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124019070 con 0x561210848ca0 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f811b400640 1 -- 172.21.15.44:0/1858847804 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8124003c80 con 0x561210848ca0 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f811b400640 1 -- 172.21.15.44:0/1858847804 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812400eac0 con 0x561210848ca0 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- 172.21.15.44:0/1858847804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561210848ca0 msgr2=0x5612109b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561210848ca0 0x5612109b1120 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8124001c30 tx=0x7f81240020f0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- 172.21.15.44:0/1858847804 shutdown_connections 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561210848ca0 0x5612109b1120 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121085f950 0x5612109b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 --2- 172.21.15.44:0/1858847804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- 172.21.15.44:0/1858847804 >> 172.21.15.44:0/1858847804 conn(0x561210935d90 msgr2=0x561210965690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- 172.21.15.44:0/1858847804 shutdown_connections 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- 172.21.15.44:0/1858847804 wait complete. 2024-09-17T05:37:56.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 -- start start 2024-09-17T05:37:56.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.865+0000 7f8138f42000 1 Processor -- start 2024-09-17T05:37:56.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210972ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 0x561210973010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210973550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56121074c5f0 con 0x56121085f950 2024-09-17T05:37:56.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5612107b5d80 con 0x56121046f460 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x561210758520 con 0x561210848ca0 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 10 client.0 _ll_register_callbacks cb 0x56121075c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210973550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210972ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210972ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:38874/0 (socket says 172.21.15.44:38874) 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812aa00640 1 -- 172.21.15.44:0/1258713203 learned_addr learned my addr 172.21.15.44:0/1258713203 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210973550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60392/0 (socket says 172.21.15.44:60392) 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8123e00640 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 0x561210973010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 -- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 msgr2=0x561210973010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 0x561210973010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 -- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 msgr2=0x561210972ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210972ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 -- 172.21.15.44:0/1258713203 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561210750190 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812aa00640 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210972ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812b400640 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210973550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8124016000 tx=0x7f8124004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc723c0aedee698 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f810fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f810fe00640 1 -- 172.21.15.44:0/1258713203 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124019070 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f810fe00640 1 -- 172.21.15.44:0/1258713203 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f812400ea70 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56121074a110 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f810fe00640 1 -- 172.21.15.44:0/1258713203 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f812402b050 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 10 client.5493 fetch_fsmap learned FSMap version 26 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561210836f10 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f810fe00640 1 -- 172.21.15.44:0/1258713203 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56121074a110 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f810fe00640 1 -- 172.21.15.44:0/1258713203 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f812402e020 con 0x56121085f950 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 10 client.5493 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:37:56.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 10 client.5493 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 20 client.5493 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5612104547d0 0x5612109c1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 4 client.5493 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612107c4a90 con 0x5612104547d0 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.869+0000 7f812aa00640 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5612104547d0 0x5612109c1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f812aa00640 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5612104547d0 0x5612109c1c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43c1b8d33794b217 server_cookie=b3e4ce5e95c0c888 in_seq=0 out_seq=0 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f810fe00640 10 client.5493 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f810fe00640 1 -- 172.21.15.44:0/1258713203 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5612107c4a90 con 0x5612104547d0 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f810fe00640 10 client.5493 handle_command_reply: tid=0 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 client.5493 shutdown 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 msgr2=0x561210973550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210973550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8124016000 tx=0x7f8124004dd0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 shutdown_connections 2024-09-17T05:37:56.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5612104547d0 0x5612109c1c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210973550 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 0x561210973010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f810fe00640 0 client.5493 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 --2- 172.21.15.44:0/1258713203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210972ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 >> 172.21.15.44:0/1258713203 conn(0x561210935d90 msgr2=0x56121096c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 shutdown_connections 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 1 -- 172.21.15.44:0/1258713203 wait complete. 2024-09-17T05:37:56.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.873+0000 7f8138f42000 20 client.5493 trim_cache size 0 max 16384 2024-09-17T05:37:56.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 Processor -- start 2024-09-17T05:37:56.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 -- start start 2024-09-17T05:37:56.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561210848ca0 0x561210966930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210966e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f812c205de0 con 0x56121085f950 2024-09-17T05:37:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f812c204e40 con 0x561210848ca0 2024-09-17T05:37:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f812c147650 con 0x56121046f460 2024-09-17T05:37:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210966e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210966e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60402/0 (socket says 172.21.15.44:60402) 2024-09-17T05:37:56.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 -- 172.21.15.44:0/31610988 learned_addr learned my addr 172.21.15.44:0/31610988 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:56.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812aa00640 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8123e00640 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561210848ca0 0x561210966930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 -- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 msgr2=0x5612109663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 -- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561210848ca0 msgr2=0x561210966930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561210848ca0 0x561210966930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 -- 172.21.15.44:0/31610988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121080ddb0 con 0x56121085f950 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f8123e00640 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561210848ca0 0x561210966930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:56.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812aa00640 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f812b400640 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210966e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f81240012f0 tx=0x7f81240015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442c96f60624d1a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f811aa00640 1 -- 172.21.15.44:0/31610988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124034070 con 0x56121085f950 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f811aa00640 1 -- 172.21.15.44:0/31610988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8124023070 con 0x56121085f950 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.893+0000 7f811aa00640 1 -- 172.21.15.44:0/31610988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124019040 con 0x56121085f950 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- 172.21.15.44:0/31610988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 msgr2=0x561210966e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210966e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f81240012f0 tx=0x7f81240015f0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- 172.21.15.44:0/31610988 shutdown_connections 2024-09-17T05:37:56.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210966e70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561210848ca0 0x561210966930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 --2- 172.21.15.44:0/31610988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56121046f460 0x5612109663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- 172.21.15.44:0/31610988 >> 172.21.15.44:0/31610988 conn(0x561210935d90 msgr2=0x561210964cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- 172.21.15.44:0/31610988 shutdown_connections 2024-09-17T05:37:56.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- 172.21.15.44:0/31610988 wait complete. 2024-09-17T05:37:56.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- start start 2024-09-17T05:37:56.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 Processor -- start 2024-09-17T05:37:56.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210a26030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 0x561210a26570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210a26ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5612107c1910 con 0x56121085f950 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561210836a80 con 0x56121046f460 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5612107b5090 con 0x561210848ca0 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f8138f42000 10 client.0 _ll_register_callbacks cb 0x7f8124017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210a26ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f812b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210a26ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60404/0 (socket says 172.21.15.44:60404) 2024-09-17T05:37:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.897+0000 7f812b400640 1 -- 172.21.15.44:0/3051481619 learned_addr learned my addr 172.21.15.44:0/3051481619 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812b400640 1 -- 172.21.15.44:0/3051481619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 msgr2=0x561210a26570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812b400640 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 0x561210a26570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812b400640 1 -- 172.21.15.44:0/3051481619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 msgr2=0x561210a26030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812b400640 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210a26030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812b400640 1 -- 172.21.15.44:0/3051481619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561210778ab0 con 0x56121085f950 2024-09-17T05:37:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812b400640 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210a26ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f812400e5b0 tx=0x7f812400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f422895c3e49d6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:56.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:56.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 1 -- 172.21.15.44:0/3051481619 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124034070 con 0x56121085f950 2024-09-17T05:37:56.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 1 -- 172.21.15.44:0/3051481619 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f8124014690 con 0x56121085f950 2024-09-17T05:37:56.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8124023070 con 0x56121085f950 2024-09-17T05:37:56.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 1 -- 172.21.15.44:0/3051481619 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8124040050 con 0x56121085f950 2024-09-17T05:37:56.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 10 client.5499 fetch_fsmap learned FSMap version 26 2024-09-17T05:37:56.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x561210757070 con 0x56121085f950 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 1 -- 172.21.15.44:0/3051481619 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8124023070 con 0x56121085f950 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 1 -- 172.21.15.44:0/3051481619 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f8124043020 con 0x56121085f950 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 10 client.5499 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 10 client.5499 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 20 client.5499 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x561210442830 0x5612109e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 4 client.5499 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "status"}) -- 0x5612107c0540 con 0x561210442830 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812aa00640 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x561210442830 0x5612109e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812aa00640 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x561210442830 0x5612109e1a40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada4da1d8d4a39d server_cookie=346b24a77abb07fc in_seq=0 out_seq=0 2024-09-17T05:37:56.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 10 client.5499 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 1 -- 172.21.15.44:0/3051481619 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5612107c0540 con 0x561210442830 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 10 client.5499 handle_command_reply: tid=0 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 client.5499 shutdown 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 msgr2=0x561210a26ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210a26ab0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f812400e5b0 tx=0x7f812400ed60 comp rx=0 tx=0).stop 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 shutdown_connections 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x561210442830 0x5612109e1a40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56121085f950 0x561210a26ab0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561210848ca0 0x561210a26570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 --2- 172.21.15.44:0/3051481619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56121046f460 0x561210a26030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f810fe00640 0 client.5499 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 >> 172.21.15.44:0/3051481619 conn(0x561210935d90 msgr2=0x5612109c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 shutdown_connections 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 1 -- 172.21.15.44:0/3051481619 wait complete. 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f8138f42000 20 client.5499 trim_cache size 0 max 16384 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5343, 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:37:56.912 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:37:56.913 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.873280502, 2024-09-17T05:37:56.913 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 26, 2024-09-17T05:37:56.913 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 51, 2024-09-17T05:37:56.913 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 51, 2024-09-17T05:37:56.913 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 15.326915416 2024-09-17T05:37:56.913 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8108073200 msgr2=0x7f8108075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8108073200 0x7f8108075710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f811c009ad0 tx=0x7f811c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c15ca20 msgr2=0x7f812c166820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c15ca20 0x7f812c166820 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8114019390 tx=0x7f8114005de0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 shutdown_connections 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8108073200 0x7f8108075710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c160060 0x7f812c070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f812c15ca20 0x7f812c166820 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 --2- 172.21.15.44:0/1093869829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f812c0c7370 0x7f812c1fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 >> 172.21.15.44:0/1093869829 conn(0x7f812c0ceaa0 msgr2=0x7f812c15ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:56.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 shutdown_connections 2024-09-17T05:37:56.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:56.901+0000 7f812be00640 1 -- 172.21.15.44:0/1093869829 wait complete. 2024-09-17T05:37:56.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:37:57.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.081+0000 7ff319800640 1 -- 172.21.15.44:0/3818584633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 msgr2=0x7ff3140ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:57.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.081+0000 7ff319800640 1 --2- 172.21.15.44:0/3818584633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff3140ce790 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009bc0 tx=0x7ff30c01f3b0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.081+0000 7ff319800640 1 -- 172.21.15.44:0/3818584633 shutdown_connections 2024-09-17T05:37:57.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.081+0000 7ff319800640 1 --2- 172.21.15.44:0/3818584633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff3140ce790 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.081+0000 7ff319800640 1 -- 172.21.15.44:0/3818584633 >> 172.21.15.44:0/3818584633 conn(0x7ff3140ccaa0 msgr2=0x7ff3140cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:57.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.081+0000 7ff319800640 1 -- 172.21.15.44:0/3818584633 shutdown_connections 2024-09-17T05:37:57.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.081+0000 7ff319800640 1 -- 172.21.15.44:0/3818584633 wait complete. 2024-09-17T05:37:57.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 Processor -- start 2024-09-17T05:37:57.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 -- start start 2024-09-17T05:37:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff314158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140cef20 0x7ff31415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3141626c0 0x7ff314162ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3140710c0 con 0x7ff314072e50 2024-09-17T05:37:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff314070f40 con 0x7ff3140cef20 2024-09-17T05:37:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff319800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff3141663a0 con 0x7ff3141626c0 2024-09-17T05:37:57.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff312a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff314158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:57.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff312a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff314158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60434/0 (socket says 172.21.15.44:60434) 2024-09-17T05:37:57.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff312a00640 1 -- 172.21.15.44:0/4036633274 learned_addr learned my addr 172.21.15.44:0/4036633274 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:57.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff30a000640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140cef20 0x7ff31415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:57.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.085+0000 7ff313400640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3141626c0 0x7ff314162ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff312a00640 1 -- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3141626c0 msgr2=0x7ff314162ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff312a00640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3141626c0 0x7ff314162ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff312a00640 1 -- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140cef20 msgr2=0x7ff31415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff312a00640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140cef20 0x7ff31415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff312a00640 1 -- 172.21.15.44:0/4036633274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff314163010 con 0x7ff314072e50 2024-09-17T05:37:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff30a000640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140cef20 0x7ff31415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff313400640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3141626c0 0x7ff314162ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff312a00640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff314158a70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c420 tx=0x7ff30400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff30b400640 1 -- 172.21.15.44:0/4036633274 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304017070 con 0x7ff314072e50 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff30b400640 1 -- 172.21.15.44:0/4036633274 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3040053c0 con 0x7ff314072e50 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3140c5ea0 con 0x7ff314072e50 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff30b400640 1 -- 172.21.15.44:0/4036633274 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304003860 con 0x7ff314072e50 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3140c6460 con 0x7ff314072e50 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31406de50 con 0x7ff314072e50 2024-09-17T05:37:57.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff30b400640 1 -- 172.21.15.44:0/4036633274 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff30401a070 con 0x7ff314072e50 2024-09-17T05:37:57.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff30b400640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff2f0073230 0x7ff2f0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:57.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.089+0000 7ff30b400640 1 -- 172.21.15.44:0/4036633274 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7ff304093720 con 0x7ff314072e50 2024-09-17T05:37:57.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.093+0000 7ff30a000640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff2f0073230 0x7ff2f0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:57.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.093+0000 7ff30a000640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff2f0073230 0x7ff2f0075740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff31409e120 tx=0x7ff2fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:57.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.097+0000 7ff30b400640 1 -- 172.21.15.44:0/4036633274 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff314163010 con 0x7ff314072e50 2024-09-17T05:37:57.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff3141595d0 con 0x7ff314072e50 2024-09-17T05:37:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff30b400640 1 -- 172.21.15.44:0/4036633274 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7ff30405e5a0 con 0x7ff314072e50 2024-09-17T05:37:57.310 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:37:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff2f0073230 msgr2=0x7ff2f0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff2f0073230 0x7ff2f0075740 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff31409e120 tx=0x7ff2fc009040 comp rx=0 tx=0).stop 2024-09-17T05:37:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 msgr2=0x7ff314158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff314158a70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c420 tx=0x7ff30400c8e0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 shutdown_connections 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3141626c0 0x7ff314162ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff2f0073230 0x7ff2f0075740 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3140cef20 0x7ff31415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 --2- 172.21.15.44:0/4036633274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff314072e50 0x7ff314158a70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 >> 172.21.15.44:0/4036633274 conn(0x7ff3140ccaa0 msgr2=0x7ff3140af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 shutdown_connections 2024-09-17T05:37:57.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57.309+0000 7ff319800640 1 -- 172.21.15.44:0/4036633274 wait complete. 2024-09-17T05:37:57.332 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:37:57.333 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:37:57.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:57.333 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:37:57.343 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42328sec preferred_lft 42328sec 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:37:57.344 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:37:57.345 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:37:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.346 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:37:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:37:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:37:57.346 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:37:57.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:57.347 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:37:57.411 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:37:57.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:57.413 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:37:57.466 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:37:57.466 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:37:57.466 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:37:57.466 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:37:57.466 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:37:57.466 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:37:57.466 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:37:57.467 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:37:57.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:37:57.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:37:57.467 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:37:57.467 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:37:57.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:37:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:57.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:57.605 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:37:57.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:37:57.657 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:37:57.657 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:37:57.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:57.657 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:37:57.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:37:57.720 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:57.772 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:37:57.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:37:57.773 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:57.824 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:37:57.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:57.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:57.925 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:57.926 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:37:57.926 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:37:57.944 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:57.944 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:37:57.944 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:37:57.944 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:37:57.944 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:37:57.954 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:37:57.958 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:37:57.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:57.959 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:57.979 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:37:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:37:58.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:58.089 INFO:teuthology.orchestra.run.smithi044.stdout:client5511 2024-09-17T05:37:58.089 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:37:58.089 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:58.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:58.098 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-09-17T05:37:58.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:58.160 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-09-17T05:37:58.211 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:37:58.211 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:37:58.211 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:37:58.211 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:37:58.211 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-09-17T05:37:58.211 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:37:58.319 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-17T05:37:58.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:58.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:58.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 -- 172.21.15.44:0/1894723612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 msgr2=0x7f6ff4167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 --2- 172.21.15.44:0/1894723612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff4167120 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6ff406ace0 tx=0x7f6fec01cd80 comp rx=0 tx=0).stop 2024-09-17T05:37:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 -- 172.21.15.44:0/1894723612 shutdown_connections 2024-09-17T05:37:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 --2- 172.21.15.44:0/1894723612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff4167120 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 --2- 172.21.15.44:0/1894723612 >> v2:172.21.15.86:3300/0 conn(0x7f6ff40b5880 0x7f6ff406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 -- 172.21.15.44:0/1894723612 >> 172.21.15.44:0/1894723612 conn(0x7f6ff40ccaa0 msgr2=0x7f6ff40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 -- 172.21.15.44:0/1894723612 shutdown_connections 2024-09-17T05:37:58.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 -- 172.21.15.44:0/1894723612 wait complete. 2024-09-17T05:37:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 Processor -- start 2024-09-17T05:37:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.529+0000 7f6ff9000640 1 -- start start 2024-09-17T05:37:58.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ff406e390 0x7f6ff409d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:58.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b5880 0x7f6ff415b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:58.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:58.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff416a000 con 0x7f6ff40ce300 2024-09-17T05:37:58.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4169e80 con 0x7f6ff40b5880 2024-09-17T05:37:58.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff416a180 con 0x7f6ff406e390 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff415bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60460/0 (socket says 172.21.15.44:60460) 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 -- 172.21.15.44:0/3359538857 learned_addr learned my addr 172.21.15.44:0/3359538857 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff1e00640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ff406e390 0x7f6ff409d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6febe00640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b5880 0x7f6ff415b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 -- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ff406e390 msgr2=0x7f6ff409d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ff406e390 0x7f6ff409d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 -- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b5880 msgr2=0x7f6ff415b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b5880 0x7f6ff415b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 -- 172.21.15.44:0/3359538857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff41f6d30 con 0x7f6ff40ce300 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff1e00640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ff406e390 0x7f6ff409d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff2800640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff415bce0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6fec019990 tx=0x7f6fec0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6fea000640 1 -- 172.21.15.44:0/3359538857 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0bb070 con 0x7f6ff40ce300 2024-09-17T05:37:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6fea000640 1 -- 172.21.15.44:0/3359538857 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fec004d40 con 0x7f6ff40ce300 2024-09-17T05:37:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff41f7010 con 0x7f6ff40ce300 2024-09-17T05:37:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6fea000640 1 -- 172.21.15.44:0/3359538857 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0b2040 con 0x7f6ff40ce300 2024-09-17T05:37:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff41f75d0 con 0x7f6ff40ce300 2024-09-17T05:37:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff406de50 con 0x7f6ff40ce300 2024-09-17T05:37:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.533+0000 7f6fea000640 1 -- 172.21.15.44:0/3359538857 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6fec0be070 con 0x7f6ff40ce300 2024-09-17T05:37:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.537+0000 7f6fea000640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fd0073230 0x7f6fd0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.537+0000 7f6fea000640 1 -- 172.21.15.44:0/3359538857 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f6fec12df30 con 0x7f6ff40ce300 2024-09-17T05:37:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.537+0000 7f6ff1e00640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fd0073230 0x7f6fd0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.537+0000 7f6ff1e00640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fd0073230 0x7f6fd0075740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009b90 tx=0x7f6fe40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.541+0000 7f6fea000640 1 -- 172.21.15.44:0/3359538857 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6fec016970 con 0x7f6ff40ce300 2024-09-17T05:37:58.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ff40c9f70 con 0x7f6ff40ce300 2024-09-17T05:37:58.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6fea000640 1 -- 172.21.15.44:0/3359538857 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7f6fec0f8e10 con 0x7f6ff40ce300 2024-09-17T05:37:58.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:37:58.755 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:37:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fd0073230 msgr2=0x7f6fd0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fd0073230 0x7f6fd0075740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009b90 tx=0x7f6fe40091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 msgr2=0x7f6ff415bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff415bce0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6fec019990 tx=0x7f6fec0092c0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 shutdown_connections 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ff40ce300 0x7f6ff415bce0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fd0073230 0x7f6fd0075740 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff40b5880 0x7f6ff415b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 --2- 172.21.15.44:0/3359538857 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6ff406e390 0x7f6ff409d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:58.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 >> 172.21.15.44:0/3359538857 conn(0x7f6ff40ccaa0 msgr2=0x7f6ff4072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:58.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 shutdown_connections 2024-09-17T05:37:58.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:58.753+0000 7f6ff9000640 1 -- 172.21.15.44:0/3359538857 wait complete. 2024-09-17T05:37:58.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T05:37:58.965 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:37:58.965 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:37:58.966 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-17T05:37:59.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 Processor -- start 2024-09-17T05:37:59.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 -- start start 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb1a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eeb1aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eec552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560eea3aa00 con 0x5560eeb38a70 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5560eea98f40 con 0x5560eeba9370 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a839e080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5560eeba7190 con 0x5560eec54eb0 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb1a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb1a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47092/0 (socket says 172.21.15.44:47092) 2024-09-17T05:37:59.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 -- 172.21.15.44:0/2794333299 learned_addr learned my addr 172.21.15.44:0/2794333299 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a0c00640 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eeb1aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a2000640 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eec552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 -- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 msgr2=0x5560eec552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eec552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 -- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 msgr2=0x5560eeb1aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eeb1aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 -- 172.21.15.44:0/2794333299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560eea13c10 con 0x5560eeb38a70 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f89a1600640 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb1a5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f899400b5f0 tx=0x7f899400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f6670c43f8ff99 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f899b400640 1 -- 172.21.15.44:0/2794333299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400a8f0 con 0x5560eeb38a70 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f899b400640 1 -- 172.21.15.44:0/2794333299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f899400aa90 con 0x5560eeb38a70 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.025+0000 7f899b400640 1 -- 172.21.15.44:0/2794333299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994015470 con 0x5560eeb38a70 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- 172.21.15.44:0/2794333299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 msgr2=0x5560eeb1a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb1a5a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f899400b5f0 tx=0x7f899400bab0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- 172.21.15.44:0/2794333299 shutdown_connections 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eec552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eeb1aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 --2- 172.21.15.44:0/2794333299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb1a5a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- 172.21.15.44:0/2794333299 >> 172.21.15.44:0/2794333299 conn(0x5560eead8d20 msgr2=0x5560eeba85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- 172.21.15.44:0/2794333299 shutdown_connections 2024-09-17T05:37:59.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- 172.21.15.44:0/2794333299 wait complete. 2024-09-17T05:37:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 Processor -- start 2024-09-17T05:37:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- start start 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb2f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eebc1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eeb35180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5560eebc20d0 con 0x5560eeb38a70 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5560eebc2e60 con 0x5560eeba9370 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a839e080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5560eebc2bc0 con 0x5560eec54eb0 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb2f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb2f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47104/0 (socket says 172.21.15.44:47104) 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 -- 172.21.15.44:0/2528819166 learned_addr learned my addr 172.21.15.44:0/2528819166 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a2000640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eeb35180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a0c00640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eebc1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 -- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 msgr2=0x5560eeb35180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eeb35180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 -- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 msgr2=0x5560eebc1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eebc1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a1600640 1 -- 172.21.15.44:0/2528819166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560eeb2f780 con 0x5560eeb38a70 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a2000640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5560eec54eb0 0x5560eeb35180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.029+0000 7f89a0c00640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560eeba9370 0x5560eebc1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f89a1600640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb2f150 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8994016a20 tx=0x7f8994016a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f899a000640 1 -- 172.21.15.44:0/2528819166 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994020420 con 0x5560eeb38a70 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f899a000640 1 -- 172.21.15.44:0/2528819166 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89940205c0 con 0x5560eeb38a70 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f899a000640 1 -- 172.21.15.44:0/2528819166 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940207f0 con 0x5560eeb38a70 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560eeb2fa20 con 0x5560eeb38a70 2024-09-17T05:37:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560eeb2ff60 con 0x5560eeb38a70 2024-09-17T05:37:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f899a000640 1 -- 172.21.15.44:0/2528819166 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8994029440 con 0x5560eeb38a70 2024-09-17T05:37:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f899a000640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8984071be0 0x7f89840740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f899a000640 1 -- 172.21.15.44:0/2528819166 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f8994094ef0 con 0x5560eeb38a70 2024-09-17T05:37:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f89a839e080 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5560eeb306a0 0x5560eeb30ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f89a0c00640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8984071be0 0x7f89840740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.033+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53) -- 0x5560eeb30ff0 con 0x5560eeb306a0 2024-09-17T05:37:59.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a2000640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5560eeb306a0 0x5560eeb30ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a0c00640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8984071be0 0x7f89840740f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f899000f470 tx=0x7f8990002640 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a2000640 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5560eeb306a0 0x5560eeb30ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a2000640 1 -- 172.21.15.44:0/2528819166 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f899c002050 con 0x5560eeb306a0 2024-09-17T05:37:59.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5560eeb306a0 msgr2=0x5560eeb30ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5560eeb306a0 0x5560eeb30ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8984071be0 msgr2=0x7f89840740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8984071be0 0x7f89840740f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f899000f470 tx=0x7f8990002640 comp rx=0 tx=0).stop 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 msgr2=0x5560eeb2f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 --2- 172.21.15.44:0/2528819166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5560eeb38a70 0x5560eeb2f150 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8994016a20 tx=0x7f8994016a50 comp rx=0 tx=0).stop 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a2000640 1 -- 172.21.15.44:0/2528819166 reap_dead start 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 shutdown_connections 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 >> 172.21.15.44:0/2528819166 conn(0x5560eead8d20 msgr2=0x5560eeba85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 shutdown_connections 2024-09-17T05:37:59.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.037+0000 7f89a839e080 1 -- 172.21.15.44:0/2528819166 wait complete. 2024-09-17T05:37:59.043 INFO:teuthology.orchestra.run.smithi044.stdout:Yalphaparent_a 2024-09-17T05:37:59.044 DEBUG:teuthology.orchestra.run.smithi044:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627777, 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "ancestors": [ 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "dirino": 1099511627776, 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "dname": "alpha", 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 2 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:37:59.104 INFO:teuthology.orchestra.run.smithi044.stdout: "dirino": 1, 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "dname": "parent_a", 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 4 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 8, 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [] 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:37:59.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:37:59.110 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-09-17T05:37:59.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 Processor -- start 2024-09-17T05:37:59.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 -- start start 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6220003640 0x560523d72c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560523d731b0 0x560523cc65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523cc6ae0 0x560523ce2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560523c4ff40 con 0x7f6220003640 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560523c5cd00 con 0x560523cc6ae0 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6241a49080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560523bf1a00 con 0x560523d731b0 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6220003640 0x560523d72c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6220003640 0x560523d72c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47116/0 (socket says 172.21.15.44:47116) 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 -- 172.21.15.44:0/3155568873 learned_addr learned my addr 172.21.15.44:0/3155568873 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623aa00640 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523cc6ae0 0x560523ce2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6233e00640 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560523d731b0 0x560523cc65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 -- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560523d731b0 msgr2=0x560523cc65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560523d731b0 0x560523cc65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 -- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523cc6ae0 msgr2=0x560523ce2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523cc6ae0 0x560523ce2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 -- 172.21.15.44:0/3155568873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560523d756f0 con 0x7f6220003640 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623aa00640 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523cc6ae0 0x560523ce2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6233e00640 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560523d731b0 0x560523cc65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f623a000640 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6220003640 0x560523d72c70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f622c000f70 tx=0x7f622c009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f954c9be7695ed server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6238c00640 1 -- 172.21.15.44:0/3155568873 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c013070 con 0x7f6220003640 2024-09-17T05:37:59.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6238c00640 1 -- 172.21.15.44:0/3155568873 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f622c00d9e0 con 0x7f6220003640 2024-09-17T05:37:59.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.213+0000 7f6238c00640 1 -- 172.21.15.44:0/3155568873 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c00de10 con 0x7f6220003640 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- 172.21.15.44:0/3155568873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6220003640 msgr2=0x560523d72c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6220003640 0x560523d72c70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f622c000f70 tx=0x7f622c009a70 comp rx=0 tx=0).stop 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- 172.21.15.44:0/3155568873 shutdown_connections 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523cc6ae0 0x560523ce2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560523d731b0 0x560523cc65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 --2- 172.21.15.44:0/3155568873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6220003640 0x560523d72c70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- 172.21.15.44:0/3155568873 >> 172.21.15.44:0/3155568873 conn(0x560523c8fd20 msgr2=0x560523cebfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- 172.21.15.44:0/3155568873 shutdown_connections 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- 172.21.15.44:0/3155568873 wait complete. 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 Processor -- start 2024-09-17T05:37:59.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- start start 2024-09-17T05:37:59.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560523cc6ae0 0x560523d71c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523d731b0 0x560523cc9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220003640 0x560523cc9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560523cc5010 con 0x560523cc6ae0 2024-09-17T05:37:59.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560523ce46e0 con 0x560523d731b0 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6241a49080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560523d75250 con 0x7f6220003640 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560523cc6ae0 0x560523d71c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560523cc6ae0 0x560523d71c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47122/0 (socket says 172.21.15.44:47122) 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 -- 172.21.15.44:0/983871683 learned_addr learned my addr 172.21.15.44:0/983871683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623aa00640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220003640 0x560523cc9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f6233e00640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523d731b0 0x560523cc9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 -- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220003640 msgr2=0x560523cc9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6220003640 0x560523cc9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 -- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523d731b0 msgr2=0x560523cc9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560523d731b0 0x560523cc9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 -- 172.21.15.44:0/983871683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560523d721b0 con 0x560523cc6ae0 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.217+0000 7f623a000640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560523cc6ae0 0x560523d71c70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x560523ce4290 tx=0x7f622c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6232a00640 1 -- 172.21.15.44:0/983871683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c013030 con 0x560523cc6ae0 2024-09-17T05:37:59.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560523ccbbf0 con 0x560523cc6ae0 2024-09-17T05:37:59.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6232a00640 1 -- 172.21.15.44:0/983871683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f622c019bd0 con 0x560523cc6ae0 2024-09-17T05:37:59.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6232a00640 1 -- 172.21.15.44:0/983871683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c00f410 con 0x560523cc6ae0 2024-09-17T05:37:59.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560523cd2fe0 con 0x560523cc6ae0 2024-09-17T05:37:59.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6232a00640 1 -- 172.21.15.44:0/983871683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f622c00f5b0 con 0x560523cc6ae0 2024-09-17T05:37:59.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6232a00640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6218071be0 0x7f62180740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6232a00640 1 -- 172.21.15.44:0/983871683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f622c01f020 con 0x560523cc6ae0 2024-09-17T05:37:59.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6241a49080 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560523e09aa0 0x560523cc7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6233e00640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6218071be0 0x7f62180740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) -- 0x560523e07f90 con 0x560523e09aa0 2024-09-17T05:37:59.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.221+0000 7f623aa00640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560523e09aa0 0x560523cc7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6233e00640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6218071be0 0x7f62180740f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6224004fd0 tx=0x7f6224004890 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f623aa00640 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560523e09aa0 0x560523cc7f90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f623aa00640 1 -- 172.21.15.44:0/983871683 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v53'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f62340074d0 con 0x560523e09aa0 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560523e09aa0 msgr2=0x560523cc7f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560523e09aa0 0x560523cc7f90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6218071be0 msgr2=0x7f62180740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6218071be0 0x7f62180740f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6224004fd0 tx=0x7f6224004890 comp rx=0 tx=0).stop 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560523cc6ae0 msgr2=0x560523d71c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 --2- 172.21.15.44:0/983871683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560523cc6ae0 0x560523d71c70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x560523ce4290 tx=0x7f622c0197d0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f623aa00640 1 -- 172.21.15.44:0/983871683 reap_dead start 2024-09-17T05:37:59.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 shutdown_connections 2024-09-17T05:37:59.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 >> 172.21.15.44:0/983871683 conn(0x560523c8fd20 msgr2=0x560523cebf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 shutdown_connections 2024-09-17T05:37:59.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.225+0000 7f6241a49080 1 -- 172.21.15.44:0/983871683 wait complete. 2024-09-17T05:37:59.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo daemon-helper kill ceph --cluster ceph -w 2024-09-17T05:37:59.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:59.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-09-17T05:37:59.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.401+0000 7fa6d7400640 1 -- 172.21.15.44:0/1675202438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6b8003c20 msgr2=0x7fa6b8004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.401+0000 7fa6d7400640 1 --2- 172.21.15.44:0/1675202438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6b8003c20 0x7fa6b8004070 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0160040 tx=0x7fa6c401ce90 comp rx=0 tx=0).stop 2024-09-17T05:37:59.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.401+0000 7fa6d5400640 1 -- 172.21.15.44:0/1675202438 reap_dead start 2024-09-17T05:37:59.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.401+0000 7fa6d7400640 1 -- 172.21.15.44:0/1675202438 shutdown_connections 2024-09-17T05:37:59.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.401+0000 7fa6d7400640 1 -- 172.21.15.44:0/1675202438 >> 172.21.15.44:0/1675202438 conn(0x7fa6d00b4160 msgr2=0x7fa6d00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.401+0000 7fa6d7400640 1 -- 172.21.15.44:0/1675202438 shutdown_connections 2024-09-17T05:37:59.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.401+0000 7fa6d7400640 1 -- 172.21.15.44:0/1675202438 wait complete. 2024-09-17T05:37:59.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 Processor -- start 2024-09-17T05:37:59.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 -- start start 2024-09-17T05:37:59.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6b8003c20 0x7fa6d0163910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6d0142930 0x7fa6d01fc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6d01fc740 0x7fa6d0152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0153680 con 0x7fa6d0142930 2024-09-17T05:37:59.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0153500 con 0x7fa6b8003c20 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d0153800 con 0x7fa6d01fc740 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6d0142930 0x7fa6d01fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6d0142930 0x7fa6d01fc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47132/0 (socket says 172.21.15.44:47132) 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 -- 172.21.15.44:0/705278017 learned_addr learned my addr 172.21.15.44:0/705278017 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6b8003c20 0x7fa6d0163910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d5400640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6d01fc740 0x7fa6d0152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 -- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6d01fc740 msgr2=0x7fa6d0152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6d01fc740 0x7fa6d0152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 -- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6b8003c20 msgr2=0x7fa6d0163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6b8003c20 0x7fa6d0163910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 -- 172.21.15.44:0/705278017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d01fcef0 con 0x7fa6d0142930 2024-09-17T05:37:59.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6cfe00640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6d0142930 0x7fa6d01fc200 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc011b10 tx=0x7fa6bc009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6ccc00640 1 -- 172.21.15.44:0/705278017 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc01e070 con 0x7fa6d0142930 2024-09-17T05:37:59.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6ccc00640 1 -- 172.21.15.44:0/705278017 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6bc004050 con 0x7fa6d0142930 2024-09-17T05:37:59.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d0141e50 con 0x7fa6d0142930 2024-09-17T05:37:59.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6ccc00640 1 -- 172.21.15.44:0/705278017 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00fea0 con 0x7fa6d0142930 2024-09-17T05:37:59.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.405+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01f9830 con 0x7fa6d0142930 2024-09-17T05:37:59.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.409+0000 7fa6ccc00640 1 -- 172.21.15.44:0/705278017 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa6bc021070 con 0x7fa6d0142930 2024-09-17T05:37:59.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.409+0000 7fa6ccc00640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa6b0073230 0x7fa6b0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.409+0000 7fa6ccc00640 1 -- 172.21.15.44:0/705278017 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fa6bc094eb0 con 0x7fa6d0142930 2024-09-17T05:37:59.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.409+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa6b0073230 0x7fa6b0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.409+0000 7fa6dec89000 1 Processor -- start 2024-09-17T05:37:59.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.409+0000 7fa6dec89000 1 -- start start 2024-09-17T05:37:59.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa6b0073230 0x7fa6b0075740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40ac000 tx=0x7fa6c4019cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8e1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc8e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5642cc6a6bd0 con 0x5642cc7981a0 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5642cc697430 con 0x5642cc77a970 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5642cc6f4ce0 con 0x5642cc790ae0 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8e1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8e1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47146/0 (socket says 172.21.15.44:47146) 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 -- 172.21.15.44:0/1286615047 learned_addr learned my addr 172.21.15.44:0/1286615047 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d5400640 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc8e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6cfe00640 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 -- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 msgr2=0x5642cc8e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 -- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 msgr2=0x5642cc8e20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc8e20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 -- 172.21.15.44:0/1286615047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642cc698d80 con 0x5642cc7981a0 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8e1640 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa6c401d370 tx=0x7fa6c40b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec9476425b7d441 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6c1200640 1 -- 172.21.15.44:0/1286615047 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40064e0 con 0x5642cc7981a0 2024-09-17T05:37:59.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6c1200640 1 -- 172.21.15.44:0/1286615047 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c40a6d70 con 0x5642cc7981a0 2024-09-17T05:37:59.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6c1200640 1 -- 172.21.15.44:0/1286615047 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4003820 con 0x5642cc7981a0 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- 172.21.15.44:0/1286615047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 msgr2=0x5642cc8e1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8e1640 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa6c401d370 tx=0x7fa6c40b5000 comp rx=0 tx=0).stop 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- 172.21.15.44:0/1286615047 shutdown_connections 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc8e20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1286615047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8e1640 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- 172.21.15.44:0/1286615047 >> 172.21.15.44:0/1286615047 conn(0x5642cc79e8c0 msgr2=0x5642cc8964b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- 172.21.15.44:0/1286615047 shutdown_connections 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.413+0000 7fa6dec89000 1 -- 172.21.15.44:0/1286615047 wait complete. 2024-09-17T05:37:59.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 -- start start 2024-09-17T05:37:59.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 Processor -- start 2024-09-17T05:37:59.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc89d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc89db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5642cc6e7f20 con 0x5642cc7981a0 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5642cc6e4110 con 0x5642cc77a970 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5642cc6896d0 con 0x5642cc790ae0 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 10 client.0 _ll_register_callbacks cb 0x5642cc688330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47162/0 (socket says 172.21.15.44:47162) 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 -- 172.21.15.44:0/1327579062 learned_addr learned my addr 172.21.15.44:0/1327579062 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc89d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6cfe00640 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc89db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 -- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 msgr2=0x5642cc89db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc89db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 -- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 msgr2=0x5642cc89d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc89d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 -- 172.21.15.44:0/1327579062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642cc682310 con 0x5642cc7981a0 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6d5400640 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8ccf10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00c5b50 tx=0x7fa6c8006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc57b4c672df36f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6b5600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6b5600640 1 -- 172.21.15.44:0/1327579062 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8011840 con 0x5642cc7981a0 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642cc67c450 con 0x5642cc7981a0 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.417+0000 7fa6b5600640 1 -- 172.21.15.44:0/1327579062 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fa6c8018ab0 con 0x5642cc7981a0 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6b5600640 1 -- 172.21.15.44:0/1327579062 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa6c8023050 con 0x5642cc7981a0 2024-09-17T05:37:59.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 10 client.5544 fetch_fsmap learned FSMap version 26 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5642cc69ff60 con 0x5642cc7981a0 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6b5600640 1 -- 172.21.15.44:0/1327579062 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5642cc67c450 con 0x5642cc7981a0 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6b5600640 1 -- 172.21.15.44:0/1327579062 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fa6c80119e0 con 0x5642cc7981a0 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 10 client.5544 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 10 client.5544 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 20 client.5544 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc386b80 0x5642cc8e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 4 client.5544 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642cc6f6c30 con 0x5642cc386b80 2024-09-17T05:37:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc386b80 0x5642cc8e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6b5600640 10 client.5544 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc386b80 0x5642cc8e88c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82c9aaa3009fd2d server_cookie=1aede6c705dce7cc in_seq=0 out_seq=0 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6b5600640 1 -- 172.21.15.44:0/1327579062 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642cc6f6c30 con 0x5642cc386b80 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6b5600640 10 client.5544 handle_command_reply: tid=0 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 client.5544 shutdown 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 msgr2=0x5642cc8ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8ccf10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00c5b50 tx=0x7fa6c8006430 comp rx=0 tx=0).stop 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 shutdown_connections 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc386b80 0x5642cc8e88c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc8ccf10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc89db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 --2- 172.21.15.44:0/1327579062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc89d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 >> 172.21.15.44:0/1327579062 conn(0x5642cc79e8c0 msgr2=0x5642cc896c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6b5600640 0 client.5544 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 shutdown_connections 2024-09-17T05:37:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 1 -- 172.21.15.44:0/1327579062 wait complete. 2024-09-17T05:37:59.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.421+0000 7fa6dec89000 20 client.5544 trim_cache size 0 max 16384 2024-09-17T05:37:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 -- 172.21.15.44:0/3063940573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 msgr2=0x7f4f680b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 --2- 172.21.15.44:0/3063940573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 0x7f4f680b3d10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009840 tx=0x7f4f5801c820 comp rx=0 tx=0).stop 2024-09-17T05:37:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 -- 172.21.15.44:0/3063940573 shutdown_connections 2024-09-17T05:37:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 --2- 172.21.15.44:0/3063940573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 0x7f4f680b3d10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 -- 172.21.15.44:0/3063940573 >> 172.21.15.44:0/3063940573 conn(0x7f4f680ceda0 msgr2=0x7f4f680cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 -- 172.21.15.44:0/3063940573 shutdown_connections 2024-09-17T05:37:59.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 -- 172.21.15.44:0/3063940573 wait complete. 2024-09-17T05:37:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.425+0000 7f4f67200640 1 Processor -- start 2024-09-17T05:37:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 -- start start 2024-09-17T05:37:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f680b4250 0x7f4f6806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 0x7f4f681512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d290 0x7f4f680b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6816ac10 con 0x7f4f6815d290 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6816aa90 con 0x7f4f680d1890 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6816ad90 con 0x7f4f680b4250 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d290 0x7f4f680b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d290 0x7f4f680b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47174/0 (socket says 172.21.15.44:47174) 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 -- 172.21.15.44:0/1103849319 learned_addr learned my addr 172.21.15.44:0/1103849319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f65400640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 0x7f4f681512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f65e00640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f680b4250 0x7f4f6806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 -- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f680b4250 msgr2=0x7f4f6806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f680b4250 0x7f4f6806f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 -- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 msgr2=0x7f4f681512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 0x7f4f681512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 -- 172.21.15.44:0/1103849319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f680b55b0 con 0x7f4f6815d290 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f65400640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f680d1890 0x7f4f681512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f66800640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f6815d290 0x7f4f680b2d70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c760 tx=0x7f4f6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60003db0 con 0x7f4f6815d290 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f6000ce10 con 0x7f4f6815d290 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 -- 172.21.15.44:0/1103849319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6806df50 con 0x7f4f6815d290 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600052d0 con 0x7f4f6815d290 2024-09-17T05:37:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.429+0000 7f4f67200640 1 -- 172.21.15.44:0/1103849319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6806e510 con 0x7f4f6815d290 2024-09-17T05:37:59.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f67200640 1 -- 172.21.15.44:0/1103849319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f4f680b3d10 con 0x7f4f6815d290 2024-09-17T05:37:59.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4f60005470 con 0x7f4f6815d290 2024-09-17T05:37:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f5e000640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f48073200 0x7f4f48075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f4f600940e0 con 0x7f4f6815d290 2024-09-17T05:37:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+503 (secure 0 0 0) 0x7f4f60096680 con 0x7f4f6815d290 2024-09-17T05:37:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f65e00640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f48073200 0x7f4f48075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f67200640 1 -- 172.21.15.44:0/1103849319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f4f680b52d0 con 0x7f4f6815d290 2024-09-17T05:37:59.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.433+0000 7f4f65e00640 1 --2- 172.21.15.44:0/1103849319 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f48073200 0x7f4f48075710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f580af000 tx=0x7f4f5801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.441+0000 7fa6dec89000 1 Processor -- start 2024-09-17T05:37:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.441+0000 7fa6dec89000 1 -- start start 2024-09-17T05:37:59.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc77a970 0x5642cc8f9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc7981a0 0x5642cc895af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d02062e0 con 0x5642cc77a970 2024-09-17T05:37:59.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0205320 con 0x5642cc7981a0 2024-09-17T05:37:59.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d0204680 con 0x5642cc790ae0 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc77a970 0x5642cc8f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc77a970 0x5642cc8f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47180/0 (socket says 172.21.15.44:47180) 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 -- 172.21.15.44:0/2943511493 learned_addr learned my addr 172.21.15.44:0/2943511493 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6cfe00640 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d5400640 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc7981a0 0x5642cc895af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 -- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 msgr2=0x5642cc8f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 -- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc7981a0 msgr2=0x5642cc895af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc7981a0 0x5642cc895af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 -- 172.21.15.44:0/2943511493 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642cc768f30 con 0x5642cc77a970 2024-09-17T05:37:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d5400640 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc7981a0 0x5642cc895af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc77a970 0x5642cc8f9280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6c401d370 tx=0x7fa6c4006730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e657381236eb299c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6b7e00640 1 -- 172.21.15.44:0/2943511493 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40a6cf0 con 0x5642cc77a970 2024-09-17T05:37:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6b7e00640 1 -- 172.21.15.44:0/2943511493 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c40a9040 con 0x5642cc77a970 2024-09-17T05:37:59.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6b7e00640 1 -- 172.21.15.44:0/2943511493 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4003860 con 0x5642cc77a970 2024-09-17T05:37:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- 172.21.15.44:0/2943511493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc77a970 msgr2=0x5642cc8f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc77a970 0x5642cc8f9280 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa6c401d370 tx=0x7fa6c4006730 comp rx=0 tx=0).stop 2024-09-17T05:37:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- 172.21.15.44:0/2943511493 shutdown_connections 2024-09-17T05:37:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc7981a0 0x5642cc895af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc8f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 --2- 172.21.15.44:0/2943511493 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc77a970 0x5642cc8f9280 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- 172.21.15.44:0/2943511493 >> 172.21.15.44:0/2943511493 conn(0x5642cc79e8c0 msgr2=0x5642cc8e06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- 172.21.15.44:0/2943511493 shutdown_connections 2024-09-17T05:37:59.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.445+0000 7fa6dec89000 1 -- 172.21.15.44:0/2943511493 wait complete. 2024-09-17T05:37:59.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 -- start start 2024-09-17T05:37:59.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 Processor -- start 2024-09-17T05:37:59.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc956c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc9571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc9576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5642cc6ec550 con 0x5642cc7981a0 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5642cc6e4110 con 0x5642cc77a970 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5642cc6ac310 con 0x5642cc790ae0 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 10 client.0 _ll_register_callbacks cb 0x7fa6c8003a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc9576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc9576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47196/0 (socket says 172.21.15.44:47196) 2024-09-17T05:37:59.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 -- 172.21.15.44:0/3787755372 learned_addr learned my addr 172.21.15.44:0/3787755372 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6cfe00640 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc9571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc956c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 -- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 msgr2=0x5642cc9571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc9571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 -- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 msgr2=0x5642cc956c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc956c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 -- 172.21.15.44:0/3787755372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642cc73fdd0 con 0x5642cc7981a0 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6d5400640 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc9576f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8001570 tx=0x7fa6c8006f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffdaae84dc925a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6b5600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6b5600640 1 -- 172.21.15.44:0/3787755372 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8011850 con 0x5642cc7981a0 2024-09-17T05:37:59.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6b5600640 1 -- 172.21.15.44:0/3787755372 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fa6c80119f0 con 0x5642cc7981a0 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c40a9040 con 0x5642cc7981a0 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6b5600640 1 -- 172.21.15.44:0/3787755372 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa6c8031410 con 0x5642cc7981a0 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 10 client.5556 fetch_fsmap learned FSMap version 26 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5642cc67a840 con 0x5642cc7981a0 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.449+0000 7fa6b5600640 1 -- 172.21.15.44:0/3787755372 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c40a9040 con 0x5642cc7981a0 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6b5600640 1 -- 172.21.15.44:0/3787755372 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fa6c80315b0 con 0x5642cc7981a0 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 10 client.5556 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 10 client.5556 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 20 client.5556 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc374be0 0x5642cc898ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 4 client.5556 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-09-17T05:37:59.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x5642cc6f26e0 con 0x5642cc374be0 2024-09-17T05:37:59.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc374be0 0x5642cc898ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d4a00640 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc374be0 0x5642cc898ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee43f6c1a6eea25 server_cookie=c7ac3aa859d049dd in_seq=0 out_seq=0 2024-09-17T05:37:59.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6b5600640 10 client.5556 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6b5600640 1 -- 172.21.15.44:0/3787755372 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5642cc6f26e0 con 0x5642cc374be0 2024-09-17T05:37:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6b5600640 10 client.5556 handle_command_reply: tid=0 2024-09-17T05:37:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 client.5556 shutdown 2024-09-17T05:37:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 msgr2=0x5642cc9576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc9576f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8001570 tx=0x7fa6c8006f10 comp rx=0 tx=0).stop 2024-09-17T05:37:59.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 shutdown_connections 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x5642cc374be0 0x5642cc898ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5642cc7981a0 0x5642cc9576f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5642cc790ae0 0x5642cc9571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 --2- 172.21.15.44:0/3787755372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5642cc77a970 0x5642cc956c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 >> 172.21.15.44:0/3787755372 conn(0x5642cc79e8c0 msgr2=0x5642cc8e0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6b5600640 0 client.5556 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 shutdown_connections 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 1 -- 172.21.15.44:0/3787755372 wait complete. 2024-09-17T05:37:59.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6dec89000 20 client.5556 trim_cache size 0 max 16384 2024-09-17T05:37:59.460 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:37:59.453+0000 7f631c600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 pv4 ap=4 DIRTYPARENT s=0 n(v0 1=1+0)->n(v0 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5511=0-4194304@1} caps={5511=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5511 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x55ce51100c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:37:59.460 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:37:59.460 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:37:59.460 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "e6381638-5b1a-44fa-82dc-95f36081964a", 2024-09-17T05:37:59.460 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:37:59.460 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:37:59.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa6b0073230 msgr2=0x7fa6b0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa6b0073230 0x7fa6b0075740 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40ac000 tx=0x7fa6c4019cd0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6d0142930 msgr2=0x7fa6d01fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6d0142930 0x7fa6d01fc200 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc011b10 tx=0x7fa6bc009ea0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 shutdown_connections 2024-09-17T05:37:59.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa6d01fc740 0x7fa6d0152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6d0142930 0x7fa6d01fc200 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa6b0073230 0x7fa6b0075740 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 --2- 172.21.15.44:0/705278017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6b8003c20 0x7fa6d0163910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 >> 172.21.15.44:0/705278017 conn(0x7fa6d00b4160 msgr2=0x7fa6d015ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 shutdown_connections 2024-09-17T05:37:59.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.453+0000 7fa6d7400640 1 -- 172.21.15.44:0/705278017 wait complete. 2024-09-17T05:37:59.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:59.476 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T05:37:59.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 -- 172.21.15.44:0/1841099390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100d18f0 msgr2=0x7fba100b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 --2- 172.21.15.44:0/1841099390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100d18f0 0x7fba100b1be0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fba100744e0 tx=0x7fba0001c800 comp rx=0 tx=0).stop 2024-09-17T05:37:59.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 -- 172.21.15.44:0/1841099390 shutdown_connections 2024-09-17T05:37:59.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 --2- 172.21.15.44:0/1841099390 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba100cf5b0 0x7fba1015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 --2- 172.21.15.44:0/1841099390 >> v2:172.21.15.86:3300/0 conn(0x7fba100d1d00 0x7fba100cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 --2- 172.21.15.44:0/1841099390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100d18f0 0x7fba100b1be0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 -- 172.21.15.44:0/1841099390 >> 172.21.15.44:0/1841099390 conn(0x7fba100b4240 msgr2=0x7fba100b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 -- 172.21.15.44:0/1841099390 shutdown_connections 2024-09-17T05:37:59.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 -- 172.21.15.44:0/1841099390 wait complete. 2024-09-17T05:37:59.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 Processor -- start 2024-09-17T05:37:59.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 -- start start 2024-09-17T05:37:59.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.637+0000 7fba16a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100cf5b0 0x7fba1006e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba16a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba100d18f0 0x7fba101fbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba16a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba100d1d00 0x7fba10071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba16a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba100d0d70 con 0x7fba100cf5b0 2024-09-17T05:37:59.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba16a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba100d0bf0 con 0x7fba100d1d00 2024-09-17T05:37:59.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba16a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fba100d0ef0 con 0x7fba100d18f0 2024-09-17T05:37:59.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100cf5b0 0x7fba1006e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100cf5b0 0x7fba1006e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47204/0 (socket says 172.21.15.44:47204) 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 -- 172.21.15.44:0/944783938 learned_addr learned my addr 172.21.15.44:0/944783938 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba07e00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba100d18f0 0x7fba101fbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba14a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba100d1d00 0x7fba10071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 -- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba100d18f0 msgr2=0x7fba101fbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba100d18f0 0x7fba101fbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 -- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba100d1d00 msgr2=0x7fba10071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba100d1d00 0x7fba10071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 -- 172.21.15.44:0/944783938 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1006ea30 con 0x7fba100cf5b0 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba14a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba100d1d00 0x7fba10071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0fe00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100cf5b0 0x7fba1006e400 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fba0001aeb0 tx=0x7fba000a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0cc00640 1 -- 172.21.15.44:0/944783938 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba000bb070 con 0x7fba100cf5b0 2024-09-17T05:37:59.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0cc00640 1 -- 172.21.15.44:0/944783938 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba00004430 con 0x7fba100cf5b0 2024-09-17T05:37:59.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0cc00640 1 -- 172.21.15.44:0/944783938 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba000b2040 con 0x7fba100cf5b0 2024-09-17T05:37:59.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba101fccc0 con 0x7fba100cf5b0 2024-09-17T05:37:59.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba101fd280 con 0x7fba100cf5b0 2024-09-17T05:37:59.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.641+0000 7fba0cc00640 1 -- 172.21.15.44:0/944783938 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fba00005290 con 0x7fba100cf5b0 2024-09-17T05:37:59.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba0cc00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb9ec073200 0x7fb9ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba0cc00640 1 -- 172.21.15.44:0/944783938 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fba0012deb0 con 0x7fba100cf5b0 2024-09-17T05:37:59.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba07e00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb9ec073200 0x7fb9ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 Processor -- start 2024-09-17T05:37:59.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 -- start start 2024-09-17T05:37:59.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba07e00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb9ec073200 0x7fb9ec075710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8005fd0 tx=0x7fb9f8005e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e7d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e7df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e7e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b02d1ccd0 con 0x564b02d116d0 2024-09-17T05:37:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564b02c32330 con 0x564b02a2caa0 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564b02c8fbb0 con 0x564b02968890 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e7d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba0fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e7d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47220/0 (socket says 172.21.15.44:47220) 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.645+0000 7fba0fe00640 1 -- 172.21.15.44:0/351892533 learned_addr learned my addr 172.21.15.44:0/351892533 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba14a00640 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e7e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba0fe00640 1 -- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 msgr2=0x564b02e7df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba07e00640 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e7df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba0fe00640 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e7df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba0fe00640 1 -- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 msgr2=0x564b02e7e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba0fe00640 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e7e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba0fe00640 1 -- 172.21.15.44:0/351892533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b02c33c80 con 0x564b02d116d0 2024-09-17T05:37:59.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba14a00640 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e7e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:59.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba07e00640 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e7df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:59.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba0fe00640 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e7d9f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fba000f5880 tx=0x7fba000f7f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbadae93608d62f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fb9ffe00640 1 -- 172.21.15.44:0/351892533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00005580 con 0x564b02d116d0 2024-09-17T05:37:59.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fb9ffe00640 1 -- 172.21.15.44:0/351892533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba000f8120 con 0x564b02d116d0 2024-09-17T05:37:59.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fb9ffe00640 1 -- 172.21.15.44:0/351892533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba000f8d10 con 0x564b02d116d0 2024-09-17T05:37:59.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 -- 172.21.15.44:0/351892533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 msgr2=0x564b02e7d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e7d9f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fba000f5880 tx=0x7fba000f7f60 comp rx=0 tx=0).stop 2024-09-17T05:37:59.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 -- 172.21.15.44:0/351892533 shutdown_connections 2024-09-17T05:37:59.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e7e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e7df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/351892533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e7d9f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 -- 172.21.15.44:0/351892533 >> 172.21.15.44:0/351892533 conn(0x564b0293c5c0 msgr2=0x564b02e3aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 -- 172.21.15.44:0/351892533 shutdown_connections 2024-09-17T05:37:59.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 -- 172.21.15.44:0/351892533 wait complete. 2024-09-17T05:37:59.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 -- start start 2024-09-17T05:37:59.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.649+0000 7fba1e0d5000 1 Processor -- start 2024-09-17T05:37:59.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e84e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02a2caa0 0x564b02e853c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e85900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b02c82df0 con 0x564b02d116d0 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564b02c7efe0 con 0x564b02968890 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564b02c244d0 con 0x564b02a2caa0 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 10 client.0 _ll_register_callbacks cb 0x564b02c027f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e85900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e85900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47226/0 (socket says 172.21.15.44:47226) 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 -- 172.21.15.44:0/2093889893 learned_addr learned my addr 172.21.15.44:0/2093889893 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba0fe00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e84e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba07e00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02a2caa0 0x564b02e853c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 -- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02a2caa0 msgr2=0x564b02e853c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02a2caa0 0x564b02e853c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 -- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 msgr2=0x564b02e84e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e84e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 -- 172.21.15.44:0/2093889893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b02c1d210 con 0x564b02d116d0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba0fe00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e84e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba14a00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e85900 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fba08011740 tx=0x7fba08011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8268bb0cc9ffc86c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fb9fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fb9fcc00640 1 -- 172.21.15.44:0/2093889893 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0801f060 con 0x564b02d116d0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fb9fcc00640 1 -- 172.21.15.44:0/2093889893 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fba0800fcf0 con 0x564b02d116d0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b02c17350 con 0x564b02d116d0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fb9fcc00640 1 -- 172.21.15.44:0/2093889893 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fba08025050 con 0x564b02d116d0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 10 client.5568 fetch_fsmap learned FSMap version 26 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x564b02c03fc0 con 0x564b02d116d0 2024-09-17T05:37:59.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fb9fcc00640 1 -- 172.21.15.44:0/2093889893 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564b02c17350 con 0x564b02d116d0 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fb9fcc00640 1 -- 172.21.15.44:0/2093889893 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fba08028020 con 0x564b02d116d0 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 10 client.5568 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 10 client.5568 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 20 client.5568 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b02921930 0x564b02e8f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 4 client.5568 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b02c91b00 con 0x564b02921930 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba0fe00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b02921930 0x564b02e8f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fba0fe00640 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b02921930 0x564b02e8f260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0b05f17f3c13ca server_cookie=9ce584334d00fdde in_seq=0 out_seq=0 2024-09-17T05:37:59.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.653+0000 7fb9fcc00640 10 client.5568 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fb9fcc00640 1 -- 172.21.15.44:0/2093889893 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b02c91b00 con 0x564b02921930 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fb9fcc00640 10 client.5568 handle_command_reply: tid=0 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 client.5568 shutdown 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 msgr2=0x564b02e85900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e85900 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fba08011740 tx=0x7fba08011c00 comp rx=0 tx=0).stop 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 shutdown_connections 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b02921930 0x564b02e8f260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02e85900 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02a2caa0 0x564b02e853c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fb9fcc00640 0 client.5568 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/2093889893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e84e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 >> 172.21.15.44:0/2093889893 conn(0x564b0293c5c0 msgr2=0x564b02e7bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 shutdown_connections 2024-09-17T05:37:59.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 1 -- 172.21.15.44:0/2093889893 wait complete. 2024-09-17T05:37:59.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.657+0000 7fba1e0d5000 20 client.5568 trim_cache size 0 max 16384 2024-09-17T05:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.673+0000 7fba1e0d5000 1 Processor -- start 2024-09-17T05:37:59.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.673+0000 7fba1e0d5000 1 -- start start 2024-09-17T05:37:59.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e37f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02a2caa0 0x564b02e38440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02d116d0 0x564b02e87c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b02e36aa0 con 0x564b02a2caa0 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba10205960 con 0x564b02968890 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fba10204940 con 0x564b02d116d0 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02a2caa0 0x564b02e38440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02a2caa0 0x564b02e38440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47236/0 (socket says 172.21.15.44:47236) 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 -- 172.21.15.44:0/3715099490 learned_addr learned my addr 172.21.15.44:0/3715099490 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba0fe00640 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e37f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba14a00640 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02d116d0 0x564b02e87c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 -- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02d116d0 msgr2=0x564b02e87c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02d116d0 0x564b02e87c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 -- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 msgr2=0x564b02e37f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e37f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 -- 172.21.15.44:0/3715099490 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b02e3a6c0 con 0x564b02a2caa0 2024-09-17T05:37:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba14a00640 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02d116d0 0x564b02e87c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:59.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba07e00640 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02a2caa0 0x564b02e38440 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800ff00 tx=0x7fb9f8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901cb32b57fd6c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fb9ff400640 1 -- 172.21.15.44:0/3715099490 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8005220 con 0x564b02a2caa0 2024-09-17T05:37:59.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fb9ff400640 1 -- 172.21.15.44:0/3715099490 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9f80053c0 con 0x564b02a2caa0 2024-09-17T05:37:59.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fb9ff400640 1 -- 172.21.15.44:0/3715099490 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80047b0 con 0x564b02a2caa0 2024-09-17T05:37:59.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3715099490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02a2caa0 msgr2=0x564b02e38440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02a2caa0 0x564b02e38440 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800ff00 tx=0x7fb9f8012000 comp rx=0 tx=0).stop 2024-09-17T05:37:59.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3715099490 shutdown_connections 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02d116d0 0x564b02e87c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02a2caa0 0x564b02e38440 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3715099490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02968890 0x564b02e37f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3715099490 >> 172.21.15.44:0/3715099490 conn(0x564b0293c5c0 msgr2=0x564b02e30c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3715099490 shutdown_connections 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.677+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3715099490 wait complete. 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 -- start start 2024-09-17T05:37:59.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 Processor -- start 2024-09-17T05:37:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e8a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e8ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02eaf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba10166090 con 0x564b02d116d0 2024-09-17T05:37:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba10165a40 con 0x564b02a2caa0 2024-09-17T05:37:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564b02944680 con 0x564b02968890 2024-09-17T05:37:59.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 10 client.0 _ll_register_callbacks cb 0x7fba0800c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02eaf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02eaf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47250/0 (socket says 172.21.15.44:47250) 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 -- 172.21.15.44:0/3852529381 learned_addr learned my addr 172.21.15.44:0/3852529381 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba0fe00640 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e8a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba07e00640 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e8ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 -- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 msgr2=0x564b02e8a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e8a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 -- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 msgr2=0x564b02e8ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e8ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 -- 172.21.15.44:0/3852529381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b02cdc680 con 0x564b02d116d0 2024-09-17T05:37:59.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba14a00640 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02eaf780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fba08000f90 tx=0x7fba0800fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00ba9341af7eaec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fb9fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fb9fcc00640 1 -- 172.21.15.44:0/3852529381 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0800f6d0 con 0x564b02d116d0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fb9fcc00640 1 -- 172.21.15.44:0/3852529381 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fba08004b30 con 0x564b02d116d0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9f80053c0 con 0x564b02d116d0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fb9fcc00640 1 -- 172.21.15.44:0/3852529381 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fba08038050 con 0x564b02d116d0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 10 client.5574 fetch_fsmap learned FSMap version 26 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x564b02c490b0 con 0x564b02d116d0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fb9fcc00640 1 -- 172.21.15.44:0/3852529381 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9f80053c0 con 0x564b02d116d0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fb9fcc00640 1 -- 172.21.15.44:0/3852529381 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7fba0803b020 con 0x564b02d116d0 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 10 client.5574 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 10 client.5574 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-17T05:37:59.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 20 client.5574 populate_metadata read hostname 'smithi044' 2024-09-17T05:37:59.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b0290f990 0x564b02ef31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:59.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 4 client.5574 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:37:59.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.681+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564b02c8d5b0 con 0x564b0290f990 2024-09-17T05:37:59.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba0fe00640 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b0290f990 0x564b02ef31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:59.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fb9fcc00640 10 client.5574 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba0fe00640 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b0290f990 0x564b02ef31e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fd96d9397ede21c server_cookie=1772a2a8705f97e9 in_seq=0 out_seq=0 2024-09-17T05:37:59.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fb9fcc00640 1 -- 172.21.15.44:0/3852529381 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x564b02c8d5b0 con 0x564b0290f990 2024-09-17T05:37:59.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fb9fcc00640 10 client.5574 handle_command_reply: tid=0 2024-09-17T05:37:59.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 client.5574 shutdown 2024-09-17T05:37:59.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 msgr2=0x564b02eaf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02eaf780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fba08000f90 tx=0x7fba0800fd20 comp rx=0 tx=0).stop 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 shutdown_connections 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x564b0290f990 0x564b02ef31e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b02d116d0 0x564b02eaf780 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564b02a2caa0 0x564b02e8ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 --2- 172.21.15.44:0/3852529381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564b02968890 0x564b02e8a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fb9fcc00640 0 client.5574 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 >> 172.21.15.44:0/3852529381 conn(0x564b0293c5c0 msgr2=0x564b02e37f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 shutdown_connections 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 1 -- 172.21.15.44:0/3852529381 wait complete. 2024-09-17T05:37:59.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba1e0d5000 20 client.5574 trim_cache size 0 max 16384 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: "e6381638-5b1a-44fa-82dc-95f36081964a": { 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "e6381638-5b1a-44fa-82dc-95f36081964a", 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive,repair" 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:59.691 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "e6381638-5b1a-44fa-82dc-95f36081964a": { 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:37:59.453966+0000", 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:37:59.692 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:37:59.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb9ec073200 msgr2=0x7fb9ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb9ec073200 0x7fb9ec075710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8005fd0 tx=0x7fb9f8005e40 comp rx=0 tx=0).stop 2024-09-17T05:37:59.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100cf5b0 msgr2=0x7fba1006e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:59.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100cf5b0 0x7fba1006e400 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fba0001aeb0 tx=0x7fba000a5790 comp rx=0 tx=0).stop 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 shutdown_connections 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb9ec073200 0x7fb9ec075710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba100d1d00 0x7fba10071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fba100d18f0 0x7fba101fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 --2- 172.21.15.44:0/944783938 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba100cf5b0 0x7fba1006e400 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 >> 172.21.15.44:0/944783938 conn(0x7fba100b4240 msgr2=0x7fba1015b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 shutdown_connections 2024-09-17T05:37:59.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:37:59.685+0000 7fba16a00640 1 -- 172.21.15.44:0/944783938 wait complete. 2024-09-17T05:37:59.706 INFO:tasks.cephfs.filesystem:scrub status for tag:e6381638-5b1a-44fa-82dc-95f36081964a - {'path': '/', 'tag': 'e6381638-5b1a-44fa-82dc-95f36081964a', 'options': 'recursive,repair'} 2024-09-17T05:38:00.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:00.365+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 7 ==== log(6 entries from seq 1 at 2024-09-17T05:37:59.455774+0000) ==== 1078+0+0 (secure 0 0 0) 0x7f4f60005760 con 0x7f4f6815d290 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: cluster: 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: id: 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: health: HEALTH_OK 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: services: 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: mgr: x(active, since 2m), standbys: y 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: mds: 1/1 daemons up, 3 standby 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: osd: 8 osds: 8 up (since 113s), 8 in (since 2m) 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:00.366 INFO:teuthology.orchestra.run.smithi044.stdout: data: 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: volumes: 1/1 healthy 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: pools: 3 pools, 97 pgs 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: objects: 24 objects, 579 KiB 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: usage: 221 MiB used, 720 GiB / 720 GiB avail 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: pgs: 97 active+clean 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: io: 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: client: 1.1 KiB/s wr, 0 op/s rd, 1 op/s wr 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:37:59.455774+0000 mds.a [INF] scrub queued for path: / 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:37:59.455777+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-09-17T05:38:00.367 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:37:59.455782+0000 mds.a [INF] scrub summary: active paths [/] 2024-09-17T05:38:00.368 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:37:59.457395+0000 mds.a [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-09-17T05:38:00.368 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:37:59.457402+0000 mds.a [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-09-17T05:38:00.368 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:37:59.459596+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-09-17T05:38:03.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:03.369+0000 7f4f5e000640 1 -- 172.21.15.44:0/1103849319 <== mon.0 v2:172.21.15.44:3300/0 8 ==== log(1 entries from seq 7 at 2024-09-17T05:38:01.582264+0000) ==== 189+0+0 (secure 0 0 0) 0x7f4f600924d0 con 0x7f4f6815d290 2024-09-17T05:38:03.373 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:38:01.582264+0000 mds.a [INF] scrub summary: idle 2024-09-17T05:38:11.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:11.855 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:29.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:29.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T05:38:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.881+0000 7f9903800640 1 -- 172.21.15.44:0/625828540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98e4005160 msgr2=0x7f98e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.881+0000 7f9903800640 1 --2- 172.21.15.44:0/625828540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98e4005160 0x7f98e400b9d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0cff10 tx=0x7f98f401d610 comp rx=0 tx=0).stop 2024-09-17T05:38:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.881+0000 7f9901800640 1 -- 172.21.15.44:0/625828540 reap_dead start 2024-09-17T05:38:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.881+0000 7f9903800640 1 -- 172.21.15.44:0/625828540 shutdown_connections 2024-09-17T05:38:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.881+0000 7f9903800640 1 -- 172.21.15.44:0/625828540 >> 172.21.15.44:0/625828540 conn(0x7f98fc0ccaa0 msgr2=0x7f98fc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:29.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.881+0000 7f9903800640 1 -- 172.21.15.44:0/625828540 shutdown_connections 2024-09-17T05:38:29.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.881+0000 7f9903800640 1 -- 172.21.15.44:0/625828540 wait complete. 2024-09-17T05:38:29.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 Processor -- start 2024-09-17T05:38:29.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 -- start start 2024-09-17T05:38:29.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98e4005160 0x7f98fc0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98fc070850 0x7f98fc155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98fc1e9360 0x7f98fc1e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0cbc90 con 0x7f98fc070850 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0cbb10 con 0x7f98e4005160 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f9903800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc0cbe10 con 0x7f98fc1e9360 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98fc070850 0x7f98fc155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f98fbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98fc070850 0x7f98fc155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40180/0 (socket says 172.21.15.44:40180) 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.885+0000 7f98fbe00640 1 -- 172.21.15.44:0/2730455471 learned_addr learned my addr 172.21.15.44:0/2730455471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f9901800640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98fc1e9360 0x7f98fc1e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f9900e00640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98e4005160 0x7f98fc0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98fbe00640 1 -- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98fc1e9360 msgr2=0x7f98fc1e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98fbe00640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98fc1e9360 0x7f98fc1e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98fbe00640 1 -- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98e4005160 msgr2=0x7f98fc0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98fbe00640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98e4005160 0x7f98fc0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98fbe00640 1 -- 172.21.15.44:0/2730455471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc1e9cb0 con 0x7f98fc070850 2024-09-17T05:38:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98fbe00640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98fc070850 0x7f98fc155a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f98e8011a60 tx=0x7f98e8011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:29.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98f8c00640 1 -- 172.21.15.44:0/2730455471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e801f070 con 0x7f98fc070850 2024-09-17T05:38:29.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98f8c00640 1 -- 172.21.15.44:0/2730455471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98e8012450 con 0x7f98fc070850 2024-09-17T05:38:29.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98f8c00640 1 -- 172.21.15.44:0/2730455471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8012840 con 0x7f98fc070850 2024-09-17T05:38:29.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc0c8490 con 0x7f98fc070850 2024-09-17T05:38:29.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc0c8a50 con 0x7f98fc070850 2024-09-17T05:38:29.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.889+0000 7f98f8c00640 1 -- 172.21.15.44:0/2730455471 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f98e8022070 con 0x7f98fc070850 2024-09-17T05:38:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f98f8c00640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98dc073200 0x7f98dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f98f8c00640 1 -- 172.21.15.44:0/2730455471 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f98e80950d0 con 0x7f98fc070850 2024-09-17T05:38:29.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98dc073200 0x7f98dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 Processor -- start 2024-09-17T05:38:29.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 -- start start 2024-09-17T05:38:29.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98dc073200 0x7f98dc075710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001340 tx=0x7f98f0006920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9aee5890 0x55fb9b3faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9afa9aa0 0x55fb9b3fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb9b299cd0 con 0x55fb9b28e6d0 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fb9b1af330 con 0x55fb9afa9aa0 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55fb9b20cbb0 con 0x55fb9aee5890 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3fa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40190/0 (socket says 172.21.15.44:40190) 2024-09-17T05:38:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 -- 172.21.15.44:0/4258282913 learned_addr learned my addr 172.21.15.44:0/4258282913 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f98fbe00640 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9aee5890 0x55fb9b3faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9901800640 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9afa9aa0 0x55fb9b3fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 -- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9aee5890 msgr2=0x55fb9b3faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9aee5890 0x55fb9b3faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 -- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9afa9aa0 msgr2=0x55fb9b3fb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.893+0000 7f9900e00640 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9afa9aa0 0x55fb9b3fb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f9900e00640 1 -- 172.21.15.44:0/4258282913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9b1b0c80 con 0x55fb9b28e6d0 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f9900e00640 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3fa9f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f98f00046a0 tx=0x7f98f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf95bcbb20dfa479 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f98ed600640 1 -- 172.21.15.44:0/4258282913 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0012530 con 0x55fb9b28e6d0 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f98ed600640 1 -- 172.21.15.44:0/4258282913 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98f0026020 con 0x55fb9b28e6d0 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f98ed600640 1 -- 172.21.15.44:0/4258282913 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00128d0 con 0x55fb9b28e6d0 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 -- 172.21.15.44:0/4258282913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 msgr2=0x55fb9b3fa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3fa9f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f98f00046a0 tx=0x7f98f0017000 comp rx=0 tx=0).stop 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 -- 172.21.15.44:0/4258282913 shutdown_connections 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9afa9aa0 0x55fb9b3fb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9aee5890 0x55fb9b3faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 --2- 172.21.15.44:0/4258282913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3fa9f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 -- 172.21.15.44:0/4258282913 >> 172.21.15.44:0/4258282913 conn(0x55fb9aeb95c0 msgr2=0x55fb9b3b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:29.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 -- 172.21.15.44:0/4258282913 shutdown_connections 2024-09-17T05:38:29.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 -- 172.21.15.44:0/4258282913 wait complete. 2024-09-17T05:38:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 -- start start 2024-09-17T05:38:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.897+0000 7f990ad87000 1 Processor -- start 2024-09-17T05:38:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b3b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b3b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb9b1ffdf0 con 0x55fb9b28e6d0 2024-09-17T05:38:29.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fb9b1fbfe0 con 0x55fb9aee5890 2024-09-17T05:38:29.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55fb9b1a14d0 con 0x55fb9afa9aa0 2024-09-17T05:38:29.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 10 client.0 _ll_register_callbacks cb 0x55fb9b17f7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:38:29.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9900e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b3b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3bd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40196/0 (socket says 172.21.15.44:40196) 2024-09-17T05:38:29.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 -- 172.21.15.44:0/3119323856 learned_addr learned my addr 172.21.15.44:0/3119323856 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:29.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98fbe00640 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b3b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 -- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 msgr2=0x55fb9b3b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b3b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 -- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 msgr2=0x55fb9b3b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b3b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 -- 172.21.15.44:0/3119323856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb9b19a210 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9900e00640 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b3b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9901800640 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3bd5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f98f4002240 tx=0x7f98f4004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5902bbe820f3ac9c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 1 -- 172.21.15.44:0/3119323856 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40aa420 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 1 -- 172.21.15.44:0/3119323856 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f98f4002040 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb9b194350 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 1 -- 172.21.15.44:0/3119323856 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f98f40aa710 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 10 client.5586 fetch_fsmap learned FSMap version 26 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55fb9b180fc0 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 1 -- 172.21.15.44:0/3119323856 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55fb9b194350 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 1 -- 172.21.15.44:0/3119323856 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f98f40aa8b0 con 0x55fb9b28e6d0 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 10 client.5586 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:38:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 10 client.5586 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 20 client.5586 populate_metadata read hostname 'smithi044' 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae9e930 0x55fb9b401e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 4 client.5586 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb9b20eb00 con 0x55fb9ae9e930 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9900e00640 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae9e930 0x55fb9b401e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f9900e00640 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae9e930 0x55fb9b401e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dee0136316b4fa5e server_cookie=5dfc0ccb25693c54 in_seq=0 out_seq=0 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 10 client.5586 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 1 -- 172.21.15.44:0/3119323856 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb9b20eb00 con 0x55fb9ae9e930 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.901+0000 7f98e2000640 10 client.5586 handle_command_reply: tid=0 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 client.5586 shutdown 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 msgr2=0x55fb9b3bd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3bd5f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f98f4002240 tx=0x7f98f4004e70 comp rx=0 tx=0).stop 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 shutdown_connections 2024-09-17T05:38:29.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae9e930 0x55fb9b401e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3bd5f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b3b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 --2- 172.21.15.44:0/3119323856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b3b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f98e2000640 0 client.5586 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 >> 172.21.15.44:0/3119323856 conn(0x55fb9aeb95c0 msgr2=0x55fb9b3afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 shutdown_connections 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 1 -- 172.21.15.44:0/3119323856 wait complete. 2024-09-17T05:38:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.905+0000 7f990ad87000 20 client.5586 trim_cache size 0 max 16384 2024-09-17T05:38:29.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.921+0000 7f990ad87000 1 Processor -- start 2024-09-17T05:38:29.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.921+0000 7f990ad87000 1 -- start start 2024-09-17T05:38:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9aee5890 0x55fb9b46c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9b28e6d0 0x55fb9b46ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fb9b3b5b20 con 0x55fb9aee5890 2024-09-17T05:38:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc202f80 con 0x55fb9b28e6d0 2024-09-17T05:38:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc201f90 con 0x55fb9afa9aa0 2024-09-17T05:38:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9aee5890 0x55fb9b46c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9aee5890 0x55fb9b46c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40200/0 (socket says 172.21.15.44:40200) 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 -- 172.21.15.44:0/4100520391 learned_addr learned my addr 172.21.15.44:0/4100520391 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f98fbe00640 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9901800640 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9b28e6d0 0x55fb9b46ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 -- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 msgr2=0x55fb9b46c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 -- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9b28e6d0 msgr2=0x55fb9b46ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9b28e6d0 0x55fb9b46ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 -- 172.21.15.44:0/4100520391 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9b259680 con 0x55fb9aee5890 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f98fbe00640 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9901800640 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9b28e6d0 0x55fb9b46ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f9900e00640 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9aee5890 0x55fb9b46c400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f98f0023000 tx=0x7f98fc0741b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c77610e512ddf23 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:29.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f98ecc00640 1 -- 172.21.15.44:0/4100520391 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0025040 con 0x55fb9aee5890 2024-09-17T05:38:29.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f98ecc00640 1 -- 172.21.15.44:0/4100520391 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98f0026040 con 0x55fb9aee5890 2024-09-17T05:38:29.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f98ecc00640 1 -- 172.21.15.44:0/4100520391 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0012c40 con 0x55fb9aee5890 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- 172.21.15.44:0/4100520391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9aee5890 msgr2=0x55fb9b46c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9aee5890 0x55fb9b46c400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f98f0023000 tx=0x7f98fc0741b0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- 172.21.15.44:0/4100520391 shutdown_connections 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9b28e6d0 0x55fb9b46ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 --2- 172.21.15.44:0/4100520391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9aee5890 0x55fb9b46c400 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- 172.21.15.44:0/4100520391 >> 172.21.15.44:0/4100520391 conn(0x55fb9aeb95c0 msgr2=0x55fb9b40cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- 172.21.15.44:0/4100520391 shutdown_connections 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- 172.21.15.44:0/4100520391 wait complete. 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 -- start start 2024-09-17T05:38:29.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.925+0000 7f990ad87000 1 Processor -- start 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b46c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc201920 con 0x55fb9b28e6d0 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc201300 con 0x55fb9aee5890 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55fb9aec1680 con 0x55fb9afa9aa0 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 10 client.0 _ll_register_callbacks cb 0x7f98f40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40206/0 (socket says 172.21.15.44:40206) 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 -- 172.21.15.44:0/2403406732 learned_addr learned my addr 172.21.15.44:0/2403406732 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9900e00640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b46c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98fbe00640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 -- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 msgr2=0x55fb9b46cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 -- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 msgr2=0x55fb9b46c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b46c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 -- 172.21.15.44:0/2403406732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb9b1c60b0 con 0x55fb9b28e6d0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98fbe00640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9901800640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3b1950 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f98f401daf0 tx=0x7f98f40bc710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45834d41c87e2755 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98e2000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98e2000640 1 -- 172.21.15.44:0/2403406732 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40bcb10 con 0x55fb9b28e6d0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98e2000640 1 -- 172.21.15.44:0/2403406732 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f98f40aae00 con 0x55fb9b28e6d0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98f0026040 con 0x55fb9b28e6d0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98e2000640 1 -- 172.21.15.44:0/2403406732 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f98f40bccb0 con 0x55fb9b28e6d0 2024-09-17T05:38:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 10 client.5592 fetch_fsmap learned FSMap version 26 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x55fb9b192610 con 0x55fb9b28e6d0 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98e2000640 1 -- 172.21.15.44:0/2403406732 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98f0026040 con 0x55fb9b28e6d0 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98e2000640 1 -- 172.21.15.44:0/2403406732 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 26) ==== 3502+0+0 (secure 0 0 0) 0x7f98f40cd430 con 0x55fb9b28e6d0 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 10 client.5592 fetch_fsmap finished waiting for FSMap version 26 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 10 client.5592 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 20 client.5592 populate_metadata read hostname 'smithi044' 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae8c990 0x55fb9b3b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 4 client.5592 mds_command: new command op to 5343 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 --> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb9b20a5b0 con 0x55fb9ae8c990 2024-09-17T05:38:29.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9900e00640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae8c990 0x55fb9b3b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:29.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f9900e00640 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae8c990 0x55fb9b3b22b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce8df2bd584287a4 server_cookie=c12b530a02077586 in_seq=0 out_seq=0 2024-09-17T05:38:29.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.929+0000 7f98e2000640 10 client.5592 ms_handle_connect on v2:172.21.15.44:6833/767726494 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f98e2000640 1 -- 172.21.15.44:0/2403406732 <== mds.0 v2:172.21.15.44:6833/767726494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55fb9b20a5b0 con 0x55fb9ae8c990 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f98e2000640 10 client.5592 handle_command_reply: tid=0 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 client.5592 shutdown 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 msgr2=0x55fb9b3b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3b1950 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f98f401daf0 tx=0x7f98f40bc710 comp rx=0 tx=0).stop 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 shutdown_connections 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:6833/767726494,v1:172.21.15.44:6835/767726494] conn(0x55fb9ae8c990 0x55fb9b3b22b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fb9b28e6d0 0x55fb9b3b1950 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fb9afa9aa0 0x55fb9b46cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 --2- 172.21.15.44:0/2403406732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fb9aee5890 0x55fb9b46c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f98e2000640 0 client.5592 ms_handle_reset on v2:172.21.15.44:6833/767726494 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 >> 172.21.15.44:0/2403406732 conn(0x55fb9aeb95c0 msgr2=0x55fb9b3bc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:29.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 shutdown_connections 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 1 -- 172.21.15.44:0/2403406732 wait complete. 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f990ad87000 20 client.5592 trim_cache size 0 max 16384 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stdout: "e6381638-5b1a-44fa-82dc-95f36081964a": { 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:37:59.453966+0000", 2024-09-17T05:38:29.937 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:38:29.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98dc073200 msgr2=0x7f98dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98dc073200 0x7f98dc075710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001340 tx=0x7f98f0006920 comp rx=0 tx=0).stop 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98fc070850 msgr2=0x7f98fc155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98fc070850 0x7f98fc155a40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f98e8011a60 tx=0x7f98e8011f20 comp rx=0 tx=0).stop 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 shutdown_connections 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98fc1e9360 0x7f98fc1e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98fc070850 0x7f98fc155a40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98dc073200 0x7f98dc075710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 --2- 172.21.15.44:0/2730455471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98e4005160 0x7f98fc0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 >> 172.21.15.44:0/2730455471 conn(0x7f98fc0ccaa0 msgr2=0x7f98fc09e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 shutdown_connections 2024-09-17T05:38:29.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:29.933+0000 7f9903800640 1 -- 172.21.15.44:0/2730455471 wait complete. 2024-09-17T05:38:29.953 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:38:30.055 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.213+0000 7f07c8a00640 1 -- 172.21.15.44:0/2580795456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07a80039f0 msgr2=0x7f07a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.213+0000 7f07c8a00640 1 --2- 172.21.15.44:0/2580795456 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07a80039f0 0x7f07a8003e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009b60 tx=0x7f07b401d290 comp rx=0 tx=0).stop 2024-09-17T05:38:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.213+0000 7f07c2800640 1 -- 172.21.15.44:0/2580795456 reap_dead start 2024-09-17T05:38:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.213+0000 7f07c8a00640 1 -- 172.21.15.44:0/2580795456 shutdown_connections 2024-09-17T05:38:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.213+0000 7f07c8a00640 1 -- 172.21.15.44:0/2580795456 >> 172.21.15.44:0/2580795456 conn(0x7f07c40ccaa0 msgr2=0x7f07c40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.213+0000 7f07c8a00640 1 -- 172.21.15.44:0/2580795456 shutdown_connections 2024-09-17T05:38:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.213+0000 7f07c8a00640 1 -- 172.21.15.44:0/2580795456 wait complete. 2024-09-17T05:38:30.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 Processor -- start 2024-09-17T05:38:30.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 -- start start 2024-09-17T05:38:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07a80039f0 0x7f07c40b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c40b2e70 0x7f07c41f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c40c62d0 0x7f07c40c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4167e80 con 0x7f07c40c62d0 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4167d00 con 0x7f07c40b2e70 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f07c4168000 con 0x7f07a80039f0 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c40c62d0 0x7f07c40c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c40c62d0 0x7f07c40c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40220/0 (socket says 172.21.15.44:40220) 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 -- 172.21.15.44:0/3830126710 learned_addr learned my addr 172.21.15.44:0/3830126710 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c1e00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07a80039f0 0x7f07c40b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07bbe00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c40b2e70 0x7f07c41f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 -- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07a80039f0 msgr2=0x7f07c40b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07a80039f0 0x7f07c40b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 -- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c40b2e70 msgr2=0x7f07c41f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c40b2e70 0x7f07c41f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 -- 172.21.15.44:0/3830126710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c406f1e0 con 0x7f07c40c62d0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c2800640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c40c62d0 0x7f07c40c66e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f07a8004790 tx=0x7f07bc001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07ba000640 1 -- 172.21.15.44:0/3830126710 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc017070 con 0x7f07c40c62d0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07ba000640 1 -- 172.21.15.44:0/3830126710 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07bc010980 con 0x7f07c40c62d0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c406f4c0 con 0x7f07c40c62d0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07ba000640 1 -- 172.21.15.44:0/3830126710 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc010dd0 con 0x7f07c40c62d0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.217+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c406fa80 con 0x7f07c40c62d0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.221+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c40cb880 con 0x7f07c40c62d0 2024-09-17T05:38:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.221+0000 7f07ba000640 1 -- 172.21.15.44:0/3830126710 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f07bc01a070 con 0x7f07c40c62d0 2024-09-17T05:38:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.221+0000 7f07ba000640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a0073200 0x7f07a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.221+0000 7f07ba000640 1 -- 172.21.15.44:0/3830126710 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f07bc0942f0 con 0x7f07c40c62d0 2024-09-17T05:38:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.221+0000 7f07c1e00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a0073200 0x7f07a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.221+0000 7f07c1e00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a0073200 0x7f07a0075710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07b40ae000 tx=0x7f07b401a030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:30.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.225+0000 7f07ba000640 1 -- 172.21.15.44:0/3830126710 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f07bc05ea70 con 0x7f07c40c62d0 2024-09-17T05:38:30.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.437+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07c40b5190 con 0x7f07c40c62d0 2024-09-17T05:38:30.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.437+0000 7f07ba000640 1 -- 172.21.15.44:0/3830126710 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7f07bc0634a0 con 0x7f07c40c62d0 2024-09-17T05:38:30.441 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:30.441 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:38:30.441 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a0073200 msgr2=0x7f07a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a0073200 0x7f07a0075710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07b40ae000 tx=0x7f07b401a030 comp rx=0 tx=0).stop 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c40c62d0 msgr2=0x7f07c40c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c40c62d0 0x7f07c40c66e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f07a8004790 tx=0x7f07bc001aa0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 shutdown_connections 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c40c62d0 0x7f07c40c66e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a0073200 0x7f07a0075710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c40b2e70 0x7f07c41f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 --2- 172.21.15.44:0/3830126710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07a80039f0 0x7f07c40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 >> 172.21.15.44:0/3830126710 conn(0x7f07c40ccaa0 msgr2=0x7f07c40cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 shutdown_connections 2024-09-17T05:38:30.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.441+0000 7f07c8a00640 1 -- 172.21.15.44:0/3830126710 wait complete. 2024-09-17T05:38:30.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T05:38:30.646 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:38:30.646 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:38:30.646 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-17T05:38:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 Processor -- start 2024-09-17T05:38:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 -- start start 2024-09-17T05:38:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902cdd2570 0x55902ce10740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902ce174a0 0x55902ce9b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce178b0 0x55902ce9b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55902cd7cf40 con 0x55902ce178b0 2024-09-17T05:38:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55902cd89d00 con 0x55902ce174a0 2024-09-17T05:38:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe2fa49080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55902cd1ea00 con 0x55902cdd2570 2024-09-17T05:38:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce178b0 0x55902ce9b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce178b0 0x55902ce9b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40240/0 (socket says 172.21.15.44:40240) 2024-09-17T05:38:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 -- 172.21.15.44:0/1747118310 learned_addr learned my addr 172.21.15.44:0/1747118310 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe27600640 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902ce174a0 0x55902ce9b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28000640 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902cdd2570 0x55902ce10740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 -- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902cdd2570 msgr2=0x55902ce10740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902cdd2570 0x55902ce10740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 -- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902ce174a0 msgr2=0x55902ce9b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902ce174a0 0x55902ce9b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 -- 172.21.15.44:0/1747118310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902ce9c210 con 0x55902ce178b0 2024-09-17T05:38:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe28a00640 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce178b0 0x55902ce9b9c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efe200015f0 tx=0x7efe20001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5943a43cea9a12cb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe26200640 1 -- 172.21.15.44:0/1747118310 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20016070 con 0x55902ce178b0 2024-09-17T05:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe26200640 1 -- 172.21.15.44:0/1747118310 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe2000f800 con 0x55902ce178b0 2024-09-17T05:38:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.705+0000 7efe26200640 1 -- 172.21.15.44:0/1747118310 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2000fc50 con 0x55902ce178b0 2024-09-17T05:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- 172.21.15.44:0/1747118310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce178b0 msgr2=0x55902ce9b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce178b0 0x55902ce9b9c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efe200015f0 tx=0x7efe20001ab0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- 172.21.15.44:0/1747118310 shutdown_connections 2024-09-17T05:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce178b0 0x55902ce9b9c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902ce174a0 0x55902ce9b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 --2- 172.21.15.44:0/1747118310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902cdd2570 0x55902ce10740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- 172.21.15.44:0/1747118310 >> 172.21.15.44:0/1747118310 conn(0x55902cdbcd20 msgr2=0x55902cdfed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- 172.21.15.44:0/1747118310 shutdown_connections 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- 172.21.15.44:0/1747118310 wait complete. 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 Processor -- start 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- start start 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902cdd2570 0x55902ce97de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce174a0 0x55902ce9e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902ce178b0 0x55902ce9ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55902ce9fc30 con 0x55902ce174a0 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55902ce9f990 con 0x55902cdd2570 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe2fa49080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55902ce9fed0 con 0x55902ce178b0 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe27600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce174a0 0x55902ce9e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe27600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce174a0 0x55902ce9e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40252/0 (socket says 172.21.15.44:40252) 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe27600640 1 -- 172.21.15.44:0/14517010 learned_addr learned my addr 172.21.15.44:0/14517010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe28000640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902cdd2570 0x55902ce97de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.709+0000 7efe28a00640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902ce178b0 0x55902ce9ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe27600640 1 -- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902ce178b0 msgr2=0x55902ce9ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe27600640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902ce178b0 0x55902ce9ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe27600640 1 -- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902cdd2570 msgr2=0x55902ce97de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe27600640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902cdd2570 0x55902ce97de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe27600640 1 -- 172.21.15.44:0/14517010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55902cdf2440 con 0x55902ce174a0 2024-09-17T05:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe28a00640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55902ce178b0 0x55902ce9ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe28000640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55902cdd2570 0x55902ce97de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe27600640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce174a0 0x55902ce9e550 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efe14096cc0 tx=0x7efe140aba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe24e00640 1 -- 172.21.15.44:0/14517010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140abce0 con 0x55902ce174a0 2024-09-17T05:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe24e00640 1 -- 172.21.15.44:0/14517010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe140b6450 con 0x55902ce174a0 2024-09-17T05:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe24e00640 1 -- 172.21.15.44:0/14517010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140b6620 con 0x55902ce174a0 2024-09-17T05:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55902cdf26e0 con 0x55902ce174a0 2024-09-17T05:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55902cdf1e90 con 0x55902ce174a0 2024-09-17T05:38:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe24e00640 1 -- 172.21.15.44:0/14517010 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe140bf020 con 0x55902ce174a0 2024-09-17T05:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe24e00640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe08071be0 0x7efe080740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.713+0000 7efe24e00640 1 -- 172.21.15.44:0/14517010 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7efe1412de80 con 0x55902ce174a0 2024-09-17T05:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe28000640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe08071be0 0x7efe080740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55902ce9b240 0x55902cf4bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53) -- 0x55902ce98320 con 0x55902ce9b240 2024-09-17T05:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe28a00640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55902ce9b240 0x55902cf4bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:30.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe28000640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe08071be0 0x7efe080740f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe18003430 tx=0x7efe18003050 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe28a00640 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55902ce9b240 0x55902cf4bb60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe28a00640 1 -- 172.21.15.44:0/14517010 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7efe20019040 con 0x55902ce9b240 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55902ce9b240 msgr2=0x55902cf4bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55902ce9b240 0x55902cf4bb60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe08071be0 msgr2=0x7efe080740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe08071be0 0x7efe080740f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe18003430 tx=0x7efe18003050 comp rx=0 tx=0).stop 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce174a0 msgr2=0x55902ce9e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:30.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 --2- 172.21.15.44:0/14517010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55902ce174a0 0x55902ce9e550 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efe14096cc0 tx=0x7efe140aba30 comp rx=0 tx=0).stop 2024-09-17T05:38:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe28a00640 1 -- 172.21.15.44:0/14517010 reap_dead start 2024-09-17T05:38:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 shutdown_connections 2024-09-17T05:38:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 >> 172.21.15.44:0/14517010 conn(0x55902cdbcd20 msgr2=0x55902ce16d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 shutdown_connections 2024-09-17T05:38:30.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:30.717+0000 7efe2fa49080 1 -- 172.21.15.44:0/14517010 wait complete. 2024-09-17T05:38:30.728 INFO:teuthology.orchestra.run.smithi044.stdout:Yalphaparent_a 2024-09-17T05:38:30.729 DEBUG:teuthology.orchestra.run.smithi044:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-17T05:38:30.781 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:38:30.781 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627777, 2024-09-17T05:38:30.781 INFO:teuthology.orchestra.run.smithi044.stdout: "ancestors": [ 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "dirino": 1099511627776, 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "dname": "alpha", 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 4 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "dirino": 1, 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "dname": "parent_a", 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 7 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 8, 2024-09-17T05:38:30.782 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [] 2024-09-17T05:38:30.783 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:38:30.783 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:30.789 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:38:30.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:38:30.927 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:38:31.023 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:38:31.023 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:38:31.023 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:38:31.023 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:31.032 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:38:31.032 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:31.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:38:31.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.285+0000 7fd601800640 1 -- 172.21.15.44:0/1140467805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e0005260 msgr2=0x7fd5e000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.285+0000 7fd601800640 1 --2- 172.21.15.44:0/1140467805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e0005260 0x7fd5e000b9d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400c630 tx=0x7fd5f401d2a0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.285+0000 7fd601800640 1 -- 172.21.15.44:0/1140467805 shutdown_connections 2024-09-17T05:38:31.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.285+0000 7fd601800640 1 --2- 172.21.15.44:0/1140467805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5e0005260 0x7fd5e000b9d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.285+0000 7fd601800640 1 -- 172.21.15.44:0/1140467805 >> 172.21.15.44:0/1140467805 conn(0x7fd5fc0ccaa0 msgr2=0x7fd5fc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:31.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.285+0000 7fd601800640 1 -- 172.21.15.44:0/1140467805 shutdown_connections 2024-09-17T05:38:31.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.285+0000 7fd601800640 1 -- 172.21.15.44:0/1140467805 wait complete. 2024-09-17T05:38:31.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 Processor -- start 2024-09-17T05:38:31.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 -- start start 2024-09-17T05:38:31.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5e0005260 0x7fd5fc0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5fc0b2e70 0x7fd5fc157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5fc15d3b0 0x7fd5fc1f6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc0cec50 con 0x7fd5fc15d3b0 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc0cb2a0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd601800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd5fc0cedd0 con 0x7fd5e0005260 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5fc15d3b0 0x7fd5fc1f6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd5f3e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5fc0b2e70 0x7fd5fc157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd5fb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5fc15d3b0 0x7fd5fc1f6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40260/0 (socket says 172.21.15.44:40260) 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd5fb400640 1 -- 172.21.15.44:0/2939108803 learned_addr learned my addr 172.21.15.44:0/2939108803 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.289+0000 7fd5faa00640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5e0005260 0x7fd5fc0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f3e00640 1 -- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5e0005260 msgr2=0x7fd5fc0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f3e00640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5e0005260 0x7fd5fc0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f3e00640 1 -- 172.21.15.44:0/2939108803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5fc15d3b0 msgr2=0x7fd5fc1f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f3e00640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5fc15d3b0 0x7fd5fc1f6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f3e00640 1 -- 172.21.15.44:0/2939108803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc15c330 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5fb400640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5fc15d3b0 0x7fd5fc1f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:38:31.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f3e00640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5fc0b2e70 0x7fd5fc157c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc070f20 tx=0x7fd5e4001640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:31.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f2a00640 1 -- 172.21.15.44:0/2939108803 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011430 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc15c5f0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f2a00640 1 -- 172.21.15.44:0/2939108803 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5e4016020 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f2a00640 1 -- 172.21.15.44:0/2939108803 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4011850 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc15cbb0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5fc0b5cf0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.293+0000 7fd5f2a00640 1 -- 172.21.15.44:0/2939108803 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd5e40119f0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.297+0000 7fd5f2a00640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd5d8073200 0x7fd5d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.297+0000 7fd5f2a00640 1 -- 172.21.15.44:0/2939108803 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fd5e40952e0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.297+0000 7fd5faa00640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd5d8073200 0x7fd5d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.297+0000 7fd5faa00640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd5d8073200 0x7fd5d8075710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009be0 tx=0x7fd5ec0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:31.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.301+0000 7fd5f2a00640 1 -- 172.21.15.44:0/2939108803 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd5e4020020 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.489+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd5fc0cd9f0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.489+0000 7fd5f2a00640 1 -- 172.21.15.44:0/2939108803 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) ==== 80+0+0 (secure 0 0 0) 0x7fd5fc0cd9f0 con 0x7fd5fc0b2e70 2024-09-17T05:38:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd5d8073200 msgr2=0x7fd5d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd5d8073200 0x7fd5d8075710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009be0 tx=0x7fd5ec0091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5fc0b2e70 msgr2=0x7fd5fc157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5fc0b2e70 0x7fd5fc157c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc070f20 tx=0x7fd5e4001640 comp rx=0 tx=0).stop 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 shutdown_connections 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd5fc15d3b0 0x7fd5fc1f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd5d8073200 0x7fd5d8075710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5fc0b2e70 0x7fd5fc157c80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 --2- 172.21.15.44:0/2939108803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd5e0005260 0x7fd5fc0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 >> 172.21.15.44:0/2939108803 conn(0x7fd5fc0ccaa0 msgr2=0x7fd5fc15a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:31.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 shutdown_connections 2024-09-17T05:38:31.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.493+0000 7fd601800640 1 -- 172.21.15.44:0/2939108803 wait complete. 2024-09-17T05:38:31.513 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:38:31.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:31.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:38:31.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:38:31.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:31.565 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:38:31.617 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:38:31.617 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:38:31.617 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:31.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:38:31.626 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:38:31.626 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:38:31.626 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:31.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:38:31.668 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:38:31.668 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:38:31.668 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:31.676 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:38:31.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:31.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.873+0000 7fc7e9a00640 1 -- 172.21.15.44:0/2171134044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c8003c40 msgr2=0x7fc7c8004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.873+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/2171134044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c8003c40 0x7fc7c8004090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4001860 tx=0x7fc7d401c880 comp rx=0 tx=0).stop 2024-09-17T05:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.873+0000 7fc7e9a00640 1 -- 172.21.15.44:0/2171134044 shutdown_connections 2024-09-17T05:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.873+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/2171134044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c8003c40 0x7fc7c8004090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.873+0000 7fc7e9a00640 1 -- 172.21.15.44:0/2171134044 >> 172.21.15.44:0/2171134044 conn(0x7fc7e40cd930 msgr2=0x7fc7e40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.873+0000 7fc7e9a00640 1 -- 172.21.15.44:0/2171134044 shutdown_connections 2024-09-17T05:38:31.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.873+0000 7fc7e9a00640 1 -- 172.21.15.44:0/2171134044 wait complete. 2024-09-17T05:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 Processor -- start 2024-09-17T05:38:31.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 -- start start 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c8003c40 0x7fc7e41f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e4158740 0x7fc7e40c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40ca120 0x7fc7e40ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40cbe20 con 0x7fc7c8003c40 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40cbca0 con 0x7fc7e40ca120 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e9a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40cbfa0 con 0x7fc7e4158740 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c8003c40 0x7fc7e41f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c8003c40 0x7fc7e41f96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40288/0 (socket says 172.21.15.44:40288) 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 -- 172.21.15.44:0/717291340 learned_addr learned my addr 172.21.15.44:0/717291340 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e3400640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40ca120 0x7fc7e40ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7dbe00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e4158740 0x7fc7e40c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 -- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e4158740 msgr2=0x7fc7e40c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e4158740 0x7fc7e40c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 -- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40ca120 msgr2=0x7fc7e40ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40ca120 0x7fc7e40ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:31.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.877+0000 7fc7e2a00640 1 -- 172.21.15.44:0/717291340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e41f9c20 con 0x7fc7c8003c40 2024-09-17T05:38:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7e2a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c8003c40 0x7fc7e41f96e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4005040 tx=0x7fc7d40a5d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7daa00640 1 -- 172.21.15.44:0/717291340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4001480 con 0x7fc7c8003c40 2024-09-17T05:38:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7daa00640 1 -- 172.21.15.44:0/717291340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7d40b4030 con 0x7fc7c8003c40 2024-09-17T05:38:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e40ca530 con 0x7fc7c8003c40 2024-09-17T05:38:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7daa00640 1 -- 172.21.15.44:0/717291340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40068d0 con 0x7fc7c8003c40 2024-09-17T05:38:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41f6010 con 0x7fc7c8003c40 2024-09-17T05:38:31.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e406d1c0 con 0x7fc7c8003c40 2024-09-17T05:38:31.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7daa00640 1 -- 172.21.15.44:0/717291340 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc7dc00cd10 con 0x7fc7c8003c40 2024-09-17T05:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7daa00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7c0073200 0x7fc7c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.881+0000 7fc7daa00640 1 -- 172.21.15.44:0/717291340 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fc7d412e690 con 0x7fc7c8003c40 2024-09-17T05:38:31.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.885+0000 7fc7dbe00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7c0073200 0x7fc7c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:31.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.885+0000 7fc7dbe00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7c0073200 0x7fc7c0075710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40d0610 tx=0x7fc7cc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:31.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:31.889+0000 7fc7daa00640 1 -- 172.21.15.44:0/717291340 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc7e40ca530 con 0x7fc7c8003c40 2024-09-17T05:38:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.097+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7e40cac70 con 0x7fc7c8003c40 2024-09-17T05:38:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7daa00640 1 -- 172.21.15.44:0/717291340 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7fc7e41f9c20 con 0x7fc7c8003c40 2024-09-17T05:38:32.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:32.101 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:38:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7c0073200 msgr2=0x7fc7c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7c0073200 0x7fc7c0075710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40d0610 tx=0x7fc7cc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c8003c40 msgr2=0x7fc7e41f96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c8003c40 0x7fc7e41f96e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4005040 tx=0x7fc7d40a5d80 comp rx=0 tx=0).stop 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 shutdown_connections 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7c0073200 0x7fc7c0075710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7e40ca120 0x7fc7e40ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7e4158740 0x7fc7e40c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 --2- 172.21.15.44:0/717291340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c8003c40 0x7fc7e41f96e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 >> 172.21.15.44:0/717291340 conn(0x7fc7e40cd930 msgr2=0x7fc7e415b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 shutdown_connections 2024-09-17T05:38:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.101+0000 7fc7e9a00640 1 -- 172.21.15.44:0/717291340 wait complete. 2024-09-17T05:38:32.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:32.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 -- 172.21.15.44:0/2156620186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 msgr2=0x7f4a8406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2156620186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 0x7f4a8406e260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009870 tx=0x7f4a6c01c6f0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 -- 172.21.15.44:0/2156620186 shutdown_connections 2024-09-17T05:38:32.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2156620186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 0x7f4a8406e260 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 -- 172.21.15.44:0/2156620186 >> 172.21.15.44:0/2156620186 conn(0x7f4a840ccaa0 msgr2=0x7f4a840cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:32.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 -- 172.21.15.44:0/2156620186 shutdown_connections 2024-09-17T05:38:32.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 -- 172.21.15.44:0/2156620186 wait complete. 2024-09-17T05:38:32.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 Processor -- start 2024-09-17T05:38:32.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.281+0000 7f4a88e00640 1 -- start start 2024-09-17T05:38:32.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 0x7f4a84166c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a84072e50 0x7f4a841588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a840cb470 0x7f4a84158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8416a020 con 0x7f4a840cb470 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84169ea0 con 0x7f4a84072e50 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8416a1a0 con 0x7f4a8406de50 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a840cb470 0x7f4a84158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a840cb470 0x7f4a84158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40298/0 (socket says 172.21.15.44:40298) 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 -- 172.21.15.44:0/2637166882 learned_addr learned my addr 172.21.15.44:0/2637166882 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a7be00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a84072e50 0x7f4a841588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a81e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 0x7f4a84166c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 -- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 msgr2=0x7f4a84166c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 0x7f4a84166c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 -- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a84072e50 msgr2=0x7f4a841588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a84072e50 0x7f4a841588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 -- 172.21.15.44:0/2637166882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a84153c60 con 0x7f4a840cb470 2024-09-17T05:38:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a82800640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a840cb470 0x7f4a84158e00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c002150 tx=0x7f4a7c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a7a000640 1 -- 172.21.15.44:0/2637166882 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c016020 con 0x7f4a840cb470 2024-09-17T05:38:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a7a000640 1 -- 172.21.15.44:0/2637166882 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a7c00ad80 con 0x7f4a840cb470 2024-09-17T05:38:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a84152ef0 con 0x7f4a840cb470 2024-09-17T05:38:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a7a000640 1 -- 172.21.15.44:0/2637166882 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c012680 con 0x7f4a840cb470 2024-09-17T05:38:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8406f4c0 con 0x7f4a840cb470 2024-09-17T05:38:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.285+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8406e260 con 0x7f4a840cb470 2024-09-17T05:38:32.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.289+0000 7f4a7a000640 1 -- 172.21.15.44:0/2637166882 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4a7c019020 con 0x7f4a840cb470 2024-09-17T05:38:32.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.289+0000 7f4a7a000640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4a60073230 0x7f4a60075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.289+0000 7f4a7a000640 1 -- 172.21.15.44:0/2637166882 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f4a7c094660 con 0x7f4a840cb470 2024-09-17T05:38:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.289+0000 7f4a81e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4a60073230 0x7f4a60075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.289+0000 7f4a81e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4a60073230 0x7f4a60075740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a74007fd0 tx=0x7f4a74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:32.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.293+0000 7f4a7a000640 1 -- 172.21.15.44:0/2637166882 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4a7c020030 con 0x7f4a840cb470 2024-09-17T05:38:32.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.501+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a840b5fa0 con 0x7f4a840cb470 2024-09-17T05:38:32.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.501+0000 7f4a7a000640 1 -- 172.21.15.44:0/2637166882 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7f4a8406e7a0 con 0x7f4a840cb470 2024-09-17T05:38:32.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:32.505 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:38:32.505 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4a60073230 msgr2=0x7f4a60075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4a60073230 0x7f4a60075740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a74007fd0 tx=0x7f4a74009040 comp rx=0 tx=0).stop 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a840cb470 msgr2=0x7f4a84158e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a840cb470 0x7f4a84158e00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c002150 tx=0x7f4a7c00a060 comp rx=0 tx=0).stop 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 shutdown_connections 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4a840cb470 0x7f4a84158e00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4a60073230 0x7f4a60075740 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a84072e50 0x7f4a841588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 --2- 172.21.15.44:0/2637166882 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4a8406de50 0x7f4a84166c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 >> 172.21.15.44:0/2637166882 conn(0x7f4a840ccaa0 msgr2=0x7f4a840afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:32.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 shutdown_connections 2024-09-17T05:38:32.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.505+0000 7f4a88e00640 1 -- 172.21.15.44:0/2637166882 wait complete. 2024-09-17T05:38:32.527 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:38:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 -- 172.21.15.44:0/3276221739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff274072e50 msgr2=0x7ff27415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 --2- 172.21.15.44:0/3276221739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff274072e50 0x7ff27415e990 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff268009900 tx=0x7ff26801c850 comp rx=0 tx=0).stop 2024-09-17T05:38:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 -- 172.21.15.44:0/3276221739 shutdown_connections 2024-09-17T05:38:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 --2- 172.21.15.44:0/3276221739 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2740cb470 0x7ff2740cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 --2- 172.21.15.44:0/3276221739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff274072e50 0x7ff27415e990 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 -- 172.21.15.44:0/3276221739 >> 172.21.15.44:0/3276221739 conn(0x7ff2740ccaa0 msgr2=0x7ff2740cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:32.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 -- 172.21.15.44:0/3276221739 shutdown_connections 2024-09-17T05:38:32.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 -- 172.21.15.44:0/3276221739 wait complete. 2024-09-17T05:38:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 Processor -- start 2024-09-17T05:38:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.685+0000 7ff27c200640 1 -- start start 2024-09-17T05:38:32.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff27406de50 0x7ff274070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff274072e50 0x7ff2741fc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2740cb470 0x7ff2741fc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff274168ed0 con 0x7ff2740cb470 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff274168d50 con 0x7ff274072e50 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff274169050 con 0x7ff27406de50 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2740cb470 0x7ff2741fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2740cb470 0x7ff2741fc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40318/0 (socket says 172.21.15.44:40318) 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 -- 172.21.15.44:0/3823113476 learned_addr learned my addr 172.21.15.44:0/3823113476 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff279800640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff27406de50 0x7ff274070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff278e00640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff274072e50 0x7ff2741fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 -- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff27406de50 msgr2=0x7ff274070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff27406de50 0x7ff274070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 -- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff274072e50 msgr2=0x7ff2741fc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff274072e50 0x7ff2741fc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 -- 172.21.15.44:0/3823113476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff274164650 con 0x7ff2740cb470 2024-09-17T05:38:32.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27a200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2740cb470 0x7ff2741fc740 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00d9a0 tx=0x7ff26c00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:32.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff271600640 1 -- 172.21.15.44:0/3823113476 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c017070 con 0x7ff2740cb470 2024-09-17T05:38:32.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff271600640 1 -- 172.21.15.44:0/3823113476 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff26c00be00 con 0x7ff2740cb470 2024-09-17T05:38:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff271600640 1 -- 172.21.15.44:0/3823113476 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0106c0 con 0x7ff2740cb470 2024-09-17T05:38:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2741fcfa0 con 0x7ff2740cb470 2024-09-17T05:38:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff274164bf0 con 0x7ff2740cb470 2024-09-17T05:38:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.689+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2741fcd10 con 0x7ff2740cb470 2024-09-17T05:38:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.693+0000 7ff271600640 1 -- 172.21.15.44:0/3823113476 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff26c010860 con 0x7ff2740cb470 2024-09-17T05:38:32.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.693+0000 7ff271600640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff254073200 0x7ff254075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:32.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.693+0000 7ff271600640 1 -- 172.21.15.44:0/3823113476 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7ff26c094a30 con 0x7ff2740cb470 2024-09-17T05:38:32.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.693+0000 7ff279800640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff254073200 0x7ff254075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.693+0000 7ff279800640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff254073200 0x7ff254075710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2680af000 tx=0x7ff26801b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:32.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.697+0000 7ff271600640 1 -- 172.21.15.44:0/3823113476 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff26c05f1b0 con 0x7ff2740cb470 2024-09-17T05:38:32.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.873+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff27415e990 con 0x7ff2740cb470 2024-09-17T05:38:32.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.873+0000 7ff271600640 1 -- 172.21.15.44:0/3823113476 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16943 (secure 0 0 0) 0x7ff26c094020 con 0x7ff2740cb470 2024-09-17T05:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:32.875 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":53,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:58.353320+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:43.204010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:44.420003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.31","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff254073200 msgr2=0x7ff254075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff254073200 0x7ff254075710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2680af000 tx=0x7ff26801b090 comp rx=0 tx=0).stop 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2740cb470 msgr2=0x7ff2741fc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2740cb470 0x7ff2741fc740 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00d9a0 tx=0x7ff26c00de60 comp rx=0 tx=0).stop 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 shutdown_connections 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2740cb470 0x7ff2741fc740 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff254073200 0x7ff254075710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff274072e50 0x7ff2741fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 --2- 172.21.15.44:0/3823113476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff27406de50 0x7ff274070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 >> 172.21.15.44:0/3823113476 conn(0x7ff2740ccaa0 msgr2=0x7ff2740b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 shutdown_connections 2024-09-17T05:38:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:32.877+0000 7ff27c200640 1 -- 172.21.15.44:0/3823113476 wait complete. 2024-09-17T05:38:32.897 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:38:32.898 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 -- 172.21.15.44:0/306905852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731006e560 msgr2=0x7f73100700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 --2- 172.21.15.44:0/306905852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731006e560 0x7f73100700d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009840 tx=0x7f72fc01c820 comp rx=0 tx=0).stop 2024-09-17T05:38:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 -- 172.21.15.44:0/306905852 shutdown_connections 2024-09-17T05:38:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 --2- 172.21.15.44:0/306905852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f731006e560 0x7f73100700d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 -- 172.21.15.44:0/306905852 >> 172.21.15.44:0/306905852 conn(0x7f73100ccaa0 msgr2=0x7f73100cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:33.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 -- 172.21.15.44:0/306905852 shutdown_connections 2024-09-17T05:38:33.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 -- 172.21.15.44:0/306905852 wait complete. 2024-09-17T05:38:33.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 Processor -- start 2024-09-17T05:38:33.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.057+0000 7f7316c00640 1 -- start start 2024-09-17T05:38:33.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7310070610 0x7f7310153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73100b5880 0x7f731009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f731009f510 0x7f731009e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f731016ace0 con 0x7f7310070610 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f731016ab60 con 0x7f73100b5880 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f731016ae60 con 0x7f731009f510 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7310070610 0x7f7310153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7310070610 0x7f7310153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40338/0 (socket says 172.21.15.44:40338) 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 -- 172.21.15.44:0/3592290340 learned_addr learned my addr 172.21.15.44:0/3592290340 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730f400640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73100b5880 0x7f731009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7314c00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f731009f510 0x7f731009e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 -- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f731009f510 msgr2=0x7f731009e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f731009f510 0x7f731009e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 -- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73100b5880 msgr2=0x7f731009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73100b5880 0x7f731009e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 -- 172.21.15.44:0/3592290340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7310157ee0 con 0x7f7310070610 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f730fe00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7310070610 0x7f7310153080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f730000c3c0 tx=0x7f730000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7307e00640 1 -- 172.21.15.44:0/3592290340 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300017070 con 0x7f7310070610 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7307e00640 1 -- 172.21.15.44:0/3592290340 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7300003600 con 0x7f7310070610 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7310158150 con 0x7f7310070610 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7307e00640 1 -- 172.21.15.44:0/3592290340 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300003a50 con 0x7f7310070610 2024-09-17T05:38:33.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7310158c30 con 0x7f7310070610 2024-09-17T05:38:33.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.061+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73100700d0 con 0x7f7310070610 2024-09-17T05:38:33.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.065+0000 7f7307e00640 1 -- 172.21.15.44:0/3592290340 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f730001a070 con 0x7f7310070610 2024-09-17T05:38:33.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.065+0000 7f7307e00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72f0073200 0x7f72f0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.065+0000 7f7307e00640 1 -- 172.21.15.44:0/3592290340 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7f7300093620 con 0x7f7310070610 2024-09-17T05:38:33.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.065+0000 7f730f400640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72f0073200 0x7f72f0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.065+0000 7f730f400640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72f0073200 0x7f72f0075710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0af000 tx=0x7f72fc01b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:33.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.069+0000 7f7307e00640 1 -- 172.21.15.44:0/3592290340 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f730005de30 con 0x7f7310070610 2024-09-17T05:38:33.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7310158810 con 0x7f7310070610 2024-09-17T05:38:33.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7307e00640 1 -- 172.21.15.44:0/3592290340 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7f7300062860 con 0x7f7310070610 2024-09-17T05:38:33.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:33.281 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:38:33.282 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72f0073200 msgr2=0x7f72f0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72f0073200 0x7f72f0075710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0af000 tx=0x7f72fc01b060 comp rx=0 tx=0).stop 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7310070610 msgr2=0x7f7310153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7310070610 0x7f7310153080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f730000c3c0 tx=0x7f730000c880 comp rx=0 tx=0).stop 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 shutdown_connections 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f731009f510 0x7f731009e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72f0073200 0x7f72f0075710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73100b5880 0x7f731009e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 --2- 172.21.15.44:0/3592290340 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7310070610 0x7f7310153080 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 >> 172.21.15.44:0/3592290340 conn(0x7f73100ccaa0 msgr2=0x7f73100af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:33.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 shutdown_connections 2024-09-17T05:38:33.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.281+0000 7f7316c00640 1 -- 172.21.15.44:0/3592290340 wait complete. 2024-09-17T05:38:33.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:33.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 -- 172.21.15.44:0/1642874969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d406de50 msgr2=0x7fa1d406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/1642874969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d406de50 0x7fa1d406e260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009840 tx=0x7fa1c001c790 comp rx=0 tx=0).stop 2024-09-17T05:38:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 -- 172.21.15.44:0/1642874969 shutdown_connections 2024-09-17T05:38:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/1642874969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d406de50 0x7fa1d406e260 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/1642874969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1d4072e50 0x7fa1d415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 -- 172.21.15.44:0/1642874969 >> 172.21.15.44:0/1642874969 conn(0x7fa1d40ccaa0 msgr2=0x7fa1d40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 -- 172.21.15.44:0/1642874969 shutdown_connections 2024-09-17T05:38:33.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.465+0000 7fa1dbe00640 1 -- 172.21.15.44:0/1642874969 wait complete. 2024-09-17T05:38:33.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 Processor -- start 2024-09-17T05:38:33.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 -- start start 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1d406de50 0x7fa1d4155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d4072e50 0x7fa1d409e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1d40ced00 0x7fa1d409ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d41694b0 con 0x7fa1d406de50 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4169330 con 0x7fa1d4072e50 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d4169630 con 0x7fa1d40ced00 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1d406de50 0x7fa1d4155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1d406de50 0x7fa1d4155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40342/0 (socket says 172.21.15.44:40342) 2024-09-17T05:38:33.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 -- 172.21.15.44:0/4221398122 learned_addr learned my addr 172.21.15.44:0/4221398122 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d8a00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d4072e50 0x7fa1d409e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9e00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1d40ced00 0x7fa1d409ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 -- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1d40ced00 msgr2=0x7fa1d409ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1d40ced00 0x7fa1d409ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 -- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d4072e50 msgr2=0x7fa1d409e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d4072e50 0x7fa1d409e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 -- 172.21.15.44:0/4221398122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d40afd60 con 0x7fa1d406de50 2024-09-17T05:38:33.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d9400640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1d406de50 0x7fa1d4155d50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800ea20 tx=0x7fa1c800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d1600640 1 -- 172.21.15.44:0/4221398122 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800cd80 con 0x7fa1d406de50 2024-09-17T05:38:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d1600640 1 -- 172.21.15.44:0/4221398122 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1c8004020 con 0x7fa1d406de50 2024-09-17T05:38:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d40a0c40 con 0x7fa1d406de50 2024-09-17T05:38:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1d1600640 1 -- 172.21.15.44:0/4221398122 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8004450 con 0x7fa1d406de50 2024-09-17T05:38:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.469+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d40a1200 con 0x7fa1d406de50 2024-09-17T05:38:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.473+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d406e260 con 0x7fa1d406de50 2024-09-17T05:38:33.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.473+0000 7fa1d1600640 1 -- 172.21.15.44:0/4221398122 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa1c8003600 con 0x7fa1d406de50 2024-09-17T05:38:33.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.473+0000 7fa1d1600640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1b4073200 0x7fa1b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.473+0000 7fa1d1600640 1 -- 172.21.15.44:0/4221398122 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fa1c8094d00 con 0x7fa1d406de50 2024-09-17T05:38:33.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.473+0000 7fa1d8a00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1b4073200 0x7fa1b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.473+0000 7fa1d8a00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1b4073200 0x7fa1b4075710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00af000 tx=0x7fa1c001afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:33.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.477+0000 7fa1d1600640 1 -- 172.21.15.44:0/4221398122 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa1c805fb60 con 0x7fa1d406de50 2024-09-17T05:38:33.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.685+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1d40aff30 con 0x7fa1d406de50 2024-09-17T05:38:33.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.685+0000 7fa1d1600640 1 -- 172.21.15.44:0/4221398122 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5214 (secure 0 0 0) 0x7fa1c805f460 con 0x7fa1d406de50 2024-09-17T05:38:33.688 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:33.688 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":26,"btime":"2024-09-17T05:37:49:070649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:37:45.459363+0000","modified":"2024-09-17T05:37:48.480774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5343":{"gid":5343,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/767726494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":767726494},{"type":"v1","addr":"172.21.15.44:6835","nonce":767726494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5343,"qdb_cluster":[5343]},"id":3}]} 2024-09-17T05:38:33.689 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 26 2024-09-17T05:38:33.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1b4073200 msgr2=0x7fa1b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1b4073200 0x7fa1b4075710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00af000 tx=0x7fa1c001afd0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1d406de50 msgr2=0x7fa1d4155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1d406de50 0x7fa1d4155d50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800ea20 tx=0x7fa1c800ee20 comp rx=0 tx=0).stop 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 shutdown_connections 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa1d40ced00 0x7fa1d409ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1b4073200 0x7fa1b4075710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1d4072e50 0x7fa1d409e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 --2- 172.21.15.44:0/4221398122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1d406de50 0x7fa1d4155d50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 >> 172.21.15.44:0/4221398122 conn(0x7fa1d40ccaa0 msgr2=0x7fa1d406ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 shutdown_connections 2024-09-17T05:38:33.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.689+0000 7fa1dbe00640 1 -- 172.21.15.44:0/4221398122 wait complete. 2024-09-17T05:38:33.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:38:33.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.869+0000 7fd50ca00640 1 -- 172.21.15.44:0/118041986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4ec004810 msgr2=0x7fd4ec004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.869+0000 7fd50ca00640 1 --2- 172.21.15.44:0/118041986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4ec004810 0x7fd4ec004c20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009b60 tx=0x7fd4f001d2b0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.869+0000 7fd506800640 1 -- 172.21.15.44:0/118041986 reap_dead start 2024-09-17T05:38:33.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.869+0000 7fd50ca00640 1 -- 172.21.15.44:0/118041986 shutdown_connections 2024-09-17T05:38:33.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.869+0000 7fd50ca00640 1 -- 172.21.15.44:0/118041986 >> 172.21.15.44:0/118041986 conn(0x7fd5080ccaa0 msgr2=0x7fd5080cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:33.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.869+0000 7fd50ca00640 1 -- 172.21.15.44:0/118041986 shutdown_connections 2024-09-17T05:38:33.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.869+0000 7fd50ca00640 1 -- 172.21.15.44:0/118041986 wait complete. 2024-09-17T05:38:33.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 Processor -- start 2024-09-17T05:38:33.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 -- start start 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ec004810 0x7fd5080a9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd508153660 0x7fd5081fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5081fa670 0x7fd5080c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd5080cec50 con 0x7fd508153660 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd50815f790 con 0x7fd5081fa670 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd50ca00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd5080cedd0 con 0x7fd4ec004810 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd508153660 0x7fd5081fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd508153660 0x7fd5081fa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40362/0 (socket says 172.21.15.44:40362) 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 -- 172.21.15.44:0/2808948091 learned_addr learned my addr 172.21.15.44:0/2808948091 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd506800640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5081fa670 0x7fd5080c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd505e00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ec004810 0x7fd5080a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 -- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ec004810 msgr2=0x7fd5080a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ec004810 0x7fd5080a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 -- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5081fa670 msgr2=0x7fd5080c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5081fa670 0x7fd5080c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 -- 172.21.15.44:0/2808948091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5080c8000 con 0x7fd508153660 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd505e00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ec004810 0x7fd5080a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.873+0000 7fd4fd400640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd508153660 0x7fd5081fa130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd4f001d0e0 tx=0x7fd4f00055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.877+0000 7fd4fea00640 1 -- 172.21.15.44:0/2808948091 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00bd070 con 0x7fd508153660 2024-09-17T05:38:33.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.877+0000 7fd4fea00640 1 -- 172.21.15.44:0/2808948091 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4f00b3040 con 0x7fd508153660 2024-09-17T05:38:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.877+0000 7fd4fea00640 1 -- 172.21.15.44:0/2808948091 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00b2070 con 0x7fd508153660 2024-09-17T05:38:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.877+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5080c82e0 con 0x7fd508153660 2024-09-17T05:38:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.877+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5080c88a0 con 0x7fd508153660 2024-09-17T05:38:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.877+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50815bf40 con 0x7fd508153660 2024-09-17T05:38:33.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.877+0000 7fd4fea00640 1 -- 172.21.15.44:0/2808948091 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd4f00046d0 con 0x7fd508153660 2024-09-17T05:38:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.881+0000 7fd4fea00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd4e4073200 0x7fd4e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.881+0000 7fd4fea00640 1 -- 172.21.15.44:0/2808948091 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7fd4f012eb70 con 0x7fd508153660 2024-09-17T05:38:33.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.881+0000 7fd505e00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd4e4073200 0x7fd4e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:33.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.881+0000 7fd505e00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd4e4073200 0x7fd4e4075710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009ac0 tx=0x7fd4f80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:33.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:33.885+0000 7fd4fea00640 1 -- 172.21.15.44:0/2808948091 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd4f00c6080 con 0x7fd508153660 2024-09-17T05:38:34.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.061+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5081faac0 con 0x7fd508153660 2024-09-17T05:38:34.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.061+0000 7fd4fea00640 1 -- 172.21.15.44:0/2808948091 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+16943 (secure 0 0 0) 0x7fd4f0016fc0 con 0x7fd508153660 2024-09-17T05:38:34.064 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:34.064 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":53,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:37:58.353320+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:37:43.204010+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-17T05:37:44.420003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.31","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd4e4073200 msgr2=0x7fd4e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd4e4073200 0x7fd4e4075710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009ac0 tx=0x7fd4f80091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd508153660 msgr2=0x7fd5081fa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd508153660 0x7fd5081fa130 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd4f001d0e0 tx=0x7fd4f00055d0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 shutdown_connections 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd4e4073200 0x7fd4e4075710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5081fa670 0x7fd5080c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd508153660 0x7fd5081fa130 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 --2- 172.21.15.44:0/2808948091 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd4ec004810 0x7fd5080a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 >> 172.21.15.44:0/2808948091 conn(0x7fd5080ccaa0 msgr2=0x7fd5080cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:34.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 shutdown_connections 2024-09-17T05:38:34.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.065+0000 7fd50ca00640 1 -- 172.21.15.44:0/2808948091 wait complete. 2024-09-17T05:38:34.089 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 -- 172.21.15.44:0/2533132498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2880039f0 msgr2=0x7ff288003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 --2- 172.21.15.44:0/2533132498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2880039f0 0x7ff288003e20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff294009b60 tx=0x7ff29401d290 comp rx=0 tx=0).stop 2024-09-17T05:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a2800640 1 -- 172.21.15.44:0/2533132498 reap_dead start 2024-09-17T05:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 -- 172.21.15.44:0/2533132498 shutdown_connections 2024-09-17T05:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 -- 172.21.15.44:0/2533132498 >> 172.21.15.44:0/2533132498 conn(0x7ff2a40d17b0 msgr2=0x7ff2a40d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 -- 172.21.15.44:0/2533132498 shutdown_connections 2024-09-17T05:38:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 -- 172.21.15.44:0/2533132498 wait complete. 2024-09-17T05:38:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 Processor -- start 2024-09-17T05:38:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.249+0000 7ff2a3200640 1 -- start start 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2880039f0 0x7ff2a40cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a414a850 0x7ff2a414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a41f8630 0x7ff2a41f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a406e300 con 0x7ff2a414a850 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a40d3ae0 con 0x7ff2a41f8630 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a406e480 con 0x7ff2880039f0 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a414a850 0x7ff2a414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a414a850 0x7ff2a414ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40376/0 (socket says 172.21.15.44:40376) 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 -- 172.21.15.44:0/2152510522 learned_addr learned my addr 172.21.15.44:0/2152510522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a2800640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a41f8630 0x7ff2a41f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a1e00640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2880039f0 0x7ff2a40cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 -- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2880039f0 msgr2=0x7ff2a40cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2880039f0 0x7ff2a40cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 -- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a41f8630 msgr2=0x7ff2a41f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a41f8630 0x7ff2a41f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 -- 172.21.15.44:0/2152510522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a40b56b0 con 0x7ff2a414a850 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29be00640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a414a850 0x7ff2a414ac60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff28c004530 tx=0x7ff28c00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29a000640 1 -- 172.21.15.44:0/2152510522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c017070 con 0x7ff2a414a850 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29a000640 1 -- 172.21.15.44:0/2152510522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff28c013970 con 0x7ff2a414a850 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a414d7f0 con 0x7ff2a414a850 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff29a000640 1 -- 172.21.15.44:0/2152510522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c013dc0 con 0x7ff2a414a850 2024-09-17T05:38:34.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a40b5950 con 0x7ff2a414a850 2024-09-17T05:38:34.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.253+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a40aae90 con 0x7ff2a414a850 2024-09-17T05:38:34.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.257+0000 7ff29a000640 1 -- 172.21.15.44:0/2152510522 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff28c0123e0 con 0x7ff2a414a850 2024-09-17T05:38:34.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.257+0000 7ff29a000640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff280073200 0x7ff280075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.257+0000 7ff29a000640 1 -- 172.21.15.44:0/2152510522 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6130+0+0 (secure 0 0 0) 0x7ff28c098dd0 con 0x7ff2a414a850 2024-09-17T05:38:34.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.257+0000 7ff2a1e00640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff280073200 0x7ff280075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.257+0000 7ff2a1e00640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff280073200 0x7ff280075710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2940ae000 tx=0x7ff29401a030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:34.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.261+0000 7ff29a000640 1 -- 172.21.15.44:0/2152510522 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff28c063c30 con 0x7ff2a414a850 2024-09-17T05:38:34.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.469+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff2a40b7700 con 0x7ff2a414a850 2024-09-17T05:38:34.470 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:38:34.469+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:38:34.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.469+0000 7ff29a000640 1 -- 172.21.15.44:0/2152510522 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7ff28c063530 con 0x7ff2a414a850 2024-09-17T05:38:34.473 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:38:34.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff280073200 msgr2=0x7ff280075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff280073200 0x7ff280075710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2940ae000 tx=0x7ff29401a030 comp rx=0 tx=0).stop 2024-09-17T05:38:34.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a414a850 msgr2=0x7ff2a414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a414a850 0x7ff2a414ac60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff28c004530 tx=0x7ff28c00f6c0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 shutdown_connections 2024-09-17T05:38:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff280073200 0x7ff280075710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a41f8630 0x7ff2a41f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2a414a850 0x7ff2a414ac60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 --2- 172.21.15.44:0/2152510522 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff2880039f0 0x7ff2a40cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 >> 172.21.15.44:0/2152510522 conn(0x7ff2a40d17b0 msgr2=0x7ff2a415f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:34.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 shutdown_connections 2024-09-17T05:38:34.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.473+0000 7ff2a3200640 1 -- 172.21.15.44:0/2152510522 wait complete. 2024-09-17T05:38:34.487 INFO:tasks.ceph.mds.a.smithi044.stderr: -7232> 2024-09-17T05:37:48.010+0000 7f6321600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:38:34.491 INFO:tasks.ceph.mds.a.smithi044.stderr: -3824> 2024-09-17T05:37:59.453+0000 7f631c600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 pv4 ap=4 DIRTYPARENT s=0 n(v0 1=1+0)->n(v0 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5511=0-4194304@1} caps={5511=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5511 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x55ce51100c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:38:34.496 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:38:34.609 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:38:34.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 -- 172.21.15.44:0/353713224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0cf5b0 msgr2=0x7fb7cc15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 --2- 172.21.15.44:0/353713224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0cf5b0 0x7fb7cc15d060 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0d3350 tx=0x7fb7c401ccc0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 -- 172.21.15.44:0/353713224 shutdown_connections 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 --2- 172.21.15.44:0/353713224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0cf5b0 0x7fb7cc15d060 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 --2- 172.21.15.44:0/353713224 >> v2:172.21.15.86:3300/0 conn(0x7fb7cc0d1d00 0x7fb7cc0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 --2- 172.21.15.44:0/353713224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7cc0d18f0 0x7fb7cc0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 -- 172.21.15.44:0/353713224 >> 172.21.15.44:0/353713224 conn(0x7fb7cc0b4240 msgr2=0x7fb7cc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 -- 172.21.15.44:0/353713224 shutdown_connections 2024-09-17T05:38:34.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.657+0000 7fb7d3200640 1 -- 172.21.15.44:0/353713224 wait complete. 2024-09-17T05:38:34.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 Processor -- start 2024-09-17T05:38:34.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 -- start start 2024-09-17T05:38:34.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7cc0cf5b0 0x7fb7cc0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0d18f0 0x7fb7cc1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7cc0d1d00 0x7fb7cc152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0d0d70 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0d0bf0 con 0x7fb7cc0cf5b0 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc0d0ef0 con 0x7fb7cc0d1d00 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0d18f0 0x7fb7cc1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0d18f0 0x7fb7cc1524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40416/0 (socket says 172.21.15.44:40416) 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 -- 172.21.15.44:0/2161849139 learned_addr learned my addr 172.21.15.44:0/2161849139 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d1200640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7cc0d1d00 0x7fb7cc152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cbe00640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7cc0cf5b0 0x7fb7cc0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 -- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7cc0d1d00 msgr2=0x7fb7cc152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7cc0d1d00 0x7fb7cc152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 -- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7cc0cf5b0 msgr2=0x7fb7cc0cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:34.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7cc0cf5b0 0x7fb7cc0cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:34.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 -- 172.21.15.44:0/2161849139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc0b52e0 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7cb400640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0d18f0 0x7fb7cc1524d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8005bd0 tx=0x7fb7b800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7c3e00640 1 -- 172.21.15.44:0/2161849139 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8004230 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7c3e00640 1 -- 172.21.15.44:0/2161849139 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb7b80044c0 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc0b55c0 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.661+0000 7fb7c3e00640 1 -- 172.21.15.44:0/2161849139 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8009a80 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.665+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc14b300 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.665+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc0b1be0 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.665+0000 7fb7c3e00640 1 -- 172.21.15.44:0/2161849139 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb7b8003600 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.665+0000 7fb7c3e00640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7ac073230 0x7fb7ac075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:34.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.669+0000 7fb7c3e00640 1 -- 172.21.15.44:0/2161849139 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6216+0+0 (secure 0 0 0) 0x7fb7b80947c0 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.669+0000 7fb7cbe00640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7ac073230 0x7fb7ac075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:34.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.669+0000 7fb7cbe00640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7ac073230 0x7fb7ac075740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009ac0 tx=0x7fb7bc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:34.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.673+0000 7fb7c3e00640 1 -- 172.21.15.44:0/2161849139 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb7b8017020 con 0x7fb7cc0d18f0 2024-09-17T05:38:34.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:34.881+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb7cc0b49d0 con 0x7fb7cc0d18f0 2024-09-17T05:38:35.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.473+0000 7fb7c3e00640 1 -- 172.21.15.44:0/2161849139 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7fb7b805f020 con 0x7fb7cc0d18f0 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.473+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7ac073230 msgr2=0x7fb7ac075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.473+0000 7fb7d3200640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7ac073230 0x7fb7ac075740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009ac0 tx=0x7fb7bc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0d18f0 msgr2=0x7fb7cc1524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0d18f0 0x7fb7cc1524d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8005bd0 tx=0x7fb7b800db90 comp rx=0 tx=0).stop 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 shutdown_connections 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb7cc0d1d00 0x7fb7cc152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7cc0d18f0 0x7fb7cc1524d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb7ac073230 0x7fb7ac075740 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 --2- 172.21.15.44:0/2161849139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7cc0cf5b0 0x7fb7cc0cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 >> 172.21.15.44:0/2161849139 conn(0x7fb7cc0b4240 msgr2=0x7fb7cc158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:35.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 shutdown_connections 2024-09-17T05:38:35.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.477+0000 7fb7d3200640 1 -- 172.21.15.44:0/2161849139 wait complete. 2024-09-17T05:38:35.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:38:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 -- 172.21.15.44:0/4078974890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 msgr2=0x7ff4200d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 --2- 172.21.15.44:0/4078974890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200d05c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff410009840 tx=0x7ff41001c820 comp rx=0 tx=0).stop 2024-09-17T05:38:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 -- 172.21.15.44:0/4078974890 shutdown_connections 2024-09-17T05:38:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 --2- 172.21.15.44:0/4078974890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200d05c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 -- 172.21.15.44:0/4078974890 >> 172.21.15.44:0/4078974890 conn(0x7ff4200b35f0 msgr2=0x7ff4200b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 -- 172.21.15.44:0/4078974890 shutdown_connections 2024-09-17T05:38:35.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 -- 172.21.15.44:0/4078974890 wait complete. 2024-09-17T05:38:35.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 Processor -- start 2024-09-17T05:38:35.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.669+0000 7ff426e00640 1 -- start start 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4200d0b00 0x7ff42013c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42015d400 0x7ff42015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff42016adb0 con 0x7ff4200702b0 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff42016ac30 con 0x7ff42015d400 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff42016af30 con 0x7ff4200d0b00 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40424/0 (socket says 172.21.15.44:40424) 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 -- 172.21.15.44:0/4164094585 learned_addr learned my addr 172.21.15.44:0/4164094585 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:35.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff424e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42015d400 0x7ff42015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff417e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4200d0b00 0x7ff42013c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 -- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4200d0b00 msgr2=0x7ff42013c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4200d0b00 0x7ff42013c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 -- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42015d400 msgr2=0x7ff42015b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42015d400 0x7ff42015b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 -- 172.21.15.44:0/4164094585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4200ca620 con 0x7ff4200702b0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff424e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42015d400 0x7ff42015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff417e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4200d0b00 0x7ff42013c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41fe00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200adae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff410019430 tx=0x7ff410005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41cc00640 1 -- 172.21.15.44:0/4164094585 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100bb070 con 0x7ff4200702b0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41cc00640 1 -- 172.21.15.44:0/4164094585 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4100043f0 con 0x7ff4200702b0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41cc00640 1 -- 172.21.15.44:0/4164094585 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b2040 con 0x7ff4200702b0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4200aed70 con 0x7ff4200702b0 2024-09-17T05:38:35.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4200caba0 con 0x7ff4200702b0 2024-09-17T05:38:35.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4200d05c0 con 0x7ff4200702b0 2024-09-17T05:38:35.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.673+0000 7ff41cc00640 1 -- 172.21.15.44:0/4164094585 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff4100be070 con 0x7ff4200702b0 2024-09-17T05:38:35.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.677+0000 7ff41cc00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3fc073200 0x7ff3fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:35.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.677+0000 7ff41cc00640 1 -- 172.21.15.44:0/4164094585 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6216+0+0 (secure 0 0 0) 0x7ff41012dde0 con 0x7ff4200702b0 2024-09-17T05:38:35.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.677+0000 7ff417e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3fc073200 0x7ff3fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:35.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.677+0000 7ff417e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3fc073200 0x7ff3fc075710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff408001400 tx=0x7ff408009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:35.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.681+0000 7ff41cc00640 1 -- 172.21.15.44:0/4164094585 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff4100f2db0 con 0x7ff4200702b0 2024-09-17T05:38:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:35.857+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff420069070 con 0x7ff4200702b0 2024-09-17T05:38:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.477+0000 7ff41cc00640 1 -- 172.21.15.44:0/4164094585 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) ==== 181+0+0 (secure 0 0 0) 0x7ff410016410 con 0x7ff4200702b0 2024-09-17T05:38:36.479 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:38:36.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3fc073200 msgr2=0x7ff3fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:36.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3fc073200 0x7ff3fc075710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff408001400 tx=0x7ff408009040 comp rx=0 tx=0).stop 2024-09-17T05:38:36.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 msgr2=0x7ff4200adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:36.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200adae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff410019430 tx=0x7ff410005db0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 shutdown_connections 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3fc073200 0x7ff3fc075710 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff42015d400 0x7ff42015b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff4200d0b00 0x7ff42013c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 --2- 172.21.15.44:0/4164094585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4200702b0 0x7ff4200adae0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 >> 172.21.15.44:0/4164094585 conn(0x7ff4200b35f0 msgr2=0x7ff420073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 shutdown_connections 2024-09-17T05:38:36.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.485+0000 7ff426e00640 1 -- 172.21.15.44:0/4164094585 wait complete. 2024-09-17T05:38:36.510 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:38:36.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 -- 172.21.15.44:0/217311236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0004d50 msgr2=0x7f37b00051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:36.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 --2- 172.21.15.44:0/217311236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0004d50 0x7f37b00051a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f37cc15dbf0 tx=0x7f37c401d1e0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37cb400640 1 -- 172.21.15.44:0/217311236 reap_dead start 2024-09-17T05:38:36.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 -- 172.21.15.44:0/217311236 shutdown_connections 2024-09-17T05:38:36.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 -- 172.21.15.44:0/217311236 >> 172.21.15.44:0/217311236 conn(0x7f37cc0b35f0 msgr2=0x7f37cc0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:36.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 -- 172.21.15.44:0/217311236 shutdown_connections 2024-09-17T05:38:36.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 -- 172.21.15.44:0/217311236 wait complete. 2024-09-17T05:38:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 Processor -- start 2024-09-17T05:38:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.677+0000 7f37d1a00640 1 -- start start 2024-09-17T05:38:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37b0004d50 0x7f37cc153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37cc150ac0 0x7f37cc1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37cc09ae60 0x7f37cc1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc0cfdc0 con 0x7f37cc09ae60 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc0cfc40 con 0x7f37cc150ac0 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f37cc0cff40 con 0x7f37b0004d50 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37cc09ae60 0x7f37cc1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37cc09ae60 0x7f37cc1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40436/0 (socket says 172.21.15.44:40436) 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 -- 172.21.15.44:0/1586508489 learned_addr learned my addr 172.21.15.44:0/1586508489 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37c2000640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37cc150ac0 0x7f37cc1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37caa00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37b0004d50 0x7f37cc153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 -- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37b0004d50 msgr2=0x7f37cc153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37b0004d50 0x7f37cc153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 -- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37cc150ac0 msgr2=0x7f37cc1f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37cc150ac0 0x7f37cc1f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 -- 172.21.15.44:0/1586508489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc154310 con 0x7f37cc09ae60 2024-09-17T05:38:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37caa00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37b0004d50 0x7f37cc153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37cb400640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37cc09ae60 0x7f37cc1553b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c2f0 tx=0x7f37c4004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37c3400640 1 -- 172.21.15.44:0/1586508489 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c400c360 con 0x7f37cc09ae60 2024-09-17T05:38:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37c3400640 1 -- 172.21.15.44:0/1586508489 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37c4001b40 con 0x7f37cc09ae60 2024-09-17T05:38:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37cc1545f0 con 0x7f37cc09ae60 2024-09-17T05:38:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37c3400640 1 -- 172.21.15.44:0/1586508489 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c40ae440 con 0x7f37cc09ae60 2024-09-17T05:38:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.681+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37cc154bb0 con 0x7f37cc09ae60 2024-09-17T05:38:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.685+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37cc154080 con 0x7f37cc09ae60 2024-09-17T05:38:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.685+0000 7f37c3400640 1 -- 172.21.15.44:0/1586508489 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f37c40c1060 con 0x7f37cc09ae60 2024-09-17T05:38:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.685+0000 7f37c3400640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f37a8073200 0x7f37a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.685+0000 7f37c3400640 1 -- 172.21.15.44:0/1586508489 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5778+0+0 (secure 0 0 0) 0x7f37c412e9e0 con 0x7f37cc09ae60 2024-09-17T05:38:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.685+0000 7f37caa00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f37a8073200 0x7f37a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.685+0000 7f37caa00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f37a8073200 0x7f37a8075710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0066c0 tx=0x7f37bc011430 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.689+0000 7f37c3400640 1 -- 172.21.15.44:0/1586508489 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f37cc0d0e30 con 0x7f37cc09ae60 2024-09-17T05:38:36.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:36.865+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f37cc0d0be0 con 0x7f37cc09ae60 2024-09-17T05:38:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.481+0000 7f37c3400640 1 -- 172.21.15.44:0/1586508489 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) ==== 169+0+0 (secure 0 0 0) 0x7f37c40f99d0 con 0x7f37cc09ae60 2024-09-17T05:38:37.481 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:38:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f37a8073200 msgr2=0x7f37a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f37a8073200 0x7f37a8075710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0066c0 tx=0x7f37bc011430 comp rx=0 tx=0).stop 2024-09-17T05:38:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37cc09ae60 msgr2=0x7f37cc1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:37.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37cc09ae60 0x7f37cc1553b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37c400c2f0 tx=0x7f37c4004a20 comp rx=0 tx=0).stop 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 shutdown_connections 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37cc09ae60 0x7f37cc1553b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f37a8073200 0x7f37a8075710 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37cc150ac0 0x7f37cc1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 --2- 172.21.15.44:0/1586508489 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f37b0004d50 0x7f37cc153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 >> 172.21.15.44:0/1586508489 conn(0x7f37cc0b35f0 msgr2=0x7f37cc15b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 shutdown_connections 2024-09-17T05:38:37.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.485+0000 7f37d1a00640 1 -- 172.21.15.44:0/1586508489 wait complete. 2024-09-17T05:38:37.510 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:38:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 -- 172.21.15.44:0/3266705157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 msgr2=0x7fa0440cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 --2- 172.21.15.44:0/3266705157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0440cb880 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009c80 tx=0x7fa03c01cd10 comp rx=0 tx=0).stop 2024-09-17T05:38:37.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 -- 172.21.15.44:0/3266705157 shutdown_connections 2024-09-17T05:38:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 --2- 172.21.15.44:0/3266705157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0440cb880 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 --2- 172.21.15.44:0/3266705157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa04406de50 0x7fa04406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 -- 172.21.15.44:0/3266705157 >> 172.21.15.44:0/3266705157 conn(0x7fa0440ccaa0 msgr2=0x7fa0440cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 -- 172.21.15.44:0/3266705157 shutdown_connections 2024-09-17T05:38:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.669+0000 7fa04a000640 1 -- 172.21.15.44:0/3266705157 wait complete. 2024-09-17T05:38:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 Processor -- start 2024-09-17T05:38:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 -- start start 2024-09-17T05:38:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa04406de50 0x7fa0441f9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044072e50 0x7fa044154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0441580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa044168ff0 con 0x7fa0440cb470 2024-09-17T05:38:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa044168e70 con 0x7fa044072e50 2024-09-17T05:38:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa04a000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa044169170 con 0x7fa04406de50 2024-09-17T05:38:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa043e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0441580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa043400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa04406de50 0x7fa0441f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa043e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0441580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40448/0 (socket says 172.21.15.44:40448) 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa043e00640 1 -- 172.21.15.44:0/247193371 learned_addr learned my addr 172.21.15.44:0/247193371 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.673+0000 7fa03aa00640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044072e50 0x7fa044154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa043e00640 1 -- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa04406de50 msgr2=0x7fa0441f9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa043e00640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa04406de50 0x7fa0441f9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa043e00640 1 -- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044072e50 msgr2=0x7fa044154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa043e00640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044072e50 0x7fa044154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa043e00640 1 -- 172.21.15.44:0/247193371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa044156670 con 0x7fa0440cb470 2024-09-17T05:38:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa043e00640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0441580a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa03c01b3c0 tx=0x7fa03c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa03be00640 1 -- 172.21.15.44:0/247193371 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0bb070 con 0x7fa0440cb470 2024-09-17T05:38:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa03be00640 1 -- 172.21.15.44:0/247193371 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa03c004d60 con 0x7fa0440cb470 2024-09-17T05:38:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa03be00640 1 -- 172.21.15.44:0/247193371 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0b2040 con 0x7fa0440cb470 2024-09-17T05:38:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0441f98e0 con 0x7fa0440cb470 2024-09-17T05:38:37.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0441f9ea0 con 0x7fa0440cb470 2024-09-17T05:38:37.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04406e260 con 0x7fa0440cb470 2024-09-17T05:38:37.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.677+0000 7fa03be00640 1 -- 172.21.15.44:0/247193371 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa03c004220 con 0x7fa0440cb470 2024-09-17T05:38:37.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.681+0000 7fa03be00640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa020073200 0x7fa020075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:37.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.681+0000 7fa03be00640 1 -- 172.21.15.44:0/247193371 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fa03c12dd90 con 0x7fa0440cb470 2024-09-17T05:38:37.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.681+0000 7fa043400640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa020073200 0x7fa020075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:37.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.681+0000 7fa043400640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa020073200 0x7fa020075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa034007fd0 tx=0x7fa034009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:37.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.685+0000 7fa03be00640 1 -- 172.21.15.44:0/247193371 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa03c0f1db0 con 0x7fa0440cb470 2024-09-17T05:38:37.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.861+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fa0440b5fa0 con 0x7fa0440cb470 2024-09-17T05:38:37.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.865+0000 7fa03be00640 1 -- 172.21.15.44:0/247193371 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7fa03c016990 con 0x7fa0440cb470 2024-09-17T05:38:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa020073200 msgr2=0x7fa020075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa020073200 0x7fa020075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa034007fd0 tx=0x7fa034009040 comp rx=0 tx=0).stop 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 msgr2=0x7fa0441580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0441580a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa03c01b3c0 tx=0x7fa03c0092c0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 shutdown_connections 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0440cb470 0x7fa0441580a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa020073200 0x7fa020075710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044072e50 0x7fa044154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 --2- 172.21.15.44:0/247193371 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa04406de50 0x7fa0441f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 >> 172.21.15.44:0/247193371 conn(0x7fa0440ccaa0 msgr2=0x7fa0440b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 shutdown_connections 2024-09-17T05:38:37.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:37.869+0000 7fa04a000640 1 -- 172.21.15.44:0/247193371 wait complete. 2024-09-17T05:38:37.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 -- 172.21.15.44:0/3410157069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92480cb470 msgr2=0x7f92480cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 --2- 172.21.15.44:0/3410157069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92480cb470 0x7f92480cb880 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9244009c80 tx=0x7f924401cd10 comp rx=0 tx=0).stop 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 -- 172.21.15.44:0/3410157069 shutdown_connections 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 --2- 172.21.15.44:0/3410157069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92480cb470 0x7f92480cb880 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 --2- 172.21.15.44:0/3410157069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9248072e50 0x7f924815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 -- 172.21.15.44:0/3410157069 >> 172.21.15.44:0/3410157069 conn(0x7f92480ccaa0 msgr2=0x7f92480cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 -- 172.21.15.44:0/3410157069 shutdown_connections 2024-09-17T05:38:38.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 -- 172.21.15.44:0/3410157069 wait complete. 2024-09-17T05:38:38.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 Processor -- start 2024-09-17T05:38:38.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.049+0000 7f9250800640 1 -- start start 2024-09-17T05:38:38.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f924806de50 0x7f9248157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9248072e50 0x7f9248157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92480cb470 0x7f92480c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9248168f20 con 0x7f924806de50 2024-09-17T05:38:38.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9248168da0 con 0x7f92480cb470 2024-09-17T05:38:38.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f92481690a0 con 0x7f9248072e50 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f924806de50 0x7f9248157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f924806de50 0x7f9248157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40476/0 (socket says 172.21.15.44:40476) 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 -- 172.21.15.44:0/2864676213 learned_addr learned my addr 172.21.15.44:0/2864676213 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924d400640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9248072e50 0x7f9248157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924e800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92480cb470 0x7f92480c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 -- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9248072e50 msgr2=0x7f9248157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9248072e50 0x7f9248157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 -- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92480cb470 msgr2=0x7f92480c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92480cb470 0x7f92480c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 -- 172.21.15.44:0/2864676213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9248155110 con 0x7f924806de50 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924e800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92480cb470 0x7f92480c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924d400640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9248072e50 0x7f9248157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f924de00640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f924806de50 0x7f9248157750 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f923c00d750 tx=0x7f923c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:38.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9242000640 1 -- 172.21.15.44:0/2864676213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c017070 con 0x7f924806de50 2024-09-17T05:38:38.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9242000640 1 -- 172.21.15.44:0/2864676213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f923c009d20 con 0x7f924806de50 2024-09-17T05:38:38.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9242000640 1 -- 172.21.15.44:0/2864676213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c005280 con 0x7f924806de50 2024-09-17T05:38:38.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9248154870 con 0x7f924806de50 2024-09-17T05:38:38.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9248154e30 con 0x7f924806de50 2024-09-17T05:38:38.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.053+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924815e990 con 0x7f924806de50 2024-09-17T05:38:38.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.057+0000 7f9242000640 1 -- 172.21.15.44:0/2864676213 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f923c005420 con 0x7f924806de50 2024-09-17T05:38:38.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.057+0000 7f9242000640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f922c073230 0x7f922c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.057+0000 7f9242000640 1 -- 172.21.15.44:0/2864676213 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f923c0941d0 con 0x7f924806de50 2024-09-17T05:38:38.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.057+0000 7f924d400640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f922c073230 0x7f922c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.057+0000 7f924d400640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f922c073230 0x7f922c075740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f92480ca2f0 tx=0x7f9238009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.061+0000 7f9242000640 1 -- 172.21.15.44:0/2864676213 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f923c00de60 con 0x7f924806de50 2024-09-17T05:38:38.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.297+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f924809ef40 con 0x7f924806de50 2024-09-17T05:38:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9242000640 1 -- 172.21.15.44:0/2864676213 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v140) ==== 149+0+0 (secure 0 0 0) 0x7f923c05f360 con 0x7f924806de50 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f922c073230 msgr2=0x7f922c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f922c073230 0x7f922c075740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f92480ca2f0 tx=0x7f9238009040 comp rx=0 tx=0).stop 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f924806de50 msgr2=0x7f9248157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f924806de50 0x7f9248157750 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f923c00d750 tx=0x7f923c00dc10 comp rx=0 tx=0).stop 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 shutdown_connections 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f922c073230 0x7f922c075740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92480cb470 0x7f92480c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9248072e50 0x7f9248157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 --2- 172.21.15.44:0/2864676213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f924806de50 0x7f9248157750 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 >> 172.21.15.44:0/2864676213 conn(0x7f92480ccaa0 msgr2=0x7f92480b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 shutdown_connections 2024-09-17T05:38:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.493+0000 7f9250800640 1 -- 172.21.15.44:0/2864676213 wait complete. 2024-09-17T05:38:38.515 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-09-17T05:38:38.515 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-09-17T05:38:38.515 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-17T05:38:38.516 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 -- 172.21.15.44:0/1995740205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c06dd30 msgr2=0x7fd35c15c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 --2- 172.21.15.44:0/1995740205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c06dd30 0x7fd35c15c430 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009900 tx=0x7fd34c01c700 comp rx=0 tx=0).stop 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 -- 172.21.15.44:0/1995740205 shutdown_connections 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 --2- 172.21.15.44:0/1995740205 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c0cf700 0x7fd35c160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 --2- 172.21.15.44:0/1995740205 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c06dd30 0x7fd35c15c430 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 -- 172.21.15.44:0/1995740205 >> 172.21.15.44:0/1995740205 conn(0x7fd35c0d1120 msgr2=0x7fd35c0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 -- 172.21.15.44:0/1995740205 shutdown_connections 2024-09-17T05:38:38.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.673+0000 7fd362400640 1 -- 172.21.15.44:0/1995740205 wait complete. 2024-09-17T05:38:38.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 Processor -- start 2024-09-17T05:38:38.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 -- start start 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c06dd30 0x7fd35c15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c0cf700 0x7fd35c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c160550 0x7fd35c15e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c169a10 con 0x7fd35c160550 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c169890 con 0x7fd35c06dd30 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd35c169b90 con 0x7fd35c0cf700 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c160550 0x7fd35c15e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c160550 0x7fd35c15e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40488/0 (socket says 172.21.15.44:40488) 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 -- 172.21.15.44:0/130037537 learned_addr learned my addr 172.21.15.44:0/130037537 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35b400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c06dd30 0x7fd35c15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd353e00640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c0cf700 0x7fd35c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 -- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c0cf700 msgr2=0x7fd35c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c0cf700 0x7fd35c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 -- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c06dd30 msgr2=0x7fd35c15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c06dd30 0x7fd35c15ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 -- 172.21.15.44:0/130037537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c0b6ee0 con 0x7fd35c160550 2024-09-17T05:38:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd35be00640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c160550 0x7fd35c15e7d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd35400be90 tx=0x7fd35400bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd353400640 1 -- 172.21.15.44:0/130037537 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354019070 con 0x7fd35c160550 2024-09-17T05:38:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd353400640 1 -- 172.21.15.44:0/130037537 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd354014440 con 0x7fd35c160550 2024-09-17T05:38:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd353400640 1 -- 172.21.15.44:0/130037537 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3540148d0 con 0x7fd35c160550 2024-09-17T05:38:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c0b4d00 con 0x7fd35c160550 2024-09-17T05:38:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.677+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c161510 con 0x7fd35c160550 2024-09-17T05:38:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.681+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c0b4a60 con 0x7fd35c160550 2024-09-17T05:38:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.681+0000 7fd353400640 1 -- 172.21.15.44:0/130037537 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd35401c070 con 0x7fd35c160550 2024-09-17T05:38:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.681+0000 7fd353400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd338073200 0x7fd338075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.681+0000 7fd353400640 1 -- 172.21.15.44:0/130037537 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fd354094050 con 0x7fd35c160550 2024-09-17T05:38:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.681+0000 7fd35b400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd338073200 0x7fd338075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.681+0000 7fd35b400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd338073200 0x7fd338075710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0af000 tx=0x7fd34c01af40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:38.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.685+0000 7fd353400640 1 -- 172.21.15.44:0/130037537 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd35c0b4a60 con 0x7fd35c160550 2024-09-17T05:38:38.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.865+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd35c15c430 con 0x7fd35c160550 2024-09-17T05:38:38.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.865+0000 7fd353400640 1 -- 172.21.15.44:0/130037537 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+13255 (secure 0 0 0) 0x7fd35405eb80 con 0x7fd35c160550 2024-09-17T05:38:38.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:38.867 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":56,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:38:37.481178+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/767726494":"2024-09-18T05:38:34.472136+0000","172.21.15.44:6833/767726494":"2024-09-18T05:38:34.472136+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:38:38.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd338073200 msgr2=0x7fd338075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd338073200 0x7fd338075710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0af000 tx=0x7fd34c01af40 comp rx=0 tx=0).stop 2024-09-17T05:38:38.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c160550 msgr2=0x7fd35c15e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:38.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c160550 0x7fd35c15e7d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd35400be90 tx=0x7fd35400bf80 comp rx=0 tx=0).stop 2024-09-17T05:38:38.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 shutdown_connections 2024-09-17T05:38:38.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd35c160550 0x7fd35c15e7d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd35c0cf700 0x7fd35c0b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd338073200 0x7fd338075710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 --2- 172.21.15.44:0/130037537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c06dd30 0x7fd35c15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:38.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 >> 172.21.15.44:0/130037537 conn(0x7fd35c0d1120 msgr2=0x7fd35c0cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:38.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 shutdown_connections 2024-09-17T05:38:38.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:38.869+0000 7fd362400640 1 -- 172.21.15.44:0/130037537 wait complete. 2024-09-17T05:38:38.890 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:36:06.284181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:38:38.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.049+0000 7f03e0400640 1 -- 172.21.15.44:0/391227890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 msgr2=0x7f03d8073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.049+0000 7f03e0400640 1 --2- 172.21.15.44:0/391227890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8073f60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f03d806fad0 tx=0x7f03cc01c7d0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- 172.21.15.44:0/391227890 shutdown_connections 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 --2- 172.21.15.44:0/391227890 >> v2:172.21.15.86:3300/0 conn(0x7f03d80cc100 0x7f03d80cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 --2- 172.21.15.44:0/391227890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8073f60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- 172.21.15.44:0/391227890 >> 172.21.15.44:0/391227890 conn(0x7f03d80d1120 msgr2=0x7f03d80d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- 172.21.15.44:0/391227890 shutdown_connections 2024-09-17T05:38:39.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- 172.21.15.44:0/391227890 wait complete. 2024-09-17T05:38:39.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 Processor -- start 2024-09-17T05:38:39.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- start start 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03d80aec80 0x7f03d80b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d80b0a80 0x7f03d81f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03d816c460 con 0x7f03d80ae870 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03d815fb70 con 0x7f03d80b0a80 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.053+0000 7f03e0400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f03d816c5e0 con 0x7f03d80aec80 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57604/0 (socket says 172.21.15.44:57604) 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 -- 172.21.15.44:0/2929001000 learned_addr learned my addr 172.21.15.44:0/2929001000 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03de400640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d80b0a80 0x7f03d81f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dd000640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03d80aec80 0x7f03d80b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 -- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03d80aec80 msgr2=0x7f03d80b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03d80aec80 0x7f03d80b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 -- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d80b0a80 msgr2=0x7f03d81f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d80b0a80 0x7f03d81f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 -- 172.21.15.44:0/2929001000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d80b2220 con 0x7f03d80ae870 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03dda00640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8157750 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f03cc01ccb0 tx=0x7f03cc005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03d5600640 1 -- 172.21.15.44:0/2929001000 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0b2040 con 0x7f03d80ae870 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03d5600640 1 -- 172.21.15.44:0/2929001000 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03cc004040 con 0x7f03d80ae870 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d81f9780 con 0x7f03d80ae870 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03d5600640 1 -- 172.21.15.44:0/2929001000 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc004470 con 0x7f03d80ae870 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d81f9d40 con 0x7f03d80ae870 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d8073f60 con 0x7f03d80ae870 2024-09-17T05:38:39.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.057+0000 7f03d5600640 1 -- 172.21.15.44:0/2929001000 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f03cc0bd030 con 0x7f03d80ae870 2024-09-17T05:38:39.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.061+0000 7f03d5600640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03b8073230 0x7f03b8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.061+0000 7f03d5600640 1 -- 172.21.15.44:0/2929001000 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f03cc12daf0 con 0x7f03d80ae870 2024-09-17T05:38:39.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.061+0000 7f03dd000640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03b8073230 0x7f03b8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.061+0000 7f03dd000640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03b8073230 0x7f03b8075740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f03c4000f70 tx=0x7f03c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:39.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.065+0000 7f03d5600640 1 -- 172.21.15.44:0/2929001000 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f03cc0c4060 con 0x7f03d80ae870 2024-09-17T05:38:39.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f03d8071500 con 0x7f03d80ae870 2024-09-17T05:38:39.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03d5600640 1 -- 172.21.15.44:0/2929001000 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7f03cc0163f0 con 0x7f03d80ae870 2024-09-17T05:38:39.242 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-17T05:38:39.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03b8073230 msgr2=0x7f03b8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03b8073230 0x7f03b8075740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f03c4000f70 tx=0x7f03c4009040 comp rx=0 tx=0).stop 2024-09-17T05:38:39.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 msgr2=0x7f03d8157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8157750 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f03cc01ccb0 tx=0x7f03cc005ca0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 shutdown_connections 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f03b8073230 0x7f03b8075740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03d80b0a80 0x7f03d81f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03d80aec80 0x7f03d80b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 --2- 172.21.15.44:0/2929001000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03d80ae870 0x7f03d8157750 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 >> 172.21.15.44:0/2929001000 conn(0x7f03d80d1120 msgr2=0x7f03d806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.241+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 shutdown_connections 2024-09-17T05:38:39.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.245+0000 7f03e0400640 1 -- 172.21.15.44:0/2929001000 wait complete. 2024-09-17T05:38:39.264 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-09-17T05:38:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 -- 172.21.15.44:0/704646368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c071c60 msgr2=0x7f547c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 --2- 172.21.15.44:0/704646368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c071c60 0x7f547c06df50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f546c009840 tx=0x7f546c01c790 comp rx=0 tx=0).stop 2024-09-17T05:38:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 -- 172.21.15.44:0/704646368 shutdown_connections 2024-09-17T05:38:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 --2- 172.21.15.44:0/704646368 >> v2:172.21.15.86:3300/0 conn(0x7f547c06e490 0x7f547c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 --2- 172.21.15.44:0/704646368 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c071c60 0x7f547c06df50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 -- 172.21.15.44:0/704646368 >> 172.21.15.44:0/704646368 conn(0x7f547c0cd930 msgr2=0x7f547c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 -- 172.21.15.44:0/704646368 shutdown_connections 2024-09-17T05:38:39.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.421+0000 7f5484800640 1 -- 172.21.15.44:0/704646368 wait complete. 2024-09-17T05:38:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 Processor -- start 2024-09-17T05:38:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 -- start start 2024-09-17T05:38:39.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c06e490 0x7f547c132480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f547c070e00 0x7f547c143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f547c071c60 0x7f547c14c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f547c15c4a0 con 0x7f547c070e00 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f547c15c320 con 0x7f547c071c60 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5484800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f547c15c620 con 0x7f547c06e490 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f547c070e00 0x7f547c143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f547c070e00 0x7f547c143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57612/0 (socket says 172.21.15.44:57612) 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 -- 172.21.15.44:0/2417534136 learned_addr learned my addr 172.21.15.44:0/2417534136 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481e00640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c06e490 0x7f547c132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5482800640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f547c071c60 0x7f547c14c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 -- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c06e490 msgr2=0x7f547c132480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c06e490 0x7f547c132480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 -- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f547c071c60 msgr2=0x7f547c14c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:39.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f547c071c60 0x7f547c14c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:39.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.425+0000 7f5481400640 1 -- 172.21.15.44:0/2417534136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c1329c0 con 0x7f547c070e00 2024-09-17T05:38:39.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.429+0000 7f5481400640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f547c070e00 0x7f547c143400 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f546c009790 tx=0x7f546c005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:39.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.429+0000 7f5476000640 1 -- 172.21.15.44:0/2417534136 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c0b2040 con 0x7f547c070e00 2024-09-17T05:38:39.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.429+0000 7f5476000640 1 -- 172.21.15.44:0/2417534136 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f546c004320 con 0x7f547c070e00 2024-09-17T05:38:39.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.429+0000 7f5476000640 1 -- 172.21.15.44:0/2417534136 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c0044f0 con 0x7f547c070e00 2024-09-17T05:38:39.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.429+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c143940 con 0x7f547c070e00 2024-09-17T05:38:39.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.429+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c14a420 con 0x7f547c070e00 2024-09-17T05:38:39.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.429+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547c14a190 con 0x7f547c070e00 2024-09-17T05:38:39.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.433+0000 7f5476000640 1 -- 172.21.15.44:0/2417534136 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f546c0052d0 con 0x7f547c070e00 2024-09-17T05:38:39.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.433+0000 7f5476000640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5460073230 0x7f5460075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:39.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.433+0000 7f5476000640 1 -- 172.21.15.44:0/2417534136 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f546c12d200 con 0x7f547c070e00 2024-09-17T05:38:39.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.433+0000 7f5481e00640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5460073230 0x7f5460075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:39.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.437+0000 7f5481e00640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5460073230 0x7f5460075740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5470007d70 tx=0x7f5470007d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:39.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.437+0000 7f5476000640 1 -- 172.21.15.44:0/2417534136 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f547c143940 con 0x7f547c070e00 2024-09-17T05:38:39.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:39.681+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f547c06cfe0 con 0x7f547c070e00 2024-09-17T05:38:40.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5476000640 1 -- 172.21.15.44:0/2417534136 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v142) ==== 172+0+0 (secure 0 0 0) 0x7f547c1329c0 con 0x7f547c070e00 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5460073230 msgr2=0x7f5460075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5460073230 0x7f5460075740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5470007d70 tx=0x7f5470007d00 comp rx=0 tx=0).stop 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f547c070e00 msgr2=0x7f547c143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f547c070e00 0x7f547c143400 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f546c009790 tx=0x7f546c005d20 comp rx=0 tx=0).stop 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 shutdown_connections 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5460073230 0x7f5460075740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f547c071c60 0x7f547c14c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f547c070e00 0x7f547c143400 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 --2- 172.21.15.44:0/2417534136 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f547c06e490 0x7f547c132480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 >> 172.21.15.44:0/2417534136 conn(0x7f547c0cd930 msgr2=0x7f547c1510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:40.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 shutdown_connections 2024-09-17T05:38:40.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.501+0000 7f5484800640 1 -- 172.21.15.44:0/2417534136 wait complete. 2024-09-17T05:38:40.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 -- 172.21.15.44:0/390793773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 msgr2=0x7fbbdc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 --2- 172.21.15.44:0/390793773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 0x7fbbdc004f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009b40 tx=0x7fbbe801d270 comp rx=0 tx=0).stop 2024-09-17T05:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbf7400640 1 -- 172.21.15.44:0/390793773 reap_dead start 2024-09-17T05:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 -- 172.21.15.44:0/390793773 shutdown_connections 2024-09-17T05:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 -- 172.21.15.44:0/390793773 >> 172.21.15.44:0/390793773 conn(0x7fbbf80ccaa0 msgr2=0x7fbbf80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 -- 172.21.15.44:0/390793773 shutdown_connections 2024-09-17T05:38:40.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 -- 172.21.15.44:0/390793773 wait complete. 2024-09-17T05:38:40.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 Processor -- start 2024-09-17T05:38:40.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.693+0000 7fbbfdc00640 1 -- start start 2024-09-17T05:38:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 0x7fbbf809d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf81f6e00 0x7fbbf81f7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf81555b0 0x7fbbf81559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf806e1e0 con 0x7fbbdc004b00 2024-09-17T05:38:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf806e060 con 0x7fbbf81f6e00 2024-09-17T05:38:40.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbbf806e360 con 0x7fbbf81555b0 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 0x7fbbf809d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 0x7fbbf809d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57620/0 (socket says 172.21.15.44:57620) 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 -- 172.21.15.44:0/3808677982 learned_addr learned my addr 172.21.15.44:0/3808677982 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6000640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf81f6e00 0x7fbbf81f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf7400640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf81555b0 0x7fbbf81559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 -- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf81555b0 msgr2=0x7fbbf81559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf81555b0 0x7fbbf81559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 -- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf81f6e00 msgr2=0x7fbbf81f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf81f6e00 0x7fbbf81f7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 -- 172.21.15.44:0/3808677982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf80b4f50 con 0x7fbbdc004b00 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6000640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf81f6e00 0x7fbbf81f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:40.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf7400640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf81555b0 0x7fbbf81559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbf6a00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 0x7fbbf809d240 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009b40 tx=0x7fbbe8009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbeea00640 1 -- 172.21.15.44:0/3808677982 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80bb030 con 0x7fbbdc004b00 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbeea00640 1 -- 172.21.15.44:0/3808677982 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbe80047c0 con 0x7fbbdc004b00 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf81f7750 con 0x7fbbdc004b00 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbeea00640 1 -- 172.21.15.44:0/3808677982 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8004b90 con 0x7fbbdc004b00 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf80b5510 con 0x7fbbdc004b00 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf80ced30 con 0x7fbbdc004b00 2024-09-17T05:38:40.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.697+0000 7fbbeea00640 1 -- 172.21.15.44:0/3808677982 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbbe80be030 con 0x7fbbdc004b00 2024-09-17T05:38:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.701+0000 7fbbeea00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbd8073200 0x7fbbd8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:40.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.701+0000 7fbbeea00640 1 -- 172.21.15.44:0/3808677982 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fbbe812f580 con 0x7fbbdc004b00 2024-09-17T05:38:40.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.701+0000 7fbbf6000640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbd8073200 0x7fbbd8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:40.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.701+0000 7fbbf6000640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbd8073200 0x7fbbd8075710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001270 tx=0x7fbbe4001120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.705+0000 7fbbeea00640 1 -- 172.21.15.44:0/3808677982 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbbe8016f80 con 0x7fbbdc004b00 2024-09-17T05:38:40.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.877+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbbf80b5fa0 con 0x7fbbdc004b00 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbeea00640 1 -- 172.21.15.44:0/3808677982 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+2294 (secure 0 0 0) 0x7fbbe80fa790 con 0x7fbbdc004b00 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:38:40.881 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3062.155679 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3184.697297 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3313.522676 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3406.954625 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4320.207875 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.313189 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7119.006184 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4437.685284 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:38:40.882 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:38:40.883 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:38:40.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbd8073200 msgr2=0x7fbbd8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:40.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbd8073200 0x7fbbd8075710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4001270 tx=0x7fbbe4001120 comp rx=0 tx=0).stop 2024-09-17T05:38:40.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 msgr2=0x7fbbf809d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 0x7fbbf809d240 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009b40 tx=0x7fbbe8009710 comp rx=0 tx=0).stop 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 shutdown_connections 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbbf81555b0 0x7fbbf81559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbd8073200 0x7fbbd8075710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbf81f6e00 0x7fbbf81f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 --2- 172.21.15.44:0/3808677982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbdc004b00 0x7fbbf809d240 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 >> 172.21.15.44:0/3808677982 conn(0x7fbbf80ccaa0 msgr2=0x7fbbf8157bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 shutdown_connections 2024-09-17T05:38:40.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:40.881+0000 7fbbfdc00640 1 -- 172.21.15.44:0/3808677982 wait complete. 2024-09-17T05:38:40.903 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:38:41.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 -- 172.21.15.44:0/1621370023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc07806e660 msgr2=0x7fc078151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 --2- 172.21.15.44:0/1621370023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc07806e660 0x7fc078151b00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc070009c80 tx=0x7fc07001cd10 comp rx=0 tx=0).stop 2024-09-17T05:38:41.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 -- 172.21.15.44:0/1621370023 shutdown_connections 2024-09-17T05:38:41.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 --2- 172.21.15.44:0/1621370023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc07806e660 0x7fc078151b00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 --2- 172.21.15.44:0/1621370023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc078070e00 0x7fc078071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 -- 172.21.15.44:0/1621370023 >> 172.21.15.44:0/1621370023 conn(0x7fc0780cd930 msgr2=0x7fc0780cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:41.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 -- 172.21.15.44:0/1621370023 shutdown_connections 2024-09-17T05:38:41.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.065+0000 7fc07ca00640 1 -- 172.21.15.44:0/1621370023 wait complete. 2024-09-17T05:38:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 Processor -- start 2024-09-17T05:38:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 -- start start 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc078070e00 0x7fc078149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0780ccb60 0x7fc078155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc07814a420 0x7fc078155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc07815c5b0 con 0x7fc078070e00 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc07815c430 con 0x7fc07814a420 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc07815c730 con 0x7fc0780ccb60 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc078070e00 0x7fc078149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc078070e00 0x7fc078149e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57638/0 (socket says 172.21.15.44:57638) 2024-09-17T05:38:41.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 -- 172.21.15.44:0/2346451234 learned_addr learned my addr 172.21.15.44:0/2346451234 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc06d400640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0780ccb60 0x7fc078155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc076800640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc07814a420 0x7fc078155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 -- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0780ccb60 msgr2=0x7fc078155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0780ccb60 0x7fc078155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 -- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc07814a420 msgr2=0x7fc078155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc07814a420 0x7fc078155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 -- 172.21.15.44:0/2346451234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0781537f0 con 0x7fc078070e00 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc076800640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc07814a420 0x7fc078155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc06d400640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0780ccb60 0x7fc078155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:41.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc075e00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc078070e00 0x7fc078149e80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc06800e7c0 tx=0x7fc06800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc06ea00640 1 -- 172.21.15.44:0/2346451234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06800ccc0 con 0x7fc078070e00 2024-09-17T05:38:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc06ea00640 1 -- 172.21.15.44:0/2346451234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc06800ce80 con 0x7fc078070e00 2024-09-17T05:38:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc06ea00640 1 -- 172.21.15.44:0/2346451234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068005280 con 0x7fc078070e00 2024-09-17T05:38:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc078152bf0 con 0x7fc078070e00 2024-09-17T05:38:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.069+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc07814c360 con 0x7fc078070e00 2024-09-17T05:38:41.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.073+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0781532b0 con 0x7fc078070e00 2024-09-17T05:38:41.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.073+0000 7fc06ea00640 1 -- 172.21.15.44:0/2346451234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc068005420 con 0x7fc078070e00 2024-09-17T05:38:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.073+0000 7fc06ea00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc054077610 0x7fc054079b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.073+0000 7fc06ea00640 1 -- 172.21.15.44:0/2346451234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fc068094ea0 con 0x7fc078070e00 2024-09-17T05:38:41.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.073+0000 7fc06d400640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc054077610 0x7fc054079b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.073+0000 7fc06d400640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc054077610 0x7fc054079b20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc0780cb030 tx=0x7fc060009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:41.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.077+0000 7fc06ea00640 1 -- 172.21.15.44:0/2346451234 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc068060130 con 0x7fc078070e00 2024-09-17T05:38:41.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.253+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc07814c5c0 con 0x7fc078070e00 2024-09-17T05:38:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.257+0000 7fc06ea00640 1 -- 172.21.15.44:0/2346451234 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fc06805fa30 con 0x7fc078070e00 2024-09-17T05:38:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc054077610 msgr2=0x7fc054079b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc054077610 0x7fc054079b20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc0780cb030 tx=0x7fc060009040 comp rx=0 tx=0).stop 2024-09-17T05:38:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc078070e00 msgr2=0x7fc078149e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc078070e00 0x7fc078149e80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc06800e7c0 tx=0x7fc06800ec80 comp rx=0 tx=0).stop 2024-09-17T05:38:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 shutdown_connections 2024-09-17T05:38:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc054077610 0x7fc054079b20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc07814a420 0x7fc078155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0780ccb60 0x7fc078155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 --2- 172.21.15.44:0/2346451234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc078070e00 0x7fc078149e80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 >> 172.21.15.44:0/2346451234 conn(0x7fc0780cd930 msgr2=0x7fc07815e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 shutdown_connections 2024-09-17T05:38:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.261+0000 7fc07ca00640 1 -- 172.21.15.44:0/2346451234 wait complete. 2024-09-17T05:38:41.282 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:38:41.282 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:38:41.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:38:41.459 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:38:41.459 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:38:41.459 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:41.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:38:41.468 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:38:41.468 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:41.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:38:41.477 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:38:41.477 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:41.520 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:38:41.521 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:38:41.521 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:41.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:38:41.532 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:38:41.532 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:41.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 -- 172.21.15.44:0/1418147224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c06de50 msgr2=0x7fa93c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 --2- 172.21.15.44:0/1418147224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c06de50 0x7fa93c06e260 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa924009900 tx=0x7fa92401c850 comp rx=0 tx=0).stop 2024-09-17T05:38:41.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 -- 172.21.15.44:0/1418147224 shutdown_connections 2024-09-17T05:38:41.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 --2- 172.21.15.44:0/1418147224 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa93c0cb470 0x7fa93c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 --2- 172.21.15.44:0/1418147224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c06de50 0x7fa93c06e260 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 -- 172.21.15.44:0/1418147224 >> 172.21.15.44:0/1418147224 conn(0x7fa93c0ccaa0 msgr2=0x7fa93c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 -- 172.21.15.44:0/1418147224 shutdown_connections 2024-09-17T05:38:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 -- 172.21.15.44:0/1418147224 wait complete. 2024-09-17T05:38:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 Processor -- start 2024-09-17T05:38:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.721+0000 7fa941600640 1 -- start start 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa93c06de50 0x7fa93c165e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa93c072e50 0x7fa93c070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c0cb470 0x7fa93c164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa93c168f70 con 0x7fa93c0cb470 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa93c168df0 con 0x7fa93c072e50 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa93c1690f0 con 0x7fa93c06de50 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c0cb470 0x7fa93c164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa932000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa93c072e50 0x7fa93c070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93aa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa93c06de50 0x7fa93c165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c0cb470 0x7fa93c164650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57658/0 (socket says 172.21.15.44:57658) 2024-09-17T05:38:41.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 -- 172.21.15.44:0/1763674000 learned_addr learned my addr 172.21.15.44:0/1763674000 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 -- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa93c06de50 msgr2=0x7fa93c165e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa93c06de50 0x7fa93c165e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 -- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa93c072e50 msgr2=0x7fa93c070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa93c072e50 0x7fa93c070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 -- 172.21.15.44:0/1763674000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93c1f9f40 con 0x7fa93c0cb470 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa932000640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa93c072e50 0x7fa93c070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa93b400640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c0cb470 0x7fa93c164650 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e940 tx=0x7fa93400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa933400640 1 -- 172.21.15.44:0/1763674000 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934004d30 con 0x7fa93c0cb470 2024-09-17T05:38:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa933400640 1 -- 172.21.15.44:0/1763674000 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa93400cb20 con 0x7fa93c0cb470 2024-09-17T05:38:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa93c06fa20 con 0x7fa93c0cb470 2024-09-17T05:38:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa933400640 1 -- 172.21.15.44:0/1763674000 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934005020 con 0x7fa93c0cb470 2024-09-17T05:38:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa93c1650e0 con 0x7fa93c0cb470 2024-09-17T05:38:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.725+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa93c06e260 con 0x7fa93c0cb470 2024-09-17T05:38:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.729+0000 7fa933400640 1 -- 172.21.15.44:0/1763674000 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa9340051c0 con 0x7fa93c0cb470 2024-09-17T05:38:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.729+0000 7fa933400640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa918073200 0x7fa918075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:41.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.729+0000 7fa933400640 1 -- 172.21.15.44:0/1763674000 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fa9340949b0 con 0x7fa93c0cb470 2024-09-17T05:38:41.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.729+0000 7fa93aa00640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa918073200 0x7fa918075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:41.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.729+0000 7fa93aa00640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa918073200 0x7fa918075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa92c007fd0 tx=0x7fa92c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:41.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.733+0000 7fa933400640 1 -- 172.21.15.44:0/1763674000 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa934016030 con 0x7fa93c0cb470 2024-09-17T05:38:41.899 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:41.903 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.941+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa93c0b5fa0 con 0x7fa93c0cb470 2024-09-17T05:38:41.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.941+0000 7fa933400640 1 -- 172.21.15.44:0/1763674000 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3905 (secure 0 0 0) 0x7fa93405f4f0 con 0x7fa93c0cb470 2024-09-17T05:38:41.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:41.943 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":28,"btime":"2024-09-17T05:38:35:474193+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/460860392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":460860392},{"type":"v1","addr":"172.21.15.86:6835","nonce":460860392}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5311,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/457456527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":457456527},{"type":"v1","addr":"172.21.15.44:6834","nonce":457456527}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5320,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/3718144534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":3718144534},{"type":"v1","addr":"172.21.15.86:6837","nonce":3718144534}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5667,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2558960098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2558960098},{"type":"v1","addr":"172.21.15.44:6835","nonce":2558960098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-09-17T05:38:41.943 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 28 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa918073200 msgr2=0x7fa918075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa918073200 0x7fa918075710 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa92c007fd0 tx=0x7fa92c009040 comp rx=0 tx=0).stop 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c0cb470 msgr2=0x7fa93c164650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c0cb470 0x7fa93c164650 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e940 tx=0x7fa93400ee00 comp rx=0 tx=0).stop 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 shutdown_connections 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa93c0cb470 0x7fa93c164650 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa918073200 0x7fa918075710 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa93c072e50 0x7fa93c070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 --2- 172.21.15.44:0/1763674000 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa93c06de50 0x7fa93c165e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 >> 172.21.15.44:0/1763674000 conn(0x7fa93c0ccaa0 msgr2=0x7fa93c1546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 shutdown_connections 2024-09-17T05:38:41.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:41.945+0000 7fa941600640 1 -- 172.21.15.44:0/1763674000 wait complete. 2024-09-17T05:38:41.966 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:38:41.966 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:38:41.966 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:38:41.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:41.967 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:38:41.967 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:38:41.967 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:38:41.967 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:41.967 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:38:41.968 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:38:41.968 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:38:41.968 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:41.968 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:38:41.969 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:38:41.969 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:38:41.969 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:41.983 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:38:41.983 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:38:41.984 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:38:41.984 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:38:42.023 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:38:42.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:38:42.027 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:38:42.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:38:42.030 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:38:42.031 DEBUG:teuthology.parallel:result is None 2024-09-17T05:38:42.032 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:38:42.032 DEBUG:teuthology.parallel:result is None 2024-09-17T05:38:42.074 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:38:42.075 DEBUG:teuthology.parallel:result is None 2024-09-17T05:38:42.077 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:38:42.077 DEBUG:teuthology.parallel:result is None 2024-09-17T05:38:42.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:38:42.133 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:38:42.135 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:38:42.176 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:38:42.176 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:38:42.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 -- 172.21.15.44:0/788882810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c072e50 msgr2=0x7f6f9c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 --2- 172.21.15.44:0/788882810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c072e50 0x7f6f9c15e990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009900 tx=0x7f6f9001c850 comp rx=0 tx=0).stop 2024-09-17T05:38:42.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 -- 172.21.15.44:0/788882810 shutdown_connections 2024-09-17T05:38:42.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 --2- 172.21.15.44:0/788882810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f9c06de50 0x7f6f9c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 --2- 172.21.15.44:0/788882810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c072e50 0x7f6f9c15e990 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 -- 172.21.15.44:0/788882810 >> 172.21.15.44:0/788882810 conn(0x7f6f9c0ccaa0 msgr2=0x7f6f9c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:42.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 -- 172.21.15.44:0/788882810 shutdown_connections 2024-09-17T05:38:42.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.241+0000 7f6fa4000640 1 -- 172.21.15.44:0/788882810 wait complete. 2024-09-17T05:38:42.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 Processor -- start 2024-09-17T05:38:42.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 -- start start 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c06de50 0x7f6f9c1fb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f9c072e50 0x7f6f9c0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f9c0ced00 0x7f6f9c09fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c169410 con 0x7f6f9c06de50 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c169290 con 0x7f6f9c0ced00 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c169590 con 0x7f6f9c072e50 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c06de50 0x7f6f9c1fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c06de50 0x7f6f9c1fb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57728/0 (socket says 172.21.15.44:57728) 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 -- 172.21.15.44:0/2294732008 learned_addr learned my addr 172.21.15.44:0/2294732008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:42.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa0c00640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f9c072e50 0x7f6f9c0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa2000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f9c0ced00 0x7f6f9c09fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 -- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f9c072e50 msgr2=0x7f6f9c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f9c072e50 0x7f6f9c0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 -- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f9c0ced00 msgr2=0x7f6f9c09fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f9c0ced00 0x7f6f9c09fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 -- 172.21.15.44:0/2294732008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0b34a0 con 0x7f6f9c06de50 2024-09-17T05:38:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa2000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f9c0ced00 0x7f6f9c09fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa1600640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c06de50 0x7f6f9c1fb500 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f900b0040 tx=0x7f6f90005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6f99600640 1 -- 172.21.15.44:0/2294732008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f900b2040 con 0x7f6f9c06de50 2024-09-17T05:38:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6f99600640 1 -- 172.21.15.44:0/2294732008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f90004330 con 0x7f6f9c06de50 2024-09-17T05:38:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6f99600640 1 -- 172.21.15.44:0/2294732008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90005280 con 0x7f6f9c06de50 2024-09-17T05:38:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c0ab900 con 0x7f6f9c06de50 2024-09-17T05:38:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.245+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c15a710 con 0x7f6f9c06de50 2024-09-17T05:38:42.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.249+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c06e260 con 0x7f6f9c06de50 2024-09-17T05:38:42.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.249+0000 7f6f99600640 1 -- 172.21.15.44:0/2294732008 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6f90005420 con 0x7f6f9c06de50 2024-09-17T05:38:42.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.249+0000 7f6f99600640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f7c073230 0x7f6f7c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.249+0000 7f6f99600640 1 -- 172.21.15.44:0/2294732008 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f6f900bd070 con 0x7f6f9c06de50 2024-09-17T05:38:42.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.249+0000 7f6fa0c00640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f7c073230 0x7f6f7c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.253+0000 7f6fa0c00640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f7c073230 0x7f6f7c075740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0a0fe0 tx=0x7f6f880091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:42.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.253+0000 7f6f99600640 1 -- 172.21.15.44:0/2294732008 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6f9c0b34a0 con 0x7f6f9c06de50 2024-09-17T05:38:42.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.441+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6f9c0cf3b0 con 0x7f6f9c06de50 2024-09-17T05:38:42.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.513+0000 7f6f99600640 1 -- 172.21.15.44:0/2294732008 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) ==== 97+0+0 (secure 0 0 0) 0x7f6f900164d0 con 0x7f6f9c06de50 2024-09-17T05:38:42.515 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-17T05:38:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f7c073230 msgr2=0x7f6f7c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f7c073230 0x7f6f7c075740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0a0fe0 tx=0x7f6f880091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c06de50 msgr2=0x7f6f9c1fb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c06de50 0x7f6f9c1fb500 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6f900b0040 tx=0x7f6f90005e70 comp rx=0 tx=0).stop 2024-09-17T05:38:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 shutdown_connections 2024-09-17T05:38:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6f7c073230 0x7f6f7c075740 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f9c0ced00 0x7f6f9c09fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f9c072e50 0x7f6f9c0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 --2- 172.21.15.44:0/2294732008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f9c06de50 0x7f6f9c1fb500 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 >> 172.21.15.44:0/2294732008 conn(0x7f6f9c0ccaa0 msgr2=0x7f6f9c1546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 shutdown_connections 2024-09-17T05:38:42.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.517+0000 7f6fa4000640 1 -- 172.21.15.44:0/2294732008 wait complete. 2024-09-17T05:38:42.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:38:42.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1604418657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec0cb470 msgr2=0x7f9cec0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1604418657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec0cb470 0x7f9cec0cb880 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9cec06ace0 tx=0x7f9ce401caf0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1604418657 shutdown_connections 2024-09-17T05:38:42.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1604418657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec0cb470 0x7f9cec0cb880 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1604418657 >> v2:172.21.15.86:3300/0 conn(0x7f9cec072e50 0x7f9cec15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1604418657 >> 172.21.15.44:0/1604418657 conn(0x7f9cec0ccaa0 msgr2=0x7f9cec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:42.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1604418657 shutdown_connections 2024-09-17T05:38:42.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1604418657 wait complete. 2024-09-17T05:38:42.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 Processor -- start 2024-09-17T05:38:42.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.701+0000 7f9cf0a00640 1 -- start start 2024-09-17T05:38:42.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec06de50 0x7f9cec0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cec072e50 0x7f9cec0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cec0cb470 0x7f9cec0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec168e80 con 0x7f9cec06de50 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec168d00 con 0x7f9cec072e50 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec169000 con 0x7f9cec0cb470 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec06de50 0x7f9cec0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec06de50 0x7f9cec0b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57740/0 (socket says 172.21.15.44:57740) 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 -- 172.21.15.44:0/1556014189 learned_addr learned my addr 172.21.15.44:0/1556014189 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce1400640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cec072e50 0x7f9cec0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cea800640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cec0cb470 0x7f9cec0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 -- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cec0cb470 msgr2=0x7f9cec0b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cec0cb470 0x7f9cec0b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 -- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cec072e50 msgr2=0x7f9cec0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cec072e50 0x7f9cec0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 -- 172.21.15.44:0/1556014189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec158400 con 0x7f9cec06de50 2024-09-17T05:38:42.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce9e00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec06de50 0x7f9cec0b5960 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00e9a0 tx=0x7f9cdc00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:42.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce2a00640 1 -- 172.21.15.44:0/1556014189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc00cd80 con 0x7f9cec06de50 2024-09-17T05:38:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce2a00640 1 -- 172.21.15.44:0/1556014189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cdc004020 con 0x7f9cec06de50 2024-09-17T05:38:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9ce2a00640 1 -- 172.21.15.44:0/1556014189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc004450 con 0x7f9cec06de50 2024-09-17T05:38:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec153fe0 con 0x7f9cec06de50 2024-09-17T05:38:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cec1545a0 con 0x7f9cec06de50 2024-09-17T05:38:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.705+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cec0cb880 con 0x7f9cec06de50 2024-09-17T05:38:42.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.709+0000 7f9ce2a00640 1 -- 172.21.15.44:0/1556014189 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9cdc003600 con 0x7f9cec06de50 2024-09-17T05:38:42.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.709+0000 7f9ce2a00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9cc8073200 0x7f9cc8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:42.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.709+0000 7f9ce2a00640 1 -- 172.21.15.44:0/1556014189 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f9cdc0948a0 con 0x7f9cec06de50 2024-09-17T05:38:42.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.709+0000 7f9ce1400640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9cc8073200 0x7f9cc8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:42.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.709+0000 7f9ce1400640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9cc8073200 0x7f9cc8075710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0c7020 tx=0x7f9cd40013a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:42.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.713+0000 7f9ce2a00640 1 -- 172.21.15.44:0/1556014189 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9cdc05f420 con 0x7f9cec06de50 2024-09-17T05:38:42.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9cec0b5fa0 con 0x7f9cec06de50 2024-09-17T05:38:42.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9ce2a00640 1 -- 172.21.15.44:0/1556014189 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f9cdc063e50 con 0x7f9cec06de50 2024-09-17T05:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-17T05:38:42.949 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw==", 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow==", 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.950 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ==", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:38:42.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA==", 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.952 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-17T05:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw==", 2024-09-17T05:38:42.953 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.954 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-17T05:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA==", 2024-09-17T05:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-17T05:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg==", 2024-09-17T05:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q==", 2024-09-17T05:38:42.957 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.958 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-17T05:38:42.959 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg==", 2024-09-17T05:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.960 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew==", 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.961 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA==", 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.962 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw==", 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow==", 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.963 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ==", 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:38:42.964 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw==", 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.965 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A==", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQARFelmev8SKhAAoaY75HymG92N8LNMMAUl6g==", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:38:42.966 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA==", 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.967 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw==", 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:42.968 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:38:42.969 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9cc8073200 msgr2=0x7f9cc8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9cc8073200 0x7f9cc8075710 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0c7020 tx=0x7f9cd40013a0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec06de50 msgr2=0x7f9cec0b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec06de50 0x7f9cec0b5960 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc00e9a0 tx=0x7f9cdc00ee60 comp rx=0 tx=0).stop 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 shutdown_connections 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9cec0cb470 0x7f9cec0b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9cc8073200 0x7f9cc8075710 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cec072e50 0x7f9cec0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 --2- 172.21.15.44:0/1556014189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9cec06de50 0x7f9cec0b5960 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:42.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 >> 172.21.15.44:0/1556014189 conn(0x7f9cec0ccaa0 msgr2=0x7f9cec159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:42.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 shutdown_connections 2024-09-17T05:38:42.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:42.949+0000 7f9cf0a00640 1 -- 172.21.15.44:0/1556014189 wait complete. 2024-09-17T05:38:42.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 -- 172.21.15.44:0/2970566088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b340cb470 msgr2=0x7f8b340cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2970566088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b340cb470 0x7f8b340cb880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009c80 tx=0x7f8b2c01cd30 comp rx=0 tx=0).stop 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 -- 172.21.15.44:0/2970566088 shutdown_connections 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2970566088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b340cb470 0x7f8b340cb880 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2970566088 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b34072e50 0x7f8b3415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 -- 172.21.15.44:0/2970566088 >> 172.21.15.44:0/2970566088 conn(0x7f8b340ccaa0 msgr2=0x7f8b340cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 -- 172.21.15.44:0/2970566088 shutdown_connections 2024-09-17T05:38:43.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 -- 172.21.15.44:0/2970566088 wait complete. 2024-09-17T05:38:43.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 Processor -- start 2024-09-17T05:38:43.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.133+0000 7f8b3b200640 1 -- start start 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b3406de50 0x7f8b340b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b34072e50 0x7f8b340cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b340cb470 0x7f8b340cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b34168fc0 con 0x7f8b3406de50 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8b34168e40 con 0x7f8b340cb470 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8b34169140 con 0x7f8b34072e50 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b3406de50 0x7f8b340b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b3406de50 0x7f8b340b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57766/0 (socket says 172.21.15.44:57766) 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 -- 172.21.15.44:0/2721849036 learned_addr learned my addr 172.21.15.44:0/2721849036 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b39200640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b340cb470 0x7f8b340cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33400640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b34072e50 0x7f8b340cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 -- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b34072e50 msgr2=0x7f8b340cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b34072e50 0x7f8b340cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 -- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b340cb470 msgr2=0x7f8b340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b340cb470 0x7f8b340cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 -- 172.21.15.44:0/2721849036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b341537f0 con 0x7f8b3406de50 2024-09-17T05:38:43.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b33e00640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b3406de50 0x7f8b340b58f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400e7f0 tx=0x7f8b2400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b2be00640 1 -- 172.21.15.44:0/2721849036 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400ccc0 con 0x7f8b3406de50 2024-09-17T05:38:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b2be00640 1 -- 172.21.15.44:0/2721849036 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2400ce80 con 0x7f8b3406de50 2024-09-17T05:38:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b2be00640 1 -- 172.21.15.44:0/2721849036 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24005280 con 0x7f8b3406de50 2024-09-17T05:38:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b34153ad0 con 0x7f8b3406de50 2024-09-17T05:38:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b34154090 con 0x7f8b3406de50 2024-09-17T05:38:43.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.137+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b340cb880 con 0x7f8b3406de50 2024-09-17T05:38:43.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.141+0000 7f8b2be00640 1 -- 172.21.15.44:0/2721849036 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8b24005420 con 0x7f8b3406de50 2024-09-17T05:38:43.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.141+0000 7f8b2be00640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8b14073230 0x7f8b14075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.141+0000 7f8b2be00640 1 -- 172.21.15.44:0/2721849036 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f8b24094900 con 0x7f8b3406de50 2024-09-17T05:38:43.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.141+0000 7f8b33400640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8b14073230 0x7f8b14075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.141+0000 7f8b33400640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8b14073230 0x7f8b14075740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b340b5420 tx=0x7f8b20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:43.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.145+0000 7f8b2be00640 1 -- 172.21.15.44:0/2721849036 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8b2405f480 con 0x7f8b3406de50 2024-09-17T05:38:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.321+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8b3409eab0 con 0x7f8b3406de50 2024-09-17T05:38:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.321+0000 7f8b2be00640 1 -- 172.21.15.44:0/2721849036 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) ==== 84+0+65 (secure 0 0 0) 0x7f8b24063eb0 con 0x7f8b3406de50 2024-09-17T05:38:43.323 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:43.324 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:38:43.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:43.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:38:43.324 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:38:43.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:43.324 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8b14073230 msgr2=0x7f8b14075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8b14073230 0x7f8b14075740 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b340b5420 tx=0x7f8b20009040 comp rx=0 tx=0).stop 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b3406de50 msgr2=0x7f8b340b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b3406de50 0x7f8b340b58f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400e7f0 tx=0x7f8b2400ecb0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 shutdown_connections 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8b14073230 0x7f8b14075740 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b340cb470 0x7f8b340cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8b34072e50 0x7f8b340cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 --2- 172.21.15.44:0/2721849036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b3406de50 0x7f8b340b58f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 >> 172.21.15.44:0/2721849036 conn(0x7f8b340ccaa0 msgr2=0x7f8b340b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:43.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 shutdown_connections 2024-09-17T05:38:43.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.325+0000 7f8b3b200640 1 -- 172.21.15.44:0/2721849036 wait complete. 2024-09-17T05:38:43.345 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:38:43.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:38:43.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.505+0000 7f0dde000640 1 -- 172.21.15.44:0/406705922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dbc004810 msgr2=0x7f0dbc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.505+0000 7f0dde000640 1 --2- 172.21.15.44:0/406705922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dbc004810 0x7f0dbc004c20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80cf6f0 tx=0x7f0dc001cea0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.509+0000 7f0dde000640 1 -- 172.21.15.44:0/406705922 shutdown_connections 2024-09-17T05:38:43.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.509+0000 7f0dde000640 1 --2- 172.21.15.44:0/406705922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dbc004810 0x7f0dbc004c20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.509+0000 7f0dde000640 1 -- 172.21.15.44:0/406705922 >> 172.21.15.44:0/406705922 conn(0x7f0dd80b35f0 msgr2=0x7f0dd80b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:43.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.509+0000 7f0dde000640 1 -- 172.21.15.44:0/406705922 shutdown_connections 2024-09-17T05:38:43.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.509+0000 7f0dde000640 1 -- 172.21.15.44:0/406705922 wait complete. 2024-09-17T05:38:43.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.509+0000 7f0dde000640 1 Processor -- start 2024-09-17T05:38:43.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.509+0000 7f0dde000640 1 -- start start 2024-09-17T05:38:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dbc004810 0x7f0dd81fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd8157400 0x7f0dd80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dd80b2450 0x7f0dd8147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd806d9e0 con 0x7f0dd8157400 2024-09-17T05:38:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd806d860 con 0x7f0dbc004810 2024-09-17T05:38:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd806db60 con 0x7f0dd80b2450 2024-09-17T05:38:43.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd8157400 0x7f0dd80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd8157400 0x7f0dd80b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57786/0 (socket says 172.21.15.44:57786) 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 -- 172.21.15.44:0/3597861534 learned_addr learned my addr 172.21.15.44:0/3597861534 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dd7400640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dbc004810 0x7f0dd81fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dd7e00640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dd80b2450 0x7f0dd8147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 -- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dd80b2450 msgr2=0x7f0dd8147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dd80b2450 0x7f0dd8147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 -- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dbc004810 msgr2=0x7f0dd81fd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dbc004810 0x7f0dd81fd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:43.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 -- 172.21.15.44:0/3597861534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd80d0800 con 0x7f0dd8157400 2024-09-17T05:38:43.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcea00640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd8157400 0x7f0dd80b1f10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0098960 tx=0x7f0dc0006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:43.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcfe00640 1 -- 172.21.15.44:0/3597861534 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00015a0 con 0x7f0dd8157400 2024-09-17T05:38:43.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcfe00640 1 -- 172.21.15.44:0/3597861534 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dc0006280 con 0x7f0dd8157400 2024-09-17T05:38:43.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd81fd7b0 con 0x7f0dd8157400 2024-09-17T05:38:43.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dcfe00640 1 -- 172.21.15.44:0/3597861534 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0003620 con 0x7f0dd8157400 2024-09-17T05:38:43.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd81f9650 con 0x7f0dd8157400 2024-09-17T05:38:43.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.513+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd8073970 con 0x7f0dd8157400 2024-09-17T05:38:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.517+0000 7f0dcfe00640 1 -- 172.21.15.44:0/3597861534 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0dc00037c0 con 0x7f0dd8157400 2024-09-17T05:38:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.517+0000 7f0dcfe00640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0db4073230 0x7f0db4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.517+0000 7f0dcfe00640 1 -- 172.21.15.44:0/3597861534 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f0dc012e210 con 0x7f0dd8157400 2024-09-17T05:38:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.517+0000 7f0dd7400640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0db4073230 0x7f0db4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:43.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.517+0000 7f0dd7400640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0db4073230 0x7f0db4075740 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000c10 tx=0x7f0dc8006b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:43.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.521+0000 7f0dcfe00640 1 -- 172.21.15.44:0/3597861534 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0dd81fd7b0 con 0x7f0dd8157400 2024-09-17T05:38:43.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:43.697+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0dd81598e0 con 0x7f0dd8157400 2024-09-17T05:38:44.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.529+0000 7f0dcfe00640 1 -- 172.21.15.44:0/3597861534 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) ==== 138+0+0 (secure 0 0 0) 0x7f0dc00bf060 con 0x7f0dd8157400 2024-09-17T05:38:44.531 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0db4073230 msgr2=0x7f0db4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0db4073230 0x7f0db4075740 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8000c10 tx=0x7f0dc8006b80 comp rx=0 tx=0).stop 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd8157400 msgr2=0x7f0dd80b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd8157400 0x7f0dd80b1f10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0098960 tx=0x7f0dc0006d30 comp rx=0 tx=0).stop 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 shutdown_connections 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0dd80b2450 0x7f0dd8147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0dd8157400 0x7f0dd80b1f10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0db4073230 0x7f0db4075740 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 --2- 172.21.15.44:0/3597861534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dbc004810 0x7f0dd81fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 >> 172.21.15.44:0/3597861534 conn(0x7f0dd80b35f0 msgr2=0x7f0dd80af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 shutdown_connections 2024-09-17T05:38:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.533+0000 7f0dde000640 1 -- 172.21.15.44:0/3597861534 wait complete. 2024-09-17T05:38:44.563 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 -- 172.21.15.44:0/3015256975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0cf780 msgr2=0x7fafec15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 --2- 172.21.15.44:0/3015256975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0cf780 0x7fafec15d060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009bc0 tx=0x7fafe401cae0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 -- 172.21.15.44:0/3015256975 shutdown_connections 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 --2- 172.21.15.44:0/3015256975 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0cf780 0x7fafec15d060 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 --2- 172.21.15.44:0/3015256975 >> v2:172.21.15.86:3300/0 conn(0x7fafec0d18f0 0x7fafec0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 -- 172.21.15.44:0/3015256975 >> 172.21.15.44:0/3015256975 conn(0x7fafec0b4240 msgr2=0x7fafec0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 -- 172.21.15.44:0/3015256975 shutdown_connections 2024-09-17T05:38:44.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 -- 172.21.15.44:0/3015256975 wait complete. 2024-09-17T05:38:44.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 Processor -- start 2024-09-17T05:38:44.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.733+0000 7faff0c00640 1 -- start start 2024-09-17T05:38:44.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafec0d18f0 0x7fafec1f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:44.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0d1d00 0x7fafec166a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:44.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafec1583f0 0x7fafec158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:44.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fafec169e80 con 0x7fafec0d18f0 2024-09-17T05:38:44.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fafec169d00 con 0x7fafec1583f0 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fafec16a000 con 0x7fafec0d1d00 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafec0d18f0 0x7fafec1f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafec0d18f0 0x7fafec1f9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57796/0 (socket says 172.21.15.44:57796) 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 -- 172.21.15.44:0/3783042452 learned_addr learned my addr 172.21.15.44:0/3783042452 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe3e00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0d1d00 0x7fafec166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafea800640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafec1583f0 0x7fafec158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 -- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0d1d00 msgr2=0x7fafec166a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0d1d00 0x7fafec166a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 -- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafec1583f0 msgr2=0x7fafec158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafec1583f0 0x7fafec158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 -- 172.21.15.44:0/3783042452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec1f9dc0 con 0x7fafec0d18f0 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe3e00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0d1d00 0x7fafec166a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafea800640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafec1583f0 0x7fafec158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:44.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe9e00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafec0d18f0 0x7fafec1f9880 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e7c0 tx=0x7fafdc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:44.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe2000640 1 -- 172.21.15.44:0/3783042452 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc00ccc0 con 0x7fafec0d18f0 2024-09-17T05:38:44.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe2000640 1 -- 172.21.15.44:0/3783042452 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafdc00ce80 con 0x7fafec0d18f0 2024-09-17T05:38:44.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafec166f90 con 0x7fafec0d18f0 2024-09-17T05:38:44.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7fafe2000640 1 -- 172.21.15.44:0/3783042452 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc005280 con 0x7fafec0d18f0 2024-09-17T05:38:44.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafec157910 con 0x7fafec0d18f0 2024-09-17T05:38:44.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.737+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafec15d060 con 0x7fafec0d18f0 2024-09-17T05:38:44.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.741+0000 7fafe2000640 1 -- 172.21.15.44:0/3783042452 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fafdc005420 con 0x7fafec0d18f0 2024-09-17T05:38:44.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.741+0000 7fafe2000640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fafc8073200 0x7fafc8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:44.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.741+0000 7fafe2000640 1 -- 172.21.15.44:0/3783042452 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5619+0+0 (secure 0 0 0) 0x7fafdc095130 con 0x7fafec0d18f0 2024-09-17T05:38:44.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.741+0000 7fafe3e00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fafc8073200 0x7fafc8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:44.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.741+0000 7fafe3e00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fafc8073200 0x7fafc8075710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafd4007a00 tx=0x7fafd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:44.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.745+0000 7fafe2000640 1 -- 172.21.15.44:0/3783042452 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fafec1f9dc0 con 0x7fafec0d18f0 2024-09-17T05:38:44.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:44.921+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fafec0cce00 con 0x7fafec0d18f0 2024-09-17T05:38:45.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.533+0000 7fafe2000640 1 -- 172.21.15.44:0/3783042452 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) ==== 170+0+0 (secure 0 0 0) 0x7fafdc060180 con 0x7fafec0d18f0 2024-09-17T05:38:45.534 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:38:45.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fafc8073200 msgr2=0x7fafc8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:45.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fafc8073200 0x7fafc8075710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fafd4007a00 tx=0x7fafd4009040 comp rx=0 tx=0).stop 2024-09-17T05:38:45.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafec0d18f0 msgr2=0x7fafec1f9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:45.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafec0d18f0 0x7fafec1f9880 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00e7c0 tx=0x7fafdc00ec80 comp rx=0 tx=0).stop 2024-09-17T05:38:45.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 shutdown_connections 2024-09-17T05:38:45.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fafc8073200 0x7fafc8075710 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafec1583f0 0x7fafec158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fafec0d1d00 0x7fafec166a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 --2- 172.21.15.44:0/3783042452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafec0d18f0 0x7fafec1f9880 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 >> 172.21.15.44:0/3783042452 conn(0x7fafec0b4240 msgr2=0x7fafec070400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:45.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 shutdown_connections 2024-09-17T05:38:45.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.537+0000 7faff0c00640 1 -- 172.21.15.44:0/3783042452 wait complete. 2024-09-17T05:38:45.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:38:45.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 -- 172.21.15.44:0/2549187451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 msgr2=0x7f8bf8072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:45.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 --2- 172.21.15.44:0/2549187451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 0x7f8bf8072e50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009900 tx=0x7f8be801f0d0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 -- 172.21.15.44:0/2549187451 shutdown_connections 2024-09-17T05:38:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 --2- 172.21.15.44:0/2549187451 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8bf806e560 0x7f8bf80ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 --2- 172.21.15.44:0/2549187451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 0x7f8bf8072e50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 -- 172.21.15.44:0/2549187451 >> 172.21.15.44:0/2549187451 conn(0x7f8bf80ccaa0 msgr2=0x7f8bf80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 -- 172.21.15.44:0/2549187451 shutdown_connections 2024-09-17T05:38:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.741+0000 7f8bfd600640 1 -- 172.21.15.44:0/2549187451 wait complete. 2024-09-17T05:38:45.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 Processor -- start 2024-09-17T05:38:45.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 -- start start 2024-09-17T05:38:45.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf80cef20 0x7f8bf80b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:45.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 0x7f8bf81f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:45.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8bf81f4430 0x7f8bf81f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:45.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf80ce950 con 0x7f8bf80cfa40 2024-09-17T05:38:45.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf80ce7d0 con 0x7f8bf80cef20 2024-09-17T05:38:45.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.745+0000 7f8bfd600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf80cead0 con 0x7f8bf81f4430 2024-09-17T05:38:45.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bf6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf80cef20 0x7f8bf80b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:45.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8befe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 0x7f8bf81f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:45.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bf6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf80cef20 0x7f8bf80b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:57230/0 (socket says 172.21.15.44:57230) 2024-09-17T05:38:45.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bf6a00640 1 -- 172.21.15.44:0/1963467168 learned_addr learned my addr 172.21.15.44:0/1963467168 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:45.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bf7400640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8bf81f4430 0x7f8bf81f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:45.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8befe00640 1 -- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8bf81f4430 msgr2=0x7f8bf81f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:45.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8befe00640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8bf81f4430 0x7f8bf81f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8befe00640 1 -- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf80cef20 msgr2=0x7f8bf80b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:45.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8befe00640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf80cef20 0x7f8bf80b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:45.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8befe00640 1 -- 172.21.15.44:0/1963467168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf80b5390 con 0x7f8bf80cfa40 2024-09-17T05:38:45.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bf6a00640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf80cef20 0x7f8bf80b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:38:45.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8befe00640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 0x7f8bf81f6030 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8be000b410 tx=0x7f8be000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:45.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8beea00640 1 -- 172.21.15.44:0/1963467168 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0015030 con 0x7f8bf80cfa40 2024-09-17T05:38:45.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8beea00640 1 -- 172.21.15.44:0/1963467168 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8be0004020 con 0x7f8bf80cfa40 2024-09-17T05:38:45.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf80c3ff0 con 0x7f8bf80cfa40 2024-09-17T05:38:45.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8beea00640 1 -- 172.21.15.44:0/1963467168 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0004470 con 0x7f8bf80cfa40 2024-09-17T05:38:45.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf80c45b0 con 0x7f8bf80cfa40 2024-09-17T05:38:45.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.749+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf80b5100 con 0x7f8bf80cfa40 2024-09-17T05:38:45.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.753+0000 7f8beea00640 1 -- 172.21.15.44:0/1963467168 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8be0018070 con 0x7f8bf80cfa40 2024-09-17T05:38:45.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.753+0000 7f8beea00640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8bd4073200 0x7f8bd4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:45.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.753+0000 7f8beea00640 1 -- 172.21.15.44:0/1963467168 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6001+0+0 (secure 0 0 0) 0x7f8be0093fe0 con 0x7f8bf80cfa40 2024-09-17T05:38:45.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.753+0000 7f8bf6a00640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8bd4073200 0x7f8bd4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:45.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.753+0000 7f8bf6a00640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8bd4073200 0x7f8bd4075710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8be801ef00 tx=0x7f8be801d910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:45.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.757+0000 7f8beea00640 1 -- 172.21.15.44:0/1963467168 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8be005e9f0 con 0x7f8bf80cfa40 2024-09-17T05:38:45.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:45.969+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8bf80ce080 con 0x7f8bf80cfa40 2024-09-17T05:38:46.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.565+0000 7f8beea00640 1 -- 172.21.15.44:0/1963467168 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v31) ==== 173+0+0 (secure 0 0 0) 0x7f8be0063420 con 0x7f8bf80cfa40 2024-09-17T05:38:46.574 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 9 and data pool 10 2024-09-17T05:38:46.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8bd4073200 msgr2=0x7f8bd4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:46.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8bd4073200 0x7f8bd4075710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8be801ef00 tx=0x7f8be801d910 comp rx=0 tx=0).stop 2024-09-17T05:38:46.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 msgr2=0x7f8bf81f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:46.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 0x7f8bf81f6030 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8be000b410 tx=0x7f8be000b8d0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 shutdown_connections 2024-09-17T05:38:46.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8bf81f4430 0x7f8bf81f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8bf80cfa40 0x7f8bf81f6030 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8bd4073200 0x7f8bd4075710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 --2- 172.21.15.44:0/1963467168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf80cef20 0x7f8bf80b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.589+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 >> 172.21.15.44:0/1963467168 conn(0x7f8bf80ccaa0 msgr2=0x7f8bf806ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.593+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 shutdown_connections 2024-09-17T05:38:46.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.593+0000 7f8bfd600640 1 -- 172.21.15.44:0/1963467168 wait complete. 2024-09-17T05:38:46.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:38:46.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 -- 172.21.15.44:0/1431133823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc00cf400 msgr2=0x7f8dc006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:46.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/1431133823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc00cf400 0x7f8dc006e160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00cffa0 tx=0x7f8da801c6a0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 -- 172.21.15.44:0/1431133823 shutdown_connections 2024-09-17T05:38:46.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/1431133823 >> v2:172.21.15.86:3300/0 conn(0x7f8dc015f0e0 0x7f8dc015f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/1431133823 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc00cf400 0x7f8dc006e160 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 -- 172.21.15.44:0/1431133823 >> 172.21.15.44:0/1431133823 conn(0x7f8dc00d1120 msgr2=0x7f8dc00d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:46.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 -- 172.21.15.44:0/1431133823 shutdown_connections 2024-09-17T05:38:46.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 -- 172.21.15.44:0/1431133823 wait complete. 2024-09-17T05:38:46.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 Processor -- start 2024-09-17T05:38:46.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.785+0000 7f8dc4c00640 1 -- start start 2024-09-17T05:38:46.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc0072190 0x7f8dc0147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dc015f0e0 0x7f8dc015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc00c4c30 0x7f8dc00c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc0168df0 con 0x7f8dc00c4c30 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc0168c70 con 0x7f8dc015f0e0 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc0168f70 con 0x7f8dc0072190 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc00c4c30 0x7f8dc00c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc00c4c30 0x7f8dc00c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57818/0 (socket says 172.21.15.44:57818) 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 -- 172.21.15.44:0/3980683377 learned_addr learned my addr 172.21.15.44:0/3980683377 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8db5400640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dc015f0e0 0x7f8dc015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbde00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc0072190 0x7f8dc0147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:46.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 -- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc0072190 msgr2=0x7f8dc0147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:46.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc0072190 0x7f8dc0147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 -- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dc015f0e0 msgr2=0x7f8dc015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:46.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dc015f0e0 0x7f8dc015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 -- 172.21.15.44:0/3980683377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc00c5580 con 0x7f8dc00c4c30 2024-09-17T05:38:46.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dbe800640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc00c4c30 0x7f8dc00c5040 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8db800eab0 tx=0x7f8db8009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:46.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8db6a00640 1 -- 172.21.15.44:0/3980683377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db800ce40 con 0x7f8dc00c4c30 2024-09-17T05:38:46.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8db6a00640 1 -- 172.21.15.44:0/3980683377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8db8004c20 con 0x7f8dc00c4c30 2024-09-17T05:38:46.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc00b0a80 con 0x7f8dc00c4c30 2024-09-17T05:38:46.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8db6a00640 1 -- 172.21.15.44:0/3980683377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8005020 con 0x7f8dc00c4c30 2024-09-17T05:38:46.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc00b1260 con 0x7f8dc00c4c30 2024-09-17T05:38:46.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.789+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc00b0cf0 con 0x7f8dc00c4c30 2024-09-17T05:38:46.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.793+0000 7f8db6a00640 1 -- 172.21.15.44:0/3980683377 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8db80051e0 con 0x7f8dc00c4c30 2024-09-17T05:38:46.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.793+0000 7f8db6a00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8d9c073200 0x7f8d9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:46.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.793+0000 7f8db6a00640 1 -- 172.21.15.44:0/3980683377 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f8db8094fe0 con 0x7f8dc00c4c30 2024-09-17T05:38:46.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.793+0000 7f8dbde00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8d9c073200 0x7f8d9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:46.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.793+0000 7f8dbde00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8d9c073200 0x7f8d9c075710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8db0001720 tx=0x7f8db0007c70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:46.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.797+0000 7f8db6a00640 1 -- 172.21.15.44:0/3980683377 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8dc00c5580 con 0x7f8dc00c4c30 2024-09-17T05:38:46.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.969+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dc006e160 con 0x7f8dc00c4c30 2024-09-17T05:38:46.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8db6a00640 1 -- 172.21.15.44:0/3980683377 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16957 (secure 0 0 0) 0x7f8db805f900 con 0x7f8dc00c4c30 2024-09-17T05:38:46.973 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:46.974 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":63,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:38:45.974858+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:38:43.712216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T05:38:44.935418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8d9c073200 msgr2=0x7f8d9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8d9c073200 0x7f8d9c075710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8db0001720 tx=0x7f8db0007c70 comp rx=0 tx=0).stop 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc00c4c30 msgr2=0x7f8dc00c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc00c4c30 0x7f8dc00c5040 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8db800eab0 tx=0x7f8db8009f70 comp rx=0 tx=0).stop 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 shutdown_connections 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc00c4c30 0x7f8dc00c5040 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8d9c073200 0x7f8d9c075710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dc015f0e0 0x7f8dc015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 --2- 172.21.15.44:0/3980683377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8dc0072190 0x7f8dc0147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:46.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 >> 172.21.15.44:0/3980683377 conn(0x7f8dc00d1120 msgr2=0x7f8dc006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:46.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 shutdown_connections 2024-09-17T05:38:46.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:46.973+0000 7f8dc4c00640 1 -- 172.21.15.44:0/3980683377 wait complete. 2024-09-17T05:38:46.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:38:47.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 -- 172.21.15.44:0/2315013107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c00cac30 msgr2=0x7fc7c00cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/2315013107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c00cac30 0x7fc7c00cec50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8009840 tx=0x7fc7a801c820 comp rx=0 tx=0).stop 2024-09-17T05:38:47.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 -- 172.21.15.44:0/2315013107 shutdown_connections 2024-09-17T05:38:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/2315013107 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c00cb040 0x7fc7c00cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/2315013107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c00cac30 0x7fc7c00cec50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 -- 172.21.15.44:0/2315013107 >> 172.21.15.44:0/2315013107 conn(0x7fc7c00ccaa0 msgr2=0x7fc7c00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 -- 172.21.15.44:0/2315013107 shutdown_connections 2024-09-17T05:38:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.153+0000 7fc7c5e00640 1 -- 172.21.15.44:0/2315013107 wait complete. 2024-09-17T05:38:47.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 Processor -- start 2024-09-17T05:38:47.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 -- start start 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c00cac30 0x7fc7c015c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c00cb040 0x7fc7c00a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c015be30 0x7fc7c0156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c0168d20 con 0x7fc7c00cb040 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c0168ba0 con 0x7fc7c015be30 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c0168ea0 con 0x7fc7c00cac30 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c00cb040 0x7fc7c00a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c00cb040 0x7fc7c00a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57832/0 (socket says 172.21.15.44:57832) 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 -- 172.21.15.44:0/95362683 learned_addr learned my addr 172.21.15.44:0/95362683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7bea00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c00cac30 0x7fc7c015c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7bf400640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c015be30 0x7fc7c0156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 -- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c00cac30 msgr2=0x7fc7c015c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c00cac30 0x7fc7c015c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 -- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c015be30 msgr2=0x7fc7c0156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c015be30 0x7fc7c0156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 -- 172.21.15.44:0/95362683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c009b8f0 con 0x7fc7c00cb040 2024-09-17T05:38:47.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c00cb040 0x7fc7c00a0780 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc7a801aed0 tx=0x7fc7a80a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7400640 1 -- 172.21.15.44:0/95362683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004380 con 0x7fc7c00cb040 2024-09-17T05:38:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7400640 1 -- 172.21.15.44:0/95362683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7a8005070 con 0x7fc7c00cb040 2024-09-17T05:38:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7b7400640 1 -- 172.21.15.44:0/95362683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8005480 con 0x7fc7c00cb040 2024-09-17T05:38:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c009ad70 con 0x7fc7c00cb040 2024-09-17T05:38:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.157+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c009b330 con 0x7fc7c00cb040 2024-09-17T05:38:47.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.161+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c006de50 con 0x7fc7c00cb040 2024-09-17T05:38:47.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.161+0000 7fc7b7400640 1 -- 172.21.15.44:0/95362683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc7a80bf060 con 0x7fc7c00cb040 2024-09-17T05:38:47.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.161+0000 7fc7b7400640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc79c073200 0x7fc79c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.161+0000 7fc7b7400640 1 -- 172.21.15.44:0/95362683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fc7a812e110 con 0x7fc7c00cb040 2024-09-17T05:38:47.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.161+0000 7fc7bea00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc79c073200 0x7fc79c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.161+0000 7fc7bea00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc79c073200 0x7fc79c075710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007fd0 tx=0x7fc7b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:47.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.165+0000 7fc7b7400640 1 -- 172.21.15.44:0/95362683 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc7a8016410 con 0x7fc7c00cb040 2024-09-17T05:38:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.341+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7c0070c10 con 0x7fc7c00cb040 2024-09-17T05:38:47.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.341+0000 7fc7b7400640 1 -- 172.21.15.44:0/95362683 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16957 (secure 0 0 0) 0x7fc7a80f88b0 con 0x7fc7c00cb040 2024-09-17T05:38:47.343 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:47.343 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":63,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:38:45.974858+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:38:43.712216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T05:38:44.935418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:38:47.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc79c073200 msgr2=0x7fc79c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc79c073200 0x7fc79c075710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0007fd0 tx=0x7fc7b0009040 comp rx=0 tx=0).stop 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c00cb040 msgr2=0x7fc7c00a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c00cb040 0x7fc7c00a0780 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc7a801aed0 tx=0x7fc7a80a66d0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 shutdown_connections 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc79c073200 0x7fc79c075710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7c015be30 0x7fc7c0156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c00cb040 0x7fc7c00a0780 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 --2- 172.21.15.44:0/95362683 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7c00cac30 0x7fc7c015c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 >> 172.21.15.44:0/95362683 conn(0x7fc7c00ccaa0 msgr2=0x7fc7c01654f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 shutdown_connections 2024-09-17T05:38:47.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.345+0000 7fc7c5e00640 1 -- 172.21.15.44:0/95362683 wait complete. 2024-09-17T05:38:47.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.525+0000 7fc987800640 1 -- 172.21.15.44:0/1448108269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 msgr2=0x7fc968003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.525+0000 7fc987800640 1 --2- 172.21.15.44:0/1448108269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc968003ed0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc97400c310 tx=0x7fc97401cf20 comp rx=0 tx=0).stop 2024-09-17T05:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- 172.21.15.44:0/1448108269 shutdown_connections 2024-09-17T05:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 --2- 172.21.15.44:0/1448108269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc968003ed0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- 172.21.15.44:0/1448108269 >> 172.21.15.44:0/1448108269 conn(0x7fc9800ccaa0 msgr2=0x7fc9800cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- 172.21.15.44:0/1448108269 shutdown_connections 2024-09-17T05:38:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- 172.21.15.44:0/1448108269 wait complete. 2024-09-17T05:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 Processor -- start 2024-09-17T05:38:47.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- start start 2024-09-17T05:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc98009cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc98009b420 0x7fc9801f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc98009b830 0x7fc9801f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc980074770 con 0x7fc968003a60 2024-09-17T05:38:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9800745f0 con 0x7fc98009b420 2024-09-17T05:38:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.529+0000 7fc987800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc980071000 con 0x7fc98009b830 2024-09-17T05:38:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc98009cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc98009cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57854/0 (socket says 172.21.15.44:57854) 2024-09-17T05:38:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 -- 172.21.15.44:0/1416965990 learned_addr learned my addr 172.21.15.44:0/1416965990 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc985800640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc98009b830 0x7fc9801f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc97fe00640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc98009b420 0x7fc9801f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 -- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc98009b830 msgr2=0x7fc9801f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc98009b830 0x7fc9801f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 -- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc98009b420 msgr2=0x7fc9801f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc98009b420 0x7fc9801f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 -- 172.21.15.44:0/1416965990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9800b5ed0 con 0x7fc968003a60 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc984e00640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc98009cff0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc97401b620 tx=0x7fc974001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc97cc00640 1 -- 172.21.15.44:0/1416965990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974001700 con 0x7fc968003a60 2024-09-17T05:38:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc97cc00640 1 -- 172.21.15.44:0/1416965990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9740060d0 con 0x7fc968003a60 2024-09-17T05:38:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc97cc00640 1 -- 172.21.15.44:0/1416965990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974006500 con 0x7fc968003a60 2024-09-17T05:38:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98009bf50 con 0x7fc968003a60 2024-09-17T05:38:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98009c510 con 0x7fc968003a60 2024-09-17T05:38:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9800cdd60 con 0x7fc968003a60 2024-09-17T05:38:47.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.533+0000 7fc97cc00640 1 -- 172.21.15.44:0/1416965990 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9740a5c70 con 0x7fc968003a60 2024-09-17T05:38:47.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.537+0000 7fc97cc00640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc960073200 0x7fc960075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:47.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.537+0000 7fc97cc00640 1 -- 172.21.15.44:0/1416965990 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fc9740b4020 con 0x7fc968003a60 2024-09-17T05:38:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.537+0000 7fc97fe00640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc960073200 0x7fc960075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:47.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.537+0000 7fc97fe00640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc960073200 0x7fc960075710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc96c000c10 tx=0x7fc96c006b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:47.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.541+0000 7fc97cc00640 1 -- 172.21.15.44:0/1416965990 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc974016cd0 con 0x7fc968003a60 2024-09-17T05:38:47.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:47.753+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc9800afd60 con 0x7fc968003a60 2024-09-17T05:38:48.532 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:38:48.529+0000 7f2ab8600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:38:48.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.577+0000 7fc97cc00640 1 -- 172.21.15.44:0/1416965990 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7fc9740f8bc0 con 0x7fc968003a60 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc960073200 msgr2=0x7fc960075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc960073200 0x7fc960075710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc96c000c10 tx=0x7fc96c006b80 comp rx=0 tx=0).stop 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 msgr2=0x7fc98009cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc98009cff0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc97401b620 tx=0x7fc974001d00 comp rx=0 tx=0).stop 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 shutdown_connections 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc98009b830 0x7fc9801f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc960073200 0x7fc960075710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc98009b420 0x7fc9801f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:48.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 --2- 172.21.15.44:0/1416965990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc968003a60 0x7fc98009cff0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 >> 172.21.15.44:0/1416965990 conn(0x7fc9800ccaa0 msgr2=0x7fc9800cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 shutdown_connections 2024-09-17T05:38:48.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.581+0000 7fc987800640 1 -- 172.21.15.44:0/1416965990 wait complete. 2024-09-17T05:38:48.608 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:38:48.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:38:48.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 -- 172.21.15.44:0/4064908140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 msgr2=0x7f2ad0005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:48.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 --2- 172.21.15.44:0/4064908140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 0x7f2ad0005160 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0ca7d0 tx=0x7f2ae401d770 comp rx=0 tx=0).stop 2024-09-17T05:38:48.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2aeb200640 1 -- 172.21.15.44:0/4064908140 reap_dead start 2024-09-17T05:38:48.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 -- 172.21.15.44:0/4064908140 shutdown_connections 2024-09-17T05:38:48.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 -- 172.21.15.44:0/4064908140 >> 172.21.15.44:0/4064908140 conn(0x7f2aec0ccaa0 msgr2=0x7f2aec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:48.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 -- 172.21.15.44:0/4064908140 shutdown_connections 2024-09-17T05:38:48.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 -- 172.21.15.44:0/4064908140 wait complete. 2024-09-17T05:38:48.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 Processor -- start 2024-09-17T05:38:48.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.777+0000 7f2af1400640 1 -- start start 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 0x7f2aec1f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec1599b0 0x7f2aec1f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0c8ca0 0x7f2aec0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec0cbdc0 con 0x7f2ad0004d50 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec06e580 con 0x7f2aec1599b0 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec0cbf40 con 0x7f2aec0c8ca0 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 0x7f2aec1f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 0x7f2aec1f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57858/0 (socket says 172.21.15.44:57858) 2024-09-17T05:38:48.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 -- 172.21.15.44:0/1708305948 learned_addr learned my addr 172.21.15.44:0/1708305948 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aeb200640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0c8ca0 0x7f2aec0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2ae3e00640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec1599b0 0x7f2aec1f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 -- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0c8ca0 msgr2=0x7f2aec0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0c8ca0 0x7f2aec0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 -- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec1599b0 msgr2=0x7f2aec1f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec1599b0 0x7f2aec1f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 -- 172.21.15.44:0/1708305948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec0c95f0 con 0x7f2ad0004d50 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2aea800640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 0x7f2aec1f6d20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2adc004680 tx=0x7f2adc0127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1708305948 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc013860 con 0x7f2ad0004d50 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1708305948 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2adc013a00 con 0x7f2ad0004d50 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1708305948 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc013e10 con 0x7f2ad0004d50 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec0c7170 con 0x7f2ad0004d50 2024-09-17T05:38:48.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.781+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec0c7730 con 0x7f2ad0004d50 2024-09-17T05:38:48.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.785+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec0cc4d0 con 0x7f2ad0004d50 2024-09-17T05:38:48.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.785+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1708305948 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2adc010480 con 0x7f2ad0004d50 2024-09-17T05:38:48.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.785+0000 7f2ae2a00640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073230 0x7f2ac8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:48.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.785+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1708305948 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f2adc097fd0 con 0x7f2ad0004d50 2024-09-17T05:38:48.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.785+0000 7f2ae3e00640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073230 0x7f2ac8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:48.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.785+0000 7f2ae3e00640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073230 0x7f2ac8075740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06f340 tx=0x7f2ad40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:48.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:48.789+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1708305948 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2aec0c95f0 con 0x7f2ad0004d50 2024-09-17T05:38:49.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.001+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2aec0b5fa0 con 0x7f2ad0004d50 2024-09-17T05:38:49.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.581+0000 7f2ae2a00640 1 -- 172.21.15.44:0/1708305948 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7f2aec06e7a0 con 0x7f2ad0004d50 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073230 msgr2=0x7f2ac8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073230 0x7f2ac8075740 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06f340 tx=0x7f2ad40091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 msgr2=0x7f2aec1f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 0x7f2aec1f6d20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2adc004680 tx=0x7f2adc0127b0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 shutdown_connections 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2aec0c8ca0 0x7f2aec0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2ac8073230 0x7f2ac8075740 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2aec1599b0 0x7f2aec1f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 --2- 172.21.15.44:0/1708305948 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ad0004d50 0x7f2aec1f6d20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 >> 172.21.15.44:0/1708305948 conn(0x7f2aec0ccaa0 msgr2=0x7f2aec0b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 shutdown_connections 2024-09-17T05:38:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.585+0000 7f2af1400640 1 -- 172.21.15.44:0/1708305948 wait complete. 2024-09-17T05:38:49.611 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:38:49.611 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 -- 172.21.15.44:0/3010646699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf980cb470 msgr2=0x7fbf980cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3010646699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf980cb470 0x7fbf980cb880 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbf9806ace0 tx=0x7fbf9001ccf0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 -- 172.21.15.44:0/3010646699 shutdown_connections 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3010646699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf980cb470 0x7fbf980cb880 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3010646699 >> v2:172.21.15.86:3300/0 conn(0x7fbf98072e50 0x7fbf9815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 -- 172.21.15.44:0/3010646699 >> 172.21.15.44:0/3010646699 conn(0x7fbf980ccaa0 msgr2=0x7fbf980cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 -- 172.21.15.44:0/3010646699 shutdown_connections 2024-09-17T05:38:49.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 -- 172.21.15.44:0/3010646699 wait complete. 2024-09-17T05:38:49.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 Processor -- start 2024-09-17T05:38:49.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.773+0000 7fbf9f600640 1 -- start start 2024-09-17T05:38:49.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9806de50 0x7fbf980c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:49.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98072e50 0x7fbf980b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:49.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf980cb470 0x7fbf980b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:49.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98168f20 con 0x7fbf98072e50 2024-09-17T05:38:49.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98168da0 con 0x7fbf9806de50 2024-09-17T05:38:49.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbf981690a0 con 0x7fbf980cb470 2024-09-17T05:38:49.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98072e50 0x7fbf980b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:49.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98072e50 0x7fbf980b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35954/0 (socket says 172.21.15.44:35954) 2024-09-17T05:38:49.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 -- 172.21.15.44:0/3403250690 learned_addr learned my addr 172.21.15.44:0/3403250690 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:49.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9806de50 0x7fbf980c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9d600640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf980cb470 0x7fbf980b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 -- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf980cb470 msgr2=0x7fbf980b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf980cb470 0x7fbf980b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 -- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9806de50 msgr2=0x7fbf980c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9806de50 0x7fbf980c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:49.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 -- 172.21.15.44:0/3403250690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf981f9170 con 0x7fbf98072e50 2024-09-17T05:38:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf97e00640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98072e50 0x7fbf980b2e70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400b410 tx=0x7fbf8400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf94c00640 1 -- 172.21.15.44:0/3403250690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84015030 con 0x7fbf98072e50 2024-09-17T05:38:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf94c00640 1 -- 172.21.15.44:0/3403250690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf84004020 con 0x7fbf98072e50 2024-09-17T05:38:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf980c9d70 con 0x7fbf98072e50 2024-09-17T05:38:49.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf94c00640 1 -- 172.21.15.44:0/3403250690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840044b0 con 0x7fbf98072e50 2024-09-17T05:38:49.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981f96c0 con 0x7fbf98072e50 2024-09-17T05:38:49.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.777+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9815e990 con 0x7fbf98072e50 2024-09-17T05:38:49.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.781+0000 7fbf94c00640 1 -- 172.21.15.44:0/3403250690 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf84018070 con 0x7fbf98072e50 2024-09-17T05:38:49.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.781+0000 7fbf94c00640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf78073200 0x7fbf78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:49.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.781+0000 7fbf94c00640 1 -- 172.21.15.44:0/3403250690 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fbf84093da0 con 0x7fbf98072e50 2024-09-17T05:38:49.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.781+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf78073200 0x7fbf78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:49.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.781+0000 7fbf9cc00640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf78073200 0x7fbf78075710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00ab40 tx=0x7fbf8c00a250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:49.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:49.785+0000 7fbf94c00640 1 -- 172.21.15.44:0/3403250690 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbf8405e660 con 0x7fbf98072e50 2024-09-17T05:38:50.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf980b5fa0 con 0x7fbf98072e50 2024-09-17T05:38:50.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf94c00640 1 -- 172.21.15.44:0/3403250690 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5221 (secure 0 0 0) 0x7fbf84063090 con 0x7fbf98072e50 2024-09-17T05:38:50.001 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:50.001 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"btime":"2024-09-17T05:38:49:581927+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:38:49.006030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:38:50.002 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 35 2024-09-17T05:38:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf78073200 msgr2=0x7fbf78075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf78073200 0x7fbf78075710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00ab40 tx=0x7fbf8c00a250 comp rx=0 tx=0).stop 2024-09-17T05:38:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98072e50 msgr2=0x7fbf980b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98072e50 0x7fbf980b2e70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400b410 tx=0x7fbf8400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 shutdown_connections 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf980cb470 0x7fbf980b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf98072e50 0x7fbf980b2e70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf78073200 0x7fbf78075710 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 --2- 172.21.15.44:0/3403250690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf9806de50 0x7fbf980c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 >> 172.21.15.44:0/3403250690 conn(0x7fbf980ccaa0 msgr2=0x7fbf9806fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 shutdown_connections 2024-09-17T05:38:50.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.001+0000 7fbf9f600640 1 -- 172.21.15.44:0/3403250690 wait complete. 2024-09-17T05:38:50.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:38:50.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.181+0000 7fbc1d200640 1 -- 172.21.15.44:0/2411790355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 msgr2=0x7fbc180cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.181+0000 7fbc1d200640 1 --2- 172.21.15.44:0/2411790355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc180cf070 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009840 tx=0x7fbc0001c760 comp rx=0 tx=0).stop 2024-09-17T05:38:50.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.181+0000 7fbc1d200640 1 -- 172.21.15.44:0/2411790355 shutdown_connections 2024-09-17T05:38:50.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.181+0000 7fbc1d200640 1 --2- 172.21.15.44:0/2411790355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc180cf070 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.181+0000 7fbc1d200640 1 -- 172.21.15.44:0/2411790355 >> 172.21.15.44:0/2411790355 conn(0x7fbc180b4240 msgr2=0x7fbc180b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:50.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.181+0000 7fbc1d200640 1 -- 172.21.15.44:0/2411790355 shutdown_connections 2024-09-17T05:38:50.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.181+0000 7fbc1d200640 1 -- 172.21.15.44:0/2411790355 wait complete. 2024-09-17T05:38:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 Processor -- start 2024-09-17T05:38:50.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 -- start start 2024-09-17T05:38:50.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc180cf5b0 0x7fbc18152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc180d18f0 0x7fbc1806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc18156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1816b080 con 0x7fbc180d1d00 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1816af00 con 0x7fbc180cf5b0 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc1d200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1816b200 con 0x7fbc180d18f0 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc18156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc18156f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35968/0 (socket says 172.21.15.44:35968) 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 -- 172.21.15.44:0/1504517060 learned_addr learned my addr 172.21.15.44:0/1504517060 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc0fe00640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc180d18f0 0x7fbc1806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc15e00640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc180cf5b0 0x7fbc18152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 -- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc180d18f0 msgr2=0x7fbc1806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc180d18f0 0x7fbc1806efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 -- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc180cf5b0 msgr2=0x7fbc18152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc180cf5b0 0x7fbc18152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 -- 172.21.15.44:0/1504517060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc18157af0 con 0x7fbc180d1d00 2024-09-17T05:38:50.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.185+0000 7fbc16800640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc18156f80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c760 tx=0x7fbc1000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:50.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc0e000640 1 -- 172.21.15.44:0/1504517060 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10003db0 con 0x7fbc180d1d00 2024-09-17T05:38:50.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc18156780 con 0x7fbc180d1d00 2024-09-17T05:38:50.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc0e000640 1 -- 172.21.15.44:0/1504517060 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc1000ce10 con 0x7fbc180d1d00 2024-09-17T05:38:50.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc0e000640 1 -- 172.21.15.44:0/1504517060 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc100052d0 con 0x7fbc180d1d00 2024-09-17T05:38:50.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc18152e90 con 0x7fbc180d1d00 2024-09-17T05:38:50.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc181531c0 con 0x7fbc180d1d00 2024-09-17T05:38:50.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc0e000640 1 -- 172.21.15.44:0/1504517060 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbc10005470 con 0x7fbc180d1d00 2024-09-17T05:38:50.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc0e000640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbf4073200 0x7fbbf4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc0e000640 1 -- 172.21.15.44:0/1504517060 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fbc10093ff0 con 0x7fbc180d1d00 2024-09-17T05:38:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.189+0000 7fbc15e00640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbf4073200 0x7fbbf4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.193+0000 7fbc15e00640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbf4073200 0x7fbbf4075710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbc08007fd0 tx=0x7fbc08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:50.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.193+0000 7fbc0e000640 1 -- 172.21.15.44:0/1504517060 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbc181531c0 con 0x7fbc180d1d00 2024-09-17T05:38:50.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.369+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc180cf070 con 0x7fbc180d1d00 2024-09-17T05:38:50.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc0e000640 1 -- 172.21.15.44:0/1504517060 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16944 (secure 0 0 0) 0x7fbc180cf9c0 con 0x7fbc180d1d00 2024-09-17T05:38:50.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:50.374 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":64,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:38:47.555505+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:38:43.712216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T05:38:44.935418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:38:50.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbf4073200 msgr2=0x7fbbf4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbf4073200 0x7fbbf4075710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbc08007fd0 tx=0x7fbc08009040 comp rx=0 tx=0).stop 2024-09-17T05:38:50.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 msgr2=0x7fbc18156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc18156f80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbc1000c760 tx=0x7fbc1000cc20 comp rx=0 tx=0).stop 2024-09-17T05:38:50.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 shutdown_connections 2024-09-17T05:38:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc180d1d00 0x7fbc18156f80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbc180d18f0 0x7fbc1806efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbbf4073200 0x7fbbf4075710 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 --2- 172.21.15.44:0/1504517060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc180cf5b0 0x7fbc18152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 >> 172.21.15.44:0/1504517060 conn(0x7fbc180b4240 msgr2=0x7fbc1815ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 shutdown_connections 2024-09-17T05:38:50.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.373+0000 7fbc1d200640 1 -- 172.21.15.44:0/1504517060 wait complete. 2024-09-17T05:38:50.397 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:38:50.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 -- 172.21.15.44:0/3844817114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad806e560 msgr2=0x7f9ad8072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 --2- 172.21.15.44:0/3844817114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad806e560 0x7f9ad8072e50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009840 tx=0x7f9ac401f010 comp rx=0 tx=0).stop 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 -- 172.21.15.44:0/3844817114 shutdown_connections 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 --2- 172.21.15.44:0/3844817114 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ad80ce080 0x7f9ad80ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 --2- 172.21.15.44:0/3844817114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad806e560 0x7f9ad8072e50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 -- 172.21.15.44:0/3844817114 >> 172.21.15.44:0/3844817114 conn(0x7f9ad80ccaa0 msgr2=0x7f9ad80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 -- 172.21.15.44:0/3844817114 shutdown_connections 2024-09-17T05:38:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.553+0000 7f9adea00640 1 -- 172.21.15.44:0/3844817114 wait complete. 2024-09-17T05:38:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 Processor -- start 2024-09-17T05:38:50.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 -- start start 2024-09-17T05:38:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ad80ce080 0x7f9ad80b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad80cef20 0x7f9ad809fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad81f9200 0x7f9ad809aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad80cf7c0 con 0x7f9ad81f9200 2024-09-17T05:38:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad8071150 con 0x7f9ad80cef20 2024-09-17T05:38:50.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adea00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad80ce9d0 con 0x7f9ad80ce080 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad81f9200 0x7f9ad809aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad81f9200 0x7f9ad809aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35970/0 (socket says 172.21.15.44:35970) 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 -- 172.21.15.44:0/391972702 learned_addr learned my addr 172.21.15.44:0/391972702 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9ad7400640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad80cef20 0x7f9ad809fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9ad7e00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ad80ce080 0x7f9ad80b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 -- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ad80ce080 msgr2=0x7f9ad80b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ad80ce080 0x7f9ad80b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 -- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad80cef20 msgr2=0x7f9ad809fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad80cef20 0x7f9ad809fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.557+0000 7f9adca00640 1 -- 172.21.15.44:0/391972702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad80a0e90 con 0x7f9ad81f9200 2024-09-17T05:38:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9adca00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad81f9200 0x7f9ad809aee0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000ea80 tx=0x7f9ad000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:50.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9acfe00640 1 -- 172.21.15.44:0/391972702 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000cea0 con 0x7f9ad81f9200 2024-09-17T05:38:50.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9acfe00640 1 -- 172.21.15.44:0/391972702 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ad0004b30 con 0x7f9ad81f9200 2024-09-17T05:38:50.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad809f260 con 0x7f9ad81f9200 2024-09-17T05:38:50.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9acfe00640 1 -- 172.21.15.44:0/391972702 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0005020 con 0x7f9ad81f9200 2024-09-17T05:38:50.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad80a0b10 con 0x7f9ad81f9200 2024-09-17T05:38:50.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad809f050 con 0x7f9ad81f9200 2024-09-17T05:38:50.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9acfe00640 1 -- 172.21.15.44:0/391972702 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ad00051c0 con 0x7f9ad81f9200 2024-09-17T05:38:50.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9acfe00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ab8073230 0x7f9ab8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.561+0000 7f9acfe00640 1 -- 172.21.15.44:0/391972702 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f9ad0094fe0 con 0x7f9ad81f9200 2024-09-17T05:38:50.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.565+0000 7f9ad7e00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ab8073230 0x7f9ab8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.565+0000 7f9ad7e00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ab8073230 0x7f9ab8075740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8001870 tx=0x7f9ac8001380 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:50.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.569+0000 7f9acfe00640 1 -- 172.21.15.44:0/391972702 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9ad005f700 con 0x7f9ad81f9200 2024-09-17T05:38:50.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.737+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ad80a1170 con 0x7f9ab8073230 2024-09-17T05:38:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9acfe00640 1 -- 172.21.15.44:0/391972702 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247321 (secure 0 0 0) 0x7f9ad80a1170 con 0x7f9ab8073230 2024-09-17T05:38:50.747 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ab8073230 msgr2=0x7f9ab8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ab8073230 0x7f9ab8075740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8001870 tx=0x7f9ac8001380 comp rx=0 tx=0).stop 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad81f9200 msgr2=0x7f9ad809aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad81f9200 0x7f9ad809aee0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000ea80 tx=0x7f9ad000ef40 comp rx=0 tx=0).stop 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 shutdown_connections 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad81f9200 0x7f9ad809aee0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ab8073230 0x7f9ab8075740 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ad80cef20 0x7f9ad809fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 --2- 172.21.15.44:0/391972702 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ad80ce080 0x7f9ad80b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 >> 172.21.15.44:0/391972702 conn(0x7f9ad80ccaa0 msgr2=0x7f9ad80af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 shutdown_connections 2024-09-17T05:38:50.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.745+0000 7f9adea00640 1 -- 172.21.15.44:0/391972702 wait complete. 2024-09-17T05:38:50.769 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-17T05:38:50.298000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239816,"kb_used_data":6936,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734904,"statfs":{"total":773094113280,"available":772848541696,"internally_reserved":0,"allocated":7102464,"data_stored":3793251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762790"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.591698+0000","last_change":"2024-09-17T05:38:46.583715+0000","last_active":"2024-09-17T05:38:46.591698+0000","last_peered":"2024-09-17T05:38:46.591698+0000","last_clean":"2024-09-17T05:38:46.591698+0000","last_became_active":"2024-09-17T05:38:46.583363+0000","last_became_peered":"2024-09-17T05:38:46.583363+0000","last_unstale":"2024-09-17T05:38:46.591698+0000","last_undegraded":"2024-09-17T05:38:46.591698+0000","last_fullsized":"2024-09-17T05:38:46.591698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:09.088815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540090+0000","last_change":"2024-09-17T05:38:45.540090+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540090+0000","last_undegraded":"2024-09-17T05:38:45.540090+0000","last_fullsized":"2024-09-17T05:38:45.540090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541369+0000","last_change":"2024-09-17T05:38:45.541369+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541369+0000","last_undegraded":"2024-09-17T05:38:45.541369+0000","last_fullsized":"2024-09-17T05:38:45.541369+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.561517+0000","last_change":"2024-09-17T05:38:45.561517+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.561517+0000","last_undegraded":"2024-09-17T05:38:45.561517+0000","last_fullsized":"2024-09-17T05:38:45.561517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540381+0000","last_change":"2024-09-17T05:38:45.540381+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540381+0000","last_undegraded":"2024-09-17T05:38:45.540381+0000","last_fullsized":"2024-09-17T05:38:45.540381+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.542165+0000","last_change":"2024-09-17T05:38:45.542165+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.542165+0000","last_undegraded":"2024-09-17T05:38:45.542165+0000","last_fullsized":"2024-09-17T05:38:45.542165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.581278+0000","last_change":"2024-09-17T05:38:46.576539+0000","last_active":"2024-09-17T05:38:46.581278+0000","last_peered":"2024-09-17T05:38:46.581278+0000","last_clean":"2024-09-17T05:38:46.581278+0000","last_became_active":"2024-09-17T05:38:46.576080+0000","last_became_peered":"2024-09-17T05:38:46.576080+0000","last_unstale":"2024-09-17T05:38:46.581278+0000","last_undegraded":"2024-09-17T05:38:46.581278+0000","last_fullsized":"2024-09-17T05:38:46.581278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:47.968279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541085+0000","last_change":"2024-09-17T05:38:45.541085+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541085+0000","last_undegraded":"2024-09-17T05:38:45.541085+0000","last_fullsized":"2024-09-17T05:38:45.541085+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557612+0000","last_change":"2024-09-17T05:38:45.557612+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557612+0000","last_undegraded":"2024-09-17T05:38:45.557612+0000","last_fullsized":"2024-09-17T05:38:45.557612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553373+0000","last_change":"2024-09-17T05:38:45.553373+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553373+0000","last_undegraded":"2024-09-17T05:38:45.553373+0000","last_fullsized":"2024-09-17T05:38:45.553373+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557223+0000","last_change":"2024-09-17T05:38:45.557223+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557223+0000","last_undegraded":"2024-09-17T05:38:45.557223+0000","last_fullsized":"2024-09-17T05:38:45.557223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.560998+0000","last_change":"2024-09-17T05:38:45.560998+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.560998+0000","last_undegraded":"2024-09-17T05:38:45.560998+0000","last_fullsized":"2024-09-17T05:38:45.560998+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.547150+0000","last_change":"2024-09-17T05:38:45.547150+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.547150+0000","last_undegraded":"2024-09-17T05:38:45.547150+0000","last_fullsized":"2024-09-17T05:38:45.547150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546009+0000","last_change":"2024-09-17T05:38:45.546009+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546009+0000","last_undegraded":"2024-09-17T05:38:45.546009+0000","last_fullsized":"2024-09-17T05:38:45.546009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551156+0000","last_change":"2024-09-17T05:38:45.551156+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551156+0000","last_undegraded":"2024-09-17T05:38:45.551156+0000","last_fullsized":"2024-09-17T05:38:45.551156+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553341+0000","last_change":"2024-09-17T05:38:45.553341+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553341+0000","last_undegraded":"2024-09-17T05:38:45.553341+0000","last_fullsized":"2024-09-17T05:38:45.553341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549405+0000","last_change":"2024-09-17T05:38:45.549405+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549405+0000","last_undegraded":"2024-09-17T05:38:45.549405+0000","last_fullsized":"2024-09-17T05:38:45.549405+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557292+0000","last_change":"2024-09-17T05:38:45.557292+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557292+0000","last_undegraded":"2024-09-17T05:38:45.557292+0000","last_fullsized":"2024-09-17T05:38:45.557292+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.556678+0000","last_change":"2024-09-17T05:38:45.556678+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.556678+0000","last_undegraded":"2024-09-17T05:38:45.556678+0000","last_fullsized":"2024-09-17T05:38:45.556678+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550992+0000","last_change":"2024-09-17T05:38:45.550992+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550992+0000","last_undegraded":"2024-09-17T05:38:45.550992+0000","last_fullsized":"2024-09-17T05:38:45.550992+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546542+0000","last_change":"2024-09-17T05:38:45.546542+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546542+0000","last_undegraded":"2024-09-17T05:38:45.546542+0000","last_fullsized":"2024-09-17T05:38:45.546542+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.539466+0000","last_change":"2024-09-17T05:38:45.539466+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.539466+0000","last_undegraded":"2024-09-17T05:38:45.539466+0000","last_fullsized":"2024-09-17T05:38:45.539466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552745+0000","last_change":"2024-09-17T05:38:45.552745+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552745+0000","last_undegraded":"2024-09-17T05:38:45.552745+0000","last_fullsized":"2024-09-17T05:38:45.552745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540510+0000","last_change":"2024-09-17T05:38:45.540510+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540510+0000","last_undegraded":"2024-09-17T05:38:45.540510+0000","last_fullsized":"2024-09-17T05:38:45.540510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549820+0000","last_change":"2024-09-17T05:38:45.549820+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549820+0000","last_undegraded":"2024-09-17T05:38:45.549820+0000","last_fullsized":"2024-09-17T05:38:45.549820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541657+0000","last_change":"2024-09-17T05:38:45.541657+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541657+0000","last_undegraded":"2024-09-17T05:38:45.541657+0000","last_fullsized":"2024-09-17T05:38:45.541657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548456+0000","last_change":"2024-09-17T05:38:45.548456+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548456+0000","last_undegraded":"2024-09-17T05:38:45.548456+0000","last_fullsized":"2024-09-17T05:38:45.548456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575662+0000","last_change":"2024-09-17T05:38:46.566215+0000","last_active":"2024-09-17T05:38:46.575662+0000","last_peered":"2024-09-17T05:38:46.575662+0000","last_clean":"2024-09-17T05:38:46.575662+0000","last_became_active":"2024-09-17T05:38:46.565932+0000","last_became_peered":"2024-09-17T05:38:46.565932+0000","last_unstale":"2024-09-17T05:38:46.575662+0000","last_undegraded":"2024-09-17T05:38:46.575662+0000","last_fullsized":"2024-09-17T05:38:46.575662+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:55.360415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.555583+0000","last_change":"2024-09-17T05:38:45.555583+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.555583+0000","last_undegraded":"2024-09-17T05:38:45.555583+0000","last_fullsized":"2024-09-17T05:38:45.555583+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553798+0000","last_change":"2024-09-17T05:38:45.553798+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553798+0000","last_undegraded":"2024-09-17T05:38:45.553798+0000","last_fullsized":"2024-09-17T05:38:45.553798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540370+0000","last_change":"2024-09-17T05:38:45.540370+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540370+0000","last_undegraded":"2024-09-17T05:38:45.540370+0000","last_fullsized":"2024-09-17T05:38:45.540370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592100+0000","last_change":"2024-09-17T05:38:46.581873+0000","last_active":"2024-09-17T05:38:46.592100+0000","last_peered":"2024-09-17T05:38:46.592100+0000","last_clean":"2024-09-17T05:38:46.592100+0000","last_became_active":"2024-09-17T05:38:46.581393+0000","last_became_peered":"2024-09-17T05:38:46.581393+0000","last_unstale":"2024-09-17T05:38:46.592100+0000","last_undegraded":"2024-09-17T05:38:46.592100+0000","last_fullsized":"2024-09-17T05:38:46.592100+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:50.725323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550985+0000","last_change":"2024-09-17T05:38:45.550985+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550985+0000","last_undegraded":"2024-09-17T05:38:45.550985+0000","last_fullsized":"2024-09-17T05:38:45.550985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.602119+0000","last_change":"2024-09-17T05:38:45.557221+0000","last_active":"2024-09-17T05:38:46.602119+0000","last_peered":"2024-09-17T05:38:46.602119+0000","last_clean":"2024-09-17T05:38:46.602119+0000","last_became_active":"2024-09-17T05:38:45.556870+0000","last_became_peered":"2024-09-17T05:38:45.556870+0000","last_unstale":"2024-09-17T05:38:46.602119+0000","last_undegraded":"2024-09-17T05:38:46.602119+0000","last_fullsized":"2024-09-17T05:38:46.602119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:15.758423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540875+0000","last_change":"2024-09-17T05:38:45.540875+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540875+0000","last_undegraded":"2024-09-17T05:38:45.540875+0000","last_fullsized":"2024-09-17T05:38:45.540875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.601073+0000","last_change":"2024-09-17T05:38:45.566302+0000","last_active":"2024-09-17T05:38:46.601073+0000","last_peered":"2024-09-17T05:38:46.601073+0000","last_clean":"2024-09-17T05:38:46.601073+0000","last_became_active":"2024-09-17T05:38:45.565920+0000","last_became_peered":"2024-09-17T05:38:45.565920+0000","last_unstale":"2024-09-17T05:38:46.601073+0000","last_undegraded":"2024-09-17T05:38:46.601073+0000","last_fullsized":"2024-09-17T05:38:46.601073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:15.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.539550+0000","last_change":"2024-09-17T05:38:45.539550+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.539550+0000","last_undegraded":"2024-09-17T05:38:45.539550+0000","last_fullsized":"2024-09-17T05:38:45.539550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.599298+0000","last_change":"2024-09-17T05:38:45.563577+0000","last_active":"2024-09-17T05:38:46.599298+0000","last_peered":"2024-09-17T05:38:46.599298+0000","last_clean":"2024-09-17T05:38:46.599298+0000","last_became_active":"2024-09-17T05:38:45.563266+0000","last_became_peered":"2024-09-17T05:38:45.563266+0000","last_unstale":"2024-09-17T05:38:46.599298+0000","last_undegraded":"2024-09-17T05:38:46.599298+0000","last_fullsized":"2024-09-17T05:38:46.599298+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:24.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550672+0000","last_change":"2024-09-17T05:38:45.550672+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550672+0000","last_undegraded":"2024-09-17T05:38:45.550672+0000","last_fullsized":"2024-09-17T05:38:45.550672+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562107+0000","last_change":"2024-09-17T05:38:45.556629+0000","last_active":"2024-09-17T05:38:45.562107+0000","last_peered":"2024-09-17T05:38:45.562107+0000","last_clean":"2024-09-17T05:38:45.562107+0000","last_became_active":"2024-09-17T05:38:45.556195+0000","last_became_peered":"2024-09-17T05:38:45.556195+0000","last_unstale":"2024-09-17T05:38:45.562107+0000","last_undegraded":"2024-09-17T05:38:45.562107+0000","last_fullsized":"2024-09-17T05:38:45.562107+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:47.232389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550178+0000","last_change":"2024-09-17T05:38:45.550178+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550178+0000","last_undegraded":"2024-09-17T05:38:45.550178+0000","last_fullsized":"2024-09-17T05:38:45.550178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568240+0000","last_change":"2024-09-17T05:38:45.565943+0000","last_active":"2024-09-17T05:38:45.568240+0000","last_peered":"2024-09-17T05:38:45.568240+0000","last_clean":"2024-09-17T05:38:45.568240+0000","last_became_active":"2024-09-17T05:38:45.565559+0000","last_became_peered":"2024-09-17T05:38:45.565559+0000","last_unstale":"2024-09-17T05:38:45.568240+0000","last_undegraded":"2024-09-17T05:38:45.568240+0000","last_fullsized":"2024-09-17T05:38:45.568240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:48.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.574340+0000","last_change":"2024-09-17T05:38:46.566137+0000","last_active":"2024-09-17T05:38:46.574340+0000","last_peered":"2024-09-17T05:38:46.574340+0000","last_clean":"2024-09-17T05:38:46.574340+0000","last_became_active":"2024-09-17T05:38:46.565806+0000","last_became_peered":"2024-09-17T05:38:46.565806+0000","last_unstale":"2024-09-17T05:38:46.574340+0000","last_undegraded":"2024-09-17T05:38:46.574340+0000","last_fullsized":"2024-09-17T05:38:46.574340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:13.028402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568900+0000","last_change":"2024-09-17T05:38:45.564188+0000","last_active":"2024-09-17T05:38:45.568900+0000","last_peered":"2024-09-17T05:38:45.568900+0000","last_clean":"2024-09-17T05:38:45.568900+0000","last_became_active":"2024-09-17T05:38:45.562211+0000","last_became_peered":"2024-09-17T05:38:45.562211+0000","last_unstale":"2024-09-17T05:38:45.568900+0000","last_undegraded":"2024-09-17T05:38:45.568900+0000","last_fullsized":"2024-09-17T05:38:45.568900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:24.997155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551140+0000","last_change":"2024-09-17T05:38:45.551140+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551140+0000","last_undegraded":"2024-09-17T05:38:45.551140+0000","last_fullsized":"2024-09-17T05:38:45.551140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562074+0000","last_change":"2024-09-17T05:38:45.558292+0000","last_active":"2024-09-17T05:38:46.562074+0000","last_peered":"2024-09-17T05:38:46.562074+0000","last_clean":"2024-09-17T05:38:46.562074+0000","last_became_active":"2024-09-17T05:38:45.557924+0000","last_became_peered":"2024-09-17T05:38:45.557924+0000","last_unstale":"2024-09-17T05:38:46.562074+0000","last_undegraded":"2024-09-17T05:38:46.562074+0000","last_fullsized":"2024-09-17T05:38:46.562074+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:11.908735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552591+0000","last_change":"2024-09-17T05:38:45.552591+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552591+0000","last_undegraded":"2024-09-17T05:38:45.552591+0000","last_fullsized":"2024-09-17T05:38:45.552591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570614+0000","last_change":"2024-09-17T05:38:45.566557+0000","last_active":"2024-09-17T05:38:45.570614+0000","last_peered":"2024-09-17T05:38:45.570614+0000","last_clean":"2024-09-17T05:38:45.570614+0000","last_became_active":"2024-09-17T05:38:45.561815+0000","last_became_peered":"2024-09-17T05:38:45.561815+0000","last_unstale":"2024-09-17T05:38:45.570614+0000","last_undegraded":"2024-09-17T05:38:45.570614+0000","last_fullsized":"2024-09-17T05:38:45.570614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:16.431335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575697+0000","last_change":"2024-09-17T05:38:46.568855+0000","last_active":"2024-09-17T05:38:46.575697+0000","last_peered":"2024-09-17T05:38:46.575697+0000","last_clean":"2024-09-17T05:38:46.575697+0000","last_became_active":"2024-09-17T05:38:46.568540+0000","last_became_peered":"2024-09-17T05:38:46.568540+0000","last_unstale":"2024-09-17T05:38:46.575697+0000","last_undegraded":"2024-09-17T05:38:46.575697+0000","last_fullsized":"2024-09-17T05:38:46.575697+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:45.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570855+0000","last_change":"2024-09-17T05:38:45.563925+0000","last_active":"2024-09-17T05:38:45.570855+0000","last_peered":"2024-09-17T05:38:45.570855+0000","last_clean":"2024-09-17T05:38:45.570855+0000","last_became_active":"2024-09-17T05:38:45.563013+0000","last_became_peered":"2024-09-17T05:38:45.563013+0000","last_unstale":"2024-09-17T05:38:45.570855+0000","last_undegraded":"2024-09-17T05:38:45.570855+0000","last_fullsized":"2024-09-17T05:38:45.570855+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:03.050294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549925+0000","last_change":"2024-09-17T05:38:45.549925+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549925+0000","last_undegraded":"2024-09-17T05:38:45.549925+0000","last_fullsized":"2024-09-17T05:38:45.549925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570331+0000","last_change":"2024-09-17T05:38:45.562855+0000","last_active":"2024-09-17T05:38:45.570331+0000","last_peered":"2024-09-17T05:38:45.570331+0000","last_clean":"2024-09-17T05:38:45.570331+0000","last_became_active":"2024-09-17T05:38:45.562513+0000","last_became_peered":"2024-09-17T05:38:45.562513+0000","last_unstale":"2024-09-17T05:38:45.570331+0000","last_undegraded":"2024-09-17T05:38:45.570331+0000","last_fullsized":"2024-09-17T05:38:45.570331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549875+0000","last_change":"2024-09-17T05:38:45.549875+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549875+0000","last_undegraded":"2024-09-17T05:38:45.549875+0000","last_fullsized":"2024-09-17T05:38:45.549875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.560753+0000","last_change":"2024-09-17T05:38:45.557154+0000","last_active":"2024-09-17T05:38:45.560753+0000","last_peered":"2024-09-17T05:38:45.560753+0000","last_clean":"2024-09-17T05:38:45.560753+0000","last_became_active":"2024-09-17T05:38:45.556734+0000","last_became_peered":"2024-09-17T05:38:45.556734+0000","last_unstale":"2024-09-17T05:38:45.560753+0000","last_undegraded":"2024-09-17T05:38:45.560753+0000","last_fullsized":"2024-09-17T05:38:45.560753+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:14.656044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.543028+0000","last_change":"2024-09-17T05:38:45.543028+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.543028+0000","last_undegraded":"2024-09-17T05:38:45.543028+0000","last_fullsized":"2024-09-17T05:38:45.543028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562141+0000","last_change":"2024-09-17T05:38:45.557059+0000","last_active":"2024-09-17T05:38:45.562141+0000","last_peered":"2024-09-17T05:38:45.562141+0000","last_clean":"2024-09-17T05:38:45.562141+0000","last_became_active":"2024-09-17T05:38:45.556369+0000","last_became_peered":"2024-09-17T05:38:45.556369+0000","last_unstale":"2024-09-17T05:38:45.562141+0000","last_undegraded":"2024-09-17T05:38:45.562141+0000","last_fullsized":"2024-09-17T05:38:45.562141+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:56.172141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551704+0000","last_change":"2024-09-17T05:38:45.551704+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551704+0000","last_undegraded":"2024-09-17T05:38:45.551704+0000","last_fullsized":"2024-09-17T05:38:45.551704+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570915+0000","last_change":"2024-09-17T05:38:45.561797+0000","last_active":"2024-09-17T05:38:45.570915+0000","last_peered":"2024-09-17T05:38:45.570915+0000","last_clean":"2024-09-17T05:38:45.570915+0000","last_became_active":"2024-09-17T05:38:45.561441+0000","last_became_peered":"2024-09-17T05:38:45.561441+0000","last_unstale":"2024-09-17T05:38:45.570915+0000","last_undegraded":"2024-09-17T05:38:45.570915+0000","last_fullsized":"2024-09-17T05:38:45.570915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:00.735046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550527+0000","last_change":"2024-09-17T05:38:45.550527+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550527+0000","last_undegraded":"2024-09-17T05:38:45.550527+0000","last_fullsized":"2024-09-17T05:38:45.550527+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569670+0000","last_change":"2024-09-17T05:38:45.565807+0000","last_active":"2024-09-17T05:38:45.569670+0000","last_peered":"2024-09-17T05:38:45.569670+0000","last_clean":"2024-09-17T05:38:45.569670+0000","last_became_active":"2024-09-17T05:38:45.565418+0000","last_became_peered":"2024-09-17T05:38:45.565418+0000","last_unstale":"2024-09-17T05:38:45.569670+0000","last_undegraded":"2024-09-17T05:38:45.569670+0000","last_fullsized":"2024-09-17T05:38:45.569670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:39.359240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552082+0000","last_change":"2024-09-17T05:38:45.552082+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552082+0000","last_undegraded":"2024-09-17T05:38:45.552082+0000","last_fullsized":"2024-09-17T05:38:45.552082+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570676+0000","last_change":"2024-09-17T05:38:45.560944+0000","last_active":"2024-09-17T05:38:45.570676+0000","last_peered":"2024-09-17T05:38:45.570676+0000","last_clean":"2024-09-17T05:38:45.570676+0000","last_became_active":"2024-09-17T05:38:45.559926+0000","last_became_peered":"2024-09-17T05:38:45.559926+0000","last_unstale":"2024-09-17T05:38:45.570676+0000","last_undegraded":"2024-09-17T05:38:45.570676+0000","last_fullsized":"2024-09-17T05:38:45.570676+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:46.035792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592302+0000","last_change":"2024-09-17T05:38:46.588274+0000","last_active":"2024-09-17T05:38:46.592302+0000","last_peered":"2024-09-17T05:38:46.592302+0000","last_clean":"2024-09-17T05:38:46.592302+0000","last_became_active":"2024-09-17T05:38:46.587955+0000","last_became_peered":"2024-09-17T05:38:46.587955+0000","last_unstale":"2024-09-17T05:38:46.592302+0000","last_undegraded":"2024-09-17T05:38:46.592302+0000","last_fullsized":"2024-09-17T05:38:46.592302+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:06.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569657+0000","last_change":"2024-09-17T05:38:45.566154+0000","last_active":"2024-09-17T05:38:45.569657+0000","last_peered":"2024-09-17T05:38:45.569657+0000","last_clean":"2024-09-17T05:38:45.569657+0000","last_became_active":"2024-09-17T05:38:45.565707+0000","last_became_peered":"2024-09-17T05:38:45.565707+0000","last_unstale":"2024-09-17T05:38:45.569657+0000","last_undegraded":"2024-09-17T05:38:45.569657+0000","last_fullsized":"2024-09-17T05:38:45.569657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:37.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549865+0000","last_change":"2024-09-17T05:38:45.549865+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549865+0000","last_undegraded":"2024-09-17T05:38:45.549865+0000","last_fullsized":"2024-09-17T05:38:45.549865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570879+0000","last_change":"2024-09-17T05:38:45.567988+0000","last_active":"2024-09-17T05:38:45.570879+0000","last_peered":"2024-09-17T05:38:45.570879+0000","last_clean":"2024-09-17T05:38:45.570879+0000","last_became_active":"2024-09-17T05:38:45.567377+0000","last_became_peered":"2024-09-17T05:38:45.567377+0000","last_unstale":"2024-09-17T05:38:45.570879+0000","last_undegraded":"2024-09-17T05:38:45.570879+0000","last_fullsized":"2024-09-17T05:38:45.570879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:13.538060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.547962+0000","last_change":"2024-09-17T05:38:45.547962+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.547962+0000","last_undegraded":"2024-09-17T05:38:45.547962+0000","last_fullsized":"2024-09-17T05:38:45.547962+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570803+0000","last_change":"2024-09-17T05:38:45.563646+0000","last_active":"2024-09-17T05:38:45.570803+0000","last_peered":"2024-09-17T05:38:45.570803+0000","last_clean":"2024-09-17T05:38:45.570803+0000","last_became_active":"2024-09-17T05:38:45.562598+0000","last_became_peered":"2024-09-17T05:38:45.562598+0000","last_unstale":"2024-09-17T05:38:45.570803+0000","last_undegraded":"2024-09-17T05:38:45.570803+0000","last_fullsized":"2024-09-17T05:38:45.570803+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:25.832091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549422+0000","last_change":"2024-09-17T05:38:45.549422+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549422+0000","last_undegraded":"2024-09-17T05:38:45.549422+0000","last_fullsized":"2024-09-17T05:38:45.549422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.560133+0000","last_change":"2024-09-17T05:38:45.553121+0000","last_active":"2024-09-17T05:38:45.560133+0000","last_peered":"2024-09-17T05:38:45.560133+0000","last_clean":"2024-09-17T05:38:45.560133+0000","last_became_active":"2024-09-17T05:38:45.552295+0000","last_became_peered":"2024-09-17T05:38:45.552295+0000","last_unstale":"2024-09-17T05:38:45.560133+0000","last_undegraded":"2024-09-17T05:38:45.560133+0000","last_fullsized":"2024-09-17T05:38:45.560133+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:03.103089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.542464+0000","last_change":"2024-09-17T05:38:45.542464+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.542464+0000","last_undegraded":"2024-09-17T05:38:45.542464+0000","last_fullsized":"2024-09-17T05:38:45.542464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.572853+0000","last_change":"2024-09-17T05:38:45.570706+0000","last_active":"2024-09-17T05:38:45.572853+0000","last_peered":"2024-09-17T05:38:45.572853+0000","last_clean":"2024-09-17T05:38:45.572853+0000","last_became_active":"2024-09-17T05:38:45.570023+0000","last_became_peered":"2024-09-17T05:38:45.570023+0000","last_unstale":"2024-09-17T05:38:45.572853+0000","last_undegraded":"2024-09-17T05:38:45.572853+0000","last_fullsized":"2024-09-17T05:38:45.572853+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:33.876827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540648+0000","last_change":"2024-09-17T05:38:45.540648+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540648+0000","last_undegraded":"2024-09-17T05:38:45.540648+0000","last_fullsized":"2024-09-17T05:38:45.540648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.563685+0000","last_change":"2024-09-17T05:38:45.551826+0000","last_active":"2024-09-17T05:38:45.563685+0000","last_peered":"2024-09-17T05:38:45.563685+0000","last_clean":"2024-09-17T05:38:45.563685+0000","last_became_active":"2024-09-17T05:38:45.551495+0000","last_became_peered":"2024-09-17T05:38:45.551495+0000","last_unstale":"2024-09-17T05:38:45.563685+0000","last_undegraded":"2024-09-17T05:38:45.563685+0000","last_fullsized":"2024-09-17T05:38:45.563685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:35.634545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548005+0000","last_change":"2024-09-17T05:38:45.548005+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548005+0000","last_undegraded":"2024-09-17T05:38:45.548005+0000","last_fullsized":"2024-09-17T05:38:45.548005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569637+0000","last_change":"2024-09-17T05:38:45.565496+0000","last_active":"2024-09-17T05:38:45.569637+0000","last_peered":"2024-09-17T05:38:45.569637+0000","last_clean":"2024-09-17T05:38:45.569637+0000","last_became_active":"2024-09-17T05:38:45.564983+0000","last_became_peered":"2024-09-17T05:38:45.564983+0000","last_unstale":"2024-09-17T05:38:45.569637+0000","last_undegraded":"2024-09-17T05:38:45.569637+0000","last_fullsized":"2024-09-17T05:38:45.569637+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:31.444638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549343+0000","last_change":"2024-09-17T05:38:45.549343+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549343+0000","last_undegraded":"2024-09-17T05:38:45.549343+0000","last_fullsized":"2024-09-17T05:38:45.549343+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562084+0000","last_change":"2024-09-17T05:38:45.554558+0000","last_active":"2024-09-17T05:38:45.562084+0000","last_peered":"2024-09-17T05:38:45.562084+0000","last_clean":"2024-09-17T05:38:45.562084+0000","last_became_active":"2024-09-17T05:38:45.553507+0000","last_became_peered":"2024-09-17T05:38:45.553507+0000","last_unstale":"2024-09-17T05:38:45.562084+0000","last_undegraded":"2024-09-17T05:38:45.562084+0000","last_fullsized":"2024-09-17T05:38:45.562084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:57.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550481+0000","last_change":"2024-09-17T05:38:45.550481+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550481+0000","last_undegraded":"2024-09-17T05:38:45.550481+0000","last_fullsized":"2024-09-17T05:38:45.550481+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570827+0000","last_change":"2024-09-17T05:38:45.563341+0000","last_active":"2024-09-17T05:38:45.570827+0000","last_peered":"2024-09-17T05:38:45.570827+0000","last_clean":"2024-09-17T05:38:45.570827+0000","last_became_active":"2024-09-17T05:38:45.562575+0000","last_became_peered":"2024-09-17T05:38:45.562575+0000","last_unstale":"2024-09-17T05:38:45.570827+0000","last_undegraded":"2024-09-17T05:38:45.570827+0000","last_fullsized":"2024-09-17T05:38:45.570827+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:57.566772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549015+0000","last_change":"2024-09-17T05:38:45.549015+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549015+0000","last_undegraded":"2024-09-17T05:38:45.549015+0000","last_fullsized":"2024-09-17T05:38:45.549015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570831+0000","last_change":"2024-09-17T05:38:45.567767+0000","last_active":"2024-09-17T05:38:45.570831+0000","last_peered":"2024-09-17T05:38:45.570831+0000","last_clean":"2024-09-17T05:38:45.570831+0000","last_became_active":"2024-09-17T05:38:45.567450+0000","last_became_peered":"2024-09-17T05:38:45.567450+0000","last_unstale":"2024-09-17T05:38:45.570831+0000","last_undegraded":"2024-09-17T05:38:45.570831+0000","last_fullsized":"2024-09-17T05:38:45.570831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:49.861577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541167+0000","last_change":"2024-09-17T05:38:45.541167+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541167+0000","last_undegraded":"2024-09-17T05:38:45.541167+0000","last_fullsized":"2024-09-17T05:38:45.541167+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562173+0000","last_change":"2024-09-17T05:38:45.554711+0000","last_active":"2024-09-17T05:38:45.562173+0000","last_peered":"2024-09-17T05:38:45.562173+0000","last_clean":"2024-09-17T05:38:45.562173+0000","last_became_active":"2024-09-17T05:38:45.554349+0000","last_became_peered":"2024-09-17T05:38:45.554349+0000","last_unstale":"2024-09-17T05:38:45.562173+0000","last_undegraded":"2024-09-17T05:38:45.562173+0000","last_fullsized":"2024-09-17T05:38:45.562173+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:38.000843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541935+0000","last_change":"2024-09-17T05:38:45.541935+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541935+0000","last_undegraded":"2024-09-17T05:38:45.541935+0000","last_fullsized":"2024-09-17T05:38:45.541935+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571034+0000","last_change":"2024-09-17T05:38:45.566114+0000","last_active":"2024-09-17T05:38:45.571034+0000","last_peered":"2024-09-17T05:38:45.571034+0000","last_clean":"2024-09-17T05:38:45.571034+0000","last_became_active":"2024-09-17T05:38:45.565806+0000","last_became_peered":"2024-09-17T05:38:45.565806+0000","last_unstale":"2024-09-17T05:38:45.571034+0000","last_undegraded":"2024-09-17T05:38:45.571034+0000","last_fullsized":"2024-09-17T05:38:45.571034+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548681+0000","last_change":"2024-09-17T05:38:45.548681+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548681+0000","last_undegraded":"2024-09-17T05:38:45.548681+0000","last_fullsized":"2024-09-17T05:38:45.548681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571620+0000","last_change":"2024-09-17T05:38:45.565198+0000","last_active":"2024-09-17T05:38:45.571620+0000","last_peered":"2024-09-17T05:38:45.571620+0000","last_clean":"2024-09-17T05:38:45.571620+0000","last_became_active":"2024-09-17T05:38:45.564886+0000","last_became_peered":"2024-09-17T05:38:45.564886+0000","last_unstale":"2024-09-17T05:38:45.571620+0000","last_undegraded":"2024-09-17T05:38:45.571620+0000","last_fullsized":"2024-09-17T05:38:45.571620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:29.762278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546205+0000","last_change":"2024-09-17T05:38:45.546205+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546205+0000","last_undegraded":"2024-09-17T05:38:45.546205+0000","last_fullsized":"2024-09-17T05:38:45.546205+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562004+0000","last_change":"2024-09-17T05:38:45.560114+0000","last_active":"2024-09-17T05:38:46.562004+0000","last_peered":"2024-09-17T05:38:46.562004+0000","last_clean":"2024-09-17T05:38:46.562004+0000","last_became_active":"2024-09-17T05:38:45.559793+0000","last_became_peered":"2024-09-17T05:38:45.559793+0000","last_unstale":"2024-09-17T05:38:46.562004+0000","last_undegraded":"2024-09-17T05:38:46.562004+0000","last_fullsized":"2024-09-17T05:38:46.562004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:41.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541464+0000","last_change":"2024-09-17T05:38:45.541464+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541464+0000","last_undegraded":"2024-09-17T05:38:45.541464+0000","last_fullsized":"2024-09-17T05:38:45.541464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571201+0000","last_change":"2024-09-17T05:38:45.569074+0000","last_active":"2024-09-17T05:38:45.571201+0000","last_peered":"2024-09-17T05:38:45.571201+0000","last_clean":"2024-09-17T05:38:45.571201+0000","last_became_active":"2024-09-17T05:38:45.568523+0000","last_became_peered":"2024-09-17T05:38:45.568523+0000","last_unstale":"2024-09-17T05:38:45.571201+0000","last_undegraded":"2024-09-17T05:38:45.571201+0000","last_fullsized":"2024-09-17T05:38:45.571201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:29.762278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551007+0000","last_change":"2024-09-17T05:38:45.551007+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551007+0000","last_undegraded":"2024-09-17T05:38:45.551007+0000","last_fullsized":"2024-09-17T05:38:45.551007+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.565108+0000","last_change":"2024-09-17T05:38:45.556497+0000","last_active":"2024-09-17T05:38:45.565108+0000","last_peered":"2024-09-17T05:38:45.565108+0000","last_clean":"2024-09-17T05:38:45.565108+0000","last_became_active":"2024-09-17T05:38:45.556092+0000","last_became_peered":"2024-09-17T05:38:45.556092+0000","last_unstale":"2024-09-17T05:38:45.565108+0000","last_undegraded":"2024-09-17T05:38:45.565108+0000","last_fullsized":"2024-09-17T05:38:45.565108+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:28.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551306+0000","last_change":"2024-09-17T05:38:45.551306+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551306+0000","last_undegraded":"2024-09-17T05:38:45.551306+0000","last_fullsized":"2024-09-17T05:38:45.551306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568513+0000","last_change":"2024-09-17T05:38:45.563687+0000","last_active":"2024-09-17T05:38:45.568513+0000","last_peered":"2024-09-17T05:38:45.568513+0000","last_clean":"2024-09-17T05:38:45.568513+0000","last_became_active":"2024-09-17T05:38:45.563295+0000","last_became_peered":"2024-09-17T05:38:45.563295+0000","last_unstale":"2024-09-17T05:38:45.568513+0000","last_undegraded":"2024-09-17T05:38:45.568513+0000","last_fullsized":"2024-09-17T05:38:45.568513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:46.497960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":186,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.555587+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:38:45.555587+0000","last_peered":"2024-09-17T05:38:45.555587+0000","last_clean":"2024-09-17T05:38:45.555587+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:38:45.555587+0000","last_undegraded":"2024-09-17T05:38:45.555587+0000","last_fullsized":"2024-09-17T05:38:45.555587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1335296,"data_stored":919087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":328719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":912420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":741376,"data_stored":328719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":774144,"data_stored":338150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:38:50.774 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:38:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3324404307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 msgr2=0x7fbb0815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3324404307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb0815e990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8009840 tx=0x7fbaf801c790 comp rx=0 tx=0).stop 2024-09-17T05:38:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3324404307 shutdown_connections 2024-09-17T05:38:50.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3324404307 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb0806de50 0x7fbb0806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3324404307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb0815e990 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3324404307 >> 172.21.15.44:0/3324404307 conn(0x7fbb080ccaa0 msgr2=0x7fbb080cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3324404307 shutdown_connections 2024-09-17T05:38:50.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3324404307 wait complete. 2024-09-17T05:38:50.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.969+0000 7fbb0ca00640 1 Processor -- start 2024-09-17T05:38:50.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 -- start start 2024-09-17T05:38:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb0806de50 0x7fbb080afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb080707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb080ced00 0x7fbb08070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb08169410 con 0x7fbb08072e50 2024-09-17T05:38:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbb08169290 con 0x7fbb080ced00 2024-09-17T05:38:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbb08169590 con 0x7fbb0806de50 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb080707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb080707b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35984/0 (socket says 172.21.15.44:35984) 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 -- 172.21.15.44:0/3070960220 learned_addr learned my addr 172.21.15.44:0/3070960220 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb05e00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb0806de50 0x7fbb080afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb06800640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb080ced00 0x7fbb08070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 -- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb0806de50 msgr2=0x7fbb080afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb0806de50 0x7fbb080afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 -- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb080ced00 msgr2=0x7fbb08070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb080ced00 0x7fbb08070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 -- 172.21.15.44:0/3070960220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0814aa00 con 0x7fbb08072e50 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb05e00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb0806de50 0x7fbb080afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbaffe00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb080707b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000d720 tx=0x7fbaf000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbafe000640 1 -- 172.21.15.44:0/3070960220 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0017070 con 0x7fbb08072e50 2024-09-17T05:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbafe000640 1 -- 172.21.15.44:0/3070960220 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaf0004310 con 0x7fbb08072e50 2024-09-17T05:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbafe000640 1 -- 172.21.15.44:0/3070960220 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0005280 con 0x7fbb08072e50 2024-09-17T05:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0814ace0 con 0x7fbb08072e50 2024-09-17T05:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0814b2a0 con 0x7fbb08072e50 2024-09-17T05:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.973+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0806e260 con 0x7fbb08072e50 2024-09-17T05:38:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.977+0000 7fbafe000640 1 -- 172.21.15.44:0/3070960220 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbaf0005420 con 0x7fbb08072e50 2024-09-17T05:38:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.977+0000 7fbafe000640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbae4073200 0x7fbae4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.977+0000 7fbafe000640 1 -- 172.21.15.44:0/3070960220 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fbaf0094730 con 0x7fbb08072e50 2024-09-17T05:38:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.977+0000 7fbb05e00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbae4073200 0x7fbae4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.977+0000 7fbb05e00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbae4073200 0x7fbae4075710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80af000 tx=0x7fbaf801afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:50.981+0000 7fbafe000640 1 -- 172.21.15.44:0/3070960220 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbaf0020020 con 0x7fbb08072e50 2024-09-17T05:38:51.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.153+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb080b5fa0 con 0x7fbae4073200 2024-09-17T05:38:51.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.161+0000 7fbafe000640 1 -- 172.21.15.44:0/3070960220 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247321 (secure 0 0 0) 0x7fbb080b5fa0 con 0x7fbae4073200 2024-09-17T05:38:51.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:51.165 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbae4073200 msgr2=0x7fbae4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbae4073200 0x7fbae4075710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80af000 tx=0x7fbaf801afd0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 msgr2=0x7fbb080707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb080707b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000d720 tx=0x7fbaf000dbe0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 shutdown_connections 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbae4073200 0x7fbae4075710 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb080ced00 0x7fbb08070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb08072e50 0x7fbb080707b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 --2- 172.21.15.44:0/3070960220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb0806de50 0x7fbb080afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 >> 172.21.15.44:0/3070960220 conn(0x7fbb080ccaa0 msgr2=0x7fbb080cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:51.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 shutdown_connections 2024-09-17T05:38:51.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.165+0000 7fbb0ca00640 1 -- 172.21.15.44:0/3070960220 wait complete. 2024-09-17T05:38:51.186 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-17T05:38:50.298000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239816,"kb_used_data":6936,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734904,"statfs":{"total":773094113280,"available":772848541696,"internally_reserved":0,"allocated":7102464,"data_stored":3793251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762790"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.591698+0000","last_change":"2024-09-17T05:38:46.583715+0000","last_active":"2024-09-17T05:38:46.591698+0000","last_peered":"2024-09-17T05:38:46.591698+0000","last_clean":"2024-09-17T05:38:46.591698+0000","last_became_active":"2024-09-17T05:38:46.583363+0000","last_became_peered":"2024-09-17T05:38:46.583363+0000","last_unstale":"2024-09-17T05:38:46.591698+0000","last_undegraded":"2024-09-17T05:38:46.591698+0000","last_fullsized":"2024-09-17T05:38:46.591698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:09.088815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540090+0000","last_change":"2024-09-17T05:38:45.540090+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540090+0000","last_undegraded":"2024-09-17T05:38:45.540090+0000","last_fullsized":"2024-09-17T05:38:45.540090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541369+0000","last_change":"2024-09-17T05:38:45.541369+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541369+0000","last_undegraded":"2024-09-17T05:38:45.541369+0000","last_fullsized":"2024-09-17T05:38:45.541369+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.561517+0000","last_change":"2024-09-17T05:38:45.561517+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.561517+0000","last_undegraded":"2024-09-17T05:38:45.561517+0000","last_fullsized":"2024-09-17T05:38:45.561517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540381+0000","last_change":"2024-09-17T05:38:45.540381+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540381+0000","last_undegraded":"2024-09-17T05:38:45.540381+0000","last_fullsized":"2024-09-17T05:38:45.540381+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.542165+0000","last_change":"2024-09-17T05:38:45.542165+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.542165+0000","last_undegraded":"2024-09-17T05:38:45.542165+0000","last_fullsized":"2024-09-17T05:38:45.542165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.581278+0000","last_change":"2024-09-17T05:38:46.576539+0000","last_active":"2024-09-17T05:38:46.581278+0000","last_peered":"2024-09-17T05:38:46.581278+0000","last_clean":"2024-09-17T05:38:46.581278+0000","last_became_active":"2024-09-17T05:38:46.576080+0000","last_became_peered":"2024-09-17T05:38:46.576080+0000","last_unstale":"2024-09-17T05:38:46.581278+0000","last_undegraded":"2024-09-17T05:38:46.581278+0000","last_fullsized":"2024-09-17T05:38:46.581278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:47.968279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541085+0000","last_change":"2024-09-17T05:38:45.541085+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541085+0000","last_undegraded":"2024-09-17T05:38:45.541085+0000","last_fullsized":"2024-09-17T05:38:45.541085+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557612+0000","last_change":"2024-09-17T05:38:45.557612+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557612+0000","last_undegraded":"2024-09-17T05:38:45.557612+0000","last_fullsized":"2024-09-17T05:38:45.557612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553373+0000","last_change":"2024-09-17T05:38:45.553373+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553373+0000","last_undegraded":"2024-09-17T05:38:45.553373+0000","last_fullsized":"2024-09-17T05:38:45.553373+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557223+0000","last_change":"2024-09-17T05:38:45.557223+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557223+0000","last_undegraded":"2024-09-17T05:38:45.557223+0000","last_fullsized":"2024-09-17T05:38:45.557223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.560998+0000","last_change":"2024-09-17T05:38:45.560998+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.560998+0000","last_undegraded":"2024-09-17T05:38:45.560998+0000","last_fullsized":"2024-09-17T05:38:45.560998+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.547150+0000","last_change":"2024-09-17T05:38:45.547150+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.547150+0000","last_undegraded":"2024-09-17T05:38:45.547150+0000","last_fullsized":"2024-09-17T05:38:45.547150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546009+0000","last_change":"2024-09-17T05:38:45.546009+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546009+0000","last_undegraded":"2024-09-17T05:38:45.546009+0000","last_fullsized":"2024-09-17T05:38:45.546009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551156+0000","last_change":"2024-09-17T05:38:45.551156+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551156+0000","last_undegraded":"2024-09-17T05:38:45.551156+0000","last_fullsized":"2024-09-17T05:38:45.551156+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553341+0000","last_change":"2024-09-17T05:38:45.553341+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553341+0000","last_undegraded":"2024-09-17T05:38:45.553341+0000","last_fullsized":"2024-09-17T05:38:45.553341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549405+0000","last_change":"2024-09-17T05:38:45.549405+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549405+0000","last_undegraded":"2024-09-17T05:38:45.549405+0000","last_fullsized":"2024-09-17T05:38:45.549405+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557292+0000","last_change":"2024-09-17T05:38:45.557292+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557292+0000","last_undegraded":"2024-09-17T05:38:45.557292+0000","last_fullsized":"2024-09-17T05:38:45.557292+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.556678+0000","last_change":"2024-09-17T05:38:45.556678+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.556678+0000","last_undegraded":"2024-09-17T05:38:45.556678+0000","last_fullsized":"2024-09-17T05:38:45.556678+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550992+0000","last_change":"2024-09-17T05:38:45.550992+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550992+0000","last_undegraded":"2024-09-17T05:38:45.550992+0000","last_fullsized":"2024-09-17T05:38:45.550992+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546542+0000","last_change":"2024-09-17T05:38:45.546542+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546542+0000","last_undegraded":"2024-09-17T05:38:45.546542+0000","last_fullsized":"2024-09-17T05:38:45.546542+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.539466+0000","last_change":"2024-09-17T05:38:45.539466+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.539466+0000","last_undegraded":"2024-09-17T05:38:45.539466+0000","last_fullsized":"2024-09-17T05:38:45.539466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552745+0000","last_change":"2024-09-17T05:38:45.552745+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552745+0000","last_undegraded":"2024-09-17T05:38:45.552745+0000","last_fullsized":"2024-09-17T05:38:45.552745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540510+0000","last_change":"2024-09-17T05:38:45.540510+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540510+0000","last_undegraded":"2024-09-17T05:38:45.540510+0000","last_fullsized":"2024-09-17T05:38:45.540510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549820+0000","last_change":"2024-09-17T05:38:45.549820+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549820+0000","last_undegraded":"2024-09-17T05:38:45.549820+0000","last_fullsized":"2024-09-17T05:38:45.549820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541657+0000","last_change":"2024-09-17T05:38:45.541657+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541657+0000","last_undegraded":"2024-09-17T05:38:45.541657+0000","last_fullsized":"2024-09-17T05:38:45.541657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548456+0000","last_change":"2024-09-17T05:38:45.548456+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548456+0000","last_undegraded":"2024-09-17T05:38:45.548456+0000","last_fullsized":"2024-09-17T05:38:45.548456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575662+0000","last_change":"2024-09-17T05:38:46.566215+0000","last_active":"2024-09-17T05:38:46.575662+0000","last_peered":"2024-09-17T05:38:46.575662+0000","last_clean":"2024-09-17T05:38:46.575662+0000","last_became_active":"2024-09-17T05:38:46.565932+0000","last_became_peered":"2024-09-17T05:38:46.565932+0000","last_unstale":"2024-09-17T05:38:46.575662+0000","last_undegraded":"2024-09-17T05:38:46.575662+0000","last_fullsized":"2024-09-17T05:38:46.575662+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:55.360415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.555583+0000","last_change":"2024-09-17T05:38:45.555583+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.555583+0000","last_undegraded":"2024-09-17T05:38:45.555583+0000","last_fullsized":"2024-09-17T05:38:45.555583+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553798+0000","last_change":"2024-09-17T05:38:45.553798+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553798+0000","last_undegraded":"2024-09-17T05:38:45.553798+0000","last_fullsized":"2024-09-17T05:38:45.553798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540370+0000","last_change":"2024-09-17T05:38:45.540370+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540370+0000","last_undegraded":"2024-09-17T05:38:45.540370+0000","last_fullsized":"2024-09-17T05:38:45.540370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592100+0000","last_change":"2024-09-17T05:38:46.581873+0000","last_active":"2024-09-17T05:38:46.592100+0000","last_peered":"2024-09-17T05:38:46.592100+0000","last_clean":"2024-09-17T05:38:46.592100+0000","last_became_active":"2024-09-17T05:38:46.581393+0000","last_became_peered":"2024-09-17T05:38:46.581393+0000","last_unstale":"2024-09-17T05:38:46.592100+0000","last_undegraded":"2024-09-17T05:38:46.592100+0000","last_fullsized":"2024-09-17T05:38:46.592100+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:50.725323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550985+0000","last_change":"2024-09-17T05:38:45.550985+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550985+0000","last_undegraded":"2024-09-17T05:38:45.550985+0000","last_fullsized":"2024-09-17T05:38:45.550985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.602119+0000","last_change":"2024-09-17T05:38:45.557221+0000","last_active":"2024-09-17T05:38:46.602119+0000","last_peered":"2024-09-17T05:38:46.602119+0000","last_clean":"2024-09-17T05:38:46.602119+0000","last_became_active":"2024-09-17T05:38:45.556870+0000","last_became_peered":"2024-09-17T05:38:45.556870+0000","last_unstale":"2024-09-17T05:38:46.602119+0000","last_undegraded":"2024-09-17T05:38:46.602119+0000","last_fullsized":"2024-09-17T05:38:46.602119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:15.758423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540875+0000","last_change":"2024-09-17T05:38:45.540875+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540875+0000","last_undegraded":"2024-09-17T05:38:45.540875+0000","last_fullsized":"2024-09-17T05:38:45.540875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.601073+0000","last_change":"2024-09-17T05:38:45.566302+0000","last_active":"2024-09-17T05:38:46.601073+0000","last_peered":"2024-09-17T05:38:46.601073+0000","last_clean":"2024-09-17T05:38:46.601073+0000","last_became_active":"2024-09-17T05:38:45.565920+0000","last_became_peered":"2024-09-17T05:38:45.565920+0000","last_unstale":"2024-09-17T05:38:46.601073+0000","last_undegraded":"2024-09-17T05:38:46.601073+0000","last_fullsized":"2024-09-17T05:38:46.601073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:15.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.539550+0000","last_change":"2024-09-17T05:38:45.539550+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.539550+0000","last_undegraded":"2024-09-17T05:38:45.539550+0000","last_fullsized":"2024-09-17T05:38:45.539550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.599298+0000","last_change":"2024-09-17T05:38:45.563577+0000","last_active":"2024-09-17T05:38:46.599298+0000","last_peered":"2024-09-17T05:38:46.599298+0000","last_clean":"2024-09-17T05:38:46.599298+0000","last_became_active":"2024-09-17T05:38:45.563266+0000","last_became_peered":"2024-09-17T05:38:45.563266+0000","last_unstale":"2024-09-17T05:38:46.599298+0000","last_undegraded":"2024-09-17T05:38:46.599298+0000","last_fullsized":"2024-09-17T05:38:46.599298+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:24.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550672+0000","last_change":"2024-09-17T05:38:45.550672+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550672+0000","last_undegraded":"2024-09-17T05:38:45.550672+0000","last_fullsized":"2024-09-17T05:38:45.550672+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562107+0000","last_change":"2024-09-17T05:38:45.556629+0000","last_active":"2024-09-17T05:38:45.562107+0000","last_peered":"2024-09-17T05:38:45.562107+0000","last_clean":"2024-09-17T05:38:45.562107+0000","last_became_active":"2024-09-17T05:38:45.556195+0000","last_became_peered":"2024-09-17T05:38:45.556195+0000","last_unstale":"2024-09-17T05:38:45.562107+0000","last_undegraded":"2024-09-17T05:38:45.562107+0000","last_fullsized":"2024-09-17T05:38:45.562107+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:47.232389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550178+0000","last_change":"2024-09-17T05:38:45.550178+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550178+0000","last_undegraded":"2024-09-17T05:38:45.550178+0000","last_fullsized":"2024-09-17T05:38:45.550178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568240+0000","last_change":"2024-09-17T05:38:45.565943+0000","last_active":"2024-09-17T05:38:45.568240+0000","last_peered":"2024-09-17T05:38:45.568240+0000","last_clean":"2024-09-17T05:38:45.568240+0000","last_became_active":"2024-09-17T05:38:45.565559+0000","last_became_peered":"2024-09-17T05:38:45.565559+0000","last_unstale":"2024-09-17T05:38:45.568240+0000","last_undegraded":"2024-09-17T05:38:45.568240+0000","last_fullsized":"2024-09-17T05:38:45.568240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:48.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.574340+0000","last_change":"2024-09-17T05:38:46.566137+0000","last_active":"2024-09-17T05:38:46.574340+0000","last_peered":"2024-09-17T05:38:46.574340+0000","last_clean":"2024-09-17T05:38:46.574340+0000","last_became_active":"2024-09-17T05:38:46.565806+0000","last_became_peered":"2024-09-17T05:38:46.565806+0000","last_unstale":"2024-09-17T05:38:46.574340+0000","last_undegraded":"2024-09-17T05:38:46.574340+0000","last_fullsized":"2024-09-17T05:38:46.574340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:13.028402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568900+0000","last_change":"2024-09-17T05:38:45.564188+0000","last_active":"2024-09-17T05:38:45.568900+0000","last_peered":"2024-09-17T05:38:45.568900+0000","last_clean":"2024-09-17T05:38:45.568900+0000","last_became_active":"2024-09-17T05:38:45.562211+0000","last_became_peered":"2024-09-17T05:38:45.562211+0000","last_unstale":"2024-09-17T05:38:45.568900+0000","last_undegraded":"2024-09-17T05:38:45.568900+0000","last_fullsized":"2024-09-17T05:38:45.568900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:24.997155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551140+0000","last_change":"2024-09-17T05:38:45.551140+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551140+0000","last_undegraded":"2024-09-17T05:38:45.551140+0000","last_fullsized":"2024-09-17T05:38:45.551140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562074+0000","last_change":"2024-09-17T05:38:45.558292+0000","last_active":"2024-09-17T05:38:46.562074+0000","last_peered":"2024-09-17T05:38:46.562074+0000","last_clean":"2024-09-17T05:38:46.562074+0000","last_became_active":"2024-09-17T05:38:45.557924+0000","last_became_peered":"2024-09-17T05:38:45.557924+0000","last_unstale":"2024-09-17T05:38:46.562074+0000","last_undegraded":"2024-09-17T05:38:46.562074+0000","last_fullsized":"2024-09-17T05:38:46.562074+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:11.908735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552591+0000","last_change":"2024-09-17T05:38:45.552591+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552591+0000","last_undegraded":"2024-09-17T05:38:45.552591+0000","last_fullsized":"2024-09-17T05:38:45.552591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570614+0000","last_change":"2024-09-17T05:38:45.566557+0000","last_active":"2024-09-17T05:38:45.570614+0000","last_peered":"2024-09-17T05:38:45.570614+0000","last_clean":"2024-09-17T05:38:45.570614+0000","last_became_active":"2024-09-17T05:38:45.561815+0000","last_became_peered":"2024-09-17T05:38:45.561815+0000","last_unstale":"2024-09-17T05:38:45.570614+0000","last_undegraded":"2024-09-17T05:38:45.570614+0000","last_fullsized":"2024-09-17T05:38:45.570614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:16.431335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575697+0000","last_change":"2024-09-17T05:38:46.568855+0000","last_active":"2024-09-17T05:38:46.575697+0000","last_peered":"2024-09-17T05:38:46.575697+0000","last_clean":"2024-09-17T05:38:46.575697+0000","last_became_active":"2024-09-17T05:38:46.568540+0000","last_became_peered":"2024-09-17T05:38:46.568540+0000","last_unstale":"2024-09-17T05:38:46.575697+0000","last_undegraded":"2024-09-17T05:38:46.575697+0000","last_fullsized":"2024-09-17T05:38:46.575697+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:45.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570855+0000","last_change":"2024-09-17T05:38:45.563925+0000","last_active":"2024-09-17T05:38:45.570855+0000","last_peered":"2024-09-17T05:38:45.570855+0000","last_clean":"2024-09-17T05:38:45.570855+0000","last_became_active":"2024-09-17T05:38:45.563013+0000","last_became_peered":"2024-09-17T05:38:45.563013+0000","last_unstale":"2024-09-17T05:38:45.570855+0000","last_undegraded":"2024-09-17T05:38:45.570855+0000","last_fullsized":"2024-09-17T05:38:45.570855+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:03.050294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549925+0000","last_change":"2024-09-17T05:38:45.549925+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549925+0000","last_undegraded":"2024-09-17T05:38:45.549925+0000","last_fullsized":"2024-09-17T05:38:45.549925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570331+0000","last_change":"2024-09-17T05:38:45.562855+0000","last_active":"2024-09-17T05:38:45.570331+0000","last_peered":"2024-09-17T05:38:45.570331+0000","last_clean":"2024-09-17T05:38:45.570331+0000","last_became_active":"2024-09-17T05:38:45.562513+0000","last_became_peered":"2024-09-17T05:38:45.562513+0000","last_unstale":"2024-09-17T05:38:45.570331+0000","last_undegraded":"2024-09-17T05:38:45.570331+0000","last_fullsized":"2024-09-17T05:38:45.570331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549875+0000","last_change":"2024-09-17T05:38:45.549875+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549875+0000","last_undegraded":"2024-09-17T05:38:45.549875+0000","last_fullsized":"2024-09-17T05:38:45.549875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.560753+0000","last_change":"2024-09-17T05:38:45.557154+0000","last_active":"2024-09-17T05:38:45.560753+0000","last_peered":"2024-09-17T05:38:45.560753+0000","last_clean":"2024-09-17T05:38:45.560753+0000","last_became_active":"2024-09-17T05:38:45.556734+0000","last_became_peered":"2024-09-17T05:38:45.556734+0000","last_unstale":"2024-09-17T05:38:45.560753+0000","last_undegraded":"2024-09-17T05:38:45.560753+0000","last_fullsized":"2024-09-17T05:38:45.560753+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:14.656044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.543028+0000","last_change":"2024-09-17T05:38:45.543028+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.543028+0000","last_undegraded":"2024-09-17T05:38:45.543028+0000","last_fullsized":"2024-09-17T05:38:45.543028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562141+0000","last_change":"2024-09-17T05:38:45.557059+0000","last_active":"2024-09-17T05:38:45.562141+0000","last_peered":"2024-09-17T05:38:45.562141+0000","last_clean":"2024-09-17T05:38:45.562141+0000","last_became_active":"2024-09-17T05:38:45.556369+0000","last_became_peered":"2024-09-17T05:38:45.556369+0000","last_unstale":"2024-09-17T05:38:45.562141+0000","last_undegraded":"2024-09-17T05:38:45.562141+0000","last_fullsized":"2024-09-17T05:38:45.562141+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:56.172141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551704+0000","last_change":"2024-09-17T05:38:45.551704+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551704+0000","last_undegraded":"2024-09-17T05:38:45.551704+0000","last_fullsized":"2024-09-17T05:38:45.551704+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570915+0000","last_change":"2024-09-17T05:38:45.561797+0000","last_active":"2024-09-17T05:38:45.570915+0000","last_peered":"2024-09-17T05:38:45.570915+0000","last_clean":"2024-09-17T05:38:45.570915+0000","last_became_active":"2024-09-17T05:38:45.561441+0000","last_became_peered":"2024-09-17T05:38:45.561441+0000","last_unstale":"2024-09-17T05:38:45.570915+0000","last_undegraded":"2024-09-17T05:38:45.570915+0000","last_fullsized":"2024-09-17T05:38:45.570915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:00.735046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550527+0000","last_change":"2024-09-17T05:38:45.550527+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550527+0000","last_undegraded":"2024-09-17T05:38:45.550527+0000","last_fullsized":"2024-09-17T05:38:45.550527+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569670+0000","last_change":"2024-09-17T05:38:45.565807+0000","last_active":"2024-09-17T05:38:45.569670+0000","last_peered":"2024-09-17T05:38:45.569670+0000","last_clean":"2024-09-17T05:38:45.569670+0000","last_became_active":"2024-09-17T05:38:45.565418+0000","last_became_peered":"2024-09-17T05:38:45.565418+0000","last_unstale":"2024-09-17T05:38:45.569670+0000","last_undegraded":"2024-09-17T05:38:45.569670+0000","last_fullsized":"2024-09-17T05:38:45.569670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:39.359240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552082+0000","last_change":"2024-09-17T05:38:45.552082+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552082+0000","last_undegraded":"2024-09-17T05:38:45.552082+0000","last_fullsized":"2024-09-17T05:38:45.552082+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570676+0000","last_change":"2024-09-17T05:38:45.560944+0000","last_active":"2024-09-17T05:38:45.570676+0000","last_peered":"2024-09-17T05:38:45.570676+0000","last_clean":"2024-09-17T05:38:45.570676+0000","last_became_active":"2024-09-17T05:38:45.559926+0000","last_became_peered":"2024-09-17T05:38:45.559926+0000","last_unstale":"2024-09-17T05:38:45.570676+0000","last_undegraded":"2024-09-17T05:38:45.570676+0000","last_fullsized":"2024-09-17T05:38:45.570676+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:46.035792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592302+0000","last_change":"2024-09-17T05:38:46.588274+0000","last_active":"2024-09-17T05:38:46.592302+0000","last_peered":"2024-09-17T05:38:46.592302+0000","last_clean":"2024-09-17T05:38:46.592302+0000","last_became_active":"2024-09-17T05:38:46.587955+0000","last_became_peered":"2024-09-17T05:38:46.587955+0000","last_unstale":"2024-09-17T05:38:46.592302+0000","last_undegraded":"2024-09-17T05:38:46.592302+0000","last_fullsized":"2024-09-17T05:38:46.592302+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:06.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569657+0000","last_change":"2024-09-17T05:38:45.566154+0000","last_active":"2024-09-17T05:38:45.569657+0000","last_peered":"2024-09-17T05:38:45.569657+0000","last_clean":"2024-09-17T05:38:45.569657+0000","last_became_active":"2024-09-17T05:38:45.565707+0000","last_became_peered":"2024-09-17T05:38:45.565707+0000","last_unstale":"2024-09-17T05:38:45.569657+0000","last_undegraded":"2024-09-17T05:38:45.569657+0000","last_fullsized":"2024-09-17T05:38:45.569657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:37.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549865+0000","last_change":"2024-09-17T05:38:45.549865+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549865+0000","last_undegraded":"2024-09-17T05:38:45.549865+0000","last_fullsized":"2024-09-17T05:38:45.549865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570879+0000","last_change":"2024-09-17T05:38:45.567988+0000","last_active":"2024-09-17T05:38:45.570879+0000","last_peered":"2024-09-17T05:38:45.570879+0000","last_clean":"2024-09-17T05:38:45.570879+0000","last_became_active":"2024-09-17T05:38:45.567377+0000","last_became_peered":"2024-09-17T05:38:45.567377+0000","last_unstale":"2024-09-17T05:38:45.570879+0000","last_undegraded":"2024-09-17T05:38:45.570879+0000","last_fullsized":"2024-09-17T05:38:45.570879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:13.538060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.547962+0000","last_change":"2024-09-17T05:38:45.547962+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.547962+0000","last_undegraded":"2024-09-17T05:38:45.547962+0000","last_fullsized":"2024-09-17T05:38:45.547962+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570803+0000","last_change":"2024-09-17T05:38:45.563646+0000","last_active":"2024-09-17T05:38:45.570803+0000","last_peered":"2024-09-17T05:38:45.570803+0000","last_clean":"2024-09-17T05:38:45.570803+0000","last_became_active":"2024-09-17T05:38:45.562598+0000","last_became_peered":"2024-09-17T05:38:45.562598+0000","last_unstale":"2024-09-17T05:38:45.570803+0000","last_undegraded":"2024-09-17T05:38:45.570803+0000","last_fullsized":"2024-09-17T05:38:45.570803+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:25.832091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549422+0000","last_change":"2024-09-17T05:38:45.549422+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549422+0000","last_undegraded":"2024-09-17T05:38:45.549422+0000","last_fullsized":"2024-09-17T05:38:45.549422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.560133+0000","last_change":"2024-09-17T05:38:45.553121+0000","last_active":"2024-09-17T05:38:45.560133+0000","last_peered":"2024-09-17T05:38:45.560133+0000","last_clean":"2024-09-17T05:38:45.560133+0000","last_became_active":"2024-09-17T05:38:45.552295+0000","last_became_peered":"2024-09-17T05:38:45.552295+0000","last_unstale":"2024-09-17T05:38:45.560133+0000","last_undegraded":"2024-09-17T05:38:45.560133+0000","last_fullsized":"2024-09-17T05:38:45.560133+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:03.103089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.542464+0000","last_change":"2024-09-17T05:38:45.542464+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.542464+0000","last_undegraded":"2024-09-17T05:38:45.542464+0000","last_fullsized":"2024-09-17T05:38:45.542464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.572853+0000","last_change":"2024-09-17T05:38:45.570706+0000","last_active":"2024-09-17T05:38:45.572853+0000","last_peered":"2024-09-17T05:38:45.572853+0000","last_clean":"2024-09-17T05:38:45.572853+0000","last_became_active":"2024-09-17T05:38:45.570023+0000","last_became_peered":"2024-09-17T05:38:45.570023+0000","last_unstale":"2024-09-17T05:38:45.572853+0000","last_undegraded":"2024-09-17T05:38:45.572853+0000","last_fullsized":"2024-09-17T05:38:45.572853+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:33.876827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540648+0000","last_change":"2024-09-17T05:38:45.540648+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540648+0000","last_undegraded":"2024-09-17T05:38:45.540648+0000","last_fullsized":"2024-09-17T05:38:45.540648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.563685+0000","last_change":"2024-09-17T05:38:45.551826+0000","last_active":"2024-09-17T05:38:45.563685+0000","last_peered":"2024-09-17T05:38:45.563685+0000","last_clean":"2024-09-17T05:38:45.563685+0000","last_became_active":"2024-09-17T05:38:45.551495+0000","last_became_peered":"2024-09-17T05:38:45.551495+0000","last_unstale":"2024-09-17T05:38:45.563685+0000","last_undegraded":"2024-09-17T05:38:45.563685+0000","last_fullsized":"2024-09-17T05:38:45.563685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:35.634545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548005+0000","last_change":"2024-09-17T05:38:45.548005+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548005+0000","last_undegraded":"2024-09-17T05:38:45.548005+0000","last_fullsized":"2024-09-17T05:38:45.548005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569637+0000","last_change":"2024-09-17T05:38:45.565496+0000","last_active":"2024-09-17T05:38:45.569637+0000","last_peered":"2024-09-17T05:38:45.569637+0000","last_clean":"2024-09-17T05:38:45.569637+0000","last_became_active":"2024-09-17T05:38:45.564983+0000","last_became_peered":"2024-09-17T05:38:45.564983+0000","last_unstale":"2024-09-17T05:38:45.569637+0000","last_undegraded":"2024-09-17T05:38:45.569637+0000","last_fullsized":"2024-09-17T05:38:45.569637+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:31.444638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549343+0000","last_change":"2024-09-17T05:38:45.549343+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549343+0000","last_undegraded":"2024-09-17T05:38:45.549343+0000","last_fullsized":"2024-09-17T05:38:45.549343+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562084+0000","last_change":"2024-09-17T05:38:45.554558+0000","last_active":"2024-09-17T05:38:45.562084+0000","last_peered":"2024-09-17T05:38:45.562084+0000","last_clean":"2024-09-17T05:38:45.562084+0000","last_became_active":"2024-09-17T05:38:45.553507+0000","last_became_peered":"2024-09-17T05:38:45.553507+0000","last_unstale":"2024-09-17T05:38:45.562084+0000","last_undegraded":"2024-09-17T05:38:45.562084+0000","last_fullsized":"2024-09-17T05:38:45.562084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:57.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550481+0000","last_change":"2024-09-17T05:38:45.550481+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550481+0000","last_undegraded":"2024-09-17T05:38:45.550481+0000","last_fullsized":"2024-09-17T05:38:45.550481+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570827+0000","last_change":"2024-09-17T05:38:45.563341+0000","last_active":"2024-09-17T05:38:45.570827+0000","last_peered":"2024-09-17T05:38:45.570827+0000","last_clean":"2024-09-17T05:38:45.570827+0000","last_became_active":"2024-09-17T05:38:45.562575+0000","last_became_peered":"2024-09-17T05:38:45.562575+0000","last_unstale":"2024-09-17T05:38:45.570827+0000","last_undegraded":"2024-09-17T05:38:45.570827+0000","last_fullsized":"2024-09-17T05:38:45.570827+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:57.566772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549015+0000","last_change":"2024-09-17T05:38:45.549015+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549015+0000","last_undegraded":"2024-09-17T05:38:45.549015+0000","last_fullsized":"2024-09-17T05:38:45.549015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570831+0000","last_change":"2024-09-17T05:38:45.567767+0000","last_active":"2024-09-17T05:38:45.570831+0000","last_peered":"2024-09-17T05:38:45.570831+0000","last_clean":"2024-09-17T05:38:45.570831+0000","last_became_active":"2024-09-17T05:38:45.567450+0000","last_became_peered":"2024-09-17T05:38:45.567450+0000","last_unstale":"2024-09-17T05:38:45.570831+0000","last_undegraded":"2024-09-17T05:38:45.570831+0000","last_fullsized":"2024-09-17T05:38:45.570831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:49.861577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541167+0000","last_change":"2024-09-17T05:38:45.541167+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541167+0000","last_undegraded":"2024-09-17T05:38:45.541167+0000","last_fullsized":"2024-09-17T05:38:45.541167+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562173+0000","last_change":"2024-09-17T05:38:45.554711+0000","last_active":"2024-09-17T05:38:45.562173+0000","last_peered":"2024-09-17T05:38:45.562173+0000","last_clean":"2024-09-17T05:38:45.562173+0000","last_became_active":"2024-09-17T05:38:45.554349+0000","last_became_peered":"2024-09-17T05:38:45.554349+0000","last_unstale":"2024-09-17T05:38:45.562173+0000","last_undegraded":"2024-09-17T05:38:45.562173+0000","last_fullsized":"2024-09-17T05:38:45.562173+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:38.000843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541935+0000","last_change":"2024-09-17T05:38:45.541935+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541935+0000","last_undegraded":"2024-09-17T05:38:45.541935+0000","last_fullsized":"2024-09-17T05:38:45.541935+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571034+0000","last_change":"2024-09-17T05:38:45.566114+0000","last_active":"2024-09-17T05:38:45.571034+0000","last_peered":"2024-09-17T05:38:45.571034+0000","last_clean":"2024-09-17T05:38:45.571034+0000","last_became_active":"2024-09-17T05:38:45.565806+0000","last_became_peered":"2024-09-17T05:38:45.565806+0000","last_unstale":"2024-09-17T05:38:45.571034+0000","last_undegraded":"2024-09-17T05:38:45.571034+0000","last_fullsized":"2024-09-17T05:38:45.571034+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548681+0000","last_change":"2024-09-17T05:38:45.548681+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548681+0000","last_undegraded":"2024-09-17T05:38:45.548681+0000","last_fullsized":"2024-09-17T05:38:45.548681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571620+0000","last_change":"2024-09-17T05:38:45.565198+0000","last_active":"2024-09-17T05:38:45.571620+0000","last_peered":"2024-09-17T05:38:45.571620+0000","last_clean":"2024-09-17T05:38:45.571620+0000","last_became_active":"2024-09-17T05:38:45.564886+0000","last_became_peered":"2024-09-17T05:38:45.564886+0000","last_unstale":"2024-09-17T05:38:45.571620+0000","last_undegraded":"2024-09-17T05:38:45.571620+0000","last_fullsized":"2024-09-17T05:38:45.571620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:29.762278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546205+0000","last_change":"2024-09-17T05:38:45.546205+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546205+0000","last_undegraded":"2024-09-17T05:38:45.546205+0000","last_fullsized":"2024-09-17T05:38:45.546205+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562004+0000","last_change":"2024-09-17T05:38:45.560114+0000","last_active":"2024-09-17T05:38:46.562004+0000","last_peered":"2024-09-17T05:38:46.562004+0000","last_clean":"2024-09-17T05:38:46.562004+0000","last_became_active":"2024-09-17T05:38:45.559793+0000","last_became_peered":"2024-09-17T05:38:45.559793+0000","last_unstale":"2024-09-17T05:38:46.562004+0000","last_undegraded":"2024-09-17T05:38:46.562004+0000","last_fullsized":"2024-09-17T05:38:46.562004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:41.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541464+0000","last_change":"2024-09-17T05:38:45.541464+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541464+0000","last_undegraded":"2024-09-17T05:38:45.541464+0000","last_fullsized":"2024-09-17T05:38:45.541464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571201+0000","last_change":"2024-09-17T05:38:45.569074+0000","last_active":"2024-09-17T05:38:45.571201+0000","last_peered":"2024-09-17T05:38:45.571201+0000","last_clean":"2024-09-17T05:38:45.571201+0000","last_became_active":"2024-09-17T05:38:45.568523+0000","last_became_peered":"2024-09-17T05:38:45.568523+0000","last_unstale":"2024-09-17T05:38:45.571201+0000","last_undegraded":"2024-09-17T05:38:45.571201+0000","last_fullsized":"2024-09-17T05:38:45.571201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:29.762278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551007+0000","last_change":"2024-09-17T05:38:45.551007+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551007+0000","last_undegraded":"2024-09-17T05:38:45.551007+0000","last_fullsized":"2024-09-17T05:38:45.551007+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.565108+0000","last_change":"2024-09-17T05:38:45.556497+0000","last_active":"2024-09-17T05:38:45.565108+0000","last_peered":"2024-09-17T05:38:45.565108+0000","last_clean":"2024-09-17T05:38:45.565108+0000","last_became_active":"2024-09-17T05:38:45.556092+0000","last_became_peered":"2024-09-17T05:38:45.556092+0000","last_unstale":"2024-09-17T05:38:45.565108+0000","last_undegraded":"2024-09-17T05:38:45.565108+0000","last_fullsized":"2024-09-17T05:38:45.565108+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:28.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551306+0000","last_change":"2024-09-17T05:38:45.551306+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551306+0000","last_undegraded":"2024-09-17T05:38:45.551306+0000","last_fullsized":"2024-09-17T05:38:45.551306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568513+0000","last_change":"2024-09-17T05:38:45.563687+0000","last_active":"2024-09-17T05:38:45.568513+0000","last_peered":"2024-09-17T05:38:45.568513+0000","last_clean":"2024-09-17T05:38:45.568513+0000","last_became_active":"2024-09-17T05:38:45.563295+0000","last_became_peered":"2024-09-17T05:38:45.563295+0000","last_unstale":"2024-09-17T05:38:45.568513+0000","last_undegraded":"2024-09-17T05:38:45.568513+0000","last_fullsized":"2024-09-17T05:38:45.568513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:46.497960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":186,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.555587+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:38:45.555587+0000","last_peered":"2024-09-17T05:38:45.555587+0000","last_clean":"2024-09-17T05:38:45.555587+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:38:45.555587+0000","last_undegraded":"2024-09-17T05:38:45.555587+0000","last_fullsized":"2024-09-17T05:38:45.555587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1335296,"data_stored":919087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":328719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":912420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":741376,"data_stored":328719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":774144,"data_stored":338150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:38:51.190 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 -- 172.21.15.44:0/2446624112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc06e390 msgr2=0x7f14dc0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 --2- 172.21.15.44:0/2446624112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc06e390 0x7f14dc0cdbf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f14dc06ace0 tx=0x7f14c401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 -- 172.21.15.44:0/2446624112 shutdown_connections 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 --2- 172.21.15.44:0/2446624112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc06e390 0x7f14dc0cdbf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 --2- 172.21.15.44:0/2446624112 >> v2:172.21.15.86:3300/0 conn(0x7f14dc0b5880 0x7f14dc06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 -- 172.21.15.44:0/2446624112 >> 172.21.15.44:0/2446624112 conn(0x7f14dc0ccaa0 msgr2=0x7f14dc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 -- 172.21.15.44:0/2446624112 shutdown_connections 2024-09-17T05:38:51.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 -- 172.21.15.44:0/2446624112 wait complete. 2024-09-17T05:38:51.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 Processor -- start 2024-09-17T05:38:51.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.385+0000 7f14e3200640 1 -- start start 2024-09-17T05:38:51.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14dc06e390 0x7f14dc0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc0b5880 0x7f14dc153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14dc0ce130 0x7f14dc09ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc16a2c0 con 0x7f14dc0b5880 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc16a140 con 0x7f14dc06e390 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f14dc16a440 con 0x7f14dc0ce130 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc0b5880 0x7f14dc153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc0b5880 0x7f14dc153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36002/0 (socket says 172.21.15.44:36002) 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 -- 172.21.15.44:0/4165341488 learned_addr learned my addr 172.21.15.44:0/4165341488 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14dbe00640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14dc06e390 0x7f14dc0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e1200640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14dc0ce130 0x7f14dc09ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 -- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14dc0ce130 msgr2=0x7f14dc09ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14dc0ce130 0x7f14dc09ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 -- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14dc06e390 msgr2=0x7f14dc0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14dc06e390 0x7f14dc0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 -- 172.21.15.44:0/4165341488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc0a13e0 con 0x7f14dc0b5880 2024-09-17T05:38:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d3400640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc0b5880 0x7f14dc153760 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f14c40b0040 tx=0x7f14c40a5580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:51.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d8c00640 1 -- 172.21.15.44:0/4165341488 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c40b2040 con 0x7f14dc0b5880 2024-09-17T05:38:51.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d8c00640 1 -- 172.21.15.44:0/4165341488 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14c40043b0 con 0x7f14dc0b5880 2024-09-17T05:38:51.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc09f330 con 0x7f14dc0b5880 2024-09-17T05:38:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14d8c00640 1 -- 172.21.15.44:0/4165341488 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4005280 con 0x7f14dc0b5880 2024-09-17T05:38:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc09f8f0 con 0x7f14dc0b5880 2024-09-17T05:38:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.389+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14dc0b5230 con 0x7f14dc0b5880 2024-09-17T05:38:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.393+0000 7f14d8c00640 1 -- 172.21.15.44:0/4165341488 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f14c4005420 con 0x7f14dc0b5880 2024-09-17T05:38:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.393+0000 7f14d8c00640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f14b8073200 0x7f14b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.393+0000 7f14d8c00640 1 -- 172.21.15.44:0/4165341488 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f14c412de60 con 0x7f14dc0b5880 2024-09-17T05:38:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.393+0000 7f14dbe00640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f14b8073200 0x7f14b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.393+0000 7f14dbe00640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f14b8073200 0x7f14b8075710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f14cc004630 tx=0x7f14cc00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:51.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.397+0000 7f14d8c00640 1 -- 172.21.15.44:0/4165341488 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f14c40164b0 con 0x7f14dc0b5880 2024-09-17T05:38:51.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.569+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14dc0cdbd0 con 0x7f14b8073200 2024-09-17T05:38:51.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.573+0000 7f14d8c00640 1 -- 172.21.15.44:0/4165341488 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247321 (secure 0 0 0) 0x7f14dc0cdbd0 con 0x7f14b8073200 2024-09-17T05:38:51.578 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:51.579 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:38:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f14b8073200 msgr2=0x7f14b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f14b8073200 0x7f14b8075710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f14cc004630 tx=0x7f14cc00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc0b5880 msgr2=0x7f14dc153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc0b5880 0x7f14dc153760 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f14c40b0040 tx=0x7f14c40a5580 comp rx=0 tx=0).stop 2024-09-17T05:38:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 shutdown_connections 2024-09-17T05:38:51.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f14dc0ce130 0x7f14dc09ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14dc0b5880 0x7f14dc153760 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f14b8073200 0x7f14b8075710 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 --2- 172.21.15.44:0/4165341488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14dc06e390 0x7f14dc0c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 >> 172.21.15.44:0/4165341488 conn(0x7f14dc0ccaa0 msgr2=0x7f14dc0b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 shutdown_connections 2024-09-17T05:38:51.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.577+0000 7f14e3200640 1 -- 172.21.15.44:0/4165341488 wait complete. 2024-09-17T05:38:51.599 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-17T05:38:50.298000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239816,"kb_used_data":6936,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734904,"statfs":{"total":773094113280,"available":772848541696,"internally_reserved":0,"allocated":7102464,"data_stored":3793251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762790"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.591698+0000","last_change":"2024-09-17T05:38:46.583715+0000","last_active":"2024-09-17T05:38:46.591698+0000","last_peered":"2024-09-17T05:38:46.591698+0000","last_clean":"2024-09-17T05:38:46.591698+0000","last_became_active":"2024-09-17T05:38:46.583363+0000","last_became_peered":"2024-09-17T05:38:46.583363+0000","last_unstale":"2024-09-17T05:38:46.591698+0000","last_undegraded":"2024-09-17T05:38:46.591698+0000","last_fullsized":"2024-09-17T05:38:46.591698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:09.088815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540090+0000","last_change":"2024-09-17T05:38:45.540090+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540090+0000","last_undegraded":"2024-09-17T05:38:45.540090+0000","last_fullsized":"2024-09-17T05:38:45.540090+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541369+0000","last_change":"2024-09-17T05:38:45.541369+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541369+0000","last_undegraded":"2024-09-17T05:38:45.541369+0000","last_fullsized":"2024-09-17T05:38:45.541369+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.561517+0000","last_change":"2024-09-17T05:38:45.561517+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.561517+0000","last_undegraded":"2024-09-17T05:38:45.561517+0000","last_fullsized":"2024-09-17T05:38:45.561517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540381+0000","last_change":"2024-09-17T05:38:45.540381+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540381+0000","last_undegraded":"2024-09-17T05:38:45.540381+0000","last_fullsized":"2024-09-17T05:38:45.540381+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.542165+0000","last_change":"2024-09-17T05:38:45.542165+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.542165+0000","last_undegraded":"2024-09-17T05:38:45.542165+0000","last_fullsized":"2024-09-17T05:38:45.542165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.581278+0000","last_change":"2024-09-17T05:38:46.576539+0000","last_active":"2024-09-17T05:38:46.581278+0000","last_peered":"2024-09-17T05:38:46.581278+0000","last_clean":"2024-09-17T05:38:46.581278+0000","last_became_active":"2024-09-17T05:38:46.576080+0000","last_became_peered":"2024-09-17T05:38:46.576080+0000","last_unstale":"2024-09-17T05:38:46.581278+0000","last_undegraded":"2024-09-17T05:38:46.581278+0000","last_fullsized":"2024-09-17T05:38:46.581278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:47.968279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541085+0000","last_change":"2024-09-17T05:38:45.541085+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541085+0000","last_undegraded":"2024-09-17T05:38:45.541085+0000","last_fullsized":"2024-09-17T05:38:45.541085+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557612+0000","last_change":"2024-09-17T05:38:45.557612+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557612+0000","last_undegraded":"2024-09-17T05:38:45.557612+0000","last_fullsized":"2024-09-17T05:38:45.557612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553373+0000","last_change":"2024-09-17T05:38:45.553373+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553373+0000","last_undegraded":"2024-09-17T05:38:45.553373+0000","last_fullsized":"2024-09-17T05:38:45.553373+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557223+0000","last_change":"2024-09-17T05:38:45.557223+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557223+0000","last_undegraded":"2024-09-17T05:38:45.557223+0000","last_fullsized":"2024-09-17T05:38:45.557223+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.560998+0000","last_change":"2024-09-17T05:38:45.560998+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.560998+0000","last_undegraded":"2024-09-17T05:38:45.560998+0000","last_fullsized":"2024-09-17T05:38:45.560998+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.547150+0000","last_change":"2024-09-17T05:38:45.547150+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.547150+0000","last_undegraded":"2024-09-17T05:38:45.547150+0000","last_fullsized":"2024-09-17T05:38:45.547150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546009+0000","last_change":"2024-09-17T05:38:45.546009+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546009+0000","last_undegraded":"2024-09-17T05:38:45.546009+0000","last_fullsized":"2024-09-17T05:38:45.546009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551156+0000","last_change":"2024-09-17T05:38:45.551156+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551156+0000","last_undegraded":"2024-09-17T05:38:45.551156+0000","last_fullsized":"2024-09-17T05:38:45.551156+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553341+0000","last_change":"2024-09-17T05:38:45.553341+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553341+0000","last_undegraded":"2024-09-17T05:38:45.553341+0000","last_fullsized":"2024-09-17T05:38:45.553341+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549405+0000","last_change":"2024-09-17T05:38:45.549405+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549405+0000","last_undegraded":"2024-09-17T05:38:45.549405+0000","last_fullsized":"2024-09-17T05:38:45.549405+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.557292+0000","last_change":"2024-09-17T05:38:45.557292+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.557292+0000","last_undegraded":"2024-09-17T05:38:45.557292+0000","last_fullsized":"2024-09-17T05:38:45.557292+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.556678+0000","last_change":"2024-09-17T05:38:45.556678+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.556678+0000","last_undegraded":"2024-09-17T05:38:45.556678+0000","last_fullsized":"2024-09-17T05:38:45.556678+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550992+0000","last_change":"2024-09-17T05:38:45.550992+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550992+0000","last_undegraded":"2024-09-17T05:38:45.550992+0000","last_fullsized":"2024-09-17T05:38:45.550992+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546542+0000","last_change":"2024-09-17T05:38:45.546542+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546542+0000","last_undegraded":"2024-09-17T05:38:45.546542+0000","last_fullsized":"2024-09-17T05:38:45.546542+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.539466+0000","last_change":"2024-09-17T05:38:45.539466+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.539466+0000","last_undegraded":"2024-09-17T05:38:45.539466+0000","last_fullsized":"2024-09-17T05:38:45.539466+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552745+0000","last_change":"2024-09-17T05:38:45.552745+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552745+0000","last_undegraded":"2024-09-17T05:38:45.552745+0000","last_fullsized":"2024-09-17T05:38:45.552745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540510+0000","last_change":"2024-09-17T05:38:45.540510+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540510+0000","last_undegraded":"2024-09-17T05:38:45.540510+0000","last_fullsized":"2024-09-17T05:38:45.540510+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549820+0000","last_change":"2024-09-17T05:38:45.549820+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549820+0000","last_undegraded":"2024-09-17T05:38:45.549820+0000","last_fullsized":"2024-09-17T05:38:45.549820+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541657+0000","last_change":"2024-09-17T05:38:45.541657+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541657+0000","last_undegraded":"2024-09-17T05:38:45.541657+0000","last_fullsized":"2024-09-17T05:38:45.541657+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548456+0000","last_change":"2024-09-17T05:38:45.548456+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548456+0000","last_undegraded":"2024-09-17T05:38:45.548456+0000","last_fullsized":"2024-09-17T05:38:45.548456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575662+0000","last_change":"2024-09-17T05:38:46.566215+0000","last_active":"2024-09-17T05:38:46.575662+0000","last_peered":"2024-09-17T05:38:46.575662+0000","last_clean":"2024-09-17T05:38:46.575662+0000","last_became_active":"2024-09-17T05:38:46.565932+0000","last_became_peered":"2024-09-17T05:38:46.565932+0000","last_unstale":"2024-09-17T05:38:46.575662+0000","last_undegraded":"2024-09-17T05:38:46.575662+0000","last_fullsized":"2024-09-17T05:38:46.575662+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:55.360415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.555583+0000","last_change":"2024-09-17T05:38:45.555583+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.555583+0000","last_undegraded":"2024-09-17T05:38:45.555583+0000","last_fullsized":"2024-09-17T05:38:45.555583+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.553798+0000","last_change":"2024-09-17T05:38:45.553798+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.553798+0000","last_undegraded":"2024-09-17T05:38:45.553798+0000","last_fullsized":"2024-09-17T05:38:45.553798+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540370+0000","last_change":"2024-09-17T05:38:45.540370+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540370+0000","last_undegraded":"2024-09-17T05:38:45.540370+0000","last_fullsized":"2024-09-17T05:38:45.540370+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592100+0000","last_change":"2024-09-17T05:38:46.581873+0000","last_active":"2024-09-17T05:38:46.592100+0000","last_peered":"2024-09-17T05:38:46.592100+0000","last_clean":"2024-09-17T05:38:46.592100+0000","last_became_active":"2024-09-17T05:38:46.581393+0000","last_became_peered":"2024-09-17T05:38:46.581393+0000","last_unstale":"2024-09-17T05:38:46.592100+0000","last_undegraded":"2024-09-17T05:38:46.592100+0000","last_fullsized":"2024-09-17T05:38:46.592100+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:50.725323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550985+0000","last_change":"2024-09-17T05:38:45.550985+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550985+0000","last_undegraded":"2024-09-17T05:38:45.550985+0000","last_fullsized":"2024-09-17T05:38:45.550985+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.602119+0000","last_change":"2024-09-17T05:38:45.557221+0000","last_active":"2024-09-17T05:38:46.602119+0000","last_peered":"2024-09-17T05:38:46.602119+0000","last_clean":"2024-09-17T05:38:46.602119+0000","last_became_active":"2024-09-17T05:38:45.556870+0000","last_became_peered":"2024-09-17T05:38:45.556870+0000","last_unstale":"2024-09-17T05:38:46.602119+0000","last_undegraded":"2024-09-17T05:38:46.602119+0000","last_fullsized":"2024-09-17T05:38:46.602119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:15.758423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540875+0000","last_change":"2024-09-17T05:38:45.540875+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540875+0000","last_undegraded":"2024-09-17T05:38:45.540875+0000","last_fullsized":"2024-09-17T05:38:45.540875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.601073+0000","last_change":"2024-09-17T05:38:45.566302+0000","last_active":"2024-09-17T05:38:46.601073+0000","last_peered":"2024-09-17T05:38:46.601073+0000","last_clean":"2024-09-17T05:38:46.601073+0000","last_became_active":"2024-09-17T05:38:45.565920+0000","last_became_peered":"2024-09-17T05:38:45.565920+0000","last_unstale":"2024-09-17T05:38:46.601073+0000","last_undegraded":"2024-09-17T05:38:46.601073+0000","last_fullsized":"2024-09-17T05:38:46.601073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:15.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.539550+0000","last_change":"2024-09-17T05:38:45.539550+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.539550+0000","last_undegraded":"2024-09-17T05:38:45.539550+0000","last_fullsized":"2024-09-17T05:38:45.539550+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.599298+0000","last_change":"2024-09-17T05:38:45.563577+0000","last_active":"2024-09-17T05:38:46.599298+0000","last_peered":"2024-09-17T05:38:46.599298+0000","last_clean":"2024-09-17T05:38:46.599298+0000","last_became_active":"2024-09-17T05:38:45.563266+0000","last_became_peered":"2024-09-17T05:38:45.563266+0000","last_unstale":"2024-09-17T05:38:46.599298+0000","last_undegraded":"2024-09-17T05:38:46.599298+0000","last_fullsized":"2024-09-17T05:38:46.599298+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:24.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550672+0000","last_change":"2024-09-17T05:38:45.550672+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550672+0000","last_undegraded":"2024-09-17T05:38:45.550672+0000","last_fullsized":"2024-09-17T05:38:45.550672+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562107+0000","last_change":"2024-09-17T05:38:45.556629+0000","last_active":"2024-09-17T05:38:45.562107+0000","last_peered":"2024-09-17T05:38:45.562107+0000","last_clean":"2024-09-17T05:38:45.562107+0000","last_became_active":"2024-09-17T05:38:45.556195+0000","last_became_peered":"2024-09-17T05:38:45.556195+0000","last_unstale":"2024-09-17T05:38:45.562107+0000","last_undegraded":"2024-09-17T05:38:45.562107+0000","last_fullsized":"2024-09-17T05:38:45.562107+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:47.232389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550178+0000","last_change":"2024-09-17T05:38:45.550178+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550178+0000","last_undegraded":"2024-09-17T05:38:45.550178+0000","last_fullsized":"2024-09-17T05:38:45.550178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568240+0000","last_change":"2024-09-17T05:38:45.565943+0000","last_active":"2024-09-17T05:38:45.568240+0000","last_peered":"2024-09-17T05:38:45.568240+0000","last_clean":"2024-09-17T05:38:45.568240+0000","last_became_active":"2024-09-17T05:38:45.565559+0000","last_became_peered":"2024-09-17T05:38:45.565559+0000","last_unstale":"2024-09-17T05:38:45.568240+0000","last_undegraded":"2024-09-17T05:38:45.568240+0000","last_fullsized":"2024-09-17T05:38:45.568240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:48.979548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.574340+0000","last_change":"2024-09-17T05:38:46.566137+0000","last_active":"2024-09-17T05:38:46.574340+0000","last_peered":"2024-09-17T05:38:46.574340+0000","last_clean":"2024-09-17T05:38:46.574340+0000","last_became_active":"2024-09-17T05:38:46.565806+0000","last_became_peered":"2024-09-17T05:38:46.565806+0000","last_unstale":"2024-09-17T05:38:46.574340+0000","last_undegraded":"2024-09-17T05:38:46.574340+0000","last_fullsized":"2024-09-17T05:38:46.574340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:13.028402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568900+0000","last_change":"2024-09-17T05:38:45.564188+0000","last_active":"2024-09-17T05:38:45.568900+0000","last_peered":"2024-09-17T05:38:45.568900+0000","last_clean":"2024-09-17T05:38:45.568900+0000","last_became_active":"2024-09-17T05:38:45.562211+0000","last_became_peered":"2024-09-17T05:38:45.562211+0000","last_unstale":"2024-09-17T05:38:45.568900+0000","last_undegraded":"2024-09-17T05:38:45.568900+0000","last_fullsized":"2024-09-17T05:38:45.568900+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:24.997155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551140+0000","last_change":"2024-09-17T05:38:45.551140+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551140+0000","last_undegraded":"2024-09-17T05:38:45.551140+0000","last_fullsized":"2024-09-17T05:38:45.551140+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562074+0000","last_change":"2024-09-17T05:38:45.558292+0000","last_active":"2024-09-17T05:38:46.562074+0000","last_peered":"2024-09-17T05:38:46.562074+0000","last_clean":"2024-09-17T05:38:46.562074+0000","last_became_active":"2024-09-17T05:38:45.557924+0000","last_became_peered":"2024-09-17T05:38:45.557924+0000","last_unstale":"2024-09-17T05:38:46.562074+0000","last_undegraded":"2024-09-17T05:38:46.562074+0000","last_fullsized":"2024-09-17T05:38:46.562074+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:11.908735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552591+0000","last_change":"2024-09-17T05:38:45.552591+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552591+0000","last_undegraded":"2024-09-17T05:38:45.552591+0000","last_fullsized":"2024-09-17T05:38:45.552591+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570614+0000","last_change":"2024-09-17T05:38:45.566557+0000","last_active":"2024-09-17T05:38:45.570614+0000","last_peered":"2024-09-17T05:38:45.570614+0000","last_clean":"2024-09-17T05:38:45.570614+0000","last_became_active":"2024-09-17T05:38:45.561815+0000","last_became_peered":"2024-09-17T05:38:45.561815+0000","last_unstale":"2024-09-17T05:38:45.570614+0000","last_undegraded":"2024-09-17T05:38:45.570614+0000","last_fullsized":"2024-09-17T05:38:45.570614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:16.431335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575697+0000","last_change":"2024-09-17T05:38:46.568855+0000","last_active":"2024-09-17T05:38:46.575697+0000","last_peered":"2024-09-17T05:38:46.575697+0000","last_clean":"2024-09-17T05:38:46.575697+0000","last_became_active":"2024-09-17T05:38:46.568540+0000","last_became_peered":"2024-09-17T05:38:46.568540+0000","last_unstale":"2024-09-17T05:38:46.575697+0000","last_undegraded":"2024-09-17T05:38:46.575697+0000","last_fullsized":"2024-09-17T05:38:46.575697+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:45.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570855+0000","last_change":"2024-09-17T05:38:45.563925+0000","last_active":"2024-09-17T05:38:45.570855+0000","last_peered":"2024-09-17T05:38:45.570855+0000","last_clean":"2024-09-17T05:38:45.570855+0000","last_became_active":"2024-09-17T05:38:45.563013+0000","last_became_peered":"2024-09-17T05:38:45.563013+0000","last_unstale":"2024-09-17T05:38:45.570855+0000","last_undegraded":"2024-09-17T05:38:45.570855+0000","last_fullsized":"2024-09-17T05:38:45.570855+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:03.050294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549925+0000","last_change":"2024-09-17T05:38:45.549925+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549925+0000","last_undegraded":"2024-09-17T05:38:45.549925+0000","last_fullsized":"2024-09-17T05:38:45.549925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570331+0000","last_change":"2024-09-17T05:38:45.562855+0000","last_active":"2024-09-17T05:38:45.570331+0000","last_peered":"2024-09-17T05:38:45.570331+0000","last_clean":"2024-09-17T05:38:45.570331+0000","last_became_active":"2024-09-17T05:38:45.562513+0000","last_became_peered":"2024-09-17T05:38:45.562513+0000","last_unstale":"2024-09-17T05:38:45.570331+0000","last_undegraded":"2024-09-17T05:38:45.570331+0000","last_fullsized":"2024-09-17T05:38:45.570331+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549875+0000","last_change":"2024-09-17T05:38:45.549875+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549875+0000","last_undegraded":"2024-09-17T05:38:45.549875+0000","last_fullsized":"2024-09-17T05:38:45.549875+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.560753+0000","last_change":"2024-09-17T05:38:45.557154+0000","last_active":"2024-09-17T05:38:45.560753+0000","last_peered":"2024-09-17T05:38:45.560753+0000","last_clean":"2024-09-17T05:38:45.560753+0000","last_became_active":"2024-09-17T05:38:45.556734+0000","last_became_peered":"2024-09-17T05:38:45.556734+0000","last_unstale":"2024-09-17T05:38:45.560753+0000","last_undegraded":"2024-09-17T05:38:45.560753+0000","last_fullsized":"2024-09-17T05:38:45.560753+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:14.656044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.543028+0000","last_change":"2024-09-17T05:38:45.543028+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.543028+0000","last_undegraded":"2024-09-17T05:38:45.543028+0000","last_fullsized":"2024-09-17T05:38:45.543028+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562141+0000","last_change":"2024-09-17T05:38:45.557059+0000","last_active":"2024-09-17T05:38:45.562141+0000","last_peered":"2024-09-17T05:38:45.562141+0000","last_clean":"2024-09-17T05:38:45.562141+0000","last_became_active":"2024-09-17T05:38:45.556369+0000","last_became_peered":"2024-09-17T05:38:45.556369+0000","last_unstale":"2024-09-17T05:38:45.562141+0000","last_undegraded":"2024-09-17T05:38:45.562141+0000","last_fullsized":"2024-09-17T05:38:45.562141+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:56.172141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551704+0000","last_change":"2024-09-17T05:38:45.551704+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551704+0000","last_undegraded":"2024-09-17T05:38:45.551704+0000","last_fullsized":"2024-09-17T05:38:45.551704+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570915+0000","last_change":"2024-09-17T05:38:45.561797+0000","last_active":"2024-09-17T05:38:45.570915+0000","last_peered":"2024-09-17T05:38:45.570915+0000","last_clean":"2024-09-17T05:38:45.570915+0000","last_became_active":"2024-09-17T05:38:45.561441+0000","last_became_peered":"2024-09-17T05:38:45.561441+0000","last_unstale":"2024-09-17T05:38:45.570915+0000","last_undegraded":"2024-09-17T05:38:45.570915+0000","last_fullsized":"2024-09-17T05:38:45.570915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:00.735046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550527+0000","last_change":"2024-09-17T05:38:45.550527+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550527+0000","last_undegraded":"2024-09-17T05:38:45.550527+0000","last_fullsized":"2024-09-17T05:38:45.550527+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569670+0000","last_change":"2024-09-17T05:38:45.565807+0000","last_active":"2024-09-17T05:38:45.569670+0000","last_peered":"2024-09-17T05:38:45.569670+0000","last_clean":"2024-09-17T05:38:45.569670+0000","last_became_active":"2024-09-17T05:38:45.565418+0000","last_became_peered":"2024-09-17T05:38:45.565418+0000","last_unstale":"2024-09-17T05:38:45.569670+0000","last_undegraded":"2024-09-17T05:38:45.569670+0000","last_fullsized":"2024-09-17T05:38:45.569670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:39.359240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.552082+0000","last_change":"2024-09-17T05:38:45.552082+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.552082+0000","last_undegraded":"2024-09-17T05:38:45.552082+0000","last_fullsized":"2024-09-17T05:38:45.552082+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570676+0000","last_change":"2024-09-17T05:38:45.560944+0000","last_active":"2024-09-17T05:38:45.570676+0000","last_peered":"2024-09-17T05:38:45.570676+0000","last_clean":"2024-09-17T05:38:45.570676+0000","last_became_active":"2024-09-17T05:38:45.559926+0000","last_became_peered":"2024-09-17T05:38:45.559926+0000","last_unstale":"2024-09-17T05:38:45.570676+0000","last_undegraded":"2024-09-17T05:38:45.570676+0000","last_fullsized":"2024-09-17T05:38:45.570676+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:46.035792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592302+0000","last_change":"2024-09-17T05:38:46.588274+0000","last_active":"2024-09-17T05:38:46.592302+0000","last_peered":"2024-09-17T05:38:46.592302+0000","last_clean":"2024-09-17T05:38:46.592302+0000","last_became_active":"2024-09-17T05:38:46.587955+0000","last_became_peered":"2024-09-17T05:38:46.587955+0000","last_unstale":"2024-09-17T05:38:46.592302+0000","last_undegraded":"2024-09-17T05:38:46.592302+0000","last_fullsized":"2024-09-17T05:38:46.592302+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:06.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569657+0000","last_change":"2024-09-17T05:38:45.566154+0000","last_active":"2024-09-17T05:38:45.569657+0000","last_peered":"2024-09-17T05:38:45.569657+0000","last_clean":"2024-09-17T05:38:45.569657+0000","last_became_active":"2024-09-17T05:38:45.565707+0000","last_became_peered":"2024-09-17T05:38:45.565707+0000","last_unstale":"2024-09-17T05:38:45.569657+0000","last_undegraded":"2024-09-17T05:38:45.569657+0000","last_fullsized":"2024-09-17T05:38:45.569657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:37.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549865+0000","last_change":"2024-09-17T05:38:45.549865+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549865+0000","last_undegraded":"2024-09-17T05:38:45.549865+0000","last_fullsized":"2024-09-17T05:38:45.549865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570879+0000","last_change":"2024-09-17T05:38:45.567988+0000","last_active":"2024-09-17T05:38:45.570879+0000","last_peered":"2024-09-17T05:38:45.570879+0000","last_clean":"2024-09-17T05:38:45.570879+0000","last_became_active":"2024-09-17T05:38:45.567377+0000","last_became_peered":"2024-09-17T05:38:45.567377+0000","last_unstale":"2024-09-17T05:38:45.570879+0000","last_undegraded":"2024-09-17T05:38:45.570879+0000","last_fullsized":"2024-09-17T05:38:45.570879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:13.538060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.547962+0000","last_change":"2024-09-17T05:38:45.547962+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.547962+0000","last_undegraded":"2024-09-17T05:38:45.547962+0000","last_fullsized":"2024-09-17T05:38:45.547962+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570803+0000","last_change":"2024-09-17T05:38:45.563646+0000","last_active":"2024-09-17T05:38:45.570803+0000","last_peered":"2024-09-17T05:38:45.570803+0000","last_clean":"2024-09-17T05:38:45.570803+0000","last_became_active":"2024-09-17T05:38:45.562598+0000","last_became_peered":"2024-09-17T05:38:45.562598+0000","last_unstale":"2024-09-17T05:38:45.570803+0000","last_undegraded":"2024-09-17T05:38:45.570803+0000","last_fullsized":"2024-09-17T05:38:45.570803+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:25.832091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549422+0000","last_change":"2024-09-17T05:38:45.549422+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549422+0000","last_undegraded":"2024-09-17T05:38:45.549422+0000","last_fullsized":"2024-09-17T05:38:45.549422+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.560133+0000","last_change":"2024-09-17T05:38:45.553121+0000","last_active":"2024-09-17T05:38:45.560133+0000","last_peered":"2024-09-17T05:38:45.560133+0000","last_clean":"2024-09-17T05:38:45.560133+0000","last_became_active":"2024-09-17T05:38:45.552295+0000","last_became_peered":"2024-09-17T05:38:45.552295+0000","last_unstale":"2024-09-17T05:38:45.560133+0000","last_undegraded":"2024-09-17T05:38:45.560133+0000","last_fullsized":"2024-09-17T05:38:45.560133+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:03.103089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.542464+0000","last_change":"2024-09-17T05:38:45.542464+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.542464+0000","last_undegraded":"2024-09-17T05:38:45.542464+0000","last_fullsized":"2024-09-17T05:38:45.542464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.572853+0000","last_change":"2024-09-17T05:38:45.570706+0000","last_active":"2024-09-17T05:38:45.572853+0000","last_peered":"2024-09-17T05:38:45.572853+0000","last_clean":"2024-09-17T05:38:45.572853+0000","last_became_active":"2024-09-17T05:38:45.570023+0000","last_became_peered":"2024-09-17T05:38:45.570023+0000","last_unstale":"2024-09-17T05:38:45.572853+0000","last_undegraded":"2024-09-17T05:38:45.572853+0000","last_fullsized":"2024-09-17T05:38:45.572853+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:33.876827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.540648+0000","last_change":"2024-09-17T05:38:45.540648+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.540648+0000","last_undegraded":"2024-09-17T05:38:45.540648+0000","last_fullsized":"2024-09-17T05:38:45.540648+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.563685+0000","last_change":"2024-09-17T05:38:45.551826+0000","last_active":"2024-09-17T05:38:45.563685+0000","last_peered":"2024-09-17T05:38:45.563685+0000","last_clean":"2024-09-17T05:38:45.563685+0000","last_became_active":"2024-09-17T05:38:45.551495+0000","last_became_peered":"2024-09-17T05:38:45.551495+0000","last_unstale":"2024-09-17T05:38:45.563685+0000","last_undegraded":"2024-09-17T05:38:45.563685+0000","last_fullsized":"2024-09-17T05:38:45.563685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:35.634545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548005+0000","last_change":"2024-09-17T05:38:45.548005+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548005+0000","last_undegraded":"2024-09-17T05:38:45.548005+0000","last_fullsized":"2024-09-17T05:38:45.548005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.569637+0000","last_change":"2024-09-17T05:38:45.565496+0000","last_active":"2024-09-17T05:38:45.569637+0000","last_peered":"2024-09-17T05:38:45.569637+0000","last_clean":"2024-09-17T05:38:45.569637+0000","last_became_active":"2024-09-17T05:38:45.564983+0000","last_became_peered":"2024-09-17T05:38:45.564983+0000","last_unstale":"2024-09-17T05:38:45.569637+0000","last_undegraded":"2024-09-17T05:38:45.569637+0000","last_fullsized":"2024-09-17T05:38:45.569637+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:31.444638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549343+0000","last_change":"2024-09-17T05:38:45.549343+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549343+0000","last_undegraded":"2024-09-17T05:38:45.549343+0000","last_fullsized":"2024-09-17T05:38:45.549343+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562084+0000","last_change":"2024-09-17T05:38:45.554558+0000","last_active":"2024-09-17T05:38:45.562084+0000","last_peered":"2024-09-17T05:38:45.562084+0000","last_clean":"2024-09-17T05:38:45.562084+0000","last_became_active":"2024-09-17T05:38:45.553507+0000","last_became_peered":"2024-09-17T05:38:45.553507+0000","last_unstale":"2024-09-17T05:38:45.562084+0000","last_undegraded":"2024-09-17T05:38:45.562084+0000","last_fullsized":"2024-09-17T05:38:45.562084+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:57.682448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.550481+0000","last_change":"2024-09-17T05:38:45.550481+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.550481+0000","last_undegraded":"2024-09-17T05:38:45.550481+0000","last_fullsized":"2024-09-17T05:38:45.550481+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570827+0000","last_change":"2024-09-17T05:38:45.563341+0000","last_active":"2024-09-17T05:38:45.570827+0000","last_peered":"2024-09-17T05:38:45.570827+0000","last_clean":"2024-09-17T05:38:45.570827+0000","last_became_active":"2024-09-17T05:38:45.562575+0000","last_became_peered":"2024-09-17T05:38:45.562575+0000","last_unstale":"2024-09-17T05:38:45.570827+0000","last_undegraded":"2024-09-17T05:38:45.570827+0000","last_fullsized":"2024-09-17T05:38:45.570827+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:57.566772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.549015+0000","last_change":"2024-09-17T05:38:45.549015+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.549015+0000","last_undegraded":"2024-09-17T05:38:45.549015+0000","last_fullsized":"2024-09-17T05:38:45.549015+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.570831+0000","last_change":"2024-09-17T05:38:45.567767+0000","last_active":"2024-09-17T05:38:45.570831+0000","last_peered":"2024-09-17T05:38:45.570831+0000","last_clean":"2024-09-17T05:38:45.570831+0000","last_became_active":"2024-09-17T05:38:45.567450+0000","last_became_peered":"2024-09-17T05:38:45.567450+0000","last_unstale":"2024-09-17T05:38:45.570831+0000","last_undegraded":"2024-09-17T05:38:45.570831+0000","last_fullsized":"2024-09-17T05:38:45.570831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:49.861577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541167+0000","last_change":"2024-09-17T05:38:45.541167+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541167+0000","last_undegraded":"2024-09-17T05:38:45.541167+0000","last_fullsized":"2024-09-17T05:38:45.541167+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.562173+0000","last_change":"2024-09-17T05:38:45.554711+0000","last_active":"2024-09-17T05:38:45.562173+0000","last_peered":"2024-09-17T05:38:45.562173+0000","last_clean":"2024-09-17T05:38:45.562173+0000","last_became_active":"2024-09-17T05:38:45.554349+0000","last_became_peered":"2024-09-17T05:38:45.554349+0000","last_unstale":"2024-09-17T05:38:45.562173+0000","last_undegraded":"2024-09-17T05:38:45.562173+0000","last_fullsized":"2024-09-17T05:38:45.562173+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:38.000843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541935+0000","last_change":"2024-09-17T05:38:45.541935+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541935+0000","last_undegraded":"2024-09-17T05:38:45.541935+0000","last_fullsized":"2024-09-17T05:38:45.541935+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571034+0000","last_change":"2024-09-17T05:38:45.566114+0000","last_active":"2024-09-17T05:38:45.571034+0000","last_peered":"2024-09-17T05:38:45.571034+0000","last_clean":"2024-09-17T05:38:45.571034+0000","last_became_active":"2024-09-17T05:38:45.565806+0000","last_became_peered":"2024-09-17T05:38:45.565806+0000","last_unstale":"2024-09-17T05:38:45.571034+0000","last_undegraded":"2024-09-17T05:38:45.571034+0000","last_fullsized":"2024-09-17T05:38:45.571034+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:18.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.548681+0000","last_change":"2024-09-17T05:38:45.548681+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.548681+0000","last_undegraded":"2024-09-17T05:38:45.548681+0000","last_fullsized":"2024-09-17T05:38:45.548681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571620+0000","last_change":"2024-09-17T05:38:45.565198+0000","last_active":"2024-09-17T05:38:45.571620+0000","last_peered":"2024-09-17T05:38:45.571620+0000","last_clean":"2024-09-17T05:38:45.571620+0000","last_became_active":"2024-09-17T05:38:45.564886+0000","last_became_peered":"2024-09-17T05:38:45.564886+0000","last_unstale":"2024-09-17T05:38:45.571620+0000","last_undegraded":"2024-09-17T05:38:45.571620+0000","last_fullsized":"2024-09-17T05:38:45.571620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:29.762278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.546205+0000","last_change":"2024-09-17T05:38:45.546205+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.546205+0000","last_undegraded":"2024-09-17T05:38:45.546205+0000","last_fullsized":"2024-09-17T05:38:45.546205+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562004+0000","last_change":"2024-09-17T05:38:45.560114+0000","last_active":"2024-09-17T05:38:46.562004+0000","last_peered":"2024-09-17T05:38:46.562004+0000","last_clean":"2024-09-17T05:38:46.562004+0000","last_became_active":"2024-09-17T05:38:45.559793+0000","last_became_peered":"2024-09-17T05:38:45.559793+0000","last_unstale":"2024-09-17T05:38:46.562004+0000","last_undegraded":"2024-09-17T05:38:46.562004+0000","last_fullsized":"2024-09-17T05:38:46.562004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:41.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.541464+0000","last_change":"2024-09-17T05:38:45.541464+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.541464+0000","last_undegraded":"2024-09-17T05:38:45.541464+0000","last_fullsized":"2024-09-17T05:38:45.541464+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.571201+0000","last_change":"2024-09-17T05:38:45.569074+0000","last_active":"2024-09-17T05:38:45.571201+0000","last_peered":"2024-09-17T05:38:45.571201+0000","last_clean":"2024-09-17T05:38:45.571201+0000","last_became_active":"2024-09-17T05:38:45.568523+0000","last_became_peered":"2024-09-17T05:38:45.568523+0000","last_unstale":"2024-09-17T05:38:45.571201+0000","last_undegraded":"2024-09-17T05:38:45.571201+0000","last_fullsized":"2024-09-17T05:38:45.571201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:29.762278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551007+0000","last_change":"2024-09-17T05:38:45.551007+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551007+0000","last_undegraded":"2024-09-17T05:38:45.551007+0000","last_fullsized":"2024-09-17T05:38:45.551007+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.565108+0000","last_change":"2024-09-17T05:38:45.556497+0000","last_active":"2024-09-17T05:38:45.565108+0000","last_peered":"2024-09-17T05:38:45.565108+0000","last_clean":"2024-09-17T05:38:45.565108+0000","last_became_active":"2024-09-17T05:38:45.556092+0000","last_became_peered":"2024-09-17T05:38:45.556092+0000","last_unstale":"2024-09-17T05:38:45.565108+0000","last_undegraded":"2024-09-17T05:38:45.565108+0000","last_fullsized":"2024-09-17T05:38:45.565108+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:28.933537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2024-09-17T05:38:45.551306+0000","last_change":"2024-09-17T05:38:45.551306+0000","last_active":"2024-09-17T05:38:45.533116+0000","last_peered":"2024-09-17T05:38:45.533116+0000","last_clean":"2024-09-17T05:38:45.533116+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:38:45.551306+0000","last_undegraded":"2024-09-17T05:38:45.551306+0000","last_fullsized":"2024-09-17T05:38:45.551306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.568513+0000","last_change":"2024-09-17T05:38:45.563687+0000","last_active":"2024-09-17T05:38:45.568513+0000","last_peered":"2024-09-17T05:38:45.568513+0000","last_clean":"2024-09-17T05:38:45.568513+0000","last_became_active":"2024-09-17T05:38:45.563295+0000","last_became_peered":"2024-09-17T05:38:45.563295+0000","last_unstale":"2024-09-17T05:38:45.568513+0000","last_undegraded":"2024-09-17T05:38:45.568513+0000","last_fullsized":"2024-09-17T05:38:45.568513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:46.497960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":186,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-17T05:38:45.555587+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:38:45.555587+0000","last_peered":"2024-09-17T05:38:45.555587+0000","last_clean":"2024-09-17T05:38:45.555587+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:38:45.555587+0000","last_undegraded":"2024-09-17T05:38:45.555587+0000","last_fullsized":"2024-09-17T05:38:45.555587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1335296,"data_stored":919087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":328719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":729088,"data_stored":322052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1323008,"data_stored":912420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31916,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339924,"statfs":{"total":96636764160,"available":96604082176,"internally_reserved":0,"allocated":741376,"data_stored":328719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":774144,"data_stored":338150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3e is not active+clean 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.540090+0000', 'last_change': '2024-09-17T05:38:45.540090+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.540090+0000', 'last_undegraded': '2024-09-17T05:38:45.540090+0000', 'last_fullsized': '2024-09-17T05:38:45.540090+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3d is not active+clean 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.541369+0000', 'last_change': '2024-09-17T05:38:45.541369+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.541369+0000', 'last_undegraded': '2024-09-17T05:38:45.541369+0000', 'last_fullsized': '2024-09-17T05:38:45.541369+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3c is not active+clean 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.561517+0000', 'last_change': '2024-09-17T05:38:45.561517+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.561517+0000', 'last_undegraded': '2024-09-17T05:38:45.561517+0000', 'last_fullsized': '2024-09-17T05:38:45.561517+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3b is not active+clean 2024-09-17T05:38:51.604 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.540381+0000', 'last_change': '2024-09-17T05:38:45.540381+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.540381+0000', 'last_undegraded': '2024-09-17T05:38:45.540381+0000', 'last_fullsized': '2024-09-17T05:38:45.540381+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3a is not active+clean 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.542165+0000', 'last_change': '2024-09-17T05:38:45.542165+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.542165+0000', 'last_undegraded': '2024-09-17T05:38:45.542165+0000', 'last_fullsized': '2024-09-17T05:38:45.542165+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.541085+0000', 'last_change': '2024-09-17T05:38:45.541085+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.541085+0000', 'last_undegraded': '2024-09-17T05:38:45.541085+0000', 'last_fullsized': '2024-09-17T05:38:45.541085+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:PG 10.37 is not active+clean 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.557612+0000', 'last_change': '2024-09-17T05:38:45.557612+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.557612+0000', 'last_undegraded': '2024-09-17T05:38:45.557612+0000', 'last_fullsized': '2024-09-17T05:38:45.557612+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:PG 10.36 is not active+clean 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.553373+0000', 'last_change': '2024-09-17T05:38:45.553373+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.553373+0000', 'last_undegraded': '2024-09-17T05:38:45.553373+0000', 'last_fullsized': '2024-09-17T05:38:45.553373+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:PG 10.35 is not active+clean 2024-09-17T05:38:51.605 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.557223+0000', 'last_change': '2024-09-17T05:38:45.557223+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.557223+0000', 'last_undegraded': '2024-09-17T05:38:45.557223+0000', 'last_fullsized': '2024-09-17T05:38:45.557223+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.560998+0000', 'last_change': '2024-09-17T05:38:45.560998+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.560998+0000', 'last_undegraded': '2024-09-17T05:38:45.560998+0000', 'last_fullsized': '2024-09-17T05:38:45.560998+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.547150+0000', 'last_change': '2024-09-17T05:38:45.547150+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.547150+0000', 'last_undegraded': '2024-09-17T05:38:45.547150+0000', 'last_fullsized': '2024-09-17T05:38:45.547150+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:PG 10.32 is not active+clean 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.546009+0000', 'last_change': '2024-09-17T05:38:45.546009+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.546009+0000', 'last_undegraded': '2024-09-17T05:38:45.546009+0000', 'last_fullsized': '2024-09-17T05:38:45.546009+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:PG 10.31 is not active+clean 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.551156+0000', 'last_change': '2024-09-17T05:38:45.551156+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.551156+0000', 'last_undegraded': '2024-09-17T05:38:45.551156+0000', 'last_fullsized': '2024-09-17T05:38:45.551156+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:PG 10.30 is not active+clean 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.553341+0000', 'last_change': '2024-09-17T05:38:45.553341+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.553341+0000', 'last_undegraded': '2024-09-17T05:38:45.553341+0000', 'last_fullsized': '2024-09-17T05:38:45.553341+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:38:51.606 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549405+0000', 'last_change': '2024-09-17T05:38:45.549405+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549405+0000', 'last_undegraded': '2024-09-17T05:38:45.549405+0000', 'last_fullsized': '2024-09-17T05:38:45.549405+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2e is not active+clean 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.557292+0000', 'last_change': '2024-09-17T05:38:45.557292+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.557292+0000', 'last_undegraded': '2024-09-17T05:38:45.557292+0000', 'last_fullsized': '2024-09-17T05:38:45.557292+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2d is not active+clean 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.556678+0000', 'last_change': '2024-09-17T05:38:45.556678+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.556678+0000', 'last_undegraded': '2024-09-17T05:38:45.556678+0000', 'last_fullsized': '2024-09-17T05:38:45.556678+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2c is not active+clean 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.550992+0000', 'last_change': '2024-09-17T05:38:45.550992+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.550992+0000', 'last_undegraded': '2024-09-17T05:38:45.550992+0000', 'last_fullsized': '2024-09-17T05:38:45.550992+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.546542+0000', 'last_change': '2024-09-17T05:38:45.546542+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.546542+0000', 'last_undegraded': '2024-09-17T05:38:45.546542+0000', 'last_fullsized': '2024-09-17T05:38:45.546542+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2a is not active+clean 2024-09-17T05:38:51.607 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.539466+0000', 'last_change': '2024-09-17T05:38:45.539466+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.539466+0000', 'last_undegraded': '2024-09-17T05:38:45.539466+0000', 'last_fullsized': '2024-09-17T05:38:45.539466+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:PG 10.29 is not active+clean 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.552745+0000', 'last_change': '2024-09-17T05:38:45.552745+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.552745+0000', 'last_undegraded': '2024-09-17T05:38:45.552745+0000', 'last_fullsized': '2024-09-17T05:38:45.552745+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:PG 10.28 is not active+clean 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.540510+0000', 'last_change': '2024-09-17T05:38:45.540510+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.540510+0000', 'last_undegraded': '2024-09-17T05:38:45.540510+0000', 'last_fullsized': '2024-09-17T05:38:45.540510+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549820+0000', 'last_change': '2024-09-17T05:38:45.549820+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549820+0000', 'last_undegraded': '2024-09-17T05:38:45.549820+0000', 'last_fullsized': '2024-09-17T05:38:45.549820+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.541657+0000', 'last_change': '2024-09-17T05:38:45.541657+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.541657+0000', 'last_undegraded': '2024-09-17T05:38:45.541657+0000', 'last_fullsized': '2024-09-17T05:38:45.541657+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:PG 10.25 is not active+clean 2024-09-17T05:38:51.608 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.548456+0000', 'last_change': '2024-09-17T05:38:45.548456+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.548456+0000', 'last_undegraded': '2024-09-17T05:38:45.548456+0000', 'last_fullsized': '2024-09-17T05:38:45.548456+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:PG 10.23 is not active+clean 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.555583+0000', 'last_change': '2024-09-17T05:38:45.555583+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.555583+0000', 'last_undegraded': '2024-09-17T05:38:45.555583+0000', 'last_fullsized': '2024-09-17T05:38:45.555583+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.553798+0000', 'last_change': '2024-09-17T05:38:45.553798+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.553798+0000', 'last_undegraded': '2024-09-17T05:38:45.553798+0000', 'last_fullsized': '2024-09-17T05:38:45.553798+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:PG 10.21 is not active+clean 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.540370+0000', 'last_change': '2024-09-17T05:38:45.540370+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.540370+0000', 'last_undegraded': '2024-09-17T05:38:45.540370+0000', 'last_fullsized': '2024-09-17T05:38:45.540370+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.550985+0000', 'last_change': '2024-09-17T05:38:45.550985+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.550985+0000', 'last_undegraded': '2024-09-17T05:38:45.550985+0000', 'last_fullsized': '2024-09-17T05:38:45.550985+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.540875+0000', 'last_change': '2024-09-17T05:38:45.540875+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.540875+0000', 'last_undegraded': '2024-09-17T05:38:45.540875+0000', 'last_fullsized': '2024-09-17T05:38:45.540875+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.609 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.539550+0000', 'last_change': '2024-09-17T05:38:45.539550+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.539550+0000', 'last_undegraded': '2024-09-17T05:38:45.539550+0000', 'last_fullsized': '2024-09-17T05:38:45.539550+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.550672+0000', 'last_change': '2024-09-17T05:38:45.550672+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.550672+0000', 'last_undegraded': '2024-09-17T05:38:45.550672+0000', 'last_fullsized': '2024-09-17T05:38:45.550672+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.550178+0000', 'last_change': '2024-09-17T05:38:45.550178+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.550178+0000', 'last_undegraded': '2024-09-17T05:38:45.550178+0000', 'last_fullsized': '2024-09-17T05:38:45.550178+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.551140+0000', 'last_change': '2024-09-17T05:38:45.551140+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.551140+0000', 'last_undegraded': '2024-09-17T05:38:45.551140+0000', 'last_fullsized': '2024-09-17T05:38:45.551140+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.552591+0000', 'last_change': '2024-09-17T05:38:45.552591+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.552591+0000', 'last_undegraded': '2024-09-17T05:38:45.552591+0000', 'last_fullsized': '2024-09-17T05:38:45.552591+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-17T05:38:51.610 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549925+0000', 'last_change': '2024-09-17T05:38:45.549925+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549925+0000', 'last_undegraded': '2024-09-17T05:38:45.549925+0000', 'last_fullsized': '2024-09-17T05:38:45.549925+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549875+0000', 'last_change': '2024-09-17T05:38:45.549875+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549875+0000', 'last_undegraded': '2024-09-17T05:38:45.549875+0000', 'last_fullsized': '2024-09-17T05:38:45.549875+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.543028+0000', 'last_change': '2024-09-17T05:38:45.543028+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.543028+0000', 'last_undegraded': '2024-09-17T05:38:45.543028+0000', 'last_fullsized': '2024-09-17T05:38:45.543028+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.551704+0000', 'last_change': '2024-09-17T05:38:45.551704+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.551704+0000', 'last_undegraded': '2024-09-17T05:38:45.551704+0000', 'last_fullsized': '2024-09-17T05:38:45.551704+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.550527+0000', 'last_change': '2024-09-17T05:38:45.550527+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.550527+0000', 'last_undegraded': '2024-09-17T05:38:45.550527+0000', 'last_fullsized': '2024-09-17T05:38:45.550527+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-17T05:38:51.611 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.552082+0000', 'last_change': '2024-09-17T05:38:45.552082+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.552082+0000', 'last_undegraded': '2024-09-17T05:38:45.552082+0000', 'last_fullsized': '2024-09-17T05:38:45.552082+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549865+0000', 'last_change': '2024-09-17T05:38:45.549865+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549865+0000', 'last_undegraded': '2024-09-17T05:38:45.549865+0000', 'last_fullsized': '2024-09-17T05:38:45.549865+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.547962+0000', 'last_change': '2024-09-17T05:38:45.547962+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.547962+0000', 'last_undegraded': '2024-09-17T05:38:45.547962+0000', 'last_fullsized': '2024-09-17T05:38:45.547962+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549422+0000', 'last_change': '2024-09-17T05:38:45.549422+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549422+0000', 'last_undegraded': '2024-09-17T05:38:45.549422+0000', 'last_fullsized': '2024-09-17T05:38:45.549422+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.542464+0000', 'last_change': '2024-09-17T05:38:45.542464+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.542464+0000', 'last_undegraded': '2024-09-17T05:38:45.542464+0000', 'last_fullsized': '2024-09-17T05:38:45.542464+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-09-17T05:38:51.612 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.540648+0000', 'last_change': '2024-09-17T05:38:45.540648+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.540648+0000', 'last_undegraded': '2024-09-17T05:38:45.540648+0000', 'last_fullsized': '2024-09-17T05:38:45.540648+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.548005+0000', 'last_change': '2024-09-17T05:38:45.548005+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.548005+0000', 'last_undegraded': '2024-09-17T05:38:45.548005+0000', 'last_fullsized': '2024-09-17T05:38:45.548005+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549343+0000', 'last_change': '2024-09-17T05:38:45.549343+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549343+0000', 'last_undegraded': '2024-09-17T05:38:45.549343+0000', 'last_fullsized': '2024-09-17T05:38:45.549343+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.550481+0000', 'last_change': '2024-09-17T05:38:45.550481+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.550481+0000', 'last_undegraded': '2024-09-17T05:38:45.550481+0000', 'last_fullsized': '2024-09-17T05:38:45.550481+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.549015+0000', 'last_change': '2024-09-17T05:38:45.549015+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.549015+0000', 'last_undegraded': '2024-09-17T05:38:45.549015+0000', 'last_fullsized': '2024-09-17T05:38:45.549015+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-17T05:38:51.613 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.541167+0000', 'last_change': '2024-09-17T05:38:45.541167+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.541167+0000', 'last_undegraded': '2024-09-17T05:38:45.541167+0000', 'last_fullsized': '2024-09-17T05:38:45.541167+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.541935+0000', 'last_change': '2024-09-17T05:38:45.541935+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.541935+0000', 'last_undegraded': '2024-09-17T05:38:45.541935+0000', 'last_fullsized': '2024-09-17T05:38:45.541935+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.548681+0000', 'last_change': '2024-09-17T05:38:45.548681+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.548681+0000', 'last_undegraded': '2024-09-17T05:38:45.548681+0000', 'last_fullsized': '2024-09-17T05:38:45.548681+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.546205+0000', 'last_change': '2024-09-17T05:38:45.546205+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.546205+0000', 'last_undegraded': '2024-09-17T05:38:45.546205+0000', 'last_fullsized': '2024-09-17T05:38:45.546205+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.541464+0000', 'last_change': '2024-09-17T05:38:45.541464+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.541464+0000', 'last_undegraded': '2024-09-17T05:38:45.541464+0000', 'last_fullsized': '2024-09-17T05:38:45.541464+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.551007+0000', 'last_change': '2024-09-17T05:38:45.551007+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.551007+0000', 'last_undegraded': '2024-09-17T05:38:45.551007+0000', 'last_fullsized': '2024-09-17T05:38:45.551007+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-17T05:38:51.614 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:38:45.551306+0000', 'last_change': '2024-09-17T05:38:45.551306+0000', 'last_active': '2024-09-17T05:38:45.533116+0000', 'last_peered': '2024-09-17T05:38:45.533116+0000', 'last_clean': '2024-09-17T05:38:45.533116+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:38:45.551306+0000', 'last_undegraded': '2024-09-17T05:38:45.551306+0000', 'last_fullsized': '2024-09-17T05:38:45.551306+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'last_clean_scrub_stamp': '2024-09-17T05:38:45.533116+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:38:51.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 -- 172.21.15.44:0/2843262767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 msgr2=0x7fc2f40cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 --2- 172.21.15.44:0/2843262767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40cf190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4071d80 tx=0x7fc2e001c800 comp rx=0 tx=0).stop 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 -- 172.21.15.44:0/2843262767 shutdown_connections 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 --2- 172.21.15.44:0/2843262767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40cf190 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 --2- 172.21.15.44:0/2843262767 >> v2:172.21.15.86:3300/0 conn(0x7fc2f40cac30 0x7fc2f40cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 -- 172.21.15.44:0/2843262767 >> 172.21.15.44:0/2843262767 conn(0x7fc2f40ccaa0 msgr2=0x7fc2f40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 -- 172.21.15.44:0/2843262767 shutdown_connections 2024-09-17T05:38:51.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.801+0000 7fc2fc600640 1 -- 172.21.15.44:0/2843262767 wait complete. 2024-09-17T05:38:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 Processor -- start 2024-09-17T05:38:51.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 -- start start 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2f40cac30 0x7fc2f40a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2f415e8c0 0x7fc2f40b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4168420 con 0x7fc2f40cb040 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f41682a0 con 0x7fc2f40cac30 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f41685a0 con 0x7fc2f415e8c0 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36006/0 (socket says 172.21.15.44:36006) 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 -- 172.21.15.44:0/3506767881 learned_addr learned my addr 172.21.15.44:0/3506767881 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9c00640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2f40cac30 0x7fc2f40a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fa600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2f415e8c0 0x7fc2f40b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 -- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2f415e8c0 msgr2=0x7fc2f40b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2f415e8c0 0x7fc2f40b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 -- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2f40cac30 msgr2=0x7fc2f40a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2f40cac30 0x7fc2f40a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 -- 172.21.15.44:0/3506767881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40b43f0 con 0x7fc2f40cb040 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9c00640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2f40cac30 0x7fc2f40a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f9200640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40b4c20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc2e001cce0 tx=0x7fc2e0005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f1600640 1 -- 172.21.15.44:0/3506767881 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00b2040 con 0x7fc2f40cb040 2024-09-17T05:38:51.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f1600640 1 -- 172.21.15.44:0/3506767881 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2e0004040 con 0x7fc2f40cb040 2024-09-17T05:38:51.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2f1600640 1 -- 172.21.15.44:0/3506767881 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0004450 con 0x7fc2f40cb040 2024-09-17T05:38:51.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f409ff50 con 0x7fc2f40cb040 2024-09-17T05:38:51.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.805+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f40a0510 con 0x7fc2f40cb040 2024-09-17T05:38:51.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.809+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f415ecd0 con 0x7fc2f40cb040 2024-09-17T05:38:51.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.809+0000 7fc2f1600640 1 -- 172.21.15.44:0/3506767881 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc2e00bd030 con 0x7fc2f40cb040 2024-09-17T05:38:51.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.809+0000 7fc2f1600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2d4073200 0x7fc2d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:51.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.809+0000 7fc2f1600640 1 -- 172.21.15.44:0/3506767881 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fc2e012de10 con 0x7fc2f40cb040 2024-09-17T05:38:51.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.809+0000 7fc2f9c00640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2d4073200 0x7fc2d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:51.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.813+0000 7fc2f9c00640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2d4073200 0x7fc2d4075710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005fd0 tx=0x7fc2e8005f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:51.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:51.813+0000 7fc2f1600640 1 -- 172.21.15.44:0/3506767881 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc2e0131030 con 0x7fc2f40cb040 2024-09-17T05:38:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.049+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc2f40cd9f0 con 0x7fc2f40cb040 2024-09-17T05:38:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.049+0000 7fc2f1600640 1 -- 172.21.15.44:0/3506767881 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1558 (secure 0 0 0) 0x7fc2e00c4060 con 0x7fc2f40cb040 2024-09-17T05:38:52.052 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:52.052 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":181,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551365,"num_in_osds":8,"osd_in_since":1726551355,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":40}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590950,"bytes_used":245571584,"bytes_avail":772848541696,"bytes_total":773094113280,"inactive_pgs_ratio":0.58762884140014648,"write_bytes_sec":177,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":35,"btime":"2024-09-17T05:38:49:581927+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5751}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-17T05:38:42.296064+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:38:52.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2d4073200 msgr2=0x7fc2d4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2d4073200 0x7fc2d4075710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005fd0 tx=0x7fc2e8005f00 comp rx=0 tx=0).stop 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 msgr2=0x7fc2f40b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40b4c20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc2e001cce0 tx=0x7fc2e0005d20 comp rx=0 tx=0).stop 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 shutdown_connections 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc2f415e8c0 0x7fc2f40b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2f40cb040 0x7fc2f40b4c20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2d4073200 0x7fc2d4075710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 --2- 172.21.15.44:0/3506767881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2f40cac30 0x7fc2f40a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 >> 172.21.15.44:0/3506767881 conn(0x7fc2f40ccaa0 msgr2=0x7fc2f409d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 shutdown_connections 2024-09-17T05:38:52.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.053+0000 7fc2fc600640 1 -- 172.21.15.44:0/3506767881 wait complete. 2024-09-17T05:38:52.075 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:38:52.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 -- 172.21.15.44:0/1766753353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 msgr2=0x7f87fc0b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 --2- 172.21.15.44:0/1766753353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0b3dd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009bc0 tx=0x7f87f401cba0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 -- 172.21.15.44:0/1766753353 shutdown_connections 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 --2- 172.21.15.44:0/1766753353 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0b3dd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 --2- 172.21.15.44:0/1766753353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87fc0ce060 0x7f87fc0afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 -- 172.21.15.44:0/1766753353 >> 172.21.15.44:0/1766753353 conn(0x7f87fc0ccf30 msgr2=0x7f87fc0cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 -- 172.21.15.44:0/1766753353 shutdown_connections 2024-09-17T05:38:52.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 -- 172.21.15.44:0/1766753353 wait complete. 2024-09-17T05:38:52.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 Processor -- start 2024-09-17T05:38:52.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.233+0000 7f8802200640 1 -- start start 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc073200 0x7f87fc13ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87fc0ce060 0x7f87fc154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc169130 con 0x7f87fc0b39c0 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc168fb0 con 0x7f87fc073200 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc1692b0 con 0x7f87fc0ce060 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36026/0 (socket says 172.21.15.44:36026) 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 -- 172.21.15.44:0/2145525889 learned_addr learned my addr 172.21.15.44:0/2145525889 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:52.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87fbe00640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87fc0ce060 0x7f87fc154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87fb400640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc073200 0x7f87fc13ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 -- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87fc0ce060 msgr2=0x7f87fc154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87fc0ce060 0x7f87fc154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 -- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc073200 msgr2=0x7f87fc13ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc073200 0x7f87fc13ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 -- 172.21.15.44:0/2145525889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc0adb90 con 0x7f87fc0b39c0 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87fbe00640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87fc0ce060 0x7f87fc154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87fb400640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc073200 0x7f87fc13ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f2a00640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0aec30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f87e400c3c0 tx=0x7f87e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f3e00640 1 -- 172.21.15.44:0/2145525889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4011790 con 0x7f87fc0b39c0 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f3e00640 1 -- 172.21.15.44:0/2145525889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87e4017070 con 0x7f87fc0b39c0 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f87f3e00640 1 -- 172.21.15.44:0/2145525889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4011ce0 con 0x7f87fc0b39c0 2024-09-17T05:38:52.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc0ade70 con 0x7f87fc0b39c0 2024-09-17T05:38:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc0ae430 con 0x7f87fc0b39c0 2024-09-17T05:38:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.237+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc0b3dd0 con 0x7f87fc0b39c0 2024-09-17T05:38:52.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.241+0000 7f87f3e00640 1 -- 172.21.15.44:0/2145525889 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f87e401c460 con 0x7f87fc0b39c0 2024-09-17T05:38:52.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.241+0000 7f87f3e00640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f87d8073200 0x7f87d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:52.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.241+0000 7f87f3e00640 1 -- 172.21.15.44:0/2145525889 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f87e4094120 con 0x7f87fc0b39c0 2024-09-17T05:38:52.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.241+0000 7f87fb400640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f87d8073200 0x7f87d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:52.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.241+0000 7f87fb400640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f87d8073200 0x7f87d8075710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009ac0 tx=0x7f87ec0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:52.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.245+0000 7f87f3e00640 1 -- 172.21.15.44:0/2145525889 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f87e405efa0 con 0x7f87fc0b39c0 2024-09-17T05:38:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.417+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87fc0ad920 con 0x7f87d8073200 2024-09-17T05:38:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.425+0000 7f87f3e00640 1 -- 172.21.15.44:0/2145525889 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252012 (secure 0 0 0) 0x7f87fc0ad920 con 0x7f87d8073200 2024-09-17T05:38:52.427 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:52.428 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:38:52.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f87d8073200 msgr2=0x7f87d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f87d8073200 0x7f87d8075710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009ac0 tx=0x7f87ec0091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 msgr2=0x7f87fc0aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0aec30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f87e400c3c0 tx=0x7f87e400c880 comp rx=0 tx=0).stop 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 shutdown_connections 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f87fc0ce060 0x7f87fc154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f87fc0b39c0 0x7f87fc0aec30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f87d8073200 0x7f87d8075710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 --2- 172.21.15.44:0/2145525889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87fc073200 0x7f87fc13ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 >> 172.21.15.44:0/2145525889 conn(0x7f87fc0ccf30 msgr2=0x7f87fc151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 shutdown_connections 2024-09-17T05:38:52.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:52.429+0000 7f8802200640 1 -- 172.21.15.44:0/2145525889 wait complete. 2024-09-17T05:38:52.448 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2024-09-17T05:38:52.298434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244240,"kb_used_data":7196,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730480,"statfs":{"total":773094113280,"available":772844011520,"internally_reserved":0,"allocated":7368704,"data_stored":3919488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.761667"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.591698+0000","last_change":"2024-09-17T05:38:46.583715+0000","last_active":"2024-09-17T05:38:46.591698+0000","last_peered":"2024-09-17T05:38:46.591698+0000","last_clean":"2024-09-17T05:38:46.591698+0000","last_became_active":"2024-09-17T05:38:46.583363+0000","last_became_peered":"2024-09-17T05:38:46.583363+0000","last_unstale":"2024-09-17T05:38:46.591698+0000","last_undegraded":"2024-09-17T05:38:46.591698+0000","last_fullsized":"2024-09-17T05:38:46.591698+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:09.088815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232206+0000","last_change":"2024-09-17T05:38:46.589668+0000","last_active":"2024-09-17T05:38:48.232206+0000","last_peered":"2024-09-17T05:38:48.232206+0000","last_clean":"2024-09-17T05:38:48.232206+0000","last_became_active":"2024-09-17T05:38:46.588645+0000","last_became_peered":"2024-09-17T05:38:46.588645+0000","last_unstale":"2024-09-17T05:38:48.232206+0000","last_undegraded":"2024-09-17T05:38:48.232206+0000","last_fullsized":"2024-09-17T05:38:48.232206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:48.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232062+0000","last_change":"2024-09-17T05:38:46.584743+0000","last_active":"2024-09-17T05:38:48.232062+0000","last_peered":"2024-09-17T05:38:48.232062+0000","last_clean":"2024-09-17T05:38:48.232062+0000","last_became_active":"2024-09-17T05:38:46.582721+0000","last_became_peered":"2024-09-17T05:38:46.582721+0000","last_unstale":"2024-09-17T05:38:48.232062+0000","last_undegraded":"2024-09-17T05:38:48.232062+0000","last_fullsized":"2024-09-17T05:38:48.232062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:47.756467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584681+0000","last_change":"2024-09-17T05:38:46.582314+0000","last_active":"2024-09-17T05:38:47.584681+0000","last_peered":"2024-09-17T05:38:47.584681+0000","last_clean":"2024-09-17T05:38:47.584681+0000","last_became_active":"2024-09-17T05:38:46.580575+0000","last_became_peered":"2024-09-17T05:38:46.580575+0000","last_unstale":"2024-09-17T05:38:47.584681+0000","last_undegraded":"2024-09-17T05:38:47.584681+0000","last_fullsized":"2024-09-17T05:38:47.584681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:33.451689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231854+0000","last_change":"2024-09-17T05:38:46.580506+0000","last_active":"2024-09-17T05:38:48.231854+0000","last_peered":"2024-09-17T05:38:48.231854+0000","last_clean":"2024-09-17T05:38:48.231854+0000","last_became_active":"2024-09-17T05:38:46.580190+0000","last_became_peered":"2024-09-17T05:38:46.580190+0000","last_unstale":"2024-09-17T05:38:48.231854+0000","last_undegraded":"2024-09-17T05:38:48.231854+0000","last_fullsized":"2024-09-17T05:38:48.231854+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:22.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231241+0000","last_change":"2024-09-17T05:38:46.596761+0000","last_active":"2024-09-17T05:38:48.231241+0000","last_peered":"2024-09-17T05:38:48.231241+0000","last_clean":"2024-09-17T05:38:48.231241+0000","last_became_active":"2024-09-17T05:38:46.596447+0000","last_became_peered":"2024-09-17T05:38:46.596447+0000","last_unstale":"2024-09-17T05:38:48.231241+0000","last_undegraded":"2024-09-17T05:38:48.231241+0000","last_fullsized":"2024-09-17T05:38:48.231241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:06.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.581278+0000","last_change":"2024-09-17T05:38:46.576539+0000","last_active":"2024-09-17T05:38:46.581278+0000","last_peered":"2024-09-17T05:38:46.581278+0000","last_clean":"2024-09-17T05:38:46.581278+0000","last_became_active":"2024-09-17T05:38:46.576080+0000","last_became_peered":"2024-09-17T05:38:46.576080+0000","last_unstale":"2024-09-17T05:38:46.581278+0000","last_undegraded":"2024-09-17T05:38:46.581278+0000","last_fullsized":"2024-09-17T05:38:46.581278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:47.968279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231755+0000","last_change":"2024-09-17T05:38:46.586518+0000","last_active":"2024-09-17T05:38:48.231755+0000","last_peered":"2024-09-17T05:38:48.231755+0000","last_clean":"2024-09-17T05:38:48.231755+0000","last_became_active":"2024-09-17T05:38:46.584357+0000","last_became_peered":"2024-09-17T05:38:46.584357+0000","last_unstale":"2024-09-17T05:38:48.231755+0000","last_undegraded":"2024-09-17T05:38:48.231755+0000","last_fullsized":"2024-09-17T05:38:48.231755+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:49.566913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585332+0000","last_change":"2024-09-17T05:38:46.567603+0000","last_active":"2024-09-17T05:38:47.585332+0000","last_peered":"2024-09-17T05:38:47.585332+0000","last_clean":"2024-09-17T05:38:47.585332+0000","last_became_active":"2024-09-17T05:38:46.566779+0000","last_became_peered":"2024-09-17T05:38:46.566779+0000","last_unstale":"2024-09-17T05:38:47.585332+0000","last_undegraded":"2024-09-17T05:38:47.585332+0000","last_fullsized":"2024-09-17T05:38:47.585332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:44.417278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560491+0000","last_change":"2024-09-17T05:38:46.578580+0000","last_active":"2024-09-17T05:38:47.560491+0000","last_peered":"2024-09-17T05:38:47.560491+0000","last_clean":"2024-09-17T05:38:47.560491+0000","last_became_active":"2024-09-17T05:38:46.578232+0000","last_became_peered":"2024-09-17T05:38:46.578232+0000","last_unstale":"2024-09-17T05:38:47.560491+0000","last_undegraded":"2024-09-17T05:38:47.560491+0000","last_fullsized":"2024-09-17T05:38:47.560491+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:52.064912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584852+0000","last_change":"2024-09-17T05:38:46.575287+0000","last_active":"2024-09-17T05:38:47.584852+0000","last_peered":"2024-09-17T05:38:47.584852+0000","last_clean":"2024-09-17T05:38:47.584852+0000","last_became_active":"2024-09-17T05:38:46.574220+0000","last_became_peered":"2024-09-17T05:38:46.574220+0000","last_unstale":"2024-09-17T05:38:47.584852+0000","last_undegraded":"2024-09-17T05:38:47.584852+0000","last_fullsized":"2024-09-17T05:38:47.584852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:51.884137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584681+0000","last_change":"2024-09-17T05:38:46.590580+0000","last_active":"2024-09-17T05:38:47.584681+0000","last_peered":"2024-09-17T05:38:47.584681+0000","last_clean":"2024-09-17T05:38:47.584681+0000","last_became_active":"2024-09-17T05:38:46.587617+0000","last_became_peered":"2024-09-17T05:38:46.587617+0000","last_unstale":"2024-09-17T05:38:47.584681+0000","last_undegraded":"2024-09-17T05:38:47.584681+0000","last_fullsized":"2024-09-17T05:38:47.584681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:02.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561908+0000","last_change":"2024-09-17T05:38:46.599704+0000","last_active":"2024-09-17T05:38:47.561908+0000","last_peered":"2024-09-17T05:38:47.561908+0000","last_clean":"2024-09-17T05:38:47.561908+0000","last_became_active":"2024-09-17T05:38:46.599407+0000","last_became_peered":"2024-09-17T05:38:46.599407+0000","last_unstale":"2024-09-17T05:38:47.561908+0000","last_undegraded":"2024-09-17T05:38:47.561908+0000","last_fullsized":"2024-09-17T05:38:47.561908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:34.457859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561637+0000","last_change":"2024-09-17T05:38:46.585181+0000","last_active":"2024-09-17T05:38:47.561637+0000","last_peered":"2024-09-17T05:38:47.561637+0000","last_clean":"2024-09-17T05:38:47.561637+0000","last_became_active":"2024-09-17T05:38:46.584764+0000","last_became_peered":"2024-09-17T05:38:46.584764+0000","last_unstale":"2024-09-17T05:38:47.561637+0000","last_undegraded":"2024-09-17T05:38:47.561637+0000","last_fullsized":"2024-09-17T05:38:47.561637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:24.827524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559655+0000","last_change":"2024-09-17T05:38:46.584583+0000","last_active":"2024-09-17T05:38:47.559655+0000","last_peered":"2024-09-17T05:38:47.559655+0000","last_clean":"2024-09-17T05:38:47.559655+0000","last_became_active":"2024-09-17T05:38:46.584127+0000","last_became_peered":"2024-09-17T05:38:46.584127+0000","last_unstale":"2024-09-17T05:38:47.559655+0000","last_undegraded":"2024-09-17T05:38:47.559655+0000","last_fullsized":"2024-09-17T05:38:47.559655+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:26.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586829+0000","last_change":"2024-09-17T05:38:46.573627+0000","last_active":"2024-09-17T05:38:47.586829+0000","last_peered":"2024-09-17T05:38:47.586829+0000","last_clean":"2024-09-17T05:38:47.586829+0000","last_became_active":"2024-09-17T05:38:46.573293+0000","last_became_peered":"2024-09-17T05:38:46.573293+0000","last_unstale":"2024-09-17T05:38:47.586829+0000","last_undegraded":"2024-09-17T05:38:47.586829+0000","last_fullsized":"2024-09-17T05:38:47.586829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:06.342259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561747+0000","last_change":"2024-09-17T05:38:46.584458+0000","last_active":"2024-09-17T05:38:47.561747+0000","last_peered":"2024-09-17T05:38:47.561747+0000","last_clean":"2024-09-17T05:38:47.561747+0000","last_became_active":"2024-09-17T05:38:46.584179+0000","last_became_peered":"2024-09-17T05:38:46.584179+0000","last_unstale":"2024-09-17T05:38:47.561747+0000","last_undegraded":"2024-09-17T05:38:47.561747+0000","last_fullsized":"2024-09-17T05:38:47.561747+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:55.233845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585092+0000","last_change":"2024-09-17T05:38:46.589858+0000","last_active":"2024-09-17T05:38:47.585092+0000","last_peered":"2024-09-17T05:38:47.585092+0000","last_clean":"2024-09-17T05:38:47.585092+0000","last_became_active":"2024-09-17T05:38:46.589478+0000","last_became_peered":"2024-09-17T05:38:46.589478+0000","last_unstale":"2024-09-17T05:38:47.585092+0000","last_undegraded":"2024-09-17T05:38:47.585092+0000","last_fullsized":"2024-09-17T05:38:47.585092+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:34.354288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584848+0000","last_change":"2024-09-17T05:38:46.568077+0000","last_active":"2024-09-17T05:38:47.584848+0000","last_peered":"2024-09-17T05:38:47.584848+0000","last_clean":"2024-09-17T05:38:47.584848+0000","last_became_active":"2024-09-17T05:38:46.567652+0000","last_became_peered":"2024-09-17T05:38:46.567652+0000","last_unstale":"2024-09-17T05:38:47.584848+0000","last_undegraded":"2024-09-17T05:38:47.584848+0000","last_fullsized":"2024-09-17T05:38:47.584848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:29.084869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561004+0000","last_change":"2024-09-17T05:38:46.595969+0000","last_active":"2024-09-17T05:38:47.561004+0000","last_peered":"2024-09-17T05:38:47.561004+0000","last_clean":"2024-09-17T05:38:47.561004+0000","last_became_active":"2024-09-17T05:38:46.595674+0000","last_became_peered":"2024-09-17T05:38:46.595674+0000","last_unstale":"2024-09-17T05:38:47.561004+0000","last_undegraded":"2024-09-17T05:38:47.561004+0000","last_fullsized":"2024-09-17T05:38:47.561004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:22.861395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561632+0000","last_change":"2024-09-17T05:38:46.585547+0000","last_active":"2024-09-17T05:38:47.561632+0000","last_peered":"2024-09-17T05:38:47.561632+0000","last_clean":"2024-09-17T05:38:47.561632+0000","last_became_active":"2024-09-17T05:38:46.584969+0000","last_became_peered":"2024-09-17T05:38:46.584969+0000","last_unstale":"2024-09-17T05:38:47.561632+0000","last_undegraded":"2024-09-17T05:38:47.561632+0000","last_fullsized":"2024-09-17T05:38:47.561632+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:58.154228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231686+0000","last_change":"2024-09-17T05:38:46.593887+0000","last_active":"2024-09-17T05:38:48.231686+0000","last_peered":"2024-09-17T05:38:48.231686+0000","last_clean":"2024-09-17T05:38:48.231686+0000","last_became_active":"2024-09-17T05:38:46.593579+0000","last_became_peered":"2024-09-17T05:38:46.593579+0000","last_unstale":"2024-09-17T05:38:48.231686+0000","last_undegraded":"2024-09-17T05:38:48.231686+0000","last_fullsized":"2024-09-17T05:38:48.231686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:28.832882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586654+0000","last_change":"2024-09-17T05:38:46.572760+0000","last_active":"2024-09-17T05:38:47.586654+0000","last_peered":"2024-09-17T05:38:47.586654+0000","last_clean":"2024-09-17T05:38:47.586654+0000","last_became_active":"2024-09-17T05:38:46.572445+0000","last_became_peered":"2024-09-17T05:38:46.572445+0000","last_unstale":"2024-09-17T05:38:47.586654+0000","last_undegraded":"2024-09-17T05:38:47.586654+0000","last_fullsized":"2024-09-17T05:38:47.586654+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:09.884165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232190+0000","last_change":"2024-09-17T05:38:46.585916+0000","last_active":"2024-09-17T05:38:48.232190+0000","last_peered":"2024-09-17T05:38:48.232190+0000","last_clean":"2024-09-17T05:38:48.232190+0000","last_became_active":"2024-09-17T05:38:46.585568+0000","last_became_peered":"2024-09-17T05:38:46.585568+0000","last_unstale":"2024-09-17T05:38:48.232190+0000","last_undegraded":"2024-09-17T05:38:48.232190+0000","last_fullsized":"2024-09-17T05:38:48.232190+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:50.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.562071+0000","last_change":"2024-09-17T05:38:46.586594+0000","last_active":"2024-09-17T05:38:47.562071+0000","last_peered":"2024-09-17T05:38:47.562071+0000","last_clean":"2024-09-17T05:38:47.562071+0000","last_became_active":"2024-09-17T05:38:46.586267+0000","last_became_peered":"2024-09-17T05:38:46.586267+0000","last_unstale":"2024-09-17T05:38:47.562071+0000","last_undegraded":"2024-09-17T05:38:47.562071+0000","last_fullsized":"2024-09-17T05:38:47.562071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:12.808727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231898+0000","last_change":"2024-09-17T05:38:46.583644+0000","last_active":"2024-09-17T05:38:48.231898+0000","last_peered":"2024-09-17T05:38:48.231898+0000","last_clean":"2024-09-17T05:38:48.231898+0000","last_became_active":"2024-09-17T05:38:46.583352+0000","last_became_peered":"2024-09-17T05:38:46.583352+0000","last_unstale":"2024-09-17T05:38:48.231898+0000","last_undegraded":"2024-09-17T05:38:48.231898+0000","last_fullsized":"2024-09-17T05:38:48.231898+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:26.757140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561610+0000","last_change":"2024-09-17T05:38:46.585986+0000","last_active":"2024-09-17T05:38:47.561610+0000","last_peered":"2024-09-17T05:38:47.561610+0000","last_clean":"2024-09-17T05:38:47.561610+0000","last_became_active":"2024-09-17T05:38:46.585647+0000","last_became_peered":"2024-09-17T05:38:46.585647+0000","last_unstale":"2024-09-17T05:38:47.561610+0000","last_undegraded":"2024-09-17T05:38:47.561610+0000","last_fullsized":"2024-09-17T05:38:47.561610+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:29.940064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575662+0000","last_change":"2024-09-17T05:38:46.566215+0000","last_active":"2024-09-17T05:38:46.575662+0000","last_peered":"2024-09-17T05:38:46.575662+0000","last_clean":"2024-09-17T05:38:46.575662+0000","last_became_active":"2024-09-17T05:38:46.565932+0000","last_became_peered":"2024-09-17T05:38:46.565932+0000","last_unstale":"2024-09-17T05:38:46.575662+0000","last_undegraded":"2024-09-17T05:38:46.575662+0000","last_fullsized":"2024-09-17T05:38:46.575662+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:55.360415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584721+0000","last_change":"2024-09-17T05:38:46.592682+0000","last_active":"2024-09-17T05:38:47.584721+0000","last_peered":"2024-09-17T05:38:47.584721+0000","last_clean":"2024-09-17T05:38:47.584721+0000","last_became_active":"2024-09-17T05:38:46.592372+0000","last_became_peered":"2024-09-17T05:38:46.592372+0000","last_unstale":"2024-09-17T05:38:47.584721+0000","last_undegraded":"2024-09-17T05:38:47.584721+0000","last_fullsized":"2024-09-17T05:38:47.584721+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:47.771869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584192+0000","last_change":"2024-09-17T05:38:46.572590+0000","last_active":"2024-09-17T05:38:47.584192+0000","last_peered":"2024-09-17T05:38:47.584192+0000","last_clean":"2024-09-17T05:38:47.584192+0000","last_became_active":"2024-09-17T05:38:46.572228+0000","last_became_peered":"2024-09-17T05:38:46.572228+0000","last_unstale":"2024-09-17T05:38:47.584192+0000","last_undegraded":"2024-09-17T05:38:47.584192+0000","last_fullsized":"2024-09-17T05:38:47.584192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:49.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231738+0000","last_change":"2024-09-17T05:38:46.585824+0000","last_active":"2024-09-17T05:38:48.231738+0000","last_peered":"2024-09-17T05:38:48.231738+0000","last_clean":"2024-09-17T05:38:48.231738+0000","last_became_active":"2024-09-17T05:38:46.585510+0000","last_became_peered":"2024-09-17T05:38:46.585510+0000","last_unstale":"2024-09-17T05:38:48.231738+0000","last_undegraded":"2024-09-17T05:38:48.231738+0000","last_fullsized":"2024-09-17T05:38:48.231738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:53.094626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592100+0000","last_change":"2024-09-17T05:38:46.581873+0000","last_active":"2024-09-17T05:38:46.592100+0000","last_peered":"2024-09-17T05:38:46.592100+0000","last_clean":"2024-09-17T05:38:46.592100+0000","last_became_active":"2024-09-17T05:38:46.581393+0000","last_became_peered":"2024-09-17T05:38:46.581393+0000","last_unstale":"2024-09-17T05:38:46.592100+0000","last_undegraded":"2024-09-17T05:38:46.592100+0000","last_fullsized":"2024-09-17T05:38:46.592100+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:50.725323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584979+0000","last_change":"2024-09-17T05:38:46.572968+0000","last_active":"2024-09-17T05:38:47.584979+0000","last_peered":"2024-09-17T05:38:47.584979+0000","last_clean":"2024-09-17T05:38:47.584979+0000","last_became_active":"2024-09-17T05:38:46.568424+0000","last_became_peered":"2024-09-17T05:38:46.568424+0000","last_unstale":"2024-09-17T05:38:47.584979+0000","last_undegraded":"2024-09-17T05:38:47.584979+0000","last_fullsized":"2024-09-17T05:38:47.584979+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:09.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.602119+0000","last_change":"2024-09-17T05:38:45.557221+0000","last_active":"2024-09-17T05:38:46.602119+0000","last_peered":"2024-09-17T05:38:46.602119+0000","last_clean":"2024-09-17T05:38:46.602119+0000","last_became_active":"2024-09-17T05:38:45.556870+0000","last_became_peered":"2024-09-17T05:38:45.556870+0000","last_unstale":"2024-09-17T05:38:46.602119+0000","last_undegraded":"2024-09-17T05:38:46.602119+0000","last_fullsized":"2024-09-17T05:38:46.602119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:15.758423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232070+0000","last_change":"2024-09-17T05:38:46.587243+0000","last_active":"2024-09-17T05:38:48.232070+0000","last_peered":"2024-09-17T05:38:48.232070+0000","last_clean":"2024-09-17T05:38:48.232070+0000","last_became_active":"2024-09-17T05:38:46.586872+0000","last_became_peered":"2024-09-17T05:38:46.586872+0000","last_unstale":"2024-09-17T05:38:48.232070+0000","last_undegraded":"2024-09-17T05:38:48.232070+0000","last_fullsized":"2024-09-17T05:38:48.232070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:42.437303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.601073+0000","last_change":"2024-09-17T05:38:45.566302+0000","last_active":"2024-09-17T05:38:46.601073+0000","last_peered":"2024-09-17T05:38:46.601073+0000","last_clean":"2024-09-17T05:38:46.601073+0000","last_became_active":"2024-09-17T05:38:45.565920+0000","last_became_peered":"2024-09-17T05:38:45.565920+0000","last_unstale":"2024-09-17T05:38:46.601073+0000","last_undegraded":"2024-09-17T05:38:46.601073+0000","last_fullsized":"2024-09-17T05:38:46.601073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:15.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232531+0000","last_change":"2024-09-17T05:38:46.585061+0000","last_active":"2024-09-17T05:38:48.232531+0000","last_peered":"2024-09-17T05:38:48.232531+0000","last_clean":"2024-09-17T05:38:48.232531+0000","last_became_active":"2024-09-17T05:38:46.584717+0000","last_became_peered":"2024-09-17T05:38:46.584717+0000","last_unstale":"2024-09-17T05:38:48.232531+0000","last_undegraded":"2024-09-17T05:38:48.232531+0000","last_fullsized":"2024-09-17T05:38:48.232531+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:02.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.599298+0000","last_change":"2024-09-17T05:38:45.563577+0000","last_active":"2024-09-17T05:38:46.599298+0000","last_peered":"2024-09-17T05:38:46.599298+0000","last_clean":"2024-09-17T05:38:46.599298+0000","last_became_active":"2024-09-17T05:38:45.563266+0000","last_became_peered":"2024-09-17T05:38:45.563266+0000","last_unstale":"2024-09-17T05:38:46.599298+0000","last_undegraded":"2024-09-17T05:38:46.599298+0000","last_fullsized":"2024-09-17T05:38:46.599298+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:24.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585492+0000","last_change":"2024-09-17T05:38:46.580612+0000","last_active":"2024-09-17T05:38:47.585492+0000","last_peered":"2024-09-17T05:38:47.585492+0000","last_clean":"2024-09-17T05:38:47.585492+0000","last_became_active":"2024-09-17T05:38:46.580288+0000","last_became_peered":"2024-09-17T05:38:46.580288+0000","last_unstale":"2024-09-17T05:38:47.585492+0000","last_undegraded":"2024-09-17T05:38:47.585492+0000","last_fullsized":"2024-09-17T05:38:47.585492+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:22.861395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231719+0000","last_change":"2024-09-17T05:38:45.556629+0000","last_active":"2024-09-17T05:38:48.231719+0000","last_peered":"2024-09-17T05:38:48.231719+0000","last_clean":"2024-09-17T05:38:48.231719+0000","last_became_active":"2024-09-17T05:38:45.556195+0000","last_became_peered":"2024-09-17T05:38:45.556195+0000","last_unstale":"2024-09-17T05:38:48.231719+0000","last_undegraded":"2024-09-17T05:38:48.231719+0000","last_fullsized":"2024-09-17T05:38:48.231719+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:09.306010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560617+0000","last_change":"2024-09-17T05:38:46.581381+0000","last_active":"2024-09-17T05:38:47.560617+0000","last_peered":"2024-09-17T05:38:47.560617+0000","last_clean":"2024-09-17T05:38:47.560617+0000","last_became_active":"2024-09-17T05:38:46.581098+0000","last_became_peered":"2024-09-17T05:38:46.581098+0000","last_unstale":"2024-09-17T05:38:47.560617+0000","last_undegraded":"2024-09-17T05:38:47.560617+0000","last_fullsized":"2024-09-17T05:38:47.560617+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:34.354288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561489+0000","last_change":"2024-09-17T05:38:45.565943+0000","last_active":"2024-09-17T05:38:47.561489+0000","last_peered":"2024-09-17T05:38:47.561489+0000","last_clean":"2024-09-17T05:38:47.561489+0000","last_became_active":"2024-09-17T05:38:45.565559+0000","last_became_peered":"2024-09-17T05:38:45.565559+0000","last_unstale":"2024-09-17T05:38:47.561489+0000","last_undegraded":"2024-09-17T05:38:47.561489+0000","last_fullsized":"2024-09-17T05:38:47.561489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:04.885275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.574340+0000","last_change":"2024-09-17T05:38:46.566137+0000","last_active":"2024-09-17T05:38:46.574340+0000","last_peered":"2024-09-17T05:38:46.574340+0000","last_clean":"2024-09-17T05:38:46.574340+0000","last_became_active":"2024-09-17T05:38:46.565806+0000","last_became_peered":"2024-09-17T05:38:46.565806+0000","last_unstale":"2024-09-17T05:38:46.574340+0000","last_undegraded":"2024-09-17T05:38:46.574340+0000","last_fullsized":"2024-09-17T05:38:46.574340+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:13.028402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231895+0000","last_change":"2024-09-17T05:38:45.564188+0000","last_active":"2024-09-17T05:38:48.231895+0000","last_peered":"2024-09-17T05:38:48.231895+0000","last_clean":"2024-09-17T05:38:48.231895+0000","last_became_active":"2024-09-17T05:38:45.562211+0000","last_became_peered":"2024-09-17T05:38:45.562211+0000","last_unstale":"2024-09-17T05:38:48.231895+0000","last_undegraded":"2024-09-17T05:38:48.231895+0000","last_fullsized":"2024-09-17T05:38:48.231895+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:26.707336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560176+0000","last_change":"2024-09-17T05:38:46.566248+0000","last_active":"2024-09-17T05:38:47.560176+0000","last_peered":"2024-09-17T05:38:47.560176+0000","last_clean":"2024-09-17T05:38:47.560176+0000","last_became_active":"2024-09-17T05:38:46.565904+0000","last_became_peered":"2024-09-17T05:38:46.565904+0000","last_unstale":"2024-09-17T05:38:47.560176+0000","last_undegraded":"2024-09-17T05:38:47.560176+0000","last_fullsized":"2024-09-17T05:38:47.560176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:12.808727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562074+0000","last_change":"2024-09-17T05:38:45.558292+0000","last_active":"2024-09-17T05:38:46.562074+0000","last_peered":"2024-09-17T05:38:46.562074+0000","last_clean":"2024-09-17T05:38:46.562074+0000","last_became_active":"2024-09-17T05:38:45.557924+0000","last_became_peered":"2024-09-17T05:38:45.557924+0000","last_unstale":"2024-09-17T05:38:46.562074+0000","last_undegraded":"2024-09-17T05:38:46.562074+0000","last_fullsized":"2024-09-17T05:38:46.562074+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:11.908735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560950+0000","last_change":"2024-09-17T05:38:46.600138+0000","last_active":"2024-09-17T05:38:47.560950+0000","last_peered":"2024-09-17T05:38:47.560950+0000","last_clean":"2024-09-17T05:38:47.560950+0000","last_became_active":"2024-09-17T05:38:46.599496+0000","last_became_peered":"2024-09-17T05:38:46.599496+0000","last_unstale":"2024-09-17T05:38:47.560950+0000","last_undegraded":"2024-09-17T05:38:47.560950+0000","last_fullsized":"2024-09-17T05:38:47.560950+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:44.417278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584423+0000","last_change":"2024-09-17T05:38:45.566557+0000","last_active":"2024-09-17T05:38:47.584423+0000","last_peered":"2024-09-17T05:38:47.584423+0000","last_clean":"2024-09-17T05:38:47.584423+0000","last_became_active":"2024-09-17T05:38:45.561815+0000","last_became_peered":"2024-09-17T05:38:45.561815+0000","last_unstale":"2024-09-17T05:38:47.584423+0000","last_undegraded":"2024-09-17T05:38:47.584423+0000","last_fullsized":"2024-09-17T05:38:47.584423+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:10.936452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.575697+0000","last_change":"2024-09-17T05:38:46.568855+0000","last_active":"2024-09-17T05:38:46.575697+0000","last_peered":"2024-09-17T05:38:46.575697+0000","last_clean":"2024-09-17T05:38:46.575697+0000","last_became_active":"2024-09-17T05:38:46.568540+0000","last_became_peered":"2024-09-17T05:38:46.568540+0000","last_unstale":"2024-09-17T05:38:46.575697+0000","last_undegraded":"2024-09-17T05:38:46.575697+0000","last_fullsized":"2024-09-17T05:38:46.575697+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:45.632807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585500+0000","last_change":"2024-09-17T05:38:45.563925+0000","last_active":"2024-09-17T05:38:47.585500+0000","last_peered":"2024-09-17T05:38:47.585500+0000","last_clean":"2024-09-17T05:38:47.585500+0000","last_became_active":"2024-09-17T05:38:45.563013+0000","last_became_peered":"2024-09-17T05:38:45.563013+0000","last_unstale":"2024-09-17T05:38:47.585500+0000","last_undegraded":"2024-09-17T05:38:47.585500+0000","last_fullsized":"2024-09-17T05:38:47.585500+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:05.883963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561146+0000","last_change":"2024-09-17T05:38:46.591733+0000","last_active":"2024-09-17T05:38:47.561146+0000","last_peered":"2024-09-17T05:38:47.561146+0000","last_clean":"2024-09-17T05:38:47.561146+0000","last_became_active":"2024-09-17T05:38:46.591443+0000","last_became_peered":"2024-09-17T05:38:46.591443+0000","last_unstale":"2024-09-17T05:38:47.561146+0000","last_undegraded":"2024-09-17T05:38:47.561146+0000","last_fullsized":"2024-09-17T05:38:47.561146+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:30.137904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561869+0000","last_change":"2024-09-17T05:38:45.562855+0000","last_active":"2024-09-17T05:38:47.561869+0000","last_peered":"2024-09-17T05:38:47.561869+0000","last_clean":"2024-09-17T05:38:47.561869+0000","last_became_active":"2024-09-17T05:38:45.562513+0000","last_became_peered":"2024-09-17T05:38:45.562513+0000","last_unstale":"2024-09-17T05:38:47.561869+0000","last_undegraded":"2024-09-17T05:38:47.561869+0000","last_fullsized":"2024-09-17T05:38:47.561869+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:11.357532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561644+0000","last_change":"2024-09-17T05:38:46.599154+0000","last_active":"2024-09-17T05:38:47.561644+0000","last_peered":"2024-09-17T05:38:47.561644+0000","last_clean":"2024-09-17T05:38:47.561644+0000","last_became_active":"2024-09-17T05:38:46.598803+0000","last_became_peered":"2024-09-17T05:38:46.598803+0000","last_unstale":"2024-09-17T05:38:47.561644+0000","last_undegraded":"2024-09-17T05:38:47.561644+0000","last_fullsized":"2024-09-17T05:38:47.561644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:57.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232228+0000","last_change":"2024-09-17T05:38:45.557154+0000","last_active":"2024-09-17T05:38:48.232228+0000","last_peered":"2024-09-17T05:38:48.232228+0000","last_clean":"2024-09-17T05:38:48.232228+0000","last_became_active":"2024-09-17T05:38:45.556734+0000","last_became_peered":"2024-09-17T05:38:45.556734+0000","last_unstale":"2024-09-17T05:38:48.232228+0000","last_undegraded":"2024-09-17T05:38:48.232228+0000","last_fullsized":"2024-09-17T05:38:48.232228+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:17.766361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232256+0000","last_change":"2024-09-17T05:38:46.587239+0000","last_active":"2024-09-17T05:38:48.232256+0000","last_peered":"2024-09-17T05:38:48.232256+0000","last_clean":"2024-09-17T05:38:48.232256+0000","last_became_active":"2024-09-17T05:38:46.585662+0000","last_became_peered":"2024-09-17T05:38:46.585662+0000","last_unstale":"2024-09-17T05:38:48.232256+0000","last_undegraded":"2024-09-17T05:38:48.232256+0000","last_fullsized":"2024-09-17T05:38:48.232256+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:40.116112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":21,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232076+0000","last_change":"2024-09-17T05:38:45.557059+0000","last_active":"2024-09-17T05:38:48.232076+0000","last_peered":"2024-09-17T05:38:48.232076+0000","last_clean":"2024-09-17T05:38:48.232076+0000","last_became_active":"2024-09-17T05:38:45.556369+0000","last_became_peered":"2024-09-17T05:38:45.556369+0000","last_unstale":"2024-09-17T05:38:48.232076+0000","last_undegraded":"2024-09-17T05:38:48.232076+0000","last_fullsized":"2024-09-17T05:38:48.232076+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:24.842363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559626+0000","last_change":"2024-09-17T05:38:46.566529+0000","last_active":"2024-09-17T05:38:47.559626+0000","last_peered":"2024-09-17T05:38:47.559626+0000","last_clean":"2024-09-17T05:38:47.559626+0000","last_became_active":"2024-09-17T05:38:46.565936+0000","last_became_peered":"2024-09-17T05:38:46.565936+0000","last_unstale":"2024-09-17T05:38:47.559626+0000","last_undegraded":"2024-09-17T05:38:47.559626+0000","last_fullsized":"2024-09-17T05:38:47.559626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:24.827524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584540+0000","last_change":"2024-09-17T05:38:45.561797+0000","last_active":"2024-09-17T05:38:47.584540+0000","last_peered":"2024-09-17T05:38:47.584540+0000","last_clean":"2024-09-17T05:38:47.584540+0000","last_became_active":"2024-09-17T05:38:45.561441+0000","last_became_peered":"2024-09-17T05:38:45.561441+0000","last_unstale":"2024-09-17T05:38:47.584540+0000","last_undegraded":"2024-09-17T05:38:47.584540+0000","last_fullsized":"2024-09-17T05:38:47.584540+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:58.166212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559903+0000","last_change":"2024-09-17T05:38:46.583184+0000","last_active":"2024-09-17T05:38:47.559903+0000","last_peered":"2024-09-17T05:38:47.559903+0000","last_clean":"2024-09-17T05:38:47.559903+0000","last_became_active":"2024-09-17T05:38:46.582829+0000","last_became_peered":"2024-09-17T05:38:46.582829+0000","last_unstale":"2024-09-17T05:38:47.559903+0000","last_undegraded":"2024-09-17T05:38:47.559903+0000","last_fullsized":"2024-09-17T05:38:47.559903+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:06.890490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559982+0000","last_change":"2024-09-17T05:38:45.565807+0000","last_active":"2024-09-17T05:38:47.559982+0000","last_peered":"2024-09-17T05:38:47.559982+0000","last_clean":"2024-09-17T05:38:47.559982+0000","last_became_active":"2024-09-17T05:38:45.565418+0000","last_became_peered":"2024-09-17T05:38:45.565418+0000","last_unstale":"2024-09-17T05:38:47.559982+0000","last_undegraded":"2024-09-17T05:38:47.559982+0000","last_fullsized":"2024-09-17T05:38:47.559982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:57.566772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559925+0000","last_change":"2024-09-17T05:38:46.590180+0000","last_active":"2024-09-17T05:38:47.559925+0000","last_peered":"2024-09-17T05:38:47.559925+0000","last_clean":"2024-09-17T05:38:47.559925+0000","last_became_active":"2024-09-17T05:38:46.588745+0000","last_became_peered":"2024-09-17T05:38:46.588745+0000","last_unstale":"2024-09-17T05:38:47.559925+0000","last_undegraded":"2024-09-17T05:38:47.559925+0000","last_fullsized":"2024-09-17T05:38:47.559925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:34.457859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231841+0000","last_change":"2024-09-17T05:38:45.560944+0000","last_active":"2024-09-17T05:38:48.231841+0000","last_peered":"2024-09-17T05:38:48.231841+0000","last_clean":"2024-09-17T05:38:48.231841+0000","last_became_active":"2024-09-17T05:38:45.559926+0000","last_became_peered":"2024-09-17T05:38:45.559926+0000","last_unstale":"2024-09-17T05:38:48.231841+0000","last_undegraded":"2024-09-17T05:38:48.231841+0000","last_fullsized":"2024-09-17T05:38:48.231841+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:19.901056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.592302+0000","last_change":"2024-09-17T05:38:46.588274+0000","last_active":"2024-09-17T05:38:46.592302+0000","last_peered":"2024-09-17T05:38:46.592302+0000","last_clean":"2024-09-17T05:38:46.592302+0000","last_became_active":"2024-09-17T05:38:46.587955+0000","last_became_peered":"2024-09-17T05:38:46.587955+0000","last_unstale":"2024-09-17T05:38:46.592302+0000","last_undegraded":"2024-09-17T05:38:46.592302+0000","last_fullsized":"2024-09-17T05:38:46.592302+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:06.354323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"63'8","reported_seq":23,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559534+0000","last_change":"2024-09-17T05:38:45.566154+0000","last_active":"2024-09-17T05:38:47.559534+0000","last_peered":"2024-09-17T05:38:47.559534+0000","last_clean":"2024-09-17T05:38:47.559534+0000","last_became_active":"2024-09-17T05:38:45.565707+0000","last_became_peered":"2024-09-17T05:38:45.565707+0000","last_unstale":"2024-09-17T05:38:47.559534+0000","last_undegraded":"2024-09-17T05:38:47.559534+0000","last_fullsized":"2024-09-17T05:38:47.559534+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:00.735046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584991+0000","last_change":"2024-09-17T05:38:46.588630+0000","last_active":"2024-09-17T05:38:47.584991+0000","last_peered":"2024-09-17T05:38:47.584991+0000","last_clean":"2024-09-17T05:38:47.584991+0000","last_became_active":"2024-09-17T05:38:46.588322+0000","last_became_peered":"2024-09-17T05:38:46.588322+0000","last_unstale":"2024-09-17T05:38:47.584991+0000","last_undegraded":"2024-09-17T05:38:47.584991+0000","last_fullsized":"2024-09-17T05:38:47.584991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:05.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585604+0000","last_change":"2024-09-17T05:38:45.567988+0000","last_active":"2024-09-17T05:38:47.585604+0000","last_peered":"2024-09-17T05:38:47.585604+0000","last_clean":"2024-09-17T05:38:47.585604+0000","last_became_active":"2024-09-17T05:38:45.567377+0000","last_became_peered":"2024-09-17T05:38:45.567377+0000","last_unstale":"2024-09-17T05:38:47.585604+0000","last_undegraded":"2024-09-17T05:38:47.585604+0000","last_fullsized":"2024-09-17T05:38:47.585604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:21.077642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561641+0000","last_change":"2024-09-17T05:38:46.596339+0000","last_active":"2024-09-17T05:38:47.561641+0000","last_peered":"2024-09-17T05:38:47.561641+0000","last_clean":"2024-09-17T05:38:47.561641+0000","last_became_active":"2024-09-17T05:38:46.596066+0000","last_became_peered":"2024-09-17T05:38:46.596066+0000","last_unstale":"2024-09-17T05:38:47.561641+0000","last_undegraded":"2024-09-17T05:38:47.561641+0000","last_fullsized":"2024-09-17T05:38:47.561641+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:22.084169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585055+0000","last_change":"2024-09-17T05:38:45.563646+0000","last_active":"2024-09-17T05:38:47.585055+0000","last_peered":"2024-09-17T05:38:47.585055+0000","last_clean":"2024-09-17T05:38:47.585055+0000","last_became_active":"2024-09-17T05:38:45.562598+0000","last_became_peered":"2024-09-17T05:38:45.562598+0000","last_unstale":"2024-09-17T05:38:47.585055+0000","last_undegraded":"2024-09-17T05:38:47.585055+0000","last_fullsized":"2024-09-17T05:38:47.585055+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:57.147702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.562010+0000","last_change":"2024-09-17T05:38:46.587623+0000","last_active":"2024-09-17T05:38:47.562010+0000","last_peered":"2024-09-17T05:38:47.562010+0000","last_clean":"2024-09-17T05:38:47.562010+0000","last_became_active":"2024-09-17T05:38:46.586993+0000","last_became_peered":"2024-09-17T05:38:46.586993+0000","last_unstale":"2024-09-17T05:38:47.562010+0000","last_undegraded":"2024-09-17T05:38:47.562010+0000","last_fullsized":"2024-09-17T05:38:47.562010+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:54.104099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232265+0000","last_change":"2024-09-17T05:38:45.553121+0000","last_active":"2024-09-17T05:38:48.232265+0000","last_peered":"2024-09-17T05:38:48.232265+0000","last_clean":"2024-09-17T05:38:48.232265+0000","last_became_active":"2024-09-17T05:38:45.552295+0000","last_became_peered":"2024-09-17T05:38:45.552295+0000","last_unstale":"2024-09-17T05:38:48.232265+0000","last_undegraded":"2024-09-17T05:38:48.232265+0000","last_fullsized":"2024-09-17T05:38:48.232265+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:33.584356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232569+0000","last_change":"2024-09-17T05:38:46.585177+0000","last_active":"2024-09-17T05:38:48.232569+0000","last_peered":"2024-09-17T05:38:48.232569+0000","last_clean":"2024-09-17T05:38:48.232569+0000","last_became_active":"2024-09-17T05:38:46.584572+0000","last_became_peered":"2024-09-17T05:38:46.584572+0000","last_unstale":"2024-09-17T05:38:48.232569+0000","last_undegraded":"2024-09-17T05:38:48.232569+0000","last_fullsized":"2024-09-17T05:38:48.232569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:09.336186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586851+0000","last_change":"2024-09-17T05:38:45.570706+0000","last_active":"2024-09-17T05:38:47.586851+0000","last_peered":"2024-09-17T05:38:47.586851+0000","last_clean":"2024-09-17T05:38:47.586851+0000","last_became_active":"2024-09-17T05:38:45.570023+0000","last_became_peered":"2024-09-17T05:38:45.570023+0000","last_unstale":"2024-09-17T05:38:47.586851+0000","last_undegraded":"2024-09-17T05:38:47.586851+0000","last_fullsized":"2024-09-17T05:38:47.586851+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:38.619976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231306+0000","last_change":"2024-09-17T05:38:46.600461+0000","last_active":"2024-09-17T05:38:48.231306+0000","last_peered":"2024-09-17T05:38:48.231306+0000","last_clean":"2024-09-17T05:38:48.231306+0000","last_became_active":"2024-09-17T05:38:46.600131+0000","last_became_peered":"2024-09-17T05:38:46.600131+0000","last_unstale":"2024-09-17T05:38:48.231306+0000","last_undegraded":"2024-09-17T05:38:48.231306+0000","last_fullsized":"2024-09-17T05:38:48.231306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:28.628721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231577+0000","last_change":"2024-09-17T05:38:45.551826+0000","last_active":"2024-09-17T05:38:48.231577+0000","last_peered":"2024-09-17T05:38:48.231577+0000","last_clean":"2024-09-17T05:38:48.231577+0000","last_became_active":"2024-09-17T05:38:45.551495+0000","last_became_peered":"2024-09-17T05:38:45.551495+0000","last_unstale":"2024-09-17T05:38:48.231577+0000","last_undegraded":"2024-09-17T05:38:48.231577+0000","last_fullsized":"2024-09-17T05:38:48.231577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:48.638858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561871+0000","last_change":"2024-09-17T05:38:46.586183+0000","last_active":"2024-09-17T05:38:47.561871+0000","last_peered":"2024-09-17T05:38:47.561871+0000","last_clean":"2024-09-17T05:38:47.561871+0000","last_became_active":"2024-09-17T05:38:46.585031+0000","last_became_peered":"2024-09-17T05:38:46.585031+0000","last_unstale":"2024-09-17T05:38:47.561871+0000","last_undegraded":"2024-09-17T05:38:47.561871+0000","last_fullsized":"2024-09-17T05:38:47.561871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:06.890490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560130+0000","last_change":"2024-09-17T05:38:45.565496+0000","last_active":"2024-09-17T05:38:47.560130+0000","last_peered":"2024-09-17T05:38:47.560130+0000","last_clean":"2024-09-17T05:38:47.560130+0000","last_became_active":"2024-09-17T05:38:45.564983+0000","last_became_peered":"2024-09-17T05:38:45.564983+0000","last_unstale":"2024-09-17T05:38:47.560130+0000","last_undegraded":"2024-09-17T05:38:47.560130+0000","last_fullsized":"2024-09-17T05:38:47.560130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:25.832091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584251+0000","last_change":"2024-09-17T05:38:46.579059+0000","last_active":"2024-09-17T05:38:47.584251+0000","last_peered":"2024-09-17T05:38:47.584251+0000","last_clean":"2024-09-17T05:38:47.584251+0000","last_became_active":"2024-09-17T05:38:46.578693+0000","last_became_peered":"2024-09-17T05:38:46.578693+0000","last_unstale":"2024-09-17T05:38:47.584251+0000","last_undegraded":"2024-09-17T05:38:47.584251+0000","last_fullsized":"2024-09-17T05:38:47.584251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:37.403885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231121+0000","last_change":"2024-09-17T05:38:45.554558+0000","last_active":"2024-09-17T05:38:48.231121+0000","last_peered":"2024-09-17T05:38:48.231121+0000","last_clean":"2024-09-17T05:38:48.231121+0000","last_became_active":"2024-09-17T05:38:45.553507+0000","last_became_peered":"2024-09-17T05:38:45.553507+0000","last_unstale":"2024-09-17T05:38:48.231121+0000","last_undegraded":"2024-09-17T05:38:48.231121+0000","last_fullsized":"2024-09-17T05:38:48.231121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:17.914364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561102+0000","last_change":"2024-09-17T05:38:46.589121+0000","last_active":"2024-09-17T05:38:47.561102+0000","last_peered":"2024-09-17T05:38:47.561102+0000","last_clean":"2024-09-17T05:38:47.561102+0000","last_became_active":"2024-09-17T05:38:46.588667+0000","last_became_peered":"2024-09-17T05:38:46.588667+0000","last_unstale":"2024-09-17T05:38:47.561102+0000","last_undegraded":"2024-09-17T05:38:47.561102+0000","last_fullsized":"2024-09-17T05:38:47.561102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:58.942202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585657+0000","last_change":"2024-09-17T05:38:45.563341+0000","last_active":"2024-09-17T05:38:47.585657+0000","last_peered":"2024-09-17T05:38:47.585657+0000","last_clean":"2024-09-17T05:38:47.585657+0000","last_became_active":"2024-09-17T05:38:45.562575+0000","last_became_peered":"2024-09-17T05:38:45.562575+0000","last_unstale":"2024-09-17T05:38:47.585657+0000","last_undegraded":"2024-09-17T05:38:47.585657+0000","last_fullsized":"2024-09-17T05:38:47.585657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:33.451333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561305+0000","last_change":"2024-09-17T05:38:46.579734+0000","last_active":"2024-09-17T05:38:47.561305+0000","last_peered":"2024-09-17T05:38:47.561305+0000","last_clean":"2024-09-17T05:38:47.561305+0000","last_became_active":"2024-09-17T05:38:46.579394+0000","last_became_peered":"2024-09-17T05:38:46.579394+0000","last_unstale":"2024-09-17T05:38:47.561305+0000","last_undegraded":"2024-09-17T05:38:47.561305+0000","last_fullsized":"2024-09-17T05:38:47.561305+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:02.072633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"64'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585320+0000","last_change":"2024-09-17T05:38:45.567767+0000","last_active":"2024-09-17T05:38:47.585320+0000","last_peered":"2024-09-17T05:38:47.585320+0000","last_clean":"2024-09-17T05:38:47.585320+0000","last_became_active":"2024-09-17T05:38:45.567450+0000","last_became_peered":"2024-09-17T05:38:45.567450+0000","last_unstale":"2024-09-17T05:38:47.585320+0000","last_undegraded":"2024-09-17T05:38:47.585320+0000","last_fullsized":"2024-09-17T05:38:47.585320+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:23.820997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232125+0000","last_change":"2024-09-17T05:38:46.582949+0000","last_active":"2024-09-17T05:38:48.232125+0000","last_peered":"2024-09-17T05:38:48.232125+0000","last_clean":"2024-09-17T05:38:48.232125+0000","last_became_active":"2024-09-17T05:38:46.582607+0000","last_became_peered":"2024-09-17T05:38:46.582607+0000","last_unstale":"2024-09-17T05:38:48.232125+0000","last_undegraded":"2024-09-17T05:38:48.232125+0000","last_fullsized":"2024-09-17T05:38:48.232125+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:47:34.077173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232238+0000","last_change":"2024-09-17T05:38:45.554711+0000","last_active":"2024-09-17T05:38:48.232238+0000","last_peered":"2024-09-17T05:38:48.232238+0000","last_clean":"2024-09-17T05:38:48.232238+0000","last_became_active":"2024-09-17T05:38:45.554349+0000","last_became_peered":"2024-09-17T05:38:45.554349+0000","last_unstale":"2024-09-17T05:38:48.232238+0000","last_undegraded":"2024-09-17T05:38:48.232238+0000","last_fullsized":"2024-09-17T05:38:48.232238+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:32.363888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232569+0000","last_change":"2024-09-17T05:38:46.584872+0000","last_active":"2024-09-17T05:38:48.232569+0000","last_peered":"2024-09-17T05:38:48.232569+0000","last_clean":"2024-09-17T05:38:48.232569+0000","last_became_active":"2024-09-17T05:38:46.584247+0000","last_became_peered":"2024-09-17T05:38:46.584247+0000","last_unstale":"2024-09-17T05:38:48.232569+0000","last_undegraded":"2024-09-17T05:38:48.232569+0000","last_fullsized":"2024-09-17T05:38:48.232569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:13.766322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586874+0000","last_change":"2024-09-17T05:38:45.566114+0000","last_active":"2024-09-17T05:38:47.586874+0000","last_peered":"2024-09-17T05:38:47.586874+0000","last_clean":"2024-09-17T05:38:47.586874+0000","last_became_active":"2024-09-17T05:38:45.565806+0000","last_became_peered":"2024-09-17T05:38:45.565806+0000","last_unstale":"2024-09-17T05:38:47.586874+0000","last_undegraded":"2024-09-17T05:38:47.586874+0000","last_fullsized":"2024-09-17T05:38:47.586874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:31.444638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584149+0000","last_change":"2024-09-17T05:38:46.582090+0000","last_active":"2024-09-17T05:38:47.584149+0000","last_peered":"2024-09-17T05:38:47.584149+0000","last_clean":"2024-09-17T05:38:47.584149+0000","last_became_active":"2024-09-17T05:38:46.581792+0000","last_became_peered":"2024-09-17T05:38:46.581792+0000","last_unstale":"2024-09-17T05:38:47.584149+0000","last_undegraded":"2024-09-17T05:38:47.584149+0000","last_fullsized":"2024-09-17T05:38:47.584149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:05.891801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561828+0000","last_change":"2024-09-17T05:38:45.565198+0000","last_active":"2024-09-17T05:38:47.561828+0000","last_peered":"2024-09-17T05:38:47.561828+0000","last_clean":"2024-09-17T05:38:47.561828+0000","last_became_active":"2024-09-17T05:38:45.564886+0000","last_became_peered":"2024-09-17T05:38:45.564886+0000","last_unstale":"2024-09-17T05:38:47.561828+0000","last_undegraded":"2024-09-17T05:38:47.561828+0000","last_fullsized":"2024-09-17T05:38:47.561828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:33.876827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561583+0000","last_change":"2024-09-17T05:38:46.579071+0000","last_active":"2024-09-17T05:38:47.561583+0000","last_peered":"2024-09-17T05:38:47.561583+0000","last_clean":"2024-09-17T05:38:47.561583+0000","last_became_active":"2024-09-17T05:38:46.578775+0000","last_became_peered":"2024-09-17T05:38:46.578775+0000","last_unstale":"2024-09-17T05:38:47.561583+0000","last_undegraded":"2024-09-17T05:38:47.561583+0000","last_fullsized":"2024-09-17T05:38:47.561583+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:14.544586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-17T05:38:46.562004+0000","last_change":"2024-09-17T05:38:45.560114+0000","last_active":"2024-09-17T05:38:46.562004+0000","last_peered":"2024-09-17T05:38:46.562004+0000","last_clean":"2024-09-17T05:38:46.562004+0000","last_became_active":"2024-09-17T05:38:45.559793+0000","last_became_peered":"2024-09-17T05:38:45.559793+0000","last_unstale":"2024-09-17T05:38:46.562004+0000","last_undegraded":"2024-09-17T05:38:46.562004+0000","last_fullsized":"2024-09-17T05:38:46.562004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:41.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231364+0000","last_change":"2024-09-17T05:38:46.600016+0000","last_active":"2024-09-17T05:38:48.231364+0000","last_peered":"2024-09-17T05:38:48.231364+0000","last_clean":"2024-09-17T05:38:48.231364+0000","last_became_active":"2024-09-17T05:38:46.599695+0000","last_became_peered":"2024-09-17T05:38:46.599695+0000","last_unstale":"2024-09-17T05:38:48.231364+0000","last_undegraded":"2024-09-17T05:38:48.231364+0000","last_fullsized":"2024-09-17T05:38:48.231364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:16.967058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586726+0000","last_change":"2024-09-17T05:38:45.569074+0000","last_active":"2024-09-17T05:38:47.586726+0000","last_peered":"2024-09-17T05:38:47.586726+0000","last_clean":"2024-09-17T05:38:47.586726+0000","last_became_active":"2024-09-17T05:38:45.568523+0000","last_became_peered":"2024-09-17T05:38:45.568523+0000","last_unstale":"2024-09-17T05:38:47.586726+0000","last_undegraded":"2024-09-17T05:38:47.586726+0000","last_fullsized":"2024-09-17T05:38:47.586726+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:11.357532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561260+0000","last_change":"2024-09-17T05:38:46.599792+0000","last_active":"2024-09-17T05:38:47.561260+0000","last_peered":"2024-09-17T05:38:47.561260+0000","last_clean":"2024-09-17T05:38:47.561260+0000","last_became_active":"2024-09-17T05:38:46.599095+0000","last_became_peered":"2024-09-17T05:38:46.599095+0000","last_unstale":"2024-09-17T05:38:47.561260+0000","last_undegraded":"2024-09-17T05:38:47.561260+0000","last_fullsized":"2024-09-17T05:38:47.561260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:52.341504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231421+0000","last_change":"2024-09-17T05:38:45.556497+0000","last_active":"2024-09-17T05:38:48.231421+0000","last_peered":"2024-09-17T05:38:48.231421+0000","last_clean":"2024-09-17T05:38:48.231421+0000","last_became_active":"2024-09-17T05:38:45.556092+0000","last_became_peered":"2024-09-17T05:38:45.556092+0000","last_unstale":"2024-09-17T05:38:48.231421+0000","last_undegraded":"2024-09-17T05:38:48.231421+0000","last_fullsized":"2024-09-17T05:38:48.231421+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:07.995691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560034+0000","last_change":"2024-09-17T05:38:46.582032+0000","last_active":"2024-09-17T05:38:47.560034+0000","last_peered":"2024-09-17T05:38:47.560034+0000","last_clean":"2024-09-17T05:38:47.560034+0000","last_became_active":"2024-09-17T05:38:46.581647+0000","last_became_peered":"2024-09-17T05:38:46.581647+0000","last_unstale":"2024-09-17T05:38:47.560034+0000","last_undegraded":"2024-09-17T05:38:47.560034+0000","last_fullsized":"2024-09-17T05:38:47.560034+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:54.104099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232159+0000","last_change":"2024-09-17T05:38:45.563687+0000","last_active":"2024-09-17T05:38:48.232159+0000","last_peered":"2024-09-17T05:38:48.232159+0000","last_clean":"2024-09-17T05:38:48.232159+0000","last_became_active":"2024-09-17T05:38:45.563295+0000","last_became_peered":"2024-09-17T05:38:45.563295+0000","last_unstale":"2024-09-17T05:38:48.232159+0000","last_undegraded":"2024-09-17T05:38:48.232159+0000","last_fullsized":"2024-09-17T05:38:48.232159+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:33.451333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559673+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:38:47.559673+0000","last_peered":"2024-09-17T05:38:47.559673+0000","last_clean":"2024-09-17T05:38:47.559673+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:38:47.559673+0000","last_undegraded":"2024-09-17T05:38:47.559673+0000","last_fullsized":"2024-09-17T05:38:47.559673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":765952,"data_stored":342578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":934670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":770048,"data_stored":343160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":774144,"data_stored":342738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":774144,"data_stored":342634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":932980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":342578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":774144,"data_stored":338150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:38:55.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:38:55.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 -- 172.21.15.44:0/1185635772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f680cb470 msgr2=0x7f2f680cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:55.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/1185635772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f680cb470 0x7f2f680cb880 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009bc0 tx=0x7f2f6001ca30 comp rx=0 tx=0).stop 2024-09-17T05:38:55.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 -- 172.21.15.44:0/1185635772 shutdown_connections 2024-09-17T05:38:55.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/1185635772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f680cb470 0x7f2f680cb880 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/1185635772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f6806de50 0x7f2f6806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 -- 172.21.15.44:0/1185635772 >> 172.21.15.44:0/1185635772 conn(0x7f2f680ccaa0 msgr2=0x7f2f680cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:55.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 -- 172.21.15.44:0/1185635772 shutdown_connections 2024-09-17T05:38:55.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 -- 172.21.15.44:0/1185635772 wait complete. 2024-09-17T05:38:55.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.625+0000 7f2f6ca00640 1 Processor -- start 2024-09-17T05:38:55.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 -- start start 2024-09-17T05:38:55.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6806de50 0x7f2f6809ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68072e50 0x7f2f681fc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f680cb470 0x7f2f681fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68168f80 con 0x7f2f6806de50 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68168e00 con 0x7f2f68072e50 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2f68169100 con 0x7f2f680cb470 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6806de50 0x7f2f6809ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6806de50 0x7f2f6809ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36036/0 (socket says 172.21.15.44:36036) 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 -- 172.21.15.44:0/4288108902 learned_addr learned my addr 172.21.15.44:0/4288108902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f5fe00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68072e50 0x7f2f681fc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f66800640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f680cb470 0x7f2f681fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:55.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 -- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f680cb470 msgr2=0x7f2f681fc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:55.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f680cb470 0x7f2f681fc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 -- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68072e50 msgr2=0x7f2f681fc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:55.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68072e50 0x7f2f681fc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 -- 172.21.15.44:0/4288108902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6809bab0 con 0x7f2f6806de50 2024-09-17T05:38:55.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f66800640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f680cb470 0x7f2f681fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:55.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f65e00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6806de50 0x7f2f6809ac50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c560 tx=0x7f2f5800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:55.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f5e000640 1 -- 172.21.15.44:0/4288108902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58016020 con 0x7f2f6806de50 2024-09-17T05:38:55.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f5e000640 1 -- 172.21.15.44:0/4288108902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f58012940 con 0x7f2f6806de50 2024-09-17T05:38:55.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6809b4f0 con 0x7f2f6806de50 2024-09-17T05:38:55.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f5e000640 1 -- 172.21.15.44:0/4288108902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58012d90 con 0x7f2f6806de50 2024-09-17T05:38:55.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f680b5310 con 0x7f2f6806de50 2024-09-17T05:38:55.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.629+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6806e260 con 0x7f2f6806de50 2024-09-17T05:38:55.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.633+0000 7f2f5e000640 1 -- 172.21.15.44:0/4288108902 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2f58019020 con 0x7f2f6806de50 2024-09-17T05:38:55.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.633+0000 7f2f5e000640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f44073230 0x7f2f44075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:55.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.633+0000 7f2f5e000640 1 -- 172.21.15.44:0/4288108902 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f2f58094400 con 0x7f2f6806de50 2024-09-17T05:38:55.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.633+0000 7f2f5fe00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f44073230 0x7f2f44075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:55.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.633+0000 7f2f5fe00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f44073230 0x7f2f44075740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f6815ac70 tx=0x7f2f500091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:55.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.637+0000 7f2f5e000640 1 -- 172.21.15.44:0/4288108902 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2f58020020 con 0x7f2f6806de50 2024-09-17T05:38:55.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.809+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f680b55b0 con 0x7f2f44073230 2024-09-17T05:38:55.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.813+0000 7f2f5e000640 1 -- 172.21.15.44:0/4288108902 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252013 (secure 0 0 0) 0x7f2f680b55b0 con 0x7f2f44073230 2024-09-17T05:38:55.818 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:55.820 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f44073230 msgr2=0x7f2f44075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f44073230 0x7f2f44075740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f6815ac70 tx=0x7f2f500091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6806de50 msgr2=0x7f2f6809ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6806de50 0x7f2f6809ac50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800c560 tx=0x7f2f5800ca20 comp rx=0 tx=0).stop 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 shutdown_connections 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2f680cb470 0x7f2f681fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f44073230 0x7f2f44075740 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f68072e50 0x7f2f681fc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 --2- 172.21.15.44:0/4288108902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2f6806de50 0x7f2f6809ac50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 >> 172.21.15.44:0/4288108902 conn(0x7f2f680ccaa0 msgr2=0x7f2f68164650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:55.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 shutdown_connections 2024-09-17T05:38:55.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:55.817+0000 7f2f6ca00640 1 -- 172.21.15.44:0/4288108902 wait complete. 2024-09-17T05:38:55.841 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-17T05:38:54.299065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244256,"kb_used_data":7208,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730464,"statfs":{"total":773094113280,"available":772843995136,"internally_reserved":0,"allocated":7380992,"data_stored":3926180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002264"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232528+0000","last_change":"2024-09-17T05:38:46.583715+0000","last_active":"2024-09-17T05:38:48.232528+0000","last_peered":"2024-09-17T05:38:48.232528+0000","last_clean":"2024-09-17T05:38:48.232528+0000","last_became_active":"2024-09-17T05:38:46.583363+0000","last_became_peered":"2024-09-17T05:38:46.583363+0000","last_unstale":"2024-09-17T05:38:48.232528+0000","last_undegraded":"2024-09-17T05:38:48.232528+0000","last_fullsized":"2024-09-17T05:38:48.232528+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:41.998863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232206+0000","last_change":"2024-09-17T05:38:46.589668+0000","last_active":"2024-09-17T05:38:48.232206+0000","last_peered":"2024-09-17T05:38:48.232206+0000","last_clean":"2024-09-17T05:38:48.232206+0000","last_became_active":"2024-09-17T05:38:46.588645+0000","last_became_peered":"2024-09-17T05:38:46.588645+0000","last_unstale":"2024-09-17T05:38:48.232206+0000","last_undegraded":"2024-09-17T05:38:48.232206+0000","last_fullsized":"2024-09-17T05:38:48.232206+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:48.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232062+0000","last_change":"2024-09-17T05:38:46.584743+0000","last_active":"2024-09-17T05:38:48.232062+0000","last_peered":"2024-09-17T05:38:48.232062+0000","last_clean":"2024-09-17T05:38:48.232062+0000","last_became_active":"2024-09-17T05:38:46.582721+0000","last_became_peered":"2024-09-17T05:38:46.582721+0000","last_unstale":"2024-09-17T05:38:48.232062+0000","last_undegraded":"2024-09-17T05:38:48.232062+0000","last_fullsized":"2024-09-17T05:38:48.232062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:47.756467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584681+0000","last_change":"2024-09-17T05:38:46.582314+0000","last_active":"2024-09-17T05:38:47.584681+0000","last_peered":"2024-09-17T05:38:47.584681+0000","last_clean":"2024-09-17T05:38:47.584681+0000","last_became_active":"2024-09-17T05:38:46.580575+0000","last_became_peered":"2024-09-17T05:38:46.580575+0000","last_unstale":"2024-09-17T05:38:47.584681+0000","last_undegraded":"2024-09-17T05:38:47.584681+0000","last_fullsized":"2024-09-17T05:38:47.584681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:33.451689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231854+0000","last_change":"2024-09-17T05:38:46.580506+0000","last_active":"2024-09-17T05:38:48.231854+0000","last_peered":"2024-09-17T05:38:48.231854+0000","last_clean":"2024-09-17T05:38:48.231854+0000","last_became_active":"2024-09-17T05:38:46.580190+0000","last_became_peered":"2024-09-17T05:38:46.580190+0000","last_unstale":"2024-09-17T05:38:48.231854+0000","last_undegraded":"2024-09-17T05:38:48.231854+0000","last_fullsized":"2024-09-17T05:38:48.231854+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:22.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231241+0000","last_change":"2024-09-17T05:38:46.596761+0000","last_active":"2024-09-17T05:38:48.231241+0000","last_peered":"2024-09-17T05:38:48.231241+0000","last_clean":"2024-09-17T05:38:48.231241+0000","last_became_active":"2024-09-17T05:38:46.596447+0000","last_became_peered":"2024-09-17T05:38:46.596447+0000","last_unstale":"2024-09-17T05:38:48.231241+0000","last_undegraded":"2024-09-17T05:38:48.231241+0000","last_fullsized":"2024-09-17T05:38:48.231241+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:06.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231669+0000","last_change":"2024-09-17T05:38:46.576539+0000","last_active":"2024-09-17T05:38:48.231669+0000","last_peered":"2024-09-17T05:38:48.231669+0000","last_clean":"2024-09-17T05:38:48.231669+0000","last_became_active":"2024-09-17T05:38:46.576080+0000","last_became_peered":"2024-09-17T05:38:46.576080+0000","last_unstale":"2024-09-17T05:38:48.231669+0000","last_undegraded":"2024-09-17T05:38:48.231669+0000","last_fullsized":"2024-09-17T05:38:48.231669+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:26.808234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231755+0000","last_change":"2024-09-17T05:38:46.586518+0000","last_active":"2024-09-17T05:38:48.231755+0000","last_peered":"2024-09-17T05:38:48.231755+0000","last_clean":"2024-09-17T05:38:48.231755+0000","last_became_active":"2024-09-17T05:38:46.584357+0000","last_became_peered":"2024-09-17T05:38:46.584357+0000","last_unstale":"2024-09-17T05:38:48.231755+0000","last_undegraded":"2024-09-17T05:38:48.231755+0000","last_fullsized":"2024-09-17T05:38:48.231755+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:49.566913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585332+0000","last_change":"2024-09-17T05:38:46.567603+0000","last_active":"2024-09-17T05:38:47.585332+0000","last_peered":"2024-09-17T05:38:47.585332+0000","last_clean":"2024-09-17T05:38:47.585332+0000","last_became_active":"2024-09-17T05:38:46.566779+0000","last_became_peered":"2024-09-17T05:38:46.566779+0000","last_unstale":"2024-09-17T05:38:47.585332+0000","last_undegraded":"2024-09-17T05:38:47.585332+0000","last_fullsized":"2024-09-17T05:38:47.585332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:44.417278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560491+0000","last_change":"2024-09-17T05:38:46.578580+0000","last_active":"2024-09-17T05:38:47.560491+0000","last_peered":"2024-09-17T05:38:47.560491+0000","last_clean":"2024-09-17T05:38:47.560491+0000","last_became_active":"2024-09-17T05:38:46.578232+0000","last_became_peered":"2024-09-17T05:38:46.578232+0000","last_unstale":"2024-09-17T05:38:47.560491+0000","last_undegraded":"2024-09-17T05:38:47.560491+0000","last_fullsized":"2024-09-17T05:38:47.560491+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:52.064912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584852+0000","last_change":"2024-09-17T05:38:46.575287+0000","last_active":"2024-09-17T05:38:47.584852+0000","last_peered":"2024-09-17T05:38:47.584852+0000","last_clean":"2024-09-17T05:38:47.584852+0000","last_became_active":"2024-09-17T05:38:46.574220+0000","last_became_peered":"2024-09-17T05:38:46.574220+0000","last_unstale":"2024-09-17T05:38:47.584852+0000","last_undegraded":"2024-09-17T05:38:47.584852+0000","last_fullsized":"2024-09-17T05:38:47.584852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:51.884137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584681+0000","last_change":"2024-09-17T05:38:46.590580+0000","last_active":"2024-09-17T05:38:47.584681+0000","last_peered":"2024-09-17T05:38:47.584681+0000","last_clean":"2024-09-17T05:38:47.584681+0000","last_became_active":"2024-09-17T05:38:46.587617+0000","last_became_peered":"2024-09-17T05:38:46.587617+0000","last_unstale":"2024-09-17T05:38:47.584681+0000","last_undegraded":"2024-09-17T05:38:47.584681+0000","last_fullsized":"2024-09-17T05:38:47.584681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:02.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561908+0000","last_change":"2024-09-17T05:38:46.599704+0000","last_active":"2024-09-17T05:38:47.561908+0000","last_peered":"2024-09-17T05:38:47.561908+0000","last_clean":"2024-09-17T05:38:47.561908+0000","last_became_active":"2024-09-17T05:38:46.599407+0000","last_became_peered":"2024-09-17T05:38:46.599407+0000","last_unstale":"2024-09-17T05:38:47.561908+0000","last_undegraded":"2024-09-17T05:38:47.561908+0000","last_fullsized":"2024-09-17T05:38:47.561908+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:34.457859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561637+0000","last_change":"2024-09-17T05:38:46.585181+0000","last_active":"2024-09-17T05:38:47.561637+0000","last_peered":"2024-09-17T05:38:47.561637+0000","last_clean":"2024-09-17T05:38:47.561637+0000","last_became_active":"2024-09-17T05:38:46.584764+0000","last_became_peered":"2024-09-17T05:38:46.584764+0000","last_unstale":"2024-09-17T05:38:47.561637+0000","last_undegraded":"2024-09-17T05:38:47.561637+0000","last_fullsized":"2024-09-17T05:38:47.561637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:24.827524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559655+0000","last_change":"2024-09-17T05:38:46.584583+0000","last_active":"2024-09-17T05:38:47.559655+0000","last_peered":"2024-09-17T05:38:47.559655+0000","last_clean":"2024-09-17T05:38:47.559655+0000","last_became_active":"2024-09-17T05:38:46.584127+0000","last_became_peered":"2024-09-17T05:38:46.584127+0000","last_unstale":"2024-09-17T05:38:47.559655+0000","last_undegraded":"2024-09-17T05:38:47.559655+0000","last_fullsized":"2024-09-17T05:38:47.559655+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:26.003681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586829+0000","last_change":"2024-09-17T05:38:46.573627+0000","last_active":"2024-09-17T05:38:47.586829+0000","last_peered":"2024-09-17T05:38:47.586829+0000","last_clean":"2024-09-17T05:38:47.586829+0000","last_became_active":"2024-09-17T05:38:46.573293+0000","last_became_peered":"2024-09-17T05:38:46.573293+0000","last_unstale":"2024-09-17T05:38:47.586829+0000","last_undegraded":"2024-09-17T05:38:47.586829+0000","last_fullsized":"2024-09-17T05:38:47.586829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:06.342259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561747+0000","last_change":"2024-09-17T05:38:46.584458+0000","last_active":"2024-09-17T05:38:47.561747+0000","last_peered":"2024-09-17T05:38:47.561747+0000","last_clean":"2024-09-17T05:38:47.561747+0000","last_became_active":"2024-09-17T05:38:46.584179+0000","last_became_peered":"2024-09-17T05:38:46.584179+0000","last_unstale":"2024-09-17T05:38:47.561747+0000","last_undegraded":"2024-09-17T05:38:47.561747+0000","last_fullsized":"2024-09-17T05:38:47.561747+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:55.233845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585092+0000","last_change":"2024-09-17T05:38:46.589858+0000","last_active":"2024-09-17T05:38:47.585092+0000","last_peered":"2024-09-17T05:38:47.585092+0000","last_clean":"2024-09-17T05:38:47.585092+0000","last_became_active":"2024-09-17T05:38:46.589478+0000","last_became_peered":"2024-09-17T05:38:46.589478+0000","last_unstale":"2024-09-17T05:38:47.585092+0000","last_undegraded":"2024-09-17T05:38:47.585092+0000","last_fullsized":"2024-09-17T05:38:47.585092+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:34.354288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584848+0000","last_change":"2024-09-17T05:38:46.568077+0000","last_active":"2024-09-17T05:38:47.584848+0000","last_peered":"2024-09-17T05:38:47.584848+0000","last_clean":"2024-09-17T05:38:47.584848+0000","last_became_active":"2024-09-17T05:38:46.567652+0000","last_became_peered":"2024-09-17T05:38:46.567652+0000","last_unstale":"2024-09-17T05:38:47.584848+0000","last_undegraded":"2024-09-17T05:38:47.584848+0000","last_fullsized":"2024-09-17T05:38:47.584848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:29.084869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561004+0000","last_change":"2024-09-17T05:38:46.595969+0000","last_active":"2024-09-17T05:38:47.561004+0000","last_peered":"2024-09-17T05:38:47.561004+0000","last_clean":"2024-09-17T05:38:47.561004+0000","last_became_active":"2024-09-17T05:38:46.595674+0000","last_became_peered":"2024-09-17T05:38:46.595674+0000","last_unstale":"2024-09-17T05:38:47.561004+0000","last_undegraded":"2024-09-17T05:38:47.561004+0000","last_fullsized":"2024-09-17T05:38:47.561004+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:22.861395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561632+0000","last_change":"2024-09-17T05:38:46.585547+0000","last_active":"2024-09-17T05:38:47.561632+0000","last_peered":"2024-09-17T05:38:47.561632+0000","last_clean":"2024-09-17T05:38:47.561632+0000","last_became_active":"2024-09-17T05:38:46.584969+0000","last_became_peered":"2024-09-17T05:38:46.584969+0000","last_unstale":"2024-09-17T05:38:47.561632+0000","last_undegraded":"2024-09-17T05:38:47.561632+0000","last_fullsized":"2024-09-17T05:38:47.561632+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:58.154228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231686+0000","last_change":"2024-09-17T05:38:46.593887+0000","last_active":"2024-09-17T05:38:48.231686+0000","last_peered":"2024-09-17T05:38:48.231686+0000","last_clean":"2024-09-17T05:38:48.231686+0000","last_became_active":"2024-09-17T05:38:46.593579+0000","last_became_peered":"2024-09-17T05:38:46.593579+0000","last_unstale":"2024-09-17T05:38:48.231686+0000","last_undegraded":"2024-09-17T05:38:48.231686+0000","last_fullsized":"2024-09-17T05:38:48.231686+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:28.832882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586654+0000","last_change":"2024-09-17T05:38:46.572760+0000","last_active":"2024-09-17T05:38:47.586654+0000","last_peered":"2024-09-17T05:38:47.586654+0000","last_clean":"2024-09-17T05:38:47.586654+0000","last_became_active":"2024-09-17T05:38:46.572445+0000","last_became_peered":"2024-09-17T05:38:46.572445+0000","last_unstale":"2024-09-17T05:38:47.586654+0000","last_undegraded":"2024-09-17T05:38:47.586654+0000","last_fullsized":"2024-09-17T05:38:47.586654+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:09.884165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232190+0000","last_change":"2024-09-17T05:38:46.585916+0000","last_active":"2024-09-17T05:38:48.232190+0000","last_peered":"2024-09-17T05:38:48.232190+0000","last_clean":"2024-09-17T05:38:48.232190+0000","last_became_active":"2024-09-17T05:38:46.585568+0000","last_became_peered":"2024-09-17T05:38:46.585568+0000","last_unstale":"2024-09-17T05:38:48.232190+0000","last_undegraded":"2024-09-17T05:38:48.232190+0000","last_fullsized":"2024-09-17T05:38:48.232190+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:50.921603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.562071+0000","last_change":"2024-09-17T05:38:46.586594+0000","last_active":"2024-09-17T05:38:47.562071+0000","last_peered":"2024-09-17T05:38:47.562071+0000","last_clean":"2024-09-17T05:38:47.562071+0000","last_became_active":"2024-09-17T05:38:46.586267+0000","last_became_peered":"2024-09-17T05:38:46.586267+0000","last_unstale":"2024-09-17T05:38:47.562071+0000","last_undegraded":"2024-09-17T05:38:47.562071+0000","last_fullsized":"2024-09-17T05:38:47.562071+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:12.808727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231898+0000","last_change":"2024-09-17T05:38:46.583644+0000","last_active":"2024-09-17T05:38:48.231898+0000","last_peered":"2024-09-17T05:38:48.231898+0000","last_clean":"2024-09-17T05:38:48.231898+0000","last_became_active":"2024-09-17T05:38:46.583352+0000","last_became_peered":"2024-09-17T05:38:46.583352+0000","last_unstale":"2024-09-17T05:38:48.231898+0000","last_undegraded":"2024-09-17T05:38:48.231898+0000","last_fullsized":"2024-09-17T05:38:48.231898+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:26.757140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561610+0000","last_change":"2024-09-17T05:38:46.585986+0000","last_active":"2024-09-17T05:38:47.561610+0000","last_peered":"2024-09-17T05:38:47.561610+0000","last_clean":"2024-09-17T05:38:47.561610+0000","last_became_active":"2024-09-17T05:38:46.585647+0000","last_became_peered":"2024-09-17T05:38:46.585647+0000","last_unstale":"2024-09-17T05:38:47.561610+0000","last_undegraded":"2024-09-17T05:38:47.561610+0000","last_fullsized":"2024-09-17T05:38:47.561610+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:29.940064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231658+0000","last_change":"2024-09-17T05:38:46.566215+0000","last_active":"2024-09-17T05:38:48.231658+0000","last_peered":"2024-09-17T05:38:48.231658+0000","last_clean":"2024-09-17T05:38:48.231658+0000","last_became_active":"2024-09-17T05:38:46.565932+0000","last_became_peered":"2024-09-17T05:38:46.565932+0000","last_unstale":"2024-09-17T05:38:48.231658+0000","last_undegraded":"2024-09-17T05:38:48.231658+0000","last_fullsized":"2024-09-17T05:38:48.231658+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:37.192882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584721+0000","last_change":"2024-09-17T05:38:46.592682+0000","last_active":"2024-09-17T05:38:47.584721+0000","last_peered":"2024-09-17T05:38:47.584721+0000","last_clean":"2024-09-17T05:38:47.584721+0000","last_became_active":"2024-09-17T05:38:46.592372+0000","last_became_peered":"2024-09-17T05:38:46.592372+0000","last_unstale":"2024-09-17T05:38:47.584721+0000","last_undegraded":"2024-09-17T05:38:47.584721+0000","last_fullsized":"2024-09-17T05:38:47.584721+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:47.771869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584192+0000","last_change":"2024-09-17T05:38:46.572590+0000","last_active":"2024-09-17T05:38:47.584192+0000","last_peered":"2024-09-17T05:38:47.584192+0000","last_clean":"2024-09-17T05:38:47.584192+0000","last_became_active":"2024-09-17T05:38:46.572228+0000","last_became_peered":"2024-09-17T05:38:46.572228+0000","last_unstale":"2024-09-17T05:38:47.584192+0000","last_undegraded":"2024-09-17T05:38:47.584192+0000","last_fullsized":"2024-09-17T05:38:47.584192+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:49.986075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231738+0000","last_change":"2024-09-17T05:38:46.585824+0000","last_active":"2024-09-17T05:38:48.231738+0000","last_peered":"2024-09-17T05:38:48.231738+0000","last_clean":"2024-09-17T05:38:48.231738+0000","last_became_active":"2024-09-17T05:38:46.585510+0000","last_became_peered":"2024-09-17T05:38:46.585510+0000","last_unstale":"2024-09-17T05:38:48.231738+0000","last_undegraded":"2024-09-17T05:38:48.231738+0000","last_fullsized":"2024-09-17T05:38:48.231738+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:53.094626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231469+0000","last_change":"2024-09-17T05:38:46.581873+0000","last_active":"2024-09-17T05:38:48.231469+0000","last_peered":"2024-09-17T05:38:48.231469+0000","last_clean":"2024-09-17T05:38:48.231469+0000","last_became_active":"2024-09-17T05:38:46.581393+0000","last_became_peered":"2024-09-17T05:38:46.581393+0000","last_unstale":"2024-09-17T05:38:48.231469+0000","last_undegraded":"2024-09-17T05:38:48.231469+0000","last_fullsized":"2024-09-17T05:38:48.231469+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:50.661347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584979+0000","last_change":"2024-09-17T05:38:46.572968+0000","last_active":"2024-09-17T05:38:47.584979+0000","last_peered":"2024-09-17T05:38:47.584979+0000","last_clean":"2024-09-17T05:38:47.584979+0000","last_became_active":"2024-09-17T05:38:46.568424+0000","last_became_peered":"2024-09-17T05:38:46.568424+0000","last_unstale":"2024-09-17T05:38:47.584979+0000","last_undegraded":"2024-09-17T05:38:47.584979+0000","last_fullsized":"2024-09-17T05:38:47.584979+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:09.152284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232571+0000","last_change":"2024-09-17T05:38:45.557221+0000","last_active":"2024-09-17T05:38:48.232571+0000","last_peered":"2024-09-17T05:38:48.232571+0000","last_clean":"2024-09-17T05:38:48.232571+0000","last_became_active":"2024-09-17T05:38:45.556870+0000","last_became_peered":"2024-09-17T05:38:45.556870+0000","last_unstale":"2024-09-17T05:38:48.232571+0000","last_undegraded":"2024-09-17T05:38:48.232571+0000","last_fullsized":"2024-09-17T05:38:48.232571+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:15.758423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232070+0000","last_change":"2024-09-17T05:38:46.587243+0000","last_active":"2024-09-17T05:38:48.232070+0000","last_peered":"2024-09-17T05:38:48.232070+0000","last_clean":"2024-09-17T05:38:48.232070+0000","last_became_active":"2024-09-17T05:38:46.586872+0000","last_became_peered":"2024-09-17T05:38:46.586872+0000","last_unstale":"2024-09-17T05:38:48.232070+0000","last_undegraded":"2024-09-17T05:38:48.232070+0000","last_fullsized":"2024-09-17T05:38:48.232070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:42.437303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232392+0000","last_change":"2024-09-17T05:38:45.566302+0000","last_active":"2024-09-17T05:38:48.232392+0000","last_peered":"2024-09-17T05:38:48.232392+0000","last_clean":"2024-09-17T05:38:48.232392+0000","last_became_active":"2024-09-17T05:38:45.565920+0000","last_became_peered":"2024-09-17T05:38:45.565920+0000","last_unstale":"2024-09-17T05:38:48.232392+0000","last_undegraded":"2024-09-17T05:38:48.232392+0000","last_fullsized":"2024-09-17T05:38:48.232392+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:15.161432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232531+0000","last_change":"2024-09-17T05:38:46.585061+0000","last_active":"2024-09-17T05:38:48.232531+0000","last_peered":"2024-09-17T05:38:48.232531+0000","last_clean":"2024-09-17T05:38:48.232531+0000","last_became_active":"2024-09-17T05:38:46.584717+0000","last_became_peered":"2024-09-17T05:38:46.584717+0000","last_unstale":"2024-09-17T05:38:48.232531+0000","last_undegraded":"2024-09-17T05:38:48.232531+0000","last_fullsized":"2024-09-17T05:38:48.232531+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:02.183305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232500+0000","last_change":"2024-09-17T05:38:45.563577+0000","last_active":"2024-09-17T05:38:48.232500+0000","last_peered":"2024-09-17T05:38:48.232500+0000","last_clean":"2024-09-17T05:38:48.232500+0000","last_became_active":"2024-09-17T05:38:45.563266+0000","last_became_peered":"2024-09-17T05:38:45.563266+0000","last_unstale":"2024-09-17T05:38:48.232500+0000","last_undegraded":"2024-09-17T05:38:48.232500+0000","last_fullsized":"2024-09-17T05:38:48.232500+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:24.411304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585492+0000","last_change":"2024-09-17T05:38:46.580612+0000","last_active":"2024-09-17T05:38:47.585492+0000","last_peered":"2024-09-17T05:38:47.585492+0000","last_clean":"2024-09-17T05:38:47.585492+0000","last_became_active":"2024-09-17T05:38:46.580288+0000","last_became_peered":"2024-09-17T05:38:46.580288+0000","last_unstale":"2024-09-17T05:38:47.585492+0000","last_undegraded":"2024-09-17T05:38:47.585492+0000","last_fullsized":"2024-09-17T05:38:47.585492+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:22.861395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231719+0000","last_change":"2024-09-17T05:38:45.556629+0000","last_active":"2024-09-17T05:38:48.231719+0000","last_peered":"2024-09-17T05:38:48.231719+0000","last_clean":"2024-09-17T05:38:48.231719+0000","last_became_active":"2024-09-17T05:38:45.556195+0000","last_became_peered":"2024-09-17T05:38:45.556195+0000","last_unstale":"2024-09-17T05:38:48.231719+0000","last_undegraded":"2024-09-17T05:38:48.231719+0000","last_fullsized":"2024-09-17T05:38:48.231719+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:09.306010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560617+0000","last_change":"2024-09-17T05:38:46.581381+0000","last_active":"2024-09-17T05:38:47.560617+0000","last_peered":"2024-09-17T05:38:47.560617+0000","last_clean":"2024-09-17T05:38:47.560617+0000","last_became_active":"2024-09-17T05:38:46.581098+0000","last_became_peered":"2024-09-17T05:38:46.581098+0000","last_unstale":"2024-09-17T05:38:47.560617+0000","last_undegraded":"2024-09-17T05:38:47.560617+0000","last_fullsized":"2024-09-17T05:38:47.560617+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:34.354288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561489+0000","last_change":"2024-09-17T05:38:45.565943+0000","last_active":"2024-09-17T05:38:47.561489+0000","last_peered":"2024-09-17T05:38:47.561489+0000","last_clean":"2024-09-17T05:38:47.561489+0000","last_became_active":"2024-09-17T05:38:45.565559+0000","last_became_peered":"2024-09-17T05:38:45.565559+0000","last_unstale":"2024-09-17T05:38:47.561489+0000","last_undegraded":"2024-09-17T05:38:47.561489+0000","last_fullsized":"2024-09-17T05:38:47.561489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:04.885275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232085+0000","last_change":"2024-09-17T05:38:46.566137+0000","last_active":"2024-09-17T05:38:48.232085+0000","last_peered":"2024-09-17T05:38:48.232085+0000","last_clean":"2024-09-17T05:38:48.232085+0000","last_became_active":"2024-09-17T05:38:46.565806+0000","last_became_peered":"2024-09-17T05:38:46.565806+0000","last_unstale":"2024-09-17T05:38:48.232085+0000","last_undegraded":"2024-09-17T05:38:48.232085+0000","last_fullsized":"2024-09-17T05:38:48.232085+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:39.500289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231895+0000","last_change":"2024-09-17T05:38:45.564188+0000","last_active":"2024-09-17T05:38:48.231895+0000","last_peered":"2024-09-17T05:38:48.231895+0000","last_clean":"2024-09-17T05:38:48.231895+0000","last_became_active":"2024-09-17T05:38:45.562211+0000","last_became_peered":"2024-09-17T05:38:45.562211+0000","last_unstale":"2024-09-17T05:38:48.231895+0000","last_undegraded":"2024-09-17T05:38:48.231895+0000","last_fullsized":"2024-09-17T05:38:48.231895+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:26.707336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560176+0000","last_change":"2024-09-17T05:38:46.566248+0000","last_active":"2024-09-17T05:38:47.560176+0000","last_peered":"2024-09-17T05:38:47.560176+0000","last_clean":"2024-09-17T05:38:47.560176+0000","last_became_active":"2024-09-17T05:38:46.565904+0000","last_became_peered":"2024-09-17T05:38:46.565904+0000","last_unstale":"2024-09-17T05:38:47.560176+0000","last_undegraded":"2024-09-17T05:38:47.560176+0000","last_fullsized":"2024-09-17T05:38:47.560176+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:12.808727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231909+0000","last_change":"2024-09-17T05:38:45.558292+0000","last_active":"2024-09-17T05:38:48.231909+0000","last_peered":"2024-09-17T05:38:48.231909+0000","last_clean":"2024-09-17T05:38:48.231909+0000","last_became_active":"2024-09-17T05:38:45.557924+0000","last_became_peered":"2024-09-17T05:38:45.557924+0000","last_unstale":"2024-09-17T05:38:48.231909+0000","last_undegraded":"2024-09-17T05:38:48.231909+0000","last_fullsized":"2024-09-17T05:38:48.231909+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:11.908735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560950+0000","last_change":"2024-09-17T05:38:46.600138+0000","last_active":"2024-09-17T05:38:47.560950+0000","last_peered":"2024-09-17T05:38:47.560950+0000","last_clean":"2024-09-17T05:38:47.560950+0000","last_became_active":"2024-09-17T05:38:46.599496+0000","last_became_peered":"2024-09-17T05:38:46.599496+0000","last_unstale":"2024-09-17T05:38:47.560950+0000","last_undegraded":"2024-09-17T05:38:47.560950+0000","last_fullsized":"2024-09-17T05:38:47.560950+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:44.417278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584423+0000","last_change":"2024-09-17T05:38:45.566557+0000","last_active":"2024-09-17T05:38:47.584423+0000","last_peered":"2024-09-17T05:38:47.584423+0000","last_clean":"2024-09-17T05:38:47.584423+0000","last_became_active":"2024-09-17T05:38:45.561815+0000","last_became_peered":"2024-09-17T05:38:45.561815+0000","last_unstale":"2024-09-17T05:38:47.584423+0000","last_undegraded":"2024-09-17T05:38:47.584423+0000","last_fullsized":"2024-09-17T05:38:47.584423+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:10.936452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231936+0000","last_change":"2024-09-17T05:38:46.568855+0000","last_active":"2024-09-17T05:38:48.231936+0000","last_peered":"2024-09-17T05:38:48.231936+0000","last_clean":"2024-09-17T05:38:48.231936+0000","last_became_active":"2024-09-17T05:38:46.568540+0000","last_became_peered":"2024-09-17T05:38:46.568540+0000","last_unstale":"2024-09-17T05:38:48.231936+0000","last_undegraded":"2024-09-17T05:38:48.231936+0000","last_fullsized":"2024-09-17T05:38:48.231936+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:09.192087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585500+0000","last_change":"2024-09-17T05:38:45.563925+0000","last_active":"2024-09-17T05:38:47.585500+0000","last_peered":"2024-09-17T05:38:47.585500+0000","last_clean":"2024-09-17T05:38:47.585500+0000","last_became_active":"2024-09-17T05:38:45.563013+0000","last_became_peered":"2024-09-17T05:38:45.563013+0000","last_unstale":"2024-09-17T05:38:47.585500+0000","last_undegraded":"2024-09-17T05:38:47.585500+0000","last_fullsized":"2024-09-17T05:38:47.585500+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:05.883963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561146+0000","last_change":"2024-09-17T05:38:46.591733+0000","last_active":"2024-09-17T05:38:47.561146+0000","last_peered":"2024-09-17T05:38:47.561146+0000","last_clean":"2024-09-17T05:38:47.561146+0000","last_became_active":"2024-09-17T05:38:46.591443+0000","last_became_peered":"2024-09-17T05:38:46.591443+0000","last_unstale":"2024-09-17T05:38:47.561146+0000","last_undegraded":"2024-09-17T05:38:47.561146+0000","last_fullsized":"2024-09-17T05:38:47.561146+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:30.137904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561869+0000","last_change":"2024-09-17T05:38:45.562855+0000","last_active":"2024-09-17T05:38:47.561869+0000","last_peered":"2024-09-17T05:38:47.561869+0000","last_clean":"2024-09-17T05:38:47.561869+0000","last_became_active":"2024-09-17T05:38:45.562513+0000","last_became_peered":"2024-09-17T05:38:45.562513+0000","last_unstale":"2024-09-17T05:38:47.561869+0000","last_undegraded":"2024-09-17T05:38:47.561869+0000","last_fullsized":"2024-09-17T05:38:47.561869+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:11.357532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561644+0000","last_change":"2024-09-17T05:38:46.599154+0000","last_active":"2024-09-17T05:38:47.561644+0000","last_peered":"2024-09-17T05:38:47.561644+0000","last_clean":"2024-09-17T05:38:47.561644+0000","last_became_active":"2024-09-17T05:38:46.598803+0000","last_became_peered":"2024-09-17T05:38:46.598803+0000","last_unstale":"2024-09-17T05:38:47.561644+0000","last_undegraded":"2024-09-17T05:38:47.561644+0000","last_fullsized":"2024-09-17T05:38:47.561644+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:37:57.178667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232228+0000","last_change":"2024-09-17T05:38:45.557154+0000","last_active":"2024-09-17T05:38:48.232228+0000","last_peered":"2024-09-17T05:38:48.232228+0000","last_clean":"2024-09-17T05:38:48.232228+0000","last_became_active":"2024-09-17T05:38:45.556734+0000","last_became_peered":"2024-09-17T05:38:45.556734+0000","last_unstale":"2024-09-17T05:38:48.232228+0000","last_undegraded":"2024-09-17T05:38:48.232228+0000","last_fullsized":"2024-09-17T05:38:48.232228+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:17.766361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232256+0000","last_change":"2024-09-17T05:38:46.587239+0000","last_active":"2024-09-17T05:38:48.232256+0000","last_peered":"2024-09-17T05:38:48.232256+0000","last_clean":"2024-09-17T05:38:48.232256+0000","last_became_active":"2024-09-17T05:38:46.585662+0000","last_became_peered":"2024-09-17T05:38:46.585662+0000","last_unstale":"2024-09-17T05:38:48.232256+0000","last_undegraded":"2024-09-17T05:38:48.232256+0000","last_fullsized":"2024-09-17T05:38:48.232256+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:40.116112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":21,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232076+0000","last_change":"2024-09-17T05:38:45.557059+0000","last_active":"2024-09-17T05:38:48.232076+0000","last_peered":"2024-09-17T05:38:48.232076+0000","last_clean":"2024-09-17T05:38:48.232076+0000","last_became_active":"2024-09-17T05:38:45.556369+0000","last_became_peered":"2024-09-17T05:38:45.556369+0000","last_unstale":"2024-09-17T05:38:48.232076+0000","last_undegraded":"2024-09-17T05:38:48.232076+0000","last_fullsized":"2024-09-17T05:38:48.232076+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:24.842363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559626+0000","last_change":"2024-09-17T05:38:46.566529+0000","last_active":"2024-09-17T05:38:47.559626+0000","last_peered":"2024-09-17T05:38:47.559626+0000","last_clean":"2024-09-17T05:38:47.559626+0000","last_became_active":"2024-09-17T05:38:46.565936+0000","last_became_peered":"2024-09-17T05:38:46.565936+0000","last_unstale":"2024-09-17T05:38:47.559626+0000","last_undegraded":"2024-09-17T05:38:47.559626+0000","last_fullsized":"2024-09-17T05:38:47.559626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:24.827524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584540+0000","last_change":"2024-09-17T05:38:45.561797+0000","last_active":"2024-09-17T05:38:47.584540+0000","last_peered":"2024-09-17T05:38:47.584540+0000","last_clean":"2024-09-17T05:38:47.584540+0000","last_became_active":"2024-09-17T05:38:45.561441+0000","last_became_peered":"2024-09-17T05:38:45.561441+0000","last_unstale":"2024-09-17T05:38:47.584540+0000","last_undegraded":"2024-09-17T05:38:47.584540+0000","last_fullsized":"2024-09-17T05:38:47.584540+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:58.166212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559903+0000","last_change":"2024-09-17T05:38:46.583184+0000","last_active":"2024-09-17T05:38:47.559903+0000","last_peered":"2024-09-17T05:38:47.559903+0000","last_clean":"2024-09-17T05:38:47.559903+0000","last_became_active":"2024-09-17T05:38:46.582829+0000","last_became_peered":"2024-09-17T05:38:46.582829+0000","last_unstale":"2024-09-17T05:38:47.559903+0000","last_undegraded":"2024-09-17T05:38:47.559903+0000","last_fullsized":"2024-09-17T05:38:47.559903+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:06.890490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559982+0000","last_change":"2024-09-17T05:38:45.565807+0000","last_active":"2024-09-17T05:38:47.559982+0000","last_peered":"2024-09-17T05:38:47.559982+0000","last_clean":"2024-09-17T05:38:47.559982+0000","last_became_active":"2024-09-17T05:38:45.565418+0000","last_became_peered":"2024-09-17T05:38:45.565418+0000","last_unstale":"2024-09-17T05:38:47.559982+0000","last_undegraded":"2024-09-17T05:38:47.559982+0000","last_fullsized":"2024-09-17T05:38:47.559982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:57.566772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559925+0000","last_change":"2024-09-17T05:38:46.590180+0000","last_active":"2024-09-17T05:38:47.559925+0000","last_peered":"2024-09-17T05:38:47.559925+0000","last_clean":"2024-09-17T05:38:47.559925+0000","last_became_active":"2024-09-17T05:38:46.588745+0000","last_became_peered":"2024-09-17T05:38:46.588745+0000","last_unstale":"2024-09-17T05:38:47.559925+0000","last_undegraded":"2024-09-17T05:38:47.559925+0000","last_fullsized":"2024-09-17T05:38:47.559925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:34.457859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231841+0000","last_change":"2024-09-17T05:38:45.560944+0000","last_active":"2024-09-17T05:38:48.231841+0000","last_peered":"2024-09-17T05:38:48.231841+0000","last_clean":"2024-09-17T05:38:48.231841+0000","last_became_active":"2024-09-17T05:38:45.559926+0000","last_became_peered":"2024-09-17T05:38:45.559926+0000","last_unstale":"2024-09-17T05:38:48.231841+0000","last_undegraded":"2024-09-17T05:38:48.231841+0000","last_fullsized":"2024-09-17T05:38:48.231841+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:19.901056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231527+0000","last_change":"2024-09-17T05:38:46.588274+0000","last_active":"2024-09-17T05:38:48.231527+0000","last_peered":"2024-09-17T05:38:48.231527+0000","last_clean":"2024-09-17T05:38:48.231527+0000","last_became_active":"2024-09-17T05:38:46.587955+0000","last_became_peered":"2024-09-17T05:38:46.587955+0000","last_unstale":"2024-09-17T05:38:48.231527+0000","last_undegraded":"2024-09-17T05:38:48.231527+0000","last_fullsized":"2024-09-17T05:38:48.231527+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:22.123542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"63'8","reported_seq":23,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559534+0000","last_change":"2024-09-17T05:38:45.566154+0000","last_active":"2024-09-17T05:38:47.559534+0000","last_peered":"2024-09-17T05:38:47.559534+0000","last_clean":"2024-09-17T05:38:47.559534+0000","last_became_active":"2024-09-17T05:38:45.565707+0000","last_became_peered":"2024-09-17T05:38:45.565707+0000","last_unstale":"2024-09-17T05:38:47.559534+0000","last_undegraded":"2024-09-17T05:38:47.559534+0000","last_fullsized":"2024-09-17T05:38:47.559534+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:00.735046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584991+0000","last_change":"2024-09-17T05:38:46.588630+0000","last_active":"2024-09-17T05:38:47.584991+0000","last_peered":"2024-09-17T05:38:47.584991+0000","last_clean":"2024-09-17T05:38:47.584991+0000","last_became_active":"2024-09-17T05:38:46.588322+0000","last_became_peered":"2024-09-17T05:38:46.588322+0000","last_unstale":"2024-09-17T05:38:47.584991+0000","last_undegraded":"2024-09-17T05:38:47.584991+0000","last_fullsized":"2024-09-17T05:38:47.584991+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:05.667138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585604+0000","last_change":"2024-09-17T05:38:45.567988+0000","last_active":"2024-09-17T05:38:47.585604+0000","last_peered":"2024-09-17T05:38:47.585604+0000","last_clean":"2024-09-17T05:38:47.585604+0000","last_became_active":"2024-09-17T05:38:45.567377+0000","last_became_peered":"2024-09-17T05:38:45.567377+0000","last_unstale":"2024-09-17T05:38:47.585604+0000","last_undegraded":"2024-09-17T05:38:47.585604+0000","last_fullsized":"2024-09-17T05:38:47.585604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:21.077642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561641+0000","last_change":"2024-09-17T05:38:46.596339+0000","last_active":"2024-09-17T05:38:47.561641+0000","last_peered":"2024-09-17T05:38:47.561641+0000","last_clean":"2024-09-17T05:38:47.561641+0000","last_became_active":"2024-09-17T05:38:46.596066+0000","last_became_peered":"2024-09-17T05:38:46.596066+0000","last_unstale":"2024-09-17T05:38:47.561641+0000","last_undegraded":"2024-09-17T05:38:47.561641+0000","last_fullsized":"2024-09-17T05:38:47.561641+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:22.084169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585055+0000","last_change":"2024-09-17T05:38:45.563646+0000","last_active":"2024-09-17T05:38:47.585055+0000","last_peered":"2024-09-17T05:38:47.585055+0000","last_clean":"2024-09-17T05:38:47.585055+0000","last_became_active":"2024-09-17T05:38:45.562598+0000","last_became_peered":"2024-09-17T05:38:45.562598+0000","last_unstale":"2024-09-17T05:38:47.585055+0000","last_undegraded":"2024-09-17T05:38:47.585055+0000","last_fullsized":"2024-09-17T05:38:47.585055+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:57.147702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.562010+0000","last_change":"2024-09-17T05:38:46.587623+0000","last_active":"2024-09-17T05:38:47.562010+0000","last_peered":"2024-09-17T05:38:47.562010+0000","last_clean":"2024-09-17T05:38:47.562010+0000","last_became_active":"2024-09-17T05:38:46.586993+0000","last_became_peered":"2024-09-17T05:38:46.586993+0000","last_unstale":"2024-09-17T05:38:47.562010+0000","last_undegraded":"2024-09-17T05:38:47.562010+0000","last_fullsized":"2024-09-17T05:38:47.562010+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:54.104099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232265+0000","last_change":"2024-09-17T05:38:45.553121+0000","last_active":"2024-09-17T05:38:48.232265+0000","last_peered":"2024-09-17T05:38:48.232265+0000","last_clean":"2024-09-17T05:38:48.232265+0000","last_became_active":"2024-09-17T05:38:45.552295+0000","last_became_peered":"2024-09-17T05:38:45.552295+0000","last_unstale":"2024-09-17T05:38:48.232265+0000","last_undegraded":"2024-09-17T05:38:48.232265+0000","last_fullsized":"2024-09-17T05:38:48.232265+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:33.584356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232569+0000","last_change":"2024-09-17T05:38:46.585177+0000","last_active":"2024-09-17T05:38:48.232569+0000","last_peered":"2024-09-17T05:38:48.232569+0000","last_clean":"2024-09-17T05:38:48.232569+0000","last_became_active":"2024-09-17T05:38:46.584572+0000","last_became_peered":"2024-09-17T05:38:46.584572+0000","last_unstale":"2024-09-17T05:38:48.232569+0000","last_undegraded":"2024-09-17T05:38:48.232569+0000","last_fullsized":"2024-09-17T05:38:48.232569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:09.336186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586851+0000","last_change":"2024-09-17T05:38:45.570706+0000","last_active":"2024-09-17T05:38:47.586851+0000","last_peered":"2024-09-17T05:38:47.586851+0000","last_clean":"2024-09-17T05:38:47.586851+0000","last_became_active":"2024-09-17T05:38:45.570023+0000","last_became_peered":"2024-09-17T05:38:45.570023+0000","last_unstale":"2024-09-17T05:38:47.586851+0000","last_undegraded":"2024-09-17T05:38:47.586851+0000","last_fullsized":"2024-09-17T05:38:47.586851+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:38.619976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231306+0000","last_change":"2024-09-17T05:38:46.600461+0000","last_active":"2024-09-17T05:38:48.231306+0000","last_peered":"2024-09-17T05:38:48.231306+0000","last_clean":"2024-09-17T05:38:48.231306+0000","last_became_active":"2024-09-17T05:38:46.600131+0000","last_became_peered":"2024-09-17T05:38:46.600131+0000","last_unstale":"2024-09-17T05:38:48.231306+0000","last_undegraded":"2024-09-17T05:38:48.231306+0000","last_fullsized":"2024-09-17T05:38:48.231306+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:28.628721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231577+0000","last_change":"2024-09-17T05:38:45.551826+0000","last_active":"2024-09-17T05:38:48.231577+0000","last_peered":"2024-09-17T05:38:48.231577+0000","last_clean":"2024-09-17T05:38:48.231577+0000","last_became_active":"2024-09-17T05:38:45.551495+0000","last_became_peered":"2024-09-17T05:38:45.551495+0000","last_unstale":"2024-09-17T05:38:48.231577+0000","last_undegraded":"2024-09-17T05:38:48.231577+0000","last_fullsized":"2024-09-17T05:38:48.231577+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:48.638858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561871+0000","last_change":"2024-09-17T05:38:46.586183+0000","last_active":"2024-09-17T05:38:47.561871+0000","last_peered":"2024-09-17T05:38:47.561871+0000","last_clean":"2024-09-17T05:38:47.561871+0000","last_became_active":"2024-09-17T05:38:46.585031+0000","last_became_peered":"2024-09-17T05:38:46.585031+0000","last_unstale":"2024-09-17T05:38:47.561871+0000","last_undegraded":"2024-09-17T05:38:47.561871+0000","last_fullsized":"2024-09-17T05:38:47.561871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:06.890490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560130+0000","last_change":"2024-09-17T05:38:45.565496+0000","last_active":"2024-09-17T05:38:47.560130+0000","last_peered":"2024-09-17T05:38:47.560130+0000","last_clean":"2024-09-17T05:38:47.560130+0000","last_became_active":"2024-09-17T05:38:45.564983+0000","last_became_peered":"2024-09-17T05:38:45.564983+0000","last_unstale":"2024-09-17T05:38:47.560130+0000","last_undegraded":"2024-09-17T05:38:47.560130+0000","last_fullsized":"2024-09-17T05:38:47.560130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:25.832091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584251+0000","last_change":"2024-09-17T05:38:46.579059+0000","last_active":"2024-09-17T05:38:47.584251+0000","last_peered":"2024-09-17T05:38:47.584251+0000","last_clean":"2024-09-17T05:38:47.584251+0000","last_became_active":"2024-09-17T05:38:46.578693+0000","last_became_peered":"2024-09-17T05:38:46.578693+0000","last_unstale":"2024-09-17T05:38:47.584251+0000","last_undegraded":"2024-09-17T05:38:47.584251+0000","last_fullsized":"2024-09-17T05:38:47.584251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:37.403885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231121+0000","last_change":"2024-09-17T05:38:45.554558+0000","last_active":"2024-09-17T05:38:48.231121+0000","last_peered":"2024-09-17T05:38:48.231121+0000","last_clean":"2024-09-17T05:38:48.231121+0000","last_became_active":"2024-09-17T05:38:45.553507+0000","last_became_peered":"2024-09-17T05:38:45.553507+0000","last_unstale":"2024-09-17T05:38:48.231121+0000","last_undegraded":"2024-09-17T05:38:48.231121+0000","last_fullsized":"2024-09-17T05:38:48.231121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:17.914364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561102+0000","last_change":"2024-09-17T05:38:46.589121+0000","last_active":"2024-09-17T05:38:47.561102+0000","last_peered":"2024-09-17T05:38:47.561102+0000","last_clean":"2024-09-17T05:38:47.561102+0000","last_became_active":"2024-09-17T05:38:46.588667+0000","last_became_peered":"2024-09-17T05:38:46.588667+0000","last_unstale":"2024-09-17T05:38:47.561102+0000","last_undegraded":"2024-09-17T05:38:47.561102+0000","last_fullsized":"2024-09-17T05:38:47.561102+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:58.942202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585657+0000","last_change":"2024-09-17T05:38:45.563341+0000","last_active":"2024-09-17T05:38:47.585657+0000","last_peered":"2024-09-17T05:38:47.585657+0000","last_clean":"2024-09-17T05:38:47.585657+0000","last_became_active":"2024-09-17T05:38:45.562575+0000","last_became_peered":"2024-09-17T05:38:45.562575+0000","last_unstale":"2024-09-17T05:38:47.585657+0000","last_undegraded":"2024-09-17T05:38:47.585657+0000","last_fullsized":"2024-09-17T05:38:47.585657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:33.451333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561305+0000","last_change":"2024-09-17T05:38:46.579734+0000","last_active":"2024-09-17T05:38:47.561305+0000","last_peered":"2024-09-17T05:38:47.561305+0000","last_clean":"2024-09-17T05:38:47.561305+0000","last_became_active":"2024-09-17T05:38:46.579394+0000","last_became_peered":"2024-09-17T05:38:46.579394+0000","last_unstale":"2024-09-17T05:38:47.561305+0000","last_undegraded":"2024-09-17T05:38:47.561305+0000","last_fullsized":"2024-09-17T05:38:47.561305+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:02.072633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"64'1","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.585320+0000","last_change":"2024-09-17T05:38:45.567767+0000","last_active":"2024-09-17T05:38:47.585320+0000","last_peered":"2024-09-17T05:38:47.585320+0000","last_clean":"2024-09-17T05:38:47.585320+0000","last_became_active":"2024-09-17T05:38:45.567450+0000","last_became_peered":"2024-09-17T05:38:45.567450+0000","last_unstale":"2024-09-17T05:38:47.585320+0000","last_undegraded":"2024-09-17T05:38:47.585320+0000","last_fullsized":"2024-09-17T05:38:47.585320+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:23.820997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232125+0000","last_change":"2024-09-17T05:38:46.582949+0000","last_active":"2024-09-17T05:38:48.232125+0000","last_peered":"2024-09-17T05:38:48.232125+0000","last_clean":"2024-09-17T05:38:48.232125+0000","last_became_active":"2024-09-17T05:38:46.582607+0000","last_became_peered":"2024-09-17T05:38:46.582607+0000","last_unstale":"2024-09-17T05:38:48.232125+0000","last_undegraded":"2024-09-17T05:38:48.232125+0000","last_fullsized":"2024-09-17T05:38:48.232125+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:47:34.077173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232238+0000","last_change":"2024-09-17T05:38:45.554711+0000","last_active":"2024-09-17T05:38:48.232238+0000","last_peered":"2024-09-17T05:38:48.232238+0000","last_clean":"2024-09-17T05:38:48.232238+0000","last_became_active":"2024-09-17T05:38:45.554349+0000","last_became_peered":"2024-09-17T05:38:45.554349+0000","last_unstale":"2024-09-17T05:38:48.232238+0000","last_undegraded":"2024-09-17T05:38:48.232238+0000","last_fullsized":"2024-09-17T05:38:48.232238+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:32.363888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232569+0000","last_change":"2024-09-17T05:38:46.584872+0000","last_active":"2024-09-17T05:38:48.232569+0000","last_peered":"2024-09-17T05:38:48.232569+0000","last_clean":"2024-09-17T05:38:48.232569+0000","last_became_active":"2024-09-17T05:38:46.584247+0000","last_became_peered":"2024-09-17T05:38:46.584247+0000","last_unstale":"2024-09-17T05:38:48.232569+0000","last_undegraded":"2024-09-17T05:38:48.232569+0000","last_fullsized":"2024-09-17T05:38:48.232569+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:13.766322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586874+0000","last_change":"2024-09-17T05:38:45.566114+0000","last_active":"2024-09-17T05:38:47.586874+0000","last_peered":"2024-09-17T05:38:47.586874+0000","last_clean":"2024-09-17T05:38:47.586874+0000","last_became_active":"2024-09-17T05:38:45.565806+0000","last_became_peered":"2024-09-17T05:38:45.565806+0000","last_unstale":"2024-09-17T05:38:47.586874+0000","last_undegraded":"2024-09-17T05:38:47.586874+0000","last_fullsized":"2024-09-17T05:38:47.586874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:31.444638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.584149+0000","last_change":"2024-09-17T05:38:46.582090+0000","last_active":"2024-09-17T05:38:47.584149+0000","last_peered":"2024-09-17T05:38:47.584149+0000","last_clean":"2024-09-17T05:38:47.584149+0000","last_became_active":"2024-09-17T05:38:46.581792+0000","last_became_peered":"2024-09-17T05:38:46.581792+0000","last_unstale":"2024-09-17T05:38:47.584149+0000","last_undegraded":"2024-09-17T05:38:47.584149+0000","last_fullsized":"2024-09-17T05:38:47.584149+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:05.891801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561828+0000","last_change":"2024-09-17T05:38:45.565198+0000","last_active":"2024-09-17T05:38:47.561828+0000","last_peered":"2024-09-17T05:38:47.561828+0000","last_clean":"2024-09-17T05:38:47.561828+0000","last_became_active":"2024-09-17T05:38:45.564886+0000","last_became_peered":"2024-09-17T05:38:45.564886+0000","last_unstale":"2024-09-17T05:38:47.561828+0000","last_undegraded":"2024-09-17T05:38:47.561828+0000","last_fullsized":"2024-09-17T05:38:47.561828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:33.876827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561583+0000","last_change":"2024-09-17T05:38:46.579071+0000","last_active":"2024-09-17T05:38:47.561583+0000","last_peered":"2024-09-17T05:38:47.561583+0000","last_clean":"2024-09-17T05:38:47.561583+0000","last_became_active":"2024-09-17T05:38:46.578775+0000","last_became_peered":"2024-09-17T05:38:46.578775+0000","last_unstale":"2024-09-17T05:38:47.561583+0000","last_undegraded":"2024-09-17T05:38:47.561583+0000","last_fullsized":"2024-09-17T05:38:47.561583+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:14.544586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231465+0000","last_change":"2024-09-17T05:38:45.560114+0000","last_active":"2024-09-17T05:38:48.231465+0000","last_peered":"2024-09-17T05:38:48.231465+0000","last_clean":"2024-09-17T05:38:48.231465+0000","last_became_active":"2024-09-17T05:38:45.559793+0000","last_became_peered":"2024-09-17T05:38:45.559793+0000","last_unstale":"2024-09-17T05:38:48.231465+0000","last_undegraded":"2024-09-17T05:38:48.231465+0000","last_fullsized":"2024-09-17T05:38:48.231465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:41.470386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231364+0000","last_change":"2024-09-17T05:38:46.600016+0000","last_active":"2024-09-17T05:38:48.231364+0000","last_peered":"2024-09-17T05:38:48.231364+0000","last_clean":"2024-09-17T05:38:48.231364+0000","last_became_active":"2024-09-17T05:38:46.599695+0000","last_became_peered":"2024-09-17T05:38:46.599695+0000","last_unstale":"2024-09-17T05:38:48.231364+0000","last_undegraded":"2024-09-17T05:38:48.231364+0000","last_fullsized":"2024-09-17T05:38:48.231364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:16.967058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.586726+0000","last_change":"2024-09-17T05:38:45.569074+0000","last_active":"2024-09-17T05:38:47.586726+0000","last_peered":"2024-09-17T05:38:47.586726+0000","last_clean":"2024-09-17T05:38:47.586726+0000","last_became_active":"2024-09-17T05:38:45.568523+0000","last_became_peered":"2024-09-17T05:38:45.568523+0000","last_unstale":"2024-09-17T05:38:47.586726+0000","last_undegraded":"2024-09-17T05:38:47.586726+0000","last_fullsized":"2024-09-17T05:38:47.586726+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:11.357532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.561260+0000","last_change":"2024-09-17T05:38:46.599792+0000","last_active":"2024-09-17T05:38:47.561260+0000","last_peered":"2024-09-17T05:38:47.561260+0000","last_clean":"2024-09-17T05:38:47.561260+0000","last_became_active":"2024-09-17T05:38:46.599095+0000","last_became_peered":"2024-09-17T05:38:46.599095+0000","last_unstale":"2024-09-17T05:38:47.561260+0000","last_undegraded":"2024-09-17T05:38:47.561260+0000","last_fullsized":"2024-09-17T05:38:47.561260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:52.341504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.231421+0000","last_change":"2024-09-17T05:38:45.556497+0000","last_active":"2024-09-17T05:38:48.231421+0000","last_peered":"2024-09-17T05:38:48.231421+0000","last_clean":"2024-09-17T05:38:48.231421+0000","last_became_active":"2024-09-17T05:38:45.556092+0000","last_became_peered":"2024-09-17T05:38:45.556092+0000","last_unstale":"2024-09-17T05:38:48.231421+0000","last_undegraded":"2024-09-17T05:38:48.231421+0000","last_fullsized":"2024-09-17T05:38:48.231421+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:07.995691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.560034+0000","last_change":"2024-09-17T05:38:46.582032+0000","last_active":"2024-09-17T05:38:47.560034+0000","last_peered":"2024-09-17T05:38:47.560034+0000","last_clean":"2024-09-17T05:38:47.560034+0000","last_became_active":"2024-09-17T05:38:46.581647+0000","last_became_peered":"2024-09-17T05:38:46.581647+0000","last_unstale":"2024-09-17T05:38:47.560034+0000","last_undegraded":"2024-09-17T05:38:47.560034+0000","last_fullsized":"2024-09-17T05:38:47.560034+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:45.533116+0000","last_clean_scrub_stamp":"2024-09-17T05:38:45.533116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:54.104099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:48.232159+0000","last_change":"2024-09-17T05:38:45.563687+0000","last_active":"2024-09-17T05:38:48.232159+0000","last_peered":"2024-09-17T05:38:48.232159+0000","last_clean":"2024-09-17T05:38:48.232159+0000","last_became_active":"2024-09-17T05:38:45.563295+0000","last_became_peered":"2024-09-17T05:38:45.563295+0000","last_unstale":"2024-09-17T05:38:48.232159+0000","last_undegraded":"2024-09-17T05:38:48.232159+0000","last_fullsized":"2024-09-17T05:38:48.232159+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:38:44.526589+0000","last_clean_scrub_stamp":"2024-09-17T05:38:44.526589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:33.451333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-17T05:38:47.559673+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:38:47.559673+0000","last_peered":"2024-09-17T05:38:47.559673+0000","last_clean":"2024-09-17T05:38:47.559673+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:38:47.559673+0000","last_undegraded":"2024-09-17T05:38:47.559673+0000","last_fullsized":"2024-09-17T05:38:47.559673+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":765952,"data_stored":342578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1380352,"data_stored":934670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509475,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":770048,"data_stored":343160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":774144,"data_stored":342738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":774144,"data_stored":342634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":932980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":342578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":786432,"data_stored":344842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:38:55.845 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:38:55.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 -- 172.21.15.44:0/2826656262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c0cb470 msgr2=0x7f4e2c0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2826656262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c0cb470 0x7f4e2c0cb880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009bc0 tx=0x7f4e2401cb10 comp rx=0 tx=0).stop 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 -- 172.21.15.44:0/2826656262 shutdown_connections 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2826656262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c0cb470 0x7f4e2c0cb880 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2826656262 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e2c072e50 0x7f4e2c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 -- 172.21.15.44:0/2826656262 >> 172.21.15.44:0/2826656262 conn(0x7f4e2c0ccaa0 msgr2=0x7f4e2c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 -- 172.21.15.44:0/2826656262 shutdown_connections 2024-09-17T05:38:56.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.049+0000 7f4e30a00640 1 -- 172.21.15.44:0/2826656262 wait complete. 2024-09-17T05:38:56.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 Processor -- start 2024-09-17T05:38:56.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 -- start start 2024-09-17T05:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e2c06de50 0x7f4e2c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c072e50 0x7f4e2c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c0cb470 0x7f4e2c1fa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c168fc0 con 0x7f4e2c0cb470 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c168e40 con 0x7f4e2c072e50 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e30a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c169140 con 0x7f4e2c06de50 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e29e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e2c06de50 0x7f4e2c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e2a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c0cb470 0x7f4e2c1fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e29e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e2c06de50 0x7f4e2c0b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:36246/0 (socket says 172.21.15.44:36246) 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e29e00640 1 -- 172.21.15.44:0/2682289600 learned_addr learned my addr 172.21.15.44:0/2682289600 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.053+0000 7f4e23e00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c072e50 0x7f4e2c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e2a800640 1 -- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e2c06de50 msgr2=0x7f4e2c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e2a800640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e2c06de50 0x7f4e2c0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e2a800640 1 -- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c072e50 msgr2=0x7f4e2c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e2a800640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c072e50 0x7f4e2c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e2a800640 1 -- 172.21.15.44:0/2682289600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c159250 con 0x7f4e2c0cb470 2024-09-17T05:38:56.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e2a800640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c0cb470 0x7f4e2c1fa200 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ac000 tx=0x7f4e24009270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:56.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e22000640 1 -- 172.21.15.44:0/2682289600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240bb070 con 0x7f4e2c0cb470 2024-09-17T05:38:56.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e22000640 1 -- 172.21.15.44:0/2682289600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e24004d40 con 0x7f4e2c0cb470 2024-09-17T05:38:56.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c159530 con 0x7f4e2c0cb470 2024-09-17T05:38:56.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e22000640 1 -- 172.21.15.44:0/2682289600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e240b2040 con 0x7f4e2c0cb470 2024-09-17T05:38:56.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c1fafd0 con 0x7f4e2c0cb470 2024-09-17T05:38:56.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c159770 con 0x7f4e2c0cb470 2024-09-17T05:38:56.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.057+0000 7f4e22000640 1 -- 172.21.15.44:0/2682289600 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4e24004220 con 0x7f4e2c0cb470 2024-09-17T05:38:56.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.061+0000 7f4e22000640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4e08073230 0x7f4e08075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.061+0000 7f4e22000640 1 -- 172.21.15.44:0/2682289600 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f4e2412e140 con 0x7f4e2c0cb470 2024-09-17T05:38:56.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.061+0000 7f4e29e00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4e08073230 0x7f4e08075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.061+0000 7f4e29e00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4e08073230 0x7f4e08075740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009c40 tx=0x7f4e1c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:56.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.065+0000 7f4e22000640 1 -- 172.21.15.44:0/2682289600 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4e240f1db0 con 0x7f4e2c0cb470 2024-09-17T05:38:56.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.297+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4e2c15e990 con 0x7f4e2c0cb470 2024-09-17T05:38:56.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.301+0000 7f4e22000640 1 -- 172.21.15.44:0/2682289600 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f4e24016790 con 0x7f4e2c0cb470 2024-09-17T05:38:56.303 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:38:56.303 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:38:56.303 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-09-17T05:38:56.303 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-09-17T05:38:56.304 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:38:56.304 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4e08073230 msgr2=0x7f4e08075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4e08073230 0x7f4e08075740 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009c40 tx=0x7f4e1c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c0cb470 msgr2=0x7f4e2c1fa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c0cb470 0x7f4e2c1fa200 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4e240ac000 tx=0x7f4e24009270 comp rx=0 tx=0).stop 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 shutdown_connections 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e2c0cb470 0x7f4e2c1fa200 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4e08073230 0x7f4e08075740 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e2c072e50 0x7f4e2c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 --2- 172.21.15.44:0/2682289600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4e2c06de50 0x7f4e2c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 >> 172.21.15.44:0/2682289600 conn(0x7f4e2c0ccaa0 msgr2=0x7f4e2c0a07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:56.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 shutdown_connections 2024-09-17T05:38:56.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.305+0000 7f4e30a00640 1 -- 172.21.15.44:0/2682289600 wait complete. 2024-09-17T05:38:56.326 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 -- 172.21.15.44:0/2910479872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0cf780 msgr2=0x7f957c15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 --2- 172.21.15.44:0/2910479872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0cf780 0x7f957c15d060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9574009bf0 tx=0x7f957401cb20 comp rx=0 tx=0).stop 2024-09-17T05:38:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 -- 172.21.15.44:0/2910479872 shutdown_connections 2024-09-17T05:38:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 --2- 172.21.15.44:0/2910479872 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0cf780 0x7f957c15d060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 -- 172.21.15.44:0/2910479872 >> 172.21.15.44:0/2910479872 conn(0x7f957c0b4240 msgr2=0x7f957c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 -- 172.21.15.44:0/2910479872 shutdown_connections 2024-09-17T05:38:56.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 -- 172.21.15.44:0/2910479872 wait complete. 2024-09-17T05:38:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 Processor -- start 2024-09-17T05:38:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.485+0000 7f9582e00640 1 -- start start 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f957c0d18f0 0x7f957c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0d1d00 0x7f957c0b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f957c153460 0x7f957c0b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f957c16afa0 con 0x7f957c153460 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f957c16ae20 con 0x7f957c0d18f0 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f957c16b120 con 0x7f957c0d1d00 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f957c153460 0x7f957c0b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f957c153460 0x7f957c0b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36054/0 (socket says 172.21.15.44:36054) 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 -- 172.21.15.44:0/4061078704 learned_addr learned my addr 172.21.15.44:0/4061078704 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f957be00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f957c0d18f0 0x7f957c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9573e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0d1d00 0x7f957c0b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 -- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0d1d00 msgr2=0x7f957c0b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0d1d00 0x7f957c0b6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 -- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f957c0d18f0 msgr2=0x7f957c152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f957c0d18f0 0x7f957c152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 -- 172.21.15.44:0/4061078704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c167a40 con 0x7f957c153460 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9580e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f957c153460 0x7f957c0b7490 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9574019730 tx=0x7f9574005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9578c00640 1 -- 172.21.15.44:0/4061078704 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740bc070 con 0x7f957c153460 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9578c00640 1 -- 172.21.15.44:0/4061078704 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9574004130 con 0x7f957c153460 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9578c00640 1 -- 172.21.15.44:0/4061078704 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740b2040 con 0x7f957c153460 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957c167d20 con 0x7f957c153460 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957c0b5ed0 con 0x7f957c153460 2024-09-17T05:38:56.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.489+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957c15d060 con 0x7f957c153460 2024-09-17T05:38:56.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.493+0000 7f9578c00640 1 -- 172.21.15.44:0/4061078704 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9574004520 con 0x7f957c153460 2024-09-17T05:38:56.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.493+0000 7f9578c00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9558073200 0x7f9558075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:56.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.493+0000 7f9578c00640 1 -- 172.21.15.44:0/4061078704 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f957412e230 con 0x7f957c153460 2024-09-17T05:38:56.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.493+0000 7f957be00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9558073200 0x7f9558075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:56.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.493+0000 7f957be00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9558073200 0x7f9558075710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f956c001710 tx=0x7f956c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:56.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.497+0000 7f9578c00640 1 -- 172.21.15.44:0/4061078704 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f95740167d0 con 0x7f957c153460 2024-09-17T05:38:56.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.709+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f957c15bbc0 con 0x7f957c153460 2024-09-17T05:38:56.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.709+0000 7f9578c00640 1 -- 172.21.15.44:0/4061078704 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5221 (secure 0 0 0) 0x7f95740f89e0 con 0x7f957c153460 2024-09-17T05:38:56.712 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:56.712 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"btime":"2024-09-17T05:38:49:581927+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:38:49.006030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:38:56.713 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 35 2024-09-17T05:38:56.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9558073200 msgr2=0x7f9558075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9558073200 0x7f9558075710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f956c001710 tx=0x7f956c009040 comp rx=0 tx=0).stop 2024-09-17T05:38:56.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f957c153460 msgr2=0x7f957c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f957c153460 0x7f957c0b7490 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9574019730 tx=0x7f9574005a80 comp rx=0 tx=0).stop 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 shutdown_connections 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f957c153460 0x7f957c0b7490 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957c0d1d00 0x7f957c0b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9558073200 0x7f9558075710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 --2- 172.21.15.44:0/4061078704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f957c0d18f0 0x7f957c152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 >> 172.21.15.44:0/4061078704 conn(0x7f957c0b4240 msgr2=0x7f957c15bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 shutdown_connections 2024-09-17T05:38:56.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:56.713+0000 7f9582e00640 1 -- 172.21.15.44:0/4061078704 wait complete. 2024-09-17T05:38:57.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:38:45.974804+0000', 'modified': '2024-09-17T05:38:49.006030+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5751}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5751': {'gid': 5751, 'name': 'c', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6834/3641732503', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 3641732503}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 3641732503}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5751, 'qdb_cluster': [5751]} 2024-09-17T05:38:57.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:38:57.138 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:38:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 -- 172.21.15.44:0/3304956596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac06de50 msgr2=0x7fe8ac06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 --2- 172.21.15.44:0/3304956596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac06de50 0x7fe8ac06e260 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe898009840 tx=0x7fe89801c790 comp rx=0 tx=0).stop 2024-09-17T05:38:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 -- 172.21.15.44:0/3304956596 shutdown_connections 2024-09-17T05:38:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 --2- 172.21.15.44:0/3304956596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac06de50 0x7fe8ac06e260 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 --2- 172.21.15.44:0/3304956596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac072e50 0x7fe8ac15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 -- 172.21.15.44:0/3304956596 >> 172.21.15.44:0/3304956596 conn(0x7fe8ac0ccaa0 msgr2=0x7fe8ac0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 -- 172.21.15.44:0/3304956596 shutdown_connections 2024-09-17T05:38:57.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 -- 172.21.15.44:0/3304956596 wait complete. 2024-09-17T05:38:57.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 Processor -- start 2024-09-17T05:38:57.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.301+0000 7fe8b3600640 1 -- start start 2024-09-17T05:38:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8ac06de50 0x7fe8ac0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac072e50 0x7fe8ac153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0ced00 0x7fe8ac0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac169410 con 0x7fe8ac06de50 2024-09-17T05:38:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac169290 con 0x7fe8ac0ced00 2024-09-17T05:38:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac169590 con 0x7fe8ac072e50 2024-09-17T05:38:57.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8ac06de50 0x7fe8ac0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8ac06de50 0x7fe8ac0c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36066/0 (socket says 172.21.15.44:36066) 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 -- 172.21.15.44:0/487694462 learned_addr learned my addr 172.21.15.44:0/487694462 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8abe00640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac072e50 0x7fe8ac153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b1600640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0ced00 0x7fe8ac0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 -- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac072e50 msgr2=0x7fe8ac153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac072e50 0x7fe8ac153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 -- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0ced00 msgr2=0x7fe8ac0c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0ced00 0x7fe8ac0c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 -- 172.21.15.44:0/487694462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac0a1090 con 0x7fe8ac06de50 2024-09-17T05:38:57.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8ac06de50 0x7fe8ac0c7e00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000e7f0 tx=0x7fe8a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8a8c00640 1 -- 172.21.15.44:0/487694462 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000ccc0 con 0x7fe8ac06de50 2024-09-17T05:38:57.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8a8c00640 1 -- 172.21.15.44:0/487694462 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8a000ce80 con 0x7fe8ac06de50 2024-09-17T05:38:57.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac0c7320 con 0x7fe8ac06de50 2024-09-17T05:38:57.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8a8c00640 1 -- 172.21.15.44:0/487694462 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0005280 con 0x7fe8ac06de50 2024-09-17T05:38:57.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac0c8ff0 con 0x7fe8ac06de50 2024-09-17T05:38:57.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.305+0000 7fe8a8c00640 1 -- 172.21.15.44:0/487694462 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8a0005420 con 0x7fe8ac06de50 2024-09-17T05:38:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8a8c00640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe88c073200 0x7fe88c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8a8c00640 1 -- 172.21.15.44:0/487694462 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fe8a0094c10 con 0x7fe8ac06de50 2024-09-17T05:38:57.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8abe00640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe88c073200 0x7fe88c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 Processor -- start 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 -- start start 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8abe00640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe88c073200 0x7fe88c075710 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe8980af000 tx=0x7fe89801afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102eeb3460 0x56102f3f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f2a3950 0x56102f3f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f28cca0 0x56102f3f5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56102f2c9410 con 0x56102f28cca0 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56102f206b40 con 0x56102eeb3460 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56102f1f5f70 con 0x56102f2a3950 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f28cca0 0x56102f3f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f28cca0 0x56102f3f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36082/0 (socket says 172.21.15.44:36082) 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b1600640 1 -- 172.21.15.44:0/1501959429 learned_addr learned my addr 172.21.15.44:0/1501959429 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102eeb3460 0x56102f3f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8abe00640 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f2a3950 0x56102f3f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b0c00640 1 -- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f2a3950 msgr2=0x56102f3f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f2a3950 0x56102f3f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b0c00640 1 -- 172.21.15.44:0/1501959429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f28cca0 msgr2=0x56102f3f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f28cca0 0x56102f3f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b0c00640 1 -- 172.21.15.44:0/1501959429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56102f1bd5b0 con 0x56102eeb3460 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b1600640 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f28cca0 0x56102f3f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.309+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102eeb3460 0x56102f3f46a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000e7c0 tx=0x7fe8a005ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68614e107714b595 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe89d200640 1 -- 172.21.15.44:0/1501959429 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0063f00 con 0x56102eeb3460 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe89d200640 1 -- 172.21.15.44:0/1501959429 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8a0068db0 con 0x56102eeb3460 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe89d200640 1 -- 172.21.15.44:0/1501959429 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0068b80 con 0x56102eeb3460 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102eeb3460 msgr2=0x56102f3f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102eeb3460 0x56102f3f46a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000e7c0 tx=0x7fe8a005ec40 comp rx=0 tx=0).stop 2024-09-17T05:38:57.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- 172.21.15.44:0/1501959429 shutdown_connections 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f28cca0 0x56102f3f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f2a3950 0x56102f3f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1501959429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102eeb3460 0x56102f3f46a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- 172.21.15.44:0/1501959429 >> 172.21.15.44:0/1501959429 conn(0x56102f379d90 msgr2=0x56102f3a9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- 172.21.15.44:0/1501959429 shutdown_connections 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- 172.21.15.44:0/1501959429 wait complete. 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- start start 2024-09-17T05:38:57.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 Processor -- start 2024-09-17T05:38:57.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f3fb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f3fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f3fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56102f1905f0 con 0x56102eeb3460 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56102f1f9d80 con 0x56102f2a3950 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56102f19c520 con 0x56102f28cca0 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.313+0000 7fe8bae82000 10 client.0 _ll_register_callbacks cb 0x56102f1a0830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f3fb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f3fb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36088/0 (socket says 172.21.15.44:36088) 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 -- 172.21.15.44:0/1636817381 learned_addr learned my addr 172.21.15.44:0/1636817381 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b1600640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f3fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8abe00640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f3fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 -- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 msgr2=0x56102f3fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f3fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 -- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 msgr2=0x56102f3fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f3fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 -- 172.21.15.44:0/1636817381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56102f194190 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b1600640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f3fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f3fb920 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0092fa0 tx=0x7fe8a0068bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ce0ce37228d064 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 1 -- 172.21.15.44:0/1636817381 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0068db0 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 1 -- 172.21.15.44:0/1636817381 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fe8a0066110 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56102f18e110 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 1 -- 172.21.15.44:0/1636817381 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe8a0071050 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 10 client.5892 fetch_fsmap learned FSMap version 35 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x56102f27af10 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 1 -- 172.21.15.44:0/1636817381 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56102f18e110 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 1 -- 172.21.15.44:0/1636817381 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7fe8a0074020 con 0x56102eeb3460 2024-09-17T05:38:57.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 10 client.5892 fetch_fsmap finished waiting for FSMap version 35 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 10 client.5892 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 20 client.5892 populate_metadata read hostname 'smithi044' 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee987d0 0x56102f405d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 4 client.5892 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56102f208a90 con 0x56102ee987d0 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8abe00640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee987d0 0x56102f405d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8abe00640 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee987d0 0x56102f405d00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f14743d3366dce0 server_cookie=3fd0e6c9587c9781 in_seq=0 out_seq=0 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 10 client.5892 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 1 -- 172.21.15.44:0/1636817381 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56102f208a90 con 0x56102ee987d0 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 10 client.5892 handle_command_reply: tid=0 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 client.5892 shutdown 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 msgr2=0x56102f3fb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f3fb920 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0092fa0 tx=0x7fe8a0068bb0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 shutdown_connections 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee987d0 0x56102f405d00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f3fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f3fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 --2- 172.21.15.44:0/1636817381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f3fb920 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe891600640 0 client.5892 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.317+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 >> 172.21.15.44:0/1636817381 conn(0x56102f379d90 msgr2=0x56102f3b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.321+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 shutdown_connections 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.321+0000 7fe8bae82000 1 -- 172.21.15.44:0/1636817381 wait complete. 2024-09-17T05:38:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.321+0000 7fe8bae82000 20 client.5892 trim_cache size 0 max 16384 2024-09-17T05:38:57.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.337+0000 7fe8bae82000 1 Processor -- start 2024-09-17T05:38:57.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.337+0000 7fe8bae82000 1 -- start start 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102eeb3460 0x56102f466840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f28cca0 0x56102f466d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f2a3950 0x56102f4672c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac204010 con 0x56102f2a3950 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac2030e0 con 0x56102f28cca0 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac0b5100 con 0x56102eeb3460 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f2a3950 0x56102f4672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f2a3950 0x56102f4672c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36096/0 (socket says 172.21.15.44:36096) 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 -- 172.21.15.44:0/2486909700 learned_addr learned my addr 172.21.15.44:0/2486909700 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102eeb3460 0x56102f466840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8abe00640 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f28cca0 0x56102f466d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 -- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102eeb3460 msgr2=0x56102f466840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102eeb3460 0x56102f466840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 -- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f28cca0 msgr2=0x56102f466d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f28cca0 0x56102f466d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 -- 172.21.15.44:0/2486909700 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56102f251db0 con 0x56102f2a3950 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8abe00640 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f28cca0 0x56102f466d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8b1600640 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f2a3950 0x56102f4672c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4002050 tx=0x7fe8a4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee646b404bf917f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe893e00640 1 -- 172.21.15.44:0/2486909700 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a401a070 con 0x56102f2a3950 2024-09-17T05:38:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe893e00640 1 -- 172.21.15.44:0/2486909700 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8a4016420 con 0x56102f2a3950 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe893e00640 1 -- 172.21.15.44:0/2486909700 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4016850 con 0x56102f2a3950 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- 172.21.15.44:0/2486909700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f2a3950 msgr2=0x56102f4672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f2a3950 0x56102f4672c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4002050 tx=0x7fe8a4007f90 comp rx=0 tx=0).stop 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- 172.21.15.44:0/2486909700 shutdown_connections 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102f2a3950 0x56102f4672c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f28cca0 0x56102f466d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 --2- 172.21.15.44:0/2486909700 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102eeb3460 0x56102f466840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- 172.21.15.44:0/2486909700 >> 172.21.15.44:0/2486909700 conn(0x56102f379d90 msgr2=0x56102f3a8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- 172.21.15.44:0/2486909700 shutdown_connections 2024-09-17T05:38:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- 172.21.15.44:0/2486909700 wait complete. 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.341+0000 7fe8bae82000 1 -- start start 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 Processor -- start 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f46a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f46a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f46ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56102f1f9d80 con 0x56102eeb3460 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac0b5750 con 0x56102f2a3950 2024-09-17T05:38:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56102f1905f0 con 0x56102f28cca0 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 10 client.0 _ll_register_callbacks cb 0x7fe8a0078070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f46a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f46a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36100/0 (socket says 172.21.15.44:36100) 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 -- 172.21.15.44:0/3350029213 learned_addr learned my addr 172.21.15.44:0/3350029213 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8abe00640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f46a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b1600640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f46ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 -- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 msgr2=0x56102f46a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f46a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 -- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 msgr2=0x56102f46ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f46ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 -- 172.21.15.44:0/3350029213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56102f1bcab0 con 0x56102eeb3460 2024-09-17T05:38:57.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b1600640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f46ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8b0c00640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f46a3d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c820 tx=0x7fe8a005eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9044040981bc66c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe891600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe891600640 1 -- 172.21.15.44:0/3350029213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a005efe0 con 0x56102eeb3460 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8a4016420 con 0x56102eeb3460 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe891600640 1 -- 172.21.15.44:0/3350029213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fe8a0076d80 con 0x56102eeb3460 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe891600640 1 -- 172.21.15.44:0/3350029213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe8a0068db0 con 0x56102eeb3460 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 10 client.5898 fetch_fsmap learned FSMap version 35 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x56102f19b070 con 0x56102eeb3460 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe891600640 1 -- 172.21.15.44:0/3350029213 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8a4016420 con 0x56102eeb3460 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe891600640 1 -- 172.21.15.44:0/3350029213 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7fe8a0074040 con 0x56102eeb3460 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 10 client.5898 fetch_fsmap finished waiting for FSMap version 35 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 10 client.5898 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:38:57.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 20 client.5898 populate_metadata read hostname 'smithi044' 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee86830 0x56102f4260b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 4 client.5898 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "status"}) -- 0x56102f204540 con 0x56102ee86830 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.345+0000 7fe8abe00640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee86830 0x56102f4260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8abe00640 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee86830 0x56102f4260b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84c999298bdb9cb server_cookie=e1d6f95249bd033 in_seq=0 out_seq=0 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe891600640 10 client.5898 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe891600640 1 -- 172.21.15.44:0/3350029213 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56102f204540 con 0x56102ee86830 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe891600640 10 client.5898 handle_command_reply: tid=0 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 client.5898 shutdown 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 msgr2=0x56102f46a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f46a3d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c820 tx=0x7fe8a005eb70 comp rx=0 tx=0).stop 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 shutdown_connections 2024-09-17T05:38:57.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56102ee86830 0x56102f4260b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56102f2a3950 0x56102f46ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56102f28cca0 0x56102f46a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 --2- 172.21.15.44:0/3350029213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56102eeb3460 0x56102f46a3d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe891600640 0 client.5898 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 >> 172.21.15.44:0/3350029213 conn(0x56102f379d90 msgr2=0x56102f3a9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 shutdown_connections 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 1 -- 172.21.15.44:0/3350029213 wait complete. 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8bae82000 20 client.5898 trim_cache size 0 max 16384 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:38:57.354 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5751, 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.777281758000001, 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 35, 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 64, 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 64, 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 15.169412838 2024-09-17T05:38:57.355 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:38:57.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe88c073200 msgr2=0x7fe88c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe88c073200 0x7fe88c075710 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe8980af000 tx=0x7fe89801afd0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8ac06de50 msgr2=0x7fe8ac0c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8ac06de50 0x7fe8ac0c7e00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000e7f0 tx=0x7fe8a000ecb0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 shutdown_connections 2024-09-17T05:38:57.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe88c073200 0x7fe88c075710 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0ced00 0x7fe8ac0c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe8ac072e50 0x7fe8ac153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 --2- 172.21.15.44:0/487694462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8ac06de50 0x7fe8ac0c7e00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 >> 172.21.15.44:0/487694462 conn(0x7fe8ac0ccaa0 msgr2=0x7fe8ac0cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 shutdown_connections 2024-09-17T05:38:57.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.349+0000 7fe8b3600640 1 -- 172.21.15.44:0/487694462 wait complete. 2024-09-17T05:38:57.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:38:57.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 -- 172.21.15.44:0/2520142937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 msgr2=0x7fee780cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 --2- 172.21.15.44:0/2520142937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780cf100 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fee60009900 tx=0x7fee6001c7c0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 -- 172.21.15.44:0/2520142937 shutdown_connections 2024-09-17T05:38:57.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 --2- 172.21.15.44:0/2520142937 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780cf100 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 --2- 172.21.15.44:0/2520142937 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee78072190 0x7fee7806e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 -- 172.21.15.44:0/2520142937 >> 172.21.15.44:0/2520142937 conn(0x7fee780d1120 msgr2=0x7fee780d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 -- 172.21.15.44:0/2520142937 shutdown_connections 2024-09-17T05:38:57.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.525+0000 7fee7d000640 1 -- 172.21.15.44:0/2520142937 wait complete. 2024-09-17T05:38:57.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 Processor -- start 2024-09-17T05:38:57.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 -- start start 2024-09-17T05:38:57.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee78072190 0x7fee781fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee780ae3e0 0x7fee7806d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee78168ea0 con 0x7fee780cecf0 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee78168d20 con 0x7fee78072190 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee7d000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fee78169020 con 0x7fee780ae3e0 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.529+0000 7fee76800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee75e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee78072190 0x7fee781fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36122/0 (socket says 172.21.15.44:36122) 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 -- 172.21.15.44:0/3436371274 learned_addr learned my addr 172.21.15.44:0/3436371274 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee6d400640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee780ae3e0 0x7fee7806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 -- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee780ae3e0 msgr2=0x7fee7806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee780ae3e0 0x7fee7806d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 -- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee78072190 msgr2=0x7fee781fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee78072190 0x7fee781fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 -- 172.21.15.44:0/3436371274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee781f9280 con 0x7fee780cecf0 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee75e00640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee78072190 0x7fee781fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee76800640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780b4400 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c6b0 tx=0x7fee7000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee6ea00640 1 -- 172.21.15.44:0/3436371274 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70003b80 con 0x7fee780cecf0 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee6ea00640 1 -- 172.21.15.44:0/3436371274 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee70003d20 con 0x7fee780cecf0 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee6ea00640 1 -- 172.21.15.44:0/3436371274 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70005330 con 0x7fee780cecf0 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee781f9560 con 0x7fee780cecf0 2024-09-17T05:38:57.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee781f9b20 con 0x7fee780cecf0 2024-09-17T05:38:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7806e160 con 0x7fee780cecf0 2024-09-17T05:38:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.533+0000 7fee6ea00640 1 -- 172.21.15.44:0/3436371274 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fee700054d0 con 0x7fee780cecf0 2024-09-17T05:38:57.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.537+0000 7fee6ea00640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee54073200 0x7fee54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:57.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.537+0000 7fee6ea00640 1 -- 172.21.15.44:0/3436371274 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fee70093fd0 con 0x7fee780cecf0 2024-09-17T05:38:57.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.537+0000 7fee75e00640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee54073200 0x7fee54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:57.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.537+0000 7fee75e00640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee54073200 0x7fee54075710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee68009f30 tx=0x7fee680091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:57.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.541+0000 7fee6ea00640 1 -- 172.21.15.44:0/3436371274 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fee780cf640 con 0x7fee780cecf0 2024-09-17T05:38:57.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.757+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fee780d1db0 con 0x7fee780cecf0 2024-09-17T05:38:57.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee6ea00640 1 -- 172.21.15.44:0/3436371274 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7fee7005e8a0 con 0x7fee780cecf0 2024-09-17T05:38:57.760 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee54073200 msgr2=0x7fee54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee54073200 0x7fee54075710 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fee68009f30 tx=0x7fee680091e0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 msgr2=0x7fee780b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780b4400 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c6b0 tx=0x7fee7000cb70 comp rx=0 tx=0).stop 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 shutdown_connections 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee780cecf0 0x7fee780b4400 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee780ae3e0 0x7fee7806d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee54073200 0x7fee54075710 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 --2- 172.21.15.44:0/3436371274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee78072190 0x7fee781fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 >> 172.21.15.44:0/3436371274 conn(0x7fee780d1120 msgr2=0x7fee780ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 shutdown_connections 2024-09-17T05:38:57.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:57.761+0000 7fee7d000640 1 -- 172.21.15.44:0/3436371274 wait complete. 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:38:57.783 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:38:57.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:57.784 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:38:57.794 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:38:57.794 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:38:57.794 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:38:57.794 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.794 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:38:57.794 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:38:57.795 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42268sec preferred_lft 42268sec 2024-09-17T05:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.796 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:38:57.797 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:38:57.797 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:38:57.797 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:38:57.797 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:38:57.797 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:38:57.797 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.798 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:38:57.798 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:38:57.798 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:38:57.798 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.798 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:38:57.798 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.799 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:38:57.799 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:38:57.799 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:38:57.799 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.799 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:38:57.799 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:38:57.800 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:38:57.800 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:38:57.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:57.800 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:38:57.854 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:38:57.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:57.856 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:38:57.909 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:38:57.909 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:38:57.910 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:38:57.910 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:38:57.910 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:38:57.910 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:38:57.910 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:38:57.910 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:38:57.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:38:57.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:38:57.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:38:57.911 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:38:58.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:38:58.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:38:58.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:58.048 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:38:58.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:38:58.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:38:58.058 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:38:58.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:58.058 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:38:58.123 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:38:58.124 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:38:58.176 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:38:58.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:38:58.177 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:38:58.231 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:38:58.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:58.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:38:58.333 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:38:58.334 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:38:58.334 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:38:58.352 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:38:58.352 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:38:58.352 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:38:58.352 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:38:58.352 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:38:58.362 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:38:58.362 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:38:58.362 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:38:58.362 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:38:58.362 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:38:58.363 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:38:58.363 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:38:58.363 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:38:58.366 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:38:58.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:58.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:38:58.386 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:38:58.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:38:58.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:38:58.491 INFO:teuthology.orchestra.run.smithi044.stdout:client5830 2024-09-17T05:38:58.491 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:38:58.492 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:38:58.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:58.501 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-09-17T05:38:58.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:58.560 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-09-17T05:38:58.610 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:38:58.610 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:38:58.610 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:38:58.610 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:38:58.610 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-09-17T05:38:58.610 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:38:58.722 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-17T05:38:58.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:38:58.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:38:58.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 -- 172.21.15.44:0/4128325932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a006de50 msgr2=0x7fe9a006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/4128325932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a006de50 0x7fe9a006e260 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00cff10 tx=0x7fe98801c830 comp rx=0 tx=0).stop 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 -- 172.21.15.44:0/4128325932 shutdown_connections 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/4128325932 >> v2:172.21.15.86:3300/0 conn(0x7fe9a00ced00 0x7fe9a00cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/4128325932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a006de50 0x7fe9a006e260 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/4128325932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a0072e50 0x7fe9a015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 -- 172.21.15.44:0/4128325932 >> 172.21.15.44:0/4128325932 conn(0x7fe9a00ccaa0 msgr2=0x7fe9a00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 -- 172.21.15.44:0/4128325932 shutdown_connections 2024-09-17T05:38:58.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 -- 172.21.15.44:0/4128325932 wait complete. 2024-09-17T05:38:58.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 Processor -- start 2024-09-17T05:38:58.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.933+0000 7fe9a5a00640 1 -- start start 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a006de50 0x7fe9a0165b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a0072e50 0x7fe9a0159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a00ced00 0x7fe9a00b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a00cc310 con 0x7fe9a0072e50 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a00cc190 con 0x7fe9a006de50 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a00cc490 con 0x7fe9a00ced00 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a0072e50 0x7fe9a0159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a0072e50 0x7fe9a0159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45672/0 (socket says 172.21.15.44:45672) 2024-09-17T05:38:58.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 -- 172.21.15.44:0/1997435230 learned_addr learned my addr 172.21.15.44:0/1997435230 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe99ea00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a006de50 0x7fe9a0165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe99f400640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a00ced00 0x7fe9a00b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 -- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a00ced00 msgr2=0x7fe9a00b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a00ced00 0x7fe9a00b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 -- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a006de50 msgr2=0x7fe9a0165b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a006de50 0x7fe9a0165b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 -- 172.21.15.44:0/1997435230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a01f94a0 con 0x7fe9a0072e50 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe99ea00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a006de50 0x7fe9a0165b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe99f400640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a00ced00 0x7fe9a00b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:58.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe997e00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a0072e50 0x7fe9a0159280 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe9880b0040 tx=0x7fe9880a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:58.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe996a00640 1 -- 172.21.15.44:0/1997435230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9880b2040 con 0x7fe9a0072e50 2024-09-17T05:38:58.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe996a00640 1 -- 172.21.15.44:0/1997435230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9880042c0 con 0x7fe9a0072e50 2024-09-17T05:38:58.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe996a00640 1 -- 172.21.15.44:0/1997435230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9880052d0 con 0x7fe9a0072e50 2024-09-17T05:38:58.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a01f9780 con 0x7fe9a0072e50 2024-09-17T05:38:58.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a01f9d40 con 0x7fe9a0072e50 2024-09-17T05:38:58.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.937+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a015e990 con 0x7fe9a0072e50 2024-09-17T05:38:58.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.941+0000 7fe996a00640 1 -- 172.21.15.44:0/1997435230 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe988005470 con 0x7fe9a0072e50 2024-09-17T05:38:58.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.941+0000 7fe996a00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe97c073200 0x7fe97c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:58.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.941+0000 7fe996a00640 1 -- 172.21.15.44:0/1997435230 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7fe98812df00 con 0x7fe9a0072e50 2024-09-17T05:38:58.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.941+0000 7fe99ea00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe97c073200 0x7fe97c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:58.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.941+0000 7fe99ea00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe97c073200 0x7fe97c075710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe990005fd0 tx=0x7fe990005e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:58.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:58.945+0000 7fe996a00640 1 -- 172.21.15.44:0/1997435230 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe9880164b0 con 0x7fe9a0072e50 2024-09-17T05:38:59.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9a00b5fa0 con 0x7fe9a0072e50 2024-09-17T05:38:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe996a00640 1 -- 172.21.15.44:0/1997435230 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5221 (secure 0 0 0) 0x7fe9880044b0 con 0x7fe9a0072e50 2024-09-17T05:38:59.154 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:59.154 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":35,"btime":"2024-09-17T05:38:49:581927+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:38:49.006030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:38:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 35 2024-09-17T05:38:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe97c073200 msgr2=0x7fe97c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe97c073200 0x7fe97c075710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe990005fd0 tx=0x7fe990005e80 comp rx=0 tx=0).stop 2024-09-17T05:38:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a0072e50 msgr2=0x7fe9a0159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a0072e50 0x7fe9a0159280 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe9880b0040 tx=0x7fe9880a5640 comp rx=0 tx=0).stop 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 shutdown_connections 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe9a00ced00 0x7fe9a00b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a0072e50 0x7fe9a0159280 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe97c073200 0x7fe97c075710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 --2- 172.21.15.44:0/1997435230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a006de50 0x7fe9a0165b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.153+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 >> 172.21.15.44:0/1997435230 conn(0x7fe9a00ccaa0 msgr2=0x7fe9a009eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.157+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 shutdown_connections 2024-09-17T05:38:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.157+0000 7fe9a5a00640 1 -- 172.21.15.44:0/1997435230 wait complete. 2024-09-17T05:38:59.177 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-17T05:38:59.363 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:38:59.364 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:38:59.364 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-17T05:38:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.421+0000 7efc6181d080 1 Processor -- start 2024-09-17T05:38:59.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.421+0000 7efc6181d080 1 -- start start 2024-09-17T05:38:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40003690 0x5566ddc762d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566ddcfbb70 0x5566ddc715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddc71ae0 0x5566ddc85740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5566ddbeff40 con 0x7efc40003690 2024-09-17T05:38:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5566ddbfcd00 con 0x5566ddcfbb70 2024-09-17T05:38:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5566ddb91a00 con 0x5566ddc71ae0 2024-09-17T05:38:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40003690 0x5566ddc762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40003690 0x5566ddc762d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45696/0 (socket says 172.21.15.44:45696) 2024-09-17T05:38:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 -- 172.21.15.44:0/3806572978 learned_addr learned my addr 172.21.15.44:0/3806572978 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5b400640 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddc71ae0 0x5566ddc85740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5a000640 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566ddcfbb70 0x5566ddc715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 -- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddc71ae0 msgr2=0x5566ddc85740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddc71ae0 0x5566ddc85740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 -- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566ddcfbb70 msgr2=0x5566ddc715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566ddcfbb70 0x5566ddc715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 -- 172.21.15.44:0/3806572978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566ddc75650 con 0x7efc40003690 2024-09-17T05:38:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5a000640 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566ddcfbb70 0x5566ddc715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:38:59.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc5aa00640 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40003690 0x5566ddc762d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efc4c001810 tx=0x7efc4c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77750cef6db0866 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc58c00640 1 -- 172.21.15.44:0/3806572978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c013070 con 0x7efc40003690 2024-09-17T05:38:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc58c00640 1 -- 172.21.15.44:0/3806572978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc4c00d960 con 0x7efc40003690 2024-09-17T05:38:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc58c00640 1 -- 172.21.15.44:0/3806572978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00ddf0 con 0x7efc40003690 2024-09-17T05:38:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- 172.21.15.44:0/3806572978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40003690 msgr2=0x5566ddc762d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40003690 0x5566ddc762d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efc4c001810 tx=0x7efc4c009a50 comp rx=0 tx=0).stop 2024-09-17T05:38:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- 172.21.15.44:0/3806572978 shutdown_connections 2024-09-17T05:38:59.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddc71ae0 0x5566ddc85740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566ddcfbb70 0x5566ddc715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 --2- 172.21.15.44:0/3806572978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40003690 0x5566ddc762d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- 172.21.15.44:0/3806572978 >> 172.21.15.44:0/3806572978 conn(0x5566ddc2fd20 msgr2=0x5566ddcfe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- 172.21.15.44:0/3806572978 shutdown_connections 2024-09-17T05:38:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.425+0000 7efc6181d080 1 -- 172.21.15.44:0/3806572978 wait complete. 2024-09-17T05:38:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 Processor -- start 2024-09-17T05:38:59.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 -- start start 2024-09-17T05:38:59.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566ddc71ae0 0x5566ddcfb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddcfbb70 0x5566dddb1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc40003690 0x5566ddc8a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5566ddc758f0 con 0x5566ddc71ae0 2024-09-17T05:38:59.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5566ddc76810 con 0x7efc40003690 2024-09-17T05:38:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5566ddc75b90 con 0x5566ddcfbb70 2024-09-17T05:38:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566ddc71ae0 0x5566ddcfb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566ddc71ae0 0x5566ddcfb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45702/0 (socket says 172.21.15.44:45702) 2024-09-17T05:38:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 -- 172.21.15.44:0/405742530 learned_addr learned my addr 172.21.15.44:0/405742530 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5a000640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddcfbb70 0x5566dddb1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5b400640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc40003690 0x5566ddc8a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 -- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddcfbb70 msgr2=0x5566dddb1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566ddcfbb70 0x5566dddb1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 -- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc40003690 msgr2=0x5566ddc8a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc40003690 0x5566ddc8a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 -- 172.21.15.44:0/405742530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566ddc85a40 con 0x5566ddc71ae0 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc5aa00640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566ddc71ae0 0x5566ddcfb530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009f50 tx=0x7efc4c019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc53400640 1 -- 172.21.15.44:0/405742530 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c013070 con 0x5566ddc71ae0 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc53400640 1 -- 172.21.15.44:0/405742530 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc4c019ac0 con 0x5566ddc71ae0 2024-09-17T05:38:59.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc53400640 1 -- 172.21.15.44:0/405742530 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4c024420 con 0x5566ddc71ae0 2024-09-17T05:38:59.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566ddc85ce0 con 0x5566ddc71ae0 2024-09-17T05:38:59.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.429+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566ddc86220 con 0x5566ddc71ae0 2024-09-17T05:38:59.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc53400640 1 -- 172.21.15.44:0/405742530 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efc4c00f410 con 0x5566ddc71ae0 2024-09-17T05:38:59.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc53400640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc3c071be0 0x7efc3c0740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc53400640 1 -- 172.21.15.44:0/405742530 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7efc4c094c00 con 0x5566ddc71ae0 2024-09-17T05:38:59.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc6181d080 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5566dddb0b70 0x5566ddc866c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) -- 0x5566ddc86c00 con 0x5566dddb0b70 2024-09-17T05:38:59.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc5a000640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc3c071be0 0x7efc3c0740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc5b400640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5566dddb0b70 0x5566ddc866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc5a000640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc3c071be0 0x7efc3c0740f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efc48004700 tx=0x7efc48004890 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc5b400640 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5566dddb0b70 0x5566ddc866c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc5b400640 1 -- 172.21.15.44:0/405742530 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) ==== 164+0+94 (crc 0 0 0) 0x7efc540074d0 con 0x5566dddb0b70 2024-09-17T05:38:59.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.433+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5566dddb0b70 msgr2=0x5566ddc866c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5566dddb0b70 0x5566ddc866c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc3c071be0 msgr2=0x7efc3c0740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc3c071be0 0x7efc3c0740f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efc48004700 tx=0x7efc48004890 comp rx=0 tx=0).stop 2024-09-17T05:38:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566ddc71ae0 msgr2=0x5566ddcfb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 --2- 172.21.15.44:0/405742530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566ddc71ae0 0x5566ddcfb530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009f50 tx=0x7efc4c019690 comp rx=0 tx=0).stop 2024-09-17T05:38:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc5b400640 1 -- 172.21.15.44:0/405742530 reap_dead start 2024-09-17T05:38:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 shutdown_connections 2024-09-17T05:38:59.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 >> 172.21.15.44:0/405742530 conn(0x5566ddc2fd20 msgr2=0x5566ddcff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 shutdown_connections 2024-09-17T05:38:59.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.437+0000 7efc6181d080 1 -- 172.21.15.44:0/405742530 wait complete. 2024-09-17T05:38:59.446 INFO:teuthology.orchestra.run.smithi044.stdout:Xfiledir_test 2024-09-17T05:38:59.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:59.446 DEBUG:teuthology.orchestra.run.smithi044:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-17T05:38:59.501 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:38:59.502 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627777, 2024-09-17T05:38:59.502 INFO:teuthology.orchestra.run.smithi044.stdout: "ancestors": [ 2024-09-17T05:38:59.502 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:59.502 INFO:teuthology.orchestra.run.smithi044.stdout: "dirino": 1099511627776, 2024-09-17T05:38:59.502 INFO:teuthology.orchestra.run.smithi044.stdout: "dname": "file", 2024-09-17T05:38:59.502 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 2 2024-09-17T05:38:59.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:38:59.503 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:38:59.503 INFO:teuthology.orchestra.run.smithi044.stdout: "dirino": 1, 2024-09-17T05:38:59.503 INFO:teuthology.orchestra.run.smithi044.stdout: "dname": "dir_test", 2024-09-17T05:38:59.503 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 4 2024-09-17T05:38:59.503 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:38:59.503 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-17T05:38:59.504 INFO:teuthology.orchestra.run.smithi044.stdout: "pool": 10, 2024-09-17T05:38:59.504 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [] 2024-09-17T05:38:59.504 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:38:59.504 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:38:59.507 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-09-17T05:38:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.609+0000 7fc2e8d68080 1 Processor -- start 2024-09-17T05:38:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.609+0000 7fc2e8d68080 1 -- start start 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a814a0 0x5653d8b04e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a818b0 0x5653d8a37d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8a382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5653d89e6f40 con 0x5653d8a802a0 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5653d89f3d00 con 0x5653d8a814a0 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5653d8988a00 con 0x5653d8a818b0 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8a382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8a382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45708/0 (socket says 172.21.15.44:45708) 2024-09-17T05:38:59.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 -- 172.21.15.44:0/3014897810 learned_addr learned my addr 172.21.15.44:0/3014897810 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e1600640 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a818b0 0x5653d8a37d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2000640 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a814a0 0x5653d8b04e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 -- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a818b0 msgr2=0x5653d8a37d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a818b0 0x5653d8a37d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 -- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a814a0 msgr2=0x5653d8b04e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a814a0 0x5653d8b04e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 -- 172.21.15.44:0/3014897810 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d8b05380 con 0x5653d8a802a0 2024-09-17T05:38:59.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e2a00640 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8a382a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0ae040 tx=0x7fc2dc018240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b77a2fd48fd4404 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2dbe00640 1 -- 172.21.15.44:0/3014897810 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0b0030 con 0x5653d8a802a0 2024-09-17T05:38:59.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2dbe00640 1 -- 172.21.15.44:0/3014897810 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2dc004130 con 0x5653d8a802a0 2024-09-17T05:38:59.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2dbe00640 1 -- 172.21.15.44:0/3014897810 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0ab990 con 0x5653d8a802a0 2024-09-17T05:38:59.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- 172.21.15.44:0/3014897810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 msgr2=0x5653d8a382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8a382a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0ae040 tx=0x7fc2dc018240 comp rx=0 tx=0).stop 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- 172.21.15.44:0/3014897810 shutdown_connections 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8a382a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a818b0 0x5653d8a37d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/3014897810 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a814a0 0x5653d8b04e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- 172.21.15.44:0/3014897810 >> 172.21.15.44:0/3014897810 conn(0x5653d8a26d20 msgr2=0x5653d8a79630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- 172.21.15.44:0/3014897810 shutdown_connections 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.613+0000 7fc2e8d68080 1 -- 172.21.15.44:0/3014897810 wait complete. 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 Processor -- start 2024-09-17T05:38:59.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 -- start start 2024-09-17T05:38:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8b038a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a814a0 0x5653d8badaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a818b0 0x5653d8ba9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5653d8a665c0 con 0x5653d8a802a0 2024-09-17T05:38:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5653d8a66860 con 0x5653d8a818b0 2024-09-17T05:38:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5653d8b05860 con 0x5653d8a814a0 2024-09-17T05:38:59.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8b038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8b038a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45720/0 (socket says 172.21.15.44:45720) 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 -- 172.21.15.44:0/1254835660 learned_addr learned my addr 172.21.15.44:0/1254835660 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e1600640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a814a0 0x5653d8badaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2a00640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a818b0 0x5653d8ba9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 -- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a814a0 msgr2=0x5653d8badaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5653d8a814a0 0x5653d8badaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 -- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a818b0 msgr2=0x5653d8ba9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653d8a818b0 0x5653d8ba9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 -- 172.21.15.44:0/1254835660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d8baa6a0 con 0x5653d8a802a0 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e2000640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8b038a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400dee0 tx=0x7fc2d400b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2daa00640 1 -- 172.21.15.44:0/1254835660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4014020 con 0x5653d8a802a0 2024-09-17T05:38:59.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2daa00640 1 -- 172.21.15.44:0/1254835660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2d4001460 con 0x5653d8a802a0 2024-09-17T05:38:59.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653d8baa940 con 0x5653d8a802a0 2024-09-17T05:38:59.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2daa00640 1 -- 172.21.15.44:0/1254835660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400a040 con 0x5653d8a802a0 2024-09-17T05:38:59.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.617+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d8bae030 con 0x5653d8a802a0 2024-09-17T05:38:59.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2daa00640 1 -- 172.21.15.44:0/1254835660 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc2d4017020 con 0x5653d8a802a0 2024-09-17T05:38:59.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2daa00640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2c4071be0 0x7fc2c40740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2daa00640 1 -- 172.21.15.44:0/1254835660 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7fc2d4092e90 con 0x5653d8a802a0 2024-09-17T05:38:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5653d8baa180 0x5653d8b0a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2e1600640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2c4071be0 0x7fc2c40740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) -- 0x5653d8b0aca0 con 0x5653d8baa180 2024-09-17T05:38:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2e2a00640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5653d8baa180 0x5653d8b0a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2e1600640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2c4071be0 0x7fc2c40740f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0003f00 tx=0x7fc2d0003b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.621+0000 7fc2e2a00640 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5653d8baa180 0x5653d8b0a760 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e2a00640 1 -- 172.21.15.44:0/1254835660 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v66'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc2dc002050 con 0x5653d8baa180 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5653d8baa180 msgr2=0x5653d8b0a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5653d8baa180 0x5653d8b0a760 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2c4071be0 msgr2=0x7fc2c40740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc2c4071be0 0x7fc2c40740f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0003f00 tx=0x7fc2d0003b20 comp rx=0 tx=0).stop 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 msgr2=0x5653d8b038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 --2- 172.21.15.44:0/1254835660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5653d8a802a0 0x5653d8b038a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400dee0 tx=0x7fc2d400b5c0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e2a00640 1 -- 172.21.15.44:0/1254835660 reap_dead start 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 shutdown_connections 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 >> 172.21.15.44:0/1254835660 conn(0x5653d8a26d20 msgr2=0x5653d8a3b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 shutdown_connections 2024-09-17T05:38:59.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.625+0000 7fc2e8d68080 1 -- 172.21.15.44:0/1254835660 wait complete. 2024-09-17T05:38:59.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:59.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-09-17T05:38:59.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 -- 172.21.15.44:0/705250281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a940b41e0 msgr2=0x7f5a9406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 --2- 172.21.15.44:0/705250281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a940b41e0 0x7f5a9406de50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009840 tx=0x7f5a7c01c790 comp rx=0 tx=0).stop 2024-09-17T05:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 -- 172.21.15.44:0/705250281 shutdown_connections 2024-09-17T05:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 --2- 172.21.15.44:0/705250281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a940b41e0 0x7f5a9406de50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 -- 172.21.15.44:0/705250281 >> 172.21.15.44:0/705250281 conn(0x7f5a940736c0 msgr2=0x7f5a94073ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 -- 172.21.15.44:0/705250281 shutdown_connections 2024-09-17T05:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 -- 172.21.15.44:0/705250281 wait complete. 2024-09-17T05:38:59.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 Processor -- start 2024-09-17T05:38:59.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.793+0000 7f5a99600640 1 -- start start 2024-09-17T05:38:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a940b41e0 0x7f5a9415d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a940b45f0 0x7f5a94155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a9415b390 0x7f5a94150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9416a470 con 0x7f5a9415b390 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9416a2f0 con 0x7f5a940b45f0 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5a9416a5f0 con 0x7f5a940b41e0 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a9415b390 0x7f5a94150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a9415b390 0x7f5a94150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45742/0 (socket says 172.21.15.44:45742) 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 -- 172.21.15.44:0/1103603596 learned_addr learned my addr 172.21.15.44:0/1103603596 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a8be00640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a940b45f0 0x7f5a94155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a92a00640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a940b41e0 0x7f5a9415d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 -- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a940b41e0 msgr2=0x7f5a9415d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a940b41e0 0x7f5a9415d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 -- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a940b45f0 msgr2=0x7f5a94155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a940b45f0 0x7f5a94155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 -- 172.21.15.44:0/1103603596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a94152550 con 0x7f5a9415b390 2024-09-17T05:38:59.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a93400640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a9415b390 0x7f5a94150620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00c730 tx=0x7f5a8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a8aa00640 1 -- 172.21.15.44:0/1103603596 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c003b80 con 0x7f5a9415b390 2024-09-17T05:38:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a8aa00640 1 -- 172.21.15.44:0/1103603596 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a8c003d20 con 0x7f5a9415b390 2024-09-17T05:38:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a94153c40 con 0x7f5a9415b390 2024-09-17T05:38:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a8aa00640 1 -- 172.21.15.44:0/1103603596 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00aa30 con 0x7f5a9415b390 2024-09-17T05:38:59.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.797+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a94151fe0 con 0x7f5a9415b390 2024-09-17T05:38:59.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.801+0000 7f5a8aa00640 1 -- 172.21.15.44:0/1103603596 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5a8c00abd0 con 0x7f5a9415b390 2024-09-17T05:38:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.801+0000 7f5a8aa00640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a70073200 0x7f5a70075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.801+0000 7f5a8aa00640 1 -- 172.21.15.44:0/1103603596 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f5a8c094030 con 0x7f5a9415b390 2024-09-17T05:38:59.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.801+0000 7f5aa0bb8000 1 Processor -- start 2024-09-17T05:38:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.801+0000 7f5a92a00640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a70073200 0x7f5a70075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.801+0000 7f5aa0bb8000 1 -- start start 2024-09-17T05:38:59.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.801+0000 7f5a92a00640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a70073200 0x7f5a70075710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a840046c0 tx=0x7f5a84007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4e0a50 0x55b35b644210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b644750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b644c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b35b3f4460 con 0x55b35b4e0a50 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b35b451ce0 con 0x55b35b4cd140 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b35b441110 con 0x55b35b4c6db0 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4e0a50 0x55b35b644210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4e0a50 0x55b35b644210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45752/0 (socket says 172.21.15.44:45752) 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 -- 172.21.15.44:0/3554507996 learned_addr learned my addr 172.21.15.44:0/3554507996 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b644750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a93400640 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b644c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 -- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 msgr2=0x55b35b644c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b644c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 -- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 msgr2=0x55b35b644750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b644750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 -- 172.21.15.44:0/3554507996 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b35b3df340 con 0x55b35b4e0a50 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4e0a50 0x55b35b644210 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400faa0 tx=0x7f5a84012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3c4672d77bf314 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a83000640 1 -- 172.21.15.44:0/3554507996 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8401b050 con 0x55b35b4e0a50 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a83000640 1 -- 172.21.15.44:0/3554507996 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a84025070 con 0x55b35b4e0a50 2024-09-17T05:38:59.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5a83000640 1 -- 172.21.15.44:0/3554507996 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84014e20 con 0x55b35b4e0a50 2024-09-17T05:38:59.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3554507996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4e0a50 msgr2=0x55b35b644210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4e0a50 0x55b35b644210 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400faa0 tx=0x7f5a84012000 comp rx=0 tx=0).stop 2024-09-17T05:38:59.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3554507996 shutdown_connections 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b644c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b644750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3554507996 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4e0a50 0x55b35b644210 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3554507996 >> 172.21.15.44:0/3554507996 conn(0x55b35b0ff590 msgr2=0x55b35b5f4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3554507996 shutdown_connections 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.805+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3554507996 wait complete. 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 -- start start 2024-09-17T05:38:59.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 Processor -- start 2024-09-17T05:38:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b64a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4cd140 0x55b35b64abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b64b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b35b3e6600 con 0x55b35b4c6db0 2024-09-17T05:38:59.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b35b444f20 con 0x55b35b4e0a50 2024-09-17T05:38:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b35b106810 con 0x55b35b4cd140 2024-09-17T05:38:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 10 client.0 _ll_register_callbacks cb 0x55b35b5e1cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:38:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b64a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a8be00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4cd140 0x55b35b64abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b64a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45756/0 (socket says 172.21.15.44:45756) 2024-09-17T05:38:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 -- 172.21.15.44:0/3307083134 learned_addr learned my addr 172.21.15.44:0/3307083134 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a93400640 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b64b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 -- 172.21.15.44:0/3307083134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4cd140 msgr2=0x55b35b64abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4cd140 0x55b35b64abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 -- 172.21.15.44:0/3307083134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 msgr2=0x55b35b64b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b64b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 -- 172.21.15.44:0/3307083134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b35b3c61f0 con 0x55b35b4c6db0 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b64a690 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5a84000f70 tx=0x7f5a840206f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf9ff997a123bda server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a77400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a77400640 1 -- 172.21.15.44:0/3307083134 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8402d020 con 0x55b35b4c6db0 2024-09-17T05:38:59.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a77400640 1 -- 172.21.15.44:0/3307083134 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f5a84020cf0 con 0x55b35b4c6db0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b35b3d9480 con 0x55b35b4c6db0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a77400640 1 -- 172.21.15.44:0/3307083134 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5a840323f0 con 0x55b35b4c6db0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 10 client.5946 fetch_fsmap learned FSMap version 35 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55b35b4c61f0 con 0x55b35b4c6db0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.809+0000 7f5a77400640 1 -- 172.21.15.44:0/3307083134 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b35b3d9480 con 0x55b35b4c6db0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5a77400640 1 -- 172.21.15.44:0/3307083134 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f5a8403a020 con 0x55b35b4c6db0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 10 client.5946 fetch_fsmap finished waiting for FSMap version 35 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 10 client.5946 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 20 client.5946 populate_metadata read hostname 'smithi044' 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0e3ac0 0x55b35b654a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 4 client.5946 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b35b453c30 con 0x55b35b0e3ac0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0e3ac0 0x55b35b654a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0e3ac0 0x55b35b654a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eddaa8a7a5863d08 server_cookie=830c09980a65dfe7 in_seq=0 out_seq=0 2024-09-17T05:38:59.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5a77400640 10 client.5946 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5a77400640 1 -- 172.21.15.44:0/3307083134 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b35b453c30 con 0x55b35b0e3ac0 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5a77400640 10 client.5946 handle_command_reply: tid=0 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 client.5946 shutdown 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 msgr2=0x55b35b64a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b64a690 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5a84000f70 tx=0x7f5a840206f0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 shutdown_connections 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0e3ac0 0x55b35b654a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b64b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4cd140 0x55b35b64abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3307083134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b64a690 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5a77400640 0 client.5946 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:59.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 >> 172.21.15.44:0/3307083134 conn(0x55b35b0ff590 msgr2=0x55b35b5fb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 shutdown_connections 2024-09-17T05:38:59.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3307083134 wait complete. 2024-09-17T05:38:59.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.813+0000 7f5aa0bb8000 20 client.5946 trim_cache size 0 max 16384 2024-09-17T05:38:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 Processor -- start 2024-09-17T05:38:59.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 -- start start 2024-09-17T05:38:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b5fa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b5fab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4e0a50 0x55b35b5fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a94201d80 con 0x55b35b4c6db0 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a940ab3b0 con 0x55b35b4cd140 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5a940aa6b0 con 0x55b35b4e0a50 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b5fa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b5fa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45770/0 (socket says 172.21.15.44:45770) 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 -- 172.21.15.44:0/3704439968 learned_addr learned my addr 172.21.15.44:0/3704439968 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a93400640 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4e0a50 0x55b35b5fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b5fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 -- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4e0a50 msgr2=0x55b35b5fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4e0a50 0x55b35b5fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 -- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 msgr2=0x55b35b5fab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b5fab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 -- 172.21.15.44:0/3704439968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b35b49d4f0 con 0x55b35b4c6db0 2024-09-17T05:38:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b5fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:38:59.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b5fa640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5a84032780 tx=0x7f5a840327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579d8541eebaab8c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a82600640 1 -- 172.21.15.44:0/3704439968 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a84040070 con 0x55b35b4c6db0 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a82600640 1 -- 172.21.15.44:0/3704439968 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a84025040 con 0x55b35b4c6db0 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.833+0000 7f5a82600640 1 -- 172.21.15.44:0/3704439968 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a8401b040 con 0x55b35b4c6db0 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3704439968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 msgr2=0x55b35b5fa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b5fa640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5a84032780 tx=0x7f5a840327b0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3704439968 shutdown_connections 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4e0a50 0x55b35b5fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4cd140 0x55b35b5fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3704439968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4c6db0 0x55b35b5fa640 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3704439968 >> 172.21.15.44:0/3704439968 conn(0x55b35b0ff590 msgr2=0x55b35b601b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3704439968 shutdown_connections 2024-09-17T05:38:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3704439968 wait complete. 2024-09-17T05:38:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- start start 2024-09-17T05:38:59.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 Processor -- start 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b64f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4cd140 0x55b35b64fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b6500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b35b106810 con 0x55b35b4cd140 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b35b444f20 con 0x55b35b4e0a50 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b35b4c5d60 con 0x55b35b4c6db0 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5aa0bb8000 10 client.0 _ll_register_callbacks cb 0x7f5a8400f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5a8be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4cd140 0x55b35b64fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5a8be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4cd140 0x55b35b64fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45774/0 (socket says 172.21.15.44:45774) 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5a8be00640 1 -- 172.21.15.44:0/3184961825 learned_addr learned my addr 172.21.15.44:0/3184961825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:38:59.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b64f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.837+0000 7f5a93400640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b6500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a8be00640 1 -- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 msgr2=0x55b35b64f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b64f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a8be00640 1 -- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 msgr2=0x55b35b6500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b6500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a8be00640 1 -- 172.21.15.44:0/3184961825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b35b3c6a10 con 0x55b35b4cd140 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a93400640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b6500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a8be00640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4cd140 0x55b35b64fb60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0193a0 tx=0x7f5a7c0a6610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a99aad752d90c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 1 -- 172.21.15.44:0/3184961825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c0a6cb0 con 0x55b35b4cd140 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 1 -- 172.21.15.44:0/3184961825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f5a7c0a6e50 con 0x55b35b4cd140 2024-09-17T05:38:59.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a84025040 con 0x55b35b4cd140 2024-09-17T05:38:59.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 1 -- 172.21.15.44:0/3184961825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5a7c0cc050 con 0x55b35b4cd140 2024-09-17T05:38:59.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 10 client.5952 fetch_fsmap learned FSMap version 35 2024-09-17T05:38:59.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x55b35b3d7740 con 0x55b35b4cd140 2024-09-17T05:38:59.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 1 -- 172.21.15.44:0/3184961825 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a84025040 con 0x55b35b4cd140 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 1 -- 172.21.15.44:0/3184961825 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f5a7c0cf020 con 0x55b35b4cd140 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 10 client.5952 fetch_fsmap finished waiting for FSMap version 35 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 10 client.5952 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 20 client.5952 populate_metadata read hostname 'smithi044' 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0d1b20 0x55b35b6505e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 4 client.5952 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x55b35b44f6e0 con 0x55b35b0d1b20 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0d1b20 0x55b35b6505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 10 client.5952 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a92a00640 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0d1b20 0x55b35b6505e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79532b66a1420578 server_cookie=fcd63229319991fb in_seq=0 out_seq=0 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 1 -- 172.21.15.44:0/3184961825 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b35b44f6e0 con 0x55b35b0d1b20 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 10 client.5952 handle_command_reply: tid=0 2024-09-17T05:38:59.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 client.5952 shutdown 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4cd140 msgr2=0x55b35b64fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4cd140 0x55b35b64fb60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0193a0 tx=0x7f5a7c0a6610 comp rx=0 tx=0).stop 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 shutdown_connections 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b35b0d1b20 0x55b35b6505e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b35b4e0a50 0x55b35b6500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b35b4cd140 0x55b35b64fb60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 --2- 172.21.15.44:0/3184961825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b35b4c6db0 0x55b35b64f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 >> 172.21.15.44:0/3184961825 conn(0x55b35b0ff590 msgr2=0x55b35b642730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5a77400640 0 client.5952 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 shutdown_connections 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.841+0000 7f5aa0bb8000 1 -- 172.21.15.44:0/3184961825 wait complete. 2024-09-17T05:38:59.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5aa0bb8000 20 client.5952 trim_cache size 0 max 16384 2024-09-17T05:38:59.847 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f2ab3600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 pv4 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-17T05:38:58.609486+0000 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5830=0-4194304@1} caps={5830=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5830 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x55f04f618b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:38:59.847 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:38:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:38:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "afa33feb-13fd-43c4-a02e-29e6b06789b6", 2024-09-17T05:38:59.847 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:38:59.847 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a70073200 msgr2=0x7f5a70075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a70073200 0x7f5a70075710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5a840046c0 tx=0x7f5a84007cd0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a9415b390 msgr2=0x7f5a94150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a9415b390 0x7f5a94150620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00c730 tx=0x7f5a8c00cbf0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 shutdown_connections 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a9415b390 0x7f5a94150620 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5a70073200 0x7f5a70075710 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a940b45f0 0x7f5a94155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 --2- 172.21.15.44:0/1103603596 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5a940b41e0 0x7f5a9415d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:38:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 >> 172.21.15.44:0/1103603596 conn(0x7f5a940736c0 msgr2=0x7f5a941582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:38:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 shutdown_connections 2024-09-17T05:38:59.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:38:59.845+0000 7f5a99600640 1 -- 172.21.15.44:0/1103603596 wait complete. 2024-09-17T05:38:59.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:38:59.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-17T05:39:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 -- 172.21.15.44:0/2887748250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 msgr2=0x7f1ec815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/2887748250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 0x7f1ec815e990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009840 tx=0x7f1ebc01c790 comp rx=0 tx=0).stop 2024-09-17T05:39:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 -- 172.21.15.44:0/2887748250 shutdown_connections 2024-09-17T05:39:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/2887748250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 0x7f1ec815e990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 -- 172.21.15.44:0/2887748250 >> 172.21.15.44:0/2887748250 conn(0x7f1ec80ccaa0 msgr2=0x7f1ec80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 -- 172.21.15.44:0/2887748250 shutdown_connections 2024-09-17T05:39:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 -- 172.21.15.44:0/2887748250 wait complete. 2024-09-17T05:39:00.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 Processor -- start 2024-09-17T05:39:00.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.025+0000 7f1ecfe00640 1 -- start start 2024-09-17T05:39:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec806de50 0x7f1ec8070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 0x7f1ec80c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ec80cb470 0x7f1ec80c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8169ee0 con 0x7f1ec806de50 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8169d60 con 0x7f1ec8072e50 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec816a060 con 0x7f1ec80cb470 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec806de50 0x7f1ec8070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec806de50 0x7f1ec8070ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45788/0 (socket says 172.21.15.44:45788) 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 -- 172.21.15.44:0/603268642 learned_addr learned my addr 172.21.15.44:0/603268642 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecde00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ec80cb470 0x7f1ec80c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecca00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 0x7f1ec80c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 -- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ec80cb470 msgr2=0x7f1ec80c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ec80cb470 0x7f1ec80c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 -- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 msgr2=0x7f1ec80c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 0x7f1ec80c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 -- 172.21.15.44:0/603268642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec806f140 con 0x7f1ec806de50 2024-09-17T05:39:00.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecca00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 0x7f1ec80c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:39:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecd400640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec806de50 0x7f1ec8070ba0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc01cc70 tx=0x7f1ebc005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ec5600640 1 -- 172.21.15.44:0/603268642 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc0bb070 con 0x7f1ec806de50 2024-09-17T05:39:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ec5600640 1 -- 172.21.15.44:0/603268642 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ebc004330 con 0x7f1ec806de50 2024-09-17T05:39:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ec5600640 1 -- 172.21.15.44:0/603268642 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc0b2040 con 0x7f1ec806de50 2024-09-17T05:39:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec80b5c40 con 0x7f1ec806de50 2024-09-17T05:39:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.029+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec815e4b0 con 0x7f1ec806de50 2024-09-17T05:39:00.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ec5600640 1 -- 172.21.15.44:0/603268642 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1ebc005230 con 0x7f1ec806de50 2024-09-17T05:39:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ec5600640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ea8073200 0x7f1ea8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ec5600640 1 -- 172.21.15.44:0/603268642 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f1ebc12dc00 con 0x7f1ec806de50 2024-09-17T05:39:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ecca00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ea8073200 0x7f1ea8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 Processor -- start 2024-09-17T05:39:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 -- start start 2024-09-17T05:39:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ecca00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ea8073200 0x7f1ea8075710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b5910 tx=0x7f1eb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e1270f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e1271470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572e110fcd0 con 0x5572e11046d0 2024-09-17T05:39:00.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5572e1025330 con 0x5572e0e1faa0 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.033+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5572e1082bb0 con 0x5572e0d5b890 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45796/0 (socket says 172.21.15.44:45796) 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 -- 172.21.15.44:0/306671106 learned_addr learned my addr 172.21.15.44:0/306671106 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecca00640 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e1270f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecde00640 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e1271470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 -- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 msgr2=0x5572e1270f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e1270f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 -- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 msgr2=0x5572e1271470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e1271470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 -- 172.21.15.44:0/306671106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e1026c80 con 0x5572e11046d0 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecca00640 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e1270f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:39:00.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ecd400640 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12709f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc0f5600 tx=0x7f1ebc0f7b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4a515c9f1f9296 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1eb9c00640 1 -- 172.21.15.44:0/306671106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc009480 con 0x5572e11046d0 2024-09-17T05:39:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1eb9c00640 1 -- 172.21.15.44:0/306671106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ebc0f8390 con 0x5572e11046d0 2024-09-17T05:39:00.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1eb9c00640 1 -- 172.21.15.44:0/306671106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc0fcdc0 con 0x5572e11046d0 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 -- 172.21.15.44:0/306671106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 msgr2=0x5572e12709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12709f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc0f5600 tx=0x7f1ebc0f7b00 comp rx=0 tx=0).stop 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 -- 172.21.15.44:0/306671106 shutdown_connections 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e1271470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e1270f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/306671106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12709f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 -- 172.21.15.44:0/306671106 >> 172.21.15.44:0/306671106 conn(0x5572e0d2f5c0 msgr2=0x5572e122dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 -- 172.21.15.44:0/306671106 shutdown_connections 2024-09-17T05:39:00.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 -- 172.21.15.44:0/306671106 wait complete. 2024-09-17T05:39:00.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 -- start start 2024-09-17T05:39:00.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.037+0000 7f1ed74a0000 1 Processor -- start 2024-09-17T05:39:00.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e122ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e122cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12335f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572e1075df0 con 0x5572e11046d0 2024-09-17T05:39:00.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5572e1071fe0 con 0x5572e0e1faa0 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5572e10174d0 con 0x5572e0d5b890 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 10 client.0 _ll_register_callbacks cb 0x5572e0ff57f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12335f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45808/0 (socket says 172.21.15.44:45808) 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 -- 172.21.15.44:0/2841991157 learned_addr learned my addr 172.21.15.44:0/2841991157 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecca00640 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e122cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecd400640 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e122ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 -- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 msgr2=0x5572e122ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e122ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 -- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 msgr2=0x5572e122cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e122cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 -- 172.21.15.44:0/2841991157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e1010210 con 0x5572e11046d0 2024-09-17T05:39:00.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecde00640 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12335f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0012660 tx=0x7f1ec0012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd7d58128a60fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1eae000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1eae000640 1 -- 172.21.15.44:0/2841991157 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0019020 con 0x5572e11046d0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1eae000640 1 -- 172.21.15.44:0/2841991157 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f1ec0003980 con 0x5572e11046d0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572e100a350 con 0x5572e11046d0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1eae000640 1 -- 172.21.15.44:0/2841991157 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1ec0023050 con 0x5572e11046d0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 10 client.5964 fetch_fsmap learned FSMap version 35 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x5572e0ff6fc0 con 0x5572e11046d0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1eae000640 1 -- 172.21.15.44:0/2841991157 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5572e100a350 con 0x5572e11046d0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1eae000640 1 -- 172.21.15.44:0/2841991157 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f1ec0026020 con 0x5572e11046d0 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 10 client.5964 fetch_fsmap finished waiting for FSMap version 35 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 10 client.5964 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 20 client.5964 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:00.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d14930 0x5572e1277e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 4 client.5964 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:39:00.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572e1084b00 con 0x5572e0d14930 2024-09-17T05:39:00.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecd400640 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d14930 0x5572e1277e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1ecd400640 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d14930 0x5572e1277e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac5916bb6865846 server_cookie=79ec93204dadee34 in_seq=0 out_seq=0 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.041+0000 7f1eae000640 10 client.5964 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1eae000640 1 -- 172.21.15.44:0/2841991157 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572e1084b00 con 0x5572e0d14930 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1eae000640 10 client.5964 handle_command_reply: tid=0 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 client.5964 shutdown 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 msgr2=0x5572e12335f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12335f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0012660 tx=0x7f1ec0012b20 comp rx=0 tx=0).stop 2024-09-17T05:39:00.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 shutdown_connections 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d14930 0x5572e1277e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12335f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0e1faa0 0x5572e122cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1eae000640 0 client.5964 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2841991157 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0d5b890 0x5572e122ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 >> 172.21.15.44:0/2841991157 conn(0x5572e0d2f5c0 msgr2=0x5572e1225d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 shutdown_connections 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2841991157 wait complete. 2024-09-17T05:39:00.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.045+0000 7f1ed74a0000 20 client.5964 trim_cache size 0 max 16384 2024-09-17T05:39:00.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.061+0000 7f1ed74a0000 1 Processor -- start 2024-09-17T05:39:00.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.061+0000 7f1ed74a0000 1 -- start start 2024-09-17T05:39:00.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5572e122bb20 con 0x5572e11046d0 2024-09-17T05:39:00.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8205c00 con 0x5572e0d5b890 2024-09-17T05:39:00.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec8204c10 con 0x5572e0e1faa0 2024-09-17T05:39:00.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45810/0 (socket says 172.21.15.44:45810) 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 -- 172.21.15.44:0/1130307473 learned_addr learned my addr 172.21.15.44:0/1130307473 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecca00640 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecd400640 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 -- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 msgr2=0x5572e12e2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 -- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 msgr2=0x5572e12e21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 -- 172.21.15.44:0/1130307473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e10cf680 con 0x5572e11046d0 2024-09-17T05:39:00.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ecde00640 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e2c70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0002240 tx=0x7f1ec0003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba55b07cb617c775 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1eb9200640 1 -- 172.21.15.44:0/1130307473 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0019070 con 0x5572e11046d0 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1eb9200640 1 -- 172.21.15.44:0/1130307473 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ec002b030 con 0x5572e11046d0 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1eb9200640 1 -- 172.21.15.44:0/1130307473 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0010870 con 0x5572e11046d0 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- 172.21.15.44:0/1130307473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 msgr2=0x5572e12e2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e2c70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0002240 tx=0x7f1ec0003e90 comp rx=0 tx=0).stop 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- 172.21.15.44:0/1130307473 shutdown_connections 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e2c70 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/1130307473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- 172.21.15.44:0/1130307473 >> 172.21.15.44:0/1130307473 conn(0x5572e0d2f5c0 msgr2=0x5572e1282fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- 172.21.15.44:0/1130307473 shutdown_connections 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.065+0000 7f1ed74a0000 1 -- 172.21.15.44:0/1130307473 wait complete. 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 -- start start 2024-09-17T05:39:00.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 Processor -- start 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8204540 con 0x5572e11046d0 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81fcc00 con 0x5572e0d5b890 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5572e0d37680 con 0x5572e0e1faa0 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 10 client.0 _ll_register_callbacks cb 0x7f1ec00122c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecd400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45826/0 (socket says 172.21.15.44:45826) 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 -- 172.21.15.44:0/2155988281 learned_addr learned my addr 172.21.15.44:0/2155988281 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:00.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 -- 172.21.15.44:0/2155988281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 msgr2=0x5572e12e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 -- 172.21.15.44:0/2155988281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 msgr2=0x5572e12e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:00.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 -- 172.21.15.44:0/2155988281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e103c0b0 con 0x5572e11046d0 2024-09-17T05:39:00.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ecde00640 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e6ec0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0002240 tx=0x7f1ec0010be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731277e236b14d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:00.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1eae000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1eae000640 1 -- 172.21.15.44:0/2155988281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0035060 con 0x5572e11046d0 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec002b030 con 0x5572e11046d0 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1eae000640 1 -- 172.21.15.44:0/2155988281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f1ec0006b60 con 0x5572e11046d0 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1eae000640 1 -- 172.21.15.44:0/2155988281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1ec003b050 con 0x5572e11046d0 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 10 client.5970 fetch_fsmap learned FSMap version 35 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x5572e1008610 con 0x5572e11046d0 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1eae000640 1 -- 172.21.15.44:0/2155988281 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ec002b030 con 0x5572e11046d0 2024-09-17T05:39:00.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1eae000640 1 -- 172.21.15.44:0/2155988281 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f1ec003e020 con 0x5572e11046d0 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 10 client.5970 fetch_fsmap finished waiting for FSMap version 35 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 10 client.5970 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 20 client.5970 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d02990 0x5572e12278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 4 client.5970 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.069+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572e10805b0 con 0x5572e0d02990 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecd400640 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d02990 0x5572e12278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecd400640 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d02990 0x5572e12278f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd749091a9aff3da server_cookie=b6899fdf309a5d89 in_seq=0 out_seq=0 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1eae000640 10 client.5970 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1eae000640 1 -- 172.21.15.44:0/2155988281 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+564 (crc 0 0 0) 0x5572e10805b0 con 0x5572e0d02990 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1eae000640 10 client.5970 handle_command_reply: tid=0 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 client.5970 shutdown 2024-09-17T05:39:00.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 msgr2=0x5572e12e6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e6ec0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0002240 tx=0x7f1ec0010be0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 shutdown_connections 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5572e0d02990 0x5572e12278f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5572e11046d0 0x5572e12e6ec0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5572e0e1faa0 0x5572e12e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 --2- 172.21.15.44:0/2155988281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572e0d5b890 0x5572e12e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 >> 172.21.15.44:0/2155988281 conn(0x5572e0d2f5c0 msgr2=0x5572e12325a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1eae000640 0 client.5970 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 shutdown_connections 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 1 -- 172.21.15.44:0/2155988281 wait complete. 2024-09-17T05:39:00.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ed74a0000 20 client.5970 trim_cache size 0 max 16384 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "afa33feb-13fd-43c4-a02e-29e6b06789b6": { 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "afa33feb-13fd-43c4-a02e-29e6b06789b6", 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive" 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "afa33feb-13fd-43c4-a02e-29e6b06789b6": { 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:38:59.841476+0000", 2024-09-17T05:39:00.077 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:39:00.078 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:39:00.078 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:39:00.078 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:39:00.078 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:39:00.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:00.078 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:00.078 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ea8073200 msgr2=0x7f1ea8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ea8073200 0x7f1ea8075710 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b5910 tx=0x7f1eb4009040 comp rx=0 tx=0).stop 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec806de50 msgr2=0x7f1ec8070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec806de50 0x7f1ec8070ba0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc01cc70 tx=0x7f1ebc005ca0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 shutdown_connections 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ec80cb470 0x7f1ec80c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1ea8073200 0x7f1ea8075710 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8072e50 0x7f1ec80c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 --2- 172.21.15.44:0/603268642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ec806de50 0x7f1ec8070ba0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 >> 172.21.15.44:0/603268642 conn(0x7f1ec80ccaa0 msgr2=0x7f1ec809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 shutdown_connections 2024-09-17T05:39:00.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:00.073+0000 7f1ecfe00640 1 -- 172.21.15.44:0/603268642 wait complete. 2024-09-17T05:39:00.094 INFO:tasks.cephfs.filesystem:scrub status for tag:afa33feb-13fd-43c4-a02e-29e6b06789b6 - {'path': '/', 'tag': 'afa33feb-13fd-43c4-a02e-29e6b06789b6', 'options': 'recursive'} 2024-09-17T05:39:02.641 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:39:02.637+0000 7f2ed9000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T05:39:11.956 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:39:11.960 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:39:30.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:39:30.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-17T05:39:30.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 -- 172.21.15.44:0/1787844447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 msgr2=0x7f16f00b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 --2- 172.21.15.44:0/1787844447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f00b3cd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009930 tx=0x7f16d801c640 comp rx=0 tx=0).stop 2024-09-17T05:39:30.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 -- 172.21.15.44:0/1787844447 shutdown_connections 2024-09-17T05:39:30.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 --2- 172.21.15.44:0/1787844447 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16f00b4210 0x7f16f00b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 --2- 172.21.15.44:0/1787844447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f00b3cd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 -- 172.21.15.44:0/1787844447 >> 172.21.15.44:0/1787844447 conn(0x7f16f00d2000 msgr2=0x7f16f00d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 -- 172.21.15.44:0/1787844447 shutdown_connections 2024-09-17T05:39:30.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.269+0000 7f16f4c00640 1 -- 172.21.15.44:0/1787844447 wait complete. 2024-09-17T05:39:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 Processor -- start 2024-09-17T05:39:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 -- start start 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16f00b4210 0x7f16f006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16f0145c50 0x7f16f00cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f015e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0169c20 con 0x7f16f015c900 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0169aa0 con 0x7f16f00b4210 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f16f0169da0 con 0x7f16f0145c50 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f015e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16ef400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16f00b4210 0x7f16f006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f015e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58180/0 (socket says 172.21.15.44:58180) 2024-09-17T05:39:30.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 -- 172.21.15.44:0/163114646 learned_addr learned my addr 172.21.15.44:0/163114646 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16e6a00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16f0145c50 0x7f16f00cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 -- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16f0145c50 msgr2=0x7f16f00cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16f0145c50 0x7f16f00cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 -- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16f00b4210 msgr2=0x7f16f006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16f00b4210 0x7f16f006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 -- 172.21.15.44:0/163114646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f01fc0c0 con 0x7f16f015c900 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16efe00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f015e640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f16e800b9a0 tx=0x7f16e800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16e7e00640 1 -- 172.21.15.44:0/163114646 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8019070 con 0x7f16f015c900 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16e7e00640 1 -- 172.21.15.44:0/163114646 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16e800ccb0 con 0x7f16f015c900 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16e7e00640 1 -- 172.21.15.44:0/163114646 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e80146a0 con 0x7f16f015c900 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f01fc530 con 0x7f16f015c900 2024-09-17T05:39:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.273+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f01fcaf0 con 0x7f16f015c900 2024-09-17T05:39:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.277+0000 7f16e7e00640 1 -- 172.21.15.44:0/163114646 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f16e801c070 con 0x7f16f015c900 2024-09-17T05:39:30.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.277+0000 7f16e7e00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f16cc073230 0x7f16cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.277+0000 7f16e7e00640 1 -- 172.21.15.44:0/163114646 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f16e8094180 con 0x7f16f015c900 2024-09-17T05:39:30.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.277+0000 7f16fd912000 1 Processor -- start 2024-09-17T05:39:30.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.277+0000 7f16ef400640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f16cc073230 0x7f16cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.277+0000 7f16fd912000 1 -- start start 2024-09-17T05:39:30.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.277+0000 7f16ef400640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f16cc073230 0x7f16cc075740 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098e0 tx=0x7f16e0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94cd016d0 0x55b94ce6d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce6df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94ca1caa0 0x55b94ce6e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b94cd0ccd0 con 0x55b94cd016d0 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b94cc22330 con 0x55b94ca1caa0 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b94cc7fbb0 con 0x55b94c958890 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94cd016d0 0x55b94ce6d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94cd016d0 0x55b94ce6d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58194/0 (socket says 172.21.15.44:58194) 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 -- 172.21.15.44:0/917521483 learned_addr learned my addr 172.21.15.44:0/917521483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16e6a00640 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce6df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16efe00640 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94ca1caa0 0x55b94ce6e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 -- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 msgr2=0x55b94ce6df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce6df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 -- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94ca1caa0 msgr2=0x55b94ce6e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94ca1caa0 0x55b94ce6e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 -- 172.21.15.44:0/917521483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94cc23c80 con 0x55b94cd016d0 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16ef400640 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94cd016d0 0x55b94ce6d9f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f16e0006d10 tx=0x7f16e0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eae0cd06edec6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16df400640 1 -- 172.21.15.44:0/917521483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e001b040 con 0x55b94cd016d0 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16df400640 1 -- 172.21.15.44:0/917521483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16e0015b50 con 0x55b94cd016d0 2024-09-17T05:39:30.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16df400640 1 -- 172.21.15.44:0/917521483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0015da0 con 0x55b94cd016d0 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- 172.21.15.44:0/917521483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94cd016d0 msgr2=0x55b94ce6d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94cd016d0 0x55b94ce6d9f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f16e0006d10 tx=0x7f16e0011000 comp rx=0 tx=0).stop 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- 172.21.15.44:0/917521483 shutdown_connections 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94ca1caa0 0x55b94ce6e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce6df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 --2- 172.21.15.44:0/917521483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94cd016d0 0x55b94ce6d9f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- 172.21.15.44:0/917521483 >> 172.21.15.44:0/917521483 conn(0x55b94c92c5c0 msgr2=0x55b94ce2aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- 172.21.15.44:0/917521483 shutdown_connections 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- 172.21.15.44:0/917521483 wait complete. 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.281+0000 7f16fd912000 1 -- start start 2024-09-17T05:39:30.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 Processor -- start 2024-09-17T05:39:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce29a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94ce29f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94ce305f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b94cc72df0 con 0x55b94ca1caa0 2024-09-17T05:39:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b94cc6efe0 con 0x55b94cd016d0 2024-09-17T05:39:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b94cc144d0 con 0x55b94c958890 2024-09-17T05:39:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 10 client.0 _ll_register_callbacks cb 0x55b94cbf27f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94ce29f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94ce29f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58206/0 (socket says 172.21.15.44:58206) 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 -- 172.21.15.44:0/535685019 learned_addr learned my addr 172.21.15.44:0/535685019 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16ef400640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce29a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16efe00640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94ce305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 -- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 msgr2=0x55b94ce29a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce29a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 -- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 msgr2=0x55b94ce305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94ce305f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 -- 172.21.15.44:0/535685019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b94cc0d210 con 0x55b94ca1caa0 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16efe00640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94ce305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16e6a00640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94ce29f40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009930 tx=0x7f16d8005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6497bcb1396ccd97 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16d3e00640 1 -- 172.21.15.44:0/535685019 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ac070 con 0x55b94ca1caa0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16d3e00640 1 -- 172.21.15.44:0/535685019 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f16d8004030 con 0x55b94ca1caa0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b94cc07350 con 0x55b94ca1caa0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16d3e00640 1 -- 172.21.15.44:0/535685019 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f16d80c2050 con 0x55b94ca1caa0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 10 client.5982 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55b94cbf3fc0 con 0x55b94ca1caa0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16d3e00640 1 -- 172.21.15.44:0/535685019 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b94cc07350 con 0x55b94ca1caa0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16d3e00640 1 -- 172.21.15.44:0/535685019 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f16d80c5020 con 0x55b94ca1caa0 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 10 client.5982 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 10 client.5982 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 20 client.5982 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:30.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c911930 0x55b94ce74e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 4 client.5982 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.285+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b94cc81b00 con 0x55b94c911930 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16ef400640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c911930 0x55b94ce74e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16ef400640 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c911930 0x55b94ce74e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e81b4adb0f3a53e server_cookie=7cfa55563a09b6f2 in_seq=0 out_seq=0 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16d3e00640 10 client.5982 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16d3e00640 1 -- 172.21.15.44:0/535685019 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b94cc81b00 con 0x55b94c911930 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16d3e00640 10 client.5982 handle_command_reply: tid=0 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 client.5982 shutdown 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 msgr2=0x55b94ce29f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94ce29f40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009930 tx=0x7f16d8005610 comp rx=0 tx=0).stop 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 shutdown_connections 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c911930 0x55b94ce74e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94ce305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94ce29f40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 --2- 172.21.15.44:0/535685019 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94ce29a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16d3e00640 0 client.5982 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 >> 172.21.15.44:0/535685019 conn(0x55b94c92c5c0 msgr2=0x55b94ce22d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 shutdown_connections 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 1 -- 172.21.15.44:0/535685019 wait complete. 2024-09-17T05:39:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.289+0000 7f16fd912000 20 client.5982 trim_cache size 0 max 16384 2024-09-17T05:39:30.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 Processor -- start 2024-09-17T05:39:30.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 -- start start 2024-09-17T05:39:30.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94c958890 0x55b94cedede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cedf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94cd016d0 0x55b94cedf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b94ce28b20 con 0x55b94ca1caa0 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16f0205d70 con 0x55b94c958890 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f16f0204d90 con 0x55b94cd016d0 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cedf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cedf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58214/0 (socket says 172.21.15.44:58214) 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 -- 172.21.15.44:0/2238682273 learned_addr learned my addr 172.21.15.44:0/2238682273 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16efe00640 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94cd016d0 0x55b94cedf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16ef400640 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94c958890 0x55b94cedede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 -- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94cd016d0 msgr2=0x55b94cedf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94cd016d0 0x55b94cedf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 -- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94c958890 msgr2=0x55b94cedede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94c958890 0x55b94cedede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 -- 172.21.15.44:0/2238682273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b94cccc680 con 0x55b94ca1caa0 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16e6a00640 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cedf320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f16d801acf0 tx=0x7f16d801c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7177db8ca20018bf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16dea00640 1 -- 172.21.15.44:0/2238682273 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ac030 con 0x55b94ca1caa0 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16dea00640 1 -- 172.21.15.44:0/2238682273 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d8000e50 con 0x55b94ca1caa0 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16dea00640 1 -- 172.21.15.44:0/2238682273 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80a6780 con 0x55b94ca1caa0 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 -- 172.21.15.44:0/2238682273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 msgr2=0x55b94cedf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.309+0000 7f16fd912000 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cedf320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f16d801acf0 tx=0x7f16d801c640 comp rx=0 tx=0).stop 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- 172.21.15.44:0/2238682273 shutdown_connections 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94cd016d0 0x55b94cedf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cedf320 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 --2- 172.21.15.44:0/2238682273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94c958890 0x55b94cedede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- 172.21.15.44:0/2238682273 >> 172.21.15.44:0/2238682273 conn(0x55b94c92c5c0 msgr2=0x55b94ce7ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- 172.21.15.44:0/2238682273 shutdown_connections 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- 172.21.15.44:0/2238682273 wait complete. 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- start start 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 Processor -- start 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94cee3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cee36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94cee3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f16f02046c0 con 0x55b94ca1caa0 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16f01451b0 con 0x55b94cd016d0 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b94c934680 con 0x55b94c958890 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16fd912000 10 client.0 _ll_register_callbacks cb 0x7f16d80a6490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cee36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cee36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58220/0 (socket says 172.21.15.44:58220) 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 -- 172.21.15.44:0/1297079747 learned_addr learned my addr 172.21.15.44:0/1297079747 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16efe00640 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94cee3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16ef400640 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94cee3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 -- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 msgr2=0x55b94cee3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94cee3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 -- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 msgr2=0x55b94cee3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94cee3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 -- 172.21.15.44:0/1297079747 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b94cc390b0 con 0x55b94ca1caa0 2024-09-17T05:39:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16e6a00640 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cee36c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009930 tx=0x7f16d80a6bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cd994e60e1d749 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.313+0000 7f16d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:30.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 1 -- 172.21.15.44:0/1297079747 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ce060 con 0x55b94ca1caa0 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 1 -- 172.21.15.44:0/1297079747 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f16d8004300 con 0x55b94ca1caa0 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16d8000e50 con 0x55b94ca1caa0 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 1 -- 172.21.15.44:0/1297079747 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f16d80d4050 con 0x55b94ca1caa0 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 10 client.5988 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55b94cc05610 con 0x55b94ca1caa0 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 1 -- 172.21.15.44:0/1297079747 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16d8000e50 con 0x55b94ca1caa0 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 1 -- 172.21.15.44:0/1297079747 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f16d80d7020 con 0x55b94ca1caa0 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 10 client.5988 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 10 client.5988 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 20 client.5988 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:30.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c8ff990 0x55b94ce9e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 4 client.5988 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b94cc7d5b0 con 0x55b94c8ff990 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16ef400640 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c8ff990 0x55b94ce9e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 10 client.5988 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16ef400640 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c8ff990 0x55b94ce9e740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d97ced694b9d0c93 server_cookie=62983b1be641d5d3 in_seq=0 out_seq=0 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 1 -- 172.21.15.44:0/1297079747 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55b94cc7d5b0 con 0x55b94c8ff990 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 10 client.5988 handle_command_reply: tid=0 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 client.5988 shutdown 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 msgr2=0x55b94cee36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cee36c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f16d8009930 tx=0x7f16d80a6bc0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 shutdown_connections 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55b94c8ff990 0x55b94ce9e740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b94cd016d0 0x55b94cee3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b94ca1caa0 0x55b94cee36c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 --2- 172.21.15.44:0/1297079747 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b94c958890 0x55b94cee3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16d3e00640 0 client.5988 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 >> 172.21.15.44:0/1297079747 conn(0x55b94c92c5c0 msgr2=0x55b94ce2f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 shutdown_connections 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 1 -- 172.21.15.44:0/1297079747 wait complete. 2024-09-17T05:39:30.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16fd912000 20 client.5988 trim_cache size 0 max 16384 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "afa33feb-13fd-43c4-a02e-29e6b06789b6": { 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:38:59.841476+0000", 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:39:30.326 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:39:30.327 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:39:30.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:30.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:30.327 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f16cc073230 msgr2=0x7f16cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f16cc073230 0x7f16cc075740 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098e0 tx=0x7f16e0009060 comp rx=0 tx=0).stop 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 msgr2=0x7f16f015e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f015e640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f16e800b9a0 tx=0x7f16e800be60 comp rx=0 tx=0).stop 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 shutdown_connections 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16f015c900 0x7f16f015e640 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16f0145c50 0x7f16f00cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f16cc073230 0x7f16cc075740 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 --2- 172.21.15.44:0/163114646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16f00b4210 0x7f16f006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 >> 172.21.15.44:0/163114646 conn(0x7f16f00d2000 msgr2=0x7f16f00c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 shutdown_connections 2024-09-17T05:39:30.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.317+0000 7f16f4c00640 1 -- 172.21.15.44:0/163114646 wait complete. 2024-09-17T05:39:30.338 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:39:30.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:39:30.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 -- 172.21.15.44:0/3183504167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 msgr2=0x7f08f015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 --2- 172.21.15.44:0/3183504167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 0x7f08f015e990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009840 tx=0x7f08e001c6b0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 -- 172.21.15.44:0/3183504167 shutdown_connections 2024-09-17T05:39:30.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 --2- 172.21.15.44:0/3183504167 >> v2:172.21.15.86:3300/0 conn(0x7f08f006de50 0x7f08f006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 --2- 172.21.15.44:0/3183504167 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 0x7f08f015e990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 -- 172.21.15.44:0/3183504167 >> 172.21.15.44:0/3183504167 conn(0x7f08f00ccaa0 msgr2=0x7f08f00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 -- 172.21.15.44:0/3183504167 shutdown_connections 2024-09-17T05:39:30.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.497+0000 7f08f7000640 1 -- 172.21.15.44:0/3183504167 wait complete. 2024-09-17T05:39:30.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 Processor -- start 2024-09-17T05:39:30.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 -- start start 2024-09-17T05:39:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f006de50 0x7f08f009ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 0x7f08f009cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f00ced00 0x7f08f01f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f08f0169410 con 0x7f08f00ced00 2024-09-17T05:39:30.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f08f0169290 con 0x7f08f006de50 2024-09-17T05:39:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f7000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f08f0169590 con 0x7f08f0072e50 2024-09-17T05:39:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f00ced00 0x7f08f01f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f00ced00 0x7f08f01f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58228/0 (socket says 172.21.15.44:58228) 2024-09-17T05:39:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 -- 172.21.15.44:0/556654928 learned_addr learned my addr 172.21.15.44:0/556654928 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08e7e00640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 0x7f08f009cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08efe00640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f006de50 0x7f08f009ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 -- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 msgr2=0x7f08f009cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 0x7f08f009cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 -- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f006de50 msgr2=0x7f08f009ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f006de50 0x7f08f009ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 -- 172.21.15.44:0/556654928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f00b3ee0 con 0x7f08f00ced00 2024-09-17T05:39:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.501+0000 7f08f5000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f00ced00 0x7f08f01f6850 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f08e800cbb0 tx=0x7f08e800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08ecc00640 1 -- 172.21.15.44:0/556654928 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8016020 con 0x7f08f00ced00 2024-09-17T05:39:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08ecc00640 1 -- 172.21.15.44:0/556654928 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08e800ab00 con 0x7f08f00ced00 2024-09-17T05:39:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08ecc00640 1 -- 172.21.15.44:0/556654928 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8012420 con 0x7f08f00ced00 2024-09-17T05:39:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f00b5920 con 0x7f08f00ced00 2024-09-17T05:39:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f01f9c20 con 0x7f08f00ced00 2024-09-17T05:39:30.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f01f9e80 con 0x7f08f00ced00 2024-09-17T05:39:30.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08ecc00640 1 -- 172.21.15.44:0/556654928 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f08e8019020 con 0x7f08f00ced00 2024-09-17T05:39:30.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08ecc00640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f08cc073230 0x7f08cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08ecc00640 1 -- 172.21.15.44:0/556654928 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f08e80947c0 con 0x7f08f00ced00 2024-09-17T05:39:30.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.505+0000 7f08efe00640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f08cc073230 0x7f08cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.509+0000 7f08efe00640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f08cc073230 0x7f08cc075740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f08e00af000 tx=0x7f08e00b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.513+0000 7f08ecc00640 1 -- 172.21.15.44:0/556654928 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f08e8020020 con 0x7f08f00ced00 2024-09-17T05:39:30.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08f006e260 con 0x7f08f00ced00 2024-09-17T05:39:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08ecc00640 1 -- 172.21.15.44:0/556654928 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5221 (secure 0 0 0) 0x7f08f006e7a0 con 0x7f08f00ced00 2024-09-17T05:39:30.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:39:30.721 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":36,"btime":"2024-09-17T05:39:02:641358+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:39:02.610164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":7,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:39:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 36 2024-09-17T05:39:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f08cc073230 msgr2=0x7f08cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f08cc073230 0x7f08cc075740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f08e00af000 tx=0x7f08e00b2040 comp rx=0 tx=0).stop 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f00ced00 msgr2=0x7f08f01f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f00ced00 0x7f08f01f6850 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f08e800cbb0 tx=0x7f08e800cca0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 shutdown_connections 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08f00ced00 0x7f08f01f6850 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f08f0072e50 0x7f08f009cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f08cc073230 0x7f08cc075740 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 --2- 172.21.15.44:0/556654928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08f006de50 0x7f08f009ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 >> 172.21.15.44:0/556654928 conn(0x7f08f00ccaa0 msgr2=0x7f08f00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 shutdown_connections 2024-09-17T05:39:30.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.721+0000 7f08f7000640 1 -- 172.21.15.44:0/556654928 wait complete. 2024-09-17T05:39:30.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-09-17T05:39:30.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 -- 172.21.15.44:0/232430339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c073320 msgr2=0x7fce0c0b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 --2- 172.21.15.44:0/232430339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c073320 0x7fce0c0b3350 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009900 tx=0x7fcdf401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 -- 172.21.15.44:0/232430339 shutdown_connections 2024-09-17T05:39:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 --2- 172.21.15.44:0/232430339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce0c0b3890 0x7fce0c0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 --2- 172.21.15.44:0/232430339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c073320 0x7fce0c0b3350 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 -- 172.21.15.44:0/232430339 >> 172.21.15.44:0/232430339 conn(0x7fce0c06ce40 msgr2=0x7fce0c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 -- 172.21.15.44:0/232430339 shutdown_connections 2024-09-17T05:39:30.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 -- 172.21.15.44:0/232430339 wait complete. 2024-09-17T05:39:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 Processor -- start 2024-09-17T05:39:30.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.905+0000 7fce0b200640 1 -- start start 2024-09-17T05:39:30.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce0c0b3890 0x7fce0c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce0c0b4f60 0x7fce0c148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c1f9fc0 0x7fce0c1f7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c168d40 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c168bc0 con 0x7fce0c0b4f60 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fce0c168ec0 con 0x7fce0c0b3890 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c1f9fc0 0x7fce0c1f7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce03e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce0c0b4f60 0x7fce0c148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce03e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce0c0b4f60 0x7fce0c148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:39080/0 (socket says 172.21.15.44:39080) 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c1f9fc0 0x7fce0c1f7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58246/0 (socket says 172.21.15.44:58246) 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce03e00640 1 -- 172.21.15.44:0/832252785 learned_addr learned my addr 172.21.15.44:0/832252785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce09e00640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce0c0b3890 0x7fce0c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 -- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce0c0b3890 msgr2=0x7fce0c155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce0c0b3890 0x7fce0c155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 -- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce0c0b4f60 msgr2=0x7fce0c148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce0c0b4f60 0x7fce0c148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 -- 172.21.15.44:0/832252785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce0c1fa540 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce03e00640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce0c0b4f60 0x7fce0c148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:39:30.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0a800640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c1f9fc0 0x7fce0c1f7000 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fce0400e990 tx=0x7fce0400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce02000640 1 -- 172.21.15.44:0/832252785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04004d30 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce02000640 1 -- 172.21.15.44:0/832252785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce0400cb60 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce0c1fa800 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce02000640 1 -- 172.21.15.44:0/832252785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04005020 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.909+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce0c1f6ae0 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce02000640 1 -- 172.21.15.44:0/832252785 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce040051c0 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce02000640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcde8073200 0x7fcde8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce02000640 1 -- 172.21.15.44:0/832252785 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7fce04095130 con 0x7fce0c1f9fc0 2024-09-17T05:39:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 Processor -- start 2024-09-17T05:39:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 -- start start 2024-09-17T05:39:30.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce09e00640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcde8073200 0x7fcde8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce09e00640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcde8073200 0x7fcde8075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc007fd0 tx=0x7fcdfc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc5bb60 0x564bccda57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bccda5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccda6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564bccc3fd00 con 0x564bccc511c0 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564bccbb3c90 con 0x564bccc3ad90 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564bccba30c0 con 0x564bccc5bb60 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bccda5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bccda5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58258/0 (socket says 172.21.15.44:58258) 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.913+0000 7fce03e00640 1 -- 172.21.15.44:0/1707099643 learned_addr learned my addr 172.21.15.44:0/1707099643 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce09e00640 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc5bb60 0x564bccda57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce0a800640 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccda6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce03e00640 1 -- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc5bb60 msgr2=0x564bccda57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce03e00640 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc5bb60 0x564bccda57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce03e00640 1 -- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 msgr2=0x564bccda6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce03e00640 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccda6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce03e00640 1 -- 172.21.15.44:0/1707099643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bccb7e290 con 0x564bccc511c0 2024-09-17T05:39:30.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce03e00640 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bccda5ce0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009900 tx=0x7fcdf4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede5e8f46aae3a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fcdfaa00640 1 -- 172.21.15.44:0/1707099643 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40b2040 con 0x564bccc511c0 2024-09-17T05:39:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fcdfaa00640 1 -- 172.21.15.44:0/1707099643 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdf4004320 con 0x564bccc511c0 2024-09-17T05:39:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fcdfaa00640 1 -- 172.21.15.44:0/1707099643 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40a5b80 con 0x564bccc511c0 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 -- 172.21.15.44:0/1707099643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 msgr2=0x564bccda5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bccda5ce0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009900 tx=0x7fcdf4019680 comp rx=0 tx=0).stop 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 -- 172.21.15.44:0/1707099643 shutdown_connections 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccda6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bccda5ce0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 --2- 172.21.15.44:0/1707099643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc5bb60 0x564bccda57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 -- 172.21.15.44:0/1707099643 >> 172.21.15.44:0/1707099643 conn(0x564bcc860760 msgr2=0x564bccd5a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 -- 172.21.15.44:0/1707099643 shutdown_connections 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 -- 172.21.15.44:0/1707099643 wait complete. 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 -- start start 2024-09-17T05:39:30.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.917+0000 7fce186d1000 1 Processor -- start 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccdaca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc511c0 0x564bccdacf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564bccb3d940 con 0x564bccc5bb60 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564bccba6ed0 con 0x564bccc3ad90 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564bcc868820 con 0x564bccc511c0 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 10 client.0 _ll_register_callbacks cb 0x564bccb817f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58272/0 (socket says 172.21.15.44:58272) 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 -- 172.21.15.44:0/980074300 learned_addr learned my addr 172.21.15.44:0/980074300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce09e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccdaca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce03e00640 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc511c0 0x564bccdacf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 -- 172.21.15.44:0/980074300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc511c0 msgr2=0x564bccdacf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc511c0 0x564bccdacf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 -- 172.21.15.44:0/980074300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 msgr2=0x564bccdaca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccdaca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 -- 172.21.15.44:0/980074300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bccb56550 con 0x564bccc5bb60 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce0a800640 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdad4a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce04093390 tx=0x7fce0405f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26521a32972414b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fcdef400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fcdef400640 1 -- 172.21.15.44:0/980074300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04079020 con 0x564bccc5bb60 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564bccb3b400 con 0x564bccc5bb60 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fcdef400640 1 -- 172.21.15.44:0/980074300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7fce0405b210 con 0x564bccc5bb60 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fcdef400640 1 -- 172.21.15.44:0/980074300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fce040642f0 con 0x564bccc5bb60 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 10 client.6006 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x564bccb41480 con 0x564bccc5bb60 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fcdef400640 1 -- 172.21.15.44:0/980074300 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564bccb3b400 con 0x564bccc5bb60 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fcdef400640 1 -- 172.21.15.44:0/980074300 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7fce04020030 con 0x564bccc5bb60 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 10 client.6006 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 10 client.6006 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 20 client.6006 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc845ad0 0x564bccdb6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 4 client.6006 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bccbb5be0 con 0x564bcc845ad0 2024-09-17T05:39:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce09e00640 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc845ad0 0x564bccdb6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fce09e00640 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc845ad0 0x564bccdb6e00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df43659386798e49 server_cookie=e7b3eb860b8b668a in_seq=0 out_seq=0 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.921+0000 7fcdef400640 10 client.6006 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fcdef400640 1 -- 172.21.15.44:0/980074300 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564bccbb5be0 con 0x564bcc845ad0 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fcdef400640 10 client.6006 handle_command_reply: tid=0 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 client.6006 shutdown 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 msgr2=0x564bccdad4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdad4a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce04093390 tx=0x7fce0405f330 comp rx=0 tx=0).stop 2024-09-17T05:39:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 shutdown_connections 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc845ad0 0x564bccdb6e00 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdad4a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc511c0 0x564bccdacf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 --2- 172.21.15.44:0/980074300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc3ad90 0x564bccdaca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fcdef400640 0 client.6006 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 >> 172.21.15.44:0/980074300 conn(0x564bcc860760 msgr2=0x564bccd5ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 shutdown_connections 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 1 -- 172.21.15.44:0/980074300 wait complete. 2024-09-17T05:39:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.925+0000 7fce186d1000 20 client.6006 trim_cache size 0 max 16384 2024-09-17T05:39:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.937+0000 7fce186d1000 1 Processor -- start 2024-09-17T05:39:30.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.937+0000 7fce186d1000 1 -- start start 2024-09-17T05:39:30.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bcce16710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bcce16c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc5bb60 0x564bcce17190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fce0c0cee70 con 0x564bccc511c0 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564bccb6ad20 con 0x564bccc5bb60 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564bccbb2a60 con 0x564bccc3ad90 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bcce16710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bcce16710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:56998/0 (socket says 172.21.15.44:56998) 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 -- 172.21.15.44:0/3014428093 learned_addr learned my addr 172.21.15.44:0/3014428093 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bcce16c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce0a800640 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc5bb60 0x564bcce17190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 -- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc5bb60 msgr2=0x564bcce17190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc5bb60 0x564bcce17190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 -- 172.21.15.44:0/3014428093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 msgr2=0x564bcce16c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bcce16c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 -- 172.21.15.44:0/3014428093 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bccc28d10 con 0x564bccc3ad90 2024-09-17T05:39:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce03e00640 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bcce16c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:39:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce09e00640 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bcce16710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x564bccb27d60 tx=0x7fcdfc00a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa45c8140db713b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fcdfa000640 1 -- 172.21.15.44:0/3014428093 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc02f070 con 0x564bccc3ad90 2024-09-17T05:39:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fcdfa000640 1 -- 172.21.15.44:0/3014428093 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdfc01b040 con 0x564bccc3ad90 2024-09-17T05:39:30.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fcdfa000640 1 -- 172.21.15.44:0/3014428093 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc016e10 con 0x564bccc3ad90 2024-09-17T05:39:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 msgr2=0x564bcce16710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bcce16710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x564bccb27d60 tx=0x7fcdfc00a000 comp rx=0 tx=0).stop 2024-09-17T05:39:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- 172.21.15.44:0/3014428093 shutdown_connections 2024-09-17T05:39:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc5bb60 0x564bcce17190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc511c0 0x564bcce16c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 --2- 172.21.15.44:0/3014428093 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bcce16710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- 172.21.15.44:0/3014428093 >> 172.21.15.44:0/3014428093 conn(0x564bcc860760 msgr2=0x564bccda3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- 172.21.15.44:0/3014428093 shutdown_connections 2024-09-17T05:39:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- 172.21.15.44:0/3014428093 wait complete. 2024-09-17T05:39:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 -- start start 2024-09-17T05:39:30.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.941+0000 7fce186d1000 1 Processor -- start 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bccdb9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc511c0 0x564bccdb9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdd7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564bccb6f300 con 0x564bccc5bb60 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564bccb60670 con 0x564bccc511c0 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564bccba61e0 con 0x564bccc3ad90 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 10 client.0 _ll_register_callbacks cb 0x7fce040093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdd7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce09e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bccdb9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdd7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58290/0 (socket says 172.21.15.44:58290) 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 -- 172.21.15.44:0/3055017326 learned_addr learned my addr 172.21.15.44:0/3055017326 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce03e00640 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc511c0 0x564bccdb9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 -- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 msgr2=0x564bccdb9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bccdb9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 -- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc511c0 msgr2=0x564bccdb9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc511c0 0x564bccdb9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 -- 172.21.15.44:0/3055017326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bccb59e50 con 0x564bccc5bb60 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce09e00640 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bccdb9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce0a800640 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdd7320 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fce040095c0 tx=0x7fce0405e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaed545fdacb46dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fcdef400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fcdef400640 1 -- 172.21.15.44:0/3055017326 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04079040 con 0x564bccc5bb60 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fcdef400640 1 -- 172.21.15.44:0/3055017326 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7fce0405ed30 con 0x564bccc5bb60 2024-09-17T05:39:30.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdfc01b040 con 0x564bccc5bb60 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fcdef400640 1 -- 172.21.15.44:0/3055017326 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fce0405b760 con 0x564bccc5bb60 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 10 client.6012 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x564bccb482d0 con 0x564bccc5bb60 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fcdef400640 1 -- 172.21.15.44:0/3055017326 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdfc01b040 con 0x564bccc5bb60 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fcdef400640 1 -- 172.21.15.44:0/3055017326 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7fce040686e0 con 0x564bccc5bb60 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 10 client.6012 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 10 client.6012 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 20 client.6012 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc833b30 0x564bcce1a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 4 client.6012 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x564bccbb1690 con 0x564bcc833b30 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.945+0000 7fce09e00640 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc833b30 0x564bcce1a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:30.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fcdef400640 10 client.6012 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce09e00640 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc833b30 0x564bcce1a960 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9440ab07f26c775 server_cookie=a99050015caaa00e in_seq=0 out_seq=0 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fcdef400640 1 -- 172.21.15.44:0/3055017326 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+141 (crc 0 0 0) 0x564bccbb1690 con 0x564bcc833b30 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fcdef400640 10 client.6012 handle_command_reply: tid=0 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 client.6012 shutdown 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 msgr2=0x564bccdd7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdd7320 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fce040095c0 tx=0x7fce0405e7c0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 shutdown_connections 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x564bcc833b30 0x564bcce1a960 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564bccc5bb60 0x564bccdd7320 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564bccc511c0 0x564bccdb9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fcdef400640 0 client.6012 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 --2- 172.21.15.44:0/3055017326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564bccc3ad90 0x564bccdb9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 >> 172.21.15.44:0/3055017326 conn(0x564bcc860760 msgr2=0x564bccda47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 shutdown_connections 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 1 -- 172.21.15.44:0/3055017326 wait complete. 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce186d1000 20 client.6012 trim_cache size 0 max 16384 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_type": "backtrace", 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 1971570536, 2024-09-17T05:39:30.953 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627777, 2024-09-17T05:39:30.954 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir_test/file" 2024-09-17T05:39:30.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:30.954 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcde8073200 msgr2=0x7fcde8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcde8073200 0x7fcde8075710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc007fd0 tx=0x7fcdfc009040 comp rx=0 tx=0).stop 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c1f9fc0 msgr2=0x7fce0c1f7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c1f9fc0 0x7fce0c1f7000 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fce0400e990 tx=0x7fce0400ee50 comp rx=0 tx=0).stop 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 shutdown_connections 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce0c1f9fc0 0x7fce0c1f7000 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcde8073200 0x7fcde8075710 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce0c0b4f60 0x7fce0c148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 --2- 172.21.15.44:0/832252785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce0c0b3890 0x7fce0c155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 >> 172.21.15.44:0/832252785 conn(0x7fce0c06ce40 msgr2=0x7fce0c1491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:30.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 shutdown_connections 2024-09-17T05:39:30.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:30.949+0000 7fce0b200640 1 -- 172.21.15.44:0/832252785 wait complete. 2024-09-17T05:39:30.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:39:31.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.125+0000 7f63c7000640 1 -- 172.21.15.44:0/2754909850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 msgr2=0x7f63a400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.125+0000 7f63c7000640 1 --2- 172.21.15.44:0/2754909850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63a400b9d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f63b800c730 tx=0x7f63b801f9e0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 -- 172.21.15.44:0/2754909850 shutdown_connections 2024-09-17T05:39:31.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 --2- 172.21.15.44:0/2754909850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63a400b9d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 -- 172.21.15.44:0/2754909850 >> 172.21.15.44:0/2754909850 conn(0x7f63c00cd930 msgr2=0x7f63c00cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 -- 172.21.15.44:0/2754909850 shutdown_connections 2024-09-17T05:39:31.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 -- 172.21.15.44:0/2754909850 wait complete. 2024-09-17T05:39:31.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 Processor -- start 2024-09-17T05:39:31.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 -- start start 2024-09-17T05:39:31.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63c01396b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.129+0000 7f63c7000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c00b6060 0x7f63c00b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c7000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63c00c9be0 0x7f63c00c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c7000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63c00cb6a0 con 0x7f63a4005290 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c7000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f63c00cb520 con 0x7f63c00b6060 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c7000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f63c00cc530 con 0x7f63c00c9be0 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63c01396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63c01396b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58310/0 (socket says 172.21.15.44:58310) 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 -- 172.21.15.44:0/3207139754 learned_addr learned my addr 172.21.15.44:0/3207139754 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bf400640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c00b6060 0x7f63c00b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c5000640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63c00c9be0 0x7f63c00c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 -- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63c00c9be0 msgr2=0x7f63c00c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63c00c9be0 0x7f63c00c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 -- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c00b6060 msgr2=0x7f63c00b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c00b6060 0x7f63c00b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 -- 172.21.15.44:0/3207139754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c00ca530 con 0x7f63a4005290 2024-09-17T05:39:31.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63bfe00640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63c01396b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f63b0003e60 tx=0x7f63b0001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63b7e00640 1 -- 172.21.15.44:0/3207139754 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b0015070 con 0x7f63a4005290 2024-09-17T05:39:31.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63b7e00640 1 -- 172.21.15.44:0/3207139754 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63b0011840 con 0x7f63a4005290 2024-09-17T05:39:31.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c01f5b00 con 0x7f63a4005290 2024-09-17T05:39:31.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63b7e00640 1 -- 172.21.15.44:0/3207139754 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b0011c90 con 0x7f63a4005290 2024-09-17T05:39:31.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c01f6340 con 0x7f63a4005290 2024-09-17T05:39:31.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c00cca90 con 0x7f63a4005290 2024-09-17T05:39:31.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.133+0000 7f63b7e00640 1 -- 172.21.15.44:0/3207139754 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f63b0018070 con 0x7f63a4005290 2024-09-17T05:39:31.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.137+0000 7f63b7e00640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f63a0073200 0x7f63a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.137+0000 7f63b7e00640 1 -- 172.21.15.44:0/3207139754 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f63b0095100 con 0x7f63a4005290 2024-09-17T05:39:31.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.137+0000 7f63bf400640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f63a0073200 0x7f63a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.137+0000 7f63bf400640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f63a0073200 0x7f63a0075710 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f63c006f330 tx=0x7f63ac00a2f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.141+0000 7f63b7e00640 1 -- 172.21.15.44:0/3207139754 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f63c01f5b00 con 0x7f63a4005290 2024-09-17T05:39:31.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.349+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f63c015e450 con 0x7f63a4005290 2024-09-17T05:39:31.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.349+0000 7f63b7e00640 1 -- 172.21.15.44:0/3207139754 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f63c00ca530 con 0x7f63a4005290 2024-09-17T05:39:31.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:39:31.350 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-09-17T05:39:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f63a0073200 msgr2=0x7f63a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f63a0073200 0x7f63a0075710 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f63c006f330 tx=0x7f63ac00a2f0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 msgr2=0x7f63c01396b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63c01396b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f63b0003e60 tx=0x7f63b0001810 comp rx=0 tx=0).stop 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 shutdown_connections 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f63c00c9be0 0x7f63c00c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f63a0073200 0x7f63a0075710 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63c00b6060 0x7f63c00b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 --2- 172.21.15.44:0/3207139754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63a4005290 0x7f63c01396b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 >> 172.21.15.44:0/3207139754 conn(0x7f63c00cd930 msgr2=0x7f63c0070820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 shutdown_connections 2024-09-17T05:39:31.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.353+0000 7f63c7000640 1 -- 172.21.15.44:0/3207139754 wait complete. 2024-09-17T05:39:31.373 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:39:31.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:39:31.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-09-17T05:39:31.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.533+0000 7f62a0400640 1 -- 172.21.15.44:0/3938038811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62981585b0 msgr2=0x7f629806e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.533+0000 7f62a0400640 1 --2- 172.21.15.44:0/3938038811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62981585b0 0x7f629806e180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f628c009840 tx=0x7f628c01c6b0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 -- 172.21.15.44:0/3938038811 shutdown_connections 2024-09-17T05:39:31.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 --2- 172.21.15.44:0/3938038811 >> v2:172.21.15.86:3300/0 conn(0x7f6298073760 0x7f6298073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 --2- 172.21.15.44:0/3938038811 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f62981585b0 0x7f629806e180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 -- 172.21.15.44:0/3938038811 >> 172.21.15.44:0/3938038811 conn(0x7f62980b35f0 msgr2=0x7f62980b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 -- 172.21.15.44:0/3938038811 shutdown_connections 2024-09-17T05:39:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 -- 172.21.15.44:0/3938038811 wait complete. 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 Processor -- start 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.537+0000 7f62a0400640 1 -- start start 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6298073760 0x7f629809a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62980ccae0 0x7f62981fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62981585b0 0x7f62981fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6298168170 con 0x7f62980ccae0 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6298167ff0 con 0x7f62981585b0 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f62981682f0 con 0x7f6298073760 2024-09-17T05:39:31.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62980ccae0 0x7f62981fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629da00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6298073760 0x7f629809a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62980ccae0 0x7f62981fc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58318/0 (socket says 172.21.15.44:58318) 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 -- 172.21.15.44:0/720232932 learned_addr learned my addr 172.21.15.44:0/720232932 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629da00640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6298073760 0x7f629809a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57060/0 (socket says 172.21.15.44:57060) 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629e400640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62981585b0 0x7f62981fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 -- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6298073760 msgr2=0x7f629809a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6298073760 0x7f629809a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 -- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62981585b0 msgr2=0x7f62981fc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62981585b0 0x7f62981fc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 -- 172.21.15.44:0/720232932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62981f9bf0 con 0x7f62980ccae0 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629da00640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6298073760 0x7f629809a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f629d000640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62980ccae0 0x7f62981fc480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f628400c500 tx=0x7f628400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f6295600640 1 -- 172.21.15.44:0/720232932 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284016020 con 0x7f62980ccae0 2024-09-17T05:39:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f6295600640 1 -- 172.21.15.44:0/720232932 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6284012920 con 0x7f62980ccae0 2024-09-17T05:39:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f6295600640 1 -- 172.21.15.44:0/720232932 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284012d70 con 0x7f62980ccae0 2024-09-17T05:39:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62980b03c0 con 0x7f62980ccae0 2024-09-17T05:39:31.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6298145160 con 0x7f62980ccae0 2024-09-17T05:39:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.541+0000 7f6295600640 1 -- 172.21.15.44:0/720232932 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6284019020 con 0x7f62980ccae0 2024-09-17T05:39:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f6295600640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6278073200 0x7f6278075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f6295600640 1 -- 172.21.15.44:0/720232932 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f6284094400 con 0x7f62980ccae0 2024-09-17T05:39:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 Processor -- start 2024-09-17T05:39:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 -- start start 2024-09-17T05:39:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629da00640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6278073200 0x7f6278075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629da00640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6278073200 0x7f6278075710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f628c0af000 tx=0x7f628c0b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26d9ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26d9f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26d9f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf26bb18b0 con 0x55cf26c256e0 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cf26ba0ce0 con 0x55cf26c25ef0 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55cf26ba4af0 con 0x55cf26c38e20 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26d9f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26d9f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58334/0 (socket says 172.21.15.44:58334) 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 -- 172.21.15.44:0/1549845220 learned_addr learned my addr 172.21.15.44:0/1549845220 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629da00640 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26d9ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629e400640 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26d9f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 -- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 msgr2=0x55cf26d9ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26d9ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 -- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 msgr2=0x55cf26d9f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26d9f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 -- 172.21.15.44:0/1549845220 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf26b544e0 con 0x55cf26c256e0 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.545+0000 7f629d000640 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26d9f1a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f628405e9b0 tx=0x7f628405e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130f39ee4d0ca30 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f628a000640 1 -- 172.21.15.44:0/1549845220 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284068500 con 0x55cf26c256e0 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f628a000640 1 -- 172.21.15.44:0/1549845220 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62840940c0 con 0x55cf26c256e0 2024-09-17T05:39:31.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f628a000640 1 -- 172.21.15.44:0/1549845220 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284063120 con 0x55cf26c256e0 2024-09-17T05:39:31.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- 172.21.15.44:0/1549845220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 msgr2=0x55cf26d9f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26d9f1a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f628405e9b0 tx=0x7f628405e880 comp rx=0 tx=0).stop 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- 172.21.15.44:0/1549845220 shutdown_connections 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26d9f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26d9f1a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 --2- 172.21.15.44:0/1549845220 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26d9ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- 172.21.15.44:0/1549845220 >> 172.21.15.44:0/1549845220 conn(0x55cf26c5c980 msgr2=0x55cf26d53ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- 172.21.15.44:0/1549845220 shutdown_connections 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- 172.21.15.44:0/1549845220 wait complete. 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- start start 2024-09-17T05:39:31.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 Processor -- start 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26da50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26da5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26da5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf26b60a20 con 0x55cf26c256e0 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cf26b4acc0 con 0x55cf26c25ef0 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55cf26b58f70 con 0x55cf26c38e20 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.549+0000 7f62a7be5000 10 client.0 _ll_register_callbacks cb 0x55cf26d40b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26da50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26da50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58348/0 (socket says 172.21.15.44:58348) 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 -- 172.21.15.44:0/21655782 learned_addr learned my addr 172.21.15.44:0/21655782 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629d000640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26da5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629e400640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26da5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 -- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 msgr2=0x55cf26da5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26da5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 -- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 msgr2=0x55cf26da5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26da5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 -- 172.21.15.44:0/21655782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf26b49ea0 con 0x55cf26c256e0 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629e400640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26da5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629da00640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26da50e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f628c009790 tx=0x7f628c01aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0cfc8a3efe5ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 1 -- 172.21.15.44:0/21655782 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c0a9c00 con 0x55cf26c256e0 2024-09-17T05:39:31.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cf26b393d0 con 0x55cf26c256e0 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 1 -- 172.21.15.44:0/21655782 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f628c0a9da0 con 0x55cf26c256e0 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 1 -- 172.21.15.44:0/21655782 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f628c0d5050 con 0x55cf26c256e0 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 10 client.6030 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55cf26b46500 con 0x55cf26c256e0 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 1 -- 172.21.15.44:0/21655782 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cf26b393d0 con 0x55cf26c256e0 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 1 -- 172.21.15.44:0/21655782 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f628c0d8020 con 0x55cf26c256e0 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 10 client.6030 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 10 client.6030 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 20 client.6030 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf26843860 0x55cf26daf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 4 client.6030 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf26bb3800 con 0x55cf26843860 2024-09-17T05:39:31.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629d000640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf26843860 0x55cf26daf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f629d000640 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf26843860 0x55cf26daf4c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf2c5416f1dae4ef server_cookie=b52593f51795ead2 in_seq=0 out_seq=0 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 10 client.6030 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 1 -- 172.21.15.44:0/21655782 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf26bb3800 con 0x55cf26843860 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 10 client.6030 handle_command_reply: tid=0 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 client.6030 shutdown 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 msgr2=0x55cf26da50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26da50e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f628c009790 tx=0x7f628c01aef0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 shutdown_connections 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf26843860 0x55cf26daf4c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c38e20 0x55cf26da5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26da5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f627ea00640 0 client.6030 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 --2- 172.21.15.44:0/21655782 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c256e0 0x55cf26da50e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 >> 172.21.15.44:0/21655782 conn(0x55cf26c5c980 msgr2=0x55cf26d54670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 shutdown_connections 2024-09-17T05:39:31.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.553+0000 7f62a7be5000 1 -- 172.21.15.44:0/21655782 wait complete. 2024-09-17T05:39:31.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.557+0000 7f62a7be5000 20 client.6030 trim_cache size 0 max 16384 2024-09-17T05:39:31.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.573+0000 7f62a7be5000 1 Processor -- start 2024-09-17T05:39:31.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.573+0000 7f62a7be5000 1 -- start start 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c256e0 0x55cf26e0fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c25ef0 0x55cf26e10530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e10a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6298147bf0 con 0x55cf26c38e20 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6298146ed0 con 0x55cf26c256e0 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6298147520 con 0x55cf26c25ef0 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e10a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e10a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58360/0 (socket says 172.21.15.44:58360) 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 -- 172.21.15.44:0/719509040 learned_addr learned my addr 172.21.15.44:0/719509040 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629d000640 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c25ef0 0x55cf26e10530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629da00640 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c256e0 0x55cf26e0fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 -- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c25ef0 msgr2=0x55cf26e10530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c25ef0 0x55cf26e10530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 -- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c256e0 msgr2=0x55cf26e0fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c256e0 0x55cf26e0fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 -- 172.21.15.44:0/719509040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf26b6edf0 con 0x55cf26c38e20 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f629e400640 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e10a70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6290016650 tx=0x7f629000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9347dc20586ca583 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f6289600640 1 -- 172.21.15.44:0/719509040 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629001c070 con 0x55cf26c38e20 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f6289600640 1 -- 172.21.15.44:0/719509040 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6290018900 con 0x55cf26c38e20 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f6289600640 1 -- 172.21.15.44:0/719509040 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290018d50 con 0x55cf26c38e20 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- 172.21.15.44:0/719509040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 msgr2=0x55cf26e10a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e10a70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6290016650 tx=0x7f629000aea0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- 172.21.15.44:0/719509040 shutdown_connections 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e10a70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c25ef0 0x55cf26e10530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 --2- 172.21.15.44:0/719509040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c256e0 0x55cf26e0fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- 172.21.15.44:0/719509040 >> 172.21.15.44:0/719509040 conn(0x55cf26c5c980 msgr2=0x55cf26d530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- 172.21.15.44:0/719509040 shutdown_connections 2024-09-17T05:39:31.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- 172.21.15.44:0/719509040 wait complete. 2024-09-17T05:39:31.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 -- start start 2024-09-17T05:39:31.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.577+0000 7f62a7be5000 1 Processor -- start 2024-09-17T05:39:31.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c256e0 0x55cf26e14390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26e148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e14e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf26b6dea0 con 0x55cf26c38e20 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cf26bb0680 con 0x55cf26c25ef0 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55cf26ba3e00 con 0x55cf26c256e0 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 10 client.0 _ll_register_callbacks cb 0x7f628c0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e14e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629da00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c256e0 0x55cf26e14390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e14e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58364/0 (socket says 172.21.15.44:58364) 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 -- 172.21.15.44:0/934983955 learned_addr learned my addr 172.21.15.44:0/934983955 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629da00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c256e0 0x55cf26e14390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:57082/0 (socket says 172.21.15.44:57082) 2024-09-17T05:39:31.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629d000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26e148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 -- 172.21.15.44:0/934983955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c256e0 msgr2=0x55cf26e14390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c256e0 0x55cf26e14390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 -- 172.21.15.44:0/934983955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 msgr2=0x55cf26e148d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26e148d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 -- 172.21.15.44:0/934983955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf26b3f290 con 0x55cf26c38e20 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629e400640 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e14e10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6290017010 tx=0x7f6290005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab23f5b2df5f63d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f627ea00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f627ea00640 1 -- 172.21.15.44:0/934983955 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629001c070 con 0x55cf26c38e20 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f627ea00640 1 -- 172.21.15.44:0/934983955 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f6290003980 con 0x55cf26c38e20 2024-09-17T05:39:31.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6290018900 con 0x55cf26c38e20 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f627ea00640 1 -- 172.21.15.44:0/934983955 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6290030050 con 0x55cf26c38e20 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 10 client.6036 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55cf26857150 con 0x55cf26c38e20 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f627ea00640 1 -- 172.21.15.44:0/934983955 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6290018900 con 0x55cf26c38e20 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f627ea00640 1 -- 172.21.15.44:0/934983955 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f6290033020 con 0x55cf26c38e20 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 10 client.6036 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 10 client.6036 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 20 client.6036 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf268318c0 0x55cf26dd0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 4 client.6036 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) -- 0x55cf26baf2b0 con 0x55cf268318c0 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.581+0000 7f629da00640 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf268318c0 0x55cf26dd0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f629da00640 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf268318c0 0x55cf26dd0260 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0023e9406ae949 server_cookie=bc24d95e3de4feff in_seq=0 out_seq=0 2024-09-17T05:39:31.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f627ea00640 10 client.6036 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f627ea00640 1 -- 172.21.15.44:0/934983955 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cf26baf2b0 con 0x55cf268318c0 2024-09-17T05:39:31.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f627ea00640 10 client.6036 handle_command_reply: tid=0 2024-09-17T05:39:31.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 client.6036 shutdown 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 msgr2=0x55cf26e14e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e14e10 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6290017010 tx=0x7f6290005c00 comp rx=0 tx=0).stop 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 shutdown_connections 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x55cf268318c0 0x55cf26dd0260 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf26c38e20 0x55cf26e14e10 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf26c25ef0 0x55cf26e148d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f627ea00640 0 client.6036 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 --2- 172.21.15.44:0/934983955 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cf26c256e0 0x55cf26e14390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 >> 172.21.15.44:0/934983955 conn(0x55cf26c5c980 msgr2=0x55cf26d530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 shutdown_connections 2024-09-17T05:39:31.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 1 -- 172.21.15.44:0/934983955 wait complete. 2024-09-17T05:39:31.588 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f2ab3600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 pv6 ap=4 DIRTYPARENT s=0 n(v0 rc2024-09-17T05:38:58.609486+0000 1=1+0)->n(v0 rc2024-09-17T05:38:58.609486+0000 1=1+0) (ifile lock->xlock w=1) (iquiesce lock w=1) cr={5830=0-4194304@1} caps={5830=pAsLsXs/-@6} | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55f04f618b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:39:31.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a7be5000 20 client.6036 trim_cache size 0 max 16384 2024-09-17T05:39:31.588 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:39:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:39:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "af29dab4-ba90-4ef3-94ad-6dca3410c3be", 2024-09-17T05:39:31.588 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:39:31.589 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:39:31.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6278073200 msgr2=0x7f6278075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6278073200 0x7f6278075710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f628c0af000 tx=0x7f628c0b2040 comp rx=0 tx=0).stop 2024-09-17T05:39:31.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62980ccae0 msgr2=0x7f62981fc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62980ccae0 0x7f62981fc480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f628400c500 tx=0x7f628400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 shutdown_connections 2024-09-17T05:39:31.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6278073200 0x7f6278075710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62981585b0 0x7f62981fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62980ccae0 0x7f62981fc480 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 --2- 172.21.15.44:0/720232932 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6298073760 0x7f629809a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 >> 172.21.15.44:0/720232932 conn(0x7f62980b35f0 msgr2=0x7f629806ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 shutdown_connections 2024-09-17T05:39:31.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.585+0000 7f62a0400640 1 -- 172.21.15.44:0/720232932 wait complete. 2024-09-17T05:39:31.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:39:31.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-17T05:39:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 -- 172.21.15.44:0/2330126034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cf780 msgr2=0x7f3b4415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 --2- 172.21.15.44:0/2330126034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cf780 0x7f3b4415d060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009bc0 tx=0x7f3b3c01ca00 comp rx=0 tx=0).stop 2024-09-17T05:39:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 -- 172.21.15.44:0/2330126034 shutdown_connections 2024-09-17T05:39:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 --2- 172.21.15.44:0/2330126034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cf780 0x7f3b4415d060 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 -- 172.21.15.44:0/2330126034 >> 172.21.15.44:0/2330126034 conn(0x7f3b440b4240 msgr2=0x7f3b440b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 -- 172.21.15.44:0/2330126034 shutdown_connections 2024-09-17T05:39:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 -- 172.21.15.44:0/2330126034 wait complete. 2024-09-17T05:39:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 Processor -- start 2024-09-17T05:39:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.769+0000 7f3b48e00640 1 -- start start 2024-09-17T05:39:31.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b440d18f0 0x7f3b440cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b440d1d00 0x7f3b4415acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cc310 0x7f3b4415b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4416af40 con 0x7f3b440d18f0 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4416adc0 con 0x7f3b440cc310 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4416b0c0 con 0x7f3b440d1d00 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b440d18f0 0x7f3b440cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b440d18f0 0x7f3b440cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58374/0 (socket says 172.21.15.44:58374) 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 -- 172.21.15.44:0/487443638 learned_addr learned my addr 172.21.15.44:0/487443638 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b3be00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b440d1d00 0x7f3b4415acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b42800640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cc310 0x7f3b4415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 -- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b440d1d00 msgr2=0x7f3b4415acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b440d1d00 0x7f3b4415acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 -- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cc310 msgr2=0x7f3b4415b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cc310 0x7f3b4415b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 -- 172.21.15.44:0/487443638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b440cbbd0 con 0x7f3b440d18f0 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b3be00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b440d1d00 0x7f3b4415acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b42800640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cc310 0x7f3b4415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b41e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b440d18f0 0x7f3b440cb690 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3b34001230 tx=0x7f3b3400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b3a000640 1 -- 172.21.15.44:0/487443638 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34016020 con 0x7f3b440d18f0 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b3a000640 1 -- 172.21.15.44:0/487443638 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3400a930 con 0x7f3b440d18f0 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b441f88b0 con 0x7f3b440d18f0 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b3a000640 1 -- 172.21.15.44:0/487443638 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400ad80 con 0x7f3b440d18f0 2024-09-17T05:39:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.773+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b441f8b90 con 0x7f3b440d18f0 2024-09-17T05:39:31.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b3a000640 1 -- 172.21.15.44:0/487443638 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3b34019020 con 0x7f3b440d18f0 2024-09-17T05:39:31.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b3a000640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3b20073230 0x7f3b20075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b3a000640 1 -- 172.21.15.44:0/487443638 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f3b34094720 con 0x7f3b440d18f0 2024-09-17T05:39:31.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 Processor -- start 2024-09-17T05:39:31.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b3be00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3b20073230 0x7f3b20075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 -- start start 2024-09-17T05:39:31.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b3be00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3b20073230 0x7f3b20075740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3b440b1c70 tx=0x7f3b2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e8fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8fe470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56016e79ccd0 con 0x56016e7916d0 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56016e6b2330 con 0x56016e4acaa0 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.777+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56016e70fbb0 con 0x56016e3e8890 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8fd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58380/0 (socket says 172.21.15.44:58380) 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 -- 172.21.15.44:0/2912892223 learned_addr learned my addr 172.21.15.44:0/2912892223 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b42800640 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8fe470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b3be00640 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e8fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 -- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 msgr2=0x56016e8fdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e8fdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 -- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 msgr2=0x56016e8fe470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8fe470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 -- 172.21.15.44:0/2912892223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016e6b3c80 con 0x56016e7916d0 2024-09-17T05:39:31.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b3be00640 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e8fdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:39:31.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b41e00640 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8fd9f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3b3405ec80 tx=0x7f3b3405e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbce676788bae12 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b32a00640 1 -- 172.21.15.44:0/2912892223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340637d0 con 0x56016e7916d0 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b32a00640 1 -- 172.21.15.44:0/2912892223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b34068710 con 0x56016e7916d0 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b32a00640 1 -- 172.21.15.44:0/2912892223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34066d50 con 0x56016e7916d0 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 -- 172.21.15.44:0/2912892223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 msgr2=0x56016e8fd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8fd9f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3b3405ec80 tx=0x7f3b3405e520 comp rx=0 tx=0).stop 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 -- 172.21.15.44:0/2912892223 shutdown_connections 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8fe470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e8fdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 --2- 172.21.15.44:0/2912892223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8fd9f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 -- 172.21.15.44:0/2912892223 >> 172.21.15.44:0/2912892223 conn(0x56016e3bc5c0 msgr2=0x56016e8baae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 -- 172.21.15.44:0/2912892223 shutdown_connections 2024-09-17T05:39:31.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 -- 172.21.15.44:0/2912892223 wait complete. 2024-09-17T05:39:31.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 -- start start 2024-09-17T05:39:31.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.781+0000 7f3b50649000 1 Processor -- start 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e3e8890 0x56016e8b9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e7916d0 0x56016e8c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56016e702df0 con 0x56016e3e8890 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56016e6fefe0 con 0x56016e4acaa0 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56016e6a44d0 con 0x56016e7916d0 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 10 client.0 _ll_register_callbacks cb 0x56016e6827f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e3e8890 0x56016e8b9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e3e8890 0x56016e8b9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58392/0 (socket says 172.21.15.44:58392) 2024-09-17T05:39:31.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 -- 172.21.15.44:0/2460349789 learned_addr learned my addr 172.21.15.44:0/2460349789 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b3be00640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b42800640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e7916d0 0x56016e8c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 -- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e7916d0 msgr2=0x56016e8c05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e7916d0 0x56016e8c05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 -- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 msgr2=0x56016e8b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 -- 172.21.15.44:0/2460349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016e69d210 con 0x56016e3e8890 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b42800640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e7916d0 0x56016e8c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b41e00640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e3e8890 0x56016e8b9a00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b34015040 tx=0x7f3b3405b190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f910580fdbcd763d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b27400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b27400640 1 -- 172.21.15.44:0/2460349789 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340637d0 con 0x56016e3e8890 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56016e697350 con 0x56016e3e8890 2024-09-17T05:39:31.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b27400640 1 -- 172.21.15.44:0/2460349789 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f3b3405df50 con 0x56016e3e8890 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b27400640 1 -- 172.21.15.44:0/2460349789 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3b34068710 con 0x56016e3e8890 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 10 client.6048 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x56016e683fc0 con 0x56016e3e8890 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b27400640 1 -- 172.21.15.44:0/2460349789 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56016e697350 con 0x56016e3e8890 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b27400640 1 -- 172.21.15.44:0/2460349789 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f3b3405a640 con 0x56016e3e8890 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 10 client.6048 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 10 client.6048 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 20 client.6048 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e3a1930 0x56016e904e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 4 client.6048 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56016e711b00 con 0x56016e3a1930 2024-09-17T05:39:31.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b3be00640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e3a1930 0x56016e904e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b3be00640 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e3a1930 0x56016e904e80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf3702fc6c70e3d1 server_cookie=e0dd9041e0e0f039 in_seq=0 out_seq=0 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.785+0000 7f3b27400640 10 client.6048 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b27400640 1 -- 172.21.15.44:0/2460349789 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56016e711b00 con 0x56016e3a1930 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b27400640 10 client.6048 handle_command_reply: tid=0 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 client.6048 shutdown 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e3e8890 msgr2=0x56016e8b9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e3e8890 0x56016e8b9a00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b34015040 tx=0x7f3b3405b190 comp rx=0 tx=0).stop 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 shutdown_connections 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e3a1930 0x56016e904e80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e7916d0 0x56016e8c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e8b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b27400640 0 client.6048 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 --2- 172.21.15.44:0/2460349789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e3e8890 0x56016e8b9a00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 >> 172.21.15.44:0/2460349789 conn(0x56016e3bc5c0 msgr2=0x56016e8b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 shutdown_connections 2024-09-17T05:39:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 1 -- 172.21.15.44:0/2460349789 wait complete. 2024-09-17T05:39:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.789+0000 7f3b50649000 20 client.6048 trim_cache size 0 max 16384 2024-09-17T05:39:31.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.805+0000 7f3b50649000 1 Processor -- start 2024-09-17T05:39:31.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.805+0000 7f3b50649000 1 -- start start 2024-09-17T05:39:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e96ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e96f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e96f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56016e8b8b20 con 0x56016e7916d0 2024-09-17T05:39:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44205d40 con 0x56016e4acaa0 2024-09-17T05:39:31.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3b44204d60 con 0x56016e3e8890 2024-09-17T05:39:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e96f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e96f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58404/0 (socket says 172.21.15.44:58404) 2024-09-17T05:39:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 -- 172.21.15.44:0/3641589364 learned_addr learned my addr 172.21.15.44:0/3641589364 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b3be00640 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e96f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 -- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 msgr2=0x56016e96ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e96ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 -- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 msgr2=0x56016e96f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e96f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 -- 172.21.15.44:0/3641589364 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016e75c680 con 0x56016e7916d0 2024-09-17T05:39:31.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b3be00640 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e96f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:39:31.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b42800640 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e96f860 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c005cd0 tx=0x7f3b3c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea86460480e3cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b32000640 1 -- 172.21.15.44:0/3641589364 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0bd070 con 0x56016e7916d0 2024-09-17T05:39:31.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b32000640 1 -- 172.21.15.44:0/3641589364 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c0b3040 con 0x56016e7916d0 2024-09-17T05:39:31.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b32000640 1 -- 172.21.15.44:0/3641589364 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0b2040 con 0x56016e7916d0 2024-09-17T05:39:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- 172.21.15.44:0/3641589364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 msgr2=0x56016e96f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e96f860 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c005cd0 tx=0x7f3b3c0197a0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- 172.21.15.44:0/3641589364 shutdown_connections 2024-09-17T05:39:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e96f860 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e4acaa0 0x56016e96f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 --2- 172.21.15.44:0/3641589364 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e3e8890 0x56016e96ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- 172.21.15.44:0/3641589364 >> 172.21.15.44:0/3641589364 conn(0x56016e3bc5c0 msgr2=0x56016e8b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- 172.21.15.44:0/3641589364 shutdown_connections 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- 172.21.15.44:0/3641589364 wait complete. 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.809+0000 7f3b50649000 1 -- start start 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 Processor -- start 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e3e8890 0x56016e96f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e4acaa0 0x56016e8b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44204690 con 0x56016e7916d0 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44204120 con 0x56016e3e8890 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56016e3c4680 con 0x56016e4acaa0 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 10 client.0 _ll_register_callbacks cb 0x7f3b34083070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:39:31.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b3be00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e4acaa0 0x56016e8b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58414/0 (socket says 172.21.15.44:58414) 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 -- 172.21.15.44:0/3430693138 learned_addr learned my addr 172.21.15.44:0/3430693138 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b41e00640 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e3e8890 0x56016e96f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 -- 172.21.15.44:0/3430693138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e4acaa0 msgr2=0x56016e8b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e4acaa0 0x56016e8b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 -- 172.21.15.44:0/3430693138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e3e8890 msgr2=0x56016e96f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e3e8890 0x56016e96f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 -- 172.21.15.44:0/3430693138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016e6c90b0 con 0x56016e7916d0 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b42800640 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8b5e00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c01b0b0 tx=0x7f3b3c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1333c4cf8aad67d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b27400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:39:31.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b27400640 1 -- 172.21.15.44:0/3430693138 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0bd040 con 0x56016e7916d0 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b27400640 1 -- 172.21.15.44:0/3430693138 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f3b3c003cc0 con 0x56016e7916d0 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c0b3040 con 0x56016e7916d0 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b27400640 1 -- 172.21.15.44:0/3430693138 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c0ce050 con 0x56016e7916d0 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 10 client.6054 fetch_fsmap learned FSMap version 36 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x56016e695610 con 0x56016e7916d0 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b27400640 1 -- 172.21.15.44:0/3430693138 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c0b3040 con 0x56016e7916d0 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b27400640 1 -- 172.21.15.44:0/3430693138 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7f3b3c0d1020 con 0x56016e7916d0 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 10 client.6054 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 10 client.6054 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 20 client.6054 populate_metadata read hostname 'smithi044' 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e38f990 0x56016e92f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 4 client.6054 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:39:31.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56016e70d5b0 con 0x56016e38f990 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.813+0000 7f3b41e00640 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e38f990 0x56016e92f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b41e00640 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e38f990 0x56016e92f400 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20d10989744e818f server_cookie=2568d8cf77418427 in_seq=0 out_seq=0 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b27400640 10 client.6054 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b27400640 1 -- 172.21.15.44:0/3430693138 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+861 (crc 0 0 0) 0x56016e70d5b0 con 0x56016e38f990 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b27400640 10 client.6054 handle_command_reply: tid=0 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 client.6054 shutdown 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 msgr2=0x56016e8b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8b5e00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c01b0b0 tx=0x7f3b3c0098e0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 shutdown_connections 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56016e38f990 0x56016e92f400 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56016e7916d0 0x56016e8b5e00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56016e4acaa0 0x56016e8b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b27400640 0 client.6054 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 --2- 172.21.15.44:0/3430693138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56016e3e8890 0x56016e96f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 >> 172.21.15.44:0/3430693138 conn(0x56016e3bc5c0 msgr2=0x56016e90eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 shutdown_connections 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 1 -- 172.21.15.44:0/3430693138 wait complete. 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b50649000 20 client.6054 trim_cache size 0 max 16384 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:39:31.823 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: "af29dab4-ba90-4ef3-94ad-6dca3410c3be": { 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "af29dab4-ba90-4ef3-94ad-6dca3410c3be", 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive,repair,force" 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:39:31.824 INFO:teuthology.orchestra.run.smithi044.stdout: "af29dab4-ba90-4ef3-94ad-6dca3410c3be": { 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:39:31.585215+0000", 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "afa33feb-13fd-43c4-a02e-29e6b06789b6": { 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:38:59.841476+0000", 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:39:31.825 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:39:31.826 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:39:31.826 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:31.826 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:39:31.826 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3b20073230 msgr2=0x7f3b20075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3b20073230 0x7f3b20075740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3b440b1c70 tx=0x7f3b2c009040 comp rx=0 tx=0).stop 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b440d18f0 msgr2=0x7f3b440cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b440d18f0 0x7f3b440cb690 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3b34001230 tx=0x7f3b3400cb70 comp rx=0 tx=0).stop 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 shutdown_connections 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3b20073230 0x7f3b20075740 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b440cc310 0x7f3b4415b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3b440d1d00 0x7f3b4415acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 --2- 172.21.15.44:0/487443638 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3b440d18f0 0x7f3b440cb690 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:39:31.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 >> 172.21.15.44:0/487443638 conn(0x7f3b440b4240 msgr2=0x7f3b4415c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:39:31.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 shutdown_connections 2024-09-17T05:39:31.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:39:31.817+0000 7f3b48e00640 1 -- 172.21.15.44:0/487443638 wait complete. 2024-09-17T05:39:31.838 INFO:tasks.cephfs.filesystem:scrub status for tag:af29dab4-ba90-4ef3-94ad-6dca3410c3be - {'path': '/', 'tag': 'af29dab4-ba90-4ef3-94ad-6dca3410c3be', 'options': 'recursive,repair,force'} 2024-09-17T05:39:42.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:39:42.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:01.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:01.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-17T05:40:02.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.012+0000 7f3c22000640 1 -- 172.21.15.44:0/3837756573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c00003a60 msgr2=0x7f3c00003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.012+0000 7f3c22000640 1 --2- 172.21.15.44:0/3837756573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c00003a60 0x7f3c00003ed0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c310 tx=0x7f3c0c01cf20 comp rx=0 tx=0).stop 2024-09-17T05:40:02.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.012+0000 7f3c22000640 1 -- 172.21.15.44:0/3837756573 shutdown_connections 2024-09-17T05:40:02.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.012+0000 7f3c22000640 1 --2- 172.21.15.44:0/3837756573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c00003a60 0x7f3c00003ed0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.012+0000 7f3c22000640 1 -- 172.21.15.44:0/3837756573 >> 172.21.15.44:0/3837756573 conn(0x7f3c1c0ccaa0 msgr2=0x7f3c1c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.012+0000 7f3c22000640 1 -- 172.21.15.44:0/3837756573 shutdown_connections 2024-09-17T05:40:02.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.012+0000 7f3c22000640 1 -- 172.21.15.44:0/3837756573 wait complete. 2024-09-17T05:40:02.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 Processor -- start 2024-09-17T05:40:02.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 -- start start 2024-09-17T05:40:02.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c00003a60 0x7f3c1c1fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c1c09d510 0x7f3c1c1fcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c1c1eb580 0x7f3c1c1eb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c0cc0f0 con 0x7f3c1c1eb580 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c0cbf70 con 0x7f3c00003a60 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c22000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c0cc270 con 0x7f3c1c09d510 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c1c1eb580 0x7f3c1c1eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c1c1eb580 0x7f3c1c1eb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60054/0 (socket says 172.21.15.44:60054) 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 -- 172.21.15.44:0/3250628228 learned_addr learned my addr 172.21.15.44:0/3250628228 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1b400640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c00003a60 0x7f3c1c1fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c13e00640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c1c09d510 0x7f3c1c1fcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 -- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c1c09d510 msgr2=0x7f3c1c1fcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c1c09d510 0x7f3c1c1fcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 -- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c00003a60 msgr2=0x7f3c1c1fc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c00003a60 0x7f3c1c1fc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.016+0000 7f3c1be00640 1 -- 172.21.15.44:0/3250628228 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1c1ebed0 con 0x7f3c1c1eb580 2024-09-17T05:40:02.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c1be00640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c1c1eb580 0x7f3c1c1eb990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0c38f0 tx=0x7f3c1400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c13400640 1 -- 172.21.15.44:0/3250628228 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14004b30 con 0x7f3c1c1eb580 2024-09-17T05:40:02.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c13400640 1 -- 172.21.15.44:0/3250628228 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c14004cd0 con 0x7f3c1c1eb580 2024-09-17T05:40:02.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c13400640 1 -- 172.21.15.44:0/3250628228 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14003be0 con 0x7f3c1c1eb580 2024-09-17T05:40:02.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c1fd350 con 0x7f3c1c1eb580 2024-09-17T05:40:02.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c1fd910 con 0x7f3c1c1eb580 2024-09-17T05:40:02.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c13400640 1 -- 172.21.15.44:0/3250628228 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3c14004030 con 0x7f3c1c1eb580 2024-09-17T05:40:02.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.020+0000 7f3c13400640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bf8073230 0x7f3bf8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c13400640 1 -- 172.21.15.44:0/3250628228 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f3c14094d80 con 0x7f3c1c1eb580 2024-09-17T05:40:02.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bf8073230 0x7f3bf8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 Processor -- start 2024-09-17T05:40:02.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 -- start start 2024-09-17T05:40:02.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bf8073230 0x7f3bf8075740 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0ac000 tx=0x7f3c0c019d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa68f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa69470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5617da907cd0 con 0x5617da8fc6d0 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5617da81d330 con 0x5617da617aa0 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5617da87abb0 con 0x5617da553890 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60064/0 (socket says 172.21.15.44:60064) 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 -- 172.21.15.44:0/2512365069 learned_addr learned my addr 172.21.15.44:0/2512365069 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1be00640 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa69470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c13e00640 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa68f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 -- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 msgr2=0x5617daa68f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa68f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 -- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 msgr2=0x5617daa69470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa69470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 -- 172.21.15.44:0/2512365069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617da81ec80 con 0x5617da8fc6d0 2024-09-17T05:40:02.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c1b400640 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa689f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c01b7f0 tx=0x7f3c0c0b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517c9f8953aad46e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c0b400640 1 -- 172.21.15.44:0/2512365069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c006500 con 0x5617da8fc6d0 2024-09-17T05:40:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c0b400640 1 -- 172.21.15.44:0/2512365069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c0c004ae0 con 0x5617da8fc6d0 2024-09-17T05:40:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.024+0000 7f3c0b400640 1 -- 172.21.15.44:0/2512365069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c0bb480 con 0x5617da8fc6d0 2024-09-17T05:40:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- 172.21.15.44:0/2512365069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 msgr2=0x5617daa689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa689f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c01b7f0 tx=0x7f3c0c0b6000 comp rx=0 tx=0).stop 2024-09-17T05:40:02.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- 172.21.15.44:0/2512365069 shutdown_connections 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa69470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa68f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 --2- 172.21.15.44:0/2512365069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa689f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- 172.21.15.44:0/2512365069 >> 172.21.15.44:0/2512365069 conn(0x5617da5275c0 msgr2=0x5617daa25ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- 172.21.15.44:0/2512365069 shutdown_connections 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- 172.21.15.44:0/2512365069 wait complete. 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- start start 2024-09-17T05:40:02.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 Processor -- start 2024-09-17T05:40:02.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa24a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa24f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa2b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5617da86ddf0 con 0x5617da8fc6d0 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5617da869fe0 con 0x5617da617aa0 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5617da80f4d0 con 0x5617da553890 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c29800000 10 client.0 _ll_register_callbacks cb 0x5617da7ed7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa2b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa2b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60066/0 (socket says 172.21.15.44:60066) 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c1be00640 1 -- 172.21.15.44:0/309354976 learned_addr learned my addr 172.21.15.44:0/309354976 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c1b400640 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa24a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.028+0000 7f3c13e00640 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa24f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1be00640 1 -- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 msgr2=0x5617daa24a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1be00640 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa24a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1be00640 1 -- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 msgr2=0x5617daa24f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1be00640 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa24f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1be00640 1 -- 172.21.15.44:0/309354976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617da808210 con 0x5617da8fc6d0 2024-09-17T05:40:02.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1be00640 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa2b5f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3c1405f0d0 tx=0x7f3c14003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c660a144ca780746 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 1 -- 172.21.15.44:0/309354976 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1401e050 con 0x5617da8fc6d0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 1 -- 172.21.15.44:0/309354976 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f3c1405ad20 con 0x5617da8fc6d0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617da802350 con 0x5617da8fc6d0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 1 -- 172.21.15.44:0/309354976 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3c14068df0 con 0x5617da8fc6d0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 10 client.6066 fetch_fsmap learned FSMap version 37 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x5617da7eefc0 con 0x5617da8fc6d0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 1 -- 172.21.15.44:0/309354976 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5617da802350 con 0x5617da8fc6d0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 1 -- 172.21.15.44:0/309354976 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f3c14018070 con 0x5617da8fc6d0 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 10 client.6066 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 10 client.6066 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:40:02.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 20 client.6066 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da50c930 0x5617daa6fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 4 client.6066 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617da87cb00 con 0x5617da50c930 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1b400640 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da50c930 0x5617daa6fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c1b400640 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da50c930 0x5617daa6fe80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75d3e6cd7e5da11 server_cookie=30dbafc20a71c97e in_seq=0 out_seq=0 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 10 client.6066 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 1 -- 172.21.15.44:0/309354976 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617da87cb00 con 0x5617da50c930 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 10 client.6066 handle_command_reply: tid=0 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 client.6066 shutdown 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 msgr2=0x5617daa2b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa2b5f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3c1405f0d0 tx=0x7f3c14003f90 comp rx=0 tx=0).stop 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 shutdown_connections 2024-09-17T05:40:02.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da50c930 0x5617daa6fe80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da8fc6d0 0x5617daa2b5f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da617aa0 0x5617daa24f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3bffe00640 0 client.6066 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 --2- 172.21.15.44:0/309354976 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da553890 0x5617daa24a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 >> 172.21.15.44:0/309354976 conn(0x5617da5275c0 msgr2=0x5617daa1dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 shutdown_connections 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 1 -- 172.21.15.44:0/309354976 wait complete. 2024-09-17T05:40:02.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.032+0000 7f3c29800000 20 client.6066 trim_cache size 0 max 16384 2024-09-17T05:40:02.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 Processor -- start 2024-09-17T05:40:02.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 -- start start 2024-09-17T05:40:02.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa2af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa2b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa1e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5617daa23b20 con 0x5617da617aa0 2024-09-17T05:40:02.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c2068e0 con 0x5617da553890 2024-09-17T05:40:02.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1c2058c0 con 0x5617da8fc6d0 2024-09-17T05:40:02.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa2b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa2b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60078/0 (socket says 172.21.15.44:60078) 2024-09-17T05:40:02.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.052+0000 7f3c13e00640 1 -- 172.21.15.44:0/1577632251 learned_addr learned my addr 172.21.15.44:0/1577632251 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c1be00640 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa1e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c1b400640 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa2af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c13e00640 1 -- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 msgr2=0x5617daa1e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c13e00640 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa1e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c13e00640 1 -- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 msgr2=0x5617daa2af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c13e00640 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa2af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c13e00640 1 -- 172.21.15.44:0/1577632251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617da8c7680 con 0x5617da617aa0 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c13e00640 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa2b4a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3c04003900 tx=0x7f3c04006b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda88a17f165f8da server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c0aa00640 1 -- 172.21.15.44:0/1577632251 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04023070 con 0x5617da617aa0 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c0aa00640 1 -- 172.21.15.44:0/1577632251 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c04012ba0 con 0x5617da617aa0 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c0aa00640 1 -- 172.21.15.44:0/1577632251 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04011440 con 0x5617da617aa0 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 -- 172.21.15.44:0/1577632251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 msgr2=0x5617daa2b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa2b4a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3c04003900 tx=0x7f3c04006b80 comp rx=0 tx=0).stop 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 -- 172.21.15.44:0/1577632251 shutdown_connections 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa1e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa2b4a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 --2- 172.21.15.44:0/1577632251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa2af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 -- 172.21.15.44:0/1577632251 >> 172.21.15.44:0/1577632251 conn(0x5617da5275c0 msgr2=0x5617daa79c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 -- 172.21.15.44:0/1577632251 shutdown_connections 2024-09-17T05:40:02.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 -- 172.21.15.44:0/1577632251 wait complete. 2024-09-17T05:40:02.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 -- start start 2024-09-17T05:40:02.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.056+0000 7f3c29800000 1 Processor -- start 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa20e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa9a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c2051f0 con 0x5617da617aa0 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c09ce90 con 0x5617da553890 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5617da52f680 con 0x5617da8fc6d0 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 10 client.0 _ll_register_callbacks cb 0x7f3c1405ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:02.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa20e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa20e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60082/0 (socket says 172.21.15.44:60082) 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 -- 172.21.15.44:0/1481633943 learned_addr learned my addr 172.21.15.44:0/1481633943 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c1b400640 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c1be00640 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa9a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 -- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 msgr2=0x5617daa9a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa9a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 -- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 msgr2=0x5617daa208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 -- 172.21.15.44:0/1481633943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617da8340b0 con 0x5617da617aa0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c13e00640 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa20e00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x5617da80c010 tx=0x7f3c0401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc039e58f316c2e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 1 -- 172.21.15.44:0/1481633943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04023040 con 0x5617da617aa0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 1 -- 172.21.15.44:0/1481633943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f3c0401ed00 con 0x5617da617aa0 2024-09-17T05:40:02.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c04012ba0 con 0x5617da617aa0 2024-09-17T05:40:02.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 1 -- 172.21.15.44:0/1481633943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3c04034050 con 0x5617da617aa0 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 10 client.6072 fetch_fsmap learned FSMap version 37 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x5617da800610 con 0x5617da617aa0 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 1 -- 172.21.15.44:0/1481633943 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c04012ba0 con 0x5617da617aa0 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 1 -- 172.21.15.44:0/1481633943 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f3c04037020 con 0x5617da617aa0 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 10 client.6072 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 10 client.6072 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 20 client.6072 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da4fa990 0x5617daa9a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 4 client.6072 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617da8785b0 con 0x5617da4fa990 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c1b400640 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da4fa990 0x5617daa9a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c1b400640 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da4fa990 0x5617daa9a940 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c2c61c2badc1e74 server_cookie=ed9ee0257ca3c137 in_seq=0 out_seq=0 2024-09-17T05:40:02.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 10 client.6072 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 1 -- 172.21.15.44:0/1481633943 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5617da8785b0 con 0x5617da4fa990 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 10 client.6072 handle_command_reply: tid=0 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 client.6072 shutdown 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 msgr2=0x5617daa20e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa20e00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x5617da80c010 tx=0x7f3c0401eb10 comp rx=0 tx=0).stop 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 shutdown_connections 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x5617da4fa990 0x5617daa9a940 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617da8fc6d0 0x5617daa9a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617da617aa0 0x5617daa20e00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 --2- 172.21.15.44:0/1481633943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617da553890 0x5617daa208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3bffe00640 0 client.6072 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 >> 172.21.15.44:0/1481633943 conn(0x5617da5275c0 msgr2=0x5617daa2af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 shutdown_connections 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 1 -- 172.21.15.44:0/1481633943 wait complete. 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.060+0000 7f3c29800000 20 client.6072 trim_cache size 0 max 16384 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "af29dab4-ba90-4ef3-94ad-6dca3410c3be": { 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:39:31.585215+0000", 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:40:02.067 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "afa33feb-13fd-43c4-a02e-29e6b06789b6": { 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:38:59.841476+0000", 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:02.068 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:02.069 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:40:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bf8073230 msgr2=0x7f3bf8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bf8073230 0x7f3bf8075740 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0ac000 tx=0x7f3c0c019d60 comp rx=0 tx=0).stop 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c1c1eb580 msgr2=0x7f3c1c1eb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c1c1eb580 0x7f3c1c1eb990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0c38f0 tx=0x7f3c1400f3c0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 shutdown_connections 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3c1c1eb580 0x7f3c1c1eb990 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3c1c09d510 0x7f3c1c1fcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3bf8073230 0x7f3bf8075740 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 --2- 172.21.15.44:0/3250628228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c00003a60 0x7f3c1c1fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 >> 172.21.15.44:0/3250628228 conn(0x7f3c1c0ccaa0 msgr2=0x7f3c1c0a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 shutdown_connections 2024-09-17T05:40:02.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.064+0000 7f3c22000640 1 -- 172.21.15.44:0/3250628228 wait complete. 2024-09-17T05:40:02.083 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:40:02.084 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.240+0000 7f4d23200640 1 -- 172.21.15.44:0/1658788240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d2406f670 msgr2=0x7f4d240cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.240+0000 7f4d23200640 1 --2- 172.21.15.44:0/1658788240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d2406f670 0x7f4d240cea80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009870 tx=0x7f4d0c01c7a0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.240+0000 7f4d23200640 1 -- 172.21.15.44:0/1658788240 shutdown_connections 2024-09-17T05:40:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.240+0000 7f4d23200640 1 --2- 172.21.15.44:0/1658788240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d2406f670 0x7f4d240cea80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.240+0000 7f4d23200640 1 -- 172.21.15.44:0/1658788240 >> 172.21.15.44:0/1658788240 conn(0x7f4d24073ce0 msgr2=0x7f4d240740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 -- 172.21.15.44:0/1658788240 shutdown_connections 2024-09-17T05:40:02.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 -- 172.21.15.44:0/1658788240 wait complete. 2024-09-17T05:40:02.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 Processor -- start 2024-09-17T05:40:02.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 -- start start 2024-09-17T05:40:02.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d24070290 0x7f4d241fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d2415e6d0 0x7f4d24140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d241544c0 0x7f4d241548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2406cfc0 con 0x7f4d2415e6d0 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2406ce40 con 0x7f4d241544c0 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d23200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2406d140 con 0x7f4d24070290 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.244+0000 7f4d1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d2415e6d0 0x7f4d24140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d2415e6d0 0x7f4d24140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60090/0 (socket says 172.21.15.44:60090) 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 -- 172.21.15.44:0/2586541562 learned_addr learned my addr 172.21.15.44:0/2586541562 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d22800640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d241544c0 0x7f4d241548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d21e00640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d24070290 0x7f4d241fbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 -- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d24070290 msgr2=0x7f4d241fbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d24070290 0x7f4d241fbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 -- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d241544c0 msgr2=0x7f4d241548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d241544c0 0x7f4d241548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 -- 172.21.15.44:0/2586541562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d241fc160 con 0x7f4d2415e6d0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1be00640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d2415e6d0 0x7f4d24140250 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c01a3d0 tx=0x7f4d0c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1a000640 1 -- 172.21.15.44:0/2586541562 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0b2040 con 0x7f4d2415e6d0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1a000640 1 -- 172.21.15.44:0/2586541562 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d0c0042f0 con 0x7f4d2415e6d0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d24154e10 con 0x7f4d2415e6d0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1a000640 1 -- 172.21.15.44:0/2586541562 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0052d0 con 0x7f4d2415e6d0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d240c6500 con 0x7f4d2415e6d0 2024-09-17T05:40:02.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d240c5f90 con 0x7f4d2415e6d0 2024-09-17T05:40:02.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.248+0000 7f4d1a000640 1 -- 172.21.15.44:0/2586541562 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4d0c005470 con 0x7f4d2415e6d0 2024-09-17T05:40:02.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.252+0000 7f4d1a000640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d00073230 0x7f4d00075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.252+0000 7f4d1a000640 1 -- 172.21.15.44:0/2586541562 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f4d0c12e130 con 0x7f4d2415e6d0 2024-09-17T05:40:02.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.252+0000 7f4d21e00640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d00073230 0x7f4d00075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.252+0000 7f4d21e00640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d00073230 0x7f4d00075740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d14001870 tx=0x7f4d14001380 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.256+0000 7f4d1a000640 1 -- 172.21.15.44:0/2586541562 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4d24154e10 con 0x7f4d2415e6d0 2024-09-17T05:40:02.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.464+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d240cea80 con 0x7f4d2415e6d0 2024-09-17T05:40:02.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.464+0000 7f4d1a000640 1 -- 172.21.15.44:0/2586541562 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5222 (secure 0 0 0) 0x7f4d241fc160 con 0x7f4d2415e6d0 2024-09-17T05:40:02.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:02.467 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"btime":"2024-09-17T05:39:34:765539+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:39:34.610591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":15,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:40:02.468 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d00073230 msgr2=0x7f4d00075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d00073230 0x7f4d00075740 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4d14001870 tx=0x7f4d14001380 comp rx=0 tx=0).stop 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d2415e6d0 msgr2=0x7f4d24140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d2415e6d0 0x7f4d24140250 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c01a3d0 tx=0x7f4d0c005db0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 shutdown_connections 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4d00073230 0x7f4d00075740 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d241544c0 0x7f4d241548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4d2415e6d0 0x7f4d24140250 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 --2- 172.21.15.44:0/2586541562 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4d24070290 0x7f4d241fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 >> 172.21.15.44:0/2586541562 conn(0x7f4d24073ce0 msgr2=0x7f4d2415d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 shutdown_connections 2024-09-17T05:40:02.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.468+0000 7f4d23200640 1 -- 172.21.15.44:0/2586541562 wait complete. 2024-09-17T05:40:02.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-09-17T05:40:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 -- 172.21.15.44:0/3045100797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 msgr2=0x7f8a6c0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 --2- 172.21.15.44:0/3045100797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0b1be0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009840 tx=0x7f8a5c01c760 comp rx=0 tx=0).stop 2024-09-17T05:40:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 -- 172.21.15.44:0/3045100797 shutdown_connections 2024-09-17T05:40:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 --2- 172.21.15.44:0/3045100797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6c0d1d00 0x7f8a6c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 --2- 172.21.15.44:0/3045100797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0b1be0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 -- 172.21.15.44:0/3045100797 >> 172.21.15.44:0/3045100797 conn(0x7f8a6c0b4240 msgr2=0x7f8a6c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 -- 172.21.15.44:0/3045100797 shutdown_connections 2024-09-17T05:40:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.648+0000 7f8a72600640 1 -- 172.21.15.44:0/3045100797 wait complete. 2024-09-17T05:40:02.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 Processor -- start 2024-09-17T05:40:02.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 -- start start 2024-09-17T05:40:02.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6c0cf5b0 0x7f8a6c166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a6c0d1d00 0x7f8a6c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c169ee0 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c169d60 con 0x7f8a6c0d1d00 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a72600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c16a060 con 0x7f8a6c0cf5b0 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60106/0 (socket says 172.21.15.44:60106) 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3744894339 learned_addr learned my addr 172.21.15.44:0/3744894339 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6b400640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6c0cf5b0 0x7f8a6c166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6be00640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a6c0d1d00 0x7f8a6c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6c0cf5b0 msgr2=0x7f8a6c166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6c0cf5b0 0x7f8a6c166cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a6c0d1d00 msgr2=0x7f8a6c1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a6c0d1d00 0x7f8a6c1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3744894339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c06e1a0 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6be00640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a6c0d1d00 0x7f8a6c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.652+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0cc150 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800d720 tx=0x7f8a5800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a63400640 1 -- 172.21.15.44:0/3744894339 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58017070 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a63400640 1 -- 172.21.15.44:0/3744894339 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a58005310 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6c06f240 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a63400640 1 -- 172.21.15.44:0/3744894339 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58009820 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6c06e760 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a63400640 1 -- 172.21.15.44:0/3744894339 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8a580099c0 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a63400640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a4c073230 0x7f8a4c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a63400640 1 -- 172.21.15.44:0/3744894339 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f8a580945c0 con 0x7f8a6c0d18f0 2024-09-17T05:40:02.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.656+0000 7f8a6b400640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a4c073230 0x7f8a4c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 Processor -- start 2024-09-17T05:40:02.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- start start 2024-09-17T05:40:02.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6b400640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a4c073230 0x7f8a4c075740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0af000 tx=0x7f8a5c01afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c6112e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4c11c0 0x56028c611820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c611d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56028c4afd00 con 0x56028c4aad90 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56028c423c90 con 0x56028c4c11c0 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56028c4130c0 con 0x56028c4cbb60 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c611d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c611d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60120/0 (socket says 172.21.15.44:60120) 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 -- 172.21.15.44:0/1060194649 learned_addr learned my addr 172.21.15.44:0/1060194649 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6b400640 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c6112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4c11c0 0x56028c611820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 -- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 msgr2=0x56028c6112e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c6112e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 -- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4c11c0 msgr2=0x56028c611820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4c11c0 0x56028c611820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 -- 172.21.15.44:0/1060194649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028c3ee290 con 0x56028c4aad90 2024-09-17T05:40:02.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a6be00640 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c611d60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8a64002040 tx=0x7f8a64002130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff55c2f2b424f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a57e00640 1 -- 172.21.15.44:0/1060194649 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400ea70 con 0x56028c4aad90 2024-09-17T05:40:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a57e00640 1 -- 172.21.15.44:0/1060194649 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a64019070 con 0x56028c4aad90 2024-09-17T05:40:02.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a57e00640 1 -- 172.21.15.44:0/1060194649 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64014480 con 0x56028c4aad90 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- 172.21.15.44:0/1060194649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 msgr2=0x56028c611d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c611d60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8a64002040 tx=0x7f8a64002130 comp rx=0 tx=0).stop 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- 172.21.15.44:0/1060194649 shutdown_connections 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c611d60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4c11c0 0x56028c611820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/1060194649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c6112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- 172.21.15.44:0/1060194649 >> 172.21.15.44:0/1060194649 conn(0x56028c0d0760 msgr2=0x56028c5f4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- 172.21.15.44:0/1060194649 shutdown_connections 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.660+0000 7f8a79bc3000 1 -- 172.21.15.44:0/1060194649 wait complete. 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 -- start start 2024-09-17T05:40:02.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 Processor -- start 2024-09-17T05:40:02.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c5cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c5cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c5f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56028c3ad940 con 0x56028c4c11c0 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56028c416ed0 con 0x56028c4aad90 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56028c0d8820 con 0x56028c4cbb60 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 10 client.0 _ll_register_callbacks cb 0x56028c3f17f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c5cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c5cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60126/0 (socket says 172.21.15.44:60126) 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 -- 172.21.15.44:0/2271732557 learned_addr learned my addr 172.21.15.44:0/2271732557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6b400640 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c5cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6be00640 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c5f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 -- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 msgr2=0x56028c5f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c5f38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 -- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 msgr2=0x56028c5cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c5cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 -- 172.21.15.44:0/2271732557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028c3c6550 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c5cd610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8a58092820 tx=0x7f8a5805b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74d67929863b7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a54c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a54c00640 1 -- 172.21.15.44:0/2271732557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58020040 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a54c00640 1 -- 172.21.15.44:0/2271732557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f8a5804c170 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56028c3ab400 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a54c00640 1 -- 172.21.15.44:0/2271732557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8a580636f0 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.664+0000 7f8a79bc3000 10 client.6093 fetch_fsmap learned FSMap version 37 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x56028c3b1480 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a54c00640 1 -- 172.21.15.44:0/2271732557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56028c3ab400 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a54c00640 1 -- 172.21.15.44:0/2271732557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f8a58084210 con 0x56028c4c11c0 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 10 client.6093 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 10 client.6093 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 20 client.6093 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:02.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0b5ad0 0x56028c6228a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 4 client.6093 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:40:02.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56028c425be0 con 0x56028c0b5ad0 2024-09-17T05:40:02.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a6b400640 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0b5ad0 0x56028c6228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a6b400640 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0b5ad0 0x56028c6228a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab19233ed24fe842 server_cookie=bc920a93bda39966 in_seq=0 out_seq=0 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a54c00640 10 client.6093 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a54c00640 1 -- 172.21.15.44:0/2271732557 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56028c425be0 con 0x56028c0b5ad0 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a54c00640 10 client.6093 handle_command_reply: tid=0 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 client.6093 shutdown 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 msgr2=0x56028c5cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c5cd610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8a58092820 tx=0x7f8a5805b1b0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 shutdown_connections 2024-09-17T05:40:02.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0b5ad0 0x56028c6228a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c5f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c5cd610 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2271732557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c5cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a54c00640 0 client.6093 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 >> 172.21.15.44:0/2271732557 conn(0x56028c0d0760 msgr2=0x56028c5c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 shutdown_connections 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2271732557 wait complete. 2024-09-17T05:40:02.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.668+0000 7f8a79bc3000 20 client.6093 trim_cache size 0 max 16384 2024-09-17T05:40:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 Processor -- start 2024-09-17T05:40:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 -- start start 2024-09-17T05:40:02.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c5c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4c11c0 0x56028c5c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4cbb60 0x56028c6228a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56028c4d2fc0 con 0x56028c4aad90 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56028c3be300 con 0x56028c4cbb60 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56028c422a60 con 0x56028c4c11c0 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c5c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c5c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60128/0 (socket says 172.21.15.44:60128) 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 -- 172.21.15.44:0/2494776954 learned_addr learned my addr 172.21.15.44:0/2494776954 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6be00640 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4cbb60 0x56028c6228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4c11c0 0x56028c5c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 -- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4c11c0 msgr2=0x56028c5c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4c11c0 0x56028c5c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 -- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4cbb60 msgr2=0x56028c6228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4cbb60 0x56028c6228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 -- 172.21.15.44:0/2494776954 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028c498d10 con 0x56028c4aad90 2024-09-17T05:40:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a6b400640 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c5c86a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009840 tx=0x7f8a5c0b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad1de7d65864f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a57400640 1 -- 172.21.15.44:0/2494776954 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0b2040 con 0x56028c4aad90 2024-09-17T05:40:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a57400640 1 -- 172.21.15.44:0/2494776954 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a5c0bf040 con 0x56028c4aad90 2024-09-17T05:40:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.684+0000 7f8a57400640 1 -- 172.21.15.44:0/2494776954 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0a5b10 con 0x56028c4aad90 2024-09-17T05:40:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2494776954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 msgr2=0x56028c5c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c5c86a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009840 tx=0x7f8a5c0b5000 comp rx=0 tx=0).stop 2024-09-17T05:40:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2494776954 shutdown_connections 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4cbb60 0x56028c6228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4c11c0 0x56028c5c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/2494776954 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4aad90 0x56028c5c86a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2494776954 >> 172.21.15.44:0/2494776954 conn(0x56028c0d0760 msgr2=0x56028c5cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2494776954 shutdown_connections 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- 172.21.15.44:0/2494776954 wait complete. 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- start start 2024-09-17T05:40:02.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 Processor -- start 2024-09-17T05:40:02.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c6258a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c625de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c642dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56028c3df300 con 0x56028c4c11c0 2024-09-17T05:40:02.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56028c3d0670 con 0x56028c4aad90 2024-09-17T05:40:02.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56028c4161e0 con 0x56028c4cbb60 2024-09-17T05:40:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a79bc3000 10 client.0 _ll_register_callbacks cb 0x7f8a58005d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c625de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c625de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60138/0 (socket says 172.21.15.44:60138) 2024-09-17T05:40:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3860818606 learned_addr learned my addr 172.21.15.44:0/3860818606 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6b400640 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c6258a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6be00640 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c642dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 msgr2=0x56028c642dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c642dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 msgr2=0x56028c6258a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c6258a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.688+0000 7f8a6aa00640 1 -- 172.21.15.44:0/3860818606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028c3c9e50 con 0x56028c4c11c0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a6aa00640 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c625de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8a5804c490 tx=0x7f8a5804c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295f0c0718a1bcc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 1 -- 172.21.15.44:0/3860818606 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58020040 con 0x56028c4c11c0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 1 -- 172.21.15.44:0/3860818606 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f8a5801cd00 con 0x56028c4c11c0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a5c0bf040 con 0x56028c4c11c0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 1 -- 172.21.15.44:0/3860818606 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8a5806e050 con 0x56028c4c11c0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 10 client.6099 fetch_fsmap learned FSMap version 37 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x56028c3b82d0 con 0x56028c4c11c0 2024-09-17T05:40:02.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 1 -- 172.21.15.44:0/3860818606 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a5c0bf040 con 0x56028c4c11c0 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 1 -- 172.21.15.44:0/3860818606 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 37) ==== 3502+0+0 (secure 0 0 0) 0x7f8a58071020 con 0x56028c4c11c0 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 10 client.6099 fetch_fsmap finished waiting for FSMap version 37 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 10 client.6099 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 20 client.6099 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0a3b30 0x56028c643780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 4 client.6099 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 --> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x56028c421690 con 0x56028c0a3b30 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a6b400640 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0a3b30 0x56028c643780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a6b400640 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0a3b30 0x56028c643780 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ee098683b20362 server_cookie=580d3a37389e9b76 in_seq=0 out_seq=0 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 10 client.6099 ms_handle_connect on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 1 -- 172.21.15.44:0/3860818606 <== mds.0 v2:172.21.15.44:6832/3641732503 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56028c421690 con 0x56028c0a3b30 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 10 client.6099 handle_command_reply: tid=0 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 client.6099 shutdown 2024-09-17T05:40:02.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 msgr2=0x56028c625de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c625de0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8a5804c490 tx=0x7f8a5804c3a0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 shutdown_connections 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:6832/3641732503,v1:172.21.15.44:6834/3641732503] conn(0x56028c0a3b30 0x56028c643780 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56028c4cbb60 0x56028c642dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56028c4c11c0 0x56028c625de0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 --2- 172.21.15.44:0/3860818606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56028c4aad90 0x56028c6258a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 >> 172.21.15.44:0/3860818606 conn(0x56028c0d0760 msgr2=0x56028c5cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a54c00640 0 client.6099 ms_handle_reset on v2:172.21.15.44:6832/3641732503 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 shutdown_connections 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 1 -- 172.21.15.44:0/3860818606 wait complete. 2024-09-17T05:40:02.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a79bc3000 20 client.6099 trim_cache size 0 max 16384 2024-09-17T05:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:02.698 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2024-09-17T05:40:02.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a4c073230 msgr2=0x7f8a4c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a4c073230 0x7f8a4c075740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0af000 tx=0x7f8a5c01afa0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 msgr2=0x7f8a6c0cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0cc150 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800d720 tx=0x7f8a5800dbe0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 shutdown_connections 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a4c073230 0x7f8a4c075740 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a6c0d1d00 0x7f8a6c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a6c0d18f0 0x7f8a6c0cc150 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 --2- 172.21.15.44:0/3744894339 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a6c0cf5b0 0x7f8a6c166cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 >> 172.21.15.44:0/3744894339 conn(0x7f8a6c0b4240 msgr2=0x7f8a6c071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 shutdown_connections 2024-09-17T05:40:02.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.692+0000 7f8a72600640 1 -- 172.21.15.44:0/3744894339 wait complete. 2024-09-17T05:40:02.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:40:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 -- 172.21.15.44:0/1135420956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 msgr2=0x7fc4b806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 --2- 172.21.15.44:0/1135420956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b806e260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009840 tx=0x7fc4a401c790 comp rx=0 tx=0).stop 2024-09-17T05:40:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 -- 172.21.15.44:0/1135420956 shutdown_connections 2024-09-17T05:40:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 --2- 172.21.15.44:0/1135420956 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4b80cb470 0x7fc4b80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 --2- 172.21.15.44:0/1135420956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b806e260 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 -- 172.21.15.44:0/1135420956 >> 172.21.15.44:0/1135420956 conn(0x7fc4b80ccaa0 msgr2=0x7fc4b80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 -- 172.21.15.44:0/1135420956 shutdown_connections 2024-09-17T05:40:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.872+0000 7fc4be000640 1 -- 172.21.15.44:0/1135420956 wait complete. 2024-09-17T05:40:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 Processor -- start 2024-09-17T05:40:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 -- start start 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b8165e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4b8072e50 0x7fc4b8070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4b80cb470 0x7fc4b8164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b8168f70 con 0x7fc4b806de50 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b8168df0 con 0x7fc4b8072e50 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4be000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b81690f0 con 0x7fc4b80cb470 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b8165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b8165e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60156/0 (socket says 172.21.15.44:60156) 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 -- 172.21.15.44:0/3237000965 learned_addr learned my addr 172.21.15.44:0/3237000965 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7e00640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4b80cb470 0x7fc4b8164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b6a00640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4b8072e50 0x7fc4b8070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 -- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4b80cb470 msgr2=0x7fc4b8164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4b80cb470 0x7fc4b8164650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 -- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4b8072e50 msgr2=0x7fc4b8070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4b8072e50 0x7fc4b8070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 -- 172.21.15.44:0/3237000965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b81f9f40 con 0x7fc4b806de50 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.876+0000 7fc4b7400640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b8165e10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c730 tx=0x7fc4a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4af400640 1 -- 172.21.15.44:0/3237000965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8016020 con 0x7fc4b806de50 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4af400640 1 -- 172.21.15.44:0/3237000965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4a800a950 con 0x7fc4b806de50 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b806fa20 con 0x7fc4b806de50 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4af400640 1 -- 172.21.15.44:0/3237000965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a800ada0 con 0x7fc4b806de50 2024-09-17T05:40:02.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b81650e0 con 0x7fc4b806de50 2024-09-17T05:40:02.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b806e260 con 0x7fc4b806de50 2024-09-17T05:40:02.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4af400640 1 -- 172.21.15.44:0/3237000965 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc4a8019020 con 0x7fc4b806de50 2024-09-17T05:40:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4af400640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc498073200 0x7fc498075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4af400640 1 -- 172.21.15.44:0/3237000965 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7fc4a8094390 con 0x7fc4b806de50 2024-09-17T05:40:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.880+0000 7fc4b6a00640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc498073200 0x7fc498075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:02.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.884+0000 7fc4b6a00640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc498073200 0x7fc498075710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40af000 tx=0x7fc4a401afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:02.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:02.884+0000 7fc4af400640 1 -- 172.21.15.44:0/3237000965 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc4a8020020 con 0x7fc4b806de50 2024-09-17T05:40:03.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc4b80b5fa0 con 0x7fc4b806de50 2024-09-17T05:40:03.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4af400640 1 -- 172.21.15.44:0/3237000965 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc4b806e7a0 con 0x7fc4b806de50 2024-09-17T05:40:03.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:03.101 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc498073200 msgr2=0x7fc498075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc498073200 0x7fc498075710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40af000 tx=0x7fc4a401afd0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 msgr2=0x7fc4b8165e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b8165e10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c730 tx=0x7fc4a800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 shutdown_connections 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc4b80cb470 0x7fc4b8164650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc498073200 0x7fc498075710 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4b8072e50 0x7fc4b8070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 --2- 172.21.15.44:0/3237000965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4b806de50 0x7fc4b8165e10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 >> 172.21.15.44:0/3237000965 conn(0x7fc4b80ccaa0 msgr2=0x7fc4b81546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:03.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 shutdown_connections 2024-09-17T05:40:03.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.100+0000 7fc4be000640 1 -- 172.21.15.44:0/3237000965 wait complete. 2024-09-17T05:40:03.123 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:40:03.123 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:40:03.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:40:03.214 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:40:03.307 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:40:03.307 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:40:03.307 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:03.308 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:03.317 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:03.317 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:03.372 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:40:03.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 -- 172.21.15.44:0/2845567567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d1d00 msgr2=0x7faabc0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:03.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 --2- 172.21.15.44:0/2845567567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d1d00 0x7faabc0cf070 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009930 tx=0x7faaa801c820 comp rx=0 tx=0).stop 2024-09-17T05:40:03.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 -- 172.21.15.44:0/2845567567 shutdown_connections 2024-09-17T05:40:03.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 --2- 172.21.15.44:0/2845567567 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faabc0cf5b0 0x7faabc15d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 --2- 172.21.15.44:0/2845567567 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d1d00 0x7faabc0cf070 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 -- 172.21.15.44:0/2845567567 >> 172.21.15.44:0/2845567567 conn(0x7faabc0b4240 msgr2=0x7faabc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 -- 172.21.15.44:0/2845567567 shutdown_connections 2024-09-17T05:40:03.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.572+0000 7faac3c00640 1 -- 172.21.15.44:0/2845567567 wait complete. 2024-09-17T05:40:03.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 Processor -- start 2024-09-17T05:40:03.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 -- start start 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc0cf5b0 0x7faabc0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d18f0 0x7faabc1511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faabc0d1d00 0x7faabc151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faabc169e80 con 0x7faabc0cf5b0 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faabc169d00 con 0x7faabc0d18f0 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac3c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faabc16a000 con 0x7faabc0d1d00 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc0cf5b0 0x7faabc0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc0cf5b0 0x7faabc0cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60164/0 (socket says 172.21.15.44:60164) 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 -- 172.21.15.44:0/2198928417 learned_addr learned my addr 172.21.15.44:0/2198928417 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faabbe00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d18f0 0x7faabc1511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faabc0d1d00 0x7faabc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 -- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faabc0d1d00 msgr2=0x7faabc151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faabc0d1d00 0x7faabc151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 -- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d18f0 msgr2=0x7faabc1511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d18f0 0x7faabc1511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.576+0000 7faac1200640 1 -- 172.21.15.44:0/2198928417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc0cbba0 con 0x7faabc0cf5b0 2024-09-17T05:40:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faac1200640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc0cf5b0 0x7faabc0cb320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faab000c3f0 tx=0x7faab000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faab8c00640 1 -- 172.21.15.44:0/2198928417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab00052d0 con 0x7faabc0cf5b0 2024-09-17T05:40:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faab8c00640 1 -- 172.21.15.44:0/2198928417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab0007020 con 0x7faabc0cf5b0 2024-09-17T05:40:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc15f250 con 0x7faabc0cf5b0 2024-09-17T05:40:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faab8c00640 1 -- 172.21.15.44:0/2198928417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0007470 con 0x7faabc0cf5b0 2024-09-17T05:40:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc1532b0 con 0x7faabc0cf5b0 2024-09-17T05:40:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc15d060 con 0x7faabc0cf5b0 2024-09-17T05:40:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faab8c00640 1 -- 172.21.15.44:0/2198928417 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faab00067e0 con 0x7faabc0cf5b0 2024-09-17T05:40:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faab8c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa9c073230 0x7faa9c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.580+0000 7faab8c00640 1 -- 172.21.15.44:0/2198928417 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7faab0093680 con 0x7faabc0cf5b0 2024-09-17T05:40:03.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.584+0000 7faabbe00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa9c073230 0x7faa9c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:03.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.584+0000 7faabbe00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa9c073230 0x7faa9c075740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faaa80af000 tx=0x7faaa801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.588+0000 7faab8c00640 1 -- 172.21.15.44:0/2198928417 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faabc0cf9c0 con 0x7faabc0cf5b0 2024-09-17T05:40:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faabc068db0 con 0x7faabc0cf5b0 2024-09-17T05:40:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faab8c00640 1 -- 172.21.15.44:0/2198928417 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) ==== 80+0+0 (secure 0 0 0) 0x7faab005dea0 con 0x7faabc0cf5b0 2024-09-17T05:40:03.773 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:40:03.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa9c073230 msgr2=0x7faa9c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:03.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa9c073230 0x7faa9c075740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faaa80af000 tx=0x7faaa801b060 comp rx=0 tx=0).stop 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc0cf5b0 msgr2=0x7faabc0cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc0cf5b0 0x7faabc0cb320 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faab000c3f0 tx=0x7faab000c7f0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 shutdown_connections 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faabc0d1d00 0x7faabc151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa9c073230 0x7faa9c075740 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc0d18f0 0x7faabc1511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 --2- 172.21.15.44:0/2198928417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc0cf5b0 0x7faabc0cb320 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 >> 172.21.15.44:0/2198928417 conn(0x7faabc0b4240 msgr2=0x7faabc150550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 shutdown_connections 2024-09-17T05:40:03.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:03.772+0000 7faac3c00640 1 -- 172.21.15.44:0/2198928417 wait complete. 2024-09-17T05:40:03.795 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:40:03.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:03.796 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:03.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:40:03.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:03.874 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:40:03.890 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:40:03.890 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:40:03.890 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:03.899 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:40:03.899 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:40:03.899 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:03.899 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:03.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:40:03.940 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:40:03.940 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:40:03.940 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:03.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:40:03.948 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:04.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 -- 172.21.15.44:0/3053438087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54140cb470 msgr2=0x7f54140cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 --2- 172.21.15.44:0/3053438087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54140cb470 0x7f54140cb880 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f540c009bc0 tx=0x7f540c01cb10 comp rx=0 tx=0).stop 2024-09-17T05:40:04.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 -- 172.21.15.44:0/3053438087 shutdown_connections 2024-09-17T05:40:04.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 --2- 172.21.15.44:0/3053438087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54140cb470 0x7f54140cb880 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 --2- 172.21.15.44:0/3053438087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f541406de50 0x7f541406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 -- 172.21.15.44:0/3053438087 >> 172.21.15.44:0/3053438087 conn(0x7f54140ccaa0 msgr2=0x7f54140cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:04.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 -- 172.21.15.44:0/3053438087 shutdown_connections 2024-09-17T05:40:04.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.140+0000 7f5418c00640 1 -- 172.21.15.44:0/3053438087 wait complete. 2024-09-17T05:40:04.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 Processor -- start 2024-09-17T05:40:04.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 -- start start 2024-09-17T05:40:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f541406de50 0x7f54140cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5414072e50 0x7f54140cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54140cb470 0x7f541406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5414168ff0 con 0x7f5414072e50 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5414168e70 con 0x7f541406de50 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5414169170 con 0x7f54140cb470 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5414072e50 0x7f54140cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5414072e50 0x7f54140cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60176/0 (socket says 172.21.15.44:60176) 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 -- 172.21.15.44:0/2664992082 learned_addr learned my addr 172.21.15.44:0/2664992082 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411e00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f541406de50 0x7f54140cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 -- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54140cb470 msgr2=0x7f541406fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5412800640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54140cb470 0x7f541406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54140cb470 0x7f541406fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 -- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f541406de50 msgr2=0x7f54140cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f541406de50 0x7f54140cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 -- 172.21.15.44:0/2664992082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5414070f80 con 0x7f5414072e50 2024-09-17T05:40:04.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411e00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f541406de50 0x7f54140cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:04.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5412800640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54140cb470 0x7f541406fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:04.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5411400640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5414072e50 0x7f54140cf180 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f540000d680 tx=0x7f540000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:04.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f540a000640 1 -- 172.21.15.44:0/2664992082 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400017070 con 0x7f5414072e50 2024-09-17T05:40:04.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f540a000640 1 -- 172.21.15.44:0/2664992082 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5400005310 con 0x7f5414072e50 2024-09-17T05:40:04.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541406f390 con 0x7f5414072e50 2024-09-17T05:40:04.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f540a000640 1 -- 172.21.15.44:0/2664992082 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400009820 con 0x7f5414072e50 2024-09-17T05:40:04.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.144+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5414164650 con 0x7f5414072e50 2024-09-17T05:40:04.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.148+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f541406e260 con 0x7f5414072e50 2024-09-17T05:40:04.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.148+0000 7f540a000640 1 -- 172.21.15.44:0/2664992082 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f54000099c0 con 0x7f5414072e50 2024-09-17T05:40:04.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.148+0000 7f540a000640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53f4073200 0x7f53f4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.148+0000 7f540a000640 1 -- 172.21.15.44:0/2664992082 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f5400094530 con 0x7f5414072e50 2024-09-17T05:40:04.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.148+0000 7f5411e00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53f4073200 0x7f53f4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.152+0000 7f5411e00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53f4073200 0x7f53f4075710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f70 tx=0x7f5404009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:04.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.152+0000 7f540a000640 1 -- 172.21.15.44:0/2664992082 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f540005f310 con 0x7f5414072e50 2024-09-17T05:40:04.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.364+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54140b5fa0 con 0x7f5414072e50 2024-09-17T05:40:04.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.364+0000 7f540a000640 1 -- 172.21.15.44:0/2664992082 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5222 (secure 0 0 0) 0x7f540005ec10 con 0x7f5414072e50 2024-09-17T05:40:04.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:04.366 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"btime":"2024-09-17T05:39:34:765539+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:39:34.610591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":15,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:40:04.366 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2024-09-17T05:40:04.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53f4073200 msgr2=0x7f53f4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53f4073200 0x7f53f4075710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5404000f70 tx=0x7f5404009040 comp rx=0 tx=0).stop 2024-09-17T05:40:04.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5414072e50 msgr2=0x7f54140cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5414072e50 0x7f54140cf180 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f540000d680 tx=0x7f540000db40 comp rx=0 tx=0).stop 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 shutdown_connections 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54140cb470 0x7f541406fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5414072e50 0x7f54140cf180 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53f4073200 0x7f53f4075710 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 --2- 172.21.15.44:0/2664992082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f541406de50 0x7f54140cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 >> 172.21.15.44:0/2664992082 conn(0x7f54140ccaa0 msgr2=0x7f54140b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 shutdown_connections 2024-09-17T05:40:04.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.368+0000 7f5418c00640 1 -- 172.21.15.44:0/2664992082 wait complete. 2024-09-17T05:40:04.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:04.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 -- 172.21.15.44:0/3805839355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200d1d00 msgr2=0x7f27200cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 --2- 172.21.15.44:0/3805839355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200d1d00 0x7f27200cf070 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f270c009870 tx=0x7f270c01c760 comp rx=0 tx=0).stop 2024-09-17T05:40:04.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 -- 172.21.15.44:0/3805839355 shutdown_connections 2024-09-17T05:40:04.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 --2- 172.21.15.44:0/3805839355 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27200cf5b0 0x7f272015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 --2- 172.21.15.44:0/3805839355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200d1d00 0x7f27200cf070 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 -- 172.21.15.44:0/3805839355 >> 172.21.15.44:0/3805839355 conn(0x7f27200b4240 msgr2=0x7f27200b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:04.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 -- 172.21.15.44:0/3805839355 shutdown_connections 2024-09-17T05:40:04.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.544+0000 7f2728600640 1 -- 172.21.15.44:0/3805839355 wait complete. 2024-09-17T05:40:04.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 Processor -- start 2024-09-17T05:40:04.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 -- start start 2024-09-17T05:40:04.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200cf5b0 0x7f2720159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27200d18f0 0x7f27200b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27200d1d00 0x7f27200b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2720169e80 con 0x7f27200cf5b0 2024-09-17T05:40:04.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2720169d00 con 0x7f27200d1d00 2024-09-17T05:40:04.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2728600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f272016a000 con 0x7f27200d18f0 2024-09-17T05:40:04.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2725c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200cf5b0 0x7f2720159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2725c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200cf5b0 0x7f2720159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60188/0 (socket says 172.21.15.44:60188) 2024-09-17T05:40:04.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2725c00640 1 -- 172.21.15.44:0/3796912557 learned_addr learned my addr 172.21.15.44:0/3796912557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:04.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2725200640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27200d18f0 0x7f27200b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2726600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27200d1d00 0x7f27200b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2725c00640 1 -- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27200d18f0 msgr2=0x7f27200b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.548+0000 7f2725c00640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27200d18f0 0x7f27200b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f2725c00640 1 -- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27200d1d00 msgr2=0x7f27200b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f2725c00640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27200d1d00 0x7f27200b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f2725c00640 1 -- 172.21.15.44:0/3796912557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27200ccd50 con 0x7f27200cf5b0 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f2725c00640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200cf5b0 0x7f2720159460 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f271400c730 tx=0x7f271400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f271d600640 1 -- 172.21.15.44:0/3796912557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714016030 con 0x7f27200cf5b0 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f271d600640 1 -- 172.21.15.44:0/3796912557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2714007dd0 con 0x7f27200cf5b0 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f271d600640 1 -- 172.21.15.44:0/3796912557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714006b00 con 0x7f27200cf5b0 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27200b73f0 con 0x7f27200cf5b0 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272006f5c0 con 0x7f27200cf5b0 2024-09-17T05:40:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272015d060 con 0x7f27200cf5b0 2024-09-17T05:40:04.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.552+0000 7f271d600640 1 -- 172.21.15.44:0/3796912557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2714019070 con 0x7f27200cf5b0 2024-09-17T05:40:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.556+0000 7f271d600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2700073200 0x7f2700075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.556+0000 7f271d600640 1 -- 172.21.15.44:0/3796912557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f27140944c0 con 0x7f27200cf5b0 2024-09-17T05:40:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.556+0000 7f2725200640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2700073200 0x7f2700075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.556+0000 7f2725200640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2700073200 0x7f2700075710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f270c0af000 tx=0x7f270c01afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:04.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.556+0000 7f271d600640 1 -- 172.21.15.44:0/3796912557 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2714020070 con 0x7f27200cf5b0 2024-09-17T05:40:04.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.764+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f272015c250 con 0x7f27200cf5b0 2024-09-17T05:40:04.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f271d600640 1 -- 172.21.15.44:0/3796912557 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5222 (secure 0 0 0) 0x7f27200cf9c0 con 0x7f27200cf5b0 2024-09-17T05:40:04.768 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:04.768 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"btime":"2024-09-17T05:39:34:765539+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:39:34.610591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":15,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:40:04.768 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2700073200 msgr2=0x7f2700075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2700073200 0x7f2700075710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f270c0af000 tx=0x7f270c01afa0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200cf5b0 msgr2=0x7f2720159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200cf5b0 0x7f2720159460 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f271400c730 tx=0x7f271400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 shutdown_connections 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2700073200 0x7f2700075710 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27200d1d00 0x7f27200b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27200d18f0 0x7f27200b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 --2- 172.21.15.44:0/3796912557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27200cf5b0 0x7f2720159460 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 >> 172.21.15.44:0/3796912557 conn(0x7f27200b4240 msgr2=0x7f27200b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 shutdown_connections 2024-09-17T05:40:04.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.768+0000 7f2728600640 1 -- 172.21.15.44:0/3796912557 wait complete. 2024-09-17T05:40:04.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:40:04.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 -- 172.21.15.44:0/2400043230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f886406de50 msgr2=0x7f886406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 --2- 172.21.15.44:0/2400043230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f886406de50 0x7f886406e260 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f884c009900 tx=0x7f884c01c850 comp rx=0 tx=0).stop 2024-09-17T05:40:04.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 -- 172.21.15.44:0/2400043230 shutdown_connections 2024-09-17T05:40:04.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 --2- 172.21.15.44:0/2400043230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f886406de50 0x7f886406e260 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 --2- 172.21.15.44:0/2400043230 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8864072e50 0x7f886415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 -- 172.21.15.44:0/2400043230 >> 172.21.15.44:0/2400043230 conn(0x7f88640ccaa0 msgr2=0x7f88640cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:04.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 -- 172.21.15.44:0/2400043230 shutdown_connections 2024-09-17T05:40:04.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 -- 172.21.15.44:0/2400043230 wait complete. 2024-09-17T05:40:04.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 Processor -- start 2024-09-17T05:40:04.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.948+0000 7f886ac00640 1 -- start start 2024-09-17T05:40:04.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f886406de50 0x7f88640c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8864072e50 0x7f88640c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88640ced00 0x7f88640b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88641694b0 con 0x7f8864072e50 2024-09-17T05:40:04.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8864169330 con 0x7f88640ced00 2024-09-17T05:40:04.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8864169630 con 0x7f886406de50 2024-09-17T05:40:04.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8864072e50 0x7f88640c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8864072e50 0x7f88640c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60218/0 (socket says 172.21.15.44:60218) 2024-09-17T05:40:04.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 -- 172.21.15.44:0/3810709087 learned_addr learned my addr 172.21.15.44:0/3810709087 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:04.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f8863e00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f886406de50 0x7f88640c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f8868c00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88640ced00 0x7f88640b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 -- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f886406de50 msgr2=0x7f88640c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f886406de50 0x7f88640c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 -- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88640ced00 msgr2=0x7f88640b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88640ced00 0x7f88640b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 -- 172.21.15.44:0/3810709087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88640c7a90 con 0x7f8864072e50 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f885be00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8864072e50 0x7f88640c8af0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f884c009850 tx=0x7f884c0a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f8860c00640 1 -- 172.21.15.44:0/3810709087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0b2040 con 0x7f8864072e50 2024-09-17T05:40:04.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f8860c00640 1 -- 172.21.15.44:0/3810709087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f884c0042c0 con 0x7f8864072e50 2024-09-17T05:40:04.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f8860c00640 1 -- 172.21.15.44:0/3810709087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c005030 con 0x7f8864072e50 2024-09-17T05:40:04.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88640c7d30 con 0x7f8864072e50 2024-09-17T05:40:04.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88640c82f0 con 0x7f8864072e50 2024-09-17T05:40:04.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f886406e260 con 0x7f8864072e50 2024-09-17T05:40:04.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.952+0000 7f8860c00640 1 -- 172.21.15.44:0/3810709087 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f884c0051f0 con 0x7f8864072e50 2024-09-17T05:40:04.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.956+0000 7f8860c00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8840073200 0x7f8840075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:04.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.956+0000 7f8860c00640 1 -- 172.21.15.44:0/3810709087 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f884c12de00 con 0x7f8864072e50 2024-09-17T05:40:04.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.956+0000 7f8863e00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8840073200 0x7f8840075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:04.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.956+0000 7f8863e00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8840073200 0x7f8840075710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f885400bb50 tx=0x7f885400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:04.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:04.960+0000 7f8860c00640 1 -- 172.21.15.44:0/3810709087 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f884c0164d0 con 0x7f8864072e50 2024-09-17T05:40:05.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.132+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8864158d90 con 0x7f8864072e50 2024-09-17T05:40:05.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f8860c00640 1 -- 172.21.15.44:0/3810709087 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+17282 (secure 0 0 0) 0x7f884c0f85a0 con 0x7f8864072e50 2024-09-17T05:40:05.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:05.137 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:38:58.626632+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:38:43.712216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T05:38:44.935418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.16","mappings":[{"from":2,"to":1}]},{"pgid":"10.19","mappings":[{"from":2,"to":7}]},{"pgid":"10.1b","mappings":[{"from":4,"to":1}]},{"pgid":"10.23","mappings":[{"from":2,"to":7}]},{"pgid":"10.24","mappings":[{"from":2,"to":5}]},{"pgid":"10.2e","mappings":[{"from":2,"to":6}]},{"pgid":"10.33","mappings":[{"from":2,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:40:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8840073200 msgr2=0x7f8840075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8840073200 0x7f8840075710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f885400bb50 tx=0x7f885400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8864072e50 msgr2=0x7f88640c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8864072e50 0x7f88640c8af0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f884c009850 tx=0x7f884c0a56a0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 shutdown_connections 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8840073200 0x7f8840075710 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88640ced00 0x7f88640b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8864072e50 0x7f88640c8af0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 --2- 172.21.15.44:0/3810709087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f886406de50 0x7f88640c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 >> 172.21.15.44:0/3810709087 conn(0x7f88640ccaa0 msgr2=0x7f886415f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 shutdown_connections 2024-09-17T05:40:05.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.136+0000 7f886ac00640 1 -- 172.21.15.44:0/3810709087 wait complete. 2024-09-17T05:40:05.160 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:40:05.160 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:05.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 -- 172.21.15.44:0/3149398763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 msgr2=0x7f56ec0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 --2- 172.21.15.44:0/3149398763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec0cdbf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f56ec06ace0 tx=0x7f56d801c800 comp rx=0 tx=0).stop 2024-09-17T05:40:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 -- 172.21.15.44:0/3149398763 shutdown_connections 2024-09-17T05:40:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 --2- 172.21.15.44:0/3149398763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec0cdbf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 --2- 172.21.15.44:0/3149398763 >> v2:172.21.15.86:3300/0 conn(0x7f56ec0b5880 0x7f56ec06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 -- 172.21.15.44:0/3149398763 >> 172.21.15.44:0/3149398763 conn(0x7f56ec0ccaa0 msgr2=0x7f56ec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 -- 172.21.15.44:0/3149398763 shutdown_connections 2024-09-17T05:40:05.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.316+0000 7f56f4200640 1 -- 172.21.15.44:0/3149398763 wait complete. 2024-09-17T05:40:05.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 Processor -- start 2024-09-17T05:40:05.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 -- start start 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec09ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0b5880 0x7f56ec0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0ce130 0x7f56ec0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec16a2c0 con 0x7f56ec06e390 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec16a140 con 0x7f56ec0b5880 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec16a440 con 0x7f56ec0ce130 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec09ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec09ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60234/0 (socket says 172.21.15.44:60234) 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 -- 172.21.15.44:0/2034888795 learned_addr learned my addr 172.21.15.44:0/2034888795 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f0e00640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0b5880 0x7f56ec0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f2200640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0ce130 0x7f56ec0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 -- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0ce130 msgr2=0x7f56ec0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0ce130 0x7f56ec0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 -- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0b5880 msgr2=0x7f56ec0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0b5880 0x7f56ec0b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 -- 172.21.15.44:0/2034888795 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec09da60 con 0x7f56ec06e390 2024-09-17T05:40:05.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f0e00640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0b5880 0x7f56ec0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:05.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f1800640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec09ba90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f56e000e7f0 tx=0x7f56e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:05.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56e9600640 1 -- 172.21.15.44:0/2034888795 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e000ccc0 con 0x7f56ec06e390 2024-09-17T05:40:05.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56e9600640 1 -- 172.21.15.44:0/2034888795 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56e000ce80 con 0x7f56ec06e390 2024-09-17T05:40:05.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec09d780 con 0x7f56ec06e390 2024-09-17T05:40:05.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.320+0000 7f56e9600640 1 -- 172.21.15.44:0/2034888795 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0005280 con 0x7f56ec06e390 2024-09-17T05:40:05.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.324+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec0ae640 con 0x7f56ec06e390 2024-09-17T05:40:05.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.324+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec0cdbd0 con 0x7f56ec06e390 2024-09-17T05:40:05.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.324+0000 7f56e9600640 1 -- 172.21.15.44:0/2034888795 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f56e0005420 con 0x7f56ec06e390 2024-09-17T05:40:05.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.324+0000 7f56e9600640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f56cc073230 0x7f56cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.324+0000 7f56e9600640 1 -- 172.21.15.44:0/2034888795 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f56e0094e40 con 0x7f56ec06e390 2024-09-17T05:40:05.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.324+0000 7f56f0e00640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f56cc073230 0x7f56cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.328+0000 7f56f0e00640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f56cc073230 0x7f56cc075740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f56d80af000 tx=0x7f56d801b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:05.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.328+0000 7f56e9600640 1 -- 172.21.15.44:0/2034888795 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f56e005fc20 con 0x7f56ec06e390 2024-09-17T05:40:05.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.536+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56ec0cd680 con 0x7f56ec06e390 2024-09-17T05:40:05.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.536+0000 7f56e9600640 1 -- 172.21.15.44:0/2034888795 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5222 (secure 0 0 0) 0x7f56e005f520 con 0x7f56ec06e390 2024-09-17T05:40:05.539 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:05.539 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"btime":"2024-09-17T05:39:34:765539+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:39:34.610591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":15,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:40:05.539 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f56cc073230 msgr2=0x7f56cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f56cc073230 0x7f56cc075740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f56d80af000 tx=0x7f56d801b040 comp rx=0 tx=0).stop 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 msgr2=0x7f56ec09ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec09ba90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f56e000e7f0 tx=0x7f56e000ecb0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 shutdown_connections 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f56ec0ce130 0x7f56ec0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f56cc073230 0x7f56cc075740 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56ec0b5880 0x7f56ec0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 --2- 172.21.15.44:0/2034888795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56ec06e390 0x7f56ec09ba90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 >> 172.21.15.44:0/2034888795 conn(0x7f56ec0ccaa0 msgr2=0x7f56ec0af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 shutdown_connections 2024-09-17T05:40:05.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.540+0000 7f56f4200640 1 -- 172.21.15.44:0/2034888795 wait complete. 2024-09-17T05:40:05.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:05.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.720+0000 7fb477600640 1 -- 172.21.15.44:0/3082944833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47006e560 msgr2=0x7fb4700700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.720+0000 7fb477600640 1 --2- 172.21.15.44:0/3082944833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47006e560 0x7fb4700700d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb458009840 tx=0x7fb45801c820 comp rx=0 tx=0).stop 2024-09-17T05:40:05.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.720+0000 7fb477600640 1 -- 172.21.15.44:0/3082944833 shutdown_connections 2024-09-17T05:40:05.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.720+0000 7fb477600640 1 --2- 172.21.15.44:0/3082944833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb47006e560 0x7fb4700700d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.720+0000 7fb477600640 1 -- 172.21.15.44:0/3082944833 >> 172.21.15.44:0/3082944833 conn(0x7fb4700ccaa0 msgr2=0x7fb4700cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:05.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.720+0000 7fb477600640 1 -- 172.21.15.44:0/3082944833 shutdown_connections 2024-09-17T05:40:05.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.720+0000 7fb477600640 1 -- 172.21.15.44:0/3082944833 wait complete. 2024-09-17T05:40:05.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 Processor -- start 2024-09-17T05:40:05.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 -- start start 2024-09-17T05:40:05.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb470070610 0x7fb4701f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4700b5880 0x7fb470159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4700c91a0 0x7fb4700c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb47016ace0 con 0x7fb4700b5880 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb47016ab60 con 0x7fb4700c91a0 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb47016ae60 con 0x7fb470070610 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4700b5880 0x7fb470159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4700b5880 0x7fb470159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60254/0 (socket says 172.21.15.44:60254) 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 -- 172.21.15.44:0/90539475 learned_addr learned my addr 172.21.15.44:0/90539475 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb475600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4700c91a0 0x7fb4700c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb474c00640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb470070610 0x7fb4701f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 -- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb470070610 msgr2=0x7fb4701f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb470070610 0x7fb4701f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 -- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4700c91a0 msgr2=0x7fb4700c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4700c91a0 0x7fb4700c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 -- 172.21.15.44:0/90539475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4700c9af0 con 0x7fb4700b5880 2024-09-17T05:40:05.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb474c00640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb470070610 0x7fb4701f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:05.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb467e00640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4700b5880 0x7fb470159050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb45801a450 tx=0x7fb4580040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:05.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb46d600640 1 -- 172.21.15.44:0/90539475 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4580044b0 con 0x7fb4700b5880 2024-09-17T05:40:05.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb46d600640 1 -- 172.21.15.44:0/90539475 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4580bd070 con 0x7fb4700b5880 2024-09-17T05:40:05.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb46d600640 1 -- 172.21.15.44:0/90539475 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4580053c0 con 0x7fb4700b5880 2024-09-17T05:40:05.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4700c8100 con 0x7fb4700b5880 2024-09-17T05:40:05.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.724+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4700c86c0 con 0x7fb4700b5880 2024-09-17T05:40:05.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.728+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4700700d0 con 0x7fb4700b5880 2024-09-17T05:40:05.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.728+0000 7fb46d600640 1 -- 172.21.15.44:0/90539475 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb4580046d0 con 0x7fb4700b5880 2024-09-17T05:40:05.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.728+0000 7fb46d600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb44c073230 0x7fb44c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:05.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.728+0000 7fb46d600640 1 -- 172.21.15.44:0/90539475 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7fb45812f370 con 0x7fb4700b5880 2024-09-17T05:40:05.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.728+0000 7fb474c00640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb44c073230 0x7fb44c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:05.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.728+0000 7fb474c00640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb44c073230 0x7fb44c075740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb460001630 tx=0x7fb460009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:05.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.732+0000 7fb46d600640 1 -- 172.21.15.44:0/90539475 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb4580c7020 con 0x7fb4700b5880 2024-09-17T05:40:05.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.952+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb47006d9c0 con 0x7fb4700b5880 2024-09-17T05:40:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.952+0000 7fb46d600640 1 -- 172.21.15.44:0/90539475 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5222 (secure 0 0 0) 0x7fb4700c9af0 con 0x7fb4700b5880 2024-09-17T05:40:05.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:05.954 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"btime":"2024-09-17T05:39:34:765539+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:38:45.974804+0000","modified":"2024-09-17T05:39:34.610591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":15,"addr":"172.21.15.44:6834/3641732503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3641732503},{"type":"v1","addr":"172.21.15.44:6834","nonce":3641732503}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:40:05.954 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 37 2024-09-17T05:40:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb44c073230 msgr2=0x7fb44c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb44c073230 0x7fb44c075740 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb460001630 tx=0x7fb460009040 comp rx=0 tx=0).stop 2024-09-17T05:40:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4700b5880 msgr2=0x7fb470159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:05.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4700b5880 0x7fb470159050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb45801a450 tx=0x7fb4580040c0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 shutdown_connections 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb44c073230 0x7fb44c075740 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4700c91a0 0x7fb4700c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4700b5880 0x7fb470159050 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 --2- 172.21.15.44:0/90539475 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb470070610 0x7fb4701f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 >> 172.21.15.44:0/90539475 conn(0x7fb4700ccaa0 msgr2=0x7fb47015f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 shutdown_connections 2024-09-17T05:40:05.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:05.956+0000 7fb477600640 1 -- 172.21.15.44:0/90539475 wait complete. 2024-09-17T05:40:05.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 -- 172.21.15.44:0/1562098028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 msgr2=0x7f5fe00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/1562098028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe00b1be0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009900 tx=0x7f5fd001c820 comp rx=0 tx=0).stop 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 -- 172.21.15.44:0/1562098028 shutdown_connections 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/1562098028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5fe00cf780 0x7f5fe015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/1562098028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe00b1be0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 -- 172.21.15.44:0/1562098028 >> 172.21.15.44:0/1562098028 conn(0x7f5fe00b4240 msgr2=0x7f5fe00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 -- 172.21.15.44:0/1562098028 shutdown_connections 2024-09-17T05:40:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.132+0000 7f5fe5c00640 1 -- 172.21.15.44:0/1562098028 wait complete. 2024-09-17T05:40:06.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.136+0000 7f5fe5c00640 1 Processor -- start 2024-09-17T05:40:06.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.136+0000 7f5fe5c00640 1 -- start start 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.136+0000 7f5fe5c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.136+0000 7f5fe5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe00d1d00 0x7f5fe00b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.136+0000 7f5fe5c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5fe0154740 0x7f5fe0154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fe5c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe0169e80 con 0x7f5fe00d1d00 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fe5c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe0169d00 con 0x7f5fe00d18f0 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fe5c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe016a000 con 0x7f5fe0154740 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe0151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:51684/0 (socket says 172.21.15.44:51684) 2024-09-17T05:40:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 -- 172.21.15.44:0/4132396015 learned_addr learned my addr 172.21.15.44:0/4132396015 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:06.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fd7e00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe00d1d00 0x7f5fe00b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdf400640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5fe0154740 0x7f5fe0154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 -- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5fe0154740 msgr2=0x7f5fe0154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5fe0154740 0x7f5fe0154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 -- 172.21.15.44:0/4132396015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe00d1d00 msgr2=0x7f5fe00b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe00d1d00 0x7f5fe00b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 -- 172.21.15.44:0/4132396015 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe0155090 con 0x7f5fe00d18f0 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fdea00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe0151e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5fd001cd00 tx=0x7f5fd00a5780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fd6a00640 1 -- 172.21.15.44:0/4132396015 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00b2040 con 0x7f5fe00d18f0 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fd6a00640 1 -- 172.21.15.44:0/4132396015 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fd00041b0 con 0x7f5fe00d18f0 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe01528d0 con 0x7f5fe00d18f0 2024-09-17T05:40:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fd6a00640 1 -- 172.21.15.44:0/4132396015 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003600 con 0x7f5fe00d18f0 2024-09-17T05:40:06.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe0150df0 con 0x7f5fe00d18f0 2024-09-17T05:40:06.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.140+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe015d060 con 0x7f5fe00d18f0 2024-09-17T05:40:06.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.144+0000 7f5fd6a00640 1 -- 172.21.15.44:0/4132396015 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5fd00bf020 con 0x7f5fe00d18f0 2024-09-17T05:40:06.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.144+0000 7f5fd6a00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5fbc073200 0x7f5fbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.144+0000 7f5fd6a00640 1 -- 172.21.15.44:0/4132396015 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f5fd012edb0 con 0x7f5fe00d18f0 2024-09-17T05:40:06.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.144+0000 7f5fd7e00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5fbc073200 0x7f5fbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.144+0000 7f5fd7e00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5fbc073200 0x7f5fbc075710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0070990 tx=0x7f5fc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:06.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.148+0000 7f5fd6a00640 1 -- 172.21.15.44:0/4132396015 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f5fd00c6020 con 0x7f5fe00d18f0 2024-09-17T05:40:06.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.324+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fe00709c0 con 0x7f5fe00d18f0 2024-09-17T05:40:06.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.324+0000 7f5fd6a00640 1 -- 172.21.15.44:0/4132396015 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+17282 (secure 0 0 0) 0x7f5fe0155090 con 0x7f5fe00d18f0 2024-09-17T05:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:06.328 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":66,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:38:58.626632+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:38:43.712216+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-17T05:38:44.935418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.16","mappings":[{"from":2,"to":1}]},{"pgid":"10.19","mappings":[{"from":2,"to":7}]},{"pgid":"10.1b","mappings":[{"from":4,"to":1}]},{"pgid":"10.23","mappings":[{"from":2,"to":7}]},{"pgid":"10.24","mappings":[{"from":2,"to":5}]},{"pgid":"10.2e","mappings":[{"from":2,"to":6}]},{"pgid":"10.33","mappings":[{"from":2,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5fbc073200 msgr2=0x7f5fbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5fbc073200 0x7f5fbc075710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0070990 tx=0x7f5fc8009040 comp rx=0 tx=0).stop 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 msgr2=0x7f5fe0151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe0151e10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5fd001cd00 tx=0x7f5fd00a5780 comp rx=0 tx=0).stop 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 shutdown_connections 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5fe0154740 0x7f5fe0154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5fe00d1d00 0x7f5fe00b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5fbc073200 0x7f5fbc075710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 --2- 172.21.15.44:0/4132396015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe00d18f0 0x7f5fe0151e10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 >> 172.21.15.44:0/4132396015 conn(0x7f5fe00b4240 msgr2=0x7f5fe00711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:06.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 shutdown_connections 2024-09-17T05:40:06.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.328+0000 7f5fe5c00640 1 -- 172.21.15.44:0/4132396015 wait complete. 2024-09-17T05:40:06.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 -- 172.21.15.44:0/3725371631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc40cb470 msgr2=0x7f6fc40cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 --2- 172.21.15.44:0/3725371631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc40cb470 0x7f6fc40cb880 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40cb0b0 tx=0x7f6fbc01caf0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 -- 172.21.15.44:0/3725371631 shutdown_connections 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 --2- 172.21.15.44:0/3725371631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc40cb470 0x7f6fc40cb880 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 --2- 172.21.15.44:0/3725371631 >> v2:172.21.15.86:3300/0 conn(0x7f6fc406de50 0x7f6fc406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 -- 172.21.15.44:0/3725371631 >> 172.21.15.44:0/3725371631 conn(0x7f6fc40ccaa0 msgr2=0x7f6fc40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 -- 172.21.15.44:0/3725371631 shutdown_connections 2024-09-17T05:40:06.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 -- 172.21.15.44:0/3725371631 wait complete. 2024-09-17T05:40:06.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.508+0000 7f6fca000640 1 Processor -- start 2024-09-17T05:40:06.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 -- start start 2024-09-17T05:40:06.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc406de50 0x7f6fc4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fc4072e50 0x7f6fc41657b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc40cb470 0x7f6fc4165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc4168ed0 con 0x7f6fc406de50 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc4168d50 con 0x7f6fc40cb470 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc4169050 con 0x7f6fc4072e50 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc406de50 0x7f6fc4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc406de50 0x7f6fc4155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60284/0 (socket says 172.21.15.44:60284) 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 -- 172.21.15.44:0/1059029109 learned_addr learned my addr 172.21.15.44:0/1059029109 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fbaa00640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fc4072e50 0x7f6fc41657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 -- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fc4072e50 msgr2=0x7f6fc41657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fc4072e50 0x7f6fc41657b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3e00640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc40cb470 0x7f6fc4165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 -- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc40cb470 msgr2=0x7f6fc4165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc40cb470 0x7f6fc4165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 -- 172.21.15.44:0/1059029109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc40c9ea0 con 0x7f6fc406de50 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fbaa00640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fc4072e50 0x7f6fc41657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3e00640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc40cb470 0x7f6fc4165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fc3400640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc406de50 0x7f6fc4155210 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c400 tx=0x7f6fb400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fbbe00640 1 -- 172.21.15.44:0/1059029109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4017070 con 0x7f6fc406de50 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fbbe00640 1 -- 172.21.15.44:0/1059029109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fb4003600 con 0x7f6fc406de50 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fbbe00640 1 -- 172.21.15.44:0/1059029109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4003a50 con 0x7f6fc406de50 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc409f5c0 con 0x7f6fc406de50 2024-09-17T05:40:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.512+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc409fb80 con 0x7f6fc406de50 2024-09-17T05:40:06.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.516+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc406e260 con 0x7f6fc406de50 2024-09-17T05:40:06.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.516+0000 7f6fbbe00640 1 -- 172.21.15.44:0/1059029109 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6fb401a070 con 0x7f6fc406de50 2024-09-17T05:40:06.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.516+0000 7f6fbbe00640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fa0073200 0x7f6fa0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.516+0000 7f6fbbe00640 1 -- 172.21.15.44:0/1059029109 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6304+0+0 (secure 0 0 0) 0x7f6fb4093830 con 0x7f6fc406de50 2024-09-17T05:40:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.516+0000 7f6fbaa00640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fa0073200 0x7f6fa0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.516+0000 7f6fbaa00640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fa0073200 0x7f6fa0075710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6fc41fc8f0 tx=0x7f6fac005d20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:06.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.520+0000 7f6fbbe00640 1 -- 172.21.15.44:0/1059029109 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6fc406e7a0 con 0x7f6fc406de50 2024-09-17T05:40:06.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.732+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6fc40749b0 con 0x7f6fc406de50 2024-09-17T05:40:06.736 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:40:06.736+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:40:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.736+0000 7f6fbbe00640 1 -- 172.21.15.44:0/1059029109 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) ==== 161+0+0 (secure 0 0 0) 0x7f6fb405e580 con 0x7f6fc406de50 2024-09-17T05:40:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fa0073200 msgr2=0x7f6fa0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fa0073200 0x7f6fa0075710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6fc41fc8f0 tx=0x7f6fac005d20 comp rx=0 tx=0).stop 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc406de50 msgr2=0x7f6fc4155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc406de50 0x7f6fc4155210 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c400 tx=0x7f6fb400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 shutdown_connections 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6fa0073200 0x7f6fa0075710 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fc40cb470 0x7f6fc4165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6fc4072e50 0x7f6fc41657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 --2- 172.21.15.44:0/1059029109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fc406de50 0x7f6fc4155210 secure :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c400 tx=0x7f6fb400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 >> 172.21.15.44:0/1059029109 conn(0x7f6fc40ccaa0 msgr2=0x7f6fc4156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:06.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 shutdown_connections 2024-09-17T05:40:06.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.740+0000 7f6fca000640 1 -- 172.21.15.44:0/1059029109 wait complete. 2024-09-17T05:40:06.753 INFO:tasks.ceph.mds.c.smithi044.stderr: -9226> 2024-09-17T05:38:48.529+0000 7f2ab8600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:40:06.757 INFO:tasks.ceph.mds.c.smithi044.stderr: -5831> 2024-09-17T05:38:59.845+0000 7f2ab3600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 pv4 ap=4 s=0 n(v0 1=1+0)->n(v0 rc2024-09-17T05:38:58.609486+0000 1=1+0) (iauth excl) (ifile lock->excl w=1) (ixattr excl) (iquiesce lock w=1) cr={5830=0-4194304@1} caps={5830=pAsxLsXsxFcb/pAsxXsxFxwb@3},l=5830 | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=0 dirty=0 waiter=1 authpin=1 scrubqueue=0 0x55f04f618b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:40:06.760 INFO:tasks.ceph.mds.c.smithi044.stderr: -3593> 2024-09-17T05:39:31.585+0000 7f2ab3600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 pv6 ap=4 DIRTYPARENT s=0 n(v0 rc2024-09-17T05:38:58.609486+0000 1=1+0)->n(v0 rc2024-09-17T05:38:58.609486+0000 1=1+0) (ifile lock->xlock w=1) (iquiesce lock w=1) cr={5830=0-4194304@1} caps={5830=pAsLsXs/-@6} | ptrwaiter=1 request=1 lock=3 caps=1 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55f04f618b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:40:06.762 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:40:06.879 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:40:06.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 -- 172.21.15.44:0/3858771675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0cf5b0 msgr2=0x7fd55c15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 --2- 172.21.15.44:0/3858771675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0cf5b0 0x7fd55c15d060 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd55c0d3350 tx=0x7fd55401ccc0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 -- 172.21.15.44:0/3858771675 shutdown_connections 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 --2- 172.21.15.44:0/3858771675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0cf5b0 0x7fd55c15d060 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 --2- 172.21.15.44:0/3858771675 >> v2:172.21.15.86:3300/0 conn(0x7fd55c0d1d00 0x7fd55c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 --2- 172.21.15.44:0/3858771675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd55c0d18f0 0x7fd55c0b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 -- 172.21.15.44:0/3858771675 >> 172.21.15.44:0/3858771675 conn(0x7fd55c0b4240 msgr2=0x7fd55c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 -- 172.21.15.44:0/3858771675 shutdown_connections 2024-09-17T05:40:06.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.924+0000 7fd561600640 1 -- 172.21.15.44:0/3858771675 wait complete. 2024-09-17T05:40:06.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 Processor -- start 2024-09-17T05:40:06.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 -- start start 2024-09-17T05:40:06.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd55c0cf5b0 0x7fd55c1fa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd55c0d18f0 0x7fd55c151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0d1d00 0x7fd55c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c0d0d70 con 0x7fd55c0d1d00 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c0d0bf0 con 0x7fd55c0cf5b0 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd55c0d0ef0 con 0x7fd55c0d18f0 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0d1d00 0x7fd55c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0d1d00 0x7fd55c1543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60332/0 (socket says 172.21.15.44:60332) 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 -- 172.21.15.44:0/3121978443 learned_addr learned my addr 172.21.15.44:0/3121978443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd553e00640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd55c0d18f0 0x7fd55c151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55aa00640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd55c0cf5b0 0x7fd55c1fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 -- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd55c0d18f0 msgr2=0x7fd55c151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd55c0d18f0 0x7fd55c151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 -- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd55c0cf5b0 msgr2=0x7fd55c1fa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:06.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd55c0cf5b0 0x7fd55c1fa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 -- 172.21.15.44:0/3121978443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55c1fae60 con 0x7fd55c0d1d00 2024-09-17T05:40:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd55b400640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0d1d00 0x7fd55c1543e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd55401b370 tx=0x7fd554005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd552a00640 1 -- 172.21.15.44:0/3121978443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540bb070 con 0x7fd55c0d1d00 2024-09-17T05:40:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd552a00640 1 -- 172.21.15.44:0/3121978443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd554004d40 con 0x7fd55c0d1d00 2024-09-17T05:40:06.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55c1f6ec0 con 0x7fd55c0d1d00 2024-09-17T05:40:06.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd552a00640 1 -- 172.21.15.44:0/3121978443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540b2040 con 0x7fd55c0d1d00 2024-09-17T05:40:06.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.928+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55c1f7480 con 0x7fd55c0d1d00 2024-09-17T05:40:06.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.932+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd55c1f6c10 con 0x7fd55c0d1d00 2024-09-17T05:40:06.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.932+0000 7fd552a00640 1 -- 172.21.15.44:0/3121978443 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd554004240 con 0x7fd55c0d1d00 2024-09-17T05:40:06.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.932+0000 7fd552a00640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd538073200 0x7fd538075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:06.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.932+0000 7fd552a00640 1 -- 172.21.15.44:0/3121978443 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6390+0+0 (secure 0 0 0) 0x7fd55412e5b0 con 0x7fd55c0d1d00 2024-09-17T05:40:06.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.932+0000 7fd55aa00640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd538073200 0x7fd538075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:06.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.936+0000 7fd55aa00640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd538073200 0x7fd538075710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd54c005fd0 tx=0x7fd54c005d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:06.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:06.936+0000 7fd552a00640 1 -- 172.21.15.44:0/3121978443 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd55c1fae60 con 0x7fd55c0d1d00 2024-09-17T05:40:07.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.148+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd55c0b1be0 con 0x7fd55c0d1d00 2024-09-17T05:40:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.864+0000 7fd552a00640 1 -- 172.21.15.44:0/3121978443 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7fd554016970 con 0x7fd55c0d1d00 2024-09-17T05:40:07.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd538073200 msgr2=0x7fd538075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:07.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd538073200 0x7fd538075710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd54c005fd0 tx=0x7fd54c005d80 comp rx=0 tx=0).stop 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0d1d00 msgr2=0x7fd55c1543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0d1d00 0x7fd55c1543e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd55401b370 tx=0x7fd554005b00 comp rx=0 tx=0).stop 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 shutdown_connections 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd55c0d1d00 0x7fd55c1543e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd55c0d18f0 0x7fd55c151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd538073200 0x7fd538075710 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 --2- 172.21.15.44:0/3121978443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd55c0cf5b0 0x7fd55c1fa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 >> 172.21.15.44:0/3121978443 conn(0x7fd55c0b4240 msgr2=0x7fd55c158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 shutdown_connections 2024-09-17T05:40:07.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:07.868+0000 7fd561600640 1 -- 172.21.15.44:0/3121978443 wait complete. 2024-09-17T05:40:07.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 -- 172.21.15.44:0/3913155686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806df80 msgr2=0x7f308806e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 --2- 172.21.15.44:0/3913155686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806df80 0x7f308806e390 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f30880cc470 tx=0x7f307001f0b0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 -- 172.21.15.44:0/3913155686 shutdown_connections 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 --2- 172.21.15.44:0/3913155686 >> v2:172.21.15.86:3300/0 conn(0x7f308806f3f0 0x7f308806f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 --2- 172.21.15.44:0/3913155686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806df80 0x7f308806e390 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 --2- 172.21.15.44:0/3913155686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3088155b10 0x7f30880af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 -- 172.21.15.44:0/3913155686 >> 172.21.15.44:0/3913155686 conn(0x7f30880b35f0 msgr2=0x7f30880b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 -- 172.21.15.44:0/3913155686 shutdown_connections 2024-09-17T05:40:08.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 -- 172.21.15.44:0/3913155686 wait complete. 2024-09-17T05:40:08.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 Processor -- start 2024-09-17T05:40:08.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.060+0000 7f308f000640 1 -- start start 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f308806df80 0x7f30881f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806f3f0 0x7f3088156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3088155b10 0x7f3088073cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30880ce370 con 0x7f308806f3f0 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30880ce1f0 con 0x7f308806df80 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f30880ce4f0 con 0x7f3088155b10 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806f3f0 0x7f3088156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806f3f0 0x7f3088156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60342/0 (socket says 172.21.15.44:60342) 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 -- 172.21.15.44:0/3404355237 learned_addr learned my addr 172.21.15.44:0/3404355237 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:08.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f3087e00640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f308806df80 0x7f30881f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308d000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3088155b10 0x7f3088073cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 -- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3088155b10 msgr2=0x7f3088073cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3088155b10 0x7f3088073cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 -- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f308806df80 msgr2=0x7f30881f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f308806df80 0x7f30881f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 -- 172.21.15.44:0/3404355237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30881f6ce0 con 0x7f308806f3f0 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308d000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3088155b10 0x7f3088073cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:08.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f307fe00640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806f3f0 0x7f3088156a20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f30700b3040 tx=0x7f3070005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f3084c00640 1 -- 172.21.15.44:0/3404355237 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30700b5040 con 0x7f308806f3f0 2024-09-17T05:40:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f3084c00640 1 -- 172.21.15.44:0/3404355237 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3070005120 con 0x7f308806f3f0 2024-09-17T05:40:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30881f4bc0 con 0x7f308806f3f0 2024-09-17T05:40:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f3084c00640 1 -- 172.21.15.44:0/3404355237 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070005570 con 0x7f308806f3f0 2024-09-17T05:40:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30881f5180 con 0x7f308806f3f0 2024-09-17T05:40:08.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.064+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3088157370 con 0x7f308806f3f0 2024-09-17T05:40:08.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.068+0000 7f3084c00640 1 -- 172.21.15.44:0/3404355237 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f30700c0060 con 0x7f308806f3f0 2024-09-17T05:40:08.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.068+0000 7f3084c00640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3064073200 0x7f3064075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:08.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.068+0000 7f3084c00640 1 -- 172.21.15.44:0/3404355237 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6390+0+0 (secure 0 0 0) 0x7f3070130e90 con 0x7f308806f3f0 2024-09-17T05:40:08.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.068+0000 7f3087e00640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3064073200 0x7f3064075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.068+0000 7f3087e00640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3064073200 0x7f3064075710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3078009b40 tx=0x7f30780091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:08.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.072+0000 7f3084c00640 1 -- 172.21.15.44:0/3404355237 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3070018c10 con 0x7f308806f3f0 2024-09-17T05:40:08.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.248+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f308806f800 con 0x7f308806f3f0 2024-09-17T05:40:08.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.876+0000 7f3084c00640 1 -- 172.21.15.44:0/3404355237 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v68) ==== 181+0+0 (secure 0 0 0) 0x7f30700fbc00 con 0x7f308806f3f0 2024-09-17T05:40:08.878 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:40:08.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3064073200 msgr2=0x7f3064075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:08.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3064073200 0x7f3064075710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3078009b40 tx=0x7f30780091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806f3f0 msgr2=0x7f3088156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:08.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806f3f0 0x7f3088156a20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f30700b3040 tx=0x7f3070005780 comp rx=0 tx=0).stop 2024-09-17T05:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 shutdown_connections 2024-09-17T05:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3088155b10 0x7f3088073cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f308806f3f0 0x7f3088156a20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3064073200 0x7f3064075710 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 --2- 172.21.15.44:0/3404355237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f308806df80 0x7f30881f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 >> 172.21.15.44:0/3404355237 conn(0x7f30880b35f0 msgr2=0x7f30880b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:08.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 shutdown_connections 2024-09-17T05:40:08.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:08.880+0000 7f308f000640 1 -- 172.21.15.44:0/3404355237 wait complete. 2024-09-17T05:40:08.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:40:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 -- 172.21.15.44:0/3592296607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a8406df80 msgr2=0x7f6a8406e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/3592296607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a8406df80 0x7f6a8406e390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009840 tx=0x7f6a6c01f010 comp rx=0 tx=0).stop 2024-09-17T05:40:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 -- 172.21.15.44:0/3592296607 shutdown_connections 2024-09-17T05:40:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/3592296607 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a8406df80 0x7f6a8406e390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/3592296607 >> v2:172.21.15.86:3300/0 conn(0x7f6a84155b10 0x7f6a840af4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:09.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 -- 172.21.15.44:0/3592296607 >> 172.21.15.44:0/3592296607 conn(0x7f6a840b35f0 msgr2=0x7f6a840b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:09.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 -- 172.21.15.44:0/3592296607 shutdown_connections 2024-09-17T05:40:09.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 -- 172.21.15.44:0/3592296607 wait complete. 2024-09-17T05:40:09.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 Processor -- start 2024-09-17T05:40:09.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.076+0000 7f6a8bc00640 1 -- start start 2024-09-17T05:40:09.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8406df80 0x7f6a8409d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:09.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a8406f3f0 0x7f6a841f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:09.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a84155b10 0x7f6a841f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:09.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8406f980 con 0x7f6a8406df80 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8406f800 con 0x7f6a8406f3f0 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8406fb00 con 0x7f6a84155b10 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8406df80 0x7f6a8409d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8406df80 0x7f6a8409d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59942/0 (socket says 172.21.15.44:59942) 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 -- 172.21.15.44:0/2330225466 learned_addr learned my addr 172.21.15.44:0/2330225466 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a7be00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a8406f3f0 0x7f6a841f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89c00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a84155b10 0x7f6a841f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 -- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a84155b10 msgr2=0x7f6a841f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a84155b10 0x7f6a841f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 -- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a8406f3f0 msgr2=0x7f6a841f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a8406f3f0 0x7f6a841f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 -- 172.21.15.44:0/2330225466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a84140070 con 0x7f6a8406df80 2024-09-17T05:40:09.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a89200640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8406df80 0x7f6a8409d880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400ea20 tx=0x7f6a7400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a81600640 1 -- 172.21.15.44:0/2330225466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7400cd80 con 0x7f6a8406df80 2024-09-17T05:40:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a81600640 1 -- 172.21.15.44:0/2330225466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a74004020 con 0x7f6a8406df80 2024-09-17T05:40:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a81600640 1 -- 172.21.15.44:0/2330225466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74004450 con 0x7f6a8406df80 2024-09-17T05:40:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a84140350 con 0x7f6a8406df80 2024-09-17T05:40:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a84153630 con 0x7f6a8406df80 2024-09-17T05:40:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.080+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a840d0e30 con 0x7f6a8406df80 2024-09-17T05:40:09.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.084+0000 7f6a81600640 1 -- 172.21.15.44:0/2330225466 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6a74003600 con 0x7f6a8406df80 2024-09-17T05:40:09.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.084+0000 7f6a81600640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6a60073200 0x7f6a60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:09.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.084+0000 7f6a81600640 1 -- 172.21.15.44:0/2330225466 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5952+0+0 (secure 0 0 0) 0x7f6a74094b90 con 0x7f6a8406df80 2024-09-17T05:40:09.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.084+0000 7f6a7be00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6a60073200 0x7f6a60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:09.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.084+0000 7f6a7be00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6a60073200 0x7f6a60075710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0b2000 tx=0x7f6a6c01d850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:09.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.088+0000 7f6a81600640 1 -- 172.21.15.44:0/2330225466 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6a7405f480 con 0x7f6a8406df80 2024-09-17T05:40:09.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.260+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a84073b20 con 0x7f6a8406df80 2024-09-17T05:40:09.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.880+0000 7f6a81600640 1 -- 172.21.15.44:0/2330225466 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v69) ==== 169+0+0 (secure 0 0 0) 0x7f6a74063eb0 con 0x7f6a8406df80 2024-09-17T05:40:09.881 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:40:09.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6a60073200 msgr2=0x7f6a60075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:09.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6a60073200 0x7f6a60075710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0b2000 tx=0x7f6a6c01d850 comp rx=0 tx=0).stop 2024-09-17T05:40:09.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8406df80 msgr2=0x7f6a8409d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:09.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8406df80 0x7f6a8409d880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400ea20 tx=0x7f6a7400ee20 comp rx=0 tx=0).stop 2024-09-17T05:40:09.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 shutdown_connections 2024-09-17T05:40:09.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6a84155b10 0x7f6a841f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:09.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6a60073200 0x7f6a60075710 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0b2000 tx=0x7f6a6c01d850 comp rx=0 tx=0).stop 2024-09-17T05:40:09.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a8406f3f0 0x7f6a841f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:09.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 --2- 172.21.15.44:0/2330225466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6a8406df80 0x7f6a8409d880 secure :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400ea20 tx=0x7f6a7400ee20 comp rx=0 tx=0).stop 2024-09-17T05:40:09.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 >> 172.21.15.44:0/2330225466 conn(0x7f6a840b35f0 msgr2=0x7f6a840aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:09.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 shutdown_connections 2024-09-17T05:40:09.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:09.884+0000 7f6a8bc00640 1 -- 172.21.15.44:0/2330225466 wait complete. 2024-09-17T05:40:09.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:40:10.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.076+0000 7f46fb600640 1 -- 172.21.15.44:0/2954020791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 msgr2=0x7f46f415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.076+0000 7f46fb600640 1 --2- 172.21.15.44:0/2954020791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 0x7f46f415e990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f46e4009840 tx=0x7f46e401c790 comp rx=0 tx=0).stop 2024-09-17T05:40:10.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.076+0000 7f46fb600640 1 -- 172.21.15.44:0/2954020791 shutdown_connections 2024-09-17T05:40:10.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.076+0000 7f46fb600640 1 --2- 172.21.15.44:0/2954020791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 0x7f46f415e990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.076+0000 7f46fb600640 1 -- 172.21.15.44:0/2954020791 >> 172.21.15.44:0/2954020791 conn(0x7f46f40ccaa0 msgr2=0x7f46f40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:10.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.076+0000 7f46fb600640 1 -- 172.21.15.44:0/2954020791 shutdown_connections 2024-09-17T05:40:10.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.076+0000 7f46fb600640 1 -- 172.21.15.44:0/2954020791 wait complete. 2024-09-17T05:40:10.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 Processor -- start 2024-09-17T05:40:10.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 -- start start 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46f406de50 0x7f46f406f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 0x7f46f4166870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f40cb470 0x7f46f4166db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4169ee0 con 0x7f46f40cb470 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4169d60 con 0x7f46f4072e50 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f46f416a060 con 0x7f46f406de50 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f40cb470 0x7f46f4166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f40cb470 0x7f46f4166db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59944/0 (socket says 172.21.15.44:59944) 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 -- 172.21.15.44:0/3241711035 learned_addr learned my addr 172.21.15.44:0/3241711035 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f8c00640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46f406de50 0x7f46f406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46ebe00640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 0x7f46f4166870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 -- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46f406de50 msgr2=0x7f46f406f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46f406de50 0x7f46f406f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 -- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 msgr2=0x7f46f4166870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 0x7f46f4166870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 -- 172.21.15.44:0/3241711035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f40c9720 con 0x7f46f40cb470 2024-09-17T05:40:10.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f8c00640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46f406de50 0x7f46f406f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:10.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f9600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f40cb470 0x7f46f4166db0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00c730 tx=0x7f46ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:10.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f1600640 1 -- 172.21.15.44:0/3241711035 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec003b80 con 0x7f46f40cb470 2024-09-17T05:40:10.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f1600640 1 -- 172.21.15.44:0/3241711035 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46ec003d20 con 0x7f46f40cb470 2024-09-17T05:40:10.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f4159ca0 con 0x7f46f40cb470 2024-09-17T05:40:10.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46f1600640 1 -- 172.21.15.44:0/3241711035 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00aab0 con 0x7f46f40cb470 2024-09-17T05:40:10.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.080+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f4166350 con 0x7f46f40cb470 2024-09-17T05:40:10.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.084+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f415e990 con 0x7f46f40cb470 2024-09-17T05:40:10.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.084+0000 7f46f1600640 1 -- 172.21.15.44:0/3241711035 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f46ec00ac50 con 0x7f46f40cb470 2024-09-17T05:40:10.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.084+0000 7f46f1600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46d0073200 0x7f46d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.084+0000 7f46f1600640 1 -- 172.21.15.44:0/3241711035 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7f46ec093ec0 con 0x7f46f40cb470 2024-09-17T05:40:10.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.084+0000 7f46f8c00640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46d0073200 0x7f46d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.084+0000 7f46f8c00640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46d0073200 0x7f46d0075710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f46e40af000 tx=0x7f46e401afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:10.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.088+0000 7f46f1600640 1 -- 172.21.15.44:0/3241711035 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f46ec05f040 con 0x7f46f40cb470 2024-09-17T05:40:10.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.260+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f46f40b5fa0 con 0x7f46f40cb470 2024-09-17T05:40:10.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46f1600640 1 -- 172.21.15.44:0/3241711035 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f46ec05e940 con 0x7f46f40cb470 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46d0073200 msgr2=0x7f46d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46d0073200 0x7f46d0075710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f46e40af000 tx=0x7f46e401afd0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f40cb470 msgr2=0x7f46f4166db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f40cb470 0x7f46f4166db0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00c730 tx=0x7f46ec00cbf0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 shutdown_connections 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46f40cb470 0x7f46f4166db0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f46d0073200 0x7f46d0075710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f46f4072e50 0x7f46f4166870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 --2- 172.21.15.44:0/3241711035 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f46f406de50 0x7f46f406f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.268+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 >> 172.21.15.44:0/3241711035 conn(0x7f46f40ccaa0 msgr2=0x7f46f409fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:10.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.272+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 shutdown_connections 2024-09-17T05:40:10.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.272+0000 7f46fb600640 1 -- 172.21.15.44:0/3241711035 wait complete. 2024-09-17T05:40:10.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 -- 172.21.15.44:0/2516098899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f406e390 msgr2=0x7f98f40cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 --2- 172.21.15.44:0/2516098899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f406e390 0x7f98f40cdbf0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f98f406ace0 tx=0x7f98dc01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 -- 172.21.15.44:0/2516098899 shutdown_connections 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 --2- 172.21.15.44:0/2516098899 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98f40ce130 0x7f98f40ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 --2- 172.21.15.44:0/2516098899 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f406e390 0x7f98f40cdbf0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 --2- 172.21.15.44:0/2516098899 >> v2:172.21.15.86:3300/0 conn(0x7f98f40b5880 0x7f98f406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 -- 172.21.15.44:0/2516098899 >> 172.21.15.44:0/2516098899 conn(0x7f98f40ccaa0 msgr2=0x7f98f40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 -- 172.21.15.44:0/2516098899 shutdown_connections 2024-09-17T05:40:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 -- 172.21.15.44:0/2516098899 wait complete. 2024-09-17T05:40:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 Processor -- start 2024-09-17T05:40:10.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.452+0000 7f98f9200640 1 -- start start 2024-09-17T05:40:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98f406e390 0x7f98f41564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f40b5880 0x7f98f4153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98f40ce130 0x7f98f40b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98f4070a60 con 0x7f98f40b5880 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f98f40708e0 con 0x7f98f40ce130 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f98f4070be0 con 0x7f98f406e390 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f40b5880 0x7f98f4153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f40b5880 0x7f98f4153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59948/0 (socket says 172.21.15.44:59948) 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 -- 172.21.15.44:0/2070659819 learned_addr learned my addr 172.21.15.44:0/2070659819 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f1e00640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98f406e390 0x7f98f41564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f2800640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98f40ce130 0x7f98f40b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 -- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98f406e390 msgr2=0x7f98f41564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98f406e390 0x7f98f41564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 -- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98f40ce130 msgr2=0x7f98f40b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98f40ce130 0x7f98f40b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 -- 172.21.15.44:0/2070659819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f409f250 con 0x7f98f40b5880 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f2800640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98f40ce130 0x7f98f40b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ebe00640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f40b5880 0x7f98f4153ab0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f98dc01af70 tx=0x7f98dc005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ea000640 1 -- 172.21.15.44:0/2070659819 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0b2040 con 0x7f98f40b5880 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ea000640 1 -- 172.21.15.44:0/2070659819 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98dc004330 con 0x7f98f40b5880 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98ea000640 1 -- 172.21.15.44:0/2070659819 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98dc005290 con 0x7f98f40b5880 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f41f8a90 con 0x7f98f40b5880 2024-09-17T05:40:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f41f9050 con 0x7f98f40b5880 2024-09-17T05:40:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.456+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f406de50 con 0x7f98f40b5880 2024-09-17T05:40:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.460+0000 7f98ea000640 1 -- 172.21.15.44:0/2070659819 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f98dc005430 con 0x7f98f40b5880 2024-09-17T05:40:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.460+0000 7f98ea000640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98d0073200 0x7f98d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.460+0000 7f98ea000640 1 -- 172.21.15.44:0/2070659819 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7f98dc12d1b0 con 0x7f98f40b5880 2024-09-17T05:40:10.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.460+0000 7f98f1e00640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98d0073200 0x7f98d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:10.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.460+0000 7f98f1e00640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98d0073200 0x7f98d0075710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f98e400bad0 tx=0x7f98e400b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:10.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.464+0000 7f98ea000640 1 -- 172.21.15.44:0/2070659819 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f98dc0164b0 con 0x7f98f40b5880 2024-09-17T05:40:10.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.708+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f98f40cde00 con 0x7f98f40b5880 2024-09-17T05:40:10.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98ea000640 1 -- 172.21.15.44:0/2070659819 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v206) ==== 169+0+0 (secure 0 0 0) 0x7f98dc0f7c50 con 0x7f98f40b5880 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98d0073200 msgr2=0x7f98d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98d0073200 0x7f98d0075710 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f98e400bad0 tx=0x7f98e400b260 comp rx=0 tx=0).stop 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f40b5880 msgr2=0x7f98f4153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f40b5880 0x7f98f4153ab0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f98dc01af70 tx=0x7f98dc005e70 comp rx=0 tx=0).stop 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 shutdown_connections 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98d0073200 0x7f98d0075710 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98f40ce130 0x7f98f40b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98f40b5880 0x7f98f4153ab0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 --2- 172.21.15.44:0/2070659819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98f406e390 0x7f98f41564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:10.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 >> 172.21.15.44:0/2070659819 conn(0x7f98f40ccaa0 msgr2=0x7f98f415e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:10.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 shutdown_connections 2024-09-17T05:40:10.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:10.892+0000 7f98f9200640 1 -- 172.21.15.44:0/2070659819 wait complete. 2024-09-17T05:40:10.915 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-09-17T05:40:10.916 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-09-17T05:40:10.916 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-17T05:40:10.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:40:11.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.072+0000 7fe83e200640 1 -- 172.21.15.44:0/351874891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe83806e560 msgr2=0x7fe8380700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.072+0000 7fe83e200640 1 --2- 172.21.15.44:0/351874891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe83806e560 0x7fe8380700d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe824009840 tx=0x7fe82401c820 comp rx=0 tx=0).stop 2024-09-17T05:40:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.072+0000 7fe83e200640 1 -- 172.21.15.44:0/351874891 shutdown_connections 2024-09-17T05:40:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.072+0000 7fe83e200640 1 --2- 172.21.15.44:0/351874891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe83806e560 0x7fe8380700d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.072+0000 7fe83e200640 1 -- 172.21.15.44:0/351874891 >> 172.21.15.44:0/351874891 conn(0x7fe8380ccaa0 msgr2=0x7fe8380cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.072+0000 7fe83e200640 1 -- 172.21.15.44:0/351874891 shutdown_connections 2024-09-17T05:40:11.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.072+0000 7fe83e200640 1 -- 172.21.15.44:0/351874891 wait complete. 2024-09-17T05:40:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 Processor -- start 2024-09-17T05:40:11.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 -- start start 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe838070610 0x7fe8380aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8380b5880 0x7fe8381f9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8381549c0 0x7fe838154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe83816ace0 con 0x7fe8380b5880 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe83816ab60 con 0x7fe8381549c0 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe83e200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe83816ae60 con 0x7fe838070610 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8380b5880 0x7fe8381f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8380b5880 0x7fe8381f9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59966/0 (socket says 172.21.15.44:59966) 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 -- 172.21.15.44:0/1831299470 learned_addr learned my addr 172.21.15.44:0/1831299470 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe837400640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe838070610 0x7fe8380aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe837e00640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8381549c0 0x7fe838154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 -- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe838070610 msgr2=0x7fe8380aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe838070610 0x7fe8380aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 -- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8381549c0 msgr2=0x7fe838154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8381549c0 0x7fe838154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 -- 172.21.15.44:0/1831299470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe838155310 con 0x7fe8380b5880 2024-09-17T05:40:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe836a00640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8380b5880 0x7fe8381f9220 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe8240b0040 tx=0x7fe8240a65a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.076+0000 7fe82f400640 1 -- 172.21.15.44:0/1831299470 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824004040 con 0x7fe8380b5880 2024-09-17T05:40:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe82f400640 1 -- 172.21.15.44:0/1831299470 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8240be070 con 0x7fe8380b5880 2024-09-17T05:40:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe82f400640 1 -- 172.21.15.44:0/1831299470 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824005050 con 0x7fe8380b5880 2024-09-17T05:40:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe838159b50 con 0x7fe8380b5880 2024-09-17T05:40:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe838157660 con 0x7fe8380b5880 2024-09-17T05:40:11.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8381598c0 con 0x7fe8380b5880 2024-09-17T05:40:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe82f400640 1 -- 172.21.15.44:0/1831299470 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe8240051f0 con 0x7fe8380b5880 2024-09-17T05:40:11.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe82f400640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe818073230 0x7fe818075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe82f400640 1 -- 172.21.15.44:0/1831299470 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7fe82412ea30 con 0x7fe8380b5880 2024-09-17T05:40:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.080+0000 7fe837400640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe818073230 0x7fe818075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.084+0000 7fe837400640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe818073230 0x7fe818075740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe8280046c0 tx=0x7fe828007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:11.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.084+0000 7fe82f400640 1 -- 172.21.15.44:0/1831299470 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe838155310 con 0x7fe8380b5880 2024-09-17T05:40:11.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8380700d0 con 0x7fe8380b5880 2024-09-17T05:40:11.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe82f400640 1 -- 172.21.15.44:0/1831299470 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+13258 (secure 0 0 0) 0x7fe824016410 con 0x7fe8380b5880 2024-09-17T05:40:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:11.270 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":69,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:40:09.881068+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/3641732503":"2024-09-18T05:40:06.738804+0000","172.21.15.44:6832/3641732503":"2024-09-18T05:40:06.738804+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe818073230 msgr2=0x7fe818075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe818073230 0x7fe818075740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe8280046c0 tx=0x7fe828007cd0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8380b5880 msgr2=0x7fe8381f9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8380b5880 0x7fe8381f9220 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe8240b0040 tx=0x7fe8240a65a0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 shutdown_connections 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe818073230 0x7fe818075740 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8381549c0 0x7fe838154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.268+0000 7fe83e200640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8380b5880 0x7fe8381f9220 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.272+0000 7fe83e200640 1 --2- 172.21.15.44:0/1831299470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe838070610 0x7fe8380aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.272+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 >> 172.21.15.44:0/1831299470 conn(0x7fe8380ccaa0 msgr2=0x7fe838072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.272+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 shutdown_connections 2024-09-17T05:40:11.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.272+0000 7fe83e200640 1 -- 172.21.15.44:0/1831299470 wait complete. 2024-09-17T05:40:11.293 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:36:06.284181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:40:11.293 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 -- 172.21.15.44:0/2504459545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd1015d560 msgr2=0x7efd1015a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 --2- 172.21.15.44:0/2504459545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd1015d560 0x7efd1015a080 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7efd10161170 tx=0x7efd0001cc60 comp rx=0 tx=0).stop 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 -- 172.21.15.44:0/2504459545 shutdown_connections 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 --2- 172.21.15.44:0/2504459545 >> v2:172.21.15.86:3300/0 conn(0x7efd100cc1e0 0x7efd1006fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 --2- 172.21.15.44:0/2504459545 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd1006ce40 0x7efd100cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 --2- 172.21.15.44:0/2504459545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd1015d560 0x7efd1015a080 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 -- 172.21.15.44:0/2504459545 >> 172.21.15.44:0/2504459545 conn(0x7efd100cd930 msgr2=0x7efd100cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 -- 172.21.15.44:0/2504459545 shutdown_connections 2024-09-17T05:40:11.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.452+0000 7efd15c00640 1 -- 172.21.15.44:0/2504459545 wait complete. 2024-09-17T05:40:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 Processor -- start 2024-09-17T05:40:11.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 -- start start 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd1006ce40 0x7efd101f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd100cc1e0 0x7efd101f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd1015d560 0x7efd100c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd10160710 con 0x7efd100cc1e0 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd10160590 con 0x7efd1015d560 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd15c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efd10160890 con 0x7efd1006ce40 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd100cc1e0 0x7efd101f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd100cc1e0 0x7efd101f9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59988/0 (socket says 172.21.15.44:59988) 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 -- 172.21.15.44:0/3010192317 learned_addr learned my addr 172.21.15.44:0/3010192317 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd0f400640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd1015d560 0x7efd100c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd0ea00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd1006ce40 0x7efd101f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 -- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd1006ce40 msgr2=0x7efd101f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd1006ce40 0x7efd101f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 -- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd1015d560 msgr2=0x7efd100c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd1015d560 0x7efd100c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.456+0000 7efd06000640 1 -- 172.21.15.44:0/3010192317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd10151d70 con 0x7efd100cc1e0 2024-09-17T05:40:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd06000640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd100cc1e0 0x7efd101f9ad0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efcf800d6d0 tx=0x7efcf800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd07400640 1 -- 172.21.15.44:0/3010192317 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8017070 con 0x7efd100cc1e0 2024-09-17T05:40:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd07400640 1 -- 172.21.15.44:0/3010192317 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcf8009b10 con 0x7efd100cc1e0 2024-09-17T05:40:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd10152050 con 0x7efd100cc1e0 2024-09-17T05:40:11.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd07400640 1 -- 172.21.15.44:0/3010192317 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8010460 con 0x7efd100cc1e0 2024-09-17T05:40:11.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd101f8f20 con 0x7efd100cc1e0 2024-09-17T05:40:11.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd10160d80 con 0x7efd100cc1e0 2024-09-17T05:40:11.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd07400640 1 -- 172.21.15.44:0/3010192317 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efcf801a070 con 0x7efd100cc1e0 2024-09-17T05:40:11.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd07400640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efcec073230 0x7efcec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.460+0000 7efd07400640 1 -- 172.21.15.44:0/3010192317 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7efcf8094480 con 0x7efd100cc1e0 2024-09-17T05:40:11.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.464+0000 7efd0ea00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efcec073230 0x7efcec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.464+0000 7efd0ea00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efcec073230 0x7efcec075740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efd000af000 tx=0x7efd0001b500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:11.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.464+0000 7efd07400640 1 -- 172.21.15.44:0/3010192317 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efcf805f0a0 con 0x7efd100cc1e0 2024-09-17T05:40:11.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.644+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efd100d02f0 con 0x7efd100cc1e0 2024-09-17T05:40:11.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.644+0000 7efd07400640 1 -- 172.21.15.44:0/3010192317 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7efcf8063ad0 con 0x7efd100cc1e0 2024-09-17T05:40:11.647 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-17T05:40:11.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efcec073230 msgr2=0x7efcec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efcec073230 0x7efcec075740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efd000af000 tx=0x7efd0001b500 comp rx=0 tx=0).stop 2024-09-17T05:40:11.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd100cc1e0 msgr2=0x7efd101f9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd100cc1e0 0x7efd101f9ad0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7efcf800d6d0 tx=0x7efcf800db90 comp rx=0 tx=0).stop 2024-09-17T05:40:11.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 shutdown_connections 2024-09-17T05:40:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efcec073230 0x7efcec075740 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd1015d560 0x7efd100c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd100cc1e0 0x7efd101f9ad0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 --2- 172.21.15.44:0/3010192317 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd1006ce40 0x7efd101f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 >> 172.21.15.44:0/3010192317 conn(0x7efd100cd930 msgr2=0x7efd100cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 shutdown_connections 2024-09-17T05:40:11.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.648+0000 7efd15c00640 1 -- 172.21.15.44:0/3010192317 wait complete. 2024-09-17T05:40:11.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-09-17T05:40:11.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 -- 172.21.15.44:0/931817605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 msgr2=0x7f1d1015d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 --2- 172.21.15.44:0/931817605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d1015d060 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1d100744e0 tx=0x7f1d0801cae0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 -- 172.21.15.44:0/931817605 shutdown_connections 2024-09-17T05:40:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 --2- 172.21.15.44:0/931817605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d1015d060 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 --2- 172.21.15.44:0/931817605 >> v2:172.21.15.86:3300/0 conn(0x7f1d100d1d00 0x7f1d100cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 -- 172.21.15.44:0/931817605 >> 172.21.15.44:0/931817605 conn(0x7f1d100b4240 msgr2=0x7f1d100b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 -- 172.21.15.44:0/931817605 shutdown_connections 2024-09-17T05:40:11.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 -- 172.21.15.44:0/931817605 wait complete. 2024-09-17T05:40:11.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 Processor -- start 2024-09-17T05:40:11.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.828+0000 7f1d14c00640 1 -- start start 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d101576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d100d18f0 0x7f1d101f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d100d1d00 0x7f1d100b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10169e80 con 0x7f1d100cf5b0 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10169d00 con 0x7f1d100d1d00 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1016a000 con 0x7f1d100d18f0 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d101576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d101576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60018/0 (socket says 172.21.15.44:60018) 2024-09-17T05:40:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 -- 172.21.15.44:0/2403887349 learned_addr learned my addr 172.21.15.44:0/2403887349 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0e800640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d100d1d00 0x7f1d100b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d07e00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d100d18f0 0x7f1d101f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 -- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d100d18f0 msgr2=0x7f1d101f9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d100d18f0 0x7f1d101f9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 -- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d100d1d00 msgr2=0x7f1d100b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d100d1d00 0x7f1d100b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 -- 172.21.15.44:0/2403887349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d101568f0 con 0x7f1d100cf5b0 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0e800640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d100d1d00 0x7f1d100b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:11.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d0de00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d101576b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000b440 tx=0x7f1d0000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d06000640 1 -- 172.21.15.44:0/2403887349 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00015020 con 0x7f1d100cf5b0 2024-09-17T05:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d06000640 1 -- 172.21.15.44:0/2403887349 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d00011980 con 0x7f1d100cf5b0 2024-09-17T05:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d06000640 1 -- 172.21.15.44:0/2403887349 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00011dd0 con 0x7f1d100cf5b0 2024-09-17T05:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d10156bd0 con 0x7f1d100cf5b0 2024-09-17T05:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d10157190 con 0x7f1d100cf5b0 2024-09-17T05:40:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.832+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1015d060 con 0x7f1d100cf5b0 2024-09-17T05:40:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.836+0000 7f1d06000640 1 -- 172.21.15.44:0/2403887349 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1d00018020 con 0x7f1d100cf5b0 2024-09-17T05:40:11.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.836+0000 7f1d06000640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cec073230 0x7f1cec075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:11.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.836+0000 7f1d06000640 1 -- 172.21.15.44:0/2403887349 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7f1d00093f80 con 0x7f1d100cf5b0 2024-09-17T05:40:11.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.836+0000 7f1d07e00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cec073230 0x7f1cec075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:11.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.836+0000 7f1d07e00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cec073230 0x7f1cec075740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80058d0 tx=0x7f1cf8005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:11.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:11.840+0000 7f1d06000640 1 -- 172.21.15.44:0/2403887349 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1d0001f030 con 0x7f1d100cf5b0 2024-09-17T05:40:12.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.080+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f1d1015c220 con 0x7f1d100cf5b0 2024-09-17T05:40:12.111 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:12.114 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:12.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.900+0000 7f1d06000640 1 -- 172.21.15.44:0/2403887349 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v208) ==== 169+0+0 (secure 0 0 0) 0x7f1d0000d040 con 0x7f1d100cf5b0 2024-09-17T05:40:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cec073230 msgr2=0x7f1cec075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cec073230 0x7f1cec075740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80058d0 tx=0x7f1cf8005860 comp rx=0 tx=0).stop 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 msgr2=0x7f1d101576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d101576b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000b440 tx=0x7f1d0000b900 comp rx=0 tx=0).stop 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 shutdown_connections 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cec073230 0x7f1cec075740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d100d1d00 0x7f1d100b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1d100d18f0 0x7f1d101f9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 --2- 172.21.15.44:0/2403887349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1d100cf5b0 0x7f1d101576b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 >> 172.21.15.44:0/2403887349 conn(0x7f1d100b4240 msgr2=0x7f1d1015aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 shutdown_connections 2024-09-17T05:40:12.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:12.904+0000 7f1d14c00640 1 -- 172.21.15.44:0/2403887349 wait complete. 2024-09-17T05:40:12.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:40:13.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 -- 172.21.15.44:0/1986042362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad8070610 msgr2=0x7f8ad8070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 --2- 172.21.15.44:0/1986042362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad8070610 0x7f8ad8070a20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8072340 tx=0x7f8ad001cb80 comp rx=0 tx=0).stop 2024-09-17T05:40:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 -- 172.21.15.44:0/1986042362 shutdown_connections 2024-09-17T05:40:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 --2- 172.21.15.44:0/1986042362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad8070610 0x7f8ad8070a20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 --2- 172.21.15.44:0/1986042362 >> v2:172.21.15.86:3300/0 conn(0x7f8ad806e560 0x7f8ad80700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 -- 172.21.15.44:0/1986042362 >> 172.21.15.44:0/1986042362 conn(0x7f8ad80ccaa0 msgr2=0x7f8ad80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 -- 172.21.15.44:0/1986042362 shutdown_connections 2024-09-17T05:40:13.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.088+0000 7f8ae0000640 1 -- 172.21.15.44:0/1986042362 wait complete. 2024-09-17T05:40:13.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 Processor -- start 2024-09-17T05:40:13.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 -- start start 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ad8070610 0x7f8ad80b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad80b5880 0x7f8ad814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ad80b45d0 0x7f8ad814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8169ee0 con 0x7f8ad80b5880 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8169d60 con 0x7f8ad80b45d0 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad816a060 con 0x7f8ad8070610 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad80b5880 0x7f8ad814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad80b5880 0x7f8ad814d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60026/0 (socket says 172.21.15.44:60026) 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 -- 172.21.15.44:0/688878775 learned_addr learned my addr 172.21.15.44:0/688878775 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:13.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ade000640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ad80b45d0 0x7f8ad814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8add600640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ad8070610 0x7f8ad80b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 -- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ad8070610 msgr2=0x7f8ad80b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ad8070610 0x7f8ad80b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 -- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ad80b45d0 msgr2=0x7f8ad814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ad80b45d0 0x7f8ad814da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 -- 172.21.15.44:0/688878775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad80b03a0 con 0x7f8ad80b5880 2024-09-17T05:40:13.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8adcc00640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad80b5880 0x7f8ad814d530 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400d750 tx=0x7f8ac400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:13.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ad5600640 1 -- 172.21.15.44:0/688878775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac4017070 con 0x7f8ad80b5880 2024-09-17T05:40:13.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ad5600640 1 -- 172.21.15.44:0/688878775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ac4009d20 con 0x7f8ad80b5880 2024-09-17T05:40:13.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ad5600640 1 -- 172.21.15.44:0/688878775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400de60 con 0x7f8ad80b5880 2024-09-17T05:40:13.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad80c8100 con 0x7f8ad80b5880 2024-09-17T05:40:13.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.092+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad80c9af0 con 0x7f8ad80b5880 2024-09-17T05:40:13.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.096+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad80700d0 con 0x7f8ad80b5880 2024-09-17T05:40:13.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.096+0000 7f8ad5600640 1 -- 172.21.15.44:0/688878775 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8ac4004280 con 0x7f8ad80b5880 2024-09-17T05:40:13.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.096+0000 7f8ad5600640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ab8073200 0x7f8ab8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.096+0000 7f8ad5600640 1 -- 172.21.15.44:0/688878775 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7f8ac40943f0 con 0x7f8ad80b5880 2024-09-17T05:40:13.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.096+0000 7f8add600640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ab8073200 0x7f8ab8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.100+0000 7f8add600640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ab8073200 0x7f8ab8075710 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007fd0 tx=0x7f8acc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:13.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.100+0000 7f8ad5600640 1 -- 172.21.15.44:0/688878775 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8ac4020020 con 0x7f8ad80b5880 2024-09-17T05:40:13.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.276+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8ad80b0610 con 0x7f8ad80b5880 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ad5600640 1 -- 172.21.15.44:0/688878775 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+2294 (secure 0 0 0) 0x7f8ac405ee90 con 0x7f8ad80b5880 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3062.155679 2024-09-17T05:40:13.280 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3184.697297 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3313.522676 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3406.954625 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4320.207875 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.313189 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7119.006184 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4437.685284 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:40:13.281 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:40:13.282 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ab8073200 msgr2=0x7f8ab8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ab8073200 0x7f8ab8075710 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8acc007fd0 tx=0x7f8acc009040 comp rx=0 tx=0).stop 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad80b5880 msgr2=0x7f8ad814d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad80b5880 0x7f8ad814d530 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400d750 tx=0x7f8ac400dc10 comp rx=0 tx=0).stop 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 shutdown_connections 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ab8073200 0x7f8ab8075710 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ad80b45d0 0x7f8ad814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ad80b5880 0x7f8ad814d530 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 --2- 172.21.15.44:0/688878775 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ad8070610 0x7f8ad80b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 >> 172.21.15.44:0/688878775 conn(0x7f8ad80ccaa0 msgr2=0x7f8ad8072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 shutdown_connections 2024-09-17T05:40:13.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.280+0000 7f8ae0000640 1 -- 172.21.15.44:0/688878775 wait complete. 2024-09-17T05:40:13.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:40:13.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 -- 172.21.15.44:0/2114065952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f988406e390 msgr2=0x7f98840cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 --2- 172.21.15.44:0/2114065952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f988406e390 0x7f98840cdbf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9884072de0 tx=0x7f986c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 -- 172.21.15.44:0/2114065952 shutdown_connections 2024-09-17T05:40:13.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 --2- 172.21.15.44:0/2114065952 >> v2:172.21.15.86:3300/0 conn(0x7f98840ce130 0x7f98840ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 --2- 172.21.15.44:0/2114065952 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f988406e390 0x7f98840cdbf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 --2- 172.21.15.44:0/2114065952 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98840b5880 0x7f988406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 -- 172.21.15.44:0/2114065952 >> 172.21.15.44:0/2114065952 conn(0x7f98840ccaa0 msgr2=0x7f98840cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:13.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 -- 172.21.15.44:0/2114065952 shutdown_connections 2024-09-17T05:40:13.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.460+0000 7f9889e00640 1 -- 172.21.15.44:0/2114065952 wait complete. 2024-09-17T05:40:13.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 Processor -- start 2024-09-17T05:40:13.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 -- start start 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f988406e390 0x7f9884153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98840b5880 0x7f98840b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98840ce130 0x7f98840b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9884070c70 con 0x7f98840ce130 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9884070af0 con 0x7f98840b5880 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9889e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9884070df0 con 0x7f988406e390 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98840ce130 0x7f98840b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98840ce130 0x7f98840b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60038/0 (socket says 172.21.15.44:60038) 2024-09-17T05:40:13.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 -- 172.21.15.44:0/2628595459 learned_addr learned my addr 172.21.15.44:0/2628595459 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f987be00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98840b5880 0x7f98840b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9882a00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f988406e390 0x7f9884153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 -- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f988406e390 msgr2=0x7f9884153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f988406e390 0x7f9884153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 -- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98840b5880 msgr2=0x7f98840b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98840b5880 0x7f98840b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 -- 172.21.15.44:0/2628595459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9884154320 con 0x7f98840ce130 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.464+0000 7f9883400640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98840ce130 0x7f98840b0f70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f987c00e970 tx=0x7f987c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:13.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f987b400640 1 -- 172.21.15.44:0/2628595459 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c004d30 con 0x7f98840ce130 2024-09-17T05:40:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f987b400640 1 -- 172.21.15.44:0/2628595459 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f987c00cb20 con 0x7f98840ce130 2024-09-17T05:40:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98840b4c20 con 0x7f98840ce130 2024-09-17T05:40:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f987b400640 1 -- 172.21.15.44:0/2628595459 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c005020 con 0x7f98840ce130 2024-09-17T05:40:13.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98840cb220 con 0x7f98840ce130 2024-09-17T05:40:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988406de50 con 0x7f98840ce130 2024-09-17T05:40:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f987b400640 1 -- 172.21.15.44:0/2628595459 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f987c0051c0 con 0x7f98840ce130 2024-09-17T05:40:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f987b400640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9860073230 0x7f9860075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f987b400640 1 -- 172.21.15.44:0/2628595459 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7f987c094980 con 0x7f98840ce130 2024-09-17T05:40:13.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.468+0000 7f9882a00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9860073230 0x7f9860075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:13.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.472+0000 7f9882a00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9860073230 0x7f9860075740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9874005950 tx=0x7f987400c460 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:13.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.472+0000 7f987b400640 1 -- 172.21.15.44:0/2628595459 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f987c016030 con 0x7f98840ce130 2024-09-17T05:40:13.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.648+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f988415b140 con 0x7f98840ce130 2024-09-17T05:40:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f987b400640 1 -- 172.21.15.44:0/2628595459 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f987c05f4c0 con 0x7f98840ce130 2024-09-17T05:40:13.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9860073230 msgr2=0x7f9860075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9860073230 0x7f9860075740 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9874005950 tx=0x7f987400c460 comp rx=0 tx=0).stop 2024-09-17T05:40:13.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98840ce130 msgr2=0x7f98840b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98840ce130 0x7f98840b0f70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f987c00e970 tx=0x7f987c00ee30 comp rx=0 tx=0).stop 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 shutdown_connections 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98840ce130 0x7f98840b0f70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9860073230 0x7f9860075740 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98840b5880 0x7f98840b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 --2- 172.21.15.44:0/2628595459 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f988406e390 0x7f9884153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 >> 172.21.15.44:0/2628595459 conn(0x7f98840ccaa0 msgr2=0x7f988415c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 shutdown_connections 2024-09-17T05:40:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:13.652+0000 7f9889e00640 1 -- 172.21.15.44:0/2628595459 wait complete. 2024-09-17T05:40:13.675 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:40:13.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:40:13.746 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:40:13.843 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:40:13.843 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:13.843 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:13.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:40:13.853 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:40:13.853 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:13.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:40:13.863 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:13.863 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:13.904 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:40:13.904 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:40:13.904 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:13.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:40:13.913 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:40:13.913 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 -- 172.21.15.44:0/3002503959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd08072e50 msgr2=0x7efd0815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 --2- 172.21.15.44:0/3002503959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd08072e50 0x7efd0815e990 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009840 tx=0x7efcfc01c790 comp rx=0 tx=0).stop 2024-09-17T05:40:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 -- 172.21.15.44:0/3002503959 shutdown_connections 2024-09-17T05:40:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 --2- 172.21.15.44:0/3002503959 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd080cb470 0x7efd080cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 --2- 172.21.15.44:0/3002503959 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd08072e50 0x7efd0815e990 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 -- 172.21.15.44:0/3002503959 >> 172.21.15.44:0/3002503959 conn(0x7efd080ccaa0 msgr2=0x7efd080cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:14.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 -- 172.21.15.44:0/3002503959 shutdown_connections 2024-09-17T05:40:14.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.104+0000 7efd10600640 1 -- 172.21.15.44:0/3002503959 wait complete. 2024-09-17T05:40:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 Processor -- start 2024-09-17T05:40:14.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 -- start start 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd0806de50 0x7efd081f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd08072e50 0x7efd08157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd080cb470 0x7efd08157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd08168ed0 con 0x7efd080cb470 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd08168d50 con 0x7efd08072e50 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efd08169050 con 0x7efd0806de50 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd080cb470 0x7efd08157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd080cb470 0x7efd08157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60056/0 (socket says 172.21.15.44:60056) 2024-09-17T05:40:14.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 -- 172.21.15.44:0/2055634248 learned_addr learned my addr 172.21.15.44:0/2055634248 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0dc00640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd0806de50 0x7efd081f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0d200640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd08072e50 0x7efd08157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 -- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd0806de50 msgr2=0x7efd081f88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd0806de50 0x7efd081f88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 -- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd08072e50 msgr2=0x7efd08157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd08072e50 0x7efd08157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 -- 172.21.15.44:0/2055634248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0814ab20 con 0x7efd080cb470 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0dc00640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd0806de50 0x7efd081f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0d200640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd08072e50 0x7efd08157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd0e600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd080cb470 0x7efd08157d90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efd0000cab0 tx=0x7efd0000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd05600640 1 -- 172.21.15.44:0/2055634248 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00007d90 con 0x7efd080cb470 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd05600640 1 -- 172.21.15.44:0/2055634248 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd00003a90 con 0x7efd080cb470 2024-09-17T05:40:14.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd05600640 1 -- 172.21.15.44:0/2055634248 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00004020 con 0x7efd080cb470 2024-09-17T05:40:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0814ae00 con 0x7efd080cb470 2024-09-17T05:40:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.108+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0814b3c0 con 0x7efd080cb470 2024-09-17T05:40:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.112+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd080cb880 con 0x7efd080cb470 2024-09-17T05:40:14.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.112+0000 7efd05600640 1 -- 172.21.15.44:0/2055634248 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efd000041c0 con 0x7efd080cb470 2024-09-17T05:40:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.112+0000 7efd05600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efce8073230 0x7efce8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.112+0000 7efd05600640 1 -- 172.21.15.44:0/2055634248 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7efd00094830 con 0x7efd080cb470 2024-09-17T05:40:14.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.112+0000 7efd0dc00640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efce8073230 0x7efce8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.116+0000 7efd0dc00640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efce8073230 0x7efce8075740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0af000 tx=0x7efcfc01afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:14.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.116+0000 7efd05600640 1 -- 172.21.15.44:0/2055634248 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efd00014070 con 0x7efd080cb470 2024-09-17T05:40:14.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.328+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd080b5fa0 con 0x7efd080cb470 2024-09-17T05:40:14.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.328+0000 7efd05600640 1 -- 172.21.15.44:0/2055634248 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+3908 (secure 0 0 0) 0x7efd0005f920 con 0x7efd080cb470 2024-09-17T05:40:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:14.329 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":39,"btime":"2024-09-17T05:40:07:868187+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2115736457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2115736457},{"type":"v1","addr":"172.21.15.86:6837","nonce":2115736457}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5668,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/2433734787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2433734787},{"type":"v1","addr":"172.21.15.86:6835","nonce":2433734787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5683,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/442427672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":442427672},{"type":"v1","addr":"172.21.15.44:6835","nonce":442427672}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6174,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/3777564514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":3777564514},{"type":"v1","addr":"172.21.15.44:6834","nonce":3777564514}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[]} 2024-09-17T05:40:14.330 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 39 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.328+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efce8073230 msgr2=0x7efce8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.328+0000 7efd10600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efce8073230 0x7efce8075740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0af000 tx=0x7efcfc01afd0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.328+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd080cb470 msgr2=0x7efd08157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.328+0000 7efd10600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd080cb470 0x7efd08157d90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efd0000cab0 tx=0x7efd0000cf70 comp rx=0 tx=0).stop 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 shutdown_connections 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd080cb470 0x7efd08157d90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efce8073230 0x7efce8075740 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd08072e50 0x7efd08157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 --2- 172.21.15.44:0/2055634248 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efd0806de50 0x7efd081f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 >> 172.21.15.44:0/2055634248 conn(0x7efd080ccaa0 msgr2=0x7efd08159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 shutdown_connections 2024-09-17T05:40:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.332+0000 7efd10600640 1 -- 172.21.15.44:0/2055634248 wait complete. 2024-09-17T05:40:14.352 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:40:14.352 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:40:14.352 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:40:14.352 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:40:14.353 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:40:14.353 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:40:14.353 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:40:14.353 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:40:14.353 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:40:14.353 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:40:14.353 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:40:14.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:40:14.354 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:40:14.354 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:40:14.354 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:40:14.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:40:14.364 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:40:14.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:40:14.370 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:40:14.370 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:40:14.371 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:40:14.371 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:40:14.372 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:40:14.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:40:14.417 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:40:14.418 DEBUG:teuthology.parallel:result is None 2024-09-17T05:40:14.419 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:40:14.419 DEBUG:teuthology.parallel:result is None 2024-09-17T05:40:14.420 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:40:14.420 DEBUG:teuthology.parallel:result is None 2024-09-17T05:40:14.421 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:40:14.421 DEBUG:teuthology.parallel:result is None 2024-09-17T05:40:14.421 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:40:14.518 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:40:14.519 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:40:14.526 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:40:14.526 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:40:14.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 -- 172.21.15.44:0/2069386856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 msgr2=0x7fe7a00ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 --2- 172.21.15.44:0/2069386856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 0x7fe7a00ce490 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe798009bc0 tx=0x7fe79801f3b0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 -- 172.21.15.44:0/2069386856 shutdown_connections 2024-09-17T05:40:14.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 --2- 172.21.15.44:0/2069386856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 0x7fe7a00ce490 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 --2- 172.21.15.44:0/2069386856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7a006e560 0x7fe7a0072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 -- 172.21.15.44:0/2069386856 >> 172.21.15.44:0/2069386856 conn(0x7fe7a00ccaa0 msgr2=0x7fe7a00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:14.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 -- 172.21.15.44:0/2069386856 shutdown_connections 2024-09-17T05:40:14.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 -- 172.21.15.44:0/2069386856 wait complete. 2024-09-17T05:40:14.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 Processor -- start 2024-09-17T05:40:14.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.588+0000 7fe7a8000640 1 -- start start 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 0x7fe7a0166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7a00cef20 0x7fe7a01534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7a0162fe0 0x7fe7a0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a00ce9d0 con 0x7fe7a00cef20 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0071150 con 0x7fe7a00ce080 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a00ceb50 con 0x7fe7a0162fe0 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7a00cef20 0x7fe7a01534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7a00cef20 0x7fe7a01534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60068/0 (socket says 172.21.15.44:60068) 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 -- 172.21.15.44:0/1685365731 learned_addr learned my addr 172.21.15.44:0/1685365731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a5600640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 0x7fe7a0166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a6000640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7a0162fe0 0x7fe7a0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 -- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7a0162fe0 msgr2=0x7fe7a0158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7a0162fe0 0x7fe7a0158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 -- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 msgr2=0x7fe7a0166cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 0x7fe7a0166cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 -- 172.21.15.44:0/1685365731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a015a480 con 0x7fe7a00cef20 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a4c00640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7a00cef20 0x7fe7a01534b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e9f0 tx=0x7fe78c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe79d600640 1 -- 172.21.15.44:0/1685365731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00ccc0 con 0x7fe7a00cef20 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe79d600640 1 -- 172.21.15.44:0/1685365731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe78c010430 con 0x7fe7a00cef20 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe79d600640 1 -- 172.21.15.44:0/1685365731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c010860 con 0x7fe7a00cef20 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a0162820 con 0x7fe7a00cef20 2024-09-17T05:40:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a015a1a0 con 0x7fe7a00cef20 2024-09-17T05:40:14.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.592+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a0072e50 con 0x7fe7a00cef20 2024-09-17T05:40:14.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.596+0000 7fe79d600640 1 -- 172.21.15.44:0/1685365731 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe78c01f020 con 0x7fe7a00cef20 2024-09-17T05:40:14.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.596+0000 7fe79d600640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe780073200 0x7fe780075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:14.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.596+0000 7fe79d600640 1 -- 172.21.15.44:0/1685365731 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5335+0+0 (secure 0 0 0) 0x7fe78c0947d0 con 0x7fe7a00cef20 2024-09-17T05:40:14.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.596+0000 7fe7a5600640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe780073200 0x7fe780075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:14.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.596+0000 7fe7a5600640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe780073200 0x7fe780075710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe794001640 tx=0x7fe794009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:14.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.600+0000 7fe79d600640 1 -- 172.21.15.44:0/1685365731 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe78c05f9e0 con 0x7fe7a00cef20 2024-09-17T05:40:14.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.784+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe7a0159c40 con 0x7fe7a00cef20 2024-09-17T05:40:14.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.912+0000 7fe79d600640 1 -- 172.21.15.44:0/1685365731 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) ==== 97+0+0 (secure 0 0 0) 0x7fe7a0159c40 con 0x7fe7a00cef20 2024-09-17T05:40:14.915 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-17T05:40:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe780073200 msgr2=0x7fe780075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe780073200 0x7fe780075710 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe794001640 tx=0x7fe794009040 comp rx=0 tx=0).stop 2024-09-17T05:40:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7a00cef20 msgr2=0x7fe7a01534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7a00cef20 0x7fe7a01534b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00e9f0 tx=0x7fe78c00eeb0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 shutdown_connections 2024-09-17T05:40:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe7a0162fe0 0x7fe7a0158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7a00cef20 0x7fe7a01534b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe780073200 0x7fe780075710 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 --2- 172.21.15.44:0/1685365731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7a00ce080 0x7fe7a0166cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:14.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 >> 172.21.15.44:0/1685365731 conn(0x7fe7a00ccaa0 msgr2=0x7fe7a006d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:14.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 shutdown_connections 2024-09-17T05:40:14.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:14.916+0000 7fe7a8000640 1 -- 172.21.15.44:0/1685365731 wait complete. 2024-09-17T05:40:14.941 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:40:15.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 -- 172.21.15.44:0/3148871263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc0cc480 msgr2=0x7fbfcc166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 --2- 172.21.15.44:0/3148871263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc0cc480 0x7fbfcc166480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009bf0 tx=0x7fbfc401cb50 comp rx=0 tx=0).stop 2024-09-17T05:40:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 -- 172.21.15.44:0/3148871263 shutdown_connections 2024-09-17T05:40:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 --2- 172.21.15.44:0/3148871263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc0cc480 0x7fbfcc166480 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 -- 172.21.15.44:0/3148871263 >> 172.21.15.44:0/3148871263 conn(0x7fbfcc0ccaa0 msgr2=0x7fbfcc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 -- 172.21.15.44:0/3148871263 shutdown_connections 2024-09-17T05:40:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 -- 172.21.15.44:0/3148871263 wait complete. 2024-09-17T05:40:15.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 Processor -- start 2024-09-17T05:40:15.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.100+0000 7fbfd2800640 1 -- start start 2024-09-17T05:40:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfcc06de50 0x7fbfcc153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc072e50 0x7fbfcc15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfcc0cc480 0x7fbfcc15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc169ff0 con 0x7fbfcc0cc480 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc169e70 con 0x7fbfcc06de50 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbfcc16a170 con 0x7fbfcc072e50 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfcc0cc480 0x7fbfcc15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfcc0cc480 0x7fbfcc15bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60074/0 (socket says 172.21.15.44:60074) 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 -- 172.21.15.44:0/2019834977 learned_addr learned my addr 172.21.15.44:0/2019834977 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcb400640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfcc06de50 0x7fbfcc153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfc2a00640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc072e50 0x7fbfcc15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 -- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc072e50 msgr2=0x7fbfcc15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc072e50 0x7fbfcc15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 -- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfcc06de50 msgr2=0x7fbfcc153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfcc06de50 0x7fbfcc153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 -- 172.21.15.44:0/2019834977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc0a05a0 con 0x7fbfcc0cc480 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcb400640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfcc06de50 0x7fbfcc153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfcbe00640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfcc0cc480 0x7fbfcc15bc70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4019760 tx=0x7fbfc4005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfc3e00640 1 -- 172.21.15.44:0/2019834977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40ba020 con 0x7fbfcc0cc480 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfc3e00640 1 -- 172.21.15.44:0/2019834977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfc4004b40 con 0x7fbfcc0cc480 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfc3e00640 1 -- 172.21.15.44:0/2019834977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40b2040 con 0x7fbfcc0cc480 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc0a0880 con 0x7fbfcc0cc480 2024-09-17T05:40:15.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc15c390 con 0x7fbfcc0cc480 2024-09-17T05:40:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.104+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfcc15c1b0 con 0x7fbfcc0cc480 2024-09-17T05:40:15.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.108+0000 7fbfc3e00640 1 -- 172.21.15.44:0/2019834977 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbfc4003fe0 con 0x7fbfcc0cc480 2024-09-17T05:40:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.108+0000 7fbfc3e00640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbfa8073200 0x7fbfa8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.108+0000 7fbfc3e00640 1 -- 172.21.15.44:0/2019834977 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5249+0+0 (secure 0 0 0) 0x7fbfc412e3c0 con 0x7fbfcc0cc480 2024-09-17T05:40:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.108+0000 7fbfcb400640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbfa8073200 0x7fbfa8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.108+0000 7fbfcb400640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbfa8073200 0x7fbfa8075710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc001130 tx=0x7fbfbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:15.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.112+0000 7fbfc3e00640 1 -- 172.21.15.44:0/2019834977 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbfcc15c1b0 con 0x7fbfcc0cc480 2024-09-17T05:40:15.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbfcc15e990 con 0x7fbfcc0cc480 2024-09-17T05:40:15.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfc3e00640 1 -- 172.21.15.44:0/2019834977 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fbfc40c4020 con 0x7fbfcc0cc480 2024-09-17T05:40:15.348 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:15.348 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw==", 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.349 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow==", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ==", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.350 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA==", 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw==", 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA==", 2024-09-17T05:40:15.352 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg==", 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q==", 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg==", 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.354 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew==", 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA==", 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw==", 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.356 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow==", 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ==", 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw==", 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.358 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A==", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:40:15.359 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQARFelmev8SKhAAoaY75HymG92N8LNMMAUl6g==", 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.360 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA==", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw==", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:40:15.361 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:40:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.362 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:40:15.362 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbfa8073200 msgr2=0x7fbfa8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbfa8073200 0x7fbfa8075710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc001130 tx=0x7fbfbc009040 comp rx=0 tx=0).stop 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfcc0cc480 msgr2=0x7fbfcc15bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfcc0cc480 0x7fbfcc15bc70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4019760 tx=0x7fbfc4005aa0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 shutdown_connections 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbfcc0cc480 0x7fbfcc15bc70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbfcc072e50 0x7fbfcc15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbfa8073200 0x7fbfa8075710 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 --2- 172.21.15.44:0/2019834977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbfcc06de50 0x7fbfcc153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 >> 172.21.15.44:0/2019834977 conn(0x7fbfcc0ccaa0 msgr2=0x7fbfcc15eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:15.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 shutdown_connections 2024-09-17T05:40:15.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.348+0000 7fbfd2800640 1 -- 172.21.15.44:0/2019834977 wait complete. 2024-09-17T05:40:15.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:40:15.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.528+0000 7f0832800640 1 -- 172.21.15.44:0/1301313174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0810003a10 msgr2=0x7f0810003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.528+0000 7f0832800640 1 --2- 172.21.15.44:0/1301313174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0810003a10 0x7f0810003e80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f081c009b60 tx=0x7f081c01d2b0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.528+0000 7f082be00640 1 -- 172.21.15.44:0/1301313174 reap_dead start 2024-09-17T05:40:15.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.528+0000 7f0832800640 1 -- 172.21.15.44:0/1301313174 shutdown_connections 2024-09-17T05:40:15.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.528+0000 7f0832800640 1 -- 172.21.15.44:0/1301313174 >> 172.21.15.44:0/1301313174 conn(0x7f082c0ccaa0 msgr2=0x7f082c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:15.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.528+0000 7f0832800640 1 -- 172.21.15.44:0/1301313174 shutdown_connections 2024-09-17T05:40:15.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.528+0000 7f0832800640 1 -- 172.21.15.44:0/1301313174 wait complete. 2024-09-17T05:40:15.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 Processor -- start 2024-09-17T05:40:15.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 -- start start 2024-09-17T05:40:15.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0810003a10 0x7f082c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f082c1fc5e0 0x7f082c1fc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f082c09f890 0x7f082c09fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f082c167020 con 0x7f082c09f890 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f082c166ea0 con 0x7f0810003a10 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f082c1671a0 con 0x7f082c1fc5e0 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f082c09f890 0x7f082c09fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f082c09f890 0x7f082c09fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60088/0 (socket says 172.21.15.44:60088) 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 -- 172.21.15.44:0/3448215988 learned_addr learned my addr 172.21.15.44:0/3448215988 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0822a00640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f082c1fc5e0 0x7f082c1fc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082b400640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0810003a10 0x7f082c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 -- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f082c1fc5e0 msgr2=0x7f082c1fc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f082c1fc5e0 0x7f082c1fc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 -- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0810003a10 msgr2=0x7f082c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0810003a10 0x7f082c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 -- 172.21.15.44:0/3448215988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082c0a01e0 con 0x7f082c09f890 2024-09-17T05:40:15.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082b400640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0810003a10 0x7f082c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:15.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f082be00640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f082c09f890 0x7f082c09fca0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f082c0c38f0 tx=0x7f08240049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:15.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0823e00640 1 -- 172.21.15.44:0/3448215988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824011660 con 0x7f082c09f890 2024-09-17T05:40:15.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0823e00640 1 -- 172.21.15.44:0/3448215988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0824016070 con 0x7f082c09f890 2024-09-17T05:40:15.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0823e00640 1 -- 172.21.15.44:0/3448215988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824011b90 con 0x7f082c09f890 2024-09-17T05:40:15.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082c160240 con 0x7f082c09f890 2024-09-17T05:40:15.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.532+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f082c1fd570 con 0x7f082c09f890 2024-09-17T05:40:15.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.536+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f082c160410 con 0x7f082c09f890 2024-09-17T05:40:15.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.536+0000 7f0823e00640 1 -- 172.21.15.44:0/3448215988 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f082401b460 con 0x7f082c09f890 2024-09-17T05:40:15.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.536+0000 7f0823e00640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0808073200 0x7f0808075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.536+0000 7f0823e00640 1 -- 172.21.15.44:0/3448215988 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5249+0+0 (secure 0 0 0) 0x7f0824094a90 con 0x7f082c09f890 2024-09-17T05:40:15.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.536+0000 7f082b400640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0808073200 0x7f0808075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.536+0000 7f082b400640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0808073200 0x7f0808075710 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f081c0ae000 tx=0x7f081c01a050 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:15.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.540+0000 7f0823e00640 1 -- 172.21.15.44:0/3448215988 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f082c0a01e0 con 0x7f082c09f890 2024-09-17T05:40:15.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.720+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f082c0b5fa0 con 0x7f082c09f890 2024-09-17T05:40:15.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.720+0000 7f0823e00640 1 -- 172.21.15.44:0/3448215988 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f082c06e7a0 con 0x7f082c09f890 2024-09-17T05:40:15.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:40:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:40:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:40:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:40:15.722 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:15.722 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.720+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0808073200 msgr2=0x7f0808075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.720+0000 7f0832800640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0808073200 0x7f0808075710 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f081c0ae000 tx=0x7f081c01a050 comp rx=0 tx=0).stop 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.720+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f082c09f890 msgr2=0x7f082c09fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.720+0000 7f0832800640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f082c09f890 0x7f082c09fca0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f082c0c38f0 tx=0x7f08240049e0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 shutdown_connections 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f082c09f890 0x7f082c09fca0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f082c1fc5e0 0x7f082c1fc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0808073200 0x7f0808075710 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 --2- 172.21.15.44:0/3448215988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0810003a10 0x7f082c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 >> 172.21.15.44:0/3448215988 conn(0x7f082c0ccaa0 msgr2=0x7f082c06f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 shutdown_connections 2024-09-17T05:40:15.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.724+0000 7f0832800640 1 -- 172.21.15.44:0/3448215988 wait complete. 2024-09-17T05:40:15.744 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:40:15.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:40:15.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 -- 172.21.15.44:0/262428153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c06e660 msgr2=0x7f343c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 --2- 172.21.15.44:0/262428153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c06e660 0x7f343c0cdbc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3434009bf0 tx=0x7f343401c820 comp rx=0 tx=0).stop 2024-09-17T05:40:15.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 -- 172.21.15.44:0/262428153 shutdown_connections 2024-09-17T05:40:15.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 --2- 172.21.15.44:0/262428153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c06e660 0x7f343c0cdbc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 --2- 172.21.15.44:0/262428153 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f343c15b6e0 0x7f343c0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 -- 172.21.15.44:0/262428153 >> 172.21.15.44:0/262428153 conn(0x7f343c09aa40 msgr2=0x7f343c0b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:15.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 -- 172.21.15.44:0/262428153 shutdown_connections 2024-09-17T05:40:15.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.904+0000 7f3443c00640 1 -- 172.21.15.44:0/262428153 wait complete. 2024-09-17T05:40:15.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 Processor -- start 2024-09-17T05:40:15.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 -- start start 2024-09-17T05:40:15.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c0d1ae0 0x7f343c153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f343c15b6e0 0x7f343c0cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f343c153ad0 0x7f343c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f343c168ca0 con 0x7f343c15b6e0 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f343c168b20 con 0x7f343c0d1ae0 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3443c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f343c168e20 con 0x7f343c153ad0 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f343be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f343c15b6e0 0x7f343c0cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f343be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f343c15b6e0 0x7f343c0cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60096/0 (socket says 172.21.15.44:60096) 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3441200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c0d1ae0 0x7f343c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f343be00640 1 -- 172.21.15.44:0/1169432094 learned_addr learned my addr 172.21.15.44:0/1169432094 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.908+0000 7f3441c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f343c153ad0 0x7f343c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.912+0000 7f3441c00640 1 -- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c0d1ae0 msgr2=0x7f343c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.912+0000 7f3441c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c0d1ae0 0x7f343c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.912+0000 7f3441c00640 1 -- 172.21.15.44:0/1169432094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f343c15b6e0 msgr2=0x7f343c0cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:15.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.912+0000 7f3441c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f343c15b6e0 0x7f343c0cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:15.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.912+0000 7f3441c00640 1 -- 172.21.15.44:0/1169432094 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c0c5e00 con 0x7f343c153ad0 2024-09-17T05:40:15.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.912+0000 7f343be00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f343c15b6e0 0x7f343c0cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:40:15.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.912+0000 7f3441c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f343c153ad0 0x7f343c0ccbb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f343c0cecd0 tx=0x7f34340a5770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:15.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.916+0000 7f3438c00640 1 -- 172.21.15.44:0/1169432094 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34340bb070 con 0x7f343c153ad0 2024-09-17T05:40:15.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.916+0000 7f3438c00640 1 -- 172.21.15.44:0/1169432094 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3434004d40 con 0x7f343c153ad0 2024-09-17T05:40:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.916+0000 7f3438c00640 1 -- 172.21.15.44:0/1169432094 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34340b2040 con 0x7f343c153ad0 2024-09-17T05:40:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.916+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c0c60e0 con 0x7f343c153ad0 2024-09-17T05:40:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.916+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c0c66a0 con 0x7f343c153ad0 2024-09-17T05:40:15.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.916+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c0cdbc0 con 0x7f343c153ad0 2024-09-17T05:40:15.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.920+0000 7f3438c00640 1 -- 172.21.15.44:0/1169432094 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f34340be070 con 0x7f343c153ad0 2024-09-17T05:40:15.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.920+0000 7f3438c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f341c073230 0x7f341c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:15.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.920+0000 7f3438c00640 1 -- 172.21.15.44:0/1169432094 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(73..73 src has 1..73) ==== 5249+0+0 (secure 0 0 0) 0x7f343412d950 con 0x7f343c153ad0 2024-09-17T05:40:15.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.920+0000 7f3441200640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f341c073230 0x7f341c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:15.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.920+0000 7f3441200640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f341c073230 0x7f341c075740 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3430009b40 tx=0x7f34300091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:15.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:15.928+0000 7f3438c00640 1 -- 172.21.15.44:0/1169432094 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3434016790 con 0x7f343c153ad0 2024-09-17T05:40:16.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.100+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f343c074a60 con 0x7f343c153ad0 2024-09-17T05:40:16.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.940+0000 7f3438c00640 1 -- 172.21.15.44:0/1169432094 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7f34340f84c0 con 0x7f343c153ad0 2024-09-17T05:40:16.940 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:40:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f341c073230 msgr2=0x7f341c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f341c073230 0x7f341c075740 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3430009b40 tx=0x7f34300091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f343c153ad0 msgr2=0x7f343c0ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f343c153ad0 0x7f343c0ccbb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f343c0cecd0 tx=0x7f34340a5770 comp rx=0 tx=0).stop 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 shutdown_connections 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f343c153ad0 0x7f343c0ccbb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f343c15b6e0 0x7f343c0cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f341c073230 0x7f341c075740 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 --2- 172.21.15.44:0/1169432094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f343c0d1ae0 0x7f343c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 >> 172.21.15.44:0/1169432094 conn(0x7f343c09aa40 msgr2=0x7f343c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 shutdown_connections 2024-09-17T05:40:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:16.944+0000 7f3443c00640 1 -- 172.21.15.44:0/1169432094 wait complete. 2024-09-17T05:40:16.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:40:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.140+0000 7f2496200640 1 -- 172.21.15.44:0/4083963428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 msgr2=0x7f2490070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.140+0000 7f2496200640 1 --2- 172.21.15.44:0/4083963428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f2490070bf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2488009bc0 tx=0x7f248801cba0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.140+0000 7f2496200640 1 -- 172.21.15.44:0/4083963428 shutdown_connections 2024-09-17T05:40:17.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.140+0000 7f2496200640 1 --2- 172.21.15.44:0/4083963428 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f2490070bf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.140+0000 7f2496200640 1 -- 172.21.15.44:0/4083963428 >> 172.21.15.44:0/4083963428 conn(0x7f24900ccaa0 msgr2=0x7f24900cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:17.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.140+0000 7f2496200640 1 -- 172.21.15.44:0/4083963428 shutdown_connections 2024-09-17T05:40:17.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.140+0000 7f2496200640 1 -- 172.21.15.44:0/4083963428 wait complete. 2024-09-17T05:40:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 Processor -- start 2024-09-17T05:40:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 -- start start 2024-09-17T05:40:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f249009c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24900b5880 0x7f24900ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f249009c8e0 0x7f24900ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f249016ace0 con 0x7f24900707e0 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f249016ab60 con 0x7f249009c8e0 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f2496200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f249016ae60 con 0x7f24900b5880 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f249009c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f249009c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60116/0 (socket says 172.21.15.44:60116) 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 -- 172.21.15.44:0/3407554822 learned_addr learned my addr 172.21.15.44:0/3407554822 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248fe00640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f249009c8e0 0x7f24900ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248ea00640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24900b5880 0x7f24900ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 -- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24900b5880 msgr2=0x7f24900ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24900b5880 0x7f24900ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 -- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f249009c8e0 msgr2=0x7f24900ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f249009c8e0 0x7f24900ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 -- 172.21.15.44:0/3407554822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24900a13f0 con 0x7f24900707e0 2024-09-17T05:40:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.144+0000 7f248f400640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f249009c3a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f248000c400 tx=0x7f248000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2487400640 1 -- 172.21.15.44:0/3407554822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480011790 con 0x7f24900707e0 2024-09-17T05:40:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2487400640 1 -- 172.21.15.44:0/3407554822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2480017070 con 0x7f24900707e0 2024-09-17T05:40:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2487400640 1 -- 172.21.15.44:0/3407554822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480011ce0 con 0x7f24900707e0 2024-09-17T05:40:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24900a1110 con 0x7f24900707e0 2024-09-17T05:40:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249009b840 con 0x7f24900707e0 2024-09-17T05:40:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2490070bf0 con 0x7f24900707e0 2024-09-17T05:40:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2487400640 1 -- 172.21.15.44:0/3407554822 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f248001c460 con 0x7f24900707e0 2024-09-17T05:40:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.148+0000 7f2487400640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2470073230 0x7f2470075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.152+0000 7f2487400640 1 -- 172.21.15.44:0/3407554822 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5619+0+0 (secure 0 0 0) 0x7f2480094a70 con 0x7f24900707e0 2024-09-17T05:40:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.152+0000 7f248ea00640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2470073230 0x7f2470075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.152+0000 7f248ea00640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2470073230 0x7f2470075740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24900694b0 tx=0x7f247c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.152+0000 7f2487400640 1 -- 172.21.15.44:0/3407554822 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f248005fac0 con 0x7f24900707e0 2024-09-17T05:40:17.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.332+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f249006dc50 con 0x7f24900707e0 2024-09-17T05:40:17.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.936+0000 7f2487400640 1 -- 172.21.15.44:0/3407554822 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) ==== 170+0+0 (secure 0 0 0) 0x7f248005f3c0 con 0x7f24900707e0 2024-09-17T05:40:17.938 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:40:17.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2470073230 msgr2=0x7f2470075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:17.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2470073230 0x7f2470075740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24900694b0 tx=0x7f247c009040 comp rx=0 tx=0).stop 2024-09-17T05:40:17.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 msgr2=0x7f249009c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:17.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f249009c3a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f248000c400 tx=0x7f248000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 shutdown_connections 2024-09-17T05:40:17.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2470073230 0x7f2470075740 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f249009c8e0 0x7f24900ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24900b5880 0x7f24900ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 --2- 172.21.15.44:0/3407554822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24900707e0 0x7f249009c3a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:17.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 >> 172.21.15.44:0/3407554822 conn(0x7f24900ccaa0 msgr2=0x7f249015df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:17.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 shutdown_connections 2024-09-17T05:40:17.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:17.940+0000 7f2496200640 1 -- 172.21.15.44:0/3407554822 wait complete. 2024-09-17T05:40:17.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:40:18.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 -- 172.21.15.44:0/1951465117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb230072e50 msgr2=0x7fb23015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:18.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 --2- 172.21.15.44:0/1951465117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb230072e50 0x7fb23015e990 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb224009900 tx=0x7fb22401c850 comp rx=0 tx=0).stop 2024-09-17T05:40:18.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 -- 172.21.15.44:0/1951465117 shutdown_connections 2024-09-17T05:40:18.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 --2- 172.21.15.44:0/1951465117 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2300cb470 0x7fb2300cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 --2- 172.21.15.44:0/1951465117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb230072e50 0x7fb23015e990 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 -- 172.21.15.44:0/1951465117 >> 172.21.15.44:0/1951465117 conn(0x7fb2300ccaa0 msgr2=0x7fb2300cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:18.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 -- 172.21.15.44:0/1951465117 shutdown_connections 2024-09-17T05:40:18.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.144+0000 7fb238200640 1 -- 172.21.15.44:0/1951465117 wait complete. 2024-09-17T05:40:18.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 Processor -- start 2024-09-17T05:40:18.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 -- start start 2024-09-17T05:40:18.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23006de50 0x7fb230164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:18.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb230072e50 0x7fb2300c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:18.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2300cb470 0x7fb23006f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:18.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb230168f70 con 0x7fb23006de50 2024-09-17T05:40:18.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb230168df0 con 0x7fb230072e50 2024-09-17T05:40:18.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb238200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb2301690f0 con 0x7fb2300cb470 2024-09-17T05:40:18.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb235800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23006de50 0x7fb230164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:18.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb235800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23006de50 0x7fb230164650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60130/0 (socket says 172.21.15.44:60130) 2024-09-17T05:40:18.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb235800640 1 -- 172.21.15.44:0/1562397213 learned_addr learned my addr 172.21.15.44:0/1562397213 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:18.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb236200640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2300cb470 0x7fb23006f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:18.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.148+0000 7fb234e00640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb230072e50 0x7fb2300c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:18.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb235800640 1 -- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2300cb470 msgr2=0x7fb23006f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:18.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb235800640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2300cb470 0x7fb23006f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb235800640 1 -- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb230072e50 msgr2=0x7fb2300c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:18.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb235800640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb230072e50 0x7fb2300c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb235800640 1 -- 172.21.15.44:0/1562397213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2300c3320 con 0x7fb23006de50 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb235800640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23006de50 0x7fb230164650 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb224009850 tx=0x7fb2240a56a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb22d600640 1 -- 172.21.15.44:0/1562397213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2240b2040 con 0x7fb23006de50 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb22d600640 1 -- 172.21.15.44:0/1562397213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2240043b0 con 0x7fb23006de50 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb22d600640 1 -- 172.21.15.44:0/1562397213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb224005270 con 0x7fb23006de50 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2301fdc60 con 0x7fb23006de50 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2300a0be0 con 0x7fb23006de50 2024-09-17T05:40:18.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.152+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23006e510 con 0x7fb23006de50 2024-09-17T05:40:18.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.156+0000 7fb22d600640 1 -- 172.21.15.44:0/1562397213 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb224005410 con 0x7fb23006de50 2024-09-17T05:40:18.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.156+0000 7fb22d600640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb210073200 0x7fb210075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:18.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.156+0000 7fb22d600640 1 -- 172.21.15.44:0/1562397213 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6001+0+0 (secure 0 0 0) 0x7fb22412d250 con 0x7fb23006de50 2024-09-17T05:40:18.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.156+0000 7fb234e00640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb210073200 0x7fb210075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:18.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.156+0000 7fb234e00640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb210073200 0x7fb210075710 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb2300b1300 tx=0x7fb21c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:18.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.160+0000 7fb22d600640 1 -- 172.21.15.44:0/1562397213 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb2240164d0 con 0x7fb23006de50 2024-09-17T05:40:18.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.368+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb2300a1280 con 0x7fb23006de50 2024-09-17T05:40:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.952+0000 7fb22d600640 1 -- 172.21.15.44:0/1562397213 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v42) ==== 174+0+0 (secure 0 0 0) 0x7fb2240f7b80 con 0x7fb23006de50 2024-09-17T05:40:18.959 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 11 and data pool 12 2024-09-17T05:40:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb210073200 msgr2=0x7fb210075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb210073200 0x7fb210075710 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb2300b1300 tx=0x7fb21c009040 comp rx=0 tx=0).stop 2024-09-17T05:40:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23006de50 msgr2=0x7fb230164650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23006de50 0x7fb230164650 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb224009850 tx=0x7fb2240a56a0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 shutdown_connections 2024-09-17T05:40:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb2300cb470 0x7fb23006f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb210073200 0x7fb210075710 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb230072e50 0x7fb2300c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 --2- 172.21.15.44:0/1562397213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb23006de50 0x7fb230164650 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:18.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.964+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 >> 172.21.15.44:0/1562397213 conn(0x7fb2300ccaa0 msgr2=0x7fb230158940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:18.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.968+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 shutdown_connections 2024-09-17T05:40:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:18.968+0000 7fb238200640 1 -- 172.21.15.44:0/1562397213 wait complete. 2024-09-17T05:40:19.006 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 -- 172.21.15.44:0/4273747065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc406de50 msgr2=0x7f4bc406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 --2- 172.21.15.44:0/4273747065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc406de50 0x7f4bc406e260 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4bc406ace0 tx=0x7f4bac01c830 comp rx=0 tx=0).stop 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 -- 172.21.15.44:0/4273747065 shutdown_connections 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 --2- 172.21.15.44:0/4273747065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc406de50 0x7f4bc406e260 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 --2- 172.21.15.44:0/4273747065 >> v2:172.21.15.86:3300/0 conn(0x7f4bc4072e50 0x7f4bc415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 -- 172.21.15.44:0/4273747065 >> 172.21.15.44:0/4273747065 conn(0x7f4bc40ccaa0 msgr2=0x7f4bc40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 -- 172.21.15.44:0/4273747065 shutdown_connections 2024-09-17T05:40:19.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 -- 172.21.15.44:0/4273747065 wait complete. 2024-09-17T05:40:19.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 Processor -- start 2024-09-17T05:40:19.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.164+0000 7f4bca800640 1 -- start start 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bc406de50 0x7f4bc40c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc4072e50 0x7f4bc4155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bc40ced00 0x7f4bc4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc4169360 con 0x7f4bc4072e50 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc41691e0 con 0x7f4bc40ced00 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4bc41694e0 con 0x7f4bc406de50 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc4072e50 0x7f4bc4155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc4072e50 0x7f4bc4155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58440/0 (socket says 172.21.15.44:58440) 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 -- 172.21.15.44:0/3688827300 learned_addr learned my addr 172.21.15.44:0/3688827300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:19.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bc3400640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bc406de50 0x7f4bc40c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bc3e00640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bc40ced00 0x7f4bc4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 -- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bc406de50 msgr2=0x7f4bc40c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bc406de50 0x7f4bc40c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 -- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bc40ced00 msgr2=0x7f4bc4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bc40ced00 0x7f4bc4155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 -- 172.21.15.44:0/3688827300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc40c82a0 con 0x7f4bc4072e50 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbbe00640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc4072e50 0x7f4bc4155640 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4bac019440 tx=0x7f4bac005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbb400640 1 -- 172.21.15.44:0/3688827300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0bd070 con 0x7f4bc4072e50 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbb400640 1 -- 172.21.15.44:0/3688827300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bac004330 con 0x7f4bc4072e50 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bbb400640 1 -- 172.21.15.44:0/3688827300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b2040 con 0x7f4bc4072e50 2024-09-17T05:40:19.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc40c8580 con 0x7f4bc4072e50 2024-09-17T05:40:19.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc4156110 con 0x7f4bc4072e50 2024-09-17T05:40:19.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.168+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc40ae870 con 0x7f4bc4072e50 2024-09-17T05:40:19.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.172+0000 7f4bbb400640 1 -- 172.21.15.44:0/3688827300 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4bac005290 con 0x7f4bc4072e50 2024-09-17T05:40:19.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.172+0000 7f4bbb400640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4ba0073230 0x7f4ba0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.172+0000 7f4bbb400640 1 -- 172.21.15.44:0/3688827300 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f4bac12dfe0 con 0x7f4bc4072e50 2024-09-17T05:40:19.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.172+0000 7f4bc3400640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4ba0073230 0x7f4ba0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.172+0000 7f4bc3400640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4ba0073230 0x7f4ba0075740 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009b40 tx=0x7f4bb40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.176+0000 7f4bbb400640 1 -- 172.21.15.44:0/3688827300 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4bac0164b0 con 0x7f4bc4072e50 2024-09-17T05:40:19.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.348+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bc40b5fa0 con 0x7f4bc4072e50 2024-09-17T05:40:19.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bbb400640 1 -- 172.21.15.44:0/3688827300 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16910 (secure 0 0 0) 0x7f4bac0f8890 con 0x7f4bc4072e50 2024-09-17T05:40:19.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:19.353 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":76,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:40:18.372352+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:40:16.116014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T05:40:17.345384+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:40:19.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4ba0073230 msgr2=0x7f4ba0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4ba0073230 0x7f4ba0075740 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009b40 tx=0x7f4bb40091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc4072e50 msgr2=0x7f4bc4155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc4072e50 0x7f4bc4155640 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4bac019440 tx=0x7f4bac005e50 comp rx=0 tx=0).stop 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 shutdown_connections 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4ba0073230 0x7f4ba0075740 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bc40ced00 0x7f4bc4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bc4072e50 0x7f4bc4155640 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 --2- 172.21.15.44:0/3688827300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4bc406de50 0x7f4bc40c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 >> 172.21.15.44:0/3688827300 conn(0x7f4bc40ccaa0 msgr2=0x7f4bc40cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:19.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 shutdown_connections 2024-09-17T05:40:19.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.352+0000 7f4bca800640 1 -- 172.21.15.44:0/3688827300 wait complete. 2024-09-17T05:40:19.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:40:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 -- 172.21.15.44:0/2864928454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf4073150 msgr2=0x7fadf415eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 --2- 172.21.15.44:0/2864928454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf4073150 0x7fadf415eda0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fadf40726c0 tx=0x7faddc01c800 comp rx=0 tx=0).stop 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 -- 172.21.15.44:0/2864928454 shutdown_connections 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 --2- 172.21.15.44:0/2864928454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf4073150 0x7fadf415eda0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 --2- 172.21.15.44:0/2864928454 >> v2:172.21.15.86:3300/0 conn(0x7fadf40b4f60 0x7fadf4072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 -- 172.21.15.44:0/2864928454 >> 172.21.15.44:0/2864928454 conn(0x7fadf406ce40 msgr2=0x7fadf406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 -- 172.21.15.44:0/2864928454 shutdown_connections 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.532+0000 7fadf9000640 1 -- 172.21.15.44:0/2864928454 wait complete. 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 Processor -- start 2024-09-17T05:40:19.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 -- start start 2024-09-17T05:40:19.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadf4073150 0x7fadf4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadf40b4f60 0x7fadf4151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf415f2e0 0x7fadf4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fadf40b4600 con 0x7fadf415f2e0 2024-09-17T05:40:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fadf40b4480 con 0x7fadf40b4f60 2024-09-17T05:40:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf9000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fadf4168f40 con 0x7fadf4073150 2024-09-17T05:40:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf415f2e0 0x7fadf4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf415f2e0 0x7fadf4155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58446/0 (socket says 172.21.15.44:58446) 2024-09-17T05:40:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 -- 172.21.15.44:0/2087169263 learned_addr learned my addr 172.21.15.44:0/2087169263 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:19.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3400640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadf4073150 0x7fadf4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadebe00640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadf40b4f60 0x7fadf4151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 -- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadf4073150 msgr2=0x7fadf4153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadf4073150 0x7fadf4153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 -- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadf40b4f60 msgr2=0x7fadf4151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadf40b4f60 0x7fadf4151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 -- 172.21.15.44:0/2087169263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf4154450 con 0x7fadf415f2e0 2024-09-17T05:40:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadf3e00640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf415f2e0 0x7fadf4155d30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fadec00cb40 tx=0x7fadec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.536+0000 7fadeb400640 1 -- 172.21.15.44:0/2087169263 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec016020 con 0x7fadf415f2e0 2024-09-17T05:40:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadeb400640 1 -- 172.21.15.44:0/2087169263 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadec00ab40 con 0x7fadf415f2e0 2024-09-17T05:40:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf4154730 con 0x7fadf415f2e0 2024-09-17T05:40:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadeb400640 1 -- 172.21.15.44:0/2087169263 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec012420 con 0x7fadf415f2e0 2024-09-17T05:40:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf4154cf0 con 0x7fadf415f2e0 2024-09-17T05:40:19.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf415eda0 con 0x7fadf415f2e0 2024-09-17T05:40:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadeb400640 1 -- 172.21.15.44:0/2087169263 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fadec019020 con 0x7fadf415f2e0 2024-09-17T05:40:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadeb400640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fadd0073200 0x7fadd0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadeb400640 1 -- 172.21.15.44:0/2087169263 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7fadec094550 con 0x7fadf415f2e0 2024-09-17T05:40:19.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.540+0000 7fadf3400640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fadd0073200 0x7fadd0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.544+0000 7fadf3400640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fadd0073200 0x7fadd0075710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fadf4073e60 tx=0x7fade400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:19.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.544+0000 7fadeb400640 1 -- 172.21.15.44:0/2087169263 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fadec020020 con 0x7fadf415f2e0 2024-09-17T05:40:19.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.724+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadf40cc610 con 0x7fadf415f2e0 2024-09-17T05:40:19.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.724+0000 7fadeb400640 1 -- 172.21.15.44:0/2087169263 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16910 (secure 0 0 0) 0x7fadf4073560 con 0x7fadf415f2e0 2024-09-17T05:40:19.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:19.726 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":76,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:40:18.372352+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:40:16.116014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T05:40:17.345384+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:40:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fadd0073200 msgr2=0x7fadd0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fadd0073200 0x7fadd0075710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fadf4073e60 tx=0x7fade400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf415f2e0 msgr2=0x7fadf4155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf415f2e0 0x7fadf4155d30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fadec00cb40 tx=0x7fadec00cc30 comp rx=0 tx=0).stop 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 shutdown_connections 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadf415f2e0 0x7fadf4155d30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fadd0073200 0x7fadd0075710 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadf40b4f60 0x7fadf4151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 --2- 172.21.15.44:0/2087169263 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadf4073150 0x7fadf4153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 >> 172.21.15.44:0/2087169263 conn(0x7fadf406ce40 msgr2=0x7fadf406f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 shutdown_connections 2024-09-17T05:40:19.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.728+0000 7fadf9000640 1 -- 172.21.15.44:0/2087169263 wait complete. 2024-09-17T05:40:19.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:40:19.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 -- 172.21.15.44:0/941891685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180b5880 msgr2=0x7f3e1806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/941891685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180b5880 0x7f3e1806de50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3e18072340 tx=0x7f3e0801c800 comp rx=0 tx=0).stop 2024-09-17T05:40:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 -- 172.21.15.44:0/941891685 shutdown_connections 2024-09-17T05:40:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/941891685 >> v2:172.21.15.86:3300/0 conn(0x7f3e1806e390 0x7f3e180cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/941891685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180b5880 0x7f3e1806de50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 -- 172.21.15.44:0/941891685 >> 172.21.15.44:0/941891685 conn(0x7f3e180ccaa0 msgr2=0x7f3e180cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 -- 172.21.15.44:0/941891685 shutdown_connections 2024-09-17T05:40:19.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.908+0000 7f3e1cc00640 1 -- 172.21.15.44:0/941891685 wait complete. 2024-09-17T05:40:19.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 Processor -- start 2024-09-17T05:40:19.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 -- start start 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e1806e390 0x7f3e1809ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e180b5880 0x7f3e18156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180ce130 0x7f3e1809c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1816a2c0 con 0x7f3e180ce130 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1816a140 con 0x7f3e180b5880 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.912+0000 7f3e1cc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1816a440 con 0x7f3e1806e390 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180ce130 0x7f3e1809c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180ce130 0x7f3e1809c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58476/0 (socket says 172.21.15.44:58476) 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 -- 172.21.15.44:0/680322497 learned_addr learned my addr 172.21.15.44:0/680322497 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e0fe00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e180b5880 0x7f3e18156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e15e00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e1806e390 0x7f3e1809ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 -- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e1806e390 msgr2=0x7f3e1809ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e1806e390 0x7f3e1809ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 -- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e180b5880 msgr2=0x7f3e18156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e180b5880 0x7f3e18156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 -- 172.21.15.44:0/680322497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1815e3e0 con 0x7f3e180ce130 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e0fe00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e180b5880 0x7f3e18156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e16800640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180ce130 0x7f3e1809c460 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000cad0 tx=0x7f3e1000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e0e000640 1 -- 172.21.15.44:0/680322497 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10016020 con 0x7f3e180ce130 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e0e000640 1 -- 172.21.15.44:0/680322497 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e1000ab40 con 0x7f3e180ce130 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e0e000640 1 -- 172.21.15.44:0/680322497 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000ce10 con 0x7f3e180ce130 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1809e770 con 0x7f3e180ce130 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1815e680 con 0x7f3e180ce130 2024-09-17T05:40:19.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e180cdbf0 con 0x7f3e180ce130 2024-09-17T05:40:19.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.916+0000 7f3e0e000640 1 -- 172.21.15.44:0/680322497 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e10019020 con 0x7f3e180ce130 2024-09-17T05:40:19.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.920+0000 7f3e0e000640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3df4073230 0x7f3df4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:19.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.920+0000 7f3e0e000640 1 -- 172.21.15.44:0/680322497 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6101+0+0 (secure 0 0 0) 0x7f3e100944f0 con 0x7f3e180ce130 2024-09-17T05:40:19.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.920+0000 7f3e15e00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3df4073230 0x7f3df4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:19.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.920+0000 7f3e15e00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3df4073230 0x7f3df4075740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e080af000 tx=0x7f3e0801b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:19.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:19.924+0000 7f3e0e000640 1 -- 172.21.15.44:0/680322497 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3e10020020 con 0x7f3e180ce130 2024-09-17T05:40:20.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.136+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3e1815dd30 con 0x7f3e180ce130 2024-09-17T05:40:20.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.960+0000 7f3e0e000640 1 -- 172.21.15.44:0/680322497 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) ==== 118+0+0 (secure 0 0 0) 0x7f3e1806e7a0 con 0x7f3e180ce130 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3df4073230 msgr2=0x7f3df4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3df4073230 0x7f3df4075740 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e080af000 tx=0x7f3e0801b040 comp rx=0 tx=0).stop 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180ce130 msgr2=0x7f3e1809c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180ce130 0x7f3e1809c460 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000cad0 tx=0x7f3e1000cbc0 comp rx=0 tx=0).stop 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 shutdown_connections 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e180ce130 0x7f3e1809c460 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3df4073230 0x7f3df4075740 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e180b5880 0x7f3e18156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 --2- 172.21.15.44:0/680322497 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e1806e390 0x7f3e1809ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:20.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 >> 172.21.15.44:0/680322497 conn(0x7f3e180ccaa0 msgr2=0x7f3e1815bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:20.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 shutdown_connections 2024-09-17T05:40:20.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:20.964+0000 7f3e1cc00640 1 -- 172.21.15.44:0/680322497 wait complete. 2024-09-17T05:40:20.991 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:40:20.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:40:21.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 -- 172.21.15.44:0/3503914407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca90145c50 msgr2=0x7fca9015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:21.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 --2- 172.21.15.44:0/3503914407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca90145c50 0x7fca9015c900 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fca900d1fd0 tx=0x7fca8001c770 comp rx=0 tx=0).stop 2024-09-17T05:40:21.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 -- 172.21.15.44:0/3503914407 shutdown_connections 2024-09-17T05:40:21.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 --2- 172.21.15.44:0/3503914407 >> v2:172.21.15.86:3300/0 conn(0x7fca900c6ec0 0x7fca900b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 --2- 172.21.15.44:0/3503914407 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca90145c50 0x7fca9015c900 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 -- 172.21.15.44:0/3503914407 >> 172.21.15.44:0/3503914407 conn(0x7fca900d2000 msgr2=0x7fca900d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:21.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 -- 172.21.15.44:0/3503914407 shutdown_connections 2024-09-17T05:40:21.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.156+0000 7fca95000640 1 -- 172.21.15.44:0/3503914407 wait complete. 2024-09-17T05:40:21.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 Processor -- start 2024-09-17T05:40:21.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 -- start start 2024-09-17T05:40:21.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca900c6ec0 0x7fca9006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:21.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca900c72d0 0x7fca901432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:21.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca90145c50 0x7fca9015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:21.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca9016a0a0 con 0x7fca900c6ec0 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca90169f20 con 0x7fca90145c50 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fca9016a220 con 0x7fca900c72d0 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca900c6ec0 0x7fca9006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca900c6ec0 0x7fca9006eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58484/0 (socket says 172.21.15.44:58484) 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 -- 172.21.15.44:0/3055080032 learned_addr learned my addr 172.21.15.44:0/3055080032 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 -- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca900c72d0 msgr2=0x7fca901432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca900c72d0 0x7fca901432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 -- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca90145c50 msgr2=0x7fca9015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca90145c50 0x7fca9015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 -- 172.21.15.44:0/3055080032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9006e0f0 con 0x7fca900c6ec0 2024-09-17T05:40:21.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca8f400640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca900c6ec0 0x7fca9006eeb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fca80000c10 tx=0x7fca800a5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca87400640 1 -- 172.21.15.44:0/3055080032 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca800bb070 con 0x7fca900c6ec0 2024-09-17T05:40:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca87400640 1 -- 172.21.15.44:0/3055080032 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca80005030 con 0x7fca900c6ec0 2024-09-17T05:40:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca87400640 1 -- 172.21.15.44:0/3055080032 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca800b2040 con 0x7fca900c6ec0 2024-09-17T05:40:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9006e3d0 con 0x7fca900c6ec0 2024-09-17T05:40:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.160+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9006e990 con 0x7fca900c6ec0 2024-09-17T05:40:21.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.164+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9015fb10 con 0x7fca900c6ec0 2024-09-17T05:40:21.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.164+0000 7fca87400640 1 -- 172.21.15.44:0/3055080032 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fca800be070 con 0x7fca900c6ec0 2024-09-17T05:40:21.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.164+0000 7fca87400640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca6c073200 0x7fca6c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:21.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.164+0000 7fca87400640 1 -- 172.21.15.44:0/3055080032 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7fca8012dd90 con 0x7fca900c6ec0 2024-09-17T05:40:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.164+0000 7fca87e00640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca6c073200 0x7fca6c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.168+0000 7fca87e00640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca6c073200 0x7fca6c075710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca9015e7a0 tx=0x7fca78005cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:21.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.168+0000 7fca87400640 1 -- 172.21.15.44:0/3055080032 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fca800f2db0 con 0x7fca900c6ec0 2024-09-17T05:40:21.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.380+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fca9015f830 con 0x7fca900c6ec0 2024-09-17T05:40:21.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.964+0000 7fca87400640 1 -- 172.21.15.44:0/3055080032 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fca800163f0 con 0x7fca900c6ec0 2024-09-17T05:40:21.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.964+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca6c073200 msgr2=0x7fca6c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.964+0000 7fca95000640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca6c073200 0x7fca6c075710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fca9015e7a0 tx=0x7fca78005cf0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.964+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca900c6ec0 msgr2=0x7fca9006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.964+0000 7fca95000640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca900c6ec0 0x7fca9006eeb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fca80000c10 tx=0x7fca800a5f70 comp rx=0 tx=0).stop 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.964+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 shutdown_connections 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.964+0000 7fca95000640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fca6c073200 0x7fca6c075710 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.968+0000 7fca95000640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca90145c50 0x7fca9015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.968+0000 7fca95000640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fca900c72d0 0x7fca901432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.968+0000 7fca95000640 1 --2- 172.21.15.44:0/3055080032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca900c6ec0 0x7fca9006eeb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.968+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 >> 172.21.15.44:0/3055080032 conn(0x7fca900d2000 msgr2=0x7fca90068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.968+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 shutdown_connections 2024-09-17T05:40:21.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:21.968+0000 7fca95000640 1 -- 172.21.15.44:0/3055080032 wait complete. 2024-09-17T05:40:21.993 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:40:21.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.156+0000 7f91ae400640 1 -- 172.21.15.44:0/3230128310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80cef20 msgr2=0x7f91a8072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.156+0000 7f91ae400640 1 --2- 172.21.15.44:0/3230128310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80cef20 0x7f91a8072e50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f919800a950 tx=0x7f9198020360 comp rx=0 tx=0).stop 2024-09-17T05:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.156+0000 7f91ae400640 1 -- 172.21.15.44:0/3230128310 shutdown_connections 2024-09-17T05:40:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.156+0000 7f91ae400640 1 --2- 172.21.15.44:0/3230128310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80cef20 0x7f91a8072e50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.156+0000 7f91ae400640 1 -- 172.21.15.44:0/3230128310 >> 172.21.15.44:0/3230128310 conn(0x7f91a80ccaa0 msgr2=0x7f91a80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.156+0000 7f91ae400640 1 -- 172.21.15.44:0/3230128310 shutdown_connections 2024-09-17T05:40:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.156+0000 7f91ae400640 1 -- 172.21.15.44:0/3230128310 wait complete. 2024-09-17T05:40:22.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 Processor -- start 2024-09-17T05:40:22.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 -- start start 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91a806de50 0x7f91a8156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80ce080 0x7f91a81f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91a80cef20 0x7f91a80b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91a80710c0 con 0x7f91a80ce080 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91a8070f40 con 0x7f91a806de50 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91ae400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f91a81663a0 con 0x7f91a80cef20 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f919fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80ce080 0x7f91a81f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91a7400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91a806de50 0x7f91a8156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f919fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80ce080 0x7f91a81f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58516/0 (socket says 172.21.15.44:58516) 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f919fe00640 1 -- 172.21.15.44:0/4026996211 learned_addr learned my addr 172.21.15.44:0/4026996211 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.160+0000 7f91a7e00640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91a80cef20 0x7f91a80b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919fe00640 1 -- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91a80cef20 msgr2=0x7f91a80b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919fe00640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91a80cef20 0x7f91a80b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919fe00640 1 -- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91a806de50 msgr2=0x7f91a8156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919fe00640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91a806de50 0x7f91a8156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919fe00640 1 -- 172.21.15.44:0/4026996211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a8155290 con 0x7f91a80ce080 2024-09-17T05:40:22.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919fe00640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80ce080 0x7f91a81f5b20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f919000c450 tx=0x7f919000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:22.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919f400640 1 -- 172.21.15.44:0/4026996211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900052d0 con 0x7f91a80ce080 2024-09-17T05:40:22.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919f400640 1 -- 172.21.15.44:0/4026996211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9190005470 con 0x7f91a80ce080 2024-09-17T05:40:22.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919f400640 1 -- 172.21.15.44:0/4026996211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190012870 con 0x7f91a80ce080 2024-09-17T05:40:22.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a8155570 con 0x7f91a80ce080 2024-09-17T05:40:22.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a80c8970 con 0x7f91a80ce080 2024-09-17T05:40:22.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a8072e50 con 0x7f91a80ce080 2024-09-17T05:40:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.164+0000 7f919f400640 1 -- 172.21.15.44:0/4026996211 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9190003600 con 0x7f91a80ce080 2024-09-17T05:40:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.168+0000 7f919f400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9184073200 0x7f9184075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.168+0000 7f919f400640 1 -- 172.21.15.44:0/4026996211 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f9190093da0 con 0x7f91a80ce080 2024-09-17T05:40:22.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.168+0000 7f91a7400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9184073200 0x7f9184075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.168+0000 7f91a7400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9184073200 0x7f9184075710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f91980b2000 tx=0x7f919801eba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:22.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.172+0000 7f919f400640 1 -- 172.21.15.44:0/4026996211 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f919005e5d0 con 0x7f91a80ce080 2024-09-17T05:40:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.380+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91a80c8c70 con 0x7f91a80ce080 2024-09-17T05:40:22.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.380+0000 7f919f400640 1 -- 172.21.15.44:0/4026996211 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5222 (secure 0 0 0) 0x7f9190063000 con 0x7f91a80ce080 2024-09-17T05:40:22.383 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:22.383 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"btime":"2024-09-17T05:40:21:965701+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:40:21.385772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6261":{"gid":6261,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/330558786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":330558786},{"type":"v1","addr":"172.21.15.44:6834","nonce":330558786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6261,"qdb_cluster":[6261]},"id":5}]} 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 46 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9184073200 msgr2=0x7f9184075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9184073200 0x7f9184075710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f91980b2000 tx=0x7f919801eba0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80ce080 msgr2=0x7f91a81f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80ce080 0x7f91a81f5b20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f919000c450 tx=0x7f919000c910 comp rx=0 tx=0).stop 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 shutdown_connections 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f91a80cef20 0x7f91a80b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91a80ce080 0x7f91a81f5b20 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9184073200 0x7f9184075710 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 --2- 172.21.15.44:0/4026996211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91a806de50 0x7f91a8156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 >> 172.21.15.44:0/4026996211 conn(0x7f91a80ccaa0 msgr2=0x7f91a8073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:22.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 shutdown_connections 2024-09-17T05:40:22.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.384+0000 7f91ae400640 1 -- 172.21.15.44:0/4026996211 wait complete. 2024-09-17T05:40:22.404 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.560+0000 7f8e52200640 1 -- 172.21.15.44:0/3881521491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c0cb040 msgr2=0x7f8e4c0cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.560+0000 7f8e52200640 1 --2- 172.21.15.44:0/3881521491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c0cb040 0x7f8e4c0cf190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009840 tx=0x7f8e3401c820 comp rx=0 tx=0).stop 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.560+0000 7f8e52200640 1 -- 172.21.15.44:0/3881521491 shutdown_connections 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.560+0000 7f8e52200640 1 --2- 172.21.15.44:0/3881521491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c0cb040 0x7f8e4c0cf190 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.560+0000 7f8e52200640 1 --2- 172.21.15.44:0/3881521491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e4c0cac30 0x7f8e4c0cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.560+0000 7f8e52200640 1 -- 172.21.15.44:0/3881521491 >> 172.21.15.44:0/3881521491 conn(0x7f8e4c0ccaa0 msgr2=0x7f8e4c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.560+0000 7f8e52200640 1 -- 172.21.15.44:0/3881521491 shutdown_connections 2024-09-17T05:40:22.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 -- 172.21.15.44:0/3881521491 wait complete. 2024-09-17T05:40:22.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 Processor -- start 2024-09-17T05:40:22.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 -- start start 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e4c0cac30 0x7f8e4c1f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e4c0cb040 0x7f8e4c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c15e8c0 0x7f8e4c09bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c1663f0 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c166270 con 0x7f8e4c0cac30 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e52200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c166570 con 0x7f8e4c0cb040 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.564+0000 7f8e4be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c15e8c0 0x7f8e4c09bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c15e8c0 0x7f8e4c09bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58530/0 (socket says 172.21.15.44:58530) 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 -- 172.21.15.44:0/1175070413 learned_addr learned my addr 172.21.15.44:0/1175070413 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:22.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4b400640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e4c0cac30 0x7f8e4c1f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e42a00640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e4c0cb040 0x7f8e4c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 -- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e4c0cb040 msgr2=0x7f8e4c156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e4c0cb040 0x7f8e4c156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 -- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e4c0cac30 msgr2=0x7f8e4c1f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e4c0cac30 0x7f8e4c1f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 -- 172.21.15.44:0/1175070413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c159e80 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e4be00640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c15e8c0 0x7f8e4c09bff0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8e44002240 tx=0x7f8e4400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e43e00640 1 -- 172.21.15.44:0/1175070413 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44016020 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e43e00640 1 -- 172.21.15.44:0/1175070413 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e4400a930 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c1f76b0 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e43e00640 1 -- 172.21.15.44:0/1175070413 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400ad80 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c09ca50 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c1f83f0 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.568+0000 7f8e43e00640 1 -- 172.21.15.44:0/1175070413 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8e44019020 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.572+0000 7f8e43e00640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8e28073200 0x7f8e28075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.572+0000 7f8e43e00640 1 -- 172.21.15.44:0/1175070413 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f8e44094500 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.572+0000 7f8e4b400640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8e28073200 0x7f8e28075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.572+0000 7f8e4b400640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8e28073200 0x7f8e28075710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009b40 tx=0x7f8e3c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:22.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.576+0000 7f8e43e00640 1 -- 172.21.15.44:0/1175070413 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8e4c1f83f0 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.752+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e4c1f74a0 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.752+0000 7f8e43e00640 1 -- 172.21.15.44:0/1175070413 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+16897 (secure 0 0 0) 0x7f8e44020020 con 0x7f8e4c15e8c0 2024-09-17T05:40:22.755 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:22.755 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":77,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:40:19.954025+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:40:16.116014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T05:40:17.345384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:40:22.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8e28073200 msgr2=0x7f8e28075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8e28073200 0x7f8e28075710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009b40 tx=0x7f8e3c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c15e8c0 msgr2=0x7f8e4c09bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c15e8c0 0x7f8e4c09bff0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8e44002240 tx=0x7f8e4400cba0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 shutdown_connections 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e4c15e8c0 0x7f8e4c09bff0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8e4c0cb040 0x7f8e4c156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8e28073200 0x7f8e28075710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 --2- 172.21.15.44:0/1175070413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e4c0cac30 0x7f8e4c1f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 >> 172.21.15.44:0/1175070413 conn(0x7f8e4c0ccaa0 msgr2=0x7f8e4c0cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 shutdown_connections 2024-09-17T05:40:22.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.756+0000 7f8e52200640 1 -- 172.21.15.44:0/1175070413 wait complete. 2024-09-17T05:40:22.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:40:22.778 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:40:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.932+0000 7f617ba00640 1 -- 172.21.15.44:0/2181490468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 msgr2=0x7f61740cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.932+0000 7f617ba00640 1 --2- 172.21.15.44:0/2181490468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f61740cf070 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6160009840 tx=0x7f616001c760 comp rx=0 tx=0).stop 2024-09-17T05:40:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.932+0000 7f617ba00640 1 -- 172.21.15.44:0/2181490468 shutdown_connections 2024-09-17T05:40:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.932+0000 7f617ba00640 1 --2- 172.21.15.44:0/2181490468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f61740cf070 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.932+0000 7f617ba00640 1 -- 172.21.15.44:0/2181490468 >> 172.21.15.44:0/2181490468 conn(0x7f61740b4240 msgr2=0x7f61740b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 -- 172.21.15.44:0/2181490468 shutdown_connections 2024-09-17T05:40:22.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 -- 172.21.15.44:0/2181490468 wait complete. 2024-09-17T05:40:22.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 Processor -- start 2024-09-17T05:40:22.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 -- start start 2024-09-17T05:40:22.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61740cf5b0 0x7f61741515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61740d18f0 0x7f6174166140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f6174166680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f617416b080 con 0x7f61740d1d00 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f617416af00 con 0x7f61740cf5b0 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f617ba00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f617416b200 con 0x7f61740d18f0 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.936+0000 7f6179a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f6174166680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f6174166680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58542/0 (socket says 172.21.15.44:58542) 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 -- 172.21.15.44:0/3445538719 learned_addr learned my addr 172.21.15.44:0/3445538719 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6173e00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61740d18f0 0x7f6174166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179000640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61740cf5b0 0x7f61741515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 -- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61740d18f0 msgr2=0x7f6174166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61740d18f0 0x7f6174166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 -- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61740cf5b0 msgr2=0x7f61741515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61740cf5b0 0x7f61741515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 -- 172.21.15.44:0/3445538719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6174167060 con 0x7f61740d1d00 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179000640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61740cf5b0 0x7f61741515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6179a00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f6174166680 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f616c00cb10 tx=0x7f616c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6170c00640 1 -- 172.21.15.44:0/3445538719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c016020 con 0x7f61740d1d00 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6170c00640 1 -- 172.21.15.44:0/3445538719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f616c00ce50 con 0x7f61740d1d00 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6170c00640 1 -- 172.21.15.44:0/3445538719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c00ada0 con 0x7f61740d1d00 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61740b5270 con 0x7f61740d1d00 2024-09-17T05:40:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6174165a30 con 0x7f61740d1d00 2024-09-17T05:40:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61740cf070 con 0x7f61740d1d00 2024-09-17T05:40:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.940+0000 7f6170c00640 1 -- 172.21.15.44:0/3445538719 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f616c019020 con 0x7f61740d1d00 2024-09-17T05:40:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.944+0000 7f6170c00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6154073200 0x7f6154075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.944+0000 7f6170c00640 1 -- 172.21.15.44:0/3445538719 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f616c094370 con 0x7f61740d1d00 2024-09-17T05:40:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.944+0000 7f6179000640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6154073200 0x7f6154075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.944+0000 7f6179000640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6154073200 0x7f6154075710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6168001630 tx=0x7f6168009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:22.948+0000 7f6170c00640 1 -- 172.21.15.44:0/3445538719 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f616c020030 con 0x7f61740d1d00 2024-09-17T05:40:23.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.120+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6174167340 con 0x7f6154073200 2024-09-17T05:40:23.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.128+0000 7f6170c00640 1 -- 172.21.15.44:0/3445538719 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251076 (secure 0 0 0) 0x7f6174167340 con 0x7f6154073200 2024-09-17T05:40:23.131 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:23.132 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.128+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6154073200 msgr2=0x7f6154075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.128+0000 7f617ba00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6154073200 0x7f6154075710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6168001630 tx=0x7f6168009040 comp rx=0 tx=0).stop 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.128+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 msgr2=0x7f6174166680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.128+0000 7f617ba00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f6174166680 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f616c00cb10 tx=0x7f616c00cc00 comp rx=0 tx=0).stop 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 shutdown_connections 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61740d1d00 0x7f6174166680 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f61740d18f0 0x7f6174166140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6154073200 0x7f6154075710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 --2- 172.21.15.44:0/3445538719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61740cf5b0 0x7f61741515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 >> 172.21.15.44:0/3445538719 conn(0x7f61740b4240 msgr2=0x7f6174068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 shutdown_connections 2024-09-17T05:40:23.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.132+0000 7f617ba00640 1 -- 172.21.15.44:0/3445538719 wait complete. 2024-09-17T05:40:23.152 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-17T05:40:22.324757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253824,"kb_used_data":8440,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720896,"statfs":{"total":773094113280,"available":772834197504,"internally_reserved":0,"allocated":8642560,"data_stored":4535146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.388951"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.881021+0000","last_change":"2024-09-17T05:40:18.975938+0000","last_active":"2024-09-17T05:40:20.881021+0000","last_peered":"2024-09-17T05:40:20.881021+0000","last_clean":"2024-09-17T05:40:20.881021+0000","last_became_active":"2024-09-17T05:40:18.974724+0000","last_became_peered":"2024-09-17T05:40:18.974724+0000","last_unstale":"2024-09-17T05:40:20.881021+0000","last_undegraded":"2024-09-17T05:40:20.881021+0000","last_fullsized":"2024-09-17T05:40:20.881021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.159194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.947782+0000","last_change":"2024-09-17T05:40:17.947782+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.947782+0000","last_undegraded":"2024-09-17T05:40:17.947782+0000","last_fullsized":"2024-09-17T05:40:17.947782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.948891+0000","last_change":"2024-09-17T05:40:17.948891+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.948891+0000","last_undegraded":"2024-09-17T05:40:17.948891+0000","last_fullsized":"2024-09-17T05:40:17.948891+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746017+0000","last_change":"2024-09-17T05:40:18.964044+0000","last_active":"2024-09-17T05:40:20.746017+0000","last_peered":"2024-09-17T05:40:20.746017+0000","last_clean":"2024-09-17T05:40:20.746017+0000","last_became_active":"2024-09-17T05:40:18.963750+0000","last_became_peered":"2024-09-17T05:40:18.963750+0000","last_unstale":"2024-09-17T05:40:20.746017+0000","last_undegraded":"2024-09-17T05:40:20.746017+0000","last_fullsized":"2024-09-17T05:40:20.746017+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:14.837382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878318+0000","last_change":"2024-09-17T05:40:18.968256+0000","last_active":"2024-09-17T05:40:20.878318+0000","last_peered":"2024-09-17T05:40:20.878318+0000","last_clean":"2024-09-17T05:40:20.878318+0000","last_became_active":"2024-09-17T05:40:18.967470+0000","last_became_peered":"2024-09-17T05:40:18.967470+0000","last_unstale":"2024-09-17T05:40:20.878318+0000","last_undegraded":"2024-09-17T05:40:20.878318+0000","last_fullsized":"2024-09-17T05:40:20.878318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:24.741584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965291+0000","last_change":"2024-09-17T05:40:18.967355+0000","last_active":"2024-09-17T05:40:19.965291+0000","last_peered":"2024-09-17T05:40:19.965291+0000","last_clean":"2024-09-17T05:40:19.965291+0000","last_became_active":"2024-09-17T05:40:18.966887+0000","last_became_peered":"2024-09-17T05:40:18.966887+0000","last_unstale":"2024-09-17T05:40:19.965291+0000","last_undegraded":"2024-09-17T05:40:19.965291+0000","last_fullsized":"2024-09-17T05:40:19.965291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745704+0000","last_change":"2024-09-17T05:40:18.968515+0000","last_active":"2024-09-17T05:40:20.745704+0000","last_peered":"2024-09-17T05:40:20.745704+0000","last_clean":"2024-09-17T05:40:20.745704+0000","last_became_active":"2024-09-17T05:40:18.968183+0000","last_became_peered":"2024-09-17T05:40:18.968183+0000","last_unstale":"2024-09-17T05:40:20.745704+0000","last_undegraded":"2024-09-17T05:40:20.745704+0000","last_fullsized":"2024-09-17T05:40:20.745704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:21.966993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960842+0000","last_change":"2024-09-17T05:40:18.959333+0000","last_active":"2024-09-17T05:40:19.960842+0000","last_peered":"2024-09-17T05:40:19.960842+0000","last_clean":"2024-09-17T05:40:19.960842+0000","last_became_active":"2024-09-17T05:40:18.959011+0000","last_became_peered":"2024-09-17T05:40:18.959011+0000","last_unstale":"2024-09-17T05:40:19.960842+0000","last_undegraded":"2024-09-17T05:40:19.960842+0000","last_fullsized":"2024-09-17T05:40:19.960842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746482+0000","last_change":"2024-09-17T05:40:18.969295+0000","last_active":"2024-09-17T05:40:20.746482+0000","last_peered":"2024-09-17T05:40:20.746482+0000","last_clean":"2024-09-17T05:40:20.746482+0000","last_became_active":"2024-09-17T05:40:18.968254+0000","last_became_peered":"2024-09-17T05:40:18.968254+0000","last_unstale":"2024-09-17T05:40:20.746482+0000","last_undegraded":"2024-09-17T05:40:20.746482+0000","last_fullsized":"2024-09-17T05:40:20.746482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880679+0000","last_change":"2024-09-17T05:40:18.963445+0000","last_active":"2024-09-17T05:40:20.880679+0000","last_peered":"2024-09-17T05:40:20.880679+0000","last_clean":"2024-09-17T05:40:20.880679+0000","last_became_active":"2024-09-17T05:40:18.963109+0000","last_became_peered":"2024-09-17T05:40:18.963109+0000","last_unstale":"2024-09-17T05:40:20.880679+0000","last_undegraded":"2024-09-17T05:40:20.880679+0000","last_fullsized":"2024-09-17T05:40:20.880679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:27.338578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.948411+0000","last_change":"2024-09-17T05:40:17.948411+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.948411+0000","last_undegraded":"2024-09-17T05:40:17.948411+0000","last_fullsized":"2024-09-17T05:40:17.948411+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961968+0000","last_change":"2024-09-17T05:40:18.963052+0000","last_active":"2024-09-17T05:40:19.961968+0000","last_peered":"2024-09-17T05:40:19.961968+0000","last_clean":"2024-09-17T05:40:19.961968+0000","last_became_active":"2024-09-17T05:40:18.962788+0000","last_became_peered":"2024-09-17T05:40:18.962788+0000","last_unstale":"2024-09-17T05:40:19.961968+0000","last_undegraded":"2024-09-17T05:40:19.961968+0000","last_fullsized":"2024-09-17T05:40:19.961968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:56.383960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944142+0000","last_change":"2024-09-17T05:40:17.944142+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944142+0000","last_undegraded":"2024-09-17T05:40:17.944142+0000","last_fullsized":"2024-09-17T05:40:17.944142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960902+0000","last_change":"2024-09-17T05:40:18.962572+0000","last_active":"2024-09-17T05:40:19.960902+0000","last_peered":"2024-09-17T05:40:19.960902+0000","last_clean":"2024-09-17T05:40:19.960902+0000","last_became_active":"2024-09-17T05:40:18.961900+0000","last_became_peered":"2024-09-17T05:40:18.961900+0000","last_unstale":"2024-09-17T05:40:19.960902+0000","last_undegraded":"2024-09-17T05:40:19.960902+0000","last_fullsized":"2024-09-17T05:40:19.960902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877975+0000","last_change":"2024-09-17T05:40:18.978496+0000","last_active":"2024-09-17T05:40:20.877975+0000","last_peered":"2024-09-17T05:40:20.877975+0000","last_clean":"2024-09-17T05:40:20.877975+0000","last_became_active":"2024-09-17T05:40:18.978005+0000","last_became_peered":"2024-09-17T05:40:18.978005+0000","last_unstale":"2024-09-17T05:40:20.877975+0000","last_undegraded":"2024-09-17T05:40:20.877975+0000","last_fullsized":"2024-09-17T05:40:20.877975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:36.509694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745632+0000","last_change":"2024-09-17T05:40:18.965425+0000","last_active":"2024-09-17T05:40:20.745632+0000","last_peered":"2024-09-17T05:40:20.745632+0000","last_clean":"2024-09-17T05:40:20.745632+0000","last_became_active":"2024-09-17T05:40:18.965158+0000","last_became_peered":"2024-09-17T05:40:18.965158+0000","last_unstale":"2024-09-17T05:40:20.745632+0000","last_undegraded":"2024-09-17T05:40:20.745632+0000","last_fullsized":"2024-09-17T05:40:20.745632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:05.487453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961571+0000","last_change":"2024-09-17T05:40:18.976391+0000","last_active":"2024-09-17T05:40:19.961571+0000","last_peered":"2024-09-17T05:40:19.961571+0000","last_clean":"2024-09-17T05:40:19.961571+0000","last_became_active":"2024-09-17T05:40:18.974193+0000","last_became_peered":"2024-09-17T05:40:18.974193+0000","last_unstale":"2024-09-17T05:40:19.961571+0000","last_undegraded":"2024-09-17T05:40:19.961571+0000","last_fullsized":"2024-09-17T05:40:19.961571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944884+0000","last_change":"2024-09-17T05:40:17.944884+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944884+0000","last_undegraded":"2024-09-17T05:40:17.944884+0000","last_fullsized":"2024-09-17T05:40:17.944884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961756+0000","last_change":"2024-09-17T05:40:18.962751+0000","last_active":"2024-09-17T05:40:19.961756+0000","last_peered":"2024-09-17T05:40:19.961756+0000","last_clean":"2024-09-17T05:40:19.961756+0000","last_became_active":"2024-09-17T05:40:18.962431+0000","last_became_peered":"2024-09-17T05:40:18.962431+0000","last_unstale":"2024-09-17T05:40:19.961756+0000","last_undegraded":"2024-09-17T05:40:19.961756+0000","last_fullsized":"2024-09-17T05:40:19.961756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:17.076796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965677+0000","last_change":"2024-09-17T05:40:18.973187+0000","last_active":"2024-09-17T05:40:19.965677+0000","last_peered":"2024-09-17T05:40:19.965677+0000","last_clean":"2024-09-17T05:40:19.965677+0000","last_became_active":"2024-09-17T05:40:18.972583+0000","last_became_peered":"2024-09-17T05:40:18.972583+0000","last_unstale":"2024-09-17T05:40:19.965677+0000","last_undegraded":"2024-09-17T05:40:19.965677+0000","last_fullsized":"2024-09-17T05:40:19.965677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:10.548067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961966+0000","last_change":"2024-09-17T05:40:18.953388+0000","last_active":"2024-09-17T05:40:19.961966+0000","last_peered":"2024-09-17T05:40:19.961966+0000","last_clean":"2024-09-17T05:40:19.961966+0000","last_became_active":"2024-09-17T05:40:18.953020+0000","last_became_peered":"2024-09-17T05:40:18.953020+0000","last_unstale":"2024-09-17T05:40:19.961966+0000","last_undegraded":"2024-09-17T05:40:19.961966+0000","last_fullsized":"2024-09-17T05:40:19.961966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.943263+0000","last_change":"2024-09-17T05:40:17.943263+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.943263+0000","last_undegraded":"2024-09-17T05:40:17.943263+0000","last_fullsized":"2024-09-17T05:40:17.943263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880403+0000","last_change":"2024-09-17T05:40:18.964476+0000","last_active":"2024-09-17T05:40:20.880403+0000","last_peered":"2024-09-17T05:40:20.880403+0000","last_clean":"2024-09-17T05:40:20.880403+0000","last_became_active":"2024-09-17T05:40:18.961909+0000","last_became_peered":"2024-09-17T05:40:18.961909+0000","last_unstale":"2024-09-17T05:40:20.880403+0000","last_undegraded":"2024-09-17T05:40:20.880403+0000","last_fullsized":"2024-09-17T05:40:20.880403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:43.786845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944946+0000","last_change":"2024-09-17T05:40:17.944946+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944946+0000","last_undegraded":"2024-09-17T05:40:17.944946+0000","last_fullsized":"2024-09-17T05:40:17.944946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965692+0000","last_change":"2024-09-17T05:40:18.976020+0000","last_active":"2024-09-17T05:40:19.965692+0000","last_peered":"2024-09-17T05:40:19.965692+0000","last_clean":"2024-09-17T05:40:19.965692+0000","last_became_active":"2024-09-17T05:40:18.975685+0000","last_became_peered":"2024-09-17T05:40:18.975685+0000","last_unstale":"2024-09-17T05:40:19.965692+0000","last_undegraded":"2024-09-17T05:40:19.965692+0000","last_fullsized":"2024-09-17T05:40:19.965692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:21.915494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746347+0000","last_change":"2024-09-17T05:40:18.970329+0000","last_active":"2024-09-17T05:40:20.746347+0000","last_peered":"2024-09-17T05:40:20.746347+0000","last_clean":"2024-09-17T05:40:20.746347+0000","last_became_active":"2024-09-17T05:40:18.970033+0000","last_became_peered":"2024-09-17T05:40:18.970033+0000","last_unstale":"2024-09-17T05:40:20.746347+0000","last_undegraded":"2024-09-17T05:40:20.746347+0000","last_fullsized":"2024-09-17T05:40:20.746347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746067+0000","last_change":"2024-09-17T05:40:18.971355+0000","last_active":"2024-09-17T05:40:20.746067+0000","last_peered":"2024-09-17T05:40:20.746067+0000","last_clean":"2024-09-17T05:40:20.746067+0000","last_became_active":"2024-09-17T05:40:18.971020+0000","last_became_peered":"2024-09-17T05:40:18.971020+0000","last_unstale":"2024-09-17T05:40:20.746067+0000","last_undegraded":"2024-09-17T05:40:20.746067+0000","last_fullsized":"2024-09-17T05:40:20.746067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:44.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878335+0000","last_change":"2024-09-17T05:40:18.973895+0000","last_active":"2024-09-17T05:40:20.878335+0000","last_peered":"2024-09-17T05:40:20.878335+0000","last_clean":"2024-09-17T05:40:20.878335+0000","last_became_active":"2024-09-17T05:40:18.968948+0000","last_became_peered":"2024-09-17T05:40:18.968948+0000","last_unstale":"2024-09-17T05:40:20.878335+0000","last_undegraded":"2024-09-17T05:40:20.878335+0000","last_fullsized":"2024-09-17T05:40:20.878335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:34.472712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965243+0000","last_change":"2024-09-17T05:40:18.971284+0000","last_active":"2024-09-17T05:40:19.965243+0000","last_peered":"2024-09-17T05:40:19.965243+0000","last_clean":"2024-09-17T05:40:19.965243+0000","last_became_active":"2024-09-17T05:40:18.966667+0000","last_became_peered":"2024-09-17T05:40:18.966667+0000","last_unstale":"2024-09-17T05:40:19.965243+0000","last_undegraded":"2024-09-17T05:40:19.965243+0000","last_fullsized":"2024-09-17T05:40:19.965243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880748+0000","last_change":"2024-09-17T05:40:18.965174+0000","last_active":"2024-09-17T05:40:20.880748+0000","last_peered":"2024-09-17T05:40:20.880748+0000","last_clean":"2024-09-17T05:40:20.880748+0000","last_became_active":"2024-09-17T05:40:18.964778+0000","last_became_peered":"2024-09-17T05:40:18.964778+0000","last_unstale":"2024-09-17T05:40:20.880748+0000","last_undegraded":"2024-09-17T05:40:20.880748+0000","last_fullsized":"2024-09-17T05:40:20.880748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:58.112444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.946191+0000","last_change":"2024-09-17T05:40:17.946191+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.946191+0000","last_undegraded":"2024-09-17T05:40:17.946191+0000","last_fullsized":"2024-09-17T05:40:17.946191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745554+0000","last_change":"2024-09-17T05:40:18.969453+0000","last_active":"2024-09-17T05:40:20.745554+0000","last_peered":"2024-09-17T05:40:20.745554+0000","last_clean":"2024-09-17T05:40:20.745554+0000","last_became_active":"2024-09-17T05:40:18.968764+0000","last_became_peered":"2024-09-17T05:40:18.968764+0000","last_unstale":"2024-09-17T05:40:20.745554+0000","last_undegraded":"2024-09-17T05:40:20.745554+0000","last_fullsized":"2024-09-17T05:40:20.745554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877960+0000","last_change":"2024-09-17T05:40:18.968303+0000","last_active":"2024-09-17T05:40:20.877960+0000","last_peered":"2024-09-17T05:40:20.877960+0000","last_clean":"2024-09-17T05:40:20.877960+0000","last_became_active":"2024-09-17T05:40:18.967969+0000","last_became_peered":"2024-09-17T05:40:18.967969+0000","last_unstale":"2024-09-17T05:40:20.877960+0000","last_undegraded":"2024-09-17T05:40:20.877960+0000","last_fullsized":"2024-09-17T05:40:20.877960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.754367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878733+0000","last_change":"2024-09-17T05:40:17.961361+0000","last_active":"2024-09-17T05:40:20.878733+0000","last_peered":"2024-09-17T05:40:20.878733+0000","last_clean":"2024-09-17T05:40:20.878733+0000","last_became_active":"2024-09-17T05:40:17.960382+0000","last_became_peered":"2024-09-17T05:40:17.960382+0000","last_unstale":"2024-09-17T05:40:20.878733+0000","last_undegraded":"2024-09-17T05:40:20.878733+0000","last_fullsized":"2024-09-17T05:40:20.878733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:14.971857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:18.975317+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:18.975011+0000","last_became_peered":"2024-09-17T05:40:18.975011+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:19.442398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880008+0000","last_change":"2024-09-17T05:40:17.966550+0000","last_active":"2024-09-17T05:40:20.880008+0000","last_peered":"2024-09-17T05:40:20.880008+0000","last_clean":"2024-09-17T05:40:20.880008+0000","last_became_active":"2024-09-17T05:40:17.966232+0000","last_became_peered":"2024-09-17T05:40:17.966232+0000","last_unstale":"2024-09-17T05:40:20.880008+0000","last_undegraded":"2024-09-17T05:40:20.880008+0000","last_fullsized":"2024-09-17T05:40:20.880008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.669759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961738+0000","last_change":"2024-09-17T05:40:18.965633+0000","last_active":"2024-09-17T05:40:19.961738+0000","last_peered":"2024-09-17T05:40:19.961738+0000","last_clean":"2024-09-17T05:40:19.961738+0000","last_became_active":"2024-09-17T05:40:18.965055+0000","last_became_peered":"2024-09-17T05:40:18.965055+0000","last_unstale":"2024-09-17T05:40:19.961738+0000","last_undegraded":"2024-09-17T05:40:19.961738+0000","last_fullsized":"2024-09-17T05:40:19.961738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:23.790972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880827+0000","last_change":"2024-09-17T05:40:17.971273+0000","last_active":"2024-09-17T05:40:20.880827+0000","last_peered":"2024-09-17T05:40:20.880827+0000","last_clean":"2024-09-17T05:40:20.880827+0000","last_became_active":"2024-09-17T05:40:17.970885+0000","last_became_peered":"2024-09-17T05:40:17.970885+0000","last_unstale":"2024-09-17T05:40:20.880827+0000","last_undegraded":"2024-09-17T05:40:20.880827+0000","last_fullsized":"2024-09-17T05:40:20.880827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.395940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745938+0000","last_change":"2024-09-17T05:40:18.966252+0000","last_active":"2024-09-17T05:40:20.745938+0000","last_peered":"2024-09-17T05:40:20.745938+0000","last_clean":"2024-09-17T05:40:20.745938+0000","last_became_active":"2024-09-17T05:40:18.965843+0000","last_became_peered":"2024-09-17T05:40:18.965843+0000","last_unstale":"2024-09-17T05:40:20.745938+0000","last_undegraded":"2024-09-17T05:40:20.745938+0000","last_fullsized":"2024-09-17T05:40:20.745938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:10.099473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962112+0000","last_change":"2024-09-17T05:40:17.973881+0000","last_active":"2024-09-17T05:40:19.962112+0000","last_peered":"2024-09-17T05:40:19.962112+0000","last_clean":"2024-09-17T05:40:19.962112+0000","last_became_active":"2024-09-17T05:40:17.973539+0000","last_became_peered":"2024-09-17T05:40:17.973539+0000","last_unstale":"2024-09-17T05:40:19.962112+0000","last_undegraded":"2024-09-17T05:40:19.962112+0000","last_fullsized":"2024-09-17T05:40:19.962112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:07.850444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965742+0000","last_change":"2024-09-17T05:40:18.972873+0000","last_active":"2024-09-17T05:40:19.965742+0000","last_peered":"2024-09-17T05:40:19.965742+0000","last_clean":"2024-09-17T05:40:19.965742+0000","last_became_active":"2024-09-17T05:40:18.972156+0000","last_became_peered":"2024-09-17T05:40:18.972156+0000","last_unstale":"2024-09-17T05:40:19.965742+0000","last_undegraded":"2024-09-17T05:40:19.965742+0000","last_fullsized":"2024-09-17T05:40:19.965742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962371+0000","last_change":"2024-09-17T05:40:17.969993+0000","last_active":"2024-09-17T05:40:19.962371+0000","last_peered":"2024-09-17T05:40:19.962371+0000","last_clean":"2024-09-17T05:40:19.962371+0000","last_became_active":"2024-09-17T05:40:17.969577+0000","last_became_peered":"2024-09-17T05:40:17.969577+0000","last_unstale":"2024-09-17T05:40:19.962371+0000","last_undegraded":"2024-09-17T05:40:19.962371+0000","last_fullsized":"2024-09-17T05:40:19.962371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.945182+0000","last_change":"2024-09-17T05:40:17.945182+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.945182+0000","last_undegraded":"2024-09-17T05:40:17.945182+0000","last_fullsized":"2024-09-17T05:40:17.945182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879329+0000","last_change":"2024-09-17T05:40:17.972241+0000","last_active":"2024-09-17T05:40:20.879329+0000","last_peered":"2024-09-17T05:40:20.879329+0000","last_clean":"2024-09-17T05:40:20.879329+0000","last_became_active":"2024-09-17T05:40:17.971903+0000","last_became_peered":"2024-09-17T05:40:17.971903+0000","last_unstale":"2024-09-17T05:40:20.879329+0000","last_undegraded":"2024-09-17T05:40:20.879329+0000","last_fullsized":"2024-09-17T05:40:20.879329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:53.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962234+0000","last_change":"2024-09-17T05:40:18.966028+0000","last_active":"2024-09-17T05:40:19.962234+0000","last_peered":"2024-09-17T05:40:19.962234+0000","last_clean":"2024-09-17T05:40:19.962234+0000","last_became_active":"2024-09-17T05:40:18.965683+0000","last_became_peered":"2024-09-17T05:40:18.965683+0000","last_unstale":"2024-09-17T05:40:19.962234+0000","last_undegraded":"2024-09-17T05:40:19.962234+0000","last_fullsized":"2024-09-17T05:40:19.962234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961382+0000","last_change":"2024-09-17T05:40:17.966777+0000","last_active":"2024-09-17T05:40:19.961382+0000","last_peered":"2024-09-17T05:40:19.961382+0000","last_clean":"2024-09-17T05:40:19.961382+0000","last_became_active":"2024-09-17T05:40:17.966414+0000","last_became_peered":"2024-09-17T05:40:17.966414+0000","last_unstale":"2024-09-17T05:40:19.961382+0000","last_undegraded":"2024-09-17T05:40:19.961382+0000","last_fullsized":"2024-09-17T05:40:19.961382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:44.209477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880088+0000","last_change":"2024-09-17T05:40:18.969318+0000","last_active":"2024-09-17T05:40:20.880088+0000","last_peered":"2024-09-17T05:40:20.880088+0000","last_clean":"2024-09-17T05:40:20.880088+0000","last_became_active":"2024-09-17T05:40:18.968996+0000","last_became_peered":"2024-09-17T05:40:18.968996+0000","last_unstale":"2024-09-17T05:40:20.880088+0000","last_undegraded":"2024-09-17T05:40:20.880088+0000","last_fullsized":"2024-09-17T05:40:20.880088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:49.154860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.968205+0000","last_change":"2024-09-17T05:40:17.959870+0000","last_active":"2024-09-17T05:40:17.968205+0000","last_peered":"2024-09-17T05:40:17.968205+0000","last_clean":"2024-09-17T05:40:17.968205+0000","last_became_active":"2024-09-17T05:40:17.959110+0000","last_became_peered":"2024-09-17T05:40:17.959110+0000","last_unstale":"2024-09-17T05:40:17.968205+0000","last_undegraded":"2024-09-17T05:40:17.968205+0000","last_fullsized":"2024-09-17T05:40:17.968205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:38.032098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944404+0000","last_change":"2024-09-17T05:40:17.944404+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944404+0000","last_undegraded":"2024-09-17T05:40:17.944404+0000","last_fullsized":"2024-09-17T05:40:17.944404+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746438+0000","last_change":"2024-09-17T05:40:17.965056+0000","last_active":"2024-09-17T05:40:20.746438+0000","last_peered":"2024-09-17T05:40:20.746438+0000","last_clean":"2024-09-17T05:40:20.746438+0000","last_became_active":"2024-09-17T05:40:17.964655+0000","last_became_peered":"2024-09-17T05:40:17.964655+0000","last_unstale":"2024-09-17T05:40:20.746438+0000","last_undegraded":"2024-09-17T05:40:20.746438+0000","last_fullsized":"2024-09-17T05:40:20.746438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:35.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961796+0000","last_change":"2024-09-17T05:40:18.957254+0000","last_active":"2024-09-17T05:40:19.961796+0000","last_peered":"2024-09-17T05:40:19.961796+0000","last_clean":"2024-09-17T05:40:19.961796+0000","last_became_active":"2024-09-17T05:40:18.956903+0000","last_became_peered":"2024-09-17T05:40:18.956903+0000","last_unstale":"2024-09-17T05:40:19.961796+0000","last_undegraded":"2024-09-17T05:40:19.961796+0000","last_fullsized":"2024-09-17T05:40:19.961796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880695+0000","last_change":"2024-09-17T05:40:17.965827+0000","last_active":"2024-09-17T05:40:20.880695+0000","last_peered":"2024-09-17T05:40:20.880695+0000","last_clean":"2024-09-17T05:40:20.880695+0000","last_became_active":"2024-09-17T05:40:17.962330+0000","last_became_peered":"2024-09-17T05:40:17.962330+0000","last_unstale":"2024-09-17T05:40:20.880695+0000","last_undegraded":"2024-09-17T05:40:20.880695+0000","last_fullsized":"2024-09-17T05:40:20.880695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:15.809852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961491+0000","last_change":"2024-09-17T05:40:18.972381+0000","last_active":"2024-09-17T05:40:19.961491+0000","last_peered":"2024-09-17T05:40:19.961491+0000","last_clean":"2024-09-17T05:40:19.961491+0000","last_became_active":"2024-09-17T05:40:18.972050+0000","last_became_peered":"2024-09-17T05:40:18.972050+0000","last_unstale":"2024-09-17T05:40:19.961491+0000","last_undegraded":"2024-09-17T05:40:19.961491+0000","last_fullsized":"2024-09-17T05:40:19.961491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965153+0000","last_change":"2024-09-17T05:40:17.971063+0000","last_active":"2024-09-17T05:40:19.965153+0000","last_peered":"2024-09-17T05:40:19.965153+0000","last_clean":"2024-09-17T05:40:19.965153+0000","last_became_active":"2024-09-17T05:40:17.970390+0000","last_became_peered":"2024-09-17T05:40:17.970390+0000","last_unstale":"2024-09-17T05:40:19.965153+0000","last_undegraded":"2024-09-17T05:40:19.965153+0000","last_fullsized":"2024-09-17T05:40:19.965153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:24.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965290+0000","last_change":"2024-09-17T05:40:18.965052+0000","last_active":"2024-09-17T05:40:19.965290+0000","last_peered":"2024-09-17T05:40:19.965290+0000","last_clean":"2024-09-17T05:40:19.965290+0000","last_became_active":"2024-09-17T05:40:18.964428+0000","last_became_peered":"2024-09-17T05:40:18.964428+0000","last_unstale":"2024-09-17T05:40:19.965290+0000","last_undegraded":"2024-09-17T05:40:19.965290+0000","last_fullsized":"2024-09-17T05:40:19.965290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:12.516191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879706+0000","last_change":"2024-09-17T05:40:17.975190+0000","last_active":"2024-09-17T05:40:20.879706+0000","last_peered":"2024-09-17T05:40:20.879706+0000","last_clean":"2024-09-17T05:40:20.879706+0000","last_became_active":"2024-09-17T05:40:17.974679+0000","last_became_peered":"2024-09-17T05:40:17.974679+0000","last_unstale":"2024-09-17T05:40:20.879706+0000","last_undegraded":"2024-09-17T05:40:20.879706+0000","last_fullsized":"2024-09-17T05:40:20.879706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:56.674619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746000+0000","last_change":"2024-09-17T05:40:18.968708+0000","last_active":"2024-09-17T05:40:20.746000+0000","last_peered":"2024-09-17T05:40:20.746000+0000","last_clean":"2024-09-17T05:40:20.746000+0000","last_became_active":"2024-09-17T05:40:18.968273+0000","last_became_peered":"2024-09-17T05:40:18.968273+0000","last_unstale":"2024-09-17T05:40:20.746000+0000","last_undegraded":"2024-09-17T05:40:20.746000+0000","last_fullsized":"2024-09-17T05:40:20.746000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:11.746260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880446+0000","last_change":"2024-09-17T05:40:17.970784+0000","last_active":"2024-09-17T05:40:20.880446+0000","last_peered":"2024-09-17T05:40:20.880446+0000","last_clean":"2024-09-17T05:40:20.880446+0000","last_became_active":"2024-09-17T05:40:17.970430+0000","last_became_peered":"2024-09-17T05:40:17.970430+0000","last_unstale":"2024-09-17T05:40:20.880446+0000","last_undegraded":"2024-09-17T05:40:20.880446+0000","last_fullsized":"2024-09-17T05:40:20.880446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:40.544858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880886+0000","last_change":"2024-09-17T05:40:18.971140+0000","last_active":"2024-09-17T05:40:20.880886+0000","last_peered":"2024-09-17T05:40:20.880886+0000","last_clean":"2024-09-17T05:40:20.880886+0000","last_became_active":"2024-09-17T05:40:18.970843+0000","last_became_peered":"2024-09-17T05:40:18.970843+0000","last_unstale":"2024-09-17T05:40:20.880886+0000","last_undegraded":"2024-09-17T05:40:20.880886+0000","last_fullsized":"2024-09-17T05:40:20.880886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:49.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961919+0000","last_change":"2024-09-17T05:40:17.973356+0000","last_active":"2024-09-17T05:40:19.961919+0000","last_peered":"2024-09-17T05:40:19.961919+0000","last_clean":"2024-09-17T05:40:19.961919+0000","last_became_active":"2024-09-17T05:40:17.973013+0000","last_became_peered":"2024-09-17T05:40:17.973013+0000","last_unstale":"2024-09-17T05:40:19.961919+0000","last_undegraded":"2024-09-17T05:40:19.961919+0000","last_fullsized":"2024-09-17T05:40:19.961919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:10.738755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962312+0000","last_change":"2024-09-17T05:40:18.970497+0000","last_active":"2024-09-17T05:40:19.962312+0000","last_peered":"2024-09-17T05:40:19.962312+0000","last_clean":"2024-09-17T05:40:19.962312+0000","last_became_active":"2024-09-17T05:40:18.970209+0000","last_became_peered":"2024-09-17T05:40:18.970209+0000","last_unstale":"2024-09-17T05:40:19.962312+0000","last_undegraded":"2024-09-17T05:40:19.962312+0000","last_fullsized":"2024-09-17T05:40:19.962312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:17.959159+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:17.958789+0000","last_became_peered":"2024-09-17T05:40:17.958789+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:58.233971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880871+0000","last_change":"2024-09-17T05:40:18.969090+0000","last_active":"2024-09-17T05:40:20.880871+0000","last_peered":"2024-09-17T05:40:20.880871+0000","last_clean":"2024-09-17T05:40:20.880871+0000","last_became_active":"2024-09-17T05:40:18.968784+0000","last_became_peered":"2024-09-17T05:40:18.968784+0000","last_unstale":"2024-09-17T05:40:20.880871+0000","last_undegraded":"2024-09-17T05:40:20.880871+0000","last_fullsized":"2024-09-17T05:40:20.880871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.582695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965006+0000","last_change":"2024-09-17T05:40:17.965172+0000","last_active":"2024-09-17T05:40:19.965006+0000","last_peered":"2024-09-17T05:40:19.965006+0000","last_clean":"2024-09-17T05:40:19.965006+0000","last_became_active":"2024-09-17T05:40:17.964923+0000","last_became_peered":"2024-09-17T05:40:17.964923+0000","last_unstale":"2024-09-17T05:40:19.965006+0000","last_undegraded":"2024-09-17T05:40:19.965006+0000","last_fullsized":"2024-09-17T05:40:19.965006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:24.487199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878121+0000","last_change":"2024-09-17T05:40:18.978887+0000","last_active":"2024-09-17T05:40:20.878121+0000","last_peered":"2024-09-17T05:40:20.878121+0000","last_clean":"2024-09-17T05:40:20.878121+0000","last_became_active":"2024-09-17T05:40:18.978477+0000","last_became_peered":"2024-09-17T05:40:18.978477+0000","last_unstale":"2024-09-17T05:40:20.878121+0000","last_undegraded":"2024-09-17T05:40:20.878121+0000","last_fullsized":"2024-09-17T05:40:20.878121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:55.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746530+0000","last_change":"2024-09-17T05:40:17.972337+0000","last_active":"2024-09-17T05:40:20.746530+0000","last_peered":"2024-09-17T05:40:20.746530+0000","last_clean":"2024-09-17T05:40:20.746530+0000","last_became_active":"2024-09-17T05:40:17.971336+0000","last_became_peered":"2024-09-17T05:40:17.971336+0000","last_unstale":"2024-09-17T05:40:20.746530+0000","last_undegraded":"2024-09-17T05:40:20.746530+0000","last_fullsized":"2024-09-17T05:40:20.746530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:18.434892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.943214+0000","last_change":"2024-09-17T05:40:17.943214+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.943214+0000","last_undegraded":"2024-09-17T05:40:17.943214+0000","last_fullsized":"2024-09-17T05:40:17.943214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746356+0000","last_change":"2024-09-17T05:40:17.965044+0000","last_active":"2024-09-17T05:40:20.746356+0000","last_peered":"2024-09-17T05:40:20.746356+0000","last_clean":"2024-09-17T05:40:20.746356+0000","last_became_active":"2024-09-17T05:40:17.964741+0000","last_became_peered":"2024-09-17T05:40:17.964741+0000","last_unstale":"2024-09-17T05:40:20.746356+0000","last_undegraded":"2024-09-17T05:40:20.746356+0000","last_fullsized":"2024-09-17T05:40:20.746356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:52.300156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961079+0000","last_change":"2024-09-17T05:40:18.964400+0000","last_active":"2024-09-17T05:40:19.961079+0000","last_peered":"2024-09-17T05:40:19.961079+0000","last_clean":"2024-09-17T05:40:19.961079+0000","last_became_active":"2024-09-17T05:40:18.964075+0000","last_became_peered":"2024-09-17T05:40:18.964075+0000","last_unstale":"2024-09-17T05:40:19.961079+0000","last_undegraded":"2024-09-17T05:40:19.961079+0000","last_fullsized":"2024-09-17T05:40:19.961079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:34.649446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878634+0000","last_change":"2024-09-17T05:40:17.967952+0000","last_active":"2024-09-17T05:40:20.878634+0000","last_peered":"2024-09-17T05:40:20.878634+0000","last_clean":"2024-09-17T05:40:20.878634+0000","last_became_active":"2024-09-17T05:40:17.967598+0000","last_became_peered":"2024-09-17T05:40:17.967598+0000","last_unstale":"2024-09-17T05:40:20.878634+0000","last_undegraded":"2024-09-17T05:40:20.878634+0000","last_fullsized":"2024-09-17T05:40:20.878634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:19.550729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878198+0000","last_change":"2024-09-17T05:40:18.975785+0000","last_active":"2024-09-17T05:40:20.878198+0000","last_peered":"2024-09-17T05:40:20.878198+0000","last_clean":"2024-09-17T05:40:20.878198+0000","last_became_active":"2024-09-17T05:40:18.967877+0000","last_became_peered":"2024-09-17T05:40:18.967877+0000","last_unstale":"2024-09-17T05:40:20.878198+0000","last_undegraded":"2024-09-17T05:40:20.878198+0000","last_fullsized":"2024-09-17T05:40:20.878198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:02.537983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878483+0000","last_change":"2024-09-17T05:40:17.969484+0000","last_active":"2024-09-17T05:40:20.878483+0000","last_peered":"2024-09-17T05:40:20.878483+0000","last_clean":"2024-09-17T05:40:20.878483+0000","last_became_active":"2024-09-17T05:40:17.969158+0000","last_became_peered":"2024-09-17T05:40:17.969158+0000","last_unstale":"2024-09-17T05:40:20.878483+0000","last_undegraded":"2024-09-17T05:40:20.878483+0000","last_fullsized":"2024-09-17T05:40:20.878483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:36.756374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878618+0000","last_change":"2024-09-17T05:40:18.967277+0000","last_active":"2024-09-17T05:40:20.878618+0000","last_peered":"2024-09-17T05:40:20.878618+0000","last_clean":"2024-09-17T05:40:20.878618+0000","last_became_active":"2024-09-17T05:40:18.966960+0000","last_became_peered":"2024-09-17T05:40:18.966960+0000","last_unstale":"2024-09-17T05:40:20.878618+0000","last_undegraded":"2024-09-17T05:40:20.878618+0000","last_fullsized":"2024-09-17T05:40:20.878618+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:27.633925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.958537+0000","last_change":"2024-09-17T05:40:17.955665+0000","last_active":"2024-09-17T05:40:17.958537+0000","last_peered":"2024-09-17T05:40:17.958537+0000","last_clean":"2024-09-17T05:40:17.958537+0000","last_became_active":"2024-09-17T05:40:17.953041+0000","last_became_peered":"2024-09-17T05:40:17.953041+0000","last_unstale":"2024-09-17T05:40:17.958537+0000","last_undegraded":"2024-09-17T05:40:17.958537+0000","last_fullsized":"2024-09-17T05:40:17.958537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:09.529223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878836+0000","last_change":"2024-09-17T05:40:18.977272+0000","last_active":"2024-09-17T05:40:20.878836+0000","last_peered":"2024-09-17T05:40:20.878836+0000","last_clean":"2024-09-17T05:40:20.878836+0000","last_became_active":"2024-09-17T05:40:18.976916+0000","last_became_peered":"2024-09-17T05:40:18.976916+0000","last_unstale":"2024-09-17T05:40:20.878836+0000","last_undegraded":"2024-09-17T05:40:20.878836+0000","last_fullsized":"2024-09-17T05:40:20.878836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:42.993651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960931+0000","last_change":"2024-09-17T05:40:17.961323+0000","last_active":"2024-09-17T05:40:19.960931+0000","last_peered":"2024-09-17T05:40:19.960931+0000","last_clean":"2024-09-17T05:40:19.960931+0000","last_became_active":"2024-09-17T05:40:17.961012+0000","last_became_peered":"2024-09-17T05:40:17.961012+0000","last_unstale":"2024-09-17T05:40:19.960931+0000","last_undegraded":"2024-09-17T05:40:19.960931+0000","last_fullsized":"2024-09-17T05:40:19.960931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:31.323376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880144+0000","last_change":"2024-09-17T05:40:18.976598+0000","last_active":"2024-09-17T05:40:20.880144+0000","last_peered":"2024-09-17T05:40:20.880144+0000","last_clean":"2024-09-17T05:40:20.880144+0000","last_became_active":"2024-09-17T05:40:18.976246+0000","last_became_peered":"2024-09-17T05:40:18.976246+0000","last_unstale":"2024-09-17T05:40:20.880144+0000","last_undegraded":"2024-09-17T05:40:20.880144+0000","last_fullsized":"2024-09-17T05:40:20.880144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:50.563559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.969434+0000","last_change":"2024-09-17T05:40:17.962804+0000","last_active":"2024-09-17T05:40:17.969434+0000","last_peered":"2024-09-17T05:40:17.969434+0000","last_clean":"2024-09-17T05:40:17.969434+0000","last_became_active":"2024-09-17T05:40:17.962441+0000","last_became_peered":"2024-09-17T05:40:17.962441+0000","last_unstale":"2024-09-17T05:40:17.969434+0000","last_undegraded":"2024-09-17T05:40:17.969434+0000","last_fullsized":"2024-09-17T05:40:17.969434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:06.031978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745945+0000","last_change":"2024-09-17T05:40:18.964746+0000","last_active":"2024-09-17T05:40:20.745945+0000","last_peered":"2024-09-17T05:40:20.745945+0000","last_clean":"2024-09-17T05:40:20.745945+0000","last_became_active":"2024-09-17T05:40:18.962288+0000","last_became_peered":"2024-09-17T05:40:18.962288+0000","last_unstale":"2024-09-17T05:40:20.745945+0000","last_undegraded":"2024-09-17T05:40:20.745945+0000","last_fullsized":"2024-09-17T05:40:20.745945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:55.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880970+0000","last_change":"2024-09-17T05:40:17.958259+0000","last_active":"2024-09-17T05:40:20.880970+0000","last_peered":"2024-09-17T05:40:20.880970+0000","last_clean":"2024-09-17T05:40:20.880970+0000","last_became_active":"2024-09-17T05:40:17.956752+0000","last_became_peered":"2024-09-17T05:40:17.956752+0000","last_unstale":"2024-09-17T05:40:20.880970+0000","last_undegraded":"2024-09-17T05:40:20.880970+0000","last_fullsized":"2024-09-17T05:40:20.880970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:54.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880734+0000","last_change":"2024-09-17T05:40:18.967915+0000","last_active":"2024-09-17T05:40:20.880734+0000","last_peered":"2024-09-17T05:40:20.880734+0000","last_clean":"2024-09-17T05:40:20.880734+0000","last_became_active":"2024-09-17T05:40:18.967620+0000","last_became_peered":"2024-09-17T05:40:18.967620+0000","last_unstale":"2024-09-17T05:40:20.880734+0000","last_undegraded":"2024-09-17T05:40:20.880734+0000","last_fullsized":"2024-09-17T05:40:20.880734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:53.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.967006+0000","last_change":"2024-09-17T05:40:17.970621+0000","last_active":"2024-09-17T05:40:19.967006+0000","last_peered":"2024-09-17T05:40:19.967006+0000","last_clean":"2024-09-17T05:40:19.967006+0000","last_became_active":"2024-09-17T05:40:17.970196+0000","last_became_peered":"2024-09-17T05:40:17.970196+0000","last_unstale":"2024-09-17T05:40:19.967006+0000","last_undegraded":"2024-09-17T05:40:19.967006+0000","last_fullsized":"2024-09-17T05:40:19.967006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:07.550401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961767+0000","last_change":"2024-09-17T05:40:18.966610+0000","last_active":"2024-09-17T05:40:19.961767+0000","last_peered":"2024-09-17T05:40:19.961767+0000","last_clean":"2024-09-17T05:40:19.961767+0000","last_became_active":"2024-09-17T05:40:18.966276+0000","last_became_peered":"2024-09-17T05:40:18.966276+0000","last_unstale":"2024-09-17T05:40:19.961767+0000","last_undegraded":"2024-09-17T05:40:19.961767+0000","last_fullsized":"2024-09-17T05:40:19.961767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:53.342120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880935+0000","last_change":"2024-09-17T05:40:17.963755+0000","last_active":"2024-09-17T05:40:20.880935+0000","last_peered":"2024-09-17T05:40:20.880935+0000","last_clean":"2024-09-17T05:40:20.880935+0000","last_became_active":"2024-09-17T05:40:17.963439+0000","last_became_peered":"2024-09-17T05:40:17.963439+0000","last_unstale":"2024-09-17T05:40:20.880935+0000","last_undegraded":"2024-09-17T05:40:20.880935+0000","last_fullsized":"2024-09-17T05:40:20.880935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.746862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961385+0000","last_change":"2024-09-17T05:40:18.956932+0000","last_active":"2024-09-17T05:40:19.961385+0000","last_peered":"2024-09-17T05:40:19.961385+0000","last_clean":"2024-09-17T05:40:19.961385+0000","last_became_active":"2024-09-17T05:40:18.956628+0000","last_became_peered":"2024-09-17T05:40:18.956628+0000","last_unstale":"2024-09-17T05:40:19.961385+0000","last_undegraded":"2024-09-17T05:40:19.961385+0000","last_fullsized":"2024-09-17T05:40:19.961385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746198+0000","last_change":"2024-09-17T05:40:17.963225+0000","last_active":"2024-09-17T05:40:20.746198+0000","last_peered":"2024-09-17T05:40:20.746198+0000","last_clean":"2024-09-17T05:40:20.746198+0000","last_became_active":"2024-09-17T05:40:17.962712+0000","last_became_peered":"2024-09-17T05:40:17.962712+0000","last_unstale":"2024-09-17T05:40:20.746198+0000","last_undegraded":"2024-09-17T05:40:20.746198+0000","last_fullsized":"2024-09-17T05:40:20.746198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:26.824455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962047+0000","last_change":"2024-09-17T05:40:18.966387+0000","last_active":"2024-09-17T05:40:19.962047+0000","last_peered":"2024-09-17T05:40:19.962047+0000","last_clean":"2024-09-17T05:40:19.962047+0000","last_became_active":"2024-09-17T05:40:18.966066+0000","last_became_peered":"2024-09-17T05:40:18.966066+0000","last_unstale":"2024-09-17T05:40:19.962047+0000","last_undegraded":"2024-09-17T05:40:19.962047+0000","last_fullsized":"2024-09-17T05:40:19.962047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879461+0000","last_change":"2024-09-17T05:40:17.967077+0000","last_active":"2024-09-17T05:40:20.879461+0000","last_peered":"2024-09-17T05:40:20.879461+0000","last_clean":"2024-09-17T05:40:20.879461+0000","last_became_active":"2024-09-17T05:40:17.966350+0000","last_became_peered":"2024-09-17T05:40:17.966350+0000","last_unstale":"2024-09-17T05:40:20.879461+0000","last_undegraded":"2024-09-17T05:40:20.879461+0000","last_fullsized":"2024-09-17T05:40:20.879461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:53.153954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746326+0000","last_change":"2024-09-17T05:40:18.972375+0000","last_active":"2024-09-17T05:40:20.746326+0000","last_peered":"2024-09-17T05:40:20.746326+0000","last_clean":"2024-09-17T05:40:20.746326+0000","last_became_active":"2024-09-17T05:40:18.972044+0000","last_became_peered":"2024-09-17T05:40:18.972044+0000","last_unstale":"2024-09-17T05:40:20.746326+0000","last_undegraded":"2024-09-17T05:40:20.746326+0000","last_fullsized":"2024-09-17T05:40:20.746326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:45.216982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965453+0000","last_change":"2024-09-17T05:40:17.963155+0000","last_active":"2024-09-17T05:40:19.965453+0000","last_peered":"2024-09-17T05:40:19.965453+0000","last_clean":"2024-09-17T05:40:19.965453+0000","last_became_active":"2024-09-17T05:40:17.962627+0000","last_became_peered":"2024-09-17T05:40:17.962627+0000","last_unstale":"2024-09-17T05:40:19.965453+0000","last_undegraded":"2024-09-17T05:40:19.965453+0000","last_fullsized":"2024-09-17T05:40:19.965453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.151688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944302+0000","last_change":"2024-09-17T05:40:17.944302+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944302+0000","last_undegraded":"2024-09-17T05:40:17.944302+0000","last_fullsized":"2024-09-17T05:40:17.944302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745749+0000","last_change":"2024-09-17T05:40:17.963433+0000","last_active":"2024-09-17T05:40:20.745749+0000","last_peered":"2024-09-17T05:40:20.745749+0000","last_clean":"2024-09-17T05:40:20.745749+0000","last_became_active":"2024-09-17T05:40:17.963089+0000","last_became_peered":"2024-09-17T05:40:17.963089+0000","last_unstale":"2024-09-17T05:40:20.745749+0000","last_undegraded":"2024-09-17T05:40:20.745749+0000","last_fullsized":"2024-09-17T05:40:20.745749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:47.055143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878756+0000","last_change":"2024-09-17T05:40:18.969053+0000","last_active":"2024-09-17T05:40:20.878756+0000","last_peered":"2024-09-17T05:40:20.878756+0000","last_clean":"2024-09-17T05:40:20.878756+0000","last_became_active":"2024-09-17T05:40:18.968741+0000","last_became_peered":"2024-09-17T05:40:18.968741+0000","last_unstale":"2024-09-17T05:40:20.878756+0000","last_undegraded":"2024-09-17T05:40:20.878756+0000","last_fullsized":"2024-09-17T05:40:20.878756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:47.639721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.960097+0000","last_change":"2024-09-17T05:40:17.955748+0000","last_active":"2024-09-17T05:40:17.960097+0000","last_peered":"2024-09-17T05:40:17.960097+0000","last_clean":"2024-09-17T05:40:17.960097+0000","last_became_active":"2024-09-17T05:40:17.953494+0000","last_became_peered":"2024-09-17T05:40:17.953494+0000","last_unstale":"2024-09-17T05:40:17.960097+0000","last_undegraded":"2024-09-17T05:40:17.960097+0000","last_fullsized":"2024-09-17T05:40:17.960097+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:33.310342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879800+0000","last_change":"2024-09-17T05:40:18.962984+0000","last_active":"2024-09-17T05:40:20.879800+0000","last_peered":"2024-09-17T05:40:20.879800+0000","last_clean":"2024-09-17T05:40:20.879800+0000","last_became_active":"2024-09-17T05:40:18.962658+0000","last_became_peered":"2024-09-17T05:40:18.962658+0000","last_unstale":"2024-09-17T05:40:20.879800+0000","last_undegraded":"2024-09-17T05:40:20.879800+0000","last_fullsized":"2024-09-17T05:40:20.879800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.691731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965293+0000","last_change":"2024-09-17T05:40:17.966745+0000","last_active":"2024-09-17T05:40:19.965293+0000","last_peered":"2024-09-17T05:40:19.965293+0000","last_clean":"2024-09-17T05:40:19.965293+0000","last_became_active":"2024-09-17T05:40:17.966394+0000","last_became_peered":"2024-09-17T05:40:17.966394+0000","last_unstale":"2024-09-17T05:40:19.965293+0000","last_undegraded":"2024-09-17T05:40:19.965293+0000","last_fullsized":"2024-09-17T05:40:19.965293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:48.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879666+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:40:20.879666+0000","last_peered":"2024-09-17T05:40:20.879666+0000","last_clean":"2024-09-17T05:40:20.879666+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:40:20.879666+0000","last_undegraded":"2024-09-17T05:40:20.879666+0000","last_fullsized":"2024-09-17T05:40:20.879666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":929792,"data_stored":417818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1531904,"data_stored":1014316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":942080,"data_stored":418882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":423858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1531904,"data_stored":1009180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":897024,"data_stored":403332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:40:23.157 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:40:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 -- 172.21.15.44:0/4277425237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 msgr2=0x7f03740cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 --2- 172.21.15.44:0/4277425237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740cec50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f03740cfb20 tx=0x7f036401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 -- 172.21.15.44:0/4277425237 shutdown_connections 2024-09-17T05:40:23.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 --2- 172.21.15.44:0/4277425237 >> v2:172.21.15.86:3300/0 conn(0x7f037415e8c0 0x7f037415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 --2- 172.21.15.44:0/4277425237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03740cb040 0x7f03740cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 --2- 172.21.15.44:0/4277425237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740cec50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 -- 172.21.15.44:0/4277425237 >> 172.21.15.44:0/4277425237 conn(0x7f03740ccaa0 msgr2=0x7f03740cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 -- 172.21.15.44:0/4277425237 shutdown_connections 2024-09-17T05:40:23.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 -- 172.21.15.44:0/4277425237 wait complete. 2024-09-17T05:40:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 Processor -- start 2024-09-17T05:40:23.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.352+0000 7f037bc00640 1 -- start start 2024-09-17T05:40:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03740cb040 0x7f037409c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037415e8c0 0x7f037409c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f037415b520 con 0x7f03740cac30 2024-09-17T05:40:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f037415b3a0 con 0x7f037415e8c0 2024-09-17T05:40:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f037415b6a0 con 0x7f03740cb040 2024-09-17T05:40:23.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740c2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58572/0 (socket says 172.21.15.44:58572) 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 -- 172.21.15.44:0/773902316 learned_addr learned my addr 172.21.15.44:0/773902316 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379c00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037415e8c0 0x7f037409c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f036be00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03740cb040 0x7f037409c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 -- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03740cb040 msgr2=0x7f037409c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03740cb040 0x7f037409c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 -- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037415e8c0 msgr2=0x7f037409c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037415e8c0 0x7f037409c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 -- 172.21.15.44:0/773902316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037409aae0 con 0x7f03740cac30 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0379200640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740c2840 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f036401af70 tx=0x7f03640a55d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0371600640 1 -- 172.21.15.44:0/773902316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03640b2040 con 0x7f03740cac30 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0371600640 1 -- 172.21.15.44:0/773902316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0364004490 con 0x7f03740cac30 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037409cfe0 con 0x7f03740cac30 2024-09-17T05:40:23.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f0371600640 1 -- 172.21.15.44:0/773902316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364005290 con 0x7f03740cac30 2024-09-17T05:40:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03740c1aa0 con 0x7f03740cac30 2024-09-17T05:40:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.356+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03740cc850 con 0x7f03740cac30 2024-09-17T05:40:23.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.360+0000 7f0371600640 1 -- 172.21.15.44:0/773902316 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f03640be060 con 0x7f03740cac30 2024-09-17T05:40:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.360+0000 7f0371600640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0350073200 0x7f0350075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.360+0000 7f0371600640 1 -- 172.21.15.44:0/773902316 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f036412da10 con 0x7f03740cac30 2024-09-17T05:40:23.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.360+0000 7f036be00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0350073200 0x7f0350075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.360+0000 7f036be00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0350073200 0x7f0350075710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f035c005fd0 tx=0x7f035c005d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:23.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.364+0000 7f0371600640 1 -- 172.21.15.44:0/773902316 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f03740cc850 con 0x7f03740cac30 2024-09-17T05:40:23.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.536+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03740c1d40 con 0x7f0350073200 2024-09-17T05:40:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.540+0000 7f0371600640 1 -- 172.21.15.44:0/773902316 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251076 (secure 0 0 0) 0x7f03740c1d40 con 0x7f0350073200 2024-09-17T05:40:23.544 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:40:23.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0350073200 msgr2=0x7f0350075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0350073200 0x7f0350075710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f035c005fd0 tx=0x7f035c005d80 comp rx=0 tx=0).stop 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 msgr2=0x7f03740c2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740c2840 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f036401af70 tx=0x7f03640a55d0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 shutdown_connections 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0350073200 0x7f0350075710 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f037415e8c0 0x7f037409c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f03740cb040 0x7f037409c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 --2- 172.21.15.44:0/773902316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03740cac30 0x7f03740c2840 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 >> 172.21.15.44:0/773902316 conn(0x7f03740ccaa0 msgr2=0x7f03740cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 shutdown_connections 2024-09-17T05:40:23.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.544+0000 7f037bc00640 1 -- 172.21.15.44:0/773902316 wait complete. 2024-09-17T05:40:23.565 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-17T05:40:22.324757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253824,"kb_used_data":8440,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720896,"statfs":{"total":773094113280,"available":772834197504,"internally_reserved":0,"allocated":8642560,"data_stored":4535146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.388951"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.881021+0000","last_change":"2024-09-17T05:40:18.975938+0000","last_active":"2024-09-17T05:40:20.881021+0000","last_peered":"2024-09-17T05:40:20.881021+0000","last_clean":"2024-09-17T05:40:20.881021+0000","last_became_active":"2024-09-17T05:40:18.974724+0000","last_became_peered":"2024-09-17T05:40:18.974724+0000","last_unstale":"2024-09-17T05:40:20.881021+0000","last_undegraded":"2024-09-17T05:40:20.881021+0000","last_fullsized":"2024-09-17T05:40:20.881021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.159194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.947782+0000","last_change":"2024-09-17T05:40:17.947782+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.947782+0000","last_undegraded":"2024-09-17T05:40:17.947782+0000","last_fullsized":"2024-09-17T05:40:17.947782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.948891+0000","last_change":"2024-09-17T05:40:17.948891+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.948891+0000","last_undegraded":"2024-09-17T05:40:17.948891+0000","last_fullsized":"2024-09-17T05:40:17.948891+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746017+0000","last_change":"2024-09-17T05:40:18.964044+0000","last_active":"2024-09-17T05:40:20.746017+0000","last_peered":"2024-09-17T05:40:20.746017+0000","last_clean":"2024-09-17T05:40:20.746017+0000","last_became_active":"2024-09-17T05:40:18.963750+0000","last_became_peered":"2024-09-17T05:40:18.963750+0000","last_unstale":"2024-09-17T05:40:20.746017+0000","last_undegraded":"2024-09-17T05:40:20.746017+0000","last_fullsized":"2024-09-17T05:40:20.746017+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:14.837382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878318+0000","last_change":"2024-09-17T05:40:18.968256+0000","last_active":"2024-09-17T05:40:20.878318+0000","last_peered":"2024-09-17T05:40:20.878318+0000","last_clean":"2024-09-17T05:40:20.878318+0000","last_became_active":"2024-09-17T05:40:18.967470+0000","last_became_peered":"2024-09-17T05:40:18.967470+0000","last_unstale":"2024-09-17T05:40:20.878318+0000","last_undegraded":"2024-09-17T05:40:20.878318+0000","last_fullsized":"2024-09-17T05:40:20.878318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:24.741584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965291+0000","last_change":"2024-09-17T05:40:18.967355+0000","last_active":"2024-09-17T05:40:19.965291+0000","last_peered":"2024-09-17T05:40:19.965291+0000","last_clean":"2024-09-17T05:40:19.965291+0000","last_became_active":"2024-09-17T05:40:18.966887+0000","last_became_peered":"2024-09-17T05:40:18.966887+0000","last_unstale":"2024-09-17T05:40:19.965291+0000","last_undegraded":"2024-09-17T05:40:19.965291+0000","last_fullsized":"2024-09-17T05:40:19.965291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745704+0000","last_change":"2024-09-17T05:40:18.968515+0000","last_active":"2024-09-17T05:40:20.745704+0000","last_peered":"2024-09-17T05:40:20.745704+0000","last_clean":"2024-09-17T05:40:20.745704+0000","last_became_active":"2024-09-17T05:40:18.968183+0000","last_became_peered":"2024-09-17T05:40:18.968183+0000","last_unstale":"2024-09-17T05:40:20.745704+0000","last_undegraded":"2024-09-17T05:40:20.745704+0000","last_fullsized":"2024-09-17T05:40:20.745704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:21.966993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960842+0000","last_change":"2024-09-17T05:40:18.959333+0000","last_active":"2024-09-17T05:40:19.960842+0000","last_peered":"2024-09-17T05:40:19.960842+0000","last_clean":"2024-09-17T05:40:19.960842+0000","last_became_active":"2024-09-17T05:40:18.959011+0000","last_became_peered":"2024-09-17T05:40:18.959011+0000","last_unstale":"2024-09-17T05:40:19.960842+0000","last_undegraded":"2024-09-17T05:40:19.960842+0000","last_fullsized":"2024-09-17T05:40:19.960842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746482+0000","last_change":"2024-09-17T05:40:18.969295+0000","last_active":"2024-09-17T05:40:20.746482+0000","last_peered":"2024-09-17T05:40:20.746482+0000","last_clean":"2024-09-17T05:40:20.746482+0000","last_became_active":"2024-09-17T05:40:18.968254+0000","last_became_peered":"2024-09-17T05:40:18.968254+0000","last_unstale":"2024-09-17T05:40:20.746482+0000","last_undegraded":"2024-09-17T05:40:20.746482+0000","last_fullsized":"2024-09-17T05:40:20.746482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880679+0000","last_change":"2024-09-17T05:40:18.963445+0000","last_active":"2024-09-17T05:40:20.880679+0000","last_peered":"2024-09-17T05:40:20.880679+0000","last_clean":"2024-09-17T05:40:20.880679+0000","last_became_active":"2024-09-17T05:40:18.963109+0000","last_became_peered":"2024-09-17T05:40:18.963109+0000","last_unstale":"2024-09-17T05:40:20.880679+0000","last_undegraded":"2024-09-17T05:40:20.880679+0000","last_fullsized":"2024-09-17T05:40:20.880679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:27.338578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.948411+0000","last_change":"2024-09-17T05:40:17.948411+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.948411+0000","last_undegraded":"2024-09-17T05:40:17.948411+0000","last_fullsized":"2024-09-17T05:40:17.948411+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961968+0000","last_change":"2024-09-17T05:40:18.963052+0000","last_active":"2024-09-17T05:40:19.961968+0000","last_peered":"2024-09-17T05:40:19.961968+0000","last_clean":"2024-09-17T05:40:19.961968+0000","last_became_active":"2024-09-17T05:40:18.962788+0000","last_became_peered":"2024-09-17T05:40:18.962788+0000","last_unstale":"2024-09-17T05:40:19.961968+0000","last_undegraded":"2024-09-17T05:40:19.961968+0000","last_fullsized":"2024-09-17T05:40:19.961968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:56.383960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944142+0000","last_change":"2024-09-17T05:40:17.944142+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944142+0000","last_undegraded":"2024-09-17T05:40:17.944142+0000","last_fullsized":"2024-09-17T05:40:17.944142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960902+0000","last_change":"2024-09-17T05:40:18.962572+0000","last_active":"2024-09-17T05:40:19.960902+0000","last_peered":"2024-09-17T05:40:19.960902+0000","last_clean":"2024-09-17T05:40:19.960902+0000","last_became_active":"2024-09-17T05:40:18.961900+0000","last_became_peered":"2024-09-17T05:40:18.961900+0000","last_unstale":"2024-09-17T05:40:19.960902+0000","last_undegraded":"2024-09-17T05:40:19.960902+0000","last_fullsized":"2024-09-17T05:40:19.960902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877975+0000","last_change":"2024-09-17T05:40:18.978496+0000","last_active":"2024-09-17T05:40:20.877975+0000","last_peered":"2024-09-17T05:40:20.877975+0000","last_clean":"2024-09-17T05:40:20.877975+0000","last_became_active":"2024-09-17T05:40:18.978005+0000","last_became_peered":"2024-09-17T05:40:18.978005+0000","last_unstale":"2024-09-17T05:40:20.877975+0000","last_undegraded":"2024-09-17T05:40:20.877975+0000","last_fullsized":"2024-09-17T05:40:20.877975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:36.509694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745632+0000","last_change":"2024-09-17T05:40:18.965425+0000","last_active":"2024-09-17T05:40:20.745632+0000","last_peered":"2024-09-17T05:40:20.745632+0000","last_clean":"2024-09-17T05:40:20.745632+0000","last_became_active":"2024-09-17T05:40:18.965158+0000","last_became_peered":"2024-09-17T05:40:18.965158+0000","last_unstale":"2024-09-17T05:40:20.745632+0000","last_undegraded":"2024-09-17T05:40:20.745632+0000","last_fullsized":"2024-09-17T05:40:20.745632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:05.487453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961571+0000","last_change":"2024-09-17T05:40:18.976391+0000","last_active":"2024-09-17T05:40:19.961571+0000","last_peered":"2024-09-17T05:40:19.961571+0000","last_clean":"2024-09-17T05:40:19.961571+0000","last_became_active":"2024-09-17T05:40:18.974193+0000","last_became_peered":"2024-09-17T05:40:18.974193+0000","last_unstale":"2024-09-17T05:40:19.961571+0000","last_undegraded":"2024-09-17T05:40:19.961571+0000","last_fullsized":"2024-09-17T05:40:19.961571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944884+0000","last_change":"2024-09-17T05:40:17.944884+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944884+0000","last_undegraded":"2024-09-17T05:40:17.944884+0000","last_fullsized":"2024-09-17T05:40:17.944884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961756+0000","last_change":"2024-09-17T05:40:18.962751+0000","last_active":"2024-09-17T05:40:19.961756+0000","last_peered":"2024-09-17T05:40:19.961756+0000","last_clean":"2024-09-17T05:40:19.961756+0000","last_became_active":"2024-09-17T05:40:18.962431+0000","last_became_peered":"2024-09-17T05:40:18.962431+0000","last_unstale":"2024-09-17T05:40:19.961756+0000","last_undegraded":"2024-09-17T05:40:19.961756+0000","last_fullsized":"2024-09-17T05:40:19.961756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:17.076796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965677+0000","last_change":"2024-09-17T05:40:18.973187+0000","last_active":"2024-09-17T05:40:19.965677+0000","last_peered":"2024-09-17T05:40:19.965677+0000","last_clean":"2024-09-17T05:40:19.965677+0000","last_became_active":"2024-09-17T05:40:18.972583+0000","last_became_peered":"2024-09-17T05:40:18.972583+0000","last_unstale":"2024-09-17T05:40:19.965677+0000","last_undegraded":"2024-09-17T05:40:19.965677+0000","last_fullsized":"2024-09-17T05:40:19.965677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:10.548067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961966+0000","last_change":"2024-09-17T05:40:18.953388+0000","last_active":"2024-09-17T05:40:19.961966+0000","last_peered":"2024-09-17T05:40:19.961966+0000","last_clean":"2024-09-17T05:40:19.961966+0000","last_became_active":"2024-09-17T05:40:18.953020+0000","last_became_peered":"2024-09-17T05:40:18.953020+0000","last_unstale":"2024-09-17T05:40:19.961966+0000","last_undegraded":"2024-09-17T05:40:19.961966+0000","last_fullsized":"2024-09-17T05:40:19.961966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.943263+0000","last_change":"2024-09-17T05:40:17.943263+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.943263+0000","last_undegraded":"2024-09-17T05:40:17.943263+0000","last_fullsized":"2024-09-17T05:40:17.943263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880403+0000","last_change":"2024-09-17T05:40:18.964476+0000","last_active":"2024-09-17T05:40:20.880403+0000","last_peered":"2024-09-17T05:40:20.880403+0000","last_clean":"2024-09-17T05:40:20.880403+0000","last_became_active":"2024-09-17T05:40:18.961909+0000","last_became_peered":"2024-09-17T05:40:18.961909+0000","last_unstale":"2024-09-17T05:40:20.880403+0000","last_undegraded":"2024-09-17T05:40:20.880403+0000","last_fullsized":"2024-09-17T05:40:20.880403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:43.786845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944946+0000","last_change":"2024-09-17T05:40:17.944946+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944946+0000","last_undegraded":"2024-09-17T05:40:17.944946+0000","last_fullsized":"2024-09-17T05:40:17.944946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965692+0000","last_change":"2024-09-17T05:40:18.976020+0000","last_active":"2024-09-17T05:40:19.965692+0000","last_peered":"2024-09-17T05:40:19.965692+0000","last_clean":"2024-09-17T05:40:19.965692+0000","last_became_active":"2024-09-17T05:40:18.975685+0000","last_became_peered":"2024-09-17T05:40:18.975685+0000","last_unstale":"2024-09-17T05:40:19.965692+0000","last_undegraded":"2024-09-17T05:40:19.965692+0000","last_fullsized":"2024-09-17T05:40:19.965692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:21.915494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746347+0000","last_change":"2024-09-17T05:40:18.970329+0000","last_active":"2024-09-17T05:40:20.746347+0000","last_peered":"2024-09-17T05:40:20.746347+0000","last_clean":"2024-09-17T05:40:20.746347+0000","last_became_active":"2024-09-17T05:40:18.970033+0000","last_became_peered":"2024-09-17T05:40:18.970033+0000","last_unstale":"2024-09-17T05:40:20.746347+0000","last_undegraded":"2024-09-17T05:40:20.746347+0000","last_fullsized":"2024-09-17T05:40:20.746347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746067+0000","last_change":"2024-09-17T05:40:18.971355+0000","last_active":"2024-09-17T05:40:20.746067+0000","last_peered":"2024-09-17T05:40:20.746067+0000","last_clean":"2024-09-17T05:40:20.746067+0000","last_became_active":"2024-09-17T05:40:18.971020+0000","last_became_peered":"2024-09-17T05:40:18.971020+0000","last_unstale":"2024-09-17T05:40:20.746067+0000","last_undegraded":"2024-09-17T05:40:20.746067+0000","last_fullsized":"2024-09-17T05:40:20.746067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:44.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878335+0000","last_change":"2024-09-17T05:40:18.973895+0000","last_active":"2024-09-17T05:40:20.878335+0000","last_peered":"2024-09-17T05:40:20.878335+0000","last_clean":"2024-09-17T05:40:20.878335+0000","last_became_active":"2024-09-17T05:40:18.968948+0000","last_became_peered":"2024-09-17T05:40:18.968948+0000","last_unstale":"2024-09-17T05:40:20.878335+0000","last_undegraded":"2024-09-17T05:40:20.878335+0000","last_fullsized":"2024-09-17T05:40:20.878335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:34.472712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965243+0000","last_change":"2024-09-17T05:40:18.971284+0000","last_active":"2024-09-17T05:40:19.965243+0000","last_peered":"2024-09-17T05:40:19.965243+0000","last_clean":"2024-09-17T05:40:19.965243+0000","last_became_active":"2024-09-17T05:40:18.966667+0000","last_became_peered":"2024-09-17T05:40:18.966667+0000","last_unstale":"2024-09-17T05:40:19.965243+0000","last_undegraded":"2024-09-17T05:40:19.965243+0000","last_fullsized":"2024-09-17T05:40:19.965243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880748+0000","last_change":"2024-09-17T05:40:18.965174+0000","last_active":"2024-09-17T05:40:20.880748+0000","last_peered":"2024-09-17T05:40:20.880748+0000","last_clean":"2024-09-17T05:40:20.880748+0000","last_became_active":"2024-09-17T05:40:18.964778+0000","last_became_peered":"2024-09-17T05:40:18.964778+0000","last_unstale":"2024-09-17T05:40:20.880748+0000","last_undegraded":"2024-09-17T05:40:20.880748+0000","last_fullsized":"2024-09-17T05:40:20.880748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:58.112444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.946191+0000","last_change":"2024-09-17T05:40:17.946191+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.946191+0000","last_undegraded":"2024-09-17T05:40:17.946191+0000","last_fullsized":"2024-09-17T05:40:17.946191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745554+0000","last_change":"2024-09-17T05:40:18.969453+0000","last_active":"2024-09-17T05:40:20.745554+0000","last_peered":"2024-09-17T05:40:20.745554+0000","last_clean":"2024-09-17T05:40:20.745554+0000","last_became_active":"2024-09-17T05:40:18.968764+0000","last_became_peered":"2024-09-17T05:40:18.968764+0000","last_unstale":"2024-09-17T05:40:20.745554+0000","last_undegraded":"2024-09-17T05:40:20.745554+0000","last_fullsized":"2024-09-17T05:40:20.745554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877960+0000","last_change":"2024-09-17T05:40:18.968303+0000","last_active":"2024-09-17T05:40:20.877960+0000","last_peered":"2024-09-17T05:40:20.877960+0000","last_clean":"2024-09-17T05:40:20.877960+0000","last_became_active":"2024-09-17T05:40:18.967969+0000","last_became_peered":"2024-09-17T05:40:18.967969+0000","last_unstale":"2024-09-17T05:40:20.877960+0000","last_undegraded":"2024-09-17T05:40:20.877960+0000","last_fullsized":"2024-09-17T05:40:20.877960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.754367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878733+0000","last_change":"2024-09-17T05:40:17.961361+0000","last_active":"2024-09-17T05:40:20.878733+0000","last_peered":"2024-09-17T05:40:20.878733+0000","last_clean":"2024-09-17T05:40:20.878733+0000","last_became_active":"2024-09-17T05:40:17.960382+0000","last_became_peered":"2024-09-17T05:40:17.960382+0000","last_unstale":"2024-09-17T05:40:20.878733+0000","last_undegraded":"2024-09-17T05:40:20.878733+0000","last_fullsized":"2024-09-17T05:40:20.878733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:14.971857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:18.975317+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:18.975011+0000","last_became_peered":"2024-09-17T05:40:18.975011+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:19.442398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880008+0000","last_change":"2024-09-17T05:40:17.966550+0000","last_active":"2024-09-17T05:40:20.880008+0000","last_peered":"2024-09-17T05:40:20.880008+0000","last_clean":"2024-09-17T05:40:20.880008+0000","last_became_active":"2024-09-17T05:40:17.966232+0000","last_became_peered":"2024-09-17T05:40:17.966232+0000","last_unstale":"2024-09-17T05:40:20.880008+0000","last_undegraded":"2024-09-17T05:40:20.880008+0000","last_fullsized":"2024-09-17T05:40:20.880008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.669759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961738+0000","last_change":"2024-09-17T05:40:18.965633+0000","last_active":"2024-09-17T05:40:19.961738+0000","last_peered":"2024-09-17T05:40:19.961738+0000","last_clean":"2024-09-17T05:40:19.961738+0000","last_became_active":"2024-09-17T05:40:18.965055+0000","last_became_peered":"2024-09-17T05:40:18.965055+0000","last_unstale":"2024-09-17T05:40:19.961738+0000","last_undegraded":"2024-09-17T05:40:19.961738+0000","last_fullsized":"2024-09-17T05:40:19.961738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:23.790972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880827+0000","last_change":"2024-09-17T05:40:17.971273+0000","last_active":"2024-09-17T05:40:20.880827+0000","last_peered":"2024-09-17T05:40:20.880827+0000","last_clean":"2024-09-17T05:40:20.880827+0000","last_became_active":"2024-09-17T05:40:17.970885+0000","last_became_peered":"2024-09-17T05:40:17.970885+0000","last_unstale":"2024-09-17T05:40:20.880827+0000","last_undegraded":"2024-09-17T05:40:20.880827+0000","last_fullsized":"2024-09-17T05:40:20.880827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.395940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745938+0000","last_change":"2024-09-17T05:40:18.966252+0000","last_active":"2024-09-17T05:40:20.745938+0000","last_peered":"2024-09-17T05:40:20.745938+0000","last_clean":"2024-09-17T05:40:20.745938+0000","last_became_active":"2024-09-17T05:40:18.965843+0000","last_became_peered":"2024-09-17T05:40:18.965843+0000","last_unstale":"2024-09-17T05:40:20.745938+0000","last_undegraded":"2024-09-17T05:40:20.745938+0000","last_fullsized":"2024-09-17T05:40:20.745938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:10.099473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962112+0000","last_change":"2024-09-17T05:40:17.973881+0000","last_active":"2024-09-17T05:40:19.962112+0000","last_peered":"2024-09-17T05:40:19.962112+0000","last_clean":"2024-09-17T05:40:19.962112+0000","last_became_active":"2024-09-17T05:40:17.973539+0000","last_became_peered":"2024-09-17T05:40:17.973539+0000","last_unstale":"2024-09-17T05:40:19.962112+0000","last_undegraded":"2024-09-17T05:40:19.962112+0000","last_fullsized":"2024-09-17T05:40:19.962112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:07.850444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965742+0000","last_change":"2024-09-17T05:40:18.972873+0000","last_active":"2024-09-17T05:40:19.965742+0000","last_peered":"2024-09-17T05:40:19.965742+0000","last_clean":"2024-09-17T05:40:19.965742+0000","last_became_active":"2024-09-17T05:40:18.972156+0000","last_became_peered":"2024-09-17T05:40:18.972156+0000","last_unstale":"2024-09-17T05:40:19.965742+0000","last_undegraded":"2024-09-17T05:40:19.965742+0000","last_fullsized":"2024-09-17T05:40:19.965742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962371+0000","last_change":"2024-09-17T05:40:17.969993+0000","last_active":"2024-09-17T05:40:19.962371+0000","last_peered":"2024-09-17T05:40:19.962371+0000","last_clean":"2024-09-17T05:40:19.962371+0000","last_became_active":"2024-09-17T05:40:17.969577+0000","last_became_peered":"2024-09-17T05:40:17.969577+0000","last_unstale":"2024-09-17T05:40:19.962371+0000","last_undegraded":"2024-09-17T05:40:19.962371+0000","last_fullsized":"2024-09-17T05:40:19.962371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.945182+0000","last_change":"2024-09-17T05:40:17.945182+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.945182+0000","last_undegraded":"2024-09-17T05:40:17.945182+0000","last_fullsized":"2024-09-17T05:40:17.945182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879329+0000","last_change":"2024-09-17T05:40:17.972241+0000","last_active":"2024-09-17T05:40:20.879329+0000","last_peered":"2024-09-17T05:40:20.879329+0000","last_clean":"2024-09-17T05:40:20.879329+0000","last_became_active":"2024-09-17T05:40:17.971903+0000","last_became_peered":"2024-09-17T05:40:17.971903+0000","last_unstale":"2024-09-17T05:40:20.879329+0000","last_undegraded":"2024-09-17T05:40:20.879329+0000","last_fullsized":"2024-09-17T05:40:20.879329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:53.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962234+0000","last_change":"2024-09-17T05:40:18.966028+0000","last_active":"2024-09-17T05:40:19.962234+0000","last_peered":"2024-09-17T05:40:19.962234+0000","last_clean":"2024-09-17T05:40:19.962234+0000","last_became_active":"2024-09-17T05:40:18.965683+0000","last_became_peered":"2024-09-17T05:40:18.965683+0000","last_unstale":"2024-09-17T05:40:19.962234+0000","last_undegraded":"2024-09-17T05:40:19.962234+0000","last_fullsized":"2024-09-17T05:40:19.962234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961382+0000","last_change":"2024-09-17T05:40:17.966777+0000","last_active":"2024-09-17T05:40:19.961382+0000","last_peered":"2024-09-17T05:40:19.961382+0000","last_clean":"2024-09-17T05:40:19.961382+0000","last_became_active":"2024-09-17T05:40:17.966414+0000","last_became_peered":"2024-09-17T05:40:17.966414+0000","last_unstale":"2024-09-17T05:40:19.961382+0000","last_undegraded":"2024-09-17T05:40:19.961382+0000","last_fullsized":"2024-09-17T05:40:19.961382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:44.209477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880088+0000","last_change":"2024-09-17T05:40:18.969318+0000","last_active":"2024-09-17T05:40:20.880088+0000","last_peered":"2024-09-17T05:40:20.880088+0000","last_clean":"2024-09-17T05:40:20.880088+0000","last_became_active":"2024-09-17T05:40:18.968996+0000","last_became_peered":"2024-09-17T05:40:18.968996+0000","last_unstale":"2024-09-17T05:40:20.880088+0000","last_undegraded":"2024-09-17T05:40:20.880088+0000","last_fullsized":"2024-09-17T05:40:20.880088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:49.154860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.968205+0000","last_change":"2024-09-17T05:40:17.959870+0000","last_active":"2024-09-17T05:40:17.968205+0000","last_peered":"2024-09-17T05:40:17.968205+0000","last_clean":"2024-09-17T05:40:17.968205+0000","last_became_active":"2024-09-17T05:40:17.959110+0000","last_became_peered":"2024-09-17T05:40:17.959110+0000","last_unstale":"2024-09-17T05:40:17.968205+0000","last_undegraded":"2024-09-17T05:40:17.968205+0000","last_fullsized":"2024-09-17T05:40:17.968205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:38.032098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944404+0000","last_change":"2024-09-17T05:40:17.944404+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944404+0000","last_undegraded":"2024-09-17T05:40:17.944404+0000","last_fullsized":"2024-09-17T05:40:17.944404+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746438+0000","last_change":"2024-09-17T05:40:17.965056+0000","last_active":"2024-09-17T05:40:20.746438+0000","last_peered":"2024-09-17T05:40:20.746438+0000","last_clean":"2024-09-17T05:40:20.746438+0000","last_became_active":"2024-09-17T05:40:17.964655+0000","last_became_peered":"2024-09-17T05:40:17.964655+0000","last_unstale":"2024-09-17T05:40:20.746438+0000","last_undegraded":"2024-09-17T05:40:20.746438+0000","last_fullsized":"2024-09-17T05:40:20.746438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:35.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961796+0000","last_change":"2024-09-17T05:40:18.957254+0000","last_active":"2024-09-17T05:40:19.961796+0000","last_peered":"2024-09-17T05:40:19.961796+0000","last_clean":"2024-09-17T05:40:19.961796+0000","last_became_active":"2024-09-17T05:40:18.956903+0000","last_became_peered":"2024-09-17T05:40:18.956903+0000","last_unstale":"2024-09-17T05:40:19.961796+0000","last_undegraded":"2024-09-17T05:40:19.961796+0000","last_fullsized":"2024-09-17T05:40:19.961796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880695+0000","last_change":"2024-09-17T05:40:17.965827+0000","last_active":"2024-09-17T05:40:20.880695+0000","last_peered":"2024-09-17T05:40:20.880695+0000","last_clean":"2024-09-17T05:40:20.880695+0000","last_became_active":"2024-09-17T05:40:17.962330+0000","last_became_peered":"2024-09-17T05:40:17.962330+0000","last_unstale":"2024-09-17T05:40:20.880695+0000","last_undegraded":"2024-09-17T05:40:20.880695+0000","last_fullsized":"2024-09-17T05:40:20.880695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:15.809852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961491+0000","last_change":"2024-09-17T05:40:18.972381+0000","last_active":"2024-09-17T05:40:19.961491+0000","last_peered":"2024-09-17T05:40:19.961491+0000","last_clean":"2024-09-17T05:40:19.961491+0000","last_became_active":"2024-09-17T05:40:18.972050+0000","last_became_peered":"2024-09-17T05:40:18.972050+0000","last_unstale":"2024-09-17T05:40:19.961491+0000","last_undegraded":"2024-09-17T05:40:19.961491+0000","last_fullsized":"2024-09-17T05:40:19.961491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965153+0000","last_change":"2024-09-17T05:40:17.971063+0000","last_active":"2024-09-17T05:40:19.965153+0000","last_peered":"2024-09-17T05:40:19.965153+0000","last_clean":"2024-09-17T05:40:19.965153+0000","last_became_active":"2024-09-17T05:40:17.970390+0000","last_became_peered":"2024-09-17T05:40:17.970390+0000","last_unstale":"2024-09-17T05:40:19.965153+0000","last_undegraded":"2024-09-17T05:40:19.965153+0000","last_fullsized":"2024-09-17T05:40:19.965153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:24.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965290+0000","last_change":"2024-09-17T05:40:18.965052+0000","last_active":"2024-09-17T05:40:19.965290+0000","last_peered":"2024-09-17T05:40:19.965290+0000","last_clean":"2024-09-17T05:40:19.965290+0000","last_became_active":"2024-09-17T05:40:18.964428+0000","last_became_peered":"2024-09-17T05:40:18.964428+0000","last_unstale":"2024-09-17T05:40:19.965290+0000","last_undegraded":"2024-09-17T05:40:19.965290+0000","last_fullsized":"2024-09-17T05:40:19.965290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:12.516191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879706+0000","last_change":"2024-09-17T05:40:17.975190+0000","last_active":"2024-09-17T05:40:20.879706+0000","last_peered":"2024-09-17T05:40:20.879706+0000","last_clean":"2024-09-17T05:40:20.879706+0000","last_became_active":"2024-09-17T05:40:17.974679+0000","last_became_peered":"2024-09-17T05:40:17.974679+0000","last_unstale":"2024-09-17T05:40:20.879706+0000","last_undegraded":"2024-09-17T05:40:20.879706+0000","last_fullsized":"2024-09-17T05:40:20.879706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:56.674619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746000+0000","last_change":"2024-09-17T05:40:18.968708+0000","last_active":"2024-09-17T05:40:20.746000+0000","last_peered":"2024-09-17T05:40:20.746000+0000","last_clean":"2024-09-17T05:40:20.746000+0000","last_became_active":"2024-09-17T05:40:18.968273+0000","last_became_peered":"2024-09-17T05:40:18.968273+0000","last_unstale":"2024-09-17T05:40:20.746000+0000","last_undegraded":"2024-09-17T05:40:20.746000+0000","last_fullsized":"2024-09-17T05:40:20.746000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:11.746260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880446+0000","last_change":"2024-09-17T05:40:17.970784+0000","last_active":"2024-09-17T05:40:20.880446+0000","last_peered":"2024-09-17T05:40:20.880446+0000","last_clean":"2024-09-17T05:40:20.880446+0000","last_became_active":"2024-09-17T05:40:17.970430+0000","last_became_peered":"2024-09-17T05:40:17.970430+0000","last_unstale":"2024-09-17T05:40:20.880446+0000","last_undegraded":"2024-09-17T05:40:20.880446+0000","last_fullsized":"2024-09-17T05:40:20.880446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:40.544858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880886+0000","last_change":"2024-09-17T05:40:18.971140+0000","last_active":"2024-09-17T05:40:20.880886+0000","last_peered":"2024-09-17T05:40:20.880886+0000","last_clean":"2024-09-17T05:40:20.880886+0000","last_became_active":"2024-09-17T05:40:18.970843+0000","last_became_peered":"2024-09-17T05:40:18.970843+0000","last_unstale":"2024-09-17T05:40:20.880886+0000","last_undegraded":"2024-09-17T05:40:20.880886+0000","last_fullsized":"2024-09-17T05:40:20.880886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:49.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961919+0000","last_change":"2024-09-17T05:40:17.973356+0000","last_active":"2024-09-17T05:40:19.961919+0000","last_peered":"2024-09-17T05:40:19.961919+0000","last_clean":"2024-09-17T05:40:19.961919+0000","last_became_active":"2024-09-17T05:40:17.973013+0000","last_became_peered":"2024-09-17T05:40:17.973013+0000","last_unstale":"2024-09-17T05:40:19.961919+0000","last_undegraded":"2024-09-17T05:40:19.961919+0000","last_fullsized":"2024-09-17T05:40:19.961919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:10.738755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962312+0000","last_change":"2024-09-17T05:40:18.970497+0000","last_active":"2024-09-17T05:40:19.962312+0000","last_peered":"2024-09-17T05:40:19.962312+0000","last_clean":"2024-09-17T05:40:19.962312+0000","last_became_active":"2024-09-17T05:40:18.970209+0000","last_became_peered":"2024-09-17T05:40:18.970209+0000","last_unstale":"2024-09-17T05:40:19.962312+0000","last_undegraded":"2024-09-17T05:40:19.962312+0000","last_fullsized":"2024-09-17T05:40:19.962312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:17.959159+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:17.958789+0000","last_became_peered":"2024-09-17T05:40:17.958789+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:58.233971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880871+0000","last_change":"2024-09-17T05:40:18.969090+0000","last_active":"2024-09-17T05:40:20.880871+0000","last_peered":"2024-09-17T05:40:20.880871+0000","last_clean":"2024-09-17T05:40:20.880871+0000","last_became_active":"2024-09-17T05:40:18.968784+0000","last_became_peered":"2024-09-17T05:40:18.968784+0000","last_unstale":"2024-09-17T05:40:20.880871+0000","last_undegraded":"2024-09-17T05:40:20.880871+0000","last_fullsized":"2024-09-17T05:40:20.880871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.582695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965006+0000","last_change":"2024-09-17T05:40:17.965172+0000","last_active":"2024-09-17T05:40:19.965006+0000","last_peered":"2024-09-17T05:40:19.965006+0000","last_clean":"2024-09-17T05:40:19.965006+0000","last_became_active":"2024-09-17T05:40:17.964923+0000","last_became_peered":"2024-09-17T05:40:17.964923+0000","last_unstale":"2024-09-17T05:40:19.965006+0000","last_undegraded":"2024-09-17T05:40:19.965006+0000","last_fullsized":"2024-09-17T05:40:19.965006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:24.487199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878121+0000","last_change":"2024-09-17T05:40:18.978887+0000","last_active":"2024-09-17T05:40:20.878121+0000","last_peered":"2024-09-17T05:40:20.878121+0000","last_clean":"2024-09-17T05:40:20.878121+0000","last_became_active":"2024-09-17T05:40:18.978477+0000","last_became_peered":"2024-09-17T05:40:18.978477+0000","last_unstale":"2024-09-17T05:40:20.878121+0000","last_undegraded":"2024-09-17T05:40:20.878121+0000","last_fullsized":"2024-09-17T05:40:20.878121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:55.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746530+0000","last_change":"2024-09-17T05:40:17.972337+0000","last_active":"2024-09-17T05:40:20.746530+0000","last_peered":"2024-09-17T05:40:20.746530+0000","last_clean":"2024-09-17T05:40:20.746530+0000","last_became_active":"2024-09-17T05:40:17.971336+0000","last_became_peered":"2024-09-17T05:40:17.971336+0000","last_unstale":"2024-09-17T05:40:20.746530+0000","last_undegraded":"2024-09-17T05:40:20.746530+0000","last_fullsized":"2024-09-17T05:40:20.746530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:18.434892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.943214+0000","last_change":"2024-09-17T05:40:17.943214+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.943214+0000","last_undegraded":"2024-09-17T05:40:17.943214+0000","last_fullsized":"2024-09-17T05:40:17.943214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746356+0000","last_change":"2024-09-17T05:40:17.965044+0000","last_active":"2024-09-17T05:40:20.746356+0000","last_peered":"2024-09-17T05:40:20.746356+0000","last_clean":"2024-09-17T05:40:20.746356+0000","last_became_active":"2024-09-17T05:40:17.964741+0000","last_became_peered":"2024-09-17T05:40:17.964741+0000","last_unstale":"2024-09-17T05:40:20.746356+0000","last_undegraded":"2024-09-17T05:40:20.746356+0000","last_fullsized":"2024-09-17T05:40:20.746356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:52.300156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961079+0000","last_change":"2024-09-17T05:40:18.964400+0000","last_active":"2024-09-17T05:40:19.961079+0000","last_peered":"2024-09-17T05:40:19.961079+0000","last_clean":"2024-09-17T05:40:19.961079+0000","last_became_active":"2024-09-17T05:40:18.964075+0000","last_became_peered":"2024-09-17T05:40:18.964075+0000","last_unstale":"2024-09-17T05:40:19.961079+0000","last_undegraded":"2024-09-17T05:40:19.961079+0000","last_fullsized":"2024-09-17T05:40:19.961079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:34.649446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878634+0000","last_change":"2024-09-17T05:40:17.967952+0000","last_active":"2024-09-17T05:40:20.878634+0000","last_peered":"2024-09-17T05:40:20.878634+0000","last_clean":"2024-09-17T05:40:20.878634+0000","last_became_active":"2024-09-17T05:40:17.967598+0000","last_became_peered":"2024-09-17T05:40:17.967598+0000","last_unstale":"2024-09-17T05:40:20.878634+0000","last_undegraded":"2024-09-17T05:40:20.878634+0000","last_fullsized":"2024-09-17T05:40:20.878634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:19.550729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878198+0000","last_change":"2024-09-17T05:40:18.975785+0000","last_active":"2024-09-17T05:40:20.878198+0000","last_peered":"2024-09-17T05:40:20.878198+0000","last_clean":"2024-09-17T05:40:20.878198+0000","last_became_active":"2024-09-17T05:40:18.967877+0000","last_became_peered":"2024-09-17T05:40:18.967877+0000","last_unstale":"2024-09-17T05:40:20.878198+0000","last_undegraded":"2024-09-17T05:40:20.878198+0000","last_fullsized":"2024-09-17T05:40:20.878198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:02.537983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878483+0000","last_change":"2024-09-17T05:40:17.969484+0000","last_active":"2024-09-17T05:40:20.878483+0000","last_peered":"2024-09-17T05:40:20.878483+0000","last_clean":"2024-09-17T05:40:20.878483+0000","last_became_active":"2024-09-17T05:40:17.969158+0000","last_became_peered":"2024-09-17T05:40:17.969158+0000","last_unstale":"2024-09-17T05:40:20.878483+0000","last_undegraded":"2024-09-17T05:40:20.878483+0000","last_fullsized":"2024-09-17T05:40:20.878483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:36.756374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878618+0000","last_change":"2024-09-17T05:40:18.967277+0000","last_active":"2024-09-17T05:40:20.878618+0000","last_peered":"2024-09-17T05:40:20.878618+0000","last_clean":"2024-09-17T05:40:20.878618+0000","last_became_active":"2024-09-17T05:40:18.966960+0000","last_became_peered":"2024-09-17T05:40:18.966960+0000","last_unstale":"2024-09-17T05:40:20.878618+0000","last_undegraded":"2024-09-17T05:40:20.878618+0000","last_fullsized":"2024-09-17T05:40:20.878618+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:27.633925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.958537+0000","last_change":"2024-09-17T05:40:17.955665+0000","last_active":"2024-09-17T05:40:17.958537+0000","last_peered":"2024-09-17T05:40:17.958537+0000","last_clean":"2024-09-17T05:40:17.958537+0000","last_became_active":"2024-09-17T05:40:17.953041+0000","last_became_peered":"2024-09-17T05:40:17.953041+0000","last_unstale":"2024-09-17T05:40:17.958537+0000","last_undegraded":"2024-09-17T05:40:17.958537+0000","last_fullsized":"2024-09-17T05:40:17.958537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:09.529223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878836+0000","last_change":"2024-09-17T05:40:18.977272+0000","last_active":"2024-09-17T05:40:20.878836+0000","last_peered":"2024-09-17T05:40:20.878836+0000","last_clean":"2024-09-17T05:40:20.878836+0000","last_became_active":"2024-09-17T05:40:18.976916+0000","last_became_peered":"2024-09-17T05:40:18.976916+0000","last_unstale":"2024-09-17T05:40:20.878836+0000","last_undegraded":"2024-09-17T05:40:20.878836+0000","last_fullsized":"2024-09-17T05:40:20.878836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:42.993651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960931+0000","last_change":"2024-09-17T05:40:17.961323+0000","last_active":"2024-09-17T05:40:19.960931+0000","last_peered":"2024-09-17T05:40:19.960931+0000","last_clean":"2024-09-17T05:40:19.960931+0000","last_became_active":"2024-09-17T05:40:17.961012+0000","last_became_peered":"2024-09-17T05:40:17.961012+0000","last_unstale":"2024-09-17T05:40:19.960931+0000","last_undegraded":"2024-09-17T05:40:19.960931+0000","last_fullsized":"2024-09-17T05:40:19.960931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:31.323376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880144+0000","last_change":"2024-09-17T05:40:18.976598+0000","last_active":"2024-09-17T05:40:20.880144+0000","last_peered":"2024-09-17T05:40:20.880144+0000","last_clean":"2024-09-17T05:40:20.880144+0000","last_became_active":"2024-09-17T05:40:18.976246+0000","last_became_peered":"2024-09-17T05:40:18.976246+0000","last_unstale":"2024-09-17T05:40:20.880144+0000","last_undegraded":"2024-09-17T05:40:20.880144+0000","last_fullsized":"2024-09-17T05:40:20.880144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:50.563559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.969434+0000","last_change":"2024-09-17T05:40:17.962804+0000","last_active":"2024-09-17T05:40:17.969434+0000","last_peered":"2024-09-17T05:40:17.969434+0000","last_clean":"2024-09-17T05:40:17.969434+0000","last_became_active":"2024-09-17T05:40:17.962441+0000","last_became_peered":"2024-09-17T05:40:17.962441+0000","last_unstale":"2024-09-17T05:40:17.969434+0000","last_undegraded":"2024-09-17T05:40:17.969434+0000","last_fullsized":"2024-09-17T05:40:17.969434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:06.031978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745945+0000","last_change":"2024-09-17T05:40:18.964746+0000","last_active":"2024-09-17T05:40:20.745945+0000","last_peered":"2024-09-17T05:40:20.745945+0000","last_clean":"2024-09-17T05:40:20.745945+0000","last_became_active":"2024-09-17T05:40:18.962288+0000","last_became_peered":"2024-09-17T05:40:18.962288+0000","last_unstale":"2024-09-17T05:40:20.745945+0000","last_undegraded":"2024-09-17T05:40:20.745945+0000","last_fullsized":"2024-09-17T05:40:20.745945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:55.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880970+0000","last_change":"2024-09-17T05:40:17.958259+0000","last_active":"2024-09-17T05:40:20.880970+0000","last_peered":"2024-09-17T05:40:20.880970+0000","last_clean":"2024-09-17T05:40:20.880970+0000","last_became_active":"2024-09-17T05:40:17.956752+0000","last_became_peered":"2024-09-17T05:40:17.956752+0000","last_unstale":"2024-09-17T05:40:20.880970+0000","last_undegraded":"2024-09-17T05:40:20.880970+0000","last_fullsized":"2024-09-17T05:40:20.880970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:54.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880734+0000","last_change":"2024-09-17T05:40:18.967915+0000","last_active":"2024-09-17T05:40:20.880734+0000","last_peered":"2024-09-17T05:40:20.880734+0000","last_clean":"2024-09-17T05:40:20.880734+0000","last_became_active":"2024-09-17T05:40:18.967620+0000","last_became_peered":"2024-09-17T05:40:18.967620+0000","last_unstale":"2024-09-17T05:40:20.880734+0000","last_undegraded":"2024-09-17T05:40:20.880734+0000","last_fullsized":"2024-09-17T05:40:20.880734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:53.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.967006+0000","last_change":"2024-09-17T05:40:17.970621+0000","last_active":"2024-09-17T05:40:19.967006+0000","last_peered":"2024-09-17T05:40:19.967006+0000","last_clean":"2024-09-17T05:40:19.967006+0000","last_became_active":"2024-09-17T05:40:17.970196+0000","last_became_peered":"2024-09-17T05:40:17.970196+0000","last_unstale":"2024-09-17T05:40:19.967006+0000","last_undegraded":"2024-09-17T05:40:19.967006+0000","last_fullsized":"2024-09-17T05:40:19.967006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:07.550401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961767+0000","last_change":"2024-09-17T05:40:18.966610+0000","last_active":"2024-09-17T05:40:19.961767+0000","last_peered":"2024-09-17T05:40:19.961767+0000","last_clean":"2024-09-17T05:40:19.961767+0000","last_became_active":"2024-09-17T05:40:18.966276+0000","last_became_peered":"2024-09-17T05:40:18.966276+0000","last_unstale":"2024-09-17T05:40:19.961767+0000","last_undegraded":"2024-09-17T05:40:19.961767+0000","last_fullsized":"2024-09-17T05:40:19.961767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:53.342120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880935+0000","last_change":"2024-09-17T05:40:17.963755+0000","last_active":"2024-09-17T05:40:20.880935+0000","last_peered":"2024-09-17T05:40:20.880935+0000","last_clean":"2024-09-17T05:40:20.880935+0000","last_became_active":"2024-09-17T05:40:17.963439+0000","last_became_peered":"2024-09-17T05:40:17.963439+0000","last_unstale":"2024-09-17T05:40:20.880935+0000","last_undegraded":"2024-09-17T05:40:20.880935+0000","last_fullsized":"2024-09-17T05:40:20.880935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.746862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961385+0000","last_change":"2024-09-17T05:40:18.956932+0000","last_active":"2024-09-17T05:40:19.961385+0000","last_peered":"2024-09-17T05:40:19.961385+0000","last_clean":"2024-09-17T05:40:19.961385+0000","last_became_active":"2024-09-17T05:40:18.956628+0000","last_became_peered":"2024-09-17T05:40:18.956628+0000","last_unstale":"2024-09-17T05:40:19.961385+0000","last_undegraded":"2024-09-17T05:40:19.961385+0000","last_fullsized":"2024-09-17T05:40:19.961385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746198+0000","last_change":"2024-09-17T05:40:17.963225+0000","last_active":"2024-09-17T05:40:20.746198+0000","last_peered":"2024-09-17T05:40:20.746198+0000","last_clean":"2024-09-17T05:40:20.746198+0000","last_became_active":"2024-09-17T05:40:17.962712+0000","last_became_peered":"2024-09-17T05:40:17.962712+0000","last_unstale":"2024-09-17T05:40:20.746198+0000","last_undegraded":"2024-09-17T05:40:20.746198+0000","last_fullsized":"2024-09-17T05:40:20.746198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:26.824455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962047+0000","last_change":"2024-09-17T05:40:18.966387+0000","last_active":"2024-09-17T05:40:19.962047+0000","last_peered":"2024-09-17T05:40:19.962047+0000","last_clean":"2024-09-17T05:40:19.962047+0000","last_became_active":"2024-09-17T05:40:18.966066+0000","last_became_peered":"2024-09-17T05:40:18.966066+0000","last_unstale":"2024-09-17T05:40:19.962047+0000","last_undegraded":"2024-09-17T05:40:19.962047+0000","last_fullsized":"2024-09-17T05:40:19.962047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879461+0000","last_change":"2024-09-17T05:40:17.967077+0000","last_active":"2024-09-17T05:40:20.879461+0000","last_peered":"2024-09-17T05:40:20.879461+0000","last_clean":"2024-09-17T05:40:20.879461+0000","last_became_active":"2024-09-17T05:40:17.966350+0000","last_became_peered":"2024-09-17T05:40:17.966350+0000","last_unstale":"2024-09-17T05:40:20.879461+0000","last_undegraded":"2024-09-17T05:40:20.879461+0000","last_fullsized":"2024-09-17T05:40:20.879461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:53.153954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746326+0000","last_change":"2024-09-17T05:40:18.972375+0000","last_active":"2024-09-17T05:40:20.746326+0000","last_peered":"2024-09-17T05:40:20.746326+0000","last_clean":"2024-09-17T05:40:20.746326+0000","last_became_active":"2024-09-17T05:40:18.972044+0000","last_became_peered":"2024-09-17T05:40:18.972044+0000","last_unstale":"2024-09-17T05:40:20.746326+0000","last_undegraded":"2024-09-17T05:40:20.746326+0000","last_fullsized":"2024-09-17T05:40:20.746326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:45.216982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965453+0000","last_change":"2024-09-17T05:40:17.963155+0000","last_active":"2024-09-17T05:40:19.965453+0000","last_peered":"2024-09-17T05:40:19.965453+0000","last_clean":"2024-09-17T05:40:19.965453+0000","last_became_active":"2024-09-17T05:40:17.962627+0000","last_became_peered":"2024-09-17T05:40:17.962627+0000","last_unstale":"2024-09-17T05:40:19.965453+0000","last_undegraded":"2024-09-17T05:40:19.965453+0000","last_fullsized":"2024-09-17T05:40:19.965453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.151688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944302+0000","last_change":"2024-09-17T05:40:17.944302+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944302+0000","last_undegraded":"2024-09-17T05:40:17.944302+0000","last_fullsized":"2024-09-17T05:40:17.944302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745749+0000","last_change":"2024-09-17T05:40:17.963433+0000","last_active":"2024-09-17T05:40:20.745749+0000","last_peered":"2024-09-17T05:40:20.745749+0000","last_clean":"2024-09-17T05:40:20.745749+0000","last_became_active":"2024-09-17T05:40:17.963089+0000","last_became_peered":"2024-09-17T05:40:17.963089+0000","last_unstale":"2024-09-17T05:40:20.745749+0000","last_undegraded":"2024-09-17T05:40:20.745749+0000","last_fullsized":"2024-09-17T05:40:20.745749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:47.055143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878756+0000","last_change":"2024-09-17T05:40:18.969053+0000","last_active":"2024-09-17T05:40:20.878756+0000","last_peered":"2024-09-17T05:40:20.878756+0000","last_clean":"2024-09-17T05:40:20.878756+0000","last_became_active":"2024-09-17T05:40:18.968741+0000","last_became_peered":"2024-09-17T05:40:18.968741+0000","last_unstale":"2024-09-17T05:40:20.878756+0000","last_undegraded":"2024-09-17T05:40:20.878756+0000","last_fullsized":"2024-09-17T05:40:20.878756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:47.639721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.960097+0000","last_change":"2024-09-17T05:40:17.955748+0000","last_active":"2024-09-17T05:40:17.960097+0000","last_peered":"2024-09-17T05:40:17.960097+0000","last_clean":"2024-09-17T05:40:17.960097+0000","last_became_active":"2024-09-17T05:40:17.953494+0000","last_became_peered":"2024-09-17T05:40:17.953494+0000","last_unstale":"2024-09-17T05:40:17.960097+0000","last_undegraded":"2024-09-17T05:40:17.960097+0000","last_fullsized":"2024-09-17T05:40:17.960097+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:33.310342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879800+0000","last_change":"2024-09-17T05:40:18.962984+0000","last_active":"2024-09-17T05:40:20.879800+0000","last_peered":"2024-09-17T05:40:20.879800+0000","last_clean":"2024-09-17T05:40:20.879800+0000","last_became_active":"2024-09-17T05:40:18.962658+0000","last_became_peered":"2024-09-17T05:40:18.962658+0000","last_unstale":"2024-09-17T05:40:20.879800+0000","last_undegraded":"2024-09-17T05:40:20.879800+0000","last_fullsized":"2024-09-17T05:40:20.879800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.691731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965293+0000","last_change":"2024-09-17T05:40:17.966745+0000","last_active":"2024-09-17T05:40:19.965293+0000","last_peered":"2024-09-17T05:40:19.965293+0000","last_clean":"2024-09-17T05:40:19.965293+0000","last_became_active":"2024-09-17T05:40:17.966394+0000","last_became_peered":"2024-09-17T05:40:17.966394+0000","last_unstale":"2024-09-17T05:40:19.965293+0000","last_undegraded":"2024-09-17T05:40:19.965293+0000","last_fullsized":"2024-09-17T05:40:19.965293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:48.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879666+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:40:20.879666+0000","last_peered":"2024-09-17T05:40:20.879666+0000","last_clean":"2024-09-17T05:40:20.879666+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:40:20.879666+0000","last_undegraded":"2024-09-17T05:40:20.879666+0000","last_fullsized":"2024-09-17T05:40:20.879666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":929792,"data_stored":417818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1531904,"data_stored":1014316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":942080,"data_stored":418882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":423858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1531904,"data_stored":1009180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":897024,"data_stored":403332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:40:23.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 -- 172.21.15.44:0/4044508312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0ce300 msgr2=0x7f4edc167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 --2- 172.21.15.44:0/4044508312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0ce300 0x7f4edc167120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009c80 tx=0x7f4ed401cda0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 -- 172.21.15.44:0/4044508312 shutdown_connections 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 --2- 172.21.15.44:0/4044508312 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0ce300 0x7f4edc167120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 --2- 172.21.15.44:0/4044508312 >> v2:172.21.15.86:3300/0 conn(0x7f4edc0b5880 0x7f4edc06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 -- 172.21.15.44:0/4044508312 >> 172.21.15.44:0/4044508312 conn(0x7f4edc0ccaa0 msgr2=0x7f4edc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 -- 172.21.15.44:0/4044508312 shutdown_connections 2024-09-17T05:40:23.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.768+0000 7f4ee2600640 1 -- 172.21.15.44:0/4044508312 wait complete. 2024-09-17T05:40:23.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 Processor -- start 2024-09-17T05:40:23.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 -- start start 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4edc06e390 0x7f4edc0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0b5880 0x7f4edc154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4edc0ce300 0x7f4edc0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc16a000 con 0x7f4edc0ce300 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc169e80 con 0x7f4edc06e390 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4edc16a180 con 0x7f4edc0b5880 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4edc0ce300 0x7f4edc0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4edc0ce300 0x7f4edc0cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58574/0 (socket says 172.21.15.44:58574) 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 -- 172.21.15.44:0/2404247143 learned_addr learned my addr 172.21.15.44:0/2404247143 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edb400640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4edc06e390 0x7f4edc0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ed3e00640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0b5880 0x7f4edc154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 -- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0b5880 msgr2=0x7f4edc154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0b5880 0x7f4edc154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 -- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4edc06e390 msgr2=0x7f4edc0c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4edc06e390 0x7f4edc0c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 -- 172.21.15.44:0/2404247143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc15c7d0 con 0x7f4edc0ce300 2024-09-17T05:40:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4edbe00640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4edc0ce300 0x7f4edc0cbb50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4ed401d280 tx=0x7f4ed4005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ed3400640 1 -- 172.21.15.44:0/2404247143 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40b2040 con 0x7f4edc0ce300 2024-09-17T05:40:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ed3400640 1 -- 172.21.15.44:0/2404247143 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ed40bb070 con 0x7f4edc0ce300 2024-09-17T05:40:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4edc1f8df0 con 0x7f4edc0ce300 2024-09-17T05:40:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ed3400640 1 -- 172.21.15.44:0/2404247143 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4004240 con 0x7f4edc0ce300 2024-09-17T05:40:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.772+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4edc1f90b0 con 0x7f4edc0ce300 2024-09-17T05:40:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.776+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4edc06de50 con 0x7f4edc0ce300 2024-09-17T05:40:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.776+0000 7f4ed3400640 1 -- 172.21.15.44:0/2404247143 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4ed40043e0 con 0x7f4edc0ce300 2024-09-17T05:40:23.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.776+0000 7f4ed3400640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4eb8073230 0x7f4eb8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:23.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.776+0000 7f4ed3400640 1 -- 172.21.15.44:0/2404247143 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f4ed412f740 con 0x7f4edc0ce300 2024-09-17T05:40:23.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.776+0000 7f4edb400640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4eb8073230 0x7f4eb8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.776+0000 7f4edb400640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4eb8073230 0x7f4eb8075740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009600 tx=0x7f4ecc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.780+0000 7f4ed3400640 1 -- 172.21.15.44:0/2404247143 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4ed4016990 con 0x7f4edc0ce300 2024-09-17T05:40:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.952+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4edc0c8190 con 0x7f4eb8073230 2024-09-17T05:40:23.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.956+0000 7f4ed3400640 1 -- 172.21.15.44:0/2404247143 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251076 (secure 0 0 0) 0x7f4edc0c8190 con 0x7f4eb8073230 2024-09-17T05:40:23.961 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:23.962 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:40:23.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4eb8073230 msgr2=0x7f4eb8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4eb8073230 0x7f4eb8075740 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009600 tx=0x7f4ecc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4edc0ce300 msgr2=0x7f4edc0cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4edc0ce300 0x7f4edc0cbb50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4ed401d280 tx=0x7f4ed4005c20 comp rx=0 tx=0).stop 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 shutdown_connections 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4edc0ce300 0x7f4edc0cbb50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4edc0b5880 0x7f4edc154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4eb8073230 0x7f4eb8075740 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 --2- 172.21.15.44:0/2404247143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4edc06e390 0x7f4edc0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 >> 172.21.15.44:0/2404247143 conn(0x7f4edc0ccaa0 msgr2=0x7f4edc155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 shutdown_connections 2024-09-17T05:40:23.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:23.960+0000 7f4ee2600640 1 -- 172.21.15.44:0/2404247143 wait complete. 2024-09-17T05:40:23.982 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-17T05:40:22.324757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253824,"kb_used_data":8440,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720896,"statfs":{"total":773094113280,"available":772834197504,"internally_reserved":0,"allocated":8642560,"data_stored":4535146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.388951"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.881021+0000","last_change":"2024-09-17T05:40:18.975938+0000","last_active":"2024-09-17T05:40:20.881021+0000","last_peered":"2024-09-17T05:40:20.881021+0000","last_clean":"2024-09-17T05:40:20.881021+0000","last_became_active":"2024-09-17T05:40:18.974724+0000","last_became_peered":"2024-09-17T05:40:18.974724+0000","last_unstale":"2024-09-17T05:40:20.881021+0000","last_undegraded":"2024-09-17T05:40:20.881021+0000","last_fullsized":"2024-09-17T05:40:20.881021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.159194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.947782+0000","last_change":"2024-09-17T05:40:17.947782+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.947782+0000","last_undegraded":"2024-09-17T05:40:17.947782+0000","last_fullsized":"2024-09-17T05:40:17.947782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.948891+0000","last_change":"2024-09-17T05:40:17.948891+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.948891+0000","last_undegraded":"2024-09-17T05:40:17.948891+0000","last_fullsized":"2024-09-17T05:40:17.948891+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746017+0000","last_change":"2024-09-17T05:40:18.964044+0000","last_active":"2024-09-17T05:40:20.746017+0000","last_peered":"2024-09-17T05:40:20.746017+0000","last_clean":"2024-09-17T05:40:20.746017+0000","last_became_active":"2024-09-17T05:40:18.963750+0000","last_became_peered":"2024-09-17T05:40:18.963750+0000","last_unstale":"2024-09-17T05:40:20.746017+0000","last_undegraded":"2024-09-17T05:40:20.746017+0000","last_fullsized":"2024-09-17T05:40:20.746017+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:14.837382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878318+0000","last_change":"2024-09-17T05:40:18.968256+0000","last_active":"2024-09-17T05:40:20.878318+0000","last_peered":"2024-09-17T05:40:20.878318+0000","last_clean":"2024-09-17T05:40:20.878318+0000","last_became_active":"2024-09-17T05:40:18.967470+0000","last_became_peered":"2024-09-17T05:40:18.967470+0000","last_unstale":"2024-09-17T05:40:20.878318+0000","last_undegraded":"2024-09-17T05:40:20.878318+0000","last_fullsized":"2024-09-17T05:40:20.878318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:24.741584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965291+0000","last_change":"2024-09-17T05:40:18.967355+0000","last_active":"2024-09-17T05:40:19.965291+0000","last_peered":"2024-09-17T05:40:19.965291+0000","last_clean":"2024-09-17T05:40:19.965291+0000","last_became_active":"2024-09-17T05:40:18.966887+0000","last_became_peered":"2024-09-17T05:40:18.966887+0000","last_unstale":"2024-09-17T05:40:19.965291+0000","last_undegraded":"2024-09-17T05:40:19.965291+0000","last_fullsized":"2024-09-17T05:40:19.965291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745704+0000","last_change":"2024-09-17T05:40:18.968515+0000","last_active":"2024-09-17T05:40:20.745704+0000","last_peered":"2024-09-17T05:40:20.745704+0000","last_clean":"2024-09-17T05:40:20.745704+0000","last_became_active":"2024-09-17T05:40:18.968183+0000","last_became_peered":"2024-09-17T05:40:18.968183+0000","last_unstale":"2024-09-17T05:40:20.745704+0000","last_undegraded":"2024-09-17T05:40:20.745704+0000","last_fullsized":"2024-09-17T05:40:20.745704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:21.966993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960842+0000","last_change":"2024-09-17T05:40:18.959333+0000","last_active":"2024-09-17T05:40:19.960842+0000","last_peered":"2024-09-17T05:40:19.960842+0000","last_clean":"2024-09-17T05:40:19.960842+0000","last_became_active":"2024-09-17T05:40:18.959011+0000","last_became_peered":"2024-09-17T05:40:18.959011+0000","last_unstale":"2024-09-17T05:40:19.960842+0000","last_undegraded":"2024-09-17T05:40:19.960842+0000","last_fullsized":"2024-09-17T05:40:19.960842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746482+0000","last_change":"2024-09-17T05:40:18.969295+0000","last_active":"2024-09-17T05:40:20.746482+0000","last_peered":"2024-09-17T05:40:20.746482+0000","last_clean":"2024-09-17T05:40:20.746482+0000","last_became_active":"2024-09-17T05:40:18.968254+0000","last_became_peered":"2024-09-17T05:40:18.968254+0000","last_unstale":"2024-09-17T05:40:20.746482+0000","last_undegraded":"2024-09-17T05:40:20.746482+0000","last_fullsized":"2024-09-17T05:40:20.746482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880679+0000","last_change":"2024-09-17T05:40:18.963445+0000","last_active":"2024-09-17T05:40:20.880679+0000","last_peered":"2024-09-17T05:40:20.880679+0000","last_clean":"2024-09-17T05:40:20.880679+0000","last_became_active":"2024-09-17T05:40:18.963109+0000","last_became_peered":"2024-09-17T05:40:18.963109+0000","last_unstale":"2024-09-17T05:40:20.880679+0000","last_undegraded":"2024-09-17T05:40:20.880679+0000","last_fullsized":"2024-09-17T05:40:20.880679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:27.338578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.948411+0000","last_change":"2024-09-17T05:40:17.948411+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.948411+0000","last_undegraded":"2024-09-17T05:40:17.948411+0000","last_fullsized":"2024-09-17T05:40:17.948411+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961968+0000","last_change":"2024-09-17T05:40:18.963052+0000","last_active":"2024-09-17T05:40:19.961968+0000","last_peered":"2024-09-17T05:40:19.961968+0000","last_clean":"2024-09-17T05:40:19.961968+0000","last_became_active":"2024-09-17T05:40:18.962788+0000","last_became_peered":"2024-09-17T05:40:18.962788+0000","last_unstale":"2024-09-17T05:40:19.961968+0000","last_undegraded":"2024-09-17T05:40:19.961968+0000","last_fullsized":"2024-09-17T05:40:19.961968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:56.383960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944142+0000","last_change":"2024-09-17T05:40:17.944142+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944142+0000","last_undegraded":"2024-09-17T05:40:17.944142+0000","last_fullsized":"2024-09-17T05:40:17.944142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960902+0000","last_change":"2024-09-17T05:40:18.962572+0000","last_active":"2024-09-17T05:40:19.960902+0000","last_peered":"2024-09-17T05:40:19.960902+0000","last_clean":"2024-09-17T05:40:19.960902+0000","last_became_active":"2024-09-17T05:40:18.961900+0000","last_became_peered":"2024-09-17T05:40:18.961900+0000","last_unstale":"2024-09-17T05:40:19.960902+0000","last_undegraded":"2024-09-17T05:40:19.960902+0000","last_fullsized":"2024-09-17T05:40:19.960902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877975+0000","last_change":"2024-09-17T05:40:18.978496+0000","last_active":"2024-09-17T05:40:20.877975+0000","last_peered":"2024-09-17T05:40:20.877975+0000","last_clean":"2024-09-17T05:40:20.877975+0000","last_became_active":"2024-09-17T05:40:18.978005+0000","last_became_peered":"2024-09-17T05:40:18.978005+0000","last_unstale":"2024-09-17T05:40:20.877975+0000","last_undegraded":"2024-09-17T05:40:20.877975+0000","last_fullsized":"2024-09-17T05:40:20.877975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:36.509694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745632+0000","last_change":"2024-09-17T05:40:18.965425+0000","last_active":"2024-09-17T05:40:20.745632+0000","last_peered":"2024-09-17T05:40:20.745632+0000","last_clean":"2024-09-17T05:40:20.745632+0000","last_became_active":"2024-09-17T05:40:18.965158+0000","last_became_peered":"2024-09-17T05:40:18.965158+0000","last_unstale":"2024-09-17T05:40:20.745632+0000","last_undegraded":"2024-09-17T05:40:20.745632+0000","last_fullsized":"2024-09-17T05:40:20.745632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:05.487453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961571+0000","last_change":"2024-09-17T05:40:18.976391+0000","last_active":"2024-09-17T05:40:19.961571+0000","last_peered":"2024-09-17T05:40:19.961571+0000","last_clean":"2024-09-17T05:40:19.961571+0000","last_became_active":"2024-09-17T05:40:18.974193+0000","last_became_peered":"2024-09-17T05:40:18.974193+0000","last_unstale":"2024-09-17T05:40:19.961571+0000","last_undegraded":"2024-09-17T05:40:19.961571+0000","last_fullsized":"2024-09-17T05:40:19.961571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944884+0000","last_change":"2024-09-17T05:40:17.944884+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944884+0000","last_undegraded":"2024-09-17T05:40:17.944884+0000","last_fullsized":"2024-09-17T05:40:17.944884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961756+0000","last_change":"2024-09-17T05:40:18.962751+0000","last_active":"2024-09-17T05:40:19.961756+0000","last_peered":"2024-09-17T05:40:19.961756+0000","last_clean":"2024-09-17T05:40:19.961756+0000","last_became_active":"2024-09-17T05:40:18.962431+0000","last_became_peered":"2024-09-17T05:40:18.962431+0000","last_unstale":"2024-09-17T05:40:19.961756+0000","last_undegraded":"2024-09-17T05:40:19.961756+0000","last_fullsized":"2024-09-17T05:40:19.961756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:17.076796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965677+0000","last_change":"2024-09-17T05:40:18.973187+0000","last_active":"2024-09-17T05:40:19.965677+0000","last_peered":"2024-09-17T05:40:19.965677+0000","last_clean":"2024-09-17T05:40:19.965677+0000","last_became_active":"2024-09-17T05:40:18.972583+0000","last_became_peered":"2024-09-17T05:40:18.972583+0000","last_unstale":"2024-09-17T05:40:19.965677+0000","last_undegraded":"2024-09-17T05:40:19.965677+0000","last_fullsized":"2024-09-17T05:40:19.965677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:10.548067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961966+0000","last_change":"2024-09-17T05:40:18.953388+0000","last_active":"2024-09-17T05:40:19.961966+0000","last_peered":"2024-09-17T05:40:19.961966+0000","last_clean":"2024-09-17T05:40:19.961966+0000","last_became_active":"2024-09-17T05:40:18.953020+0000","last_became_peered":"2024-09-17T05:40:18.953020+0000","last_unstale":"2024-09-17T05:40:19.961966+0000","last_undegraded":"2024-09-17T05:40:19.961966+0000","last_fullsized":"2024-09-17T05:40:19.961966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.943263+0000","last_change":"2024-09-17T05:40:17.943263+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.943263+0000","last_undegraded":"2024-09-17T05:40:17.943263+0000","last_fullsized":"2024-09-17T05:40:17.943263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880403+0000","last_change":"2024-09-17T05:40:18.964476+0000","last_active":"2024-09-17T05:40:20.880403+0000","last_peered":"2024-09-17T05:40:20.880403+0000","last_clean":"2024-09-17T05:40:20.880403+0000","last_became_active":"2024-09-17T05:40:18.961909+0000","last_became_peered":"2024-09-17T05:40:18.961909+0000","last_unstale":"2024-09-17T05:40:20.880403+0000","last_undegraded":"2024-09-17T05:40:20.880403+0000","last_fullsized":"2024-09-17T05:40:20.880403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:43.786845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944946+0000","last_change":"2024-09-17T05:40:17.944946+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944946+0000","last_undegraded":"2024-09-17T05:40:17.944946+0000","last_fullsized":"2024-09-17T05:40:17.944946+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965692+0000","last_change":"2024-09-17T05:40:18.976020+0000","last_active":"2024-09-17T05:40:19.965692+0000","last_peered":"2024-09-17T05:40:19.965692+0000","last_clean":"2024-09-17T05:40:19.965692+0000","last_became_active":"2024-09-17T05:40:18.975685+0000","last_became_peered":"2024-09-17T05:40:18.975685+0000","last_unstale":"2024-09-17T05:40:19.965692+0000","last_undegraded":"2024-09-17T05:40:19.965692+0000","last_fullsized":"2024-09-17T05:40:19.965692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:21.915494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746347+0000","last_change":"2024-09-17T05:40:18.970329+0000","last_active":"2024-09-17T05:40:20.746347+0000","last_peered":"2024-09-17T05:40:20.746347+0000","last_clean":"2024-09-17T05:40:20.746347+0000","last_became_active":"2024-09-17T05:40:18.970033+0000","last_became_peered":"2024-09-17T05:40:18.970033+0000","last_unstale":"2024-09-17T05:40:20.746347+0000","last_undegraded":"2024-09-17T05:40:20.746347+0000","last_fullsized":"2024-09-17T05:40:20.746347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746067+0000","last_change":"2024-09-17T05:40:18.971355+0000","last_active":"2024-09-17T05:40:20.746067+0000","last_peered":"2024-09-17T05:40:20.746067+0000","last_clean":"2024-09-17T05:40:20.746067+0000","last_became_active":"2024-09-17T05:40:18.971020+0000","last_became_peered":"2024-09-17T05:40:18.971020+0000","last_unstale":"2024-09-17T05:40:20.746067+0000","last_undegraded":"2024-09-17T05:40:20.746067+0000","last_fullsized":"2024-09-17T05:40:20.746067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:44.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878335+0000","last_change":"2024-09-17T05:40:18.973895+0000","last_active":"2024-09-17T05:40:20.878335+0000","last_peered":"2024-09-17T05:40:20.878335+0000","last_clean":"2024-09-17T05:40:20.878335+0000","last_became_active":"2024-09-17T05:40:18.968948+0000","last_became_peered":"2024-09-17T05:40:18.968948+0000","last_unstale":"2024-09-17T05:40:20.878335+0000","last_undegraded":"2024-09-17T05:40:20.878335+0000","last_fullsized":"2024-09-17T05:40:20.878335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:34.472712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965243+0000","last_change":"2024-09-17T05:40:18.971284+0000","last_active":"2024-09-17T05:40:19.965243+0000","last_peered":"2024-09-17T05:40:19.965243+0000","last_clean":"2024-09-17T05:40:19.965243+0000","last_became_active":"2024-09-17T05:40:18.966667+0000","last_became_peered":"2024-09-17T05:40:18.966667+0000","last_unstale":"2024-09-17T05:40:19.965243+0000","last_undegraded":"2024-09-17T05:40:19.965243+0000","last_fullsized":"2024-09-17T05:40:19.965243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880748+0000","last_change":"2024-09-17T05:40:18.965174+0000","last_active":"2024-09-17T05:40:20.880748+0000","last_peered":"2024-09-17T05:40:20.880748+0000","last_clean":"2024-09-17T05:40:20.880748+0000","last_became_active":"2024-09-17T05:40:18.964778+0000","last_became_peered":"2024-09-17T05:40:18.964778+0000","last_unstale":"2024-09-17T05:40:20.880748+0000","last_undegraded":"2024-09-17T05:40:20.880748+0000","last_fullsized":"2024-09-17T05:40:20.880748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:58.112444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.946191+0000","last_change":"2024-09-17T05:40:17.946191+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.946191+0000","last_undegraded":"2024-09-17T05:40:17.946191+0000","last_fullsized":"2024-09-17T05:40:17.946191+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745554+0000","last_change":"2024-09-17T05:40:18.969453+0000","last_active":"2024-09-17T05:40:20.745554+0000","last_peered":"2024-09-17T05:40:20.745554+0000","last_clean":"2024-09-17T05:40:20.745554+0000","last_became_active":"2024-09-17T05:40:18.968764+0000","last_became_peered":"2024-09-17T05:40:18.968764+0000","last_unstale":"2024-09-17T05:40:20.745554+0000","last_undegraded":"2024-09-17T05:40:20.745554+0000","last_fullsized":"2024-09-17T05:40:20.745554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877960+0000","last_change":"2024-09-17T05:40:18.968303+0000","last_active":"2024-09-17T05:40:20.877960+0000","last_peered":"2024-09-17T05:40:20.877960+0000","last_clean":"2024-09-17T05:40:20.877960+0000","last_became_active":"2024-09-17T05:40:18.967969+0000","last_became_peered":"2024-09-17T05:40:18.967969+0000","last_unstale":"2024-09-17T05:40:20.877960+0000","last_undegraded":"2024-09-17T05:40:20.877960+0000","last_fullsized":"2024-09-17T05:40:20.877960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.754367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878733+0000","last_change":"2024-09-17T05:40:17.961361+0000","last_active":"2024-09-17T05:40:20.878733+0000","last_peered":"2024-09-17T05:40:20.878733+0000","last_clean":"2024-09-17T05:40:20.878733+0000","last_became_active":"2024-09-17T05:40:17.960382+0000","last_became_peered":"2024-09-17T05:40:17.960382+0000","last_unstale":"2024-09-17T05:40:20.878733+0000","last_undegraded":"2024-09-17T05:40:20.878733+0000","last_fullsized":"2024-09-17T05:40:20.878733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:14.971857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:18.975317+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:18.975011+0000","last_became_peered":"2024-09-17T05:40:18.975011+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:19.442398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880008+0000","last_change":"2024-09-17T05:40:17.966550+0000","last_active":"2024-09-17T05:40:20.880008+0000","last_peered":"2024-09-17T05:40:20.880008+0000","last_clean":"2024-09-17T05:40:20.880008+0000","last_became_active":"2024-09-17T05:40:17.966232+0000","last_became_peered":"2024-09-17T05:40:17.966232+0000","last_unstale":"2024-09-17T05:40:20.880008+0000","last_undegraded":"2024-09-17T05:40:20.880008+0000","last_fullsized":"2024-09-17T05:40:20.880008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.669759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961738+0000","last_change":"2024-09-17T05:40:18.965633+0000","last_active":"2024-09-17T05:40:19.961738+0000","last_peered":"2024-09-17T05:40:19.961738+0000","last_clean":"2024-09-17T05:40:19.961738+0000","last_became_active":"2024-09-17T05:40:18.965055+0000","last_became_peered":"2024-09-17T05:40:18.965055+0000","last_unstale":"2024-09-17T05:40:19.961738+0000","last_undegraded":"2024-09-17T05:40:19.961738+0000","last_fullsized":"2024-09-17T05:40:19.961738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:23.790972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880827+0000","last_change":"2024-09-17T05:40:17.971273+0000","last_active":"2024-09-17T05:40:20.880827+0000","last_peered":"2024-09-17T05:40:20.880827+0000","last_clean":"2024-09-17T05:40:20.880827+0000","last_became_active":"2024-09-17T05:40:17.970885+0000","last_became_peered":"2024-09-17T05:40:17.970885+0000","last_unstale":"2024-09-17T05:40:20.880827+0000","last_undegraded":"2024-09-17T05:40:20.880827+0000","last_fullsized":"2024-09-17T05:40:20.880827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.395940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745938+0000","last_change":"2024-09-17T05:40:18.966252+0000","last_active":"2024-09-17T05:40:20.745938+0000","last_peered":"2024-09-17T05:40:20.745938+0000","last_clean":"2024-09-17T05:40:20.745938+0000","last_became_active":"2024-09-17T05:40:18.965843+0000","last_became_peered":"2024-09-17T05:40:18.965843+0000","last_unstale":"2024-09-17T05:40:20.745938+0000","last_undegraded":"2024-09-17T05:40:20.745938+0000","last_fullsized":"2024-09-17T05:40:20.745938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:10.099473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962112+0000","last_change":"2024-09-17T05:40:17.973881+0000","last_active":"2024-09-17T05:40:19.962112+0000","last_peered":"2024-09-17T05:40:19.962112+0000","last_clean":"2024-09-17T05:40:19.962112+0000","last_became_active":"2024-09-17T05:40:17.973539+0000","last_became_peered":"2024-09-17T05:40:17.973539+0000","last_unstale":"2024-09-17T05:40:19.962112+0000","last_undegraded":"2024-09-17T05:40:19.962112+0000","last_fullsized":"2024-09-17T05:40:19.962112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:07.850444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965742+0000","last_change":"2024-09-17T05:40:18.972873+0000","last_active":"2024-09-17T05:40:19.965742+0000","last_peered":"2024-09-17T05:40:19.965742+0000","last_clean":"2024-09-17T05:40:19.965742+0000","last_became_active":"2024-09-17T05:40:18.972156+0000","last_became_peered":"2024-09-17T05:40:18.972156+0000","last_unstale":"2024-09-17T05:40:19.965742+0000","last_undegraded":"2024-09-17T05:40:19.965742+0000","last_fullsized":"2024-09-17T05:40:19.965742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962371+0000","last_change":"2024-09-17T05:40:17.969993+0000","last_active":"2024-09-17T05:40:19.962371+0000","last_peered":"2024-09-17T05:40:19.962371+0000","last_clean":"2024-09-17T05:40:19.962371+0000","last_became_active":"2024-09-17T05:40:17.969577+0000","last_became_peered":"2024-09-17T05:40:17.969577+0000","last_unstale":"2024-09-17T05:40:19.962371+0000","last_undegraded":"2024-09-17T05:40:19.962371+0000","last_fullsized":"2024-09-17T05:40:19.962371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.945182+0000","last_change":"2024-09-17T05:40:17.945182+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.945182+0000","last_undegraded":"2024-09-17T05:40:17.945182+0000","last_fullsized":"2024-09-17T05:40:17.945182+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879329+0000","last_change":"2024-09-17T05:40:17.972241+0000","last_active":"2024-09-17T05:40:20.879329+0000","last_peered":"2024-09-17T05:40:20.879329+0000","last_clean":"2024-09-17T05:40:20.879329+0000","last_became_active":"2024-09-17T05:40:17.971903+0000","last_became_peered":"2024-09-17T05:40:17.971903+0000","last_unstale":"2024-09-17T05:40:20.879329+0000","last_undegraded":"2024-09-17T05:40:20.879329+0000","last_fullsized":"2024-09-17T05:40:20.879329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:53.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962234+0000","last_change":"2024-09-17T05:40:18.966028+0000","last_active":"2024-09-17T05:40:19.962234+0000","last_peered":"2024-09-17T05:40:19.962234+0000","last_clean":"2024-09-17T05:40:19.962234+0000","last_became_active":"2024-09-17T05:40:18.965683+0000","last_became_peered":"2024-09-17T05:40:18.965683+0000","last_unstale":"2024-09-17T05:40:19.962234+0000","last_undegraded":"2024-09-17T05:40:19.962234+0000","last_fullsized":"2024-09-17T05:40:19.962234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961382+0000","last_change":"2024-09-17T05:40:17.966777+0000","last_active":"2024-09-17T05:40:19.961382+0000","last_peered":"2024-09-17T05:40:19.961382+0000","last_clean":"2024-09-17T05:40:19.961382+0000","last_became_active":"2024-09-17T05:40:17.966414+0000","last_became_peered":"2024-09-17T05:40:17.966414+0000","last_unstale":"2024-09-17T05:40:19.961382+0000","last_undegraded":"2024-09-17T05:40:19.961382+0000","last_fullsized":"2024-09-17T05:40:19.961382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:44.209477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880088+0000","last_change":"2024-09-17T05:40:18.969318+0000","last_active":"2024-09-17T05:40:20.880088+0000","last_peered":"2024-09-17T05:40:20.880088+0000","last_clean":"2024-09-17T05:40:20.880088+0000","last_became_active":"2024-09-17T05:40:18.968996+0000","last_became_peered":"2024-09-17T05:40:18.968996+0000","last_unstale":"2024-09-17T05:40:20.880088+0000","last_undegraded":"2024-09-17T05:40:20.880088+0000","last_fullsized":"2024-09-17T05:40:20.880088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:49.154860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.968205+0000","last_change":"2024-09-17T05:40:17.959870+0000","last_active":"2024-09-17T05:40:17.968205+0000","last_peered":"2024-09-17T05:40:17.968205+0000","last_clean":"2024-09-17T05:40:17.968205+0000","last_became_active":"2024-09-17T05:40:17.959110+0000","last_became_peered":"2024-09-17T05:40:17.959110+0000","last_unstale":"2024-09-17T05:40:17.968205+0000","last_undegraded":"2024-09-17T05:40:17.968205+0000","last_fullsized":"2024-09-17T05:40:17.968205+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:38.032098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944404+0000","last_change":"2024-09-17T05:40:17.944404+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944404+0000","last_undegraded":"2024-09-17T05:40:17.944404+0000","last_fullsized":"2024-09-17T05:40:17.944404+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746438+0000","last_change":"2024-09-17T05:40:17.965056+0000","last_active":"2024-09-17T05:40:20.746438+0000","last_peered":"2024-09-17T05:40:20.746438+0000","last_clean":"2024-09-17T05:40:20.746438+0000","last_became_active":"2024-09-17T05:40:17.964655+0000","last_became_peered":"2024-09-17T05:40:17.964655+0000","last_unstale":"2024-09-17T05:40:20.746438+0000","last_undegraded":"2024-09-17T05:40:20.746438+0000","last_fullsized":"2024-09-17T05:40:20.746438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:35.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961796+0000","last_change":"2024-09-17T05:40:18.957254+0000","last_active":"2024-09-17T05:40:19.961796+0000","last_peered":"2024-09-17T05:40:19.961796+0000","last_clean":"2024-09-17T05:40:19.961796+0000","last_became_active":"2024-09-17T05:40:18.956903+0000","last_became_peered":"2024-09-17T05:40:18.956903+0000","last_unstale":"2024-09-17T05:40:19.961796+0000","last_undegraded":"2024-09-17T05:40:19.961796+0000","last_fullsized":"2024-09-17T05:40:19.961796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880695+0000","last_change":"2024-09-17T05:40:17.965827+0000","last_active":"2024-09-17T05:40:20.880695+0000","last_peered":"2024-09-17T05:40:20.880695+0000","last_clean":"2024-09-17T05:40:20.880695+0000","last_became_active":"2024-09-17T05:40:17.962330+0000","last_became_peered":"2024-09-17T05:40:17.962330+0000","last_unstale":"2024-09-17T05:40:20.880695+0000","last_undegraded":"2024-09-17T05:40:20.880695+0000","last_fullsized":"2024-09-17T05:40:20.880695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:15.809852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961491+0000","last_change":"2024-09-17T05:40:18.972381+0000","last_active":"2024-09-17T05:40:19.961491+0000","last_peered":"2024-09-17T05:40:19.961491+0000","last_clean":"2024-09-17T05:40:19.961491+0000","last_became_active":"2024-09-17T05:40:18.972050+0000","last_became_peered":"2024-09-17T05:40:18.972050+0000","last_unstale":"2024-09-17T05:40:19.961491+0000","last_undegraded":"2024-09-17T05:40:19.961491+0000","last_fullsized":"2024-09-17T05:40:19.961491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965153+0000","last_change":"2024-09-17T05:40:17.971063+0000","last_active":"2024-09-17T05:40:19.965153+0000","last_peered":"2024-09-17T05:40:19.965153+0000","last_clean":"2024-09-17T05:40:19.965153+0000","last_became_active":"2024-09-17T05:40:17.970390+0000","last_became_peered":"2024-09-17T05:40:17.970390+0000","last_unstale":"2024-09-17T05:40:19.965153+0000","last_undegraded":"2024-09-17T05:40:19.965153+0000","last_fullsized":"2024-09-17T05:40:19.965153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:24.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965290+0000","last_change":"2024-09-17T05:40:18.965052+0000","last_active":"2024-09-17T05:40:19.965290+0000","last_peered":"2024-09-17T05:40:19.965290+0000","last_clean":"2024-09-17T05:40:19.965290+0000","last_became_active":"2024-09-17T05:40:18.964428+0000","last_became_peered":"2024-09-17T05:40:18.964428+0000","last_unstale":"2024-09-17T05:40:19.965290+0000","last_undegraded":"2024-09-17T05:40:19.965290+0000","last_fullsized":"2024-09-17T05:40:19.965290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:12.516191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879706+0000","last_change":"2024-09-17T05:40:17.975190+0000","last_active":"2024-09-17T05:40:20.879706+0000","last_peered":"2024-09-17T05:40:20.879706+0000","last_clean":"2024-09-17T05:40:20.879706+0000","last_became_active":"2024-09-17T05:40:17.974679+0000","last_became_peered":"2024-09-17T05:40:17.974679+0000","last_unstale":"2024-09-17T05:40:20.879706+0000","last_undegraded":"2024-09-17T05:40:20.879706+0000","last_fullsized":"2024-09-17T05:40:20.879706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:56.674619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746000+0000","last_change":"2024-09-17T05:40:18.968708+0000","last_active":"2024-09-17T05:40:20.746000+0000","last_peered":"2024-09-17T05:40:20.746000+0000","last_clean":"2024-09-17T05:40:20.746000+0000","last_became_active":"2024-09-17T05:40:18.968273+0000","last_became_peered":"2024-09-17T05:40:18.968273+0000","last_unstale":"2024-09-17T05:40:20.746000+0000","last_undegraded":"2024-09-17T05:40:20.746000+0000","last_fullsized":"2024-09-17T05:40:20.746000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:11.746260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880446+0000","last_change":"2024-09-17T05:40:17.970784+0000","last_active":"2024-09-17T05:40:20.880446+0000","last_peered":"2024-09-17T05:40:20.880446+0000","last_clean":"2024-09-17T05:40:20.880446+0000","last_became_active":"2024-09-17T05:40:17.970430+0000","last_became_peered":"2024-09-17T05:40:17.970430+0000","last_unstale":"2024-09-17T05:40:20.880446+0000","last_undegraded":"2024-09-17T05:40:20.880446+0000","last_fullsized":"2024-09-17T05:40:20.880446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:40.544858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880886+0000","last_change":"2024-09-17T05:40:18.971140+0000","last_active":"2024-09-17T05:40:20.880886+0000","last_peered":"2024-09-17T05:40:20.880886+0000","last_clean":"2024-09-17T05:40:20.880886+0000","last_became_active":"2024-09-17T05:40:18.970843+0000","last_became_peered":"2024-09-17T05:40:18.970843+0000","last_unstale":"2024-09-17T05:40:20.880886+0000","last_undegraded":"2024-09-17T05:40:20.880886+0000","last_fullsized":"2024-09-17T05:40:20.880886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:49.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961919+0000","last_change":"2024-09-17T05:40:17.973356+0000","last_active":"2024-09-17T05:40:19.961919+0000","last_peered":"2024-09-17T05:40:19.961919+0000","last_clean":"2024-09-17T05:40:19.961919+0000","last_became_active":"2024-09-17T05:40:17.973013+0000","last_became_peered":"2024-09-17T05:40:17.973013+0000","last_unstale":"2024-09-17T05:40:19.961919+0000","last_undegraded":"2024-09-17T05:40:19.961919+0000","last_fullsized":"2024-09-17T05:40:19.961919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:10.738755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962312+0000","last_change":"2024-09-17T05:40:18.970497+0000","last_active":"2024-09-17T05:40:19.962312+0000","last_peered":"2024-09-17T05:40:19.962312+0000","last_clean":"2024-09-17T05:40:19.962312+0000","last_became_active":"2024-09-17T05:40:18.970209+0000","last_became_peered":"2024-09-17T05:40:18.970209+0000","last_unstale":"2024-09-17T05:40:19.962312+0000","last_undegraded":"2024-09-17T05:40:19.962312+0000","last_fullsized":"2024-09-17T05:40:19.962312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:17.959159+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:17.958789+0000","last_became_peered":"2024-09-17T05:40:17.958789+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:58.233971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880871+0000","last_change":"2024-09-17T05:40:18.969090+0000","last_active":"2024-09-17T05:40:20.880871+0000","last_peered":"2024-09-17T05:40:20.880871+0000","last_clean":"2024-09-17T05:40:20.880871+0000","last_became_active":"2024-09-17T05:40:18.968784+0000","last_became_peered":"2024-09-17T05:40:18.968784+0000","last_unstale":"2024-09-17T05:40:20.880871+0000","last_undegraded":"2024-09-17T05:40:20.880871+0000","last_fullsized":"2024-09-17T05:40:20.880871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.582695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965006+0000","last_change":"2024-09-17T05:40:17.965172+0000","last_active":"2024-09-17T05:40:19.965006+0000","last_peered":"2024-09-17T05:40:19.965006+0000","last_clean":"2024-09-17T05:40:19.965006+0000","last_became_active":"2024-09-17T05:40:17.964923+0000","last_became_peered":"2024-09-17T05:40:17.964923+0000","last_unstale":"2024-09-17T05:40:19.965006+0000","last_undegraded":"2024-09-17T05:40:19.965006+0000","last_fullsized":"2024-09-17T05:40:19.965006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:24.487199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878121+0000","last_change":"2024-09-17T05:40:18.978887+0000","last_active":"2024-09-17T05:40:20.878121+0000","last_peered":"2024-09-17T05:40:20.878121+0000","last_clean":"2024-09-17T05:40:20.878121+0000","last_became_active":"2024-09-17T05:40:18.978477+0000","last_became_peered":"2024-09-17T05:40:18.978477+0000","last_unstale":"2024-09-17T05:40:20.878121+0000","last_undegraded":"2024-09-17T05:40:20.878121+0000","last_fullsized":"2024-09-17T05:40:20.878121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:55.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746530+0000","last_change":"2024-09-17T05:40:17.972337+0000","last_active":"2024-09-17T05:40:20.746530+0000","last_peered":"2024-09-17T05:40:20.746530+0000","last_clean":"2024-09-17T05:40:20.746530+0000","last_became_active":"2024-09-17T05:40:17.971336+0000","last_became_peered":"2024-09-17T05:40:17.971336+0000","last_unstale":"2024-09-17T05:40:20.746530+0000","last_undegraded":"2024-09-17T05:40:20.746530+0000","last_fullsized":"2024-09-17T05:40:20.746530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:18.434892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.943214+0000","last_change":"2024-09-17T05:40:17.943214+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.943214+0000","last_undegraded":"2024-09-17T05:40:17.943214+0000","last_fullsized":"2024-09-17T05:40:17.943214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746356+0000","last_change":"2024-09-17T05:40:17.965044+0000","last_active":"2024-09-17T05:40:20.746356+0000","last_peered":"2024-09-17T05:40:20.746356+0000","last_clean":"2024-09-17T05:40:20.746356+0000","last_became_active":"2024-09-17T05:40:17.964741+0000","last_became_peered":"2024-09-17T05:40:17.964741+0000","last_unstale":"2024-09-17T05:40:20.746356+0000","last_undegraded":"2024-09-17T05:40:20.746356+0000","last_fullsized":"2024-09-17T05:40:20.746356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:52.300156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961079+0000","last_change":"2024-09-17T05:40:18.964400+0000","last_active":"2024-09-17T05:40:19.961079+0000","last_peered":"2024-09-17T05:40:19.961079+0000","last_clean":"2024-09-17T05:40:19.961079+0000","last_became_active":"2024-09-17T05:40:18.964075+0000","last_became_peered":"2024-09-17T05:40:18.964075+0000","last_unstale":"2024-09-17T05:40:19.961079+0000","last_undegraded":"2024-09-17T05:40:19.961079+0000","last_fullsized":"2024-09-17T05:40:19.961079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:34.649446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878634+0000","last_change":"2024-09-17T05:40:17.967952+0000","last_active":"2024-09-17T05:40:20.878634+0000","last_peered":"2024-09-17T05:40:20.878634+0000","last_clean":"2024-09-17T05:40:20.878634+0000","last_became_active":"2024-09-17T05:40:17.967598+0000","last_became_peered":"2024-09-17T05:40:17.967598+0000","last_unstale":"2024-09-17T05:40:20.878634+0000","last_undegraded":"2024-09-17T05:40:20.878634+0000","last_fullsized":"2024-09-17T05:40:20.878634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:19.550729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878198+0000","last_change":"2024-09-17T05:40:18.975785+0000","last_active":"2024-09-17T05:40:20.878198+0000","last_peered":"2024-09-17T05:40:20.878198+0000","last_clean":"2024-09-17T05:40:20.878198+0000","last_became_active":"2024-09-17T05:40:18.967877+0000","last_became_peered":"2024-09-17T05:40:18.967877+0000","last_unstale":"2024-09-17T05:40:20.878198+0000","last_undegraded":"2024-09-17T05:40:20.878198+0000","last_fullsized":"2024-09-17T05:40:20.878198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:02.537983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878483+0000","last_change":"2024-09-17T05:40:17.969484+0000","last_active":"2024-09-17T05:40:20.878483+0000","last_peered":"2024-09-17T05:40:20.878483+0000","last_clean":"2024-09-17T05:40:20.878483+0000","last_became_active":"2024-09-17T05:40:17.969158+0000","last_became_peered":"2024-09-17T05:40:17.969158+0000","last_unstale":"2024-09-17T05:40:20.878483+0000","last_undegraded":"2024-09-17T05:40:20.878483+0000","last_fullsized":"2024-09-17T05:40:20.878483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:36.756374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878618+0000","last_change":"2024-09-17T05:40:18.967277+0000","last_active":"2024-09-17T05:40:20.878618+0000","last_peered":"2024-09-17T05:40:20.878618+0000","last_clean":"2024-09-17T05:40:20.878618+0000","last_became_active":"2024-09-17T05:40:18.966960+0000","last_became_peered":"2024-09-17T05:40:18.966960+0000","last_unstale":"2024-09-17T05:40:20.878618+0000","last_undegraded":"2024-09-17T05:40:20.878618+0000","last_fullsized":"2024-09-17T05:40:20.878618+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:27.633925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.958537+0000","last_change":"2024-09-17T05:40:17.955665+0000","last_active":"2024-09-17T05:40:17.958537+0000","last_peered":"2024-09-17T05:40:17.958537+0000","last_clean":"2024-09-17T05:40:17.958537+0000","last_became_active":"2024-09-17T05:40:17.953041+0000","last_became_peered":"2024-09-17T05:40:17.953041+0000","last_unstale":"2024-09-17T05:40:17.958537+0000","last_undegraded":"2024-09-17T05:40:17.958537+0000","last_fullsized":"2024-09-17T05:40:17.958537+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:09.529223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878836+0000","last_change":"2024-09-17T05:40:18.977272+0000","last_active":"2024-09-17T05:40:20.878836+0000","last_peered":"2024-09-17T05:40:20.878836+0000","last_clean":"2024-09-17T05:40:20.878836+0000","last_became_active":"2024-09-17T05:40:18.976916+0000","last_became_peered":"2024-09-17T05:40:18.976916+0000","last_unstale":"2024-09-17T05:40:20.878836+0000","last_undegraded":"2024-09-17T05:40:20.878836+0000","last_fullsized":"2024-09-17T05:40:20.878836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:42.993651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960931+0000","last_change":"2024-09-17T05:40:17.961323+0000","last_active":"2024-09-17T05:40:19.960931+0000","last_peered":"2024-09-17T05:40:19.960931+0000","last_clean":"2024-09-17T05:40:19.960931+0000","last_became_active":"2024-09-17T05:40:17.961012+0000","last_became_peered":"2024-09-17T05:40:17.961012+0000","last_unstale":"2024-09-17T05:40:19.960931+0000","last_undegraded":"2024-09-17T05:40:19.960931+0000","last_fullsized":"2024-09-17T05:40:19.960931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:31.323376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880144+0000","last_change":"2024-09-17T05:40:18.976598+0000","last_active":"2024-09-17T05:40:20.880144+0000","last_peered":"2024-09-17T05:40:20.880144+0000","last_clean":"2024-09-17T05:40:20.880144+0000","last_became_active":"2024-09-17T05:40:18.976246+0000","last_became_peered":"2024-09-17T05:40:18.976246+0000","last_unstale":"2024-09-17T05:40:20.880144+0000","last_undegraded":"2024-09-17T05:40:20.880144+0000","last_fullsized":"2024-09-17T05:40:20.880144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:50.563559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.969434+0000","last_change":"2024-09-17T05:40:17.962804+0000","last_active":"2024-09-17T05:40:17.969434+0000","last_peered":"2024-09-17T05:40:17.969434+0000","last_clean":"2024-09-17T05:40:17.969434+0000","last_became_active":"2024-09-17T05:40:17.962441+0000","last_became_peered":"2024-09-17T05:40:17.962441+0000","last_unstale":"2024-09-17T05:40:17.969434+0000","last_undegraded":"2024-09-17T05:40:17.969434+0000","last_fullsized":"2024-09-17T05:40:17.969434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:06.031978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745945+0000","last_change":"2024-09-17T05:40:18.964746+0000","last_active":"2024-09-17T05:40:20.745945+0000","last_peered":"2024-09-17T05:40:20.745945+0000","last_clean":"2024-09-17T05:40:20.745945+0000","last_became_active":"2024-09-17T05:40:18.962288+0000","last_became_peered":"2024-09-17T05:40:18.962288+0000","last_unstale":"2024-09-17T05:40:20.745945+0000","last_undegraded":"2024-09-17T05:40:20.745945+0000","last_fullsized":"2024-09-17T05:40:20.745945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:55.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880970+0000","last_change":"2024-09-17T05:40:17.958259+0000","last_active":"2024-09-17T05:40:20.880970+0000","last_peered":"2024-09-17T05:40:20.880970+0000","last_clean":"2024-09-17T05:40:20.880970+0000","last_became_active":"2024-09-17T05:40:17.956752+0000","last_became_peered":"2024-09-17T05:40:17.956752+0000","last_unstale":"2024-09-17T05:40:20.880970+0000","last_undegraded":"2024-09-17T05:40:20.880970+0000","last_fullsized":"2024-09-17T05:40:20.880970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:54.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880734+0000","last_change":"2024-09-17T05:40:18.967915+0000","last_active":"2024-09-17T05:40:20.880734+0000","last_peered":"2024-09-17T05:40:20.880734+0000","last_clean":"2024-09-17T05:40:20.880734+0000","last_became_active":"2024-09-17T05:40:18.967620+0000","last_became_peered":"2024-09-17T05:40:18.967620+0000","last_unstale":"2024-09-17T05:40:20.880734+0000","last_undegraded":"2024-09-17T05:40:20.880734+0000","last_fullsized":"2024-09-17T05:40:20.880734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:53.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.967006+0000","last_change":"2024-09-17T05:40:17.970621+0000","last_active":"2024-09-17T05:40:19.967006+0000","last_peered":"2024-09-17T05:40:19.967006+0000","last_clean":"2024-09-17T05:40:19.967006+0000","last_became_active":"2024-09-17T05:40:17.970196+0000","last_became_peered":"2024-09-17T05:40:17.970196+0000","last_unstale":"2024-09-17T05:40:19.967006+0000","last_undegraded":"2024-09-17T05:40:19.967006+0000","last_fullsized":"2024-09-17T05:40:19.967006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:07.550401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961767+0000","last_change":"2024-09-17T05:40:18.966610+0000","last_active":"2024-09-17T05:40:19.961767+0000","last_peered":"2024-09-17T05:40:19.961767+0000","last_clean":"2024-09-17T05:40:19.961767+0000","last_became_active":"2024-09-17T05:40:18.966276+0000","last_became_peered":"2024-09-17T05:40:18.966276+0000","last_unstale":"2024-09-17T05:40:19.961767+0000","last_undegraded":"2024-09-17T05:40:19.961767+0000","last_fullsized":"2024-09-17T05:40:19.961767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:53.342120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880935+0000","last_change":"2024-09-17T05:40:17.963755+0000","last_active":"2024-09-17T05:40:20.880935+0000","last_peered":"2024-09-17T05:40:20.880935+0000","last_clean":"2024-09-17T05:40:20.880935+0000","last_became_active":"2024-09-17T05:40:17.963439+0000","last_became_peered":"2024-09-17T05:40:17.963439+0000","last_unstale":"2024-09-17T05:40:20.880935+0000","last_undegraded":"2024-09-17T05:40:20.880935+0000","last_fullsized":"2024-09-17T05:40:20.880935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.746862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961385+0000","last_change":"2024-09-17T05:40:18.956932+0000","last_active":"2024-09-17T05:40:19.961385+0000","last_peered":"2024-09-17T05:40:19.961385+0000","last_clean":"2024-09-17T05:40:19.961385+0000","last_became_active":"2024-09-17T05:40:18.956628+0000","last_became_peered":"2024-09-17T05:40:18.956628+0000","last_unstale":"2024-09-17T05:40:19.961385+0000","last_undegraded":"2024-09-17T05:40:19.961385+0000","last_fullsized":"2024-09-17T05:40:19.961385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746198+0000","last_change":"2024-09-17T05:40:17.963225+0000","last_active":"2024-09-17T05:40:20.746198+0000","last_peered":"2024-09-17T05:40:20.746198+0000","last_clean":"2024-09-17T05:40:20.746198+0000","last_became_active":"2024-09-17T05:40:17.962712+0000","last_became_peered":"2024-09-17T05:40:17.962712+0000","last_unstale":"2024-09-17T05:40:20.746198+0000","last_undegraded":"2024-09-17T05:40:20.746198+0000","last_fullsized":"2024-09-17T05:40:20.746198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:26.824455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962047+0000","last_change":"2024-09-17T05:40:18.966387+0000","last_active":"2024-09-17T05:40:19.962047+0000","last_peered":"2024-09-17T05:40:19.962047+0000","last_clean":"2024-09-17T05:40:19.962047+0000","last_became_active":"2024-09-17T05:40:18.966066+0000","last_became_peered":"2024-09-17T05:40:18.966066+0000","last_unstale":"2024-09-17T05:40:19.962047+0000","last_undegraded":"2024-09-17T05:40:19.962047+0000","last_fullsized":"2024-09-17T05:40:19.962047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879461+0000","last_change":"2024-09-17T05:40:17.967077+0000","last_active":"2024-09-17T05:40:20.879461+0000","last_peered":"2024-09-17T05:40:20.879461+0000","last_clean":"2024-09-17T05:40:20.879461+0000","last_became_active":"2024-09-17T05:40:17.966350+0000","last_became_peered":"2024-09-17T05:40:17.966350+0000","last_unstale":"2024-09-17T05:40:20.879461+0000","last_undegraded":"2024-09-17T05:40:20.879461+0000","last_fullsized":"2024-09-17T05:40:20.879461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:53.153954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746326+0000","last_change":"2024-09-17T05:40:18.972375+0000","last_active":"2024-09-17T05:40:20.746326+0000","last_peered":"2024-09-17T05:40:20.746326+0000","last_clean":"2024-09-17T05:40:20.746326+0000","last_became_active":"2024-09-17T05:40:18.972044+0000","last_became_peered":"2024-09-17T05:40:18.972044+0000","last_unstale":"2024-09-17T05:40:20.746326+0000","last_undegraded":"2024-09-17T05:40:20.746326+0000","last_fullsized":"2024-09-17T05:40:20.746326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:45.216982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965453+0000","last_change":"2024-09-17T05:40:17.963155+0000","last_active":"2024-09-17T05:40:19.965453+0000","last_peered":"2024-09-17T05:40:19.965453+0000","last_clean":"2024-09-17T05:40:19.965453+0000","last_became_active":"2024-09-17T05:40:17.962627+0000","last_became_peered":"2024-09-17T05:40:17.962627+0000","last_unstale":"2024-09-17T05:40:19.965453+0000","last_undegraded":"2024-09-17T05:40:19.965453+0000","last_fullsized":"2024-09-17T05:40:19.965453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.151688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":75,"state":"creating+peering","last_fresh":"2024-09-17T05:40:17.944302+0000","last_change":"2024-09-17T05:40:17.944302+0000","last_active":"2024-09-17T05:40:17.933195+0000","last_peered":"2024-09-17T05:40:17.933195+0000","last_clean":"2024-09-17T05:40:17.933195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:40:17.944302+0000","last_undegraded":"2024-09-17T05:40:17.944302+0000","last_fullsized":"2024-09-17T05:40:17.944302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745749+0000","last_change":"2024-09-17T05:40:17.963433+0000","last_active":"2024-09-17T05:40:20.745749+0000","last_peered":"2024-09-17T05:40:20.745749+0000","last_clean":"2024-09-17T05:40:20.745749+0000","last_became_active":"2024-09-17T05:40:17.963089+0000","last_became_peered":"2024-09-17T05:40:17.963089+0000","last_unstale":"2024-09-17T05:40:20.745749+0000","last_undegraded":"2024-09-17T05:40:20.745749+0000","last_fullsized":"2024-09-17T05:40:20.745749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:47.055143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878756+0000","last_change":"2024-09-17T05:40:18.969053+0000","last_active":"2024-09-17T05:40:20.878756+0000","last_peered":"2024-09-17T05:40:20.878756+0000","last_clean":"2024-09-17T05:40:20.878756+0000","last_became_active":"2024-09-17T05:40:18.968741+0000","last_became_peered":"2024-09-17T05:40:18.968741+0000","last_unstale":"2024-09-17T05:40:20.878756+0000","last_undegraded":"2024-09-17T05:40:20.878756+0000","last_fullsized":"2024-09-17T05:40:20.878756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:47.639721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-17T05:40:17.960097+0000","last_change":"2024-09-17T05:40:17.955748+0000","last_active":"2024-09-17T05:40:17.960097+0000","last_peered":"2024-09-17T05:40:17.960097+0000","last_clean":"2024-09-17T05:40:17.960097+0000","last_became_active":"2024-09-17T05:40:17.953494+0000","last_became_peered":"2024-09-17T05:40:17.953494+0000","last_unstale":"2024-09-17T05:40:17.960097+0000","last_undegraded":"2024-09-17T05:40:17.960097+0000","last_fullsized":"2024-09-17T05:40:17.960097+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:33.310342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879800+0000","last_change":"2024-09-17T05:40:18.962984+0000","last_active":"2024-09-17T05:40:20.879800+0000","last_peered":"2024-09-17T05:40:20.879800+0000","last_clean":"2024-09-17T05:40:20.879800+0000","last_became_active":"2024-09-17T05:40:18.962658+0000","last_became_peered":"2024-09-17T05:40:18.962658+0000","last_unstale":"2024-09-17T05:40:20.879800+0000","last_undegraded":"2024-09-17T05:40:20.879800+0000","last_fullsized":"2024-09-17T05:40:20.879800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.691731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965293+0000","last_change":"2024-09-17T05:40:17.966745+0000","last_active":"2024-09-17T05:40:19.965293+0000","last_peered":"2024-09-17T05:40:19.965293+0000","last_clean":"2024-09-17T05:40:19.965293+0000","last_became_active":"2024-09-17T05:40:17.966394+0000","last_became_peered":"2024-09-17T05:40:17.966394+0000","last_unstale":"2024-09-17T05:40:19.965293+0000","last_undegraded":"2024-09-17T05:40:19.965293+0000","last_fullsized":"2024-09-17T05:40:19.965293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:48.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879666+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:40:20.879666+0000","last_peered":"2024-09-17T05:40:20.879666+0000","last_clean":"2024-09-17T05:40:20.879666+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:40:20.879666+0000","last_undegraded":"2024-09-17T05:40:20.879666+0000","last_fullsized":"2024-09-17T05:40:20.879666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":929792,"data_stored":417818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1531904,"data_stored":1014316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":942080,"data_stored":418882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":423858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1531904,"data_stored":1009180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":897024,"data_stored":403332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.947782+0000', 'last_change': '2024-09-17T05:40:17.947782+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.947782+0000', 'last_undegraded': '2024-09-17T05:40:17.947782+0000', 'last_fullsized': '2024-09-17T05:40:17.947782+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3d is not active+clean 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.948891+0000', 'last_change': '2024-09-17T05:40:17.948891+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.948891+0000', 'last_undegraded': '2024-09-17T05:40:17.948891+0000', 'last_fullsized': '2024-09-17T05:40:17.948891+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.948411+0000', 'last_change': '2024-09-17T05:40:17.948411+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.948411+0000', 'last_undegraded': '2024-09-17T05:40:17.948411+0000', 'last_fullsized': '2024-09-17T05:40:17.948411+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:PG 12.33 is not active+clean 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.944142+0000', 'last_change': '2024-09-17T05:40:17.944142+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.944142+0000', 'last_undegraded': '2024-09-17T05:40:17.944142+0000', 'last_fullsized': '2024-09-17T05:40:17.944142+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.986 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2e is not active+clean 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.944884+0000', 'last_change': '2024-09-17T05:40:17.944884+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.944884+0000', 'last_undegraded': '2024-09-17T05:40:17.944884+0000', 'last_fullsized': '2024-09-17T05:40:17.944884+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2a is not active+clean 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.943263+0000', 'last_change': '2024-09-17T05:40:17.943263+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.943263+0000', 'last_undegraded': '2024-09-17T05:40:17.943263+0000', 'last_fullsized': '2024-09-17T05:40:17.943263+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.944946+0000', 'last_change': '2024-09-17T05:40:17.944946+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.944946+0000', 'last_undegraded': '2024-09-17T05:40:17.944946+0000', 'last_fullsized': '2024-09-17T05:40:17.944946+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:PG 12.21 is not active+clean 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.946191+0000', 'last_change': '2024-09-17T05:40:17.946191+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.946191+0000', 'last_undegraded': '2024-09-17T05:40:17.946191+0000', 'last_fullsized': '2024-09-17T05:40:17.946191+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.945182+0000', 'last_change': '2024-09-17T05:40:17.945182+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.945182+0000', 'last_undegraded': '2024-09-17T05:40:17.945182+0000', 'last_fullsized': '2024-09-17T05:40:17.945182+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-17T05:40:23.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.944404+0000', 'last_change': '2024-09-17T05:40:17.944404+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.944404+0000', 'last_undegraded': '2024-09-17T05:40:17.944404+0000', 'last_fullsized': '2024-09-17T05:40:17.944404+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.988 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-17T05:40:23.988 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.943214+0000', 'last_change': '2024-09-17T05:40:17.943214+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.943214+0000', 'last_undegraded': '2024-09-17T05:40:17.943214+0000', 'last_fullsized': '2024-09-17T05:40:17.943214+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.988 INFO:tasks.ceph.ceph_manager.ceph:PG 12.6 is not active+clean 2024-09-17T05:40:23.988 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 75, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:40:17.944302+0000', 'last_change': '2024-09-17T05:40:17.944302+0000', 'last_active': '2024-09-17T05:40:17.933195+0000', 'last_peered': '2024-09-17T05:40:17.933195+0000', 'last_clean': '2024-09-17T05:40:17.933195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:40:17.944302+0000', 'last_undegraded': '2024-09-17T05:40:17.944302+0000', 'last_fullsized': '2024-09-17T05:40:17.944302+0000', 'mapping_epoch': 75, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:40:17.933195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:40:23.988 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 -- 172.21.15.44:0/2613461778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72806de50 msgr2=0x7fe72806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 --2- 172.21.15.44:0/2613461778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72806de50 0x7fe72806e260 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe72806ace0 tx=0x7fe71001c770 comp rx=0 tx=0).stop 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 -- 172.21.15.44:0/2613461778 shutdown_connections 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 --2- 172.21.15.44:0/2613461778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72806de50 0x7fe72806e260 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 --2- 172.21.15.44:0/2613461778 >> v2:172.21.15.86:3300/0 conn(0x7fe728072e50 0x7fe72815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 -- 172.21.15.44:0/2613461778 >> 172.21.15.44:0/2613461778 conn(0x7fe7280ccaa0 msgr2=0x7fe7280cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 -- 172.21.15.44:0/2613461778 shutdown_connections 2024-09-17T05:40:24.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 -- 172.21.15.44:0/2613461778 wait complete. 2024-09-17T05:40:24.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 Processor -- start 2024-09-17T05:40:24.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.184+0000 7fe72dc00640 1 -- start start 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe72806de50 0x7fe7280aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe728072e50 0x7fe7280c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7280ced00 0x7fe7280c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe728169410 con 0x7fe728072e50 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe728169290 con 0x7fe7280ced00 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe728169590 con 0x7fe72806de50 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe728072e50 0x7fe7280c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe728072e50 0x7fe7280c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58588/0 (socket says 172.21.15.44:58588) 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 -- 172.21.15.44:0/593698642 learned_addr learned my addr 172.21.15.44:0/593698642 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:24.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe726a00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe72806de50 0x7fe7280aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe727400640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7280ced00 0x7fe7280c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 -- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe72806de50 msgr2=0x7fe7280aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe72806de50 0x7fe7280aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 -- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7280ced00 msgr2=0x7fe7280c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7280ced00 0x7fe7280c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 -- 172.21.15.44:0/593698642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7280b14b0 con 0x7fe728072e50 2024-09-17T05:40:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71e000640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe728072e50 0x7fe7280c70d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe710009790 tx=0x7fe710005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71f400640 1 -- 172.21.15.44:0/593698642 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7100b2040 con 0x7fe728072e50 2024-09-17T05:40:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71f400640 1 -- 172.21.15.44:0/593698642 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7100043e0 con 0x7fe728072e50 2024-09-17T05:40:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7280b5d00 con 0x7fe728072e50 2024-09-17T05:40:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe71f400640 1 -- 172.21.15.44:0/593698642 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710005270 con 0x7fe728072e50 2024-09-17T05:40:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7280c7ca0 con 0x7fe728072e50 2024-09-17T05:40:24.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.188+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72806e260 con 0x7fe728072e50 2024-09-17T05:40:24.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.192+0000 7fe71f400640 1 -- 172.21.15.44:0/593698642 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe710005410 con 0x7fe728072e50 2024-09-17T05:40:24.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.192+0000 7fe71f400640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe704073260 0x7fe704075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.192+0000 7fe71f400640 1 -- 172.21.15.44:0/593698642 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7fe71012dc70 con 0x7fe728072e50 2024-09-17T05:40:24.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.192+0000 7fe726a00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe704073260 0x7fe704075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.192+0000 7fe726a00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe704073260 0x7fe704075770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe718004630 tx=0x7fe71800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:24.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.196+0000 7fe71f400640 1 -- 172.21.15.44:0/593698642 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe7100bd060 con 0x7fe728072e50 2024-09-17T05:40:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe7280b5fa0 con 0x7fe728072e50 2024-09-17T05:40:24.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe71f400640 1 -- 172.21.15.44:0/593698642 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7fe7100163f0 con 0x7fe728072e50 2024-09-17T05:40:24.437 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:24.438 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":273,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":77,"num_osds":8,"num_up_osds":8,"osd_up_since":1726551365,"num_in_osds":8,"osd_in_since":1726551355,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":85},{"state_name":"creating+peering","count":12}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":259915776,"bytes_avail":772834197504,"bytes_total":773094113280,"inactive_pgs_ratio":0.12371134012937546,"write_bytes_sec":2660,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":46,"btime":"2024-09-17T05:40:21:965701+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6261}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-17T05:40:04.320555+0000","services":{}},"progress_events":{}} 2024-09-17T05:40:24.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe704073260 msgr2=0x7fe704075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe704073260 0x7fe704075770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe718004630 tx=0x7fe71800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe728072e50 msgr2=0x7fe7280c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe728072e50 0x7fe7280c70d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe710009790 tx=0x7fe710005db0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 shutdown_connections 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe704073260 0x7fe704075770 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7280ced00 0x7fe7280c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe728072e50 0x7fe7280c70d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 --2- 172.21.15.44:0/593698642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe72806de50 0x7fe7280aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 >> 172.21.15.44:0/593698642 conn(0x7fe7280ccaa0 msgr2=0x7fe72815f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 shutdown_connections 2024-09-17T05:40:24.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.436+0000 7fe72dc00640 1 -- 172.21.15.44:0/593698642 wait complete. 2024-09-17T05:40:24.459 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:40:24.459 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:40:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 -- 172.21.15.44:0/983562980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 msgr2=0x7f74e0167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 --2- 172.21.15.44:0/983562980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e0167120 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f74e006ace0 tx=0x7f74d801cb80 comp rx=0 tx=0).stop 2024-09-17T05:40:24.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 -- 172.21.15.44:0/983562980 shutdown_connections 2024-09-17T05:40:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 --2- 172.21.15.44:0/983562980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e0167120 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 --2- 172.21.15.44:0/983562980 >> v2:172.21.15.86:3300/0 conn(0x7f74e00b5880 0x7f74e006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 -- 172.21.15.44:0/983562980 >> 172.21.15.44:0/983562980 conn(0x7f74e00ccaa0 msgr2=0x7f74e00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 -- 172.21.15.44:0/983562980 shutdown_connections 2024-09-17T05:40:24.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 -- 172.21.15.44:0/983562980 wait complete. 2024-09-17T05:40:24.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 Processor -- start 2024-09-17T05:40:24.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.616+0000 7f74e6e00640 1 -- start start 2024-09-17T05:40:24.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e006e390 0x7f74e0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f74e00b5880 0x7f74e009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e00ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f74e016a000 con 0x7f74e00ce300 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0169e80 con 0x7f74e006e390 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f74e016a180 con 0x7f74e00b5880 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e00ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e00ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58606/0 (socket says 172.21.15.44:58606) 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 -- 172.21.15.44:0/1768522611 learned_addr learned my addr 172.21.15.44:0/1768522611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74dfe00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e006e390 0x7f74e0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74d7e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f74e00b5880 0x7f74e009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 -- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f74e00b5880 msgr2=0x7f74e009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f74e00b5880 0x7f74e009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 -- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e006e390 msgr2=0x7f74e0158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e006e390 0x7f74e0158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 -- 172.21.15.44:0/1768522611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e015a090 con 0x7f74e00ce300 2024-09-17T05:40:24.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e4e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e00ae7a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f74d801c5f0 tx=0x7f74d8005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:24.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74dcc00640 1 -- 172.21.15.44:0/1768522611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d80b2040 con 0x7f74e00ce300 2024-09-17T05:40:24.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74dcc00640 1 -- 172.21.15.44:0/1768522611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74d80bb070 con 0x7f74e00ce300 2024-09-17T05:40:24.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e015a370 con 0x7f74e00ce300 2024-09-17T05:40:24.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74dcc00640 1 -- 172.21.15.44:0/1768522611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8004530 con 0x7f74e00ce300 2024-09-17T05:40:24.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.620+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e00a0730 con 0x7f74e00ce300 2024-09-17T05:40:24.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.624+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e006de50 con 0x7f74e00ce300 2024-09-17T05:40:24.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.624+0000 7f74dcc00640 1 -- 172.21.15.44:0/1768522611 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f74d80046d0 con 0x7f74e00ce300 2024-09-17T05:40:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.624+0000 7f74dcc00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f74bc073200 0x7f74bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.624+0000 7f74dcc00640 1 -- 172.21.15.44:0/1768522611 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f74d812ee90 con 0x7f74e00ce300 2024-09-17T05:40:24.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.624+0000 7f74dfe00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f74bc073200 0x7f74bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:24.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.624+0000 7f74dfe00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f74bc073200 0x7f74bc075710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009b40 tx=0x7f74d00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:24.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.628+0000 7f74dcc00640 1 -- 172.21.15.44:0/1768522611 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f74d8016770 con 0x7f74e00ce300 2024-09-17T05:40:24.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.800+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74e00a0960 con 0x7f74bc073200 2024-09-17T05:40:24.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.804+0000 7f74dcc00640 1 -- 172.21.15.44:0/1768522611 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252055 (secure 0 0 0) 0x7f74e00a0960 con 0x7f74bc073200 2024-09-17T05:40:24.809 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:24.810 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:40:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f74bc073200 msgr2=0x7f74bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f74bc073200 0x7f74bc075710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f74d0009b40 tx=0x7f74d00091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 msgr2=0x7f74e00ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e00ae7a0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f74d801c5f0 tx=0x7f74d8005a60 comp rx=0 tx=0).stop 2024-09-17T05:40:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 shutdown_connections 2024-09-17T05:40:24.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f74e00ce300 0x7f74e00ae7a0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f74e00b5880 0x7f74e009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f74bc073200 0x7f74bc075710 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 --2- 172.21.15.44:0/1768522611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e006e390 0x7f74e0158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 >> 172.21.15.44:0/1768522611 conn(0x7f74e00ccaa0 msgr2=0x7f74e00cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 shutdown_connections 2024-09-17T05:40:24.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:24.808+0000 7f74e6e00640 1 -- 172.21.15.44:0/1768522611 wait complete. 2024-09-17T05:40:24.830 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-17T05:40:24.325389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253872,"kb_used_data":8484,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720848,"statfs":{"total":773094113280,"available":772834148352,"internally_reserved":0,"allocated":8687616,"data_stored":4556344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.384940"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.881021+0000","last_change":"2024-09-17T05:40:18.975938+0000","last_active":"2024-09-17T05:40:20.881021+0000","last_peered":"2024-09-17T05:40:20.881021+0000","last_clean":"2024-09-17T05:40:20.881021+0000","last_became_active":"2024-09-17T05:40:18.974724+0000","last_became_peered":"2024-09-17T05:40:18.974724+0000","last_unstale":"2024-09-17T05:40:20.881021+0000","last_undegraded":"2024-09-17T05:40:20.881021+0000","last_fullsized":"2024-09-17T05:40:20.881021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.159194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963256+0000","last_change":"2024-09-17T05:40:18.972572+0000","last_active":"2024-09-17T05:40:19.963256+0000","last_peered":"2024-09-17T05:40:19.963256+0000","last_clean":"2024-09-17T05:40:19.963256+0000","last_became_active":"2024-09-17T05:40:18.971843+0000","last_became_peered":"2024-09-17T05:40:18.971843+0000","last_unstale":"2024-09-17T05:40:19.963256+0000","last_undegraded":"2024-09-17T05:40:19.963256+0000","last_fullsized":"2024-09-17T05:40:19.963256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:52.967939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963113+0000","last_change":"2024-09-17T05:40:18.963920+0000","last_active":"2024-09-17T05:40:19.963113+0000","last_peered":"2024-09-17T05:40:19.963113+0000","last_clean":"2024-09-17T05:40:19.963113+0000","last_became_active":"2024-09-17T05:40:18.963366+0000","last_became_peered":"2024-09-17T05:40:18.963366+0000","last_unstale":"2024-09-17T05:40:19.963113+0000","last_undegraded":"2024-09-17T05:40:19.963113+0000","last_fullsized":"2024-09-17T05:40:19.963113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:28.191817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746017+0000","last_change":"2024-09-17T05:40:18.964044+0000","last_active":"2024-09-17T05:40:20.746017+0000","last_peered":"2024-09-17T05:40:20.746017+0000","last_clean":"2024-09-17T05:40:20.746017+0000","last_became_active":"2024-09-17T05:40:18.963750+0000","last_became_peered":"2024-09-17T05:40:18.963750+0000","last_unstale":"2024-09-17T05:40:20.746017+0000","last_undegraded":"2024-09-17T05:40:20.746017+0000","last_fullsized":"2024-09-17T05:40:20.746017+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:14.837382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878318+0000","last_change":"2024-09-17T05:40:18.968256+0000","last_active":"2024-09-17T05:40:20.878318+0000","last_peered":"2024-09-17T05:40:20.878318+0000","last_clean":"2024-09-17T05:40:20.878318+0000","last_became_active":"2024-09-17T05:40:18.967470+0000","last_became_peered":"2024-09-17T05:40:18.967470+0000","last_unstale":"2024-09-17T05:40:20.878318+0000","last_undegraded":"2024-09-17T05:40:20.878318+0000","last_fullsized":"2024-09-17T05:40:20.878318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:24.741584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965291+0000","last_change":"2024-09-17T05:40:18.967355+0000","last_active":"2024-09-17T05:40:19.965291+0000","last_peered":"2024-09-17T05:40:19.965291+0000","last_clean":"2024-09-17T05:40:19.965291+0000","last_became_active":"2024-09-17T05:40:18.966887+0000","last_became_peered":"2024-09-17T05:40:18.966887+0000","last_unstale":"2024-09-17T05:40:19.965291+0000","last_undegraded":"2024-09-17T05:40:19.965291+0000","last_fullsized":"2024-09-17T05:40:19.965291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745704+0000","last_change":"2024-09-17T05:40:18.968515+0000","last_active":"2024-09-17T05:40:20.745704+0000","last_peered":"2024-09-17T05:40:20.745704+0000","last_clean":"2024-09-17T05:40:20.745704+0000","last_became_active":"2024-09-17T05:40:18.968183+0000","last_became_peered":"2024-09-17T05:40:18.968183+0000","last_unstale":"2024-09-17T05:40:20.745704+0000","last_undegraded":"2024-09-17T05:40:20.745704+0000","last_fullsized":"2024-09-17T05:40:20.745704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:21.966993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960842+0000","last_change":"2024-09-17T05:40:18.959333+0000","last_active":"2024-09-17T05:40:19.960842+0000","last_peered":"2024-09-17T05:40:19.960842+0000","last_clean":"2024-09-17T05:40:19.960842+0000","last_became_active":"2024-09-17T05:40:18.959011+0000","last_became_peered":"2024-09-17T05:40:18.959011+0000","last_unstale":"2024-09-17T05:40:19.960842+0000","last_undegraded":"2024-09-17T05:40:19.960842+0000","last_fullsized":"2024-09-17T05:40:19.960842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746482+0000","last_change":"2024-09-17T05:40:18.969295+0000","last_active":"2024-09-17T05:40:20.746482+0000","last_peered":"2024-09-17T05:40:20.746482+0000","last_clean":"2024-09-17T05:40:20.746482+0000","last_became_active":"2024-09-17T05:40:18.968254+0000","last_became_peered":"2024-09-17T05:40:18.968254+0000","last_unstale":"2024-09-17T05:40:20.746482+0000","last_undegraded":"2024-09-17T05:40:20.746482+0000","last_fullsized":"2024-09-17T05:40:20.746482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880679+0000","last_change":"2024-09-17T05:40:18.963445+0000","last_active":"2024-09-17T05:40:20.880679+0000","last_peered":"2024-09-17T05:40:20.880679+0000","last_clean":"2024-09-17T05:40:20.880679+0000","last_became_active":"2024-09-17T05:40:18.963109+0000","last_became_peered":"2024-09-17T05:40:18.963109+0000","last_unstale":"2024-09-17T05:40:20.880679+0000","last_undegraded":"2024-09-17T05:40:20.880679+0000","last_fullsized":"2024-09-17T05:40:20.880679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:27.338578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963236+0000","last_change":"2024-09-17T05:40:18.972852+0000","last_active":"2024-09-17T05:40:19.963236+0000","last_peered":"2024-09-17T05:40:19.963236+0000","last_clean":"2024-09-17T05:40:19.963236+0000","last_became_active":"2024-09-17T05:40:18.970733+0000","last_became_peered":"2024-09-17T05:40:18.970733+0000","last_unstale":"2024-09-17T05:40:19.963236+0000","last_undegraded":"2024-09-17T05:40:19.963236+0000","last_fullsized":"2024-09-17T05:40:19.963236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:10.690775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961968+0000","last_change":"2024-09-17T05:40:18.963052+0000","last_active":"2024-09-17T05:40:19.961968+0000","last_peered":"2024-09-17T05:40:19.961968+0000","last_clean":"2024-09-17T05:40:19.961968+0000","last_became_active":"2024-09-17T05:40:18.962788+0000","last_became_peered":"2024-09-17T05:40:18.962788+0000","last_unstale":"2024-09-17T05:40:19.961968+0000","last_undegraded":"2024-09-17T05:40:19.961968+0000","last_fullsized":"2024-09-17T05:40:19.961968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:56.383960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962799+0000","last_change":"2024-09-17T05:40:18.978158+0000","last_active":"2024-09-17T05:40:19.962799+0000","last_peered":"2024-09-17T05:40:19.962799+0000","last_clean":"2024-09-17T05:40:19.962799+0000","last_became_active":"2024-09-17T05:40:18.977779+0000","last_became_peered":"2024-09-17T05:40:18.977779+0000","last_unstale":"2024-09-17T05:40:19.962799+0000","last_undegraded":"2024-09-17T05:40:19.962799+0000","last_fullsized":"2024-09-17T05:40:19.962799+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:18.183799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960902+0000","last_change":"2024-09-17T05:40:18.962572+0000","last_active":"2024-09-17T05:40:19.960902+0000","last_peered":"2024-09-17T05:40:19.960902+0000","last_clean":"2024-09-17T05:40:19.960902+0000","last_became_active":"2024-09-17T05:40:18.961900+0000","last_became_peered":"2024-09-17T05:40:18.961900+0000","last_unstale":"2024-09-17T05:40:19.960902+0000","last_undegraded":"2024-09-17T05:40:19.960902+0000","last_fullsized":"2024-09-17T05:40:19.960902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877975+0000","last_change":"2024-09-17T05:40:18.978496+0000","last_active":"2024-09-17T05:40:20.877975+0000","last_peered":"2024-09-17T05:40:20.877975+0000","last_clean":"2024-09-17T05:40:20.877975+0000","last_became_active":"2024-09-17T05:40:18.978005+0000","last_became_peered":"2024-09-17T05:40:18.978005+0000","last_unstale":"2024-09-17T05:40:20.877975+0000","last_undegraded":"2024-09-17T05:40:20.877975+0000","last_fullsized":"2024-09-17T05:40:20.877975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:36.509694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745632+0000","last_change":"2024-09-17T05:40:18.965425+0000","last_active":"2024-09-17T05:40:20.745632+0000","last_peered":"2024-09-17T05:40:20.745632+0000","last_clean":"2024-09-17T05:40:20.745632+0000","last_became_active":"2024-09-17T05:40:18.965158+0000","last_became_peered":"2024-09-17T05:40:18.965158+0000","last_unstale":"2024-09-17T05:40:20.745632+0000","last_undegraded":"2024-09-17T05:40:20.745632+0000","last_fullsized":"2024-09-17T05:40:20.745632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:05.487453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961571+0000","last_change":"2024-09-17T05:40:18.976391+0000","last_active":"2024-09-17T05:40:19.961571+0000","last_peered":"2024-09-17T05:40:19.961571+0000","last_clean":"2024-09-17T05:40:19.961571+0000","last_became_active":"2024-09-17T05:40:18.974193+0000","last_became_peered":"2024-09-17T05:40:18.974193+0000","last_unstale":"2024-09-17T05:40:19.961571+0000","last_undegraded":"2024-09-17T05:40:19.961571+0000","last_fullsized":"2024-09-17T05:40:19.961571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963256+0000","last_change":"2024-09-17T05:40:18.973241+0000","last_active":"2024-09-17T05:40:19.963256+0000","last_peered":"2024-09-17T05:40:19.963256+0000","last_clean":"2024-09-17T05:40:19.963256+0000","last_became_active":"2024-09-17T05:40:18.970058+0000","last_became_peered":"2024-09-17T05:40:18.970058+0000","last_unstale":"2024-09-17T05:40:19.963256+0000","last_undegraded":"2024-09-17T05:40:19.963256+0000","last_fullsized":"2024-09-17T05:40:19.963256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:34:31.266739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961756+0000","last_change":"2024-09-17T05:40:18.962751+0000","last_active":"2024-09-17T05:40:19.961756+0000","last_peered":"2024-09-17T05:40:19.961756+0000","last_clean":"2024-09-17T05:40:19.961756+0000","last_became_active":"2024-09-17T05:40:18.962431+0000","last_became_peered":"2024-09-17T05:40:18.962431+0000","last_unstale":"2024-09-17T05:40:19.961756+0000","last_undegraded":"2024-09-17T05:40:19.961756+0000","last_fullsized":"2024-09-17T05:40:19.961756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:17.076796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965677+0000","last_change":"2024-09-17T05:40:18.973187+0000","last_active":"2024-09-17T05:40:19.965677+0000","last_peered":"2024-09-17T05:40:19.965677+0000","last_clean":"2024-09-17T05:40:19.965677+0000","last_became_active":"2024-09-17T05:40:18.972583+0000","last_became_peered":"2024-09-17T05:40:18.972583+0000","last_unstale":"2024-09-17T05:40:19.965677+0000","last_undegraded":"2024-09-17T05:40:19.965677+0000","last_fullsized":"2024-09-17T05:40:19.965677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:10.548067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961966+0000","last_change":"2024-09-17T05:40:18.953388+0000","last_active":"2024-09-17T05:40:19.961966+0000","last_peered":"2024-09-17T05:40:19.961966+0000","last_clean":"2024-09-17T05:40:19.961966+0000","last_became_active":"2024-09-17T05:40:18.953020+0000","last_became_peered":"2024-09-17T05:40:18.953020+0000","last_unstale":"2024-09-17T05:40:19.961966+0000","last_undegraded":"2024-09-17T05:40:19.961966+0000","last_fullsized":"2024-09-17T05:40:19.961966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962787+0000","last_change":"2024-09-17T05:40:18.967442+0000","last_active":"2024-09-17T05:40:19.962787+0000","last_peered":"2024-09-17T05:40:19.962787+0000","last_clean":"2024-09-17T05:40:19.962787+0000","last_became_active":"2024-09-17T05:40:18.967058+0000","last_became_peered":"2024-09-17T05:40:18.967058+0000","last_unstale":"2024-09-17T05:40:19.962787+0000","last_undegraded":"2024-09-17T05:40:19.962787+0000","last_fullsized":"2024-09-17T05:40:19.962787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:18.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880403+0000","last_change":"2024-09-17T05:40:18.964476+0000","last_active":"2024-09-17T05:40:20.880403+0000","last_peered":"2024-09-17T05:40:20.880403+0000","last_clean":"2024-09-17T05:40:20.880403+0000","last_became_active":"2024-09-17T05:40:18.961909+0000","last_became_peered":"2024-09-17T05:40:18.961909+0000","last_unstale":"2024-09-17T05:40:20.880403+0000","last_undegraded":"2024-09-17T05:40:20.880403+0000","last_fullsized":"2024-09-17T05:40:20.880403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:43.786845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962058+0000","last_change":"2024-09-17T05:40:18.978358+0000","last_active":"2024-09-17T05:40:19.962058+0000","last_peered":"2024-09-17T05:40:19.962058+0000","last_clean":"2024-09-17T05:40:19.962058+0000","last_became_active":"2024-09-17T05:40:18.978018+0000","last_became_peered":"2024-09-17T05:40:18.978018+0000","last_unstale":"2024-09-17T05:40:19.962058+0000","last_undegraded":"2024-09-17T05:40:19.962058+0000","last_fullsized":"2024-09-17T05:40:19.962058+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:13.844999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965692+0000","last_change":"2024-09-17T05:40:18.976020+0000","last_active":"2024-09-17T05:40:19.965692+0000","last_peered":"2024-09-17T05:40:19.965692+0000","last_clean":"2024-09-17T05:40:19.965692+0000","last_became_active":"2024-09-17T05:40:18.975685+0000","last_became_peered":"2024-09-17T05:40:18.975685+0000","last_unstale":"2024-09-17T05:40:19.965692+0000","last_undegraded":"2024-09-17T05:40:19.965692+0000","last_fullsized":"2024-09-17T05:40:19.965692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:21.915494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746347+0000","last_change":"2024-09-17T05:40:18.970329+0000","last_active":"2024-09-17T05:40:20.746347+0000","last_peered":"2024-09-17T05:40:20.746347+0000","last_clean":"2024-09-17T05:40:20.746347+0000","last_became_active":"2024-09-17T05:40:18.970033+0000","last_became_peered":"2024-09-17T05:40:18.970033+0000","last_unstale":"2024-09-17T05:40:20.746347+0000","last_undegraded":"2024-09-17T05:40:20.746347+0000","last_fullsized":"2024-09-17T05:40:20.746347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746067+0000","last_change":"2024-09-17T05:40:18.971355+0000","last_active":"2024-09-17T05:40:20.746067+0000","last_peered":"2024-09-17T05:40:20.746067+0000","last_clean":"2024-09-17T05:40:20.746067+0000","last_became_active":"2024-09-17T05:40:18.971020+0000","last_became_peered":"2024-09-17T05:40:18.971020+0000","last_unstale":"2024-09-17T05:40:20.746067+0000","last_undegraded":"2024-09-17T05:40:20.746067+0000","last_fullsized":"2024-09-17T05:40:20.746067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:44.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878335+0000","last_change":"2024-09-17T05:40:18.973895+0000","last_active":"2024-09-17T05:40:20.878335+0000","last_peered":"2024-09-17T05:40:20.878335+0000","last_clean":"2024-09-17T05:40:20.878335+0000","last_became_active":"2024-09-17T05:40:18.968948+0000","last_became_peered":"2024-09-17T05:40:18.968948+0000","last_unstale":"2024-09-17T05:40:20.878335+0000","last_undegraded":"2024-09-17T05:40:20.878335+0000","last_fullsized":"2024-09-17T05:40:20.878335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:34.472712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965243+0000","last_change":"2024-09-17T05:40:18.971284+0000","last_active":"2024-09-17T05:40:19.965243+0000","last_peered":"2024-09-17T05:40:19.965243+0000","last_clean":"2024-09-17T05:40:19.965243+0000","last_became_active":"2024-09-17T05:40:18.966667+0000","last_became_peered":"2024-09-17T05:40:18.966667+0000","last_unstale":"2024-09-17T05:40:19.965243+0000","last_undegraded":"2024-09-17T05:40:19.965243+0000","last_fullsized":"2024-09-17T05:40:19.965243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880748+0000","last_change":"2024-09-17T05:40:18.965174+0000","last_active":"2024-09-17T05:40:20.880748+0000","last_peered":"2024-09-17T05:40:20.880748+0000","last_clean":"2024-09-17T05:40:20.880748+0000","last_became_active":"2024-09-17T05:40:18.964778+0000","last_became_peered":"2024-09-17T05:40:18.964778+0000","last_unstale":"2024-09-17T05:40:20.880748+0000","last_undegraded":"2024-09-17T05:40:20.880748+0000","last_fullsized":"2024-09-17T05:40:20.880748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:58.112444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962482+0000","last_change":"2024-09-17T05:40:18.970246+0000","last_active":"2024-09-17T05:40:19.962482+0000","last_peered":"2024-09-17T05:40:19.962482+0000","last_clean":"2024-09-17T05:40:19.962482+0000","last_became_active":"2024-09-17T05:40:18.969884+0000","last_became_peered":"2024-09-17T05:40:18.969884+0000","last_unstale":"2024-09-17T05:40:19.962482+0000","last_undegraded":"2024-09-17T05:40:19.962482+0000","last_fullsized":"2024-09-17T05:40:19.962482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:23.572986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745554+0000","last_change":"2024-09-17T05:40:18.969453+0000","last_active":"2024-09-17T05:40:20.745554+0000","last_peered":"2024-09-17T05:40:20.745554+0000","last_clean":"2024-09-17T05:40:20.745554+0000","last_became_active":"2024-09-17T05:40:18.968764+0000","last_became_peered":"2024-09-17T05:40:18.968764+0000","last_unstale":"2024-09-17T05:40:20.745554+0000","last_undegraded":"2024-09-17T05:40:20.745554+0000","last_fullsized":"2024-09-17T05:40:20.745554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877960+0000","last_change":"2024-09-17T05:40:18.968303+0000","last_active":"2024-09-17T05:40:20.877960+0000","last_peered":"2024-09-17T05:40:20.877960+0000","last_clean":"2024-09-17T05:40:20.877960+0000","last_became_active":"2024-09-17T05:40:18.967969+0000","last_became_peered":"2024-09-17T05:40:18.967969+0000","last_unstale":"2024-09-17T05:40:20.877960+0000","last_undegraded":"2024-09-17T05:40:20.877960+0000","last_fullsized":"2024-09-17T05:40:20.877960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.754367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878733+0000","last_change":"2024-09-17T05:40:17.961361+0000","last_active":"2024-09-17T05:40:20.878733+0000","last_peered":"2024-09-17T05:40:20.878733+0000","last_clean":"2024-09-17T05:40:20.878733+0000","last_became_active":"2024-09-17T05:40:17.960382+0000","last_became_peered":"2024-09-17T05:40:17.960382+0000","last_unstale":"2024-09-17T05:40:20.878733+0000","last_undegraded":"2024-09-17T05:40:20.878733+0000","last_fullsized":"2024-09-17T05:40:20.878733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:14.971857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:18.975317+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:18.975011+0000","last_became_peered":"2024-09-17T05:40:18.975011+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:19.442398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880008+0000","last_change":"2024-09-17T05:40:17.966550+0000","last_active":"2024-09-17T05:40:20.880008+0000","last_peered":"2024-09-17T05:40:20.880008+0000","last_clean":"2024-09-17T05:40:20.880008+0000","last_became_active":"2024-09-17T05:40:17.966232+0000","last_became_peered":"2024-09-17T05:40:17.966232+0000","last_unstale":"2024-09-17T05:40:20.880008+0000","last_undegraded":"2024-09-17T05:40:20.880008+0000","last_fullsized":"2024-09-17T05:40:20.880008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.669759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961738+0000","last_change":"2024-09-17T05:40:18.965633+0000","last_active":"2024-09-17T05:40:19.961738+0000","last_peered":"2024-09-17T05:40:19.961738+0000","last_clean":"2024-09-17T05:40:19.961738+0000","last_became_active":"2024-09-17T05:40:18.965055+0000","last_became_peered":"2024-09-17T05:40:18.965055+0000","last_unstale":"2024-09-17T05:40:19.961738+0000","last_undegraded":"2024-09-17T05:40:19.961738+0000","last_fullsized":"2024-09-17T05:40:19.961738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:23.790972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880827+0000","last_change":"2024-09-17T05:40:17.971273+0000","last_active":"2024-09-17T05:40:20.880827+0000","last_peered":"2024-09-17T05:40:20.880827+0000","last_clean":"2024-09-17T05:40:20.880827+0000","last_became_active":"2024-09-17T05:40:17.970885+0000","last_became_peered":"2024-09-17T05:40:17.970885+0000","last_unstale":"2024-09-17T05:40:20.880827+0000","last_undegraded":"2024-09-17T05:40:20.880827+0000","last_fullsized":"2024-09-17T05:40:20.880827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.395940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745938+0000","last_change":"2024-09-17T05:40:18.966252+0000","last_active":"2024-09-17T05:40:20.745938+0000","last_peered":"2024-09-17T05:40:20.745938+0000","last_clean":"2024-09-17T05:40:20.745938+0000","last_became_active":"2024-09-17T05:40:18.965843+0000","last_became_peered":"2024-09-17T05:40:18.965843+0000","last_unstale":"2024-09-17T05:40:20.745938+0000","last_undegraded":"2024-09-17T05:40:20.745938+0000","last_fullsized":"2024-09-17T05:40:20.745938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:10.099473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962112+0000","last_change":"2024-09-17T05:40:17.973881+0000","last_active":"2024-09-17T05:40:19.962112+0000","last_peered":"2024-09-17T05:40:19.962112+0000","last_clean":"2024-09-17T05:40:19.962112+0000","last_became_active":"2024-09-17T05:40:17.973539+0000","last_became_peered":"2024-09-17T05:40:17.973539+0000","last_unstale":"2024-09-17T05:40:19.962112+0000","last_undegraded":"2024-09-17T05:40:19.962112+0000","last_fullsized":"2024-09-17T05:40:19.962112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:07.850444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965742+0000","last_change":"2024-09-17T05:40:18.972873+0000","last_active":"2024-09-17T05:40:19.965742+0000","last_peered":"2024-09-17T05:40:19.965742+0000","last_clean":"2024-09-17T05:40:19.965742+0000","last_became_active":"2024-09-17T05:40:18.972156+0000","last_became_peered":"2024-09-17T05:40:18.972156+0000","last_unstale":"2024-09-17T05:40:19.965742+0000","last_undegraded":"2024-09-17T05:40:19.965742+0000","last_fullsized":"2024-09-17T05:40:19.965742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962371+0000","last_change":"2024-09-17T05:40:17.969993+0000","last_active":"2024-09-17T05:40:19.962371+0000","last_peered":"2024-09-17T05:40:19.962371+0000","last_clean":"2024-09-17T05:40:19.962371+0000","last_became_active":"2024-09-17T05:40:17.969577+0000","last_became_peered":"2024-09-17T05:40:17.969577+0000","last_unstale":"2024-09-17T05:40:19.962371+0000","last_undegraded":"2024-09-17T05:40:19.962371+0000","last_fullsized":"2024-09-17T05:40:19.962371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963500+0000","last_change":"2024-09-17T05:40:18.973334+0000","last_active":"2024-09-17T05:40:19.963500+0000","last_peered":"2024-09-17T05:40:19.963500+0000","last_clean":"2024-09-17T05:40:19.963500+0000","last_became_active":"2024-09-17T05:40:18.971131+0000","last_became_peered":"2024-09-17T05:40:18.971131+0000","last_unstale":"2024-09-17T05:40:19.963500+0000","last_undegraded":"2024-09-17T05:40:19.963500+0000","last_fullsized":"2024-09-17T05:40:19.963500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:00.092352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879329+0000","last_change":"2024-09-17T05:40:17.972241+0000","last_active":"2024-09-17T05:40:20.879329+0000","last_peered":"2024-09-17T05:40:20.879329+0000","last_clean":"2024-09-17T05:40:20.879329+0000","last_became_active":"2024-09-17T05:40:17.971903+0000","last_became_peered":"2024-09-17T05:40:17.971903+0000","last_unstale":"2024-09-17T05:40:20.879329+0000","last_undegraded":"2024-09-17T05:40:20.879329+0000","last_fullsized":"2024-09-17T05:40:20.879329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:53.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962234+0000","last_change":"2024-09-17T05:40:18.966028+0000","last_active":"2024-09-17T05:40:19.962234+0000","last_peered":"2024-09-17T05:40:19.962234+0000","last_clean":"2024-09-17T05:40:19.962234+0000","last_became_active":"2024-09-17T05:40:18.965683+0000","last_became_peered":"2024-09-17T05:40:18.965683+0000","last_unstale":"2024-09-17T05:40:19.962234+0000","last_undegraded":"2024-09-17T05:40:19.962234+0000","last_fullsized":"2024-09-17T05:40:19.962234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961382+0000","last_change":"2024-09-17T05:40:17.966777+0000","last_active":"2024-09-17T05:40:19.961382+0000","last_peered":"2024-09-17T05:40:19.961382+0000","last_clean":"2024-09-17T05:40:19.961382+0000","last_became_active":"2024-09-17T05:40:17.966414+0000","last_became_peered":"2024-09-17T05:40:17.966414+0000","last_unstale":"2024-09-17T05:40:19.961382+0000","last_undegraded":"2024-09-17T05:40:19.961382+0000","last_fullsized":"2024-09-17T05:40:19.961382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:44.209477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880088+0000","last_change":"2024-09-17T05:40:18.969318+0000","last_active":"2024-09-17T05:40:20.880088+0000","last_peered":"2024-09-17T05:40:20.880088+0000","last_clean":"2024-09-17T05:40:20.880088+0000","last_became_active":"2024-09-17T05:40:18.968996+0000","last_became_peered":"2024-09-17T05:40:18.968996+0000","last_unstale":"2024-09-17T05:40:20.880088+0000","last_undegraded":"2024-09-17T05:40:20.880088+0000","last_fullsized":"2024-09-17T05:40:20.880088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:49.154860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962249+0000","last_change":"2024-09-17T05:40:17.959870+0000","last_active":"2024-09-17T05:40:19.962249+0000","last_peered":"2024-09-17T05:40:19.962249+0000","last_clean":"2024-09-17T05:40:19.962249+0000","last_became_active":"2024-09-17T05:40:17.959110+0000","last_became_peered":"2024-09-17T05:40:17.959110+0000","last_unstale":"2024-09-17T05:40:19.962249+0000","last_undegraded":"2024-09-17T05:40:19.962249+0000","last_fullsized":"2024-09-17T05:40:19.962249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:56.467002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962143+0000","last_change":"2024-09-17T05:40:18.964351+0000","last_active":"2024-09-17T05:40:19.962143+0000","last_peered":"2024-09-17T05:40:19.962143+0000","last_clean":"2024-09-17T05:40:19.962143+0000","last_became_active":"2024-09-17T05:40:18.963996+0000","last_became_peered":"2024-09-17T05:40:18.963996+0000","last_unstale":"2024-09-17T05:40:19.962143+0000","last_undegraded":"2024-09-17T05:40:19.962143+0000","last_fullsized":"2024-09-17T05:40:19.962143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.388632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746438+0000","last_change":"2024-09-17T05:40:17.965056+0000","last_active":"2024-09-17T05:40:20.746438+0000","last_peered":"2024-09-17T05:40:20.746438+0000","last_clean":"2024-09-17T05:40:20.746438+0000","last_became_active":"2024-09-17T05:40:17.964655+0000","last_became_peered":"2024-09-17T05:40:17.964655+0000","last_unstale":"2024-09-17T05:40:20.746438+0000","last_undegraded":"2024-09-17T05:40:20.746438+0000","last_fullsized":"2024-09-17T05:40:20.746438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:35.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961796+0000","last_change":"2024-09-17T05:40:18.957254+0000","last_active":"2024-09-17T05:40:19.961796+0000","last_peered":"2024-09-17T05:40:19.961796+0000","last_clean":"2024-09-17T05:40:19.961796+0000","last_became_active":"2024-09-17T05:40:18.956903+0000","last_became_peered":"2024-09-17T05:40:18.956903+0000","last_unstale":"2024-09-17T05:40:19.961796+0000","last_undegraded":"2024-09-17T05:40:19.961796+0000","last_fullsized":"2024-09-17T05:40:19.961796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880695+0000","last_change":"2024-09-17T05:40:17.965827+0000","last_active":"2024-09-17T05:40:20.880695+0000","last_peered":"2024-09-17T05:40:20.880695+0000","last_clean":"2024-09-17T05:40:20.880695+0000","last_became_active":"2024-09-17T05:40:17.962330+0000","last_became_peered":"2024-09-17T05:40:17.962330+0000","last_unstale":"2024-09-17T05:40:20.880695+0000","last_undegraded":"2024-09-17T05:40:20.880695+0000","last_fullsized":"2024-09-17T05:40:20.880695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:15.809852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961491+0000","last_change":"2024-09-17T05:40:18.972381+0000","last_active":"2024-09-17T05:40:19.961491+0000","last_peered":"2024-09-17T05:40:19.961491+0000","last_clean":"2024-09-17T05:40:19.961491+0000","last_became_active":"2024-09-17T05:40:18.972050+0000","last_became_peered":"2024-09-17T05:40:18.972050+0000","last_unstale":"2024-09-17T05:40:19.961491+0000","last_undegraded":"2024-09-17T05:40:19.961491+0000","last_fullsized":"2024-09-17T05:40:19.961491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965153+0000","last_change":"2024-09-17T05:40:17.971063+0000","last_active":"2024-09-17T05:40:19.965153+0000","last_peered":"2024-09-17T05:40:19.965153+0000","last_clean":"2024-09-17T05:40:19.965153+0000","last_became_active":"2024-09-17T05:40:17.970390+0000","last_became_peered":"2024-09-17T05:40:17.970390+0000","last_unstale":"2024-09-17T05:40:19.965153+0000","last_undegraded":"2024-09-17T05:40:19.965153+0000","last_fullsized":"2024-09-17T05:40:19.965153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:24.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965290+0000","last_change":"2024-09-17T05:40:18.965052+0000","last_active":"2024-09-17T05:40:19.965290+0000","last_peered":"2024-09-17T05:40:19.965290+0000","last_clean":"2024-09-17T05:40:19.965290+0000","last_became_active":"2024-09-17T05:40:18.964428+0000","last_became_peered":"2024-09-17T05:40:18.964428+0000","last_unstale":"2024-09-17T05:40:19.965290+0000","last_undegraded":"2024-09-17T05:40:19.965290+0000","last_fullsized":"2024-09-17T05:40:19.965290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:12.516191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879706+0000","last_change":"2024-09-17T05:40:17.975190+0000","last_active":"2024-09-17T05:40:20.879706+0000","last_peered":"2024-09-17T05:40:20.879706+0000","last_clean":"2024-09-17T05:40:20.879706+0000","last_became_active":"2024-09-17T05:40:17.974679+0000","last_became_peered":"2024-09-17T05:40:17.974679+0000","last_unstale":"2024-09-17T05:40:20.879706+0000","last_undegraded":"2024-09-17T05:40:20.879706+0000","last_fullsized":"2024-09-17T05:40:20.879706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:56.674619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746000+0000","last_change":"2024-09-17T05:40:18.968708+0000","last_active":"2024-09-17T05:40:20.746000+0000","last_peered":"2024-09-17T05:40:20.746000+0000","last_clean":"2024-09-17T05:40:20.746000+0000","last_became_active":"2024-09-17T05:40:18.968273+0000","last_became_peered":"2024-09-17T05:40:18.968273+0000","last_unstale":"2024-09-17T05:40:20.746000+0000","last_undegraded":"2024-09-17T05:40:20.746000+0000","last_fullsized":"2024-09-17T05:40:20.746000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:11.746260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880446+0000","last_change":"2024-09-17T05:40:17.970784+0000","last_active":"2024-09-17T05:40:20.880446+0000","last_peered":"2024-09-17T05:40:20.880446+0000","last_clean":"2024-09-17T05:40:20.880446+0000","last_became_active":"2024-09-17T05:40:17.970430+0000","last_became_peered":"2024-09-17T05:40:17.970430+0000","last_unstale":"2024-09-17T05:40:20.880446+0000","last_undegraded":"2024-09-17T05:40:20.880446+0000","last_fullsized":"2024-09-17T05:40:20.880446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:40.544858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880886+0000","last_change":"2024-09-17T05:40:18.971140+0000","last_active":"2024-09-17T05:40:20.880886+0000","last_peered":"2024-09-17T05:40:20.880886+0000","last_clean":"2024-09-17T05:40:20.880886+0000","last_became_active":"2024-09-17T05:40:18.970843+0000","last_became_peered":"2024-09-17T05:40:18.970843+0000","last_unstale":"2024-09-17T05:40:20.880886+0000","last_undegraded":"2024-09-17T05:40:20.880886+0000","last_fullsized":"2024-09-17T05:40:20.880886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:49.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961919+0000","last_change":"2024-09-17T05:40:17.973356+0000","last_active":"2024-09-17T05:40:19.961919+0000","last_peered":"2024-09-17T05:40:19.961919+0000","last_clean":"2024-09-17T05:40:19.961919+0000","last_became_active":"2024-09-17T05:40:17.973013+0000","last_became_peered":"2024-09-17T05:40:17.973013+0000","last_unstale":"2024-09-17T05:40:19.961919+0000","last_undegraded":"2024-09-17T05:40:19.961919+0000","last_fullsized":"2024-09-17T05:40:19.961919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:10.738755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962312+0000","last_change":"2024-09-17T05:40:18.970497+0000","last_active":"2024-09-17T05:40:19.962312+0000","last_peered":"2024-09-17T05:40:19.962312+0000","last_clean":"2024-09-17T05:40:19.962312+0000","last_became_active":"2024-09-17T05:40:18.970209+0000","last_became_peered":"2024-09-17T05:40:18.970209+0000","last_unstale":"2024-09-17T05:40:19.962312+0000","last_undegraded":"2024-09-17T05:40:19.962312+0000","last_fullsized":"2024-09-17T05:40:19.962312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:17.959159+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:17.958789+0000","last_became_peered":"2024-09-17T05:40:17.958789+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:58.233971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880871+0000","last_change":"2024-09-17T05:40:18.969090+0000","last_active":"2024-09-17T05:40:20.880871+0000","last_peered":"2024-09-17T05:40:20.880871+0000","last_clean":"2024-09-17T05:40:20.880871+0000","last_became_active":"2024-09-17T05:40:18.968784+0000","last_became_peered":"2024-09-17T05:40:18.968784+0000","last_unstale":"2024-09-17T05:40:20.880871+0000","last_undegraded":"2024-09-17T05:40:20.880871+0000","last_fullsized":"2024-09-17T05:40:20.880871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.582695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965006+0000","last_change":"2024-09-17T05:40:17.965172+0000","last_active":"2024-09-17T05:40:19.965006+0000","last_peered":"2024-09-17T05:40:19.965006+0000","last_clean":"2024-09-17T05:40:19.965006+0000","last_became_active":"2024-09-17T05:40:17.964923+0000","last_became_peered":"2024-09-17T05:40:17.964923+0000","last_unstale":"2024-09-17T05:40:19.965006+0000","last_undegraded":"2024-09-17T05:40:19.965006+0000","last_fullsized":"2024-09-17T05:40:19.965006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:24.487199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878121+0000","last_change":"2024-09-17T05:40:18.978887+0000","last_active":"2024-09-17T05:40:20.878121+0000","last_peered":"2024-09-17T05:40:20.878121+0000","last_clean":"2024-09-17T05:40:20.878121+0000","last_became_active":"2024-09-17T05:40:18.978477+0000","last_became_peered":"2024-09-17T05:40:18.978477+0000","last_unstale":"2024-09-17T05:40:20.878121+0000","last_undegraded":"2024-09-17T05:40:20.878121+0000","last_fullsized":"2024-09-17T05:40:20.878121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:55.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746530+0000","last_change":"2024-09-17T05:40:17.972337+0000","last_active":"2024-09-17T05:40:20.746530+0000","last_peered":"2024-09-17T05:40:20.746530+0000","last_clean":"2024-09-17T05:40:20.746530+0000","last_became_active":"2024-09-17T05:40:17.971336+0000","last_became_peered":"2024-09-17T05:40:17.971336+0000","last_unstale":"2024-09-17T05:40:20.746530+0000","last_undegraded":"2024-09-17T05:40:20.746530+0000","last_fullsized":"2024-09-17T05:40:20.746530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:18.434892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962728+0000","last_change":"2024-09-17T05:40:18.968306+0000","last_active":"2024-09-17T05:40:19.962728+0000","last_peered":"2024-09-17T05:40:19.962728+0000","last_clean":"2024-09-17T05:40:19.962728+0000","last_became_active":"2024-09-17T05:40:18.967891+0000","last_became_peered":"2024-09-17T05:40:18.967891+0000","last_unstale":"2024-09-17T05:40:19.962728+0000","last_undegraded":"2024-09-17T05:40:19.962728+0000","last_fullsized":"2024-09-17T05:40:19.962728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:39.803397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746356+0000","last_change":"2024-09-17T05:40:17.965044+0000","last_active":"2024-09-17T05:40:20.746356+0000","last_peered":"2024-09-17T05:40:20.746356+0000","last_clean":"2024-09-17T05:40:20.746356+0000","last_became_active":"2024-09-17T05:40:17.964741+0000","last_became_peered":"2024-09-17T05:40:17.964741+0000","last_unstale":"2024-09-17T05:40:20.746356+0000","last_undegraded":"2024-09-17T05:40:20.746356+0000","last_fullsized":"2024-09-17T05:40:20.746356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:52.300156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961079+0000","last_change":"2024-09-17T05:40:18.964400+0000","last_active":"2024-09-17T05:40:19.961079+0000","last_peered":"2024-09-17T05:40:19.961079+0000","last_clean":"2024-09-17T05:40:19.961079+0000","last_became_active":"2024-09-17T05:40:18.964075+0000","last_became_peered":"2024-09-17T05:40:18.964075+0000","last_unstale":"2024-09-17T05:40:19.961079+0000","last_undegraded":"2024-09-17T05:40:19.961079+0000","last_fullsized":"2024-09-17T05:40:19.961079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:34.649446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878634+0000","last_change":"2024-09-17T05:40:17.967952+0000","last_active":"2024-09-17T05:40:20.878634+0000","last_peered":"2024-09-17T05:40:20.878634+0000","last_clean":"2024-09-17T05:40:20.878634+0000","last_became_active":"2024-09-17T05:40:17.967598+0000","last_became_peered":"2024-09-17T05:40:17.967598+0000","last_unstale":"2024-09-17T05:40:20.878634+0000","last_undegraded":"2024-09-17T05:40:20.878634+0000","last_fullsized":"2024-09-17T05:40:20.878634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:19.550729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878198+0000","last_change":"2024-09-17T05:40:18.975785+0000","last_active":"2024-09-17T05:40:20.878198+0000","last_peered":"2024-09-17T05:40:20.878198+0000","last_clean":"2024-09-17T05:40:20.878198+0000","last_became_active":"2024-09-17T05:40:18.967877+0000","last_became_peered":"2024-09-17T05:40:18.967877+0000","last_unstale":"2024-09-17T05:40:20.878198+0000","last_undegraded":"2024-09-17T05:40:20.878198+0000","last_fullsized":"2024-09-17T05:40:20.878198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:02.537983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878483+0000","last_change":"2024-09-17T05:40:17.969484+0000","last_active":"2024-09-17T05:40:20.878483+0000","last_peered":"2024-09-17T05:40:20.878483+0000","last_clean":"2024-09-17T05:40:20.878483+0000","last_became_active":"2024-09-17T05:40:17.969158+0000","last_became_peered":"2024-09-17T05:40:17.969158+0000","last_unstale":"2024-09-17T05:40:20.878483+0000","last_undegraded":"2024-09-17T05:40:20.878483+0000","last_fullsized":"2024-09-17T05:40:20.878483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:36.756374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878618+0000","last_change":"2024-09-17T05:40:18.967277+0000","last_active":"2024-09-17T05:40:20.878618+0000","last_peered":"2024-09-17T05:40:20.878618+0000","last_clean":"2024-09-17T05:40:20.878618+0000","last_became_active":"2024-09-17T05:40:18.966960+0000","last_became_peered":"2024-09-17T05:40:18.966960+0000","last_unstale":"2024-09-17T05:40:20.878618+0000","last_undegraded":"2024-09-17T05:40:20.878618+0000","last_fullsized":"2024-09-17T05:40:20.878618+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:27.633925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962843+0000","last_change":"2024-09-17T05:40:17.955665+0000","last_active":"2024-09-17T05:40:19.962843+0000","last_peered":"2024-09-17T05:40:19.962843+0000","last_clean":"2024-09-17T05:40:19.962843+0000","last_became_active":"2024-09-17T05:40:17.953041+0000","last_became_peered":"2024-09-17T05:40:17.953041+0000","last_unstale":"2024-09-17T05:40:19.962843+0000","last_undegraded":"2024-09-17T05:40:19.962843+0000","last_fullsized":"2024-09-17T05:40:19.962843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:00.753900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878836+0000","last_change":"2024-09-17T05:40:18.977272+0000","last_active":"2024-09-17T05:40:20.878836+0000","last_peered":"2024-09-17T05:40:20.878836+0000","last_clean":"2024-09-17T05:40:20.878836+0000","last_became_active":"2024-09-17T05:40:18.976916+0000","last_became_peered":"2024-09-17T05:40:18.976916+0000","last_unstale":"2024-09-17T05:40:20.878836+0000","last_undegraded":"2024-09-17T05:40:20.878836+0000","last_fullsized":"2024-09-17T05:40:20.878836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:42.993651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960931+0000","last_change":"2024-09-17T05:40:17.961323+0000","last_active":"2024-09-17T05:40:19.960931+0000","last_peered":"2024-09-17T05:40:19.960931+0000","last_clean":"2024-09-17T05:40:19.960931+0000","last_became_active":"2024-09-17T05:40:17.961012+0000","last_became_peered":"2024-09-17T05:40:17.961012+0000","last_unstale":"2024-09-17T05:40:19.960931+0000","last_undegraded":"2024-09-17T05:40:19.960931+0000","last_fullsized":"2024-09-17T05:40:19.960931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:31.323376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880144+0000","last_change":"2024-09-17T05:40:18.976598+0000","last_active":"2024-09-17T05:40:20.880144+0000","last_peered":"2024-09-17T05:40:20.880144+0000","last_clean":"2024-09-17T05:40:20.880144+0000","last_became_active":"2024-09-17T05:40:18.976246+0000","last_became_peered":"2024-09-17T05:40:18.976246+0000","last_unstale":"2024-09-17T05:40:20.880144+0000","last_undegraded":"2024-09-17T05:40:20.880144+0000","last_fullsized":"2024-09-17T05:40:20.880144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:50.563559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962333+0000","last_change":"2024-09-17T05:40:17.962804+0000","last_active":"2024-09-17T05:40:19.962333+0000","last_peered":"2024-09-17T05:40:19.962333+0000","last_clean":"2024-09-17T05:40:19.962333+0000","last_became_active":"2024-09-17T05:40:17.962441+0000","last_became_peered":"2024-09-17T05:40:17.962441+0000","last_unstale":"2024-09-17T05:40:19.962333+0000","last_undegraded":"2024-09-17T05:40:19.962333+0000","last_fullsized":"2024-09-17T05:40:19.962333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:18.623325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745945+0000","last_change":"2024-09-17T05:40:18.964746+0000","last_active":"2024-09-17T05:40:20.745945+0000","last_peered":"2024-09-17T05:40:20.745945+0000","last_clean":"2024-09-17T05:40:20.745945+0000","last_became_active":"2024-09-17T05:40:18.962288+0000","last_became_peered":"2024-09-17T05:40:18.962288+0000","last_unstale":"2024-09-17T05:40:20.745945+0000","last_undegraded":"2024-09-17T05:40:20.745945+0000","last_fullsized":"2024-09-17T05:40:20.745945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:55.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880970+0000","last_change":"2024-09-17T05:40:17.958259+0000","last_active":"2024-09-17T05:40:20.880970+0000","last_peered":"2024-09-17T05:40:20.880970+0000","last_clean":"2024-09-17T05:40:20.880970+0000","last_became_active":"2024-09-17T05:40:17.956752+0000","last_became_peered":"2024-09-17T05:40:17.956752+0000","last_unstale":"2024-09-17T05:40:20.880970+0000","last_undegraded":"2024-09-17T05:40:20.880970+0000","last_fullsized":"2024-09-17T05:40:20.880970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:54.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880734+0000","last_change":"2024-09-17T05:40:18.967915+0000","last_active":"2024-09-17T05:40:20.880734+0000","last_peered":"2024-09-17T05:40:20.880734+0000","last_clean":"2024-09-17T05:40:20.880734+0000","last_became_active":"2024-09-17T05:40:18.967620+0000","last_became_peered":"2024-09-17T05:40:18.967620+0000","last_unstale":"2024-09-17T05:40:20.880734+0000","last_undegraded":"2024-09-17T05:40:20.880734+0000","last_fullsized":"2024-09-17T05:40:20.880734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:53.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.967006+0000","last_change":"2024-09-17T05:40:17.970621+0000","last_active":"2024-09-17T05:40:19.967006+0000","last_peered":"2024-09-17T05:40:19.967006+0000","last_clean":"2024-09-17T05:40:19.967006+0000","last_became_active":"2024-09-17T05:40:17.970196+0000","last_became_peered":"2024-09-17T05:40:17.970196+0000","last_unstale":"2024-09-17T05:40:19.967006+0000","last_undegraded":"2024-09-17T05:40:19.967006+0000","last_fullsized":"2024-09-17T05:40:19.967006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:07.550401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961767+0000","last_change":"2024-09-17T05:40:18.966610+0000","last_active":"2024-09-17T05:40:19.961767+0000","last_peered":"2024-09-17T05:40:19.961767+0000","last_clean":"2024-09-17T05:40:19.961767+0000","last_became_active":"2024-09-17T05:40:18.966276+0000","last_became_peered":"2024-09-17T05:40:18.966276+0000","last_unstale":"2024-09-17T05:40:19.961767+0000","last_undegraded":"2024-09-17T05:40:19.961767+0000","last_fullsized":"2024-09-17T05:40:19.961767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:53.342120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880935+0000","last_change":"2024-09-17T05:40:17.963755+0000","last_active":"2024-09-17T05:40:20.880935+0000","last_peered":"2024-09-17T05:40:20.880935+0000","last_clean":"2024-09-17T05:40:20.880935+0000","last_became_active":"2024-09-17T05:40:17.963439+0000","last_became_peered":"2024-09-17T05:40:17.963439+0000","last_unstale":"2024-09-17T05:40:20.880935+0000","last_undegraded":"2024-09-17T05:40:20.880935+0000","last_fullsized":"2024-09-17T05:40:20.880935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.746862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961385+0000","last_change":"2024-09-17T05:40:18.956932+0000","last_active":"2024-09-17T05:40:19.961385+0000","last_peered":"2024-09-17T05:40:19.961385+0000","last_clean":"2024-09-17T05:40:19.961385+0000","last_became_active":"2024-09-17T05:40:18.956628+0000","last_became_peered":"2024-09-17T05:40:18.956628+0000","last_unstale":"2024-09-17T05:40:19.961385+0000","last_undegraded":"2024-09-17T05:40:19.961385+0000","last_fullsized":"2024-09-17T05:40:19.961385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746198+0000","last_change":"2024-09-17T05:40:17.963225+0000","last_active":"2024-09-17T05:40:20.746198+0000","last_peered":"2024-09-17T05:40:20.746198+0000","last_clean":"2024-09-17T05:40:20.746198+0000","last_became_active":"2024-09-17T05:40:17.962712+0000","last_became_peered":"2024-09-17T05:40:17.962712+0000","last_unstale":"2024-09-17T05:40:20.746198+0000","last_undegraded":"2024-09-17T05:40:20.746198+0000","last_fullsized":"2024-09-17T05:40:20.746198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:26.824455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962047+0000","last_change":"2024-09-17T05:40:18.966387+0000","last_active":"2024-09-17T05:40:19.962047+0000","last_peered":"2024-09-17T05:40:19.962047+0000","last_clean":"2024-09-17T05:40:19.962047+0000","last_became_active":"2024-09-17T05:40:18.966066+0000","last_became_peered":"2024-09-17T05:40:18.966066+0000","last_unstale":"2024-09-17T05:40:19.962047+0000","last_undegraded":"2024-09-17T05:40:19.962047+0000","last_fullsized":"2024-09-17T05:40:19.962047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879461+0000","last_change":"2024-09-17T05:40:17.967077+0000","last_active":"2024-09-17T05:40:20.879461+0000","last_peered":"2024-09-17T05:40:20.879461+0000","last_clean":"2024-09-17T05:40:20.879461+0000","last_became_active":"2024-09-17T05:40:17.966350+0000","last_became_peered":"2024-09-17T05:40:17.966350+0000","last_unstale":"2024-09-17T05:40:20.879461+0000","last_undegraded":"2024-09-17T05:40:20.879461+0000","last_fullsized":"2024-09-17T05:40:20.879461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:53.153954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746326+0000","last_change":"2024-09-17T05:40:18.972375+0000","last_active":"2024-09-17T05:40:20.746326+0000","last_peered":"2024-09-17T05:40:20.746326+0000","last_clean":"2024-09-17T05:40:20.746326+0000","last_became_active":"2024-09-17T05:40:18.972044+0000","last_became_peered":"2024-09-17T05:40:18.972044+0000","last_unstale":"2024-09-17T05:40:20.746326+0000","last_undegraded":"2024-09-17T05:40:20.746326+0000","last_fullsized":"2024-09-17T05:40:20.746326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:45.216982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965453+0000","last_change":"2024-09-17T05:40:17.963155+0000","last_active":"2024-09-17T05:40:19.965453+0000","last_peered":"2024-09-17T05:40:19.965453+0000","last_clean":"2024-09-17T05:40:19.965453+0000","last_became_active":"2024-09-17T05:40:17.962627+0000","last_became_peered":"2024-09-17T05:40:17.962627+0000","last_unstale":"2024-09-17T05:40:19.965453+0000","last_undegraded":"2024-09-17T05:40:19.965453+0000","last_fullsized":"2024-09-17T05:40:19.965453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.151688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963532+0000","last_change":"2024-09-17T05:40:18.969617+0000","last_active":"2024-09-17T05:40:19.963532+0000","last_peered":"2024-09-17T05:40:19.963532+0000","last_clean":"2024-09-17T05:40:19.963532+0000","last_became_active":"2024-09-17T05:40:18.969296+0000","last_became_peered":"2024-09-17T05:40:18.969296+0000","last_unstale":"2024-09-17T05:40:19.963532+0000","last_undegraded":"2024-09-17T05:40:19.963532+0000","last_fullsized":"2024-09-17T05:40:19.963532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:15.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745749+0000","last_change":"2024-09-17T05:40:17.963433+0000","last_active":"2024-09-17T05:40:20.745749+0000","last_peered":"2024-09-17T05:40:20.745749+0000","last_clean":"2024-09-17T05:40:20.745749+0000","last_became_active":"2024-09-17T05:40:17.963089+0000","last_became_peered":"2024-09-17T05:40:17.963089+0000","last_unstale":"2024-09-17T05:40:20.745749+0000","last_undegraded":"2024-09-17T05:40:20.745749+0000","last_fullsized":"2024-09-17T05:40:20.745749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:47.055143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878756+0000","last_change":"2024-09-17T05:40:18.969053+0000","last_active":"2024-09-17T05:40:20.878756+0000","last_peered":"2024-09-17T05:40:20.878756+0000","last_clean":"2024-09-17T05:40:20.878756+0000","last_became_active":"2024-09-17T05:40:18.968741+0000","last_became_peered":"2024-09-17T05:40:18.968741+0000","last_unstale":"2024-09-17T05:40:20.878756+0000","last_undegraded":"2024-09-17T05:40:20.878756+0000","last_fullsized":"2024-09-17T05:40:20.878756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:47.639721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962377+0000","last_change":"2024-09-17T05:40:17.955748+0000","last_active":"2024-09-17T05:40:19.962377+0000","last_peered":"2024-09-17T05:40:19.962377+0000","last_clean":"2024-09-17T05:40:19.962377+0000","last_became_active":"2024-09-17T05:40:17.953494+0000","last_became_peered":"2024-09-17T05:40:17.953494+0000","last_unstale":"2024-09-17T05:40:19.962377+0000","last_undegraded":"2024-09-17T05:40:19.962377+0000","last_fullsized":"2024-09-17T05:40:19.962377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:20.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879800+0000","last_change":"2024-09-17T05:40:18.962984+0000","last_active":"2024-09-17T05:40:20.879800+0000","last_peered":"2024-09-17T05:40:20.879800+0000","last_clean":"2024-09-17T05:40:20.879800+0000","last_became_active":"2024-09-17T05:40:18.962658+0000","last_became_peered":"2024-09-17T05:40:18.962658+0000","last_unstale":"2024-09-17T05:40:20.879800+0000","last_undegraded":"2024-09-17T05:40:20.879800+0000","last_fullsized":"2024-09-17T05:40:20.879800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.691731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965293+0000","last_change":"2024-09-17T05:40:17.966745+0000","last_active":"2024-09-17T05:40:19.965293+0000","last_peered":"2024-09-17T05:40:19.965293+0000","last_clean":"2024-09-17T05:40:19.965293+0000","last_became_active":"2024-09-17T05:40:17.966394+0000","last_became_peered":"2024-09-17T05:40:17.966394+0000","last_unstale":"2024-09-17T05:40:19.965293+0000","last_undegraded":"2024-09-17T05:40:19.965293+0000","last_fullsized":"2024-09-17T05:40:19.965293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:48.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879666+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:40:20.879666+0000","last_peered":"2024-09-17T05:40:20.879666+0000","last_clean":"2024-09-17T05:40:20.879666+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:40:20.879666+0000","last_undegraded":"2024-09-17T05:40:20.879666+0000","last_fullsized":"2024-09-17T05:40:20.879666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":929792,"data_stored":417818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1531904,"data_stored":1014316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":942080,"data_stored":418882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":423858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1531904,"data_stored":1009180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":942080,"data_stored":424530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:40:24.920 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:40:24.920+0000 7fc1fd600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:40:27.835 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:40:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 -- 172.21.15.44:0/3691575099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd4004810 msgr2=0x7fecd4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3691575099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd4004810 0x7fecd4004c20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fecd8006fd0 tx=0x7fecd801cf10 comp rx=0 tx=0).stop 2024-09-17T05:40:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 -- 172.21.15.44:0/3691575099 shutdown_connections 2024-09-17T05:40:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3691575099 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd4004810 0x7fecd4004c20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 -- 172.21.15.44:0/3691575099 >> 172.21.15.44:0/3691575099 conn(0x7fecf00b4240 msgr2=0x7fecf00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 -- 172.21.15.44:0/3691575099 shutdown_connections 2024-09-17T05:40:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 -- 172.21.15.44:0/3691575099 wait complete. 2024-09-17T05:40:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 Processor -- start 2024-09-17T05:40:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.008+0000 7fecf6a00640 1 -- start start 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecd4004810 0x7fecf013a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf00b5770 0x7fecf013d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecf01f66f0 0x7fecf01f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fecf00cf860 con 0x7fecf01f66f0 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fecf00cf6e0 con 0x7fecf00b5770 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fecf00cf9e0 con 0x7fecd4004810 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecf01f66f0 0x7fecf01f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecefe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecd4004810 0x7fecf013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecefe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecd4004810 0x7fecf013a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:50006/0 (socket says 172.21.15.44:50006) 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecf01f66f0 0x7fecf01f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58620/0 (socket says 172.21.15.44:58620) 2024-09-17T05:40:28.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecefe00640 1 -- 172.21.15.44:0/3860787825 learned_addr learned my addr 172.21.15.44:0/3860787825 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fece7400640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf00b5770 0x7fecf013d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 -- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecd4004810 msgr2=0x7fecf013a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecd4004810 0x7fecf013a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 -- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf00b5770 msgr2=0x7fecf013d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf00b5770 0x7fecf013d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 -- 172.21.15.44:0/3860787825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf0154620 con 0x7fecf01f66f0 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecefe00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecd4004810 0x7fecf013a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf4a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecf01f66f0 0x7fecf01f6b00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fecf01600b0 tx=0x7fece80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fececc00640 1 -- 172.21.15.44:0/3860787825 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8011870 con 0x7fecf01f66f0 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fececc00640 1 -- 172.21.15.44:0/3860787825 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fece8017070 con 0x7fecf01f66f0 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf0139d20 con 0x7fecf01f66f0 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fececc00640 1 -- 172.21.15.44:0/3860787825 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8011d20 con 0x7fecf01f66f0 2024-09-17T05:40:28.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf013a2e0 con 0x7fecf01f66f0 2024-09-17T05:40:28.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.012+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf015d440 con 0x7fecf01f66f0 2024-09-17T05:40:28.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.016+0000 7fececc00640 1 -- 172.21.15.44:0/3860787825 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fece801c460 con 0x7fecf01f66f0 2024-09-17T05:40:28.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.016+0000 7fececc00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feccc073230 0x7feccc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.016+0000 7fececc00640 1 -- 172.21.15.44:0/3860787825 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7fece8094a90 con 0x7fecf01f66f0 2024-09-17T05:40:28.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.016+0000 7fecefe00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feccc073230 0x7feccc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.016+0000 7fecefe00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feccc073230 0x7feccc075740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fece0005bd0 tx=0x7fece00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:28.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.020+0000 7fececc00640 1 -- 172.21.15.44:0/3860787825 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fece805f230 con 0x7fecf01f66f0 2024-09-17T05:40:28.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.192+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fecf01543d0 con 0x7feccc073230 2024-09-17T05:40:28.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.196+0000 7fececc00640 1 -- 172.21.15.44:0/3860787825 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251972 (secure 0 0 0) 0x7fece005e860 con 0x7feccc073230 2024-09-17T05:40:28.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feccc073230 msgr2=0x7feccc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feccc073230 0x7feccc075740 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fece0005bd0 tx=0x7fece00091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecf01f66f0 msgr2=0x7fecf01f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecf01f66f0 0x7fecf01f6b00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fecf01600b0 tx=0x7fece80019c0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 shutdown_connections 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecf01f66f0 0x7fecf01f6b00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feccc073230 0x7feccc075740 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf00b5770 0x7fecf013d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 --2- 172.21.15.44:0/3860787825 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fecd4004810 0x7fecf013a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 >> 172.21.15.44:0/3860787825 conn(0x7fecf00b4240 msgr2=0x7fecf0150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 shutdown_connections 2024-09-17T05:40:28.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.200+0000 7fecf6a00640 1 -- 172.21.15.44:0/3860787825 wait complete. 2024-09-17T05:40:28.222 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-17T05:40:26.325879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253884,"kb_used_data":8520,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720836,"statfs":{"total":773094113280,"available":772834136064,"internally_reserved":0,"allocated":8724480,"data_stored":4576420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002050"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.881021+0000","last_change":"2024-09-17T05:40:18.975938+0000","last_active":"2024-09-17T05:40:20.881021+0000","last_peered":"2024-09-17T05:40:20.881021+0000","last_clean":"2024-09-17T05:40:20.881021+0000","last_became_active":"2024-09-17T05:40:18.974724+0000","last_became_peered":"2024-09-17T05:40:18.974724+0000","last_unstale":"2024-09-17T05:40:20.881021+0000","last_undegraded":"2024-09-17T05:40:20.881021+0000","last_fullsized":"2024-09-17T05:40:20.881021+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:28.159194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963256+0000","last_change":"2024-09-17T05:40:18.972572+0000","last_active":"2024-09-17T05:40:19.963256+0000","last_peered":"2024-09-17T05:40:19.963256+0000","last_clean":"2024-09-17T05:40:19.963256+0000","last_became_active":"2024-09-17T05:40:18.971843+0000","last_became_peered":"2024-09-17T05:40:18.971843+0000","last_unstale":"2024-09-17T05:40:19.963256+0000","last_undegraded":"2024-09-17T05:40:19.963256+0000","last_fullsized":"2024-09-17T05:40:19.963256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:52.967939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963113+0000","last_change":"2024-09-17T05:40:18.963920+0000","last_active":"2024-09-17T05:40:19.963113+0000","last_peered":"2024-09-17T05:40:19.963113+0000","last_clean":"2024-09-17T05:40:19.963113+0000","last_became_active":"2024-09-17T05:40:18.963366+0000","last_became_peered":"2024-09-17T05:40:18.963366+0000","last_unstale":"2024-09-17T05:40:19.963113+0000","last_undegraded":"2024-09-17T05:40:19.963113+0000","last_fullsized":"2024-09-17T05:40:19.963113+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:28.191817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746017+0000","last_change":"2024-09-17T05:40:18.964044+0000","last_active":"2024-09-17T05:40:20.746017+0000","last_peered":"2024-09-17T05:40:20.746017+0000","last_clean":"2024-09-17T05:40:20.746017+0000","last_became_active":"2024-09-17T05:40:18.963750+0000","last_became_peered":"2024-09-17T05:40:18.963750+0000","last_unstale":"2024-09-17T05:40:20.746017+0000","last_undegraded":"2024-09-17T05:40:20.746017+0000","last_fullsized":"2024-09-17T05:40:20.746017+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:14.837382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878318+0000","last_change":"2024-09-17T05:40:18.968256+0000","last_active":"2024-09-17T05:40:20.878318+0000","last_peered":"2024-09-17T05:40:20.878318+0000","last_clean":"2024-09-17T05:40:20.878318+0000","last_became_active":"2024-09-17T05:40:18.967470+0000","last_became_peered":"2024-09-17T05:40:18.967470+0000","last_unstale":"2024-09-17T05:40:20.878318+0000","last_undegraded":"2024-09-17T05:40:20.878318+0000","last_fullsized":"2024-09-17T05:40:20.878318+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:24.741584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965291+0000","last_change":"2024-09-17T05:40:18.967355+0000","last_active":"2024-09-17T05:40:19.965291+0000","last_peered":"2024-09-17T05:40:19.965291+0000","last_clean":"2024-09-17T05:40:19.965291+0000","last_became_active":"2024-09-17T05:40:18.966887+0000","last_became_peered":"2024-09-17T05:40:18.966887+0000","last_unstale":"2024-09-17T05:40:19.965291+0000","last_undegraded":"2024-09-17T05:40:19.965291+0000","last_fullsized":"2024-09-17T05:40:19.965291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745704+0000","last_change":"2024-09-17T05:40:18.968515+0000","last_active":"2024-09-17T05:40:20.745704+0000","last_peered":"2024-09-17T05:40:20.745704+0000","last_clean":"2024-09-17T05:40:20.745704+0000","last_became_active":"2024-09-17T05:40:18.968183+0000","last_became_peered":"2024-09-17T05:40:18.968183+0000","last_unstale":"2024-09-17T05:40:20.745704+0000","last_undegraded":"2024-09-17T05:40:20.745704+0000","last_fullsized":"2024-09-17T05:40:20.745704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:21.966993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960842+0000","last_change":"2024-09-17T05:40:18.959333+0000","last_active":"2024-09-17T05:40:19.960842+0000","last_peered":"2024-09-17T05:40:19.960842+0000","last_clean":"2024-09-17T05:40:19.960842+0000","last_became_active":"2024-09-17T05:40:18.959011+0000","last_became_peered":"2024-09-17T05:40:18.959011+0000","last_unstale":"2024-09-17T05:40:19.960842+0000","last_undegraded":"2024-09-17T05:40:19.960842+0000","last_fullsized":"2024-09-17T05:40:19.960842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746482+0000","last_change":"2024-09-17T05:40:18.969295+0000","last_active":"2024-09-17T05:40:20.746482+0000","last_peered":"2024-09-17T05:40:20.746482+0000","last_clean":"2024-09-17T05:40:20.746482+0000","last_became_active":"2024-09-17T05:40:18.968254+0000","last_became_peered":"2024-09-17T05:40:18.968254+0000","last_unstale":"2024-09-17T05:40:20.746482+0000","last_undegraded":"2024-09-17T05:40:20.746482+0000","last_fullsized":"2024-09-17T05:40:20.746482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:59.007984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880679+0000","last_change":"2024-09-17T05:40:18.963445+0000","last_active":"2024-09-17T05:40:20.880679+0000","last_peered":"2024-09-17T05:40:20.880679+0000","last_clean":"2024-09-17T05:40:20.880679+0000","last_became_active":"2024-09-17T05:40:18.963109+0000","last_became_peered":"2024-09-17T05:40:18.963109+0000","last_unstale":"2024-09-17T05:40:20.880679+0000","last_undegraded":"2024-09-17T05:40:20.880679+0000","last_fullsized":"2024-09-17T05:40:20.880679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:27.338578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963236+0000","last_change":"2024-09-17T05:40:18.972852+0000","last_active":"2024-09-17T05:40:19.963236+0000","last_peered":"2024-09-17T05:40:19.963236+0000","last_clean":"2024-09-17T05:40:19.963236+0000","last_became_active":"2024-09-17T05:40:18.970733+0000","last_became_peered":"2024-09-17T05:40:18.970733+0000","last_unstale":"2024-09-17T05:40:19.963236+0000","last_undegraded":"2024-09-17T05:40:19.963236+0000","last_fullsized":"2024-09-17T05:40:19.963236+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:10.690775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961968+0000","last_change":"2024-09-17T05:40:18.963052+0000","last_active":"2024-09-17T05:40:19.961968+0000","last_peered":"2024-09-17T05:40:19.961968+0000","last_clean":"2024-09-17T05:40:19.961968+0000","last_became_active":"2024-09-17T05:40:18.962788+0000","last_became_peered":"2024-09-17T05:40:18.962788+0000","last_unstale":"2024-09-17T05:40:19.961968+0000","last_undegraded":"2024-09-17T05:40:19.961968+0000","last_fullsized":"2024-09-17T05:40:19.961968+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:56.383960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962799+0000","last_change":"2024-09-17T05:40:18.978158+0000","last_active":"2024-09-17T05:40:19.962799+0000","last_peered":"2024-09-17T05:40:19.962799+0000","last_clean":"2024-09-17T05:40:19.962799+0000","last_became_active":"2024-09-17T05:40:18.977779+0000","last_became_peered":"2024-09-17T05:40:18.977779+0000","last_unstale":"2024-09-17T05:40:19.962799+0000","last_undegraded":"2024-09-17T05:40:19.962799+0000","last_fullsized":"2024-09-17T05:40:19.962799+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:18.183799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960902+0000","last_change":"2024-09-17T05:40:18.962572+0000","last_active":"2024-09-17T05:40:19.960902+0000","last_peered":"2024-09-17T05:40:19.960902+0000","last_clean":"2024-09-17T05:40:19.960902+0000","last_became_active":"2024-09-17T05:40:18.961900+0000","last_became_peered":"2024-09-17T05:40:18.961900+0000","last_unstale":"2024-09-17T05:40:19.960902+0000","last_undegraded":"2024-09-17T05:40:19.960902+0000","last_fullsized":"2024-09-17T05:40:19.960902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877975+0000","last_change":"2024-09-17T05:40:18.978496+0000","last_active":"2024-09-17T05:40:20.877975+0000","last_peered":"2024-09-17T05:40:20.877975+0000","last_clean":"2024-09-17T05:40:20.877975+0000","last_became_active":"2024-09-17T05:40:18.978005+0000","last_became_peered":"2024-09-17T05:40:18.978005+0000","last_unstale":"2024-09-17T05:40:20.877975+0000","last_undegraded":"2024-09-17T05:40:20.877975+0000","last_fullsized":"2024-09-17T05:40:20.877975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:36.509694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745632+0000","last_change":"2024-09-17T05:40:18.965425+0000","last_active":"2024-09-17T05:40:20.745632+0000","last_peered":"2024-09-17T05:40:20.745632+0000","last_clean":"2024-09-17T05:40:20.745632+0000","last_became_active":"2024-09-17T05:40:18.965158+0000","last_became_peered":"2024-09-17T05:40:18.965158+0000","last_unstale":"2024-09-17T05:40:20.745632+0000","last_undegraded":"2024-09-17T05:40:20.745632+0000","last_fullsized":"2024-09-17T05:40:20.745632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:05.487453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961571+0000","last_change":"2024-09-17T05:40:18.976391+0000","last_active":"2024-09-17T05:40:19.961571+0000","last_peered":"2024-09-17T05:40:19.961571+0000","last_clean":"2024-09-17T05:40:19.961571+0000","last_became_active":"2024-09-17T05:40:18.974193+0000","last_became_peered":"2024-09-17T05:40:18.974193+0000","last_unstale":"2024-09-17T05:40:19.961571+0000","last_undegraded":"2024-09-17T05:40:19.961571+0000","last_fullsized":"2024-09-17T05:40:19.961571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963256+0000","last_change":"2024-09-17T05:40:18.973241+0000","last_active":"2024-09-17T05:40:19.963256+0000","last_peered":"2024-09-17T05:40:19.963256+0000","last_clean":"2024-09-17T05:40:19.963256+0000","last_became_active":"2024-09-17T05:40:18.970058+0000","last_became_peered":"2024-09-17T05:40:18.970058+0000","last_unstale":"2024-09-17T05:40:19.963256+0000","last_undegraded":"2024-09-17T05:40:19.963256+0000","last_fullsized":"2024-09-17T05:40:19.963256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:34:31.266739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961756+0000","last_change":"2024-09-17T05:40:18.962751+0000","last_active":"2024-09-17T05:40:19.961756+0000","last_peered":"2024-09-17T05:40:19.961756+0000","last_clean":"2024-09-17T05:40:19.961756+0000","last_became_active":"2024-09-17T05:40:18.962431+0000","last_became_peered":"2024-09-17T05:40:18.962431+0000","last_unstale":"2024-09-17T05:40:19.961756+0000","last_undegraded":"2024-09-17T05:40:19.961756+0000","last_fullsized":"2024-09-17T05:40:19.961756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:17.076796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965677+0000","last_change":"2024-09-17T05:40:18.973187+0000","last_active":"2024-09-17T05:40:19.965677+0000","last_peered":"2024-09-17T05:40:19.965677+0000","last_clean":"2024-09-17T05:40:19.965677+0000","last_became_active":"2024-09-17T05:40:18.972583+0000","last_became_peered":"2024-09-17T05:40:18.972583+0000","last_unstale":"2024-09-17T05:40:19.965677+0000","last_undegraded":"2024-09-17T05:40:19.965677+0000","last_fullsized":"2024-09-17T05:40:19.965677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:55:10.548067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961966+0000","last_change":"2024-09-17T05:40:18.953388+0000","last_active":"2024-09-17T05:40:19.961966+0000","last_peered":"2024-09-17T05:40:19.961966+0000","last_clean":"2024-09-17T05:40:19.961966+0000","last_became_active":"2024-09-17T05:40:18.953020+0000","last_became_peered":"2024-09-17T05:40:18.953020+0000","last_unstale":"2024-09-17T05:40:19.961966+0000","last_undegraded":"2024-09-17T05:40:19.961966+0000","last_fullsized":"2024-09-17T05:40:19.961966+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:34.273954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962787+0000","last_change":"2024-09-17T05:40:18.967442+0000","last_active":"2024-09-17T05:40:19.962787+0000","last_peered":"2024-09-17T05:40:19.962787+0000","last_clean":"2024-09-17T05:40:19.962787+0000","last_became_active":"2024-09-17T05:40:18.967058+0000","last_became_peered":"2024-09-17T05:40:18.967058+0000","last_unstale":"2024-09-17T05:40:19.962787+0000","last_undegraded":"2024-09-17T05:40:19.962787+0000","last_fullsized":"2024-09-17T05:40:19.962787+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:18.622862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880403+0000","last_change":"2024-09-17T05:40:18.964476+0000","last_active":"2024-09-17T05:40:20.880403+0000","last_peered":"2024-09-17T05:40:20.880403+0000","last_clean":"2024-09-17T05:40:20.880403+0000","last_became_active":"2024-09-17T05:40:18.961909+0000","last_became_peered":"2024-09-17T05:40:18.961909+0000","last_unstale":"2024-09-17T05:40:20.880403+0000","last_undegraded":"2024-09-17T05:40:20.880403+0000","last_fullsized":"2024-09-17T05:40:20.880403+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:43.786845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962058+0000","last_change":"2024-09-17T05:40:18.978358+0000","last_active":"2024-09-17T05:40:19.962058+0000","last_peered":"2024-09-17T05:40:19.962058+0000","last_clean":"2024-09-17T05:40:19.962058+0000","last_became_active":"2024-09-17T05:40:18.978018+0000","last_became_peered":"2024-09-17T05:40:18.978018+0000","last_unstale":"2024-09-17T05:40:19.962058+0000","last_undegraded":"2024-09-17T05:40:19.962058+0000","last_fullsized":"2024-09-17T05:40:19.962058+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:13.844999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965692+0000","last_change":"2024-09-17T05:40:18.976020+0000","last_active":"2024-09-17T05:40:19.965692+0000","last_peered":"2024-09-17T05:40:19.965692+0000","last_clean":"2024-09-17T05:40:19.965692+0000","last_became_active":"2024-09-17T05:40:18.975685+0000","last_became_peered":"2024-09-17T05:40:18.975685+0000","last_unstale":"2024-09-17T05:40:19.965692+0000","last_undegraded":"2024-09-17T05:40:19.965692+0000","last_fullsized":"2024-09-17T05:40:19.965692+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:21.915494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746347+0000","last_change":"2024-09-17T05:40:18.970329+0000","last_active":"2024-09-17T05:40:20.746347+0000","last_peered":"2024-09-17T05:40:20.746347+0000","last_clean":"2024-09-17T05:40:20.746347+0000","last_became_active":"2024-09-17T05:40:18.970033+0000","last_became_peered":"2024-09-17T05:40:18.970033+0000","last_unstale":"2024-09-17T05:40:20.746347+0000","last_undegraded":"2024-09-17T05:40:20.746347+0000","last_fullsized":"2024-09-17T05:40:20.746347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746067+0000","last_change":"2024-09-17T05:40:18.971355+0000","last_active":"2024-09-17T05:40:20.746067+0000","last_peered":"2024-09-17T05:40:20.746067+0000","last_clean":"2024-09-17T05:40:20.746067+0000","last_became_active":"2024-09-17T05:40:18.971020+0000","last_became_peered":"2024-09-17T05:40:18.971020+0000","last_unstale":"2024-09-17T05:40:20.746067+0000","last_undegraded":"2024-09-17T05:40:20.746067+0000","last_fullsized":"2024-09-17T05:40:20.746067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:44.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878335+0000","last_change":"2024-09-17T05:40:18.973895+0000","last_active":"2024-09-17T05:40:20.878335+0000","last_peered":"2024-09-17T05:40:20.878335+0000","last_clean":"2024-09-17T05:40:20.878335+0000","last_became_active":"2024-09-17T05:40:18.968948+0000","last_became_peered":"2024-09-17T05:40:18.968948+0000","last_unstale":"2024-09-17T05:40:20.878335+0000","last_undegraded":"2024-09-17T05:40:20.878335+0000","last_fullsized":"2024-09-17T05:40:20.878335+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:34.472712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965243+0000","last_change":"2024-09-17T05:40:18.971284+0000","last_active":"2024-09-17T05:40:19.965243+0000","last_peered":"2024-09-17T05:40:19.965243+0000","last_clean":"2024-09-17T05:40:19.965243+0000","last_became_active":"2024-09-17T05:40:18.966667+0000","last_became_peered":"2024-09-17T05:40:18.966667+0000","last_unstale":"2024-09-17T05:40:19.965243+0000","last_undegraded":"2024-09-17T05:40:19.965243+0000","last_fullsized":"2024-09-17T05:40:19.965243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:23.321683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880748+0000","last_change":"2024-09-17T05:40:18.965174+0000","last_active":"2024-09-17T05:40:20.880748+0000","last_peered":"2024-09-17T05:40:20.880748+0000","last_clean":"2024-09-17T05:40:20.880748+0000","last_became_active":"2024-09-17T05:40:18.964778+0000","last_became_peered":"2024-09-17T05:40:18.964778+0000","last_unstale":"2024-09-17T05:40:20.880748+0000","last_undegraded":"2024-09-17T05:40:20.880748+0000","last_fullsized":"2024-09-17T05:40:20.880748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:58.112444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962482+0000","last_change":"2024-09-17T05:40:18.970246+0000","last_active":"2024-09-17T05:40:19.962482+0000","last_peered":"2024-09-17T05:40:19.962482+0000","last_clean":"2024-09-17T05:40:19.962482+0000","last_became_active":"2024-09-17T05:40:18.969884+0000","last_became_peered":"2024-09-17T05:40:18.969884+0000","last_unstale":"2024-09-17T05:40:19.962482+0000","last_undegraded":"2024-09-17T05:40:19.962482+0000","last_fullsized":"2024-09-17T05:40:19.962482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:23.572986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745554+0000","last_change":"2024-09-17T05:40:18.969453+0000","last_active":"2024-09-17T05:40:20.745554+0000","last_peered":"2024-09-17T05:40:20.745554+0000","last_clean":"2024-09-17T05:40:20.745554+0000","last_became_active":"2024-09-17T05:40:18.968764+0000","last_became_peered":"2024-09-17T05:40:18.968764+0000","last_unstale":"2024-09-17T05:40:20.745554+0000","last_undegraded":"2024-09-17T05:40:20.745554+0000","last_fullsized":"2024-09-17T05:40:20.745554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:23.985483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.877960+0000","last_change":"2024-09-17T05:40:18.968303+0000","last_active":"2024-09-17T05:40:20.877960+0000","last_peered":"2024-09-17T05:40:20.877960+0000","last_clean":"2024-09-17T05:40:20.877960+0000","last_became_active":"2024-09-17T05:40:18.967969+0000","last_became_peered":"2024-09-17T05:40:18.967969+0000","last_unstale":"2024-09-17T05:40:20.877960+0000","last_undegraded":"2024-09-17T05:40:20.877960+0000","last_fullsized":"2024-09-17T05:40:20.877960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:06.754367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"76'4","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878733+0000","last_change":"2024-09-17T05:40:17.961361+0000","last_active":"2024-09-17T05:40:20.878733+0000","last_peered":"2024-09-17T05:40:20.878733+0000","last_clean":"2024-09-17T05:40:20.878733+0000","last_became_active":"2024-09-17T05:40:17.960382+0000","last_became_peered":"2024-09-17T05:40:17.960382+0000","last_unstale":"2024-09-17T05:40:20.878733+0000","last_undegraded":"2024-09-17T05:40:20.878733+0000","last_fullsized":"2024-09-17T05:40:20.878733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:14.971857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:18.975317+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:18.975011+0000","last_became_peered":"2024-09-17T05:40:18.975011+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:19.442398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880008+0000","last_change":"2024-09-17T05:40:17.966550+0000","last_active":"2024-09-17T05:40:20.880008+0000","last_peered":"2024-09-17T05:40:20.880008+0000","last_clean":"2024-09-17T05:40:20.880008+0000","last_became_active":"2024-09-17T05:40:17.966232+0000","last_became_peered":"2024-09-17T05:40:17.966232+0000","last_unstale":"2024-09-17T05:40:20.880008+0000","last_undegraded":"2024-09-17T05:40:20.880008+0000","last_fullsized":"2024-09-17T05:40:20.880008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:14.669759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961738+0000","last_change":"2024-09-17T05:40:18.965633+0000","last_active":"2024-09-17T05:40:19.961738+0000","last_peered":"2024-09-17T05:40:19.961738+0000","last_clean":"2024-09-17T05:40:19.961738+0000","last_became_active":"2024-09-17T05:40:18.965055+0000","last_became_peered":"2024-09-17T05:40:18.965055+0000","last_unstale":"2024-09-17T05:40:19.961738+0000","last_undegraded":"2024-09-17T05:40:19.961738+0000","last_fullsized":"2024-09-17T05:40:19.961738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:23.790972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880827+0000","last_change":"2024-09-17T05:40:17.971273+0000","last_active":"2024-09-17T05:40:20.880827+0000","last_peered":"2024-09-17T05:40:20.880827+0000","last_clean":"2024-09-17T05:40:20.880827+0000","last_became_active":"2024-09-17T05:40:17.970885+0000","last_became_peered":"2024-09-17T05:40:17.970885+0000","last_unstale":"2024-09-17T05:40:20.880827+0000","last_undegraded":"2024-09-17T05:40:20.880827+0000","last_fullsized":"2024-09-17T05:40:20.880827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:28.395940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745938+0000","last_change":"2024-09-17T05:40:18.966252+0000","last_active":"2024-09-17T05:40:20.745938+0000","last_peered":"2024-09-17T05:40:20.745938+0000","last_clean":"2024-09-17T05:40:20.745938+0000","last_became_active":"2024-09-17T05:40:18.965843+0000","last_became_peered":"2024-09-17T05:40:18.965843+0000","last_unstale":"2024-09-17T05:40:20.745938+0000","last_undegraded":"2024-09-17T05:40:20.745938+0000","last_fullsized":"2024-09-17T05:40:20.745938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:10.099473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962112+0000","last_change":"2024-09-17T05:40:17.973881+0000","last_active":"2024-09-17T05:40:19.962112+0000","last_peered":"2024-09-17T05:40:19.962112+0000","last_clean":"2024-09-17T05:40:19.962112+0000","last_became_active":"2024-09-17T05:40:17.973539+0000","last_became_peered":"2024-09-17T05:40:17.973539+0000","last_unstale":"2024-09-17T05:40:19.962112+0000","last_undegraded":"2024-09-17T05:40:19.962112+0000","last_fullsized":"2024-09-17T05:40:19.962112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:07.850444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965742+0000","last_change":"2024-09-17T05:40:18.972873+0000","last_active":"2024-09-17T05:40:19.965742+0000","last_peered":"2024-09-17T05:40:19.965742+0000","last_clean":"2024-09-17T05:40:19.965742+0000","last_became_active":"2024-09-17T05:40:18.972156+0000","last_became_peered":"2024-09-17T05:40:18.972156+0000","last_unstale":"2024-09-17T05:40:19.965742+0000","last_undegraded":"2024-09-17T05:40:19.965742+0000","last_fullsized":"2024-09-17T05:40:19.965742+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:13.564993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962371+0000","last_change":"2024-09-17T05:40:17.969993+0000","last_active":"2024-09-17T05:40:19.962371+0000","last_peered":"2024-09-17T05:40:19.962371+0000","last_clean":"2024-09-17T05:40:19.962371+0000","last_became_active":"2024-09-17T05:40:17.969577+0000","last_became_peered":"2024-09-17T05:40:17.969577+0000","last_unstale":"2024-09-17T05:40:19.962371+0000","last_undegraded":"2024-09-17T05:40:19.962371+0000","last_fullsized":"2024-09-17T05:40:19.962371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:46.662803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963500+0000","last_change":"2024-09-17T05:40:18.973334+0000","last_active":"2024-09-17T05:40:19.963500+0000","last_peered":"2024-09-17T05:40:19.963500+0000","last_clean":"2024-09-17T05:40:19.963500+0000","last_became_active":"2024-09-17T05:40:18.971131+0000","last_became_peered":"2024-09-17T05:40:18.971131+0000","last_unstale":"2024-09-17T05:40:19.963500+0000","last_undegraded":"2024-09-17T05:40:19.963500+0000","last_fullsized":"2024-09-17T05:40:19.963500+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:00.092352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879329+0000","last_change":"2024-09-17T05:40:17.972241+0000","last_active":"2024-09-17T05:40:20.879329+0000","last_peered":"2024-09-17T05:40:20.879329+0000","last_clean":"2024-09-17T05:40:20.879329+0000","last_became_active":"2024-09-17T05:40:17.971903+0000","last_became_peered":"2024-09-17T05:40:17.971903+0000","last_unstale":"2024-09-17T05:40:20.879329+0000","last_undegraded":"2024-09-17T05:40:20.879329+0000","last_fullsized":"2024-09-17T05:40:20.879329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:50:53.884124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962234+0000","last_change":"2024-09-17T05:40:18.966028+0000","last_active":"2024-09-17T05:40:19.962234+0000","last_peered":"2024-09-17T05:40:19.962234+0000","last_clean":"2024-09-17T05:40:19.962234+0000","last_became_active":"2024-09-17T05:40:18.965683+0000","last_became_peered":"2024-09-17T05:40:18.965683+0000","last_unstale":"2024-09-17T05:40:19.962234+0000","last_undegraded":"2024-09-17T05:40:19.962234+0000","last_fullsized":"2024-09-17T05:40:19.962234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961382+0000","last_change":"2024-09-17T05:40:17.966777+0000","last_active":"2024-09-17T05:40:19.961382+0000","last_peered":"2024-09-17T05:40:19.961382+0000","last_clean":"2024-09-17T05:40:19.961382+0000","last_became_active":"2024-09-17T05:40:17.966414+0000","last_became_peered":"2024-09-17T05:40:17.966414+0000","last_unstale":"2024-09-17T05:40:19.961382+0000","last_undegraded":"2024-09-17T05:40:19.961382+0000","last_fullsized":"2024-09-17T05:40:19.961382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:44.209477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880088+0000","last_change":"2024-09-17T05:40:18.969318+0000","last_active":"2024-09-17T05:40:20.880088+0000","last_peered":"2024-09-17T05:40:20.880088+0000","last_clean":"2024-09-17T05:40:20.880088+0000","last_became_active":"2024-09-17T05:40:18.968996+0000","last_became_peered":"2024-09-17T05:40:18.968996+0000","last_unstale":"2024-09-17T05:40:20.880088+0000","last_undegraded":"2024-09-17T05:40:20.880088+0000","last_fullsized":"2024-09-17T05:40:20.880088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:49.154860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962249+0000","last_change":"2024-09-17T05:40:17.959870+0000","last_active":"2024-09-17T05:40:19.962249+0000","last_peered":"2024-09-17T05:40:19.962249+0000","last_clean":"2024-09-17T05:40:19.962249+0000","last_became_active":"2024-09-17T05:40:17.959110+0000","last_became_peered":"2024-09-17T05:40:17.959110+0000","last_unstale":"2024-09-17T05:40:19.962249+0000","last_undegraded":"2024-09-17T05:40:19.962249+0000","last_fullsized":"2024-09-17T05:40:19.962249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:56.467002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962143+0000","last_change":"2024-09-17T05:40:18.964351+0000","last_active":"2024-09-17T05:40:19.962143+0000","last_peered":"2024-09-17T05:40:19.962143+0000","last_clean":"2024-09-17T05:40:19.962143+0000","last_became_active":"2024-09-17T05:40:18.963996+0000","last_became_peered":"2024-09-17T05:40:18.963996+0000","last_unstale":"2024-09-17T05:40:19.962143+0000","last_undegraded":"2024-09-17T05:40:19.962143+0000","last_fullsized":"2024-09-17T05:40:19.962143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:45.388632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746438+0000","last_change":"2024-09-17T05:40:17.965056+0000","last_active":"2024-09-17T05:40:20.746438+0000","last_peered":"2024-09-17T05:40:20.746438+0000","last_clean":"2024-09-17T05:40:20.746438+0000","last_became_active":"2024-09-17T05:40:17.964655+0000","last_became_peered":"2024-09-17T05:40:17.964655+0000","last_unstale":"2024-09-17T05:40:20.746438+0000","last_undegraded":"2024-09-17T05:40:20.746438+0000","last_fullsized":"2024-09-17T05:40:20.746438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:35.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961796+0000","last_change":"2024-09-17T05:40:18.957254+0000","last_active":"2024-09-17T05:40:19.961796+0000","last_peered":"2024-09-17T05:40:19.961796+0000","last_clean":"2024-09-17T05:40:19.961796+0000","last_became_active":"2024-09-17T05:40:18.956903+0000","last_became_peered":"2024-09-17T05:40:18.956903+0000","last_unstale":"2024-09-17T05:40:19.961796+0000","last_undegraded":"2024-09-17T05:40:19.961796+0000","last_fullsized":"2024-09-17T05:40:19.961796+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:04.217703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880695+0000","last_change":"2024-09-17T05:40:17.965827+0000","last_active":"2024-09-17T05:40:20.880695+0000","last_peered":"2024-09-17T05:40:20.880695+0000","last_clean":"2024-09-17T05:40:20.880695+0000","last_became_active":"2024-09-17T05:40:17.962330+0000","last_became_peered":"2024-09-17T05:40:17.962330+0000","last_unstale":"2024-09-17T05:40:20.880695+0000","last_undegraded":"2024-09-17T05:40:20.880695+0000","last_fullsized":"2024-09-17T05:40:20.880695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:15.809852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961491+0000","last_change":"2024-09-17T05:40:18.972381+0000","last_active":"2024-09-17T05:40:19.961491+0000","last_peered":"2024-09-17T05:40:19.961491+0000","last_clean":"2024-09-17T05:40:19.961491+0000","last_became_active":"2024-09-17T05:40:18.972050+0000","last_became_peered":"2024-09-17T05:40:18.972050+0000","last_unstale":"2024-09-17T05:40:19.961491+0000","last_undegraded":"2024-09-17T05:40:19.961491+0000","last_fullsized":"2024-09-17T05:40:19.961491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:00.915234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"76'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965153+0000","last_change":"2024-09-17T05:40:17.971063+0000","last_active":"2024-09-17T05:40:19.965153+0000","last_peered":"2024-09-17T05:40:19.965153+0000","last_clean":"2024-09-17T05:40:19.965153+0000","last_became_active":"2024-09-17T05:40:17.970390+0000","last_became_peered":"2024-09-17T05:40:17.970390+0000","last_unstale":"2024-09-17T05:40:19.965153+0000","last_undegraded":"2024-09-17T05:40:19.965153+0000","last_fullsized":"2024-09-17T05:40:19.965153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:24.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965290+0000","last_change":"2024-09-17T05:40:18.965052+0000","last_active":"2024-09-17T05:40:19.965290+0000","last_peered":"2024-09-17T05:40:19.965290+0000","last_clean":"2024-09-17T05:40:19.965290+0000","last_became_active":"2024-09-17T05:40:18.964428+0000","last_became_peered":"2024-09-17T05:40:18.964428+0000","last_unstale":"2024-09-17T05:40:19.965290+0000","last_undegraded":"2024-09-17T05:40:19.965290+0000","last_fullsized":"2024-09-17T05:40:19.965290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:12.516191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"76'6","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879706+0000","last_change":"2024-09-17T05:40:17.975190+0000","last_active":"2024-09-17T05:40:20.879706+0000","last_peered":"2024-09-17T05:40:20.879706+0000","last_clean":"2024-09-17T05:40:20.879706+0000","last_became_active":"2024-09-17T05:40:17.974679+0000","last_became_peered":"2024-09-17T05:40:17.974679+0000","last_unstale":"2024-09-17T05:40:20.879706+0000","last_undegraded":"2024-09-17T05:40:20.879706+0000","last_fullsized":"2024-09-17T05:40:20.879706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:56.674619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746000+0000","last_change":"2024-09-17T05:40:18.968708+0000","last_active":"2024-09-17T05:40:20.746000+0000","last_peered":"2024-09-17T05:40:20.746000+0000","last_clean":"2024-09-17T05:40:20.746000+0000","last_became_active":"2024-09-17T05:40:18.968273+0000","last_became_peered":"2024-09-17T05:40:18.968273+0000","last_unstale":"2024-09-17T05:40:20.746000+0000","last_undegraded":"2024-09-17T05:40:20.746000+0000","last_fullsized":"2024-09-17T05:40:20.746000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:11.746260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880446+0000","last_change":"2024-09-17T05:40:17.970784+0000","last_active":"2024-09-17T05:40:20.880446+0000","last_peered":"2024-09-17T05:40:20.880446+0000","last_clean":"2024-09-17T05:40:20.880446+0000","last_became_active":"2024-09-17T05:40:17.970430+0000","last_became_peered":"2024-09-17T05:40:17.970430+0000","last_unstale":"2024-09-17T05:40:20.880446+0000","last_undegraded":"2024-09-17T05:40:20.880446+0000","last_fullsized":"2024-09-17T05:40:20.880446+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:40.544858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880886+0000","last_change":"2024-09-17T05:40:18.971140+0000","last_active":"2024-09-17T05:40:20.880886+0000","last_peered":"2024-09-17T05:40:20.880886+0000","last_clean":"2024-09-17T05:40:20.880886+0000","last_became_active":"2024-09-17T05:40:18.970843+0000","last_became_peered":"2024-09-17T05:40:18.970843+0000","last_unstale":"2024-09-17T05:40:20.880886+0000","last_undegraded":"2024-09-17T05:40:20.880886+0000","last_fullsized":"2024-09-17T05:40:20.880886+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:49.607280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961919+0000","last_change":"2024-09-17T05:40:17.973356+0000","last_active":"2024-09-17T05:40:19.961919+0000","last_peered":"2024-09-17T05:40:19.961919+0000","last_clean":"2024-09-17T05:40:19.961919+0000","last_became_active":"2024-09-17T05:40:17.973013+0000","last_became_peered":"2024-09-17T05:40:17.973013+0000","last_unstale":"2024-09-17T05:40:19.961919+0000","last_undegraded":"2024-09-17T05:40:19.961919+0000","last_fullsized":"2024-09-17T05:40:19.961919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:10.738755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962312+0000","last_change":"2024-09-17T05:40:18.970497+0000","last_active":"2024-09-17T05:40:19.962312+0000","last_peered":"2024-09-17T05:40:19.962312+0000","last_clean":"2024-09-17T05:40:19.962312+0000","last_became_active":"2024-09-17T05:40:18.970209+0000","last_became_peered":"2024-09-17T05:40:18.970209+0000","last_unstale":"2024-09-17T05:40:19.962312+0000","last_undegraded":"2024-09-17T05:40:19.962312+0000","last_fullsized":"2024-09-17T05:40:19.962312+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:30.685862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878119+0000","last_change":"2024-09-17T05:40:17.959159+0000","last_active":"2024-09-17T05:40:20.878119+0000","last_peered":"2024-09-17T05:40:20.878119+0000","last_clean":"2024-09-17T05:40:20.878119+0000","last_became_active":"2024-09-17T05:40:17.958789+0000","last_became_peered":"2024-09-17T05:40:17.958789+0000","last_unstale":"2024-09-17T05:40:20.878119+0000","last_undegraded":"2024-09-17T05:40:20.878119+0000","last_fullsized":"2024-09-17T05:40:20.878119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:58.233971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880871+0000","last_change":"2024-09-17T05:40:18.969090+0000","last_active":"2024-09-17T05:40:20.880871+0000","last_peered":"2024-09-17T05:40:20.880871+0000","last_clean":"2024-09-17T05:40:20.880871+0000","last_became_active":"2024-09-17T05:40:18.968784+0000","last_became_peered":"2024-09-17T05:40:18.968784+0000","last_unstale":"2024-09-17T05:40:20.880871+0000","last_undegraded":"2024-09-17T05:40:20.880871+0000","last_fullsized":"2024-09-17T05:40:20.880871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.582695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"76'8","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965006+0000","last_change":"2024-09-17T05:40:17.965172+0000","last_active":"2024-09-17T05:40:19.965006+0000","last_peered":"2024-09-17T05:40:19.965006+0000","last_clean":"2024-09-17T05:40:19.965006+0000","last_became_active":"2024-09-17T05:40:17.964923+0000","last_became_peered":"2024-09-17T05:40:17.964923+0000","last_unstale":"2024-09-17T05:40:19.965006+0000","last_undegraded":"2024-09-17T05:40:19.965006+0000","last_fullsized":"2024-09-17T05:40:19.965006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:24.487199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878121+0000","last_change":"2024-09-17T05:40:18.978887+0000","last_active":"2024-09-17T05:40:20.878121+0000","last_peered":"2024-09-17T05:40:20.878121+0000","last_clean":"2024-09-17T05:40:20.878121+0000","last_became_active":"2024-09-17T05:40:18.978477+0000","last_became_peered":"2024-09-17T05:40:18.978477+0000","last_unstale":"2024-09-17T05:40:20.878121+0000","last_undegraded":"2024-09-17T05:40:20.878121+0000","last_fullsized":"2024-09-17T05:40:20.878121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:55.261474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746530+0000","last_change":"2024-09-17T05:40:17.972337+0000","last_active":"2024-09-17T05:40:20.746530+0000","last_peered":"2024-09-17T05:40:20.746530+0000","last_clean":"2024-09-17T05:40:20.746530+0000","last_became_active":"2024-09-17T05:40:17.971336+0000","last_became_peered":"2024-09-17T05:40:17.971336+0000","last_unstale":"2024-09-17T05:40:20.746530+0000","last_undegraded":"2024-09-17T05:40:20.746530+0000","last_fullsized":"2024-09-17T05:40:20.746530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:18.434892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962728+0000","last_change":"2024-09-17T05:40:18.968306+0000","last_active":"2024-09-17T05:40:19.962728+0000","last_peered":"2024-09-17T05:40:19.962728+0000","last_clean":"2024-09-17T05:40:19.962728+0000","last_became_active":"2024-09-17T05:40:18.967891+0000","last_became_peered":"2024-09-17T05:40:18.967891+0000","last_unstale":"2024-09-17T05:40:19.962728+0000","last_undegraded":"2024-09-17T05:40:19.962728+0000","last_fullsized":"2024-09-17T05:40:19.962728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:39.803397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746356+0000","last_change":"2024-09-17T05:40:17.965044+0000","last_active":"2024-09-17T05:40:20.746356+0000","last_peered":"2024-09-17T05:40:20.746356+0000","last_clean":"2024-09-17T05:40:20.746356+0000","last_became_active":"2024-09-17T05:40:17.964741+0000","last_became_peered":"2024-09-17T05:40:17.964741+0000","last_unstale":"2024-09-17T05:40:20.746356+0000","last_undegraded":"2024-09-17T05:40:20.746356+0000","last_fullsized":"2024-09-17T05:40:20.746356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:52.300156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961079+0000","last_change":"2024-09-17T05:40:18.964400+0000","last_active":"2024-09-17T05:40:19.961079+0000","last_peered":"2024-09-17T05:40:19.961079+0000","last_clean":"2024-09-17T05:40:19.961079+0000","last_became_active":"2024-09-17T05:40:18.964075+0000","last_became_peered":"2024-09-17T05:40:18.964075+0000","last_unstale":"2024-09-17T05:40:19.961079+0000","last_undegraded":"2024-09-17T05:40:19.961079+0000","last_fullsized":"2024-09-17T05:40:19.961079+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:34.649446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"76'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878634+0000","last_change":"2024-09-17T05:40:17.967952+0000","last_active":"2024-09-17T05:40:20.878634+0000","last_peered":"2024-09-17T05:40:20.878634+0000","last_clean":"2024-09-17T05:40:20.878634+0000","last_became_active":"2024-09-17T05:40:17.967598+0000","last_became_peered":"2024-09-17T05:40:17.967598+0000","last_unstale":"2024-09-17T05:40:20.878634+0000","last_undegraded":"2024-09-17T05:40:20.878634+0000","last_fullsized":"2024-09-17T05:40:20.878634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:19.550729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878198+0000","last_change":"2024-09-17T05:40:18.975785+0000","last_active":"2024-09-17T05:40:20.878198+0000","last_peered":"2024-09-17T05:40:20.878198+0000","last_clean":"2024-09-17T05:40:20.878198+0000","last_became_active":"2024-09-17T05:40:18.967877+0000","last_became_peered":"2024-09-17T05:40:18.967877+0000","last_unstale":"2024-09-17T05:40:20.878198+0000","last_undegraded":"2024-09-17T05:40:20.878198+0000","last_fullsized":"2024-09-17T05:40:20.878198+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:02.537983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878483+0000","last_change":"2024-09-17T05:40:17.969484+0000","last_active":"2024-09-17T05:40:20.878483+0000","last_peered":"2024-09-17T05:40:20.878483+0000","last_clean":"2024-09-17T05:40:20.878483+0000","last_became_active":"2024-09-17T05:40:17.969158+0000","last_became_peered":"2024-09-17T05:40:17.969158+0000","last_unstale":"2024-09-17T05:40:20.878483+0000","last_undegraded":"2024-09-17T05:40:20.878483+0000","last_fullsized":"2024-09-17T05:40:20.878483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:36.756374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878618+0000","last_change":"2024-09-17T05:40:18.967277+0000","last_active":"2024-09-17T05:40:20.878618+0000","last_peered":"2024-09-17T05:40:20.878618+0000","last_clean":"2024-09-17T05:40:20.878618+0000","last_became_active":"2024-09-17T05:40:18.966960+0000","last_became_peered":"2024-09-17T05:40:18.966960+0000","last_unstale":"2024-09-17T05:40:20.878618+0000","last_undegraded":"2024-09-17T05:40:20.878618+0000","last_fullsized":"2024-09-17T05:40:20.878618+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:35:27.633925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962843+0000","last_change":"2024-09-17T05:40:17.955665+0000","last_active":"2024-09-17T05:40:19.962843+0000","last_peered":"2024-09-17T05:40:19.962843+0000","last_clean":"2024-09-17T05:40:19.962843+0000","last_became_active":"2024-09-17T05:40:17.953041+0000","last_became_peered":"2024-09-17T05:40:17.953041+0000","last_unstale":"2024-09-17T05:40:19.962843+0000","last_undegraded":"2024-09-17T05:40:19.962843+0000","last_fullsized":"2024-09-17T05:40:19.962843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:00.753900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878836+0000","last_change":"2024-09-17T05:40:18.977272+0000","last_active":"2024-09-17T05:40:20.878836+0000","last_peered":"2024-09-17T05:40:20.878836+0000","last_clean":"2024-09-17T05:40:20.878836+0000","last_became_active":"2024-09-17T05:40:18.976916+0000","last_became_peered":"2024-09-17T05:40:18.976916+0000","last_unstale":"2024-09-17T05:40:20.878836+0000","last_undegraded":"2024-09-17T05:40:20.878836+0000","last_fullsized":"2024-09-17T05:40:20.878836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:42.993651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.960931+0000","last_change":"2024-09-17T05:40:17.961323+0000","last_active":"2024-09-17T05:40:19.960931+0000","last_peered":"2024-09-17T05:40:19.960931+0000","last_clean":"2024-09-17T05:40:19.960931+0000","last_became_active":"2024-09-17T05:40:17.961012+0000","last_became_peered":"2024-09-17T05:40:17.961012+0000","last_unstale":"2024-09-17T05:40:19.960931+0000","last_undegraded":"2024-09-17T05:40:19.960931+0000","last_fullsized":"2024-09-17T05:40:19.960931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:31.323376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880144+0000","last_change":"2024-09-17T05:40:18.976598+0000","last_active":"2024-09-17T05:40:20.880144+0000","last_peered":"2024-09-17T05:40:20.880144+0000","last_clean":"2024-09-17T05:40:20.880144+0000","last_became_active":"2024-09-17T05:40:18.976246+0000","last_became_peered":"2024-09-17T05:40:18.976246+0000","last_unstale":"2024-09-17T05:40:20.880144+0000","last_undegraded":"2024-09-17T05:40:20.880144+0000","last_fullsized":"2024-09-17T05:40:20.880144+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:50.563559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962333+0000","last_change":"2024-09-17T05:40:17.962804+0000","last_active":"2024-09-17T05:40:19.962333+0000","last_peered":"2024-09-17T05:40:19.962333+0000","last_clean":"2024-09-17T05:40:19.962333+0000","last_became_active":"2024-09-17T05:40:17.962441+0000","last_became_peered":"2024-09-17T05:40:17.962441+0000","last_unstale":"2024-09-17T05:40:19.962333+0000","last_undegraded":"2024-09-17T05:40:19.962333+0000","last_fullsized":"2024-09-17T05:40:19.962333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:18.623325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745945+0000","last_change":"2024-09-17T05:40:18.964746+0000","last_active":"2024-09-17T05:40:20.745945+0000","last_peered":"2024-09-17T05:40:20.745945+0000","last_clean":"2024-09-17T05:40:20.745945+0000","last_became_active":"2024-09-17T05:40:18.962288+0000","last_became_peered":"2024-09-17T05:40:18.962288+0000","last_unstale":"2024-09-17T05:40:20.745945+0000","last_undegraded":"2024-09-17T05:40:20.745945+0000","last_fullsized":"2024-09-17T05:40:20.745945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:55.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"76'2","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880970+0000","last_change":"2024-09-17T05:40:17.958259+0000","last_active":"2024-09-17T05:40:20.880970+0000","last_peered":"2024-09-17T05:40:20.880970+0000","last_clean":"2024-09-17T05:40:20.880970+0000","last_became_active":"2024-09-17T05:40:17.956752+0000","last_became_peered":"2024-09-17T05:40:17.956752+0000","last_unstale":"2024-09-17T05:40:20.880970+0000","last_undegraded":"2024-09-17T05:40:20.880970+0000","last_fullsized":"2024-09-17T05:40:20.880970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:59:54.253968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880734+0000","last_change":"2024-09-17T05:40:18.967915+0000","last_active":"2024-09-17T05:40:20.880734+0000","last_peered":"2024-09-17T05:40:20.880734+0000","last_clean":"2024-09-17T05:40:20.880734+0000","last_became_active":"2024-09-17T05:40:18.967620+0000","last_became_peered":"2024-09-17T05:40:18.967620+0000","last_unstale":"2024-09-17T05:40:20.880734+0000","last_undegraded":"2024-09-17T05:40:20.880734+0000","last_fullsized":"2024-09-17T05:40:20.880734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:53.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"77'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.967006+0000","last_change":"2024-09-17T05:40:17.970621+0000","last_active":"2024-09-17T05:40:19.967006+0000","last_peered":"2024-09-17T05:40:19.967006+0000","last_clean":"2024-09-17T05:40:19.967006+0000","last_became_active":"2024-09-17T05:40:17.970196+0000","last_became_peered":"2024-09-17T05:40:17.970196+0000","last_unstale":"2024-09-17T05:40:19.967006+0000","last_undegraded":"2024-09-17T05:40:19.967006+0000","last_fullsized":"2024-09-17T05:40:19.967006+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:07.550401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961767+0000","last_change":"2024-09-17T05:40:18.966610+0000","last_active":"2024-09-17T05:40:19.961767+0000","last_peered":"2024-09-17T05:40:19.961767+0000","last_clean":"2024-09-17T05:40:19.961767+0000","last_became_active":"2024-09-17T05:40:18.966276+0000","last_became_peered":"2024-09-17T05:40:18.966276+0000","last_unstale":"2024-09-17T05:40:19.961767+0000","last_undegraded":"2024-09-17T05:40:19.961767+0000","last_fullsized":"2024-09-17T05:40:19.961767+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:53.342120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.880935+0000","last_change":"2024-09-17T05:40:17.963755+0000","last_active":"2024-09-17T05:40:20.880935+0000","last_peered":"2024-09-17T05:40:20.880935+0000","last_clean":"2024-09-17T05:40:20.880935+0000","last_became_active":"2024-09-17T05:40:17.963439+0000","last_became_peered":"2024-09-17T05:40:17.963439+0000","last_unstale":"2024-09-17T05:40:20.880935+0000","last_undegraded":"2024-09-17T05:40:20.880935+0000","last_fullsized":"2024-09-17T05:40:20.880935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:05.746862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.961385+0000","last_change":"2024-09-17T05:40:18.956932+0000","last_active":"2024-09-17T05:40:19.961385+0000","last_peered":"2024-09-17T05:40:19.961385+0000","last_clean":"2024-09-17T05:40:19.961385+0000","last_became_active":"2024-09-17T05:40:18.956628+0000","last_became_peered":"2024-09-17T05:40:18.956628+0000","last_unstale":"2024-09-17T05:40:19.961385+0000","last_undegraded":"2024-09-17T05:40:19.961385+0000","last_fullsized":"2024-09-17T05:40:19.961385+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746198+0000","last_change":"2024-09-17T05:40:17.963225+0000","last_active":"2024-09-17T05:40:20.746198+0000","last_peered":"2024-09-17T05:40:20.746198+0000","last_clean":"2024-09-17T05:40:20.746198+0000","last_became_active":"2024-09-17T05:40:17.962712+0000","last_became_peered":"2024-09-17T05:40:17.962712+0000","last_unstale":"2024-09-17T05:40:20.746198+0000","last_undegraded":"2024-09-17T05:40:20.746198+0000","last_fullsized":"2024-09-17T05:40:20.746198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:26.824455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962047+0000","last_change":"2024-09-17T05:40:18.966387+0000","last_active":"2024-09-17T05:40:19.962047+0000","last_peered":"2024-09-17T05:40:19.962047+0000","last_clean":"2024-09-17T05:40:19.962047+0000","last_became_active":"2024-09-17T05:40:18.966066+0000","last_became_peered":"2024-09-17T05:40:18.966066+0000","last_unstale":"2024-09-17T05:40:19.962047+0000","last_undegraded":"2024-09-17T05:40:19.962047+0000","last_fullsized":"2024-09-17T05:40:19.962047+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879461+0000","last_change":"2024-09-17T05:40:17.967077+0000","last_active":"2024-09-17T05:40:20.879461+0000","last_peered":"2024-09-17T05:40:20.879461+0000","last_clean":"2024-09-17T05:40:20.879461+0000","last_became_active":"2024-09-17T05:40:17.966350+0000","last_became_peered":"2024-09-17T05:40:17.966350+0000","last_unstale":"2024-09-17T05:40:20.879461+0000","last_undegraded":"2024-09-17T05:40:20.879461+0000","last_fullsized":"2024-09-17T05:40:20.879461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:53.153954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.746326+0000","last_change":"2024-09-17T05:40:18.972375+0000","last_active":"2024-09-17T05:40:20.746326+0000","last_peered":"2024-09-17T05:40:20.746326+0000","last_clean":"2024-09-17T05:40:20.746326+0000","last_became_active":"2024-09-17T05:40:18.972044+0000","last_became_peered":"2024-09-17T05:40:18.972044+0000","last_unstale":"2024-09-17T05:40:20.746326+0000","last_undegraded":"2024-09-17T05:40:20.746326+0000","last_fullsized":"2024-09-17T05:40:20.746326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:45.216982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965453+0000","last_change":"2024-09-17T05:40:17.963155+0000","last_active":"2024-09-17T05:40:19.965453+0000","last_peered":"2024-09-17T05:40:19.965453+0000","last_clean":"2024-09-17T05:40:19.965453+0000","last_became_active":"2024-09-17T05:40:17.962627+0000","last_became_peered":"2024-09-17T05:40:17.962627+0000","last_unstale":"2024-09-17T05:40:19.965453+0000","last_undegraded":"2024-09-17T05:40:19.965453+0000","last_fullsized":"2024-09-17T05:40:19.965453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.151688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.963532+0000","last_change":"2024-09-17T05:40:18.969617+0000","last_active":"2024-09-17T05:40:19.963532+0000","last_peered":"2024-09-17T05:40:19.963532+0000","last_clean":"2024-09-17T05:40:19.963532+0000","last_became_active":"2024-09-17T05:40:18.969296+0000","last_became_peered":"2024-09-17T05:40:18.969296+0000","last_unstale":"2024-09-17T05:40:19.963532+0000","last_undegraded":"2024-09-17T05:40:19.963532+0000","last_fullsized":"2024-09-17T05:40:19.963532+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:15.279292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.745749+0000","last_change":"2024-09-17T05:40:17.963433+0000","last_active":"2024-09-17T05:40:20.745749+0000","last_peered":"2024-09-17T05:40:20.745749+0000","last_clean":"2024-09-17T05:40:20.745749+0000","last_became_active":"2024-09-17T05:40:17.963089+0000","last_became_peered":"2024-09-17T05:40:17.963089+0000","last_unstale":"2024-09-17T05:40:20.745749+0000","last_undegraded":"2024-09-17T05:40:20.745749+0000","last_fullsized":"2024-09-17T05:40:20.745749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:47.055143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.878756+0000","last_change":"2024-09-17T05:40:18.969053+0000","last_active":"2024-09-17T05:40:20.878756+0000","last_peered":"2024-09-17T05:40:20.878756+0000","last_clean":"2024-09-17T05:40:20.878756+0000","last_became_active":"2024-09-17T05:40:18.968741+0000","last_became_peered":"2024-09-17T05:40:18.968741+0000","last_unstale":"2024-09-17T05:40:20.878756+0000","last_undegraded":"2024-09-17T05:40:20.878756+0000","last_fullsized":"2024-09-17T05:40:20.878756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:47.639721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.962377+0000","last_change":"2024-09-17T05:40:17.955748+0000","last_active":"2024-09-17T05:40:19.962377+0000","last_peered":"2024-09-17T05:40:19.962377+0000","last_clean":"2024-09-17T05:40:19.962377+0000","last_became_active":"2024-09-17T05:40:17.953494+0000","last_became_peered":"2024-09-17T05:40:17.953494+0000","last_unstale":"2024-09-17T05:40:19.962377+0000","last_undegraded":"2024-09-17T05:40:19.962377+0000","last_fullsized":"2024-09-17T05:40:19.962377+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:20.875136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879800+0000","last_change":"2024-09-17T05:40:18.962984+0000","last_active":"2024-09-17T05:40:20.879800+0000","last_peered":"2024-09-17T05:40:20.879800+0000","last_clean":"2024-09-17T05:40:20.879800+0000","last_became_active":"2024-09-17T05:40:18.962658+0000","last_became_peered":"2024-09-17T05:40:18.962658+0000","last_unstale":"2024-09-17T05:40:20.879800+0000","last_undegraded":"2024-09-17T05:40:20.879800+0000","last_fullsized":"2024-09-17T05:40:20.879800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:17.933195+0000","last_clean_scrub_stamp":"2024-09-17T05:40:17.933195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.691731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:19.965293+0000","last_change":"2024-09-17T05:40:17.966745+0000","last_active":"2024-09-17T05:40:19.965293+0000","last_peered":"2024-09-17T05:40:19.965293+0000","last_clean":"2024-09-17T05:40:19.965293+0000","last_became_active":"2024-09-17T05:40:17.966394+0000","last_became_peered":"2024-09-17T05:40:17.966394+0000","last_unstale":"2024-09-17T05:40:19.965293+0000","last_undegraded":"2024-09-17T05:40:19.965293+0000","last_fullsized":"2024-09-17T05:40:19.965293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:40:16.925689+0000","last_clean_scrub_stamp":"2024-09-17T05:40:16.925689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:48.599774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-17T05:40:20.879666+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:40:20.879666+0000","last_peered":"2024-09-17T05:40:20.879666+0000","last_clean":"2024-09-17T05:40:20.879666+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:40:20.879666+0000","last_undegraded":"2024-09-17T05:40:20.879666+0000","last_fullsized":"2024-09-17T05:40:20.879666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":424510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1531904,"data_stored":1014316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":954368,"data_stored":425574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":423858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":1015872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":937984,"data_stored":423880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":942080,"data_stored":424530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:40:28.226 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:40:28.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:40:28.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 -- 172.21.15.44:0/478146823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cf360 msgr2=0x7ff1fc15ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 --2- 172.21.15.44:0/478146823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cf360 0x7ff1fc15ad20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff1e400a950 tx=0x7ff1e401db40 comp rx=0 tx=0).stop 2024-09-17T05:40:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 -- 172.21.15.44:0/478146823 shutdown_connections 2024-09-17T05:40:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 --2- 172.21.15.44:0/478146823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cf360 0x7ff1fc15ad20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 -- 172.21.15.44:0/478146823 >> 172.21.15.44:0/478146823 conn(0x7ff1fc0ccaa0 msgr2=0x7ff1fc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 -- 172.21.15.44:0/478146823 shutdown_connections 2024-09-17T05:40:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 -- 172.21.15.44:0/478146823 wait complete. 2024-09-17T05:40:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 Processor -- start 2024-09-17T05:40:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.428+0000 7ff201c00640 1 -- start start 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cac30 0x7ff1fc0a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1fc0cb040 0x7ff1fc1ee080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1fc0cf360 0x7ff1fc06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc168df0 con 0x7ff1fc0cac30 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc168c70 con 0x7ff1fc0cf360 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff1fc168f70 con 0x7ff1fc0cb040 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cac30 0x7ff1fc0a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cac30 0x7ff1fc0a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58646/0 (socket says 172.21.15.44:58646) 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 -- 172.21.15.44:0/3207999568 learned_addr learned my addr 172.21.15.44:0/3207999568 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1fb400640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1fc0cf360 0x7ff1fc06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1f2000640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1fc0cb040 0x7ff1fc1ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 -- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1fc0cb040 msgr2=0x7ff1fc1ee080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1fc0cb040 0x7ff1fc1ee080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 -- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1fc0cf360 msgr2=0x7ff1fc06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1fc0cf360 0x7ff1fc06fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 -- 172.21.15.44:0/3207999568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1fc09fda0 con 0x7ff1fc0cac30 2024-09-17T05:40:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1faa00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cac30 0x7ff1fc0a0e40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c3f0 tx=0x7ff1ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1f3400640 1 -- 172.21.15.44:0/3207999568 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec0068a0 con 0x7ff1fc0cac30 2024-09-17T05:40:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1f3400640 1 -- 172.21.15.44:0/3207999568 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1ec006b50 con 0x7ff1fc0cac30 2024-09-17T05:40:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc0a0080 con 0x7ff1fc0cac30 2024-09-17T05:40:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff1f3400640 1 -- 172.21.15.44:0/3207999568 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec007020 con 0x7ff1fc0cac30 2024-09-17T05:40:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc0a0640 con 0x7ff1fc0cac30 2024-09-17T05:40:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.432+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1fc0cec50 con 0x7ff1fc0cac30 2024-09-17T05:40:28.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.436+0000 7ff1f3400640 1 -- 172.21.15.44:0/3207999568 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff1ec019020 con 0x7ff1fc0cac30 2024-09-17T05:40:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.436+0000 7ff1f3400640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff1d8073230 0x7ff1d8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.436+0000 7ff1f3400640 1 -- 172.21.15.44:0/3207999568 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7ff1ec093970 con 0x7ff1fc0cac30 2024-09-17T05:40:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.436+0000 7ff1f2000640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff1d8073230 0x7ff1d8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.436+0000 7ff1f2000640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff1d8073230 0x7ff1d8075740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40b0000 tx=0x7ff1e401c380 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:28.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.440+0000 7ff1f3400640 1 -- 172.21.15.44:0/3207999568 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff1ec05e1b0 con 0x7ff1fc0cac30 2024-09-17T05:40:28.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.676+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff1fc0b5f80 con 0x7ff1fc0cac30 2024-09-17T05:40:28.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.680+0000 7ff1f3400640 1 -- 172.21.15.44:0/3207999568 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7ff1ec062be0 con 0x7ff1fc0cac30 2024-09-17T05:40:28.681 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:40:28.681 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:40:28.682 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-09-17T05:40:28.682 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-09-17T05:40:28.682 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:40:28.682 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.680+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff1d8073230 msgr2=0x7ff1d8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.680+0000 7ff201c00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff1d8073230 0x7ff1d8075740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40b0000 tx=0x7ff1e401c380 comp rx=0 tx=0).stop 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.680+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cac30 msgr2=0x7ff1fc0a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.680+0000 7ff201c00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cac30 0x7ff1fc0a0e40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c3f0 tx=0x7ff1ec00c8b0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 shutdown_connections 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff1d8073230 0x7ff1d8075740 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1fc0cf360 0x7ff1fc06fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1fc0cb040 0x7ff1fc1ee080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 --2- 172.21.15.44:0/3207999568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1fc0cac30 0x7ff1fc0a0e40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 >> 172.21.15.44:0/3207999568 conn(0x7ff1fc0ccaa0 msgr2=0x7ff1fc15ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:28.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 shutdown_connections 2024-09-17T05:40:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.684+0000 7ff201c00640 1 -- 172.21.15.44:0/3207999568 wait complete. 2024-09-17T05:40:28.704 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 -- 172.21.15.44:0/4273176476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940d1d00 msgr2=0x7fb9940cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 --2- 172.21.15.44:0/4273176476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940d1d00 0x7fb9940cf070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009840 tx=0x7fb97c01c760 comp rx=0 tx=0).stop 2024-09-17T05:40:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 -- 172.21.15.44:0/4273176476 shutdown_connections 2024-09-17T05:40:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 --2- 172.21.15.44:0/4273176476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940d1d00 0x7fb9940cf070 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 --2- 172.21.15.44:0/4273176476 >> v2:172.21.15.86:3300/0 conn(0x7fb9940d18f0 0x7fb9940b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 -- 172.21.15.44:0/4273176476 >> 172.21.15.44:0/4273176476 conn(0x7fb9940b4240 msgr2=0x7fb9940b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 -- 172.21.15.44:0/4273176476 shutdown_connections 2024-09-17T05:40:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.860+0000 7fb998a00640 1 -- 172.21.15.44:0/4273176476 wait complete. 2024-09-17T05:40:28.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 Processor -- start 2024-09-17T05:40:28.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 -- start start 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940cf5b0 0x7fb9941598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9940d18f0 0x7fb994152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9940d1d00 0x7fb994152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb994169ee0 con 0x7fb9940d1d00 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb994169d60 con 0x7fb9940d18f0 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb998a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb99416a060 con 0x7fb9940cf5b0 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb992800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9940d1d00 0x7fb994152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb992800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9940d1d00 0x7fb994152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50898/0 (socket says 172.21.15.44:50898) 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb992800640 1 -- 172.21.15.44:0/1221731008 learned_addr learned my addr 172.21.15.44:0/1221731008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:28.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb991e00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940cf5b0 0x7fb9941598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb98be00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9940d18f0 0x7fb994152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb992800640 1 -- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940cf5b0 msgr2=0x7fb9941598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb992800640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940cf5b0 0x7fb9941598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb992800640 1 -- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9940d18f0 msgr2=0x7fb994152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.864+0000 7fb992800640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9940d18f0 0x7fb994152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb992800640 1 -- 172.21.15.44:0/1221731008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb994159df0 con 0x7fb9940d1d00 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb98be00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9940d18f0 0x7fb994152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb992800640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9940d1d00 0x7fb994152580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00ca30 tx=0x7fb98c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb98a000640 1 -- 172.21.15.44:0/1221731008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c016020 con 0x7fb9940d1d00 2024-09-17T05:40:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb98a000640 1 -- 172.21.15.44:0/1221731008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb98c00a930 con 0x7fb9940d1d00 2024-09-17T05:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99415def0 con 0x7fb9940d1d00 2024-09-17T05:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb98a000640 1 -- 172.21.15.44:0/1221731008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00adc0 con 0x7fb9940d1d00 2024-09-17T05:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99415e4b0 con 0x7fb9940d1d00 2024-09-17T05:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9940b1be0 con 0x7fb9940d1d00 2024-09-17T05:40:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb98a000640 1 -- 172.21.15.44:0/1221731008 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb98c019020 con 0x7fb9940d1d00 2024-09-17T05:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.868+0000 7fb98a000640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb970073230 0x7fb970075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.872+0000 7fb98a000640 1 -- 172.21.15.44:0/1221731008 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7fb98c0940c0 con 0x7fb9940d1d00 2024-09-17T05:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.872+0000 7fb991e00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb970073230 0x7fb970075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.872+0000 7fb991e00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb970073230 0x7fb970075740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb984009600 tx=0x7fb9840091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:28.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:28.876+0000 7fb98a000640 1 -- 172.21.15.44:0/1221731008 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb98c020030 con 0x7fb9940d1d00 2024-09-17T05:40:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.084+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb99415bf90 con 0x7fb9940d1d00 2024-09-17T05:40:29.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.084+0000 7fb98a000640 1 -- 172.21.15.44:0/1221731008 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5222 (secure 0 0 0) 0x7fb9940cf9c0 con 0x7fb9940d1d00 2024-09-17T05:40:29.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:29.087 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"btime":"2024-09-17T05:40:21:965701+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:40:21.385772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6261":{"gid":6261,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/330558786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":330558786},{"type":"v1","addr":"172.21.15.44:6834","nonce":330558786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6261,"qdb_cluster":[6261]},"id":5}]} 2024-09-17T05:40:29.087 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 46 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb970073230 msgr2=0x7fb970075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb970073230 0x7fb970075740 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb984009600 tx=0x7fb9840091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9940d1d00 msgr2=0x7fb994152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9940d1d00 0x7fb994152580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00ca30 tx=0x7fb98c00cb20 comp rx=0 tx=0).stop 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 shutdown_connections 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9940d1d00 0x7fb994152580 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb970073230 0x7fb970075740 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9940d18f0 0x7fb994152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 --2- 172.21.15.44:0/1221731008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9940cf5b0 0x7fb9941598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 >> 172.21.15.44:0/1221731008 conn(0x7fb9940b4240 msgr2=0x7fb9940b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 shutdown_connections 2024-09-17T05:40:29.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.088+0000 7fb998a00640 1 -- 172.21.15.44:0/1221731008 wait complete. 2024-09-17T05:40:29.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:40:18.372314+0000', 'modified': '2024-09-17T05:40:21.385772+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6261}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6261': {'gid': 6261, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6834/330558786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 330558786}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 330558786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6261, 'qdb_cluster': [6261]} 2024-09-17T05:40:29.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:40:29.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:40:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.672+0000 7f94a1600640 1 -- 172.21.15.44:0/358269148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c06de50 msgr2=0x7f949c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.672+0000 7f94a1600640 1 --2- 172.21.15.44:0/358269148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c06de50 0x7f949c06e260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9484009840 tx=0x7f948401c6b0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.672+0000 7f94a1600640 1 -- 172.21.15.44:0/358269148 shutdown_connections 2024-09-17T05:40:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.672+0000 7f94a1600640 1 --2- 172.21.15.44:0/358269148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c06de50 0x7f949c06e260 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.672+0000 7f94a1600640 1 -- 172.21.15.44:0/358269148 >> 172.21.15.44:0/358269148 conn(0x7f949c0ccaa0 msgr2=0x7f949c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.672+0000 7f94a1600640 1 -- 172.21.15.44:0/358269148 shutdown_connections 2024-09-17T05:40:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.672+0000 7f94a1600640 1 -- 172.21.15.44:0/358269148 wait complete. 2024-09-17T05:40:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 Processor -- start 2024-09-17T05:40:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 -- start start 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f949c06de50 0x7f949c0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c072e50 0x7f949c158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f949c0cb470 0x7f949c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f949c169f20 con 0x7f949c06de50 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f949c169da0 con 0x7f949c072e50 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f94a1600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f949c16a0a0 con 0x7f949c0cb470 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f949aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f949c06de50 0x7f949c0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f949aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f949c06de50 0x7f949c0c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50914/0 (socket says 172.21.15.44:50914) 2024-09-17T05:40:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f949aa00640 1 -- 172.21.15.44:0/491888515 learned_addr learned my addr 172.21.15.44:0/491888515 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f9493e00640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c072e50 0x7f949c158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.676+0000 7f949b400640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f949c0cb470 0x7f949c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f949aa00640 1 -- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f949c0cb470 msgr2=0x7f949c0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f949aa00640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f949c0cb470 0x7f949c0b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f949aa00640 1 -- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c072e50 msgr2=0x7f949c158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f949aa00640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c072e50 0x7f949c158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f949aa00640 1 -- 172.21.15.44:0/491888515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c158780 con 0x7f949c06de50 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f949aa00640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f949c06de50 0x7f949c0c72e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c430 tx=0x7f948c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f9492a00640 1 -- 172.21.15.44:0/491888515 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c017070 con 0x7f949c06de50 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f9492a00640 1 -- 172.21.15.44:0/491888515 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f948c0053c0 con 0x7f949c06de50 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f9492a00640 1 -- 172.21.15.44:0/491888515 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c003860 con 0x7f949c06de50 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949c0c7be0 con 0x7f949c06de50 2024-09-17T05:40:29.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f949c0c81a0 con 0x7f949c06de50 2024-09-17T05:40:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.680+0000 7f9492a00640 1 -- 172.21.15.44:0/491888515 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f948c01a070 con 0x7f949c06de50 2024-09-17T05:40:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f9492a00640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9478073200 0x7f9478075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f9492a00640 1 -- 172.21.15.44:0/491888515 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f948c0937b0 con 0x7f949c06de50 2024-09-17T05:40:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 Processor -- start 2024-09-17T05:40:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f9493e00640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9478073200 0x7f9478075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 -- start start 2024-09-17T05:40:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f9493e00640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9478073200 0x7f9478075710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94840af000 tx=0x7f94840b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d8246a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d824be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6bcca0 0x55c21d825120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c21d6f9410 con 0x55c21d2e3460 2024-09-17T05:40:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c21d636b40 con 0x55c21d6d3950 2024-09-17T05:40:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55c21d625f70 con 0x55c21d6bcca0 2024-09-17T05:40:29.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d8246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d8246a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50928/0 (socket says 172.21.15.44:50928) 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 -- 172.21.15.44:0/3369503179 learned_addr learned my addr 172.21.15.44:0/3369503179 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949b400640 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6bcca0 0x55c21d825120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f9493e00640 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d824be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 -- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6bcca0 msgr2=0x55c21d825120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6bcca0 0x55c21d825120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 -- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 msgr2=0x55c21d824be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d824be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 -- 172.21.15.44:0/3369503179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21d5ed5b0 con 0x55c21d2e3460 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f9493e00640 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d824be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:29.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f949aa00640 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d8246a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f948c005630 tx=0x7f948c05d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d37c7a09d488e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f948b000640 1 -- 172.21.15.44:0/3369503179 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c062a10 con 0x55c21d2e3460 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f948b000640 1 -- 172.21.15.44:0/3369503179 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f948c0678c0 con 0x55c21d2e3460 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f948b000640 1 -- 172.21.15.44:0/3369503179 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c063e00 con 0x55c21d2e3460 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 -- 172.21.15.44:0/3369503179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 msgr2=0x55c21d8246a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.684+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d8246a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f948c005630 tx=0x7f948c05d810 comp rx=0 tx=0).stop 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- 172.21.15.44:0/3369503179 shutdown_connections 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6bcca0 0x55c21d825120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d824be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3369503179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d8246a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- 172.21.15.44:0/3369503179 >> 172.21.15.44:0/3369503179 conn(0x55c21d7a9d90 msgr2=0x55c21d7d9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- 172.21.15.44:0/3369503179 shutdown_connections 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- 172.21.15.44:0/3369503179 wait complete. 2024-09-17T05:40:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- start start 2024-09-17T05:40:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 Processor -- start 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d82b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6bcca0 0x55c21d82be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d82c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c21d5c05f0 con 0x55c21d2e3460 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c21d629d80 con 0x55c21d6bcca0 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55c21d5cc520 con 0x55c21d6d3950 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 10 client.0 _ll_register_callbacks cb 0x55c21d5d0830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d82b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d82b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50938/0 (socket says 172.21.15.44:50938) 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 -- 172.21.15.44:0/2015773654 learned_addr learned my addr 172.21.15.44:0/2015773654 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949b400640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d82c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f9493e00640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6bcca0 0x55c21d82be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 -- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 msgr2=0x55c21d82c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d82c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 -- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6bcca0 msgr2=0x55c21d82be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6bcca0 0x55c21d82be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 -- 172.21.15.44:0/2015773654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21d5c4190 con 0x55c21d2e3460 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949b400640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d82c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f949aa00640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d82b920 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f948c005630 tx=0x7f948c05a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d50d24b74fb24b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f947f400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f947f400640 1 -- 172.21.15.44:0/2015773654 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c062a10 con 0x55c21d2e3460 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f947f400640 1 -- 172.21.15.44:0/2015773654 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f948c0780b0 con 0x55c21d2e3460 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.688+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c21d5be110 con 0x55c21d2e3460 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f947f400640 1 -- 172.21.15.44:0/2015773654 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f948c05d240 con 0x55c21d2e3460 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 10 client.6423 fetch_fsmap learned FSMap version 46 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55c21d6aaf10 con 0x55c21d2e3460 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f947f400640 1 -- 172.21.15.44:0/2015773654 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c21d5be110 con 0x55c21d2e3460 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f947f400640 1 -- 172.21.15.44:0/2015773654 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f948c05d3e0 con 0x55c21d2e3460 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 10 client.6423 fetch_fsmap finished waiting for FSMap version 46 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 10 client.6423 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 20 client.6423 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2c87d0 0x55c21d835d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 4 client.6423 mds_command: new command op to 6261 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:40:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 --> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c21d638a90 con 0x55c21d2c87d0 2024-09-17T05:40:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f9493e00640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2c87d0 0x55c21d835d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f9493e00640 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2c87d0 0x55c21d835d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7eaa1ec7ab241d4 server_cookie=51991af8ef109146 in_seq=0 out_seq=0 2024-09-17T05:40:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f947f400640 10 client.6423 ms_handle_connect on v2:172.21.15.44:6832/330558786 2024-09-17T05:40:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f947f400640 1 -- 172.21.15.44:0/2015773654 <== mds.0 v2:172.21.15.44:6832/330558786 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c21d638a90 con 0x55c21d2c87d0 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f947f400640 10 client.6423 handle_command_reply: tid=0 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 client.6423 shutdown 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 msgr2=0x55c21d82b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d82b920 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f948c005630 tx=0x7f948c05a500 comp rx=0 tx=0).stop 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 shutdown_connections 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2c87d0 0x55c21d835d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d82c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6bcca0 0x55c21d82be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f947f400640 0 client.6423 ms_handle_reset on v2:172.21.15.44:6832/330558786 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 --2- 172.21.15.44:0/2015773654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d2e3460 0x55c21d82b920 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 >> 172.21.15.44:0/2015773654 conn(0x55c21d7a9d90 msgr2=0x55c21d7e0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 shutdown_connections 2024-09-17T05:40:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 1 -- 172.21.15.44:0/2015773654 wait complete. 2024-09-17T05:40:29.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.692+0000 7f94a8e04000 20 client.6423 trim_cache size 0 max 16384 2024-09-17T05:40:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 Processor -- start 2024-09-17T05:40:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 -- start start 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d2e3460 0x55c21d896840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d896d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d8972c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f949c205650 con 0x55c21d6bcca0 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f949c204650 con 0x55c21d6d3950 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.712+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f949c0b51a0 con 0x55c21d2e3460 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d896d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d896d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50954/0 (socket says 172.21.15.44:50954) 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 -- 172.21.15.44:0/3751388096 learned_addr learned my addr 172.21.15.44:0/3751388096 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f949aa00640 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d2e3460 0x55c21d896840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f949b400640 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d8972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 -- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d2e3460 msgr2=0x55c21d896840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d2e3460 0x55c21d896840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 -- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 msgr2=0x55c21d8972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d8972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 -- 172.21.15.44:0/3751388096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21d681db0 con 0x55c21d6bcca0 2024-09-17T05:40:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f9493e00640 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d896d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9484005240 tx=0x7f948401c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb19aa8657b17f33 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f948a600640 1 -- 172.21.15.44:0/3751388096 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484004ba0 con 0x55c21d6bcca0 2024-09-17T05:40:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f948a600640 1 -- 172.21.15.44:0/3751388096 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94840cd030 con 0x55c21d6bcca0 2024-09-17T05:40:29.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f948a600640 1 -- 172.21.15.44:0/3751388096 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94840a6500 con 0x55c21d6bcca0 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 -- 172.21.15.44:0/3751388096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 msgr2=0x55c21d896d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d896d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9484005240 tx=0x7f948401c6b0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 -- 172.21.15.44:0/3751388096 shutdown_connections 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d6d3950 0x55c21d8972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d896d80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 --2- 172.21.15.44:0/3751388096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d2e3460 0x55c21d896840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 -- 172.21.15.44:0/3751388096 >> 172.21.15.44:0/3751388096 conn(0x55c21d7a9d90 msgr2=0x55c21d7d8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 -- 172.21.15.44:0/3751388096 shutdown_connections 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 -- 172.21.15.44:0/3751388096 wait complete. 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 -- start start 2024-09-17T05:40:29.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.716+0000 7f94a8e04000 1 Processor -- start 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d2e3460 0x55c21d89a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d89a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d89ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c21d5cc520 con 0x55c21d6bcca0 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f949c204090 con 0x55c21d2e3460 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55c21d5c05f0 con 0x55c21d6d3950 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 10 client.0 _ll_register_callbacks cb 0x7f9494001f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:29.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d89a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d89a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50962/0 (socket says 172.21.15.44:50962) 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 -- 172.21.15.44:0/4019133571 learned_addr learned my addr 172.21.15.44:0/4019133571 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f949aa00640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d2e3460 0x55c21d89a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f949b400640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d89ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 -- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 msgr2=0x55c21d89ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d89ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 -- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d2e3460 msgr2=0x55c21d89a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d2e3460 0x55c21d89a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 -- 172.21.15.44:0/4019133571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21d5ecab0 con 0x55c21d6bcca0 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f949b400640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d89ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f9493e00640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d89a910 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f948401a2e0 tx=0x7f9484004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b505859ea6fb8230 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 1 -- 172.21.15.44:0/4019133571 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94840d4030 con 0x55c21d6bcca0 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 1 -- 172.21.15.44:0/4019133571 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f9484004020 con 0x55c21d6bcca0 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94840cd030 con 0x55c21d6bcca0 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 1 -- 172.21.15.44:0/4019133571 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f94840df050 con 0x55c21d6bcca0 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 10 client.6429 fetch_fsmap learned FSMap version 46 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55c21d5cb070 con 0x55c21d6bcca0 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 1 -- 172.21.15.44:0/4019133571 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94840cd030 con 0x55c21d6bcca0 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 1 -- 172.21.15.44:0/4019133571 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f94840e2020 con 0x55c21d6bcca0 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 10 client.6429 fetch_fsmap finished waiting for FSMap version 46 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 10 client.6429 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 20 client.6429 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2b6830 0x55c21d856050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 4 client.6429 mds_command: new command op to 6261 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:40:29.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 --> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] -- command(tid 0: {"prefix": "status"}) -- 0x55c21d634540 con 0x55c21d2b6830 2024-09-17T05:40:29.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f949aa00640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2b6830 0x55c21d856050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f949aa00640 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2b6830 0x55c21d856050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b914fd073d973c2 server_cookie=2ffd6e130e963f04 in_seq=0 out_seq=0 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 10 client.6429 ms_handle_connect on v2:172.21.15.44:6832/330558786 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 1 -- 172.21.15.44:0/4019133571 <== mds.0 v2:172.21.15.44:6832/330558786 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55c21d634540 con 0x55c21d2b6830 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 10 client.6429 handle_command_reply: tid=0 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 client.6429 shutdown 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 msgr2=0x55c21d89a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d89a910 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f948401a2e0 tx=0x7f9484004d80 comp rx=0 tx=0).stop 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 shutdown_connections 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:6832/330558786,v1:172.21.15.44:6834/330558786] conn(0x55c21d2b6830 0x55c21d856050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c21d6d3950 0x55c21d89ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c21d6bcca0 0x55c21d89a910 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 --2- 172.21.15.44:0/4019133571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c21d2e3460 0x55c21d89a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 >> 172.21.15.44:0/4019133571 conn(0x55c21d7a9d90 msgr2=0x55c21d7d9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.720+0000 7f947f400640 0 client.6429 ms_handle_reset on v2:172.21.15.44:6832/330558786 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 shutdown_connections 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a8e04000 1 -- 172.21.15.44:0/4019133571 wait complete. 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a8e04000 20 client.6429 trim_cache size 0 max 16384 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:40:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6261, 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 10.770838003, 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 46, 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 77, 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 77, 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 15.200977427 2024-09-17T05:40:29.728 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9478073200 msgr2=0x7f9478075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9478073200 0x7f9478075710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94840af000 tx=0x7f94840b2040 comp rx=0 tx=0).stop 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f949c06de50 msgr2=0x7f949c0c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f949c06de50 0x7f949c0c72e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c430 tx=0x7f948c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 shutdown_connections 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f949c0cb470 0x7f949c0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9478073200 0x7f9478075710 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f949c072e50 0x7f949c158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 --2- 172.21.15.44:0/491888515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f949c06de50 0x7f949c0c72e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 >> 172.21.15.44:0/491888515 conn(0x7f949c0ccaa0 msgr2=0x7f949c070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 shutdown_connections 2024-09-17T05:40:29.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.724+0000 7f94a1600640 1 -- 172.21.15.44:0/491888515 wait complete. 2024-09-17T05:40:29.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.900+0000 7f9117000640 1 -- 172.21.15.44:0/748585373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911006f670 msgr2=0x7f9110144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.900+0000 7f9117000640 1 --2- 172.21.15.44:0/748585373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911006f670 0x7f9110144f20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f911015c960 tx=0x7f90fc01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 -- 172.21.15.44:0/748585373 shutdown_connections 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 --2- 172.21.15.44:0/748585373 >> v2:172.21.15.86:3300/0 conn(0x7f9110160960 0x7f91100cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 --2- 172.21.15.44:0/748585373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f911006f670 0x7f9110144f20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 -- 172.21.15.44:0/748585373 >> 172.21.15.44:0/748585373 conn(0x7f9110073ce0 msgr2=0x7f91100740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 -- 172.21.15.44:0/748585373 shutdown_connections 2024-09-17T05:40:29.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 -- 172.21.15.44:0/748585373 wait complete. 2024-09-17T05:40:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 Processor -- start 2024-09-17T05:40:29.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.904+0000 7f9117000640 1 -- start start 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91101455f0 0x7f9110140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110160960 0x7f911013fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91101407c0 0x7f911006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9110169ba0 con 0x7f91101455f0 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9110169a20 con 0x7f91101407c0 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9110169d20 con 0x7f9110160960 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91101455f0 0x7f9110140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91101455f0 0x7f9110140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50990/0 (socket says 172.21.15.44:50990) 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 -- 172.21.15.44:0/3006693800 learned_addr learned my addr 172.21.15.44:0/3006693800 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:29.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9116600640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91101407c0 0x7f911006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115200640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110160960 0x7f911013fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 -- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110160960 msgr2=0x7f911013fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110160960 0x7f911013fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 -- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91101407c0 msgr2=0x7f911006e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91101407c0 0x7f911006e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 -- 172.21.15.44:0/3006693800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91101576f0 con 0x7f91101455f0 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9115c00640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91101455f0 0x7f9110140ca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f910400c3f0 tx=0x7f910400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f910d600640 1 -- 172.21.15.44:0/3006693800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104017070 con 0x7f91101455f0 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f910d600640 1 -- 172.21.15.44:0/3006693800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91040053c0 con 0x7f91101455f0 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91101579d0 con 0x7f91101455f0 2024-09-17T05:40:29.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f910d600640 1 -- 172.21.15.44:0/3006693800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104003860 con 0x7f91101455f0 2024-09-17T05:40:29.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9110157f90 con 0x7f91101455f0 2024-09-17T05:40:29.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9110144f20 con 0x7f91101455f0 2024-09-17T05:40:29.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.908+0000 7f910d600640 1 -- 172.21.15.44:0/3006693800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f910401a070 con 0x7f91101455f0 2024-09-17T05:40:29.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.912+0000 7f910d600640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f90f0073230 0x7f90f0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:29.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.912+0000 7f910d600640 1 -- 172.21.15.44:0/3006693800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f9104093710 con 0x7f91101455f0 2024-09-17T05:40:29.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.912+0000 7f9115200640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f90f0073230 0x7f90f0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:29.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.912+0000 7f9115200640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f90f0073230 0x7f90f0075740 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0af000 tx=0x7f90fc01b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:29.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:29.916+0000 7f910d600640 1 -- 172.21.15.44:0/3006693800 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9104001090 con 0x7f91101455f0 2024-09-17T05:40:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.128+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9110070490 con 0x7f91101455f0 2024-09-17T05:40:30.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.128+0000 7f910d600640 1 -- 172.21.15.44:0/3006693800 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7f910405e5a0 con 0x7f91101455f0 2024-09-17T05:40:30.131 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:40:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f90f0073230 msgr2=0x7f90f0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f90f0073230 0x7f90f0075740 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0af000 tx=0x7f90fc01b100 comp rx=0 tx=0).stop 2024-09-17T05:40:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91101455f0 msgr2=0x7f9110140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91101455f0 0x7f9110140ca0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f910400c3f0 tx=0x7f910400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:40:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 shutdown_connections 2024-09-17T05:40:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f90f0073230 0x7f90f0075740 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:30.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91101407c0 0x7f911006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9110160960 0x7f911013fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 --2- 172.21.15.44:0/3006693800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91101455f0 0x7f9110140ca0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 >> 172.21.15.44:0/3006693800 conn(0x7f9110073ce0 msgr2=0x7f91101656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 shutdown_connections 2024-09-17T05:40:30.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30.132+0000 7f9117000640 1 -- 172.21.15.44:0/3006693800 wait complete. 2024-09-17T05:40:30.153 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:40:30.153 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:40:30.153 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:40:30.154 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:40:30.154 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:30.154 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:40:30.154 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:40:30.154 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:40:30.154 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:40:30.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.154 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:40:30.165 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:40:30.165 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:40:30.165 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:40:30.165 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.165 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:40:30.165 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:30.166 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42176sec preferred_lft 42176sec 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:40:30.167 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.168 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:40:30.169 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:40:30.170 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:30.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.170 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:40:30.229 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:40:30.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.231 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:40:30.284 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:40:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:40:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:40:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:40:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:40:30.285 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:40:30.285 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:40:30.285 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:40:30.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:40:30.285 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:40:30.286 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:40:30.286 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:40:30.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:40:30.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:40:30.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.428 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:40:30.437 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:40:30.438 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:40:30.438 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:40:30.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.438 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:40:30.499 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:40:30.499 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:30.555 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:40:30.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:40:30.556 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:30.607 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:40:30.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:40:30.708 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:40:30.726 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:40:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:40:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:40:30.727 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:40:30.736 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:40:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:40:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:40:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:40:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:40:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:40:30.737 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:40:30.740 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:40:30.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:30.761 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:40:30.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:40:30.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:40:30.871 INFO:teuthology.orchestra.run.smithi044.stdout:client6298 2024-09-17T05:40:30.872 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:30.872 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:30.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.881 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-09-17T05:40:30.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.939 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-09-17T05:40:30.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:30.994 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-09-17T05:40:31.049 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:40:31.049 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:40:31.049 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:40:31.050 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:40:31.050 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-09-17T05:40:31.050 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:40:31.156 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-17T05:40:31.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:40:31.165 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:31.165 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:31.216 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:31.216 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:31.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 -- 172.21.15.44:0/1221795301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 msgr2=0x7f378c15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 --2- 172.21.15.44:0/1221795301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c15d060 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f378c0744e0 tx=0x7f378401cac0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 -- 172.21.15.44:0/1221795301 shutdown_connections 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 --2- 172.21.15.44:0/1221795301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c15d060 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 --2- 172.21.15.44:0/1221795301 >> v2:172.21.15.86:3300/0 conn(0x7f378c0d1d00 0x7f378c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 -- 172.21.15.44:0/1221795301 >> 172.21.15.44:0/1221795301 conn(0x7f378c0b4240 msgr2=0x7f378c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 -- 172.21.15.44:0/1221795301 shutdown_connections 2024-09-17T05:40:31.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.468+0000 7f3793c00640 1 -- 172.21.15.44:0/1221795301 wait complete. 2024-09-17T05:40:31.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 Processor -- start 2024-09-17T05:40:31.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 -- start start 2024-09-17T05:40:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c1fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f378c0d18f0 0x7f378c156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0d1d00 0x7f378c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f378c169e80 con 0x7f378c0cf5b0 2024-09-17T05:40:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f378c169d00 con 0x7f378c0d1d00 2024-09-17T05:40:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3793c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f378c16a000 con 0x7f378c0d18f0 2024-09-17T05:40:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c1fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c1fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50998/0 (socket says 172.21.15.44:50998) 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 -- 172.21.15.44:0/3820900301 learned_addr learned my addr 172.21.15.44:0/3820900301 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f378be00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f378c0d18f0 0x7f378c156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0d1d00 0x7f378c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 -- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f378c0d18f0 msgr2=0x7f378c156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f378c0d18f0 0x7f378c156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 -- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0d1d00 msgr2=0x7f378c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0d1d00 0x7f378c1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 -- 172.21.15.44:0/3820900301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c1fcf60 con 0x7f378c0cf5b0 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f378be00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f378c0d18f0 0x7f378c156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0d1d00 0x7f378c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.472+0000 7f3791200640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c1fc660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f378000c400 tx=0x7f378000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3788c00640 1 -- 172.21.15.44:0/3820900301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780017070 con 0x7f378c0cf5b0 2024-09-17T05:40:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3788c00640 1 -- 172.21.15.44:0/3820900301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3780003600 con 0x7f378c0cf5b0 2024-09-17T05:40:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3788c00640 1 -- 172.21.15.44:0/3820900301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780003a50 con 0x7f378c0cf5b0 2024-09-17T05:40:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378c1fd240 con 0x7f378c0cf5b0 2024-09-17T05:40:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378c1f9180 con 0x7f378c0cf5b0 2024-09-17T05:40:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378c15d060 con 0x7f378c0cf5b0 2024-09-17T05:40:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3788c00640 1 -- 172.21.15.44:0/3820900301 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f378001a070 con 0x7f378c0cf5b0 2024-09-17T05:40:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3788c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f376c073200 0x7f376c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f3788c00640 1 -- 172.21.15.44:0/3820900301 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f3780093680 con 0x7f378c0cf5b0 2024-09-17T05:40:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.476+0000 7f378be00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f376c073200 0x7f376c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.480+0000 7f378be00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f376c073200 0x7f376c075710 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f378c0cccd0 tx=0x7f3778005ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.484+0000 7f3788c00640 1 -- 172.21.15.44:0/3820900301 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f378c0cf9c0 con 0x7f378c0cf5b0 2024-09-17T05:40:31.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.668+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f378c0d13f0 con 0x7f378c0cf5b0 2024-09-17T05:40:31.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.668+0000 7f3788c00640 1 -- 172.21.15.44:0/3820900301 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v77) ==== 80+0+0 (secure 0 0 0) 0x7f378005e5a0 con 0x7f378c0cf5b0 2024-09-17T05:40:31.671 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:40:31.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f376c073200 msgr2=0x7f376c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f376c073200 0x7f376c075710 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f378c0cccd0 tx=0x7f3778005ed0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 msgr2=0x7f378c1fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c1fc660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f378000c400 tx=0x7f378000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 shutdown_connections 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f376c073200 0x7f376c075710 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f378c0d1d00 0x7f378c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f378c0d18f0 0x7f378c156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 --2- 172.21.15.44:0/3820900301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f378c0cf5b0 0x7f378c1fc660 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 >> 172.21.15.44:0/3820900301 conn(0x7f378c0b4240 msgr2=0x7f378c0b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 shutdown_connections 2024-09-17T05:40:31.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.672+0000 7f3793c00640 1 -- 172.21.15.44:0/3820900301 wait complete. 2024-09-17T05:40:31.694 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:40:31.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:31.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:31.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:40:31.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:31.756 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:40:31.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.976+0000 7f92d2a00640 1 -- 172.21.15.44:0/334460911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b0005360 msgr2=0x7f92b000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.976+0000 7f92d2a00640 1 --2- 172.21.15.44:0/334460911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b0005360 0x7f92b000b9d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f92c400c670 tx=0x7f92c401fa20 comp rx=0 tx=0).stop 2024-09-17T05:40:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.976+0000 7f92d2a00640 1 -- 172.21.15.44:0/334460911 shutdown_connections 2024-09-17T05:40:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.976+0000 7f92d2a00640 1 --2- 172.21.15.44:0/334460911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b0005360 0x7f92b000b9d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.976+0000 7f92d2a00640 1 -- 172.21.15.44:0/334460911 >> 172.21.15.44:0/334460911 conn(0x7f92cc0ccaa0 msgr2=0x7f92cc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.976+0000 7f92d2a00640 1 -- 172.21.15.44:0/334460911 shutdown_connections 2024-09-17T05:40:31.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.976+0000 7f92d2a00640 1 -- 172.21.15.44:0/334460911 wait complete. 2024-09-17T05:40:31.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 Processor -- start 2024-09-17T05:40:31.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 -- start start 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b0005360 0x7f92cc1f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc070ed0 0x7f92cc0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92cc09fa60 0x7f92cc0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc15ed20 con 0x7f92cc070ed0 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc15eba0 con 0x7f92cc09fa60 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f92cc06e260 con 0x7f92b0005360 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc070ed0 0x7f92cc0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc070ed0 0x7f92cc0c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51006/0 (socket says 172.21.15.44:51006) 2024-09-17T05:40:31.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 -- 172.21.15.44:0/532908865 learned_addr learned my addr 172.21.15.44:0/532908865 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d0a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92cc09fa60 0x7f92cc0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92cbe00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b0005360 0x7f92cc1f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 -- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b0005360 msgr2=0x7f92cc1f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b0005360 0x7f92cc1f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 -- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92cc09fa60 msgr2=0x7f92cc0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92cc09fa60 0x7f92cc0c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 -- 172.21.15.44:0/532908865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc0c30e0 con 0x7f92cc070ed0 2024-09-17T05:40:31.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d0a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92cc09fa60 0x7f92cc0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c3e00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc070ed0 0x7f92cc0c8740 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f92b4004da0 tx=0x7f92b4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c8c00640 1 -- 172.21.15.44:0/532908865 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4011660 con 0x7f92cc070ed0 2024-09-17T05:40:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c8c00640 1 -- 172.21.15.44:0/532908865 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92b40118f0 con 0x7f92cc070ed0 2024-09-17T05:40:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc0c2c20 con 0x7f92cc070ed0 2024-09-17T05:40:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92c8c00640 1 -- 172.21.15.44:0/532908865 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4011ce0 con 0x7f92cc070ed0 2024-09-17T05:40:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.980+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc0c9530 con 0x7f92cc070ed0 2024-09-17T05:40:31.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.984+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc070b10 con 0x7f92cc070ed0 2024-09-17T05:40:31.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.984+0000 7f92c8c00640 1 -- 172.21.15.44:0/532908865 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f92b401c470 con 0x7f92cc070ed0 2024-09-17T05:40:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.984+0000 7f92c8c00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f92a8073230 0x7f92a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.984+0000 7f92c8c00640 1 -- 172.21.15.44:0/532908865 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f92b4094b30 con 0x7f92cc070ed0 2024-09-17T05:40:31.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.984+0000 7f92cbe00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f92a8073230 0x7f92a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:31.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.984+0000 7f92cbe00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f92a8073230 0x7f92a8075740 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009be0 tx=0x7f92bc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:31.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:31.988+0000 7f92c8c00640 1 -- 172.21.15.44:0/532908865 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f92b405fa40 con 0x7f92cc070ed0 2024-09-17T05:40:32.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92cc0ced00 con 0x7f92cc070ed0 2024-09-17T05:40:32.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92c8c00640 1 -- 172.21.15.44:0/532908865 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5222 (secure 0 0 0) 0x7f92b405f340 con 0x7f92cc070ed0 2024-09-17T05:40:32.200 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:32.200 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"btime":"2024-09-17T05:40:21:965701+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:40:21.385772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6261},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6261":{"gid":6261,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6834/330558786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":330558786},{"type":"v1","addr":"172.21.15.44:6834","nonce":330558786}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6261,"qdb_cluster":[6261]},"id":5}]} 2024-09-17T05:40:32.200 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 46 2024-09-17T05:40:32.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f92a8073230 msgr2=0x7f92a8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f92a8073230 0x7f92a8075740 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009be0 tx=0x7f92bc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc070ed0 msgr2=0x7f92cc0c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc070ed0 0x7f92cc0c8740 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f92b4004da0 tx=0x7f92b4001640 comp rx=0 tx=0).stop 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 shutdown_connections 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f92a8073230 0x7f92a8075740 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92cc09fa60 0x7f92cc0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92cc070ed0 0x7f92cc0c8740 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 --2- 172.21.15.44:0/532908865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b0005360 0x7f92cc1f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 >> 172.21.15.44:0/532908865 conn(0x7f92cc0ccaa0 msgr2=0x7f92cc09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 shutdown_connections 2024-09-17T05:40:32.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.200+0000 7f92d2a00640 1 -- 172.21.15.44:0/532908865 wait complete. 2024-09-17T05:40:32.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-17T05:40:32.406 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:40:32.407 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:40:32.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:40:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.564+0000 7f1eff200640 1 -- 172.21.15.44:0/2492312681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef8073d20 msgr2=0x7f1ef8151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.564+0000 7f1eff200640 1 --2- 172.21.15.44:0/2492312681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef8073d20 0x7f1ef8151070 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009bc0 tx=0x7f1ef401cb10 comp rx=0 tx=0).stop 2024-09-17T05:40:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 -- 172.21.15.44:0/2492312681 shutdown_connections 2024-09-17T05:40:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 --2- 172.21.15.44:0/2492312681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef8073d20 0x7f1ef8151070 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 -- 172.21.15.44:0/2492312681 >> 172.21.15.44:0/2492312681 conn(0x7f1ef806ce40 msgr2=0x7f1ef806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 -- 172.21.15.44:0/2492312681 shutdown_connections 2024-09-17T05:40:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 -- 172.21.15.44:0/2492312681 wait complete. 2024-09-17T05:40:32.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 Processor -- start 2024-09-17T05:40:32.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 -- start start 2024-09-17T05:40:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ef806fa30 0x7f1ef814b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef8073d20 0x7f1ef81f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef80b3270 0x7f1ef8150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8168e20 con 0x7f1ef8073d20 2024-09-17T05:40:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.568+0000 7f1eff200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8168ca0 con 0x7f1ef80b3270 2024-09-17T05:40:32.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1eff200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef8168fa0 con 0x7f1ef806fa30 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef8073d20 0x7f1ef81f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef8073d20 0x7f1ef81f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51016/0 (socket says 172.21.15.44:51016) 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 -- 172.21.15.44:0/56078377 learned_addr learned my addr 172.21.15.44:0/56078377 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efde00640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ef806fa30 0x7f1ef814b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efe800640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef80b3270 0x7f1ef8150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 -- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ef806fa30 msgr2=0x7f1ef814b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ef806fa30 0x7f1ef814b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 -- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef80b3270 msgr2=0x7f1ef8150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef80b3270 0x7f1ef8150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 -- 172.21.15.44:0/56078377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef814dc70 con 0x7f1ef8073d20 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efde00640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ef806fa30 0x7f1ef814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1efd400640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef8073d20 0x7f1ef81f6670 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c3c0 tx=0x7f1ee800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1ef2000640 1 -- 172.21.15.44:0/56078377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8011790 con 0x7f1ef8073d20 2024-09-17T05:40:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1ef2000640 1 -- 172.21.15.44:0/56078377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ee8017070 con 0x7f1ef8073d20 2024-09-17T05:40:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef814b690 con 0x7f1ef8073d20 2024-09-17T05:40:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1ef2000640 1 -- 172.21.15.44:0/56078377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8011cc0 con 0x7f1ef8073d20 2024-09-17T05:40:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef814e1f0 con 0x7f1ef8073d20 2024-09-17T05:40:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef8151070 con 0x7f1ef8073d20 2024-09-17T05:40:32.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.572+0000 7f1ef2000640 1 -- 172.21.15.44:0/56078377 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1ee801c460 con 0x7f1ef8073d20 2024-09-17T05:40:32.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.576+0000 7f1ef2000640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1edc073200 0x7f1edc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.576+0000 7f1ef2000640 1 -- 172.21.15.44:0/56078377 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6101+0+0 (secure 0 0 0) 0x7f1ee8094c20 con 0x7f1ef8073d20 2024-09-17T05:40:32.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.576+0000 7f1efde00640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1edc073200 0x7f1edc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.576+0000 7f1efde00640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1edc073200 0x7f1edc075710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000f70 tx=0x7f1eec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.580+0000 7f1ef2000640 1 -- 172.21.15.44:0/56078377 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1ee805faa0 con 0x7f1ef8073d20 2024-09-17T05:40:32.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.788+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1ef814b930 con 0x7f1ef8073d20 2024-09-17T05:40:32.788 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:40:32.788+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:40:32.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.788+0000 7f1ef2000640 1 -- 172.21.15.44:0/56078377 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 161+0+0 (secure 0 0 0) 0x7f1ee805f3a0 con 0x7f1ef8073d20 2024-09-17T05:40:32.791 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1edc073200 msgr2=0x7f1edc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1edc073200 0x7f1edc075710 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1eec000f70 tx=0x7f1eec009040 comp rx=0 tx=0).stop 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef8073d20 msgr2=0x7f1ef81f6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef8073d20 0x7f1ef81f6670 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c3c0 tx=0x7f1ee800c880 comp rx=0 tx=0).stop 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 shutdown_connections 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1edc073200 0x7f1edc075710 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ef80b3270 0x7f1ef8150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ef8073d20 0x7f1ef81f6670 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 --2- 172.21.15.44:0/56078377 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ef806fa30 0x7f1ef814b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 >> 172.21.15.44:0/56078377 conn(0x7f1ef806ce40 msgr2=0x7f1ef80b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:32.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 shutdown_connections 2024-09-17T05:40:32.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.792+0000 7f1eff200640 1 -- 172.21.15.44:0/56078377 wait complete. 2024-09-17T05:40:32.810 INFO:tasks.ceph.mds.c.smithi044.stderr: -5213> 2024-09-17T05:40:24.920+0000 7fc1fd600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:40:32.824 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-17T05:40:32.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 Processor -- start 2024-09-17T05:40:32.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 -- start start 2024-09-17T05:40:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb013be4a0 0x55bb01443720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb01443090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb01375470 0x55bb013b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bb012c5a00 con 0x55bb013be4a0 2024-09-17T05:40:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bb01323f40 con 0x55bb0144a070 2024-09-17T05:40:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98ae0a8080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55bb013c0a00 con 0x55bb01375470 2024-09-17T05:40:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98a7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb013be4a0 0x55bb01443720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98a7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb013be4a0 0x55bb01443720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51032/0 (socket says 172.21.15.44:51032) 2024-09-17T05:40:32.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.884+0000 7f98a7200640 1 -- 172.21.15.44:0/3648440902 learned_addr learned my addr 172.21.15.44:0/3648440902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:32.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a7c00640 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb01375470 0x55bb013b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a6800640 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb01443090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a7200640 1 -- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb01375470 msgr2=0x55bb013b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:32.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a7200640 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb01375470 0x55bb013b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a7200640 1 -- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 msgr2=0x55bb01443090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a7200640 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb01443090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a7200640 1 -- 172.21.15.44:0/3648440902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0129ec10 con 0x55bb013be4a0 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a6800640 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb01443090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a7200640 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb013be4a0 0x55bb01443720 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f989800b5c0 tx=0x7f989800ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789ea0a40a101f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a5400640 1 -- 172.21.15.44:0/3648440902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989800a950 con 0x55bb013be4a0 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a5400640 1 -- 172.21.15.44:0/3648440902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f989800aaf0 con 0x55bb013be4a0 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98a5400640 1 -- 172.21.15.44:0/3648440902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898008460 con 0x55bb013be4a0 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 -- 172.21.15.44:0/3648440902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb013be4a0 msgr2=0x55bb01443720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb013be4a0 0x55bb01443720 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f989800b5c0 tx=0x7f989800ba80 comp rx=0 tx=0).stop 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 -- 172.21.15.44:0/3648440902 shutdown_connections 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb01375470 0x55bb013b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb01443090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/3648440902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb013be4a0 0x55bb01443720 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 -- 172.21.15.44:0/3648440902 >> 172.21.15.44:0/3648440902 conn(0x55bb01363d20 msgr2=0x55bb01374d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:32.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 -- 172.21.15.44:0/3648440902 shutdown_connections 2024-09-17T05:40:32.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 -- 172.21.15.44:0/3648440902 wait complete. 2024-09-17T05:40:32.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 Processor -- start 2024-09-17T05:40:32.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.888+0000 7f98ae0a8080 1 -- start start 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb013be4a0 0x55bb014445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb013a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb014436b0 0x55bb013b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bb013bcc10 con 0x55bb014436b0 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bb013bafe0 con 0x55bb0144a070 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55bb013bb240 con 0x55bb013be4a0 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb014436b0 0x55bb013b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb014436b0 0x55bb013b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51034/0 (socket says 172.21.15.44:51034) 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 -- 172.21.15.44:0/1070161571 learned_addr learned my addr 172.21.15.44:0/1070161571 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7200640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb013be4a0 0x55bb014445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a6800640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb013a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 -- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb013be4a0 msgr2=0x55bb014445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bb013be4a0 0x55bb014445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 -- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 msgr2=0x55bb013a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb0144a070 0x55bb013a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 -- 172.21.15.44:0/1070161571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb01444c00 con 0x55bb014436b0 2024-09-17T05:40:32.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98a7c00640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb014436b0 0x55bb013b6630 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f98a000a600 tx=0x7f98a00abeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:32.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f989fe00640 1 -- 172.21.15.44:0/1070161571 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00bb030 con 0x55bb014436b0 2024-09-17T05:40:32.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f989fe00640 1 -- 172.21.15.44:0/1070161571 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98a00c0410 con 0x55bb014436b0 2024-09-17T05:40:32.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f989fe00640 1 -- 172.21.15.44:0/1070161571 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00b0040 con 0x55bb014436b0 2024-09-17T05:40:32.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb01444ea0 con 0x55bb014436b0 2024-09-17T05:40:32.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.892+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb014477c0 con 0x55bb014436b0 2024-09-17T05:40:32.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f989fe00640 1 -- 172.21.15.44:0/1070161571 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f98a00be030 con 0x55bb014436b0 2024-09-17T05:40:32.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f989fe00640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9888071c10 0x7f9888074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f989fe00640 1 -- 172.21.15.44:0/1070161571 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f98a012dc80 con 0x55bb014436b0 2024-09-17T05:40:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f98a7200640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9888071c10 0x7f9888074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55bb01448170 0x55bb01448580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) -- 0x55bb01448ac0 con 0x55bb01448170 2024-09-17T05:40:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f98a6800640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55bb01448170 0x55bb01448580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f98a7200640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9888071c10 0x7f9888074120 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9898005010 tx=0x7f9898018040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.896+0000 7f98a6800640 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55bb01448170 0x55bb01448580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:32.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98a6800640 1 -- 172.21.15.44:0/1070161571 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v78'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f98940106a0 con 0x55bb01448170 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55bb01448170 msgr2=0x55bb01448580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55bb01448170 0x55bb01448580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9888071c10 msgr2=0x7f9888074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9888071c10 0x7f9888074120 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9898005010 tx=0x7f9898018040 comp rx=0 tx=0).stop 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb014436b0 msgr2=0x55bb013b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 --2- 172.21.15.44:0/1070161571 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bb014436b0 0x55bb013b6630 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f98a000a600 tx=0x7f98a00abeb0 comp rx=0 tx=0).stop 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98a7c00640 1 -- 172.21.15.44:0/1070161571 reap_dead start 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 shutdown_connections 2024-09-17T05:40:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 >> 172.21.15.44:0/1070161571 conn(0x55bb01363d20 msgr2=0x55bb013b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:32.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 shutdown_connections 2024-09-17T05:40:32.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:32.900+0000 7f98ae0a8080 1 -- 172.21.15.44:0/1070161571 wait complete. 2024-09-17T05:40:32.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T05:40:32.941 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:40:33.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 -- 172.21.15.44:0/948599431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415f1e0 msgr2=0x7f6c7415b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:33.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 --2- 172.21.15.44:0/948599431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415f1e0 0x7f6c7415b6b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6c740cd520 tx=0x7f6c5c01c6e0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 -- 172.21.15.44:0/948599431 shutdown_connections 2024-09-17T05:40:33.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 --2- 172.21.15.44:0/948599431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415f1e0 0x7f6c7415b6b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 --2- 172.21.15.44:0/948599431 >> v2:172.21.15.44:3300/0 conn(0x7f6c74158a90 0x7f6c7415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 -- 172.21.15.44:0/948599431 >> 172.21.15.44:0/948599431 conn(0x7f6c7406ce40 msgr2=0x7f6c7406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:33.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 -- 172.21.15.44:0/948599431 shutdown_connections 2024-09-17T05:40:33.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 -- 172.21.15.44:0/948599431 wait complete. 2024-09-17T05:40:33.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 Processor -- start 2024-09-17T05:40:33.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.076+0000 7f6c73e00640 1 -- start start 2024-09-17T05:40:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c74158a90 0x7f6c7415e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415bbf0 0x7f6c741603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c7415f1e0 0x7f6c74153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740b3b30 con 0x7f6c74158a90 2024-09-17T05:40:33.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740b39b0 con 0x7f6c7415bbf0 2024-09-17T05:40:33.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6c740b3cb0 con 0x7f6c7415f1e0 2024-09-17T05:40:33.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c74158a90 0x7f6c7415e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:33.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c74158a90 0x7f6c7415e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51088/0 (socket says 172.21.15.44:51088) 2024-09-17T05:40:33.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 -- 172.21.15.44:0/4068047618 learned_addr learned my addr 172.21.15.44:0/4068047618 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 -- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c7415f1e0 msgr2=0x7f6c74153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c6a000640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415bbf0 0x7f6c741603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c7415f1e0 0x7f6c74153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 -- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415bbf0 msgr2=0x7f6c741603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415bbf0 0x7f6c741603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 -- 172.21.15.44:0/4068047618 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c741635c0 con 0x7f6c74158a90 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c6a000640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415bbf0 0x7f6c741603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:33.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c72a00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c74158a90 0x7f6c7415e190 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400e9a0 tx=0x7f6c6400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c6b400640 1 -- 172.21.15.44:0/4068047618 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400cd80 con 0x7f6c74158a90 2024-09-17T05:40:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c6b400640 1 -- 172.21.15.44:0/4068047618 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c64004020 con 0x7f6c74158a90 2024-09-17T05:40:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c6b400640 1 -- 172.21.15.44:0/4068047618 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64004450 con 0x7f6c74158a90 2024-09-17T05:40:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7415f900 con 0x7f6c74158a90 2024-09-17T05:40:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7415fec0 con 0x7f6c74158a90 2024-09-17T05:40:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.080+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c740b4160 con 0x7f6c74158a90 2024-09-17T05:40:33.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.084+0000 7f6c6b400640 1 -- 172.21.15.44:0/4068047618 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6c64003600 con 0x7f6c74158a90 2024-09-17T05:40:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.084+0000 7f6c6b400640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6c50073260 0x7f6c50075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.084+0000 7f6c6b400640 1 -- 172.21.15.44:0/4068047618 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f6c64094da0 con 0x7f6c74158a90 2024-09-17T05:40:33.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.084+0000 7f6c6a000640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6c50073260 0x7f6c50075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:33.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.084+0000 7f6c6a000640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6c50073260 0x7f6c50075770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0af000 tx=0x7f6c5c01af20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:33.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.088+0000 7f6c6b400640 1 -- 172.21.15.44:0/4068047618 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6c6405fbd0 con 0x7f6c74158a90 2024-09-17T05:40:33.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.300+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f6c74166d50 con 0x7f6c74158a90 2024-09-17T05:40:33.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.792+0000 7f6c6b400640 1 -- 172.21.15.44:0/4068047618 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v48) ==== 162+0+0 (secure 0 0 0) 0x7f6c6405f4d0 con 0x7f6c74158a90 2024-09-17T05:40:33.793 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T05:40:33.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6c50073260 msgr2=0x7f6c50075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:33.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6c50073260 0x7f6c50075770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0af000 tx=0x7f6c5c01af20 comp rx=0 tx=0).stop 2024-09-17T05:40:33.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c74158a90 msgr2=0x7f6c7415e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:33.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c74158a90 0x7f6c7415e190 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400e9a0 tx=0x7f6c6400ee60 comp rx=0 tx=0).stop 2024-09-17T05:40:33.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 shutdown_connections 2024-09-17T05:40:33.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6c7415f1e0 0x7f6c74153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6c50073260 0x7f6c50075770 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c7415bbf0 0x7f6c741603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 --2- 172.21.15.44:0/4068047618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c74158a90 0x7f6c7415e190 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:33.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 >> 172.21.15.44:0/4068047618 conn(0x7f6c7406ce40 msgr2=0x7f6c7406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:33.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 shutdown_connections 2024-09-17T05:40:33.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:33.796+0000 7f6c73e00640 1 -- 172.21.15.44:0/4068047618 wait complete. 2024-09-17T05:40:33.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 -- 172.21.15.44:0/3749126007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 msgr2=0x7fbed80b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 --2- 172.21.15.44:0/3749126007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 0x7fbed80b1be0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009840 tx=0x7fbecc01c760 comp rx=0 tx=0).stop 2024-09-17T05:40:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 -- 172.21.15.44:0/3749126007 shutdown_connections 2024-09-17T05:40:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 --2- 172.21.15.44:0/3749126007 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed80d1d00 0x7fbed80cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 --2- 172.21.15.44:0/3749126007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 0x7fbed80b1be0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 -- 172.21.15.44:0/3749126007 >> 172.21.15.44:0/3749126007 conn(0x7fbed80b4240 msgr2=0x7fbed80b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:34.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 -- 172.21.15.44:0/3749126007 shutdown_connections 2024-09-17T05:40:34.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.024+0000 7fbee0600640 1 -- 172.21.15.44:0/3749126007 wait complete. 2024-09-17T05:40:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 Processor -- start 2024-09-17T05:40:34.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 -- start start 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed80cf5b0 0x7fbed81490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 0x7fbed81495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbed80d1d00 0x7fbed8149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8169ee0 con 0x7fbed80d1d00 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbed8169d60 con 0x7fbed80d18f0 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbed816a060 con 0x7fbed80cf5b0 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbed80d1d00 0x7fbed8149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbed80d1d00 0x7fbed8149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51116/0 (socket says 172.21.15.44:51116) 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 -- 172.21.15.44:0/434215687 learned_addr learned my addr 172.21.15.44:0/434215687 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:34.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbedd200640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 0x7fbed81495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbeddc00640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed80cf5b0 0x7fbed81490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 -- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed80cf5b0 msgr2=0x7fbed81490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed80cf5b0 0x7fbed81490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 -- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 msgr2=0x7fbed81495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 0x7fbed81495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 -- 172.21.15.44:0/434215687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed80cb860 con 0x7fbed80d1d00 2024-09-17T05:40:34.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbede600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbed80d1d00 0x7fbed8149b20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbed000ca30 tx=0x7fbed000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbed5600640 1 -- 172.21.15.44:0/434215687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0016020 con 0x7fbed80d1d00 2024-09-17T05:40:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbed5600640 1 -- 172.21.15.44:0/434215687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbed000a8d0 con 0x7fbed80d1d00 2024-09-17T05:40:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbed5600640 1 -- 172.21.15.44:0/434215687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed000ad60 con 0x7fbed80d1d00 2024-09-17T05:40:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed80cb5c0 con 0x7fbed80d1d00 2024-09-17T05:40:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.028+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed8150e00 con 0x7fbed80d1d00 2024-09-17T05:40:34.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.032+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed80b1be0 con 0x7fbed80d1d00 2024-09-17T05:40:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.032+0000 7fbed5600640 1 -- 172.21.15.44:0/434215687 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbed0019020 con 0x7fbed80d1d00 2024-09-17T05:40:34.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.032+0000 7fbed5600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbeb8073200 0x7fbeb8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.032+0000 7fbed5600640 1 -- 172.21.15.44:0/434215687 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fbed00946d0 con 0x7fbed80d1d00 2024-09-17T05:40:34.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.032+0000 7fbeddc00640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbeb8073200 0x7fbeb8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:34.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.036+0000 7fbeddc00640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbeb8073200 0x7fbeb8075710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0af000 tx=0x7fbecc01afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:34.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.036+0000 7fbed5600640 1 -- 172.21.15.44:0/434215687 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbed0020030 con 0x7fbed80d1d00 2024-09-17T05:40:34.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.248+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbed815c170 con 0x7fbed80d1d00 2024-09-17T05:40:34.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.248+0000 7fbed5600640 1 -- 172.21.15.44:0/434215687 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5219 (secure 0 0 0) 0x7fbed80cf9c0 con 0x7fbed80d1d00 2024-09-17T05:40:34.250 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:34.250 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":49,"btime":"2024-09-17T05:40:33:798807+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:40:33.798788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-17T05:40:34.250 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 49 2024-09-17T05:40:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbeb8073200 msgr2=0x7fbeb8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbeb8073200 0x7fbeb8075710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0af000 tx=0x7fbecc01afa0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbed80d1d00 msgr2=0x7fbed8149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbed80d1d00 0x7fbed8149b20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbed000ca30 tx=0x7fbed000cb20 comp rx=0 tx=0).stop 2024-09-17T05:40:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 shutdown_connections 2024-09-17T05:40:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbed80d1d00 0x7fbed8149b20 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbeb8073200 0x7fbeb8075710 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbed80d18f0 0x7fbed81495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 --2- 172.21.15.44:0/434215687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbed80cf5b0 0x7fbed81490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:34.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 >> 172.21.15.44:0/434215687 conn(0x7fbed80b4240 msgr2=0x7fbed81534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:34.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 shutdown_connections 2024-09-17T05:40:34.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:34.252+0000 7fbee0600640 1 -- 172.21.15.44:0/434215687 wait complete. 2024-09-17T05:40:34.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:40:18.372314+0000', 'modified': '2024-09-17T05:40:33.798788+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6337}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6337': {'gid': 6337, 'name': 'c', 'rank': 0, 'incarnation': 49, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6834/2539887819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2539887819}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2539887819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:40:34.675 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6337:up:replay 2024-09-17T05:40:35.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:35.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 -- 172.21.15.44:0/1006587627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac06e490 msgr2=0x7fadac151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:35.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1006587627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac06e490 0x7fadac151b00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fadac15b950 tx=0x7fada401ccf0 comp rx=0 tx=0).stop 2024-09-17T05:40:35.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 -- 172.21.15.44:0/1006587627 shutdown_connections 2024-09-17T05:40:35.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1006587627 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac06e490 0x7fadac151b00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:35.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1006587627 >> v2:172.21.15.86:3300/0 conn(0x7fadac071c60 0x7fadac06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:35.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 -- 172.21.15.44:0/1006587627 >> 172.21.15.44:0/1006587627 conn(0x7fadac0cd930 msgr2=0x7fadac0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:35.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 -- 172.21.15.44:0/1006587627 shutdown_connections 2024-09-17T05:40:35.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 -- 172.21.15.44:0/1006587627 wait complete. 2024-09-17T05:40:35.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.848+0000 7fadb1a00640 1 Processor -- start 2024-09-17T05:40:35.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 -- start start 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadac06e490 0x7fadac13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadac070e00 0x7fadac1f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac071c60 0x7fadac06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fadac15c470 con 0x7fadac071c60 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fadac15c2f0 con 0x7fadac06e490 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fadac15c5f0 con 0x7fadac070e00 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac071c60 0x7fadac06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac071c60 0x7fadac06d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51132/0 (socket says 172.21.15.44:51132) 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 -- 172.21.15.44:0/1895775159 learned_addr learned my addr 172.21.15.44:0/1895775159 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:35.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadaaa00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadac06e490 0x7fadac13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:35.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fada2000640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadac070e00 0x7fadac1f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:35.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 -- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadac070e00 msgr2=0x7fadac1f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:35.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadac070e00 0x7fadac1f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:35.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 -- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadac06e490 msgr2=0x7fadac13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:35.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadac06e490 0x7fadac13ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:35.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 -- 172.21.15.44:0/1895775159 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac1f9380 con 0x7fadac071c60 2024-09-17T05:40:35.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadab400640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac071c60 0x7fadac06d2a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fada4019900 tx=0x7fada40092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fada3400640 1 -- 172.21.15.44:0/1895775159 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada40bb070 con 0x7fadac071c60 2024-09-17T05:40:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fada3400640 1 -- 172.21.15.44:0/1895775159 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fada4004d40 con 0x7fadac071c60 2024-09-17T05:40:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fada3400640 1 -- 172.21.15.44:0/1895775159 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada40b2040 con 0x7fadac071c60 2024-09-17T05:40:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac1f9660 con 0x7fadac071c60 2024-09-17T05:40:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.852+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac13e500 con 0x7fadac071c60 2024-09-17T05:40:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.856+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadac1f90f0 con 0x7fadac071c60 2024-09-17T05:40:35.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.856+0000 7fada3400640 1 -- 172.21.15.44:0/1895775159 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fada4004200 con 0x7fadac071c60 2024-09-17T05:40:35.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.856+0000 7fada3400640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad88073200 0x7fad88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:35.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.856+0000 7fada3400640 1 -- 172.21.15.44:0/1895775159 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fada412e1a0 con 0x7fadac071c60 2024-09-17T05:40:35.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.856+0000 7fadaaa00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad88073200 0x7fad88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:35.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.856+0000 7fadaaa00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad88073200 0x7fad88075710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fad9c007fd0 tx=0x7fad9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:35.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:35.860+0000 7fada3400640 1 -- 172.21.15.44:0/1895775159 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fada4016970 con 0x7fadac071c60 2024-09-17T05:40:36.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.068+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadac0b0d30 con 0x7fadac071c60 2024-09-17T05:40:36.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.068+0000 7fada3400640 1 -- 172.21.15.44:0/1895775159 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5219 (secure 0 0 0) 0x7fada40f8a10 con 0x7fadac071c60 2024-09-17T05:40:36.071 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:36.071 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"btime":"2024-09-17T05:40:35:803976+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:40:34.807893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-17T05:40:36.071 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 51 2024-09-17T05:40:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad88073200 msgr2=0x7fad88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad88073200 0x7fad88075710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fad9c007fd0 tx=0x7fad9c009040 comp rx=0 tx=0).stop 2024-09-17T05:40:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac071c60 msgr2=0x7fadac06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac071c60 0x7fadac06d2a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fada4019900 tx=0x7fada40092c0 comp rx=0 tx=0).stop 2024-09-17T05:40:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 shutdown_connections 2024-09-17T05:40:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fadac071c60 0x7fadac06d2a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:36.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fadac070e00 0x7fadac1f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad88073200 0x7fad88075710 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 --2- 172.21.15.44:0/1895775159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadac06e490 0x7fadac13ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 >> 172.21.15.44:0/1895775159 conn(0x7fadac0cd930 msgr2=0x7fadac15d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 shutdown_connections 2024-09-17T05:40:36.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:36.072+0000 7fadb1a00640 1 -- 172.21.15.44:0/1895775159 wait complete. 2024-09-17T05:40:36.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:40:18.372314+0000', 'modified': '2024-09-17T05:40:34.807893+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6337}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6337': {'gid': 6337, 'name': 'c', 'rank': 0, 'incarnation': 49, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.44:6834/2539887819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2539887819}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2539887819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:40:36.496 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6337:up:rejoin 2024-09-17T05:40:37.497 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.668+0000 7fef21600640 1 -- 172.21.15.44:0/854379330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0b5880 msgr2=0x7fef1c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.668+0000 7fef21600640 1 --2- 172.21.15.44:0/854379330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0b5880 0x7fef1c06de50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fef04009900 tx=0x7fef0401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.668+0000 7fef21600640 1 -- 172.21.15.44:0/854379330 shutdown_connections 2024-09-17T05:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.668+0000 7fef21600640 1 --2- 172.21.15.44:0/854379330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0b5880 0x7fef1c06de50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.668+0000 7fef21600640 1 -- 172.21.15.44:0/854379330 >> 172.21.15.44:0/854379330 conn(0x7fef1c0ccaa0 msgr2=0x7fef1c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.668+0000 7fef21600640 1 -- 172.21.15.44:0/854379330 shutdown_connections 2024-09-17T05:40:37.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.668+0000 7fef21600640 1 -- 172.21.15.44:0/854379330 wait complete. 2024-09-17T05:40:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 Processor -- start 2024-09-17T05:40:37.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 -- start start 2024-09-17T05:40:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef1c06e390 0x7fef1c0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:37.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef1c0b5880 0x7fef1c1fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0ce300 0x7fef1c153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c16b680 con 0x7fef1c0ce300 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c074750 con 0x7fef1c06e390 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fef1c16b800 con 0x7fef1c0b5880 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0ce300 0x7fef1c153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0ce300 0x7fef1c153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51138/0 (socket says 172.21.15.44:51138) 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 -- 172.21.15.44:0/602638895 learned_addr learned my addr 172.21.15.44:0/602638895 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef12000640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef1c0b5880 0x7fef1c1fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1aa00640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef1c06e390 0x7fef1c0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 -- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef1c0b5880 msgr2=0x7fef1c1fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef1c0b5880 0x7fef1c1fd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 -- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef1c06e390 msgr2=0x7fef1c0aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:37.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef1c06e390 0x7fef1c0aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 -- 172.21.15.44:0/602638895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c1fd6e0 con 0x7fef1c0ce300 2024-09-17T05:40:37.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef1b400640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0ce300 0x7fef1c153990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fef1400b9e0 tx=0x7fef1400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:37.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef13400640 1 -- 172.21.15.44:0/602638895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef14003b80 con 0x7fef1c0ce300 2024-09-17T05:40:37.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef13400640 1 -- 172.21.15.44:0/602638895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef14003e10 con 0x7fef1c0ce300 2024-09-17T05:40:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c0c8070 con 0x7fef1c0ce300 2024-09-17T05:40:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef13400640 1 -- 172.21.15.44:0/602638895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1400cb80 con 0x7fef1c0ce300 2024-09-17T05:40:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.672+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c0c8630 con 0x7fef1c0ce300 2024-09-17T05:40:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.676+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1c0af5b0 con 0x7fef1c0ce300 2024-09-17T05:40:37.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.676+0000 7fef13400640 1 -- 172.21.15.44:0/602638895 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fef14006d10 con 0x7fef1c0ce300 2024-09-17T05:40:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.676+0000 7fef13400640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feef8073230 0x7feef8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.676+0000 7fef13400640 1 -- 172.21.15.44:0/602638895 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fef14093e40 con 0x7fef1c0ce300 2024-09-17T05:40:37.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.676+0000 7fef1aa00640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feef8073230 0x7feef8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:37.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.680+0000 7fef1aa00640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feef8073230 0x7feef8075740 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef040af000 tx=0x7fef0401b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:37.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.680+0000 7fef13400640 1 -- 172.21.15.44:0/602638895 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fef1405e630 con 0x7fef1c0ce300 2024-09-17T05:40:37.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.888+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef1c0af340 con 0x7fef1c0ce300 2024-09-17T05:40:37.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.888+0000 7fef13400640 1 -- 172.21.15.44:0/602638895 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5226 (secure 0 0 0) 0x7fef14063060 con 0x7fef1c0ce300 2024-09-17T05:40:37.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:40:37.892 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"btime":"2024-09-17T05:40:36:805874+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:40:36.805863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6337,"qdb_cluster":[6337]},"id":5}]} 2024-09-17T05:40:37.892 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 52 2024-09-17T05:40:37.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feef8073230 msgr2=0x7feef8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feef8073230 0x7feef8075740 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fef040af000 tx=0x7fef0401b120 comp rx=0 tx=0).stop 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0ce300 msgr2=0x7fef1c153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0ce300 0x7fef1c153990 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fef1400b9e0 tx=0x7fef1400bea0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 shutdown_connections 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef1c0ce300 0x7fef1c153990 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fef1c0b5880 0x7fef1c1fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feef8073230 0x7feef8075740 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 --2- 172.21.15.44:0/602638895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef1c06e390 0x7fef1c0aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 >> 172.21.15.44:0/602638895 conn(0x7fef1c0ccaa0 msgr2=0x7fef1c072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 shutdown_connections 2024-09-17T05:40:37.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:37.892+0000 7fef21600640 1 -- 172.21.15.44:0/602638895 wait complete. 2024-09-17T05:40:38.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:40:18.372314+0000', 'modified': '2024-09-17T05:40:36.805863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 78, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6337}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6337': {'gid': 6337, 'name': 'c', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6834/2539887819', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6832', 'nonce': 2539887819}, {'type': 'v1', 'addr': '172.21.15.44:6834', 'nonce': 2539887819}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6337, 'qdb_cluster': [6337]} 2024-09-17T05:40:38.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:40:38.317 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:40:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 -- 172.21.15.44:0/1802790201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c406e560 msgr2=0x7ff0c40700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/1802790201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c406e560 0x7ff0c40700d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff0c409e100 tx=0x7ff0ac01cd80 comp rx=0 tx=0).stop 2024-09-17T05:40:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 -- 172.21.15.44:0/1802790201 shutdown_connections 2024-09-17T05:40:38.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/1802790201 >> v2:172.21.15.86:3300/0 conn(0x7ff0c4070610 0x7ff0c4070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/1802790201 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c406e560 0x7ff0c40700d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 -- 172.21.15.44:0/1802790201 >> 172.21.15.44:0/1802790201 conn(0x7ff0c40ccaa0 msgr2=0x7ff0c40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 -- 172.21.15.44:0/1802790201 shutdown_connections 2024-09-17T05:40:38.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.480+0000 7ff0c8c00640 1 -- 172.21.15.44:0/1802790201 wait complete. 2024-09-17T05:40:38.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 Processor -- start 2024-09-17T05:40:38.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 -- start start 2024-09-17T05:40:38.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4070610 0x7ff0c4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c40b5880 0x7ff0c40a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40c2b10 0x7ff0c409f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4169ee0 con 0x7ff0c4070610 2024-09-17T05:40:38.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4169d60 con 0x7ff0c40b5880 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c8c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c416a060 con 0x7ff0c40c2b10 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4070610 0x7ff0c4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4070610 0x7ff0c4156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51154/0 (socket says 172.21.15.44:51154) 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0c1e00640 1 -- 172.21.15.44:0/343725506 learned_addr learned my addr 172.21.15.44:0/343725506 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.484+0000 7ff0b9400640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c40b5880 0x7ff0c40a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c2800640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40c2b10 0x7ff0c409f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c1e00640 1 -- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40c2b10 msgr2=0x7ff0c409f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40c2b10 0x7ff0c409f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c1e00640 1 -- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c40b5880 msgr2=0x7ff0c40a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c40b5880 0x7ff0c40a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c1e00640 1 -- 172.21.15.44:0/343725506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c415fd10 con 0x7ff0c4070610 2024-09-17T05:40:38.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4070610 0x7ff0c4156a40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400b410 tx=0x7ff0b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0baa00640 1 -- 172.21.15.44:0/343725506 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4015030 con 0x7ff0c4070610 2024-09-17T05:40:38.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0baa00640 1 -- 172.21.15.44:0/343725506 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0b4004020 con 0x7ff0c4070610 2024-09-17T05:40:38.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c4155c80 con 0x7ff0c4070610 2024-09-17T05:40:38.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0baa00640 1 -- 172.21.15.44:0/343725506 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4004470 con 0x7ff0c4070610 2024-09-17T05:40:38.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c4156240 con 0x7ff0c4070610 2024-09-17T05:40:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.488+0000 7ff0baa00640 1 -- 172.21.15.44:0/343725506 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff0b4018070 con 0x7ff0c4070610 2024-09-17T05:40:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0baa00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a0073200 0x7ff0a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0baa00640 1 -- 172.21.15.44:0/343725506 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7ff0b4093e80 con 0x7ff0c4070610 2024-09-17T05:40:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 Processor -- start 2024-09-17T05:40:38.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0b9400640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a0073200 0x7ff0a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 -- start start 2024-09-17T05:40:38.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0b9400640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a0073200 0x7ff0a0075710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0af000 tx=0x7ff0ac01b5c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f3193676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f319367be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f319368120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f31923c410 con 0x55f318e26460 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f319179b40 con 0x55f3191ffca0 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f319168f70 con 0x55f319216950 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f3193676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f3193676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51158/0 (socket says 172.21.15.44:51158) 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 -- 172.21.15.44:0/1029191109 learned_addr learned my addr 172.21.15.44:0/1029191109 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0b9400640 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f319367be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c2800640 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f319368120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 -- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 msgr2=0x55f319367be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f319367be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 -- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 msgr2=0x55f319368120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f319368120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 -- 172.21.15.44:0/1029191109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3191305b0 con 0x55f318e26460 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0b9400640 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f319367be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f3193676a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40920a0 tx=0x7ff0b405e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb58a44c83d6026 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0b2600640 1 -- 172.21.15.44:0/1029191109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b405d8c0 con 0x55f318e26460 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0b2600640 1 -- 172.21.15.44:0/1029191109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0b405da80 con 0x55f318e26460 2024-09-17T05:40:38.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.492+0000 7ff0b2600640 1 -- 172.21.15.44:0/1029191109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4065500 con 0x55f318e26460 2024-09-17T05:40:38.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- 172.21.15.44:0/1029191109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 msgr2=0x55f3193676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f3193676a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40920a0 tx=0x7ff0b405e720 comp rx=0 tx=0).stop 2024-09-17T05:40:38.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- 172.21.15.44:0/1029191109 shutdown_connections 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f319368120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f319367be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 --2- 172.21.15.44:0/1029191109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f3193676a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- 172.21.15.44:0/1029191109 >> 172.21.15.44:0/1029191109 conn(0x55f3192ecd90 msgr2=0x55f31931c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- 172.21.15.44:0/1029191109 shutdown_connections 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- 172.21.15.44:0/1029191109 wait complete. 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- start start 2024-09-17T05:40:38.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 Processor -- start 2024-09-17T05:40:38.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f31936e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f31936ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f31936f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f3191035f0 con 0x55f318e26460 2024-09-17T05:40:38.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f31916cd80 con 0x55f3191ffca0 2024-09-17T05:40:38.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f31910f520 con 0x55f319216950 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0d0179000 10 client.0 _ll_register_callbacks cb 0x55f319113830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f31936e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0b9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f31936ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f31936e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51170/0 (socket says 172.21.15.44:51170) 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 -- 172.21.15.44:0/439267822 learned_addr learned my addr 172.21.15.44:0/439267822 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c2800640 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f31936f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 -- 172.21.15.44:0/439267822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 msgr2=0x55f31936f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f31936f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 -- 172.21.15.44:0/439267822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 msgr2=0x55f31936ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f31936ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.496+0000 7ff0c1e00640 1 -- 172.21.15.44:0/439267822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f319107190 con 0x55f318e26460 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f31936e920 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400b3e0 tx=0x7ff0b4068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9dc89c89444394b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:38.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 1 -- 172.21.15.44:0/439267822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b405dac0 con 0x55f318e26460 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 1 -- 172.21.15.44:0/439267822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7ff0b40652a0 con 0x55f318e26460 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f319101110 con 0x55f318e26460 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 1 -- 172.21.15.44:0/439267822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff0b406e050 con 0x55f318e26460 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 10 client.6513 fetch_fsmap learned FSMap version 52 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55f3191edf10 con 0x55f318e26460 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 1 -- 172.21.15.44:0/439267822 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f319101110 con 0x55f318e26460 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 1 -- 172.21.15.44:0/439267822 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7ff0b4071020 con 0x55f318e26460 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 10 client.6513 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 10 client.6513 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 20 client.6513 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318e0b7d0 0x55f319378d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 4 client.6513 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:40:38.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f31917ba90 con 0x55f318e0b7d0 2024-09-17T05:40:38.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0b9400640 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318e0b7d0 0x55f319378d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0b9400640 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318e0b7d0 0x55f319378d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e37219e722433f6 server_cookie=b4eb6a1143566454 in_seq=0 out_seq=0 2024-09-17T05:40:38.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 10 client.6513 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 1 -- 172.21.15.44:0/439267822 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f31917ba90 con 0x55f318e0b7d0 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 10 client.6513 handle_command_reply: tid=0 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 client.6513 shutdown 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 msgr2=0x55f31936e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f31936e920 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400b3e0 tx=0x7ff0b4068000 comp rx=0 tx=0).stop 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 shutdown_connections 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318e0b7d0 0x55f319378d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f31936f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f31936ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 --2- 172.21.15.44:0/439267822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f318e26460 0x55f31936e920 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0a6a00640 0 client.6513 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:38.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 >> 172.21.15.44:0/439267822 conn(0x55f3192ecd90 msgr2=0x55f319323440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 shutdown_connections 2024-09-17T05:40:38.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 1 -- 172.21.15.44:0/439267822 wait complete. 2024-09-17T05:40:38.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.500+0000 7ff0d0179000 20 client.6513 trim_cache size 0 max 16384 2024-09-17T05:40:38.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.520+0000 7ff0d0179000 1 Processor -- start 2024-09-17T05:40:38.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.520+0000 7ff0d0179000 1 -- start start 2024-09-17T05:40:38.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f318e26460 0x55f3193d9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f3193d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f319216950 0x55f3193da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4203cb0 con 0x55f319216950 2024-09-17T05:40:38.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c40c16f0 con 0x55f3191ffca0 2024-09-17T05:40:38.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c41fad20 con 0x55f318e26460 2024-09-17T05:40:38.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f319216950 0x55f3193da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f319216950 0x55f3193da0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51182/0 (socket says 172.21.15.44:51182) 2024-09-17T05:40:38.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 -- 172.21.15.44:0/2893013318 learned_addr learned my addr 172.21.15.44:0/2893013318 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:38.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f318e26460 0x55f3193d9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0b9400640 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f3193d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 -- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f318e26460 msgr2=0x55f3193d9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f318e26460 0x55f3193d9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 -- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 msgr2=0x55f3193d9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f3193d9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 -- 172.21.15.44:0/2893013318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3191c4db0 con 0x55f319216950 2024-09-17T05:40:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0c2800640 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f319216950 0x55f3193da0a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc003790 tx=0x7ff0bc003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cc3b087940bfc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0b1c00640 1 -- 172.21.15.44:0/2893013318 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc00ba60 con 0x55f319216950 2024-09-17T05:40:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0b1c00640 1 -- 172.21.15.44:0/2893013318 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0bc020070 con 0x55f319216950 2024-09-17T05:40:38.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0b1c00640 1 -- 172.21.15.44:0/2893013318 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc011440 con 0x55f319216950 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- 172.21.15.44:0/2893013318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f319216950 msgr2=0x55f3193da0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f319216950 0x55f3193da0a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc003790 tx=0x7ff0bc003c50 comp rx=0 tx=0).stop 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- 172.21.15.44:0/2893013318 shutdown_connections 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f319216950 0x55f3193da0a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f3191ffca0 0x55f3193d9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 --2- 172.21.15.44:0/2893013318 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f318e26460 0x55f3193d9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- 172.21.15.44:0/2893013318 >> 172.21.15.44:0/2893013318 conn(0x55f3192ecd90 msgr2=0x55f319365620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- 172.21.15.44:0/2893013318 shutdown_connections 2024-09-17T05:40:38.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- 172.21.15.44:0/2893013318 wait complete. 2024-09-17T05:40:38.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 -- start start 2024-09-17T05:40:38.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.524+0000 7ff0d0179000 1 Processor -- start 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f318e26460 0x55f3193dd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3191ffca0 0x55f3193dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f3193dde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f31910f520 con 0x55f3191ffca0 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c40c10a0 con 0x55f318e26460 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f3191035f0 con 0x55f319216950 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 10 client.0 _ll_register_callbacks cb 0x7ff0b4077070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:38.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3191ffca0 0x55f3193dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3191ffca0 0x55f3193dd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51198/0 (socket says 172.21.15.44:51198) 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 -- 172.21.15.44:0/466153302 learned_addr learned my addr 172.21.15.44:0/466153302 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f318e26460 0x55f3193dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0c2800640 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f3193dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 -- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 msgr2=0x55f3193dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f3193dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 -- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f318e26460 msgr2=0x55f3193dd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f318e26460 0x55f3193dd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 -- 172.21.15.44:0/466153302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f31912fab0 con 0x55f3191ffca0 2024-09-17T05:40:38.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0b9400640 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3191ffca0 0x55f3193dd8d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000f90 tx=0x7ff0ac01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62313a539378c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0a6a00640 1 -- 172.21.15.44:0/466153302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0b2040 con 0x55f3191ffca0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0a6a00640 1 -- 172.21.15.44:0/466153302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7ff0ac004710 con 0x55f3191ffca0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0bc020070 con 0x55f3191ffca0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0a6a00640 1 -- 172.21.15.44:0/466153302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7ff0ac0dd050 con 0x55f3191ffca0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 10 client.6519 fetch_fsmap learned FSMap version 52 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55f31910e070 con 0x55f3191ffca0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0a6a00640 1 -- 172.21.15.44:0/466153302 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0bc020070 con 0x55f3191ffca0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0a6a00640 1 -- 172.21.15.44:0/466153302 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7ff0ac0e0020 con 0x55f3191ffca0 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 10 client.6519 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 10 client.6519 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 20 client.6519 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318df9830 0x55f31939a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 4 client.6519 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "status"}) -- 0x55f319177540 con 0x55f318df9830 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.528+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318df9830 0x55f31939a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0a6a00640 10 client.6519 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c1e00640 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318df9830 0x55f31939a450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a06365e4b9e21342 server_cookie=34e60aaa01f4ccb3 in_seq=0 out_seq=0 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0a6a00640 1 -- 172.21.15.44:0/466153302 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f319177540 con 0x55f318df9830 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0a6a00640 10 client.6519 handle_command_reply: tid=0 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 client.6519 shutdown 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3191ffca0 msgr2=0x55f3193dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3191ffca0 0x55f3193dd8d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac000f90 tx=0x7ff0ac01cd80 comp rx=0 tx=0).stop 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 shutdown_connections 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f318df9830 0x55f31939a450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f319216950 0x55f3193dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f3191ffca0 0x55f3193dd8d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 --2- 172.21.15.44:0/466153302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f318e26460 0x55f3193dd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0a6a00640 0 client.6519 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 >> 172.21.15.44:0/466153302 conn(0x55f3192ecd90 msgr2=0x55f3193786a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 shutdown_connections 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 1 -- 172.21.15.44:0/466153302 wait complete. 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0d0179000 20 client.6519 trim_cache size 0 max 16384 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6337, 2024-09-17T05:40:38.535 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.7284116210000002, 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 52, 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 78, 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 78, 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 5.5859321250000002 2024-09-17T05:40:38.536 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a0073200 msgr2=0x7ff0a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a0073200 0x7ff0a0075710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0af000 tx=0x7ff0ac01b5c0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4070610 msgr2=0x7ff0c4156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4070610 0x7ff0c4156a40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400b410 tx=0x7ff0b400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 shutdown_connections 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40c2b10 0x7ff0c409f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a0073200 0x7ff0a0075710 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c40b5880 0x7ff0c40a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 --2- 172.21.15.44:0/343725506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c4070610 0x7ff0c4156a40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 >> 172.21.15.44:0/343725506 conn(0x7ff0c40ccaa0 msgr2=0x7ff0c406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 shutdown_connections 2024-09-17T05:40:38.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.532+0000 7ff0c8c00640 1 -- 172.21.15.44:0/343725506 wait complete. 2024-09-17T05:40:38.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:40:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.708+0000 7fc9af000640 1 -- 172.21.15.44:0/3245443107 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a80cf400 msgr2=0x7fc9a806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.708+0000 7fc9af000640 1 --2- 172.21.15.44:0/3245443107 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a80cf400 0x7fc9a806e160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc990009870 tx=0x7fc99001c740 comp rx=0 tx=0).stop 2024-09-17T05:40:38.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.708+0000 7fc9af000640 1 -- 172.21.15.44:0/3245443107 shutdown_connections 2024-09-17T05:40:38.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.708+0000 7fc9af000640 1 --2- 172.21.15.44:0/3245443107 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a80cf400 0x7fc9a806e160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.708+0000 7fc9af000640 1 -- 172.21.15.44:0/3245443107 >> 172.21.15.44:0/3245443107 conn(0x7fc9a80d1120 msgr2=0x7fc9a80d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.708+0000 7fc9af000640 1 -- 172.21.15.44:0/3245443107 shutdown_connections 2024-09-17T05:40:38.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.708+0000 7fc9af000640 1 -- 172.21.15.44:0/3245443107 wait complete. 2024-09-17T05:40:38.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 Processor -- start 2024-09-17T05:40:38.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 -- start start 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9a8072190 0x7fc9a80b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9a815f0e0 0x7fc9a80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a815dc80 0x7fc9a8159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a816a070 con 0x7fc9a815f0e0 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8169ef0 con 0x7fc9a8072190 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9af000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a816a1f0 con 0x7fc9a815dc80 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc99fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9a815f0e0 0x7fc9a80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc99fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9a815f0e0 0x7fc9a80b26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51212/0 (socket says 172.21.15.44:51212) 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc99fe00640 1 -- 172.21.15.44:0/41175973 learned_addr learned my addr 172.21.15.44:0/41175973 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.712+0000 7fc9a7e00640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9a8072190 0x7fc9a80b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9ad000640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a815dc80 0x7fc9a8159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc99fe00640 1 -- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a815dc80 msgr2=0x7fc9a8159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc99fe00640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a815dc80 0x7fc9a8159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc99fe00640 1 -- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9a8072190 msgr2=0x7fc9a80b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc99fe00640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9a8072190 0x7fc9a80b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc99fe00640 1 -- 172.21.15.44:0/41175973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a815e1e0 con 0x7fc9a815f0e0 2024-09-17T05:40:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc99fe00640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9a815f0e0 0x7fc9a80b26f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc990000c10 tx=0x7fc9900a5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9a4c00640 1 -- 172.21.15.44:0/41175973 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9900bb070 con 0x7fc9a815f0e0 2024-09-17T05:40:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9a4c00640 1 -- 172.21.15.44:0/41175973 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc990004330 con 0x7fc9a815f0e0 2024-09-17T05:40:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a815c2e0 con 0x7fc9a815f0e0 2024-09-17T05:40:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9a4c00640 1 -- 172.21.15.44:0/41175973 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9900b2040 con 0x7fc9a815f0e0 2024-09-17T05:40:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a815c8a0 con 0x7fc9a815f0e0 2024-09-17T05:40:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a806e160 con 0x7fc9a815f0e0 2024-09-17T05:40:38.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.716+0000 7fc9a4c00640 1 -- 172.21.15.44:0/41175973 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9900be070 con 0x7fc9a815f0e0 2024-09-17T05:40:38.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.720+0000 7fc9a4c00640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc984073200 0x7fc984075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:38.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.720+0000 7fc9a4c00640 1 -- 172.21.15.44:0/41175973 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fc99012d930 con 0x7fc9a815f0e0 2024-09-17T05:40:38.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.720+0000 7fc9a7e00640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc984073200 0x7fc984075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.720+0000 7fc9a7e00640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc984073200 0x7fc984075710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc998007fd0 tx=0x7fc998009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.724+0000 7fc9a4c00640 1 -- 172.21.15.44:0/41175973 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc990016450 con 0x7fc9a815f0e0 2024-09-17T05:40:38.805 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:40:38.804+0000 7fa106800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:40:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc9a80d1db0 con 0x7fc9a815f0e0 2024-09-17T05:40:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9a4c00640 1 -- 172.21.15.44:0/41175973 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7fc9900f8080 con 0x7fc9a815f0e0 2024-09-17T05:40:38.937 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc984073200 msgr2=0x7fc984075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc984073200 0x7fc984075710 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc998007fd0 tx=0x7fc998009040 comp rx=0 tx=0).stop 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9a815f0e0 msgr2=0x7fc9a80b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9a815f0e0 0x7fc9a80b26f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc990000c10 tx=0x7fc9900a5f70 comp rx=0 tx=0).stop 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 shutdown_connections 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9a815dc80 0x7fc9a8159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9a815f0e0 0x7fc9a80b26f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc984073200 0x7fc984075710 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 --2- 172.21.15.44:0/41175973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9a8072190 0x7fc9a80b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:38.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 >> 172.21.15.44:0/41175973 conn(0x7fc9a80d1120 msgr2=0x7fc9a815b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:38.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 shutdown_connections 2024-09-17T05:40:38.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:38.936+0000 7fc9af000640 1 -- 172.21.15.44:0/41175973 wait complete. 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:40:38.959 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:40:38.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:38.960 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:40:38.969 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42167sec preferred_lft 42167sec 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:40:38.970 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:40:38.971 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:40:38.972 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.972 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:40:38.972 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:40:38.972 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:40:38.972 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:40:38.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:38.973 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:40:39.037 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:40:39.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:39.040 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:40:39.097 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:40:39.097 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:40:39.097 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:40:39.097 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:40:39.097 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:40:39.097 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:40:39.098 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:40:39.098 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:40:39.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:40:39.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:40:39.098 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:40:39.098 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:40:39.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:40:39.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:40:39.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:39.240 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:40:39.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:40:39.249 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:40:39.250 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:40:39.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:39.250 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:40:39.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:40:39.311 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:39.367 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:40:39.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:40:39.367 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:39.422 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:40:39.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:39.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:39.525 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:39.525 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:40:39.526 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:40:39.543 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:39.544 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:40:39.544 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:40:39.544 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:40:39.544 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:40:39.553 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:40:39.554 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:40:39.554 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:40:39.554 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:40:39.554 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:40:39.554 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:40:39.554 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:40:39.554 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:40:39.558 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:40:39.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:39.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:39.580 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:40:39.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:40:39.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:40:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:client5855 2024-09-17T05:40:39.681 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:39.681 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:39.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:39.690 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-09-17T05:40:39.742 INFO:teuthology.orchestra.run.smithi044.stdout:file_undamaged 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> import json 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> import sys 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> try: 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-09-17T05:40:39.743 DEBUG:teuthology.orchestra.run.smithi044:> except OSError as e: 2024-09-17T05:40:39.744 DEBUG:teuthology.orchestra.run.smithi044:> sys.exit(e.errno) 2024-09-17T05:40:39.744 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:40:39.744 DEBUG:teuthology.orchestra.run.smithi044:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-17T05:40:39.744 DEBUG:teuthology.orchestra.run.smithi044:> print(json.dumps( 2024-09-17T05:40:39.744 DEBUG:teuthology.orchestra.run.smithi044:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-17T05:40:39.744 DEBUG:teuthology.orchestra.run.smithi044:> indent=2)) 2024-09-17T05:40:39.744 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:40:39.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:39 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-17T05:40:39.867 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:40:39.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:39.868 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-09-17T05:40:39.925 INFO:teuthology.orchestra.run.smithi044.stdout:2 2024-09-17T05:40:39.925 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:39.925 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:39.976 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:40:39.976 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:40:40.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:40:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 -- 172.21.15.44:0/473399250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 msgr2=0x7f27ec0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 --2- 172.21.15.44:0/473399250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec0cb880 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009c80 tx=0x7f27e401cd10 comp rx=0 tx=0).stop 2024-09-17T05:40:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 -- 172.21.15.44:0/473399250 shutdown_connections 2024-09-17T05:40:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 --2- 172.21.15.44:0/473399250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec0cb880 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 --2- 172.21.15.44:0/473399250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27ec072e50 0x7f27ec15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 -- 172.21.15.44:0/473399250 >> 172.21.15.44:0/473399250 conn(0x7f27ec0ccaa0 msgr2=0x7f27ec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 -- 172.21.15.44:0/473399250 shutdown_connections 2024-09-17T05:40:40.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.228+0000 7f27f3200640 1 -- 172.21.15.44:0/473399250 wait complete. 2024-09-17T05:40:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 Processor -- start 2024-09-17T05:40:40.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 -- start start 2024-09-17T05:40:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec06de50 0x7f27ec0c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27ec072e50 0x7f27ec159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec168f20 con 0x7f27ec0cb470 2024-09-17T05:40:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec168da0 con 0x7f27ec06de50 2024-09-17T05:40:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f27ec1690a0 con 0x7f27ec072e50 2024-09-17T05:40:40.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42034/0 (socket says 172.21.15.44:42034) 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 -- 172.21.15.44:0/2672892529 learned_addr learned my addr 172.21.15.44:0/2672892529 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27ebe00640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec06de50 0x7f27ec0c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 -- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27ec072e50 msgr2=0x7f27ec159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27e3e00640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27ec072e50 0x7f27ec159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27ec072e50 0x7f27ec159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 -- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec06de50 msgr2=0x7f27ec0c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec06de50 0x7f27ec0c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 -- 172.21.15.44:0/2672892529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec0c9150 con 0x7f27ec0cb470 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27ebe00640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec06de50 0x7f27ec0c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27e3e00640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27ec072e50 0x7f27ec159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f1200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec159ec0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f27e401b3c0 tx=0x7f27e4005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27e8c00640 1 -- 172.21.15.44:0/2672892529 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40bc070 con 0x7f27ec0cb470 2024-09-17T05:40:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27e8c00640 1 -- 172.21.15.44:0/2672892529 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27e40040f0 con 0x7f27ec0cb470 2024-09-17T05:40:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27e8c00640 1 -- 172.21.15.44:0/2672892529 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40b2040 con 0x7f27ec0cb470 2024-09-17T05:40:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec0c9430 con 0x7f27ec0cb470 2024-09-17T05:40:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.232+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec0c99f0 con 0x7f27ec0cb470 2024-09-17T05:40:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.236+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ec15e990 con 0x7f27ec0cb470 2024-09-17T05:40:40.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.236+0000 7f27e8c00640 1 -- 172.21.15.44:0/2672892529 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f27e4004540 con 0x7f27ec0cb470 2024-09-17T05:40:40.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.236+0000 7f27e8c00640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f27c8073200 0x7f27c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.236+0000 7f27e8c00640 1 -- 172.21.15.44:0/2672892529 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f27e412e390 con 0x7f27ec0cb470 2024-09-17T05:40:40.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.236+0000 7f27ebe00640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f27c8073200 0x7f27c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.240+0000 7f27ebe00640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f27c8073200 0x7f27c8075710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009ac0 tx=0x7f27dc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.240+0000 7f27e8c00640 1 -- 172.21.15.44:0/2672892529 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f27e40c5080 con 0x7f27ec0cb470 2024-09-17T05:40:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.424+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27ec0b5fa0 con 0x7f27ec0cb470 2024-09-17T05:40:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.424+0000 7f27e8c00640 1 -- 172.21.15.44:0/2672892529 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v78) ==== 80+0+120 (secure 0 0 0) 0x7f27e4016990 con 0x7f27ec0cb470 2024-09-17T05:40:40.427 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/330558786 2024-09-18T05:40:32.791517+0000 2024-09-17T05:40:40.427 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/330558786 2024-09-18T05:40:32.791517+0000 2024-09-17T05:40:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-17T05:40:40.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f27c8073200 msgr2=0x7f27c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f27c8073200 0x7f27c8075710 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009ac0 tx=0x7f27dc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 msgr2=0x7f27ec159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec159ec0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f27e401b3c0 tx=0x7f27e4005a60 comp rx=0 tx=0).stop 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 shutdown_connections 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27ec0cb470 0x7f27ec159ec0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27ec072e50 0x7f27ec159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f27c8073200 0x7f27c8075710 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 --2- 172.21.15.44:0/2672892529 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec06de50 0x7f27ec0c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 >> 172.21.15.44:0/2672892529 conn(0x7f27ec0ccaa0 msgr2=0x7f27ec156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 shutdown_connections 2024-09-17T05:40:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.428+0000 7f27f3200640 1 -- 172.21.15.44:0/2672892529 wait complete. 2024-09-17T05:40:40.449 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:40:40.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:40.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:40:40.475 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:40:40.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:40.476 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:40:40.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:40.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-09-17T05:40:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.736+0000 7fde47400640 1 -- 172.21.15.44:0/1082376662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 msgr2=0x7fde400d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.736+0000 7fde47400640 1 --2- 172.21.15.44:0/1082376662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 0x7fde400d08f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009870 tx=0x7fde2c01c7a0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.736+0000 7fde47400640 1 -- 172.21.15.44:0/1082376662 shutdown_connections 2024-09-17T05:40:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.736+0000 7fde47400640 1 --2- 172.21.15.44:0/1082376662 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 0x7fde400d08f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.736+0000 7fde47400640 1 -- 172.21.15.44:0/1082376662 >> 172.21.15.44:0/1082376662 conn(0x7fde400b35f0 msgr2=0x7fde400b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.736+0000 7fde47400640 1 -- 172.21.15.44:0/1082376662 shutdown_connections 2024-09-17T05:40:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.736+0000 7fde47400640 1 -- 172.21.15.44:0/1082376662 wait complete. 2024-09-17T05:40:40.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 Processor -- start 2024-09-17T05:40:40.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 -- start start 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde400af680 0x7fde40074920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde400cf120 0x7fde4009d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 0x7fde4015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde4016b050 con 0x7fde400af680 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fde4016aed0 con 0x7fde400cf120 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde47400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fde4016b1d0 con 0x7fde400d04e0 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde400af680 0x7fde40074920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde400af680 0x7fde40074920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42050/0 (socket says 172.21.15.44:42050) 2024-09-17T05:40:40.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 -- 172.21.15.44:0/3444618295 learned_addr learned my addr 172.21.15.44:0/3444618295 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde3fe00640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde400cf120 0x7fde4009d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde45400640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 0x7fde4015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 -- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 msgr2=0x7fde4015b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 0x7fde4015b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 -- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde400cf120 msgr2=0x7fde4009d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde400cf120 0x7fde4009d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 -- 172.21.15.44:0/3444618295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4009e0d0 con 0x7fde400af680 2024-09-17T05:40:40.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.740+0000 7fde44a00640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde400af680 0x7fde40074920 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fde3400c760 tx=0x7fde3400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde3cc00640 1 -- 172.21.15.44:0/3444618295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34016020 con 0x7fde400af680 2024-09-17T05:40:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4009a360 con 0x7fde400af680 2024-09-17T05:40:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde3cc00640 1 -- 172.21.15.44:0/3444618295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde3400ab60 con 0x7fde400af680 2024-09-17T05:40:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde3cc00640 1 -- 172.21.15.44:0/3444618295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3400ce10 con 0x7fde400af680 2024-09-17T05:40:40.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4009a920 con 0x7fde400af680 2024-09-17T05:40:40.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde3cc00640 1 -- 172.21.15.44:0/3444618295 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fde34019020 con 0x7fde400af680 2024-09-17T05:40:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde3cc00640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde20073200 0x7fde20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.744+0000 7fde3cc00640 1 -- 172.21.15.44:0/3444618295 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fde340946a0 con 0x7fde400af680 2024-09-17T05:40:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde20073200 0x7fde20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 Processor -- start 2024-09-17T05:40:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 -- start start 2024-09-17T05:40:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde20073200 0x7fde20075710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0af000 tx=0x7fde2c01afe0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521b86620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a13ce0 0x55d521b86b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a0d9a0 0x55d521b870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d521998a60 con 0x55d521a13ce0 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d521987e90 con 0x55d521a27940 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55d52198bca0 con 0x55d521a0d9a0 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a13ce0 0x55d521b86b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a13ce0 0x55d521b86b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42058/0 (socket says 172.21.15.44:42058) 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 -- 172.21.15.44:0/223356866 learned_addr learned my addr 172.21.15.44:0/223356866 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde44a00640 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521b86620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde45400640 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a0d9a0 0x55d521b870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 -- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a0d9a0 msgr2=0x55d521b870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a0d9a0 0x55d521b870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 -- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 msgr2=0x55d521b86620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521b86620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 -- 172.21.15.44:0/223356866 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5219d1060 con 0x55d521a13ce0 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde44a00640 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521b86620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde3fe00640 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a13ce0 0x55d521b86b60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fde2c01cc80 tx=0x7fde2c0a7050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e60abccdfdc4321 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde31200640 1 -- 172.21.15.44:0/223356866 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0c9070 con 0x55d521a13ce0 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde31200640 1 -- 172.21.15.44:0/223356866 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde2c0a5950 con 0x55d521a13ce0 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde31200640 1 -- 172.21.15.44:0/223356866 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0b2040 con 0x55d521a13ce0 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 -- 172.21.15.44:0/223356866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a13ce0 msgr2=0x55d521b86b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a13ce0 0x55d521b86b60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fde2c01cc80 tx=0x7fde2c0a7050 comp rx=0 tx=0).stop 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 -- 172.21.15.44:0/223356866 shutdown_connections 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a0d9a0 0x55d521b870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a13ce0 0x55d521b86b60 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 --2- 172.21.15.44:0/223356866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521b86620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.748+0000 7fde4ec15000 1 -- 172.21.15.44:0/223356866 >> 172.21.15.44:0/223356866 conn(0x55d521646330 msgr2=0x55d521b3b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 -- 172.21.15.44:0/223356866 shutdown_connections 2024-09-17T05:40:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 -- 172.21.15.44:0/223356866 wait complete. 2024-09-17T05:40:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 -- start start 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 Processor -- start 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a0d9a0 0x55d521b85e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521b41ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a27940 0x55d521b423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d5219cbb80 con 0x55d521a27940 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d521931970 con 0x55d521a0d9a0 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55d52193dbd0 con 0x55d521a13ce0 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde4ec15000 10 client.0 _ll_register_callbacks cb 0x55d52192e410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a27940 0x55d521b423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde3fe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521b41ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a27940 0x55d521b423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42070/0 (socket says 172.21.15.44:42070) 2024-09-17T05:40:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde44a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a0d9a0 0x55d521b85e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 -- 172.21.15.44:0/2405027836 learned_addr learned my addr 172.21.15.44:0/2405027836 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 -- 172.21.15.44:0/2405027836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 msgr2=0x55d521b41ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521b41ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 -- 172.21.15.44:0/2405027836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a0d9a0 msgr2=0x55d521b85e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a0d9a0 0x55d521b85e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 -- 172.21.15.44:0/2405027836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d521930b50 con 0x55d521a27940 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde45400640 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a27940 0x55d521b423e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fde38005950 tx=0x7fde38001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3ebcbb58b6e160 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.752+0000 7fde25600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 1 -- 172.21.15.44:0/2405027836 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38013570 con 0x55d521a27940 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 1 -- 172.21.15.44:0/2405027836 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fde38013710 con 0x55d521a27940 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d521920200 con 0x55d521a27940 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 1 -- 172.21.15.44:0/2405027836 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fde38021050 con 0x55d521a27940 2024-09-17T05:40:40.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 10 client.6543 fetch_fsmap learned FSMap version 52 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55d5219260c0 con 0x55d521a27940 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 1 -- 172.21.15.44:0/2405027836 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d521920200 con 0x55d521a27940 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 1 -- 172.21.15.44:0/2405027836 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7fde38024020 con 0x55d521a27940 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 10 client.6543 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 10 client.6543 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 20 client.6543 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d52162ab10 0x55d521b480e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 4 client.6543 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d52199a9b0 con 0x55d52162ab10 2024-09-17T05:40:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde44a00640 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d52162ab10 0x55d521b480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde44a00640 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d52162ab10 0x55d521b480e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a230687c27785b66 server_cookie=4e5f5f42f552295b in_seq=0 out_seq=0 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 10 client.6543 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 1 -- 172.21.15.44:0/2405027836 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d52199a9b0 con 0x55d52162ab10 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 10 client.6543 handle_command_reply: tid=0 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 client.6543 shutdown 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a27940 msgr2=0x55d521b423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a27940 0x55d521b423e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fde38005950 tx=0x7fde38001930 comp rx=0 tx=0).stop 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 shutdown_connections 2024-09-17T05:40:40.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d52162ab10 0x55d521b480e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a27940 0x55d521b423e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521b41ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 --2- 172.21.15.44:0/2405027836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a0d9a0 0x55d521b85e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 >> 172.21.15.44:0/2405027836 conn(0x55d521646330 msgr2=0x55d521b3b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde25600640 0 client.6543 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 shutdown_connections 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 1 -- 172.21.15.44:0/2405027836 wait complete. 2024-09-17T05:40:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.756+0000 7fde4ec15000 20 client.6543 trim_cache size 0 max 16384 2024-09-17T05:40:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 Processor -- start 2024-09-17T05:40:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 -- start start 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bf75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a13ce0 0x55d521bf7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a27940 0x55d521bf8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde4009b390 con 0x55d521a0d9a0 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fde401fd360 con 0x55d521a13ce0 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fde400cbce0 con 0x55d521a27940 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde44a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bf75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde44a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bf75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42082/0 (socket says 172.21.15.44:42082) 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde44a00640 1 -- 172.21.15.44:0/1234209760 learned_addr learned my addr 172.21.15.44:0/1234209760 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde3fe00640 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a13ce0 0x55d521bf7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.776+0000 7fde45400640 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a27940 0x55d521bf8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde44a00640 1 -- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a27940 msgr2=0x55d521bf8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde44a00640 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a27940 0x55d521bf8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde44a00640 1 -- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a13ce0 msgr2=0x55d521bf7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde44a00640 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a13ce0 0x55d521bf7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde44a00640 1 -- 172.21.15.44:0/1234209760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d521a0cde0 con 0x55d521a0d9a0 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde44a00640 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bf75f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fde3405ecc0 tx=0x7fde3401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4551ea5674994e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde27e00640 1 -- 172.21.15.44:0/1234209760 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde340686e0 con 0x55d521a0d9a0 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde27e00640 1 -- 172.21.15.44:0/1234209760 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde3405b0b0 con 0x55d521a0d9a0 2024-09-17T05:40:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde27e00640 1 -- 172.21.15.44:0/1234209760 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3405dfb0 con 0x55d521a0d9a0 2024-09-17T05:40:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 -- 172.21.15.44:0/1234209760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 msgr2=0x55d521bf75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bf75f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fde3405ecc0 tx=0x7fde3401d040 comp rx=0 tx=0).stop 2024-09-17T05:40:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 -- 172.21.15.44:0/1234209760 shutdown_connections 2024-09-17T05:40:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a27940 0x55d521bf8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a13ce0 0x55d521bf7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1234209760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bf75f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 -- 172.21.15.44:0/1234209760 >> 172.21.15.44:0/1234209760 conn(0x55d521646330 msgr2=0x55d521b96380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 -- 172.21.15.44:0/1234209760 shutdown_connections 2024-09-17T05:40:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 -- 172.21.15.44:0/1234209760 wait complete. 2024-09-17T05:40:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 -- start start 2024-09-17T05:40:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.780+0000 7fde4ec15000 1 Processor -- start 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bfbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521bfc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521bfc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d521953f60 con 0x55d521a0d9a0 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d521953780 con 0x55d521a27940 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55d52198afb0 con 0x55d521a13ce0 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 10 client.0 _ll_register_callbacks cb 0x7fde38003b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bfbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bfbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42098/0 (socket says 172.21.15.44:42098) 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 -- 172.21.15.44:0/1680578023 learned_addr learned my addr 172.21.15.44:0/1680578023 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde3fe00640 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521bfc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde45400640 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521bfc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 -- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 msgr2=0x55d521bfc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521bfc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 -- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 msgr2=0x55d521bfc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521bfc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 -- 172.21.15.44:0/1680578023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d52191e640 con 0x55d521a0d9a0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde44a00640 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bfbc80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fde34094010 tx=0x7fde34007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cf13b91af40788 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 1 -- 172.21.15.44:0/1680578023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3405e1b0 con 0x55d521a0d9a0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 1 -- 172.21.15.44:0/1680578023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fde34066b20 con 0x55d521a0d9a0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde3405b0b0 con 0x55d521a0d9a0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 1 -- 172.21.15.44:0/1680578023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fde34066d40 con 0x55d521a0d9a0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 10 client.6549 fetch_fsmap learned FSMap version 52 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55d521950b10 con 0x55d521a0d9a0 2024-09-17T05:40:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 1 -- 172.21.15.44:0/1680578023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde3405b0b0 con 0x55d521a0d9a0 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 1 -- 172.21.15.44:0/1680578023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7fde3405a6a0 con 0x55d521a0d9a0 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 10 client.6549 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 10 client.6549 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 20 client.6549 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d521618b70 0x55d521bb7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 4 client.6549 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) -- 0x55d521996460 con 0x55d521618b70 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde3fe00640 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d521618b70 0x55d521bb7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 10 client.6549 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde3fe00640 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d521618b70 0x55d521bb7330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae2d8f83a9d0049 server_cookie=b8651b1b0a1b7123 in_seq=0 out_seq=0 2024-09-17T05:40:40.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 1 -- 172.21.15.44:0/1680578023 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d521996460 con 0x55d521618b70 2024-09-17T05:40:40.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 10 client.6549 handle_command_reply: tid=0 2024-09-17T05:40:40.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 client.6549 shutdown 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 msgr2=0x55d521bfbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bfbc80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fde34094010 tx=0x7fde34007ad0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 shutdown_connections 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55d521618b70 0x55d521bb7330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d521a27940 0x55d521bfc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d521a13ce0 0x55d521bfc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 --2- 172.21.15.44:0/1680578023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d521a0d9a0 0x55d521bfbc80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde25600640 0 client.6549 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 >> 172.21.15.44:0/1680578023 conn(0x55d521646330 msgr2=0x55d521b3ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.784+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 shutdown_connections 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde4ec15000 1 -- 172.21.15.44:0/1680578023 wait complete. 2024-09-17T05:40:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde4ec15000 20 client.6549 trim_cache size 0 max 16384 2024-09-17T05:40:40.791 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:40:40.791 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:40:40.791 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "a2e333e2-57f6-4b12-968e-f9095df34174", 2024-09-17T05:40:40.791 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:40:40.791 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde20073200 msgr2=0x7fde20075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde20073200 0x7fde20075710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0af000 tx=0x7fde2c01afe0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde400af680 msgr2=0x7fde40074920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde400af680 0x7fde40074920 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fde3400c760 tx=0x7fde3400cc20 comp rx=0 tx=0).stop 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 shutdown_connections 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fde400d04e0 0x7fde4015b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fde20073200 0x7fde20075710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde400cf120 0x7fde4009d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 --2- 172.21.15.44:0/3444618295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde400af680 0x7fde40074920 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 >> 172.21.15.44:0/3444618295 conn(0x7fde400b35f0 msgr2=0x7fde4015e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 shutdown_connections 2024-09-17T05:40:40.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.788+0000 7fde47400640 1 -- 172.21.15.44:0/3444618295 wait complete. 2024-09-17T05:40:40.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:40:40.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-09-17T05:40:40.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 -- 172.21.15.44:0/501139529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36e8005290 msgr2=0x7f36e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 --2- 172.21.15.44:0/501139529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36e8005290 0x7f36e800b9d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f36f800c600 tx=0x7f36f801f920 comp rx=0 tx=0).stop 2024-09-17T05:40:40.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 -- 172.21.15.44:0/501139529 shutdown_connections 2024-09-17T05:40:40.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 --2- 172.21.15.44:0/501139529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36e8005290 0x7f36e800b9d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 -- 172.21.15.44:0/501139529 >> 172.21.15.44:0/501139529 conn(0x7f37000ccaa0 msgr2=0x7f37000cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 -- 172.21.15.44:0/501139529 shutdown_connections 2024-09-17T05:40:40.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 -- 172.21.15.44:0/501139529 wait complete. 2024-09-17T05:40:40.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 Processor -- start 2024-09-17T05:40:40.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.968+0000 7f3707600640 1 -- start start 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e8005290 0x7f370009f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370009c340 0x7f37001f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f370009d250 0x7f370009ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3700074770 con 0x7f370009c340 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f37000745f0 con 0x7f36e8005290 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f37000700d0 con 0x7f370009d250 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370009c340 0x7f37001f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370009c340 0x7f37001f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42106/0 (socket says 172.21.15.44:42106) 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 -- 172.21.15.44:0/3738941412 learned_addr learned my addr 172.21.15.44:0/3738941412 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3704c00640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e8005290 0x7f370009f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3705600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f370009d250 0x7f370009ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 -- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f370009d250 msgr2=0x7f370009ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f370009d250 0x7f370009ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 -- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e8005290 msgr2=0x7f370009f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e8005290 0x7f370009f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 -- 172.21.15.44:0/3738941412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37000a1500 con 0x7f370009c340 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3705600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f370009d250 0x7f370009ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36ffe00640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370009c340 0x7f37001f4da0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f36ec011890 tx=0x7f36ec011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36fcc00640 1 -- 172.21.15.44:0/3738941412 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00f9a0 con 0x7f370009c340 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36fcc00640 1 -- 172.21.15.44:0/3738941412 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36ec00fb40 con 0x7f370009c340 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f36fcc00640 1 -- 172.21.15.44:0/3738941412 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec003600 con 0x7f370009c340 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370009b580 con 0x7f370009c340 2024-09-17T05:40:40.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.972+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370009bb40 con 0x7f370009c340 2024-09-17T05:40:40.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f36fcc00640 1 -- 172.21.15.44:0/3738941412 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f36ec0037a0 con 0x7f370009c340 2024-09-17T05:40:40.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f36fcc00640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e0073230 0x7f36e0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f36fcc00640 1 -- 172.21.15.44:0/3738941412 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f36ec0953d0 con 0x7f370009c340 2024-09-17T05:40:40.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f370ee49000 1 Processor -- start 2024-09-17T05:40:40.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f3704c00640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e0073230 0x7f36e0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f370ee49000 1 -- start start 2024-09-17T05:40:40.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f3704c00640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e0073230 0x7f36e0075740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006e10 tx=0x7f36f40062f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.976+0000 7f370ee49000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f40c6d0 0x56466f5789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f578f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f127aa0 0x56466f579470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56466f417cd0 con 0x56466f40c6d0 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56466f32d330 con 0x56466f127aa0 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56466f38abb0 con 0x56466f063890 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f40c6d0 0x56466f5789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f40c6d0 0x56466f5789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42116/0 (socket says 172.21.15.44:42116) 2024-09-17T05:40:40.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 -- 172.21.15.44:0/2848565133 learned_addr learned my addr 172.21.15.44:0/2848565133 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f36ffe00640 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f578f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3705600640 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f127aa0 0x56466f579470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 -- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 msgr2=0x56466f578f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f578f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 -- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f127aa0 msgr2=0x56466f579470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f127aa0 0x56466f579470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 -- 172.21.15.44:0/2848565133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466f32ec80 con 0x56466f40c6d0 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3705600640 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f127aa0 0x56466f579470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f3704c00640 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f40c6d0 0x56466f5789f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f36f4001860 tx=0x7f36f4006050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e8c048d7afbbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f36f1200640 1 -- 172.21.15.44:0/2848565133 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f40129c0 con 0x56466f40c6d0 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f36f1200640 1 -- 172.21.15.44:0/2848565133 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36f4024020 con 0x56466f40c6d0 2024-09-17T05:40:40.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f36f1200640 1 -- 172.21.15.44:0/2848565133 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4012c70 con 0x56466f40c6d0 2024-09-17T05:40:40.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- 172.21.15.44:0/2848565133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f40c6d0 msgr2=0x56466f5789f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f40c6d0 0x56466f5789f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f36f4001860 tx=0x7f36f4006050 comp rx=0 tx=0).stop 2024-09-17T05:40:40.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- 172.21.15.44:0/2848565133 shutdown_connections 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f127aa0 0x56466f579470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f578f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 --2- 172.21.15.44:0/2848565133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f40c6d0 0x56466f5789f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- 172.21.15.44:0/2848565133 >> 172.21.15.44:0/2848565133 conn(0x56466f0375c0 msgr2=0x56466f535ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- 172.21.15.44:0/2848565133 shutdown_connections 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- 172.21.15.44:0/2848565133 wait complete. 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 -- start start 2024-09-17T05:40:40.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.980+0000 7f370ee49000 1 Processor -- start 2024-09-17T05:40:40.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f534a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f534f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f53b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56466f37ddf0 con 0x56466f127aa0 2024-09-17T05:40:40.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56466f379fe0 con 0x56466f40c6d0 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56466f31f4d0 con 0x56466f063890 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 10 client.0 _ll_register_callbacks cb 0x56466f2fd7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f534f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f534f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42118/0 (socket says 172.21.15.44:42118) 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 -- 172.21.15.44:0/1674871564 learned_addr learned my addr 172.21.15.44:0/1674871564 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f3704c00640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f534a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f3705600640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f53b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 -- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 msgr2=0x56466f534a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f534a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 -- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 msgr2=0x56466f53b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f53b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 -- 172.21.15.44:0/1674871564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466f318210 con 0x56466f127aa0 2024-09-17T05:40:40.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f3704c00640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f534a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f3705600640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f53b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36ffe00640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f534f40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f36ec05c2c0 tx=0x7f36ec05f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497d78a77303e8e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36e5600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36e5600640 1 -- 172.21.15.44:0/1674871564 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec04d030 con 0x56466f127aa0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36e5600640 1 -- 172.21.15.44:0/1674871564 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f36ec069200 con 0x56466f127aa0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56466f312350 con 0x56466f127aa0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36e5600640 1 -- 172.21.15.44:0/1674871564 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f36ec07e050 con 0x56466f127aa0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 10 client.6561 fetch_fsmap learned FSMap version 52 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x56466f2fefc0 con 0x56466f127aa0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36e5600640 1 -- 172.21.15.44:0/1674871564 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56466f312350 con 0x56466f127aa0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f36e5600640 1 -- 172.21.15.44:0/1674871564 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7f36ec018070 con 0x56466f127aa0 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 10 client.6561 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 10 client.6561 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:40:40.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 20 client.6561 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f01c930 0x56466f57fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 4 client.6561 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:40:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56466f38cb00 con 0x56466f01c930 2024-09-17T05:40:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.984+0000 7f3704c00640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f01c930 0x56466f57fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f3704c00640 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f01c930 0x56466f57fe80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db031347e1c4dbf4 server_cookie=38e74435cac21747 in_seq=0 out_seq=0 2024-09-17T05:40:40.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f36e5600640 10 client.6561 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:40.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f36e5600640 1 -- 172.21.15.44:0/1674871564 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56466f38cb00 con 0x56466f01c930 2024-09-17T05:40:40.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f36e5600640 10 client.6561 handle_command_reply: tid=0 2024-09-17T05:40:40.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 client.6561 shutdown 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 msgr2=0x56466f534f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f534f40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f36ec05c2c0 tx=0x7f36ec05f330 comp rx=0 tx=0).stop 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 shutdown_connections 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f01c930 0x56466f57fe80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f53b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f534f40 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 --2- 172.21.15.44:0/1674871564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f534a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f36e5600640 0 client.6561 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 >> 172.21.15.44:0/1674871564 conn(0x56466f0375c0 msgr2=0x56466f52dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 shutdown_connections 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 1 -- 172.21.15.44:0/1674871564 wait complete. 2024-09-17T05:40:40.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:40.988+0000 7f370ee49000 20 client.6561 trim_cache size 0 max 16384 2024-09-17T05:40:41.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.004+0000 7f370ee49000 1 Processor -- start 2024-09-17T05:40:41.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- start start 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f063890 0x56466f5ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ea730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f40c6d0 0x56466f5eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56466f533b20 con 0x56466f127aa0 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3700202ad0 con 0x56466f063890 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3700201af0 con 0x56466f40c6d0 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ea730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ea730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42126/0 (socket says 172.21.15.44:42126) 2024-09-17T05:40:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 -- 172.21.15.44:0/3092077247 learned_addr learned my addr 172.21.15.44:0/3092077247 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 -- 172.21.15.44:0/3092077247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f40c6d0 msgr2=0x56466f5eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 --2- 172.21.15.44:0/3092077247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f40c6d0 0x56466f5eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 -- 172.21.15.44:0/3092077247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f063890 msgr2=0x56466f5ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 --2- 172.21.15.44:0/3092077247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f063890 0x56466f5ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 -- 172.21.15.44:0/3092077247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56466f3d7680 con 0x56466f127aa0 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36ffe00640 1 --2- 172.21.15.44:0/3092077247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ea730 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f36ec063010 tx=0x7f36ec060360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d6fd4e21c4d7f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36e7e00640 1 -- 172.21.15.44:0/3092077247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec04d040 con 0x56466f127aa0 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36e7e00640 1 -- 172.21.15.44:0/3092077247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36ec0645e0 con 0x56466f127aa0 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f36e7e00640 1 -- 172.21.15.44:0/3092077247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec05f450 con 0x56466f127aa0 2024-09-17T05:40:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- 172.21.15.44:0/3092077247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 msgr2=0x56466f5ea730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 --2- 172.21.15.44:0/3092077247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ea730 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f36ec063010 tx=0x7f36ec060360 comp rx=0 tx=0).stop 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- 172.21.15.44:0/3092077247 shutdown_connections 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 --2- 172.21.15.44:0/3092077247 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f40c6d0 0x56466f5eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 --2- 172.21.15.44:0/3092077247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ea730 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 --2- 172.21.15.44:0/3092077247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f063890 0x56466f5ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- 172.21.15.44:0/3092077247 >> 172.21.15.44:0/3092077247 conn(0x56466f0375c0 msgr2=0x56466f58afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- 172.21.15.44:0/3092077247 shutdown_connections 2024-09-17T05:40:41.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.008+0000 7f370ee49000 1 -- 172.21.15.44:0/3092077247 wait complete. 2024-09-17T05:40:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 -- start start 2024-09-17T05:40:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 Processor -- start 2024-09-17T05:40:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f5ee440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f5eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37002014a0 con 0x56466f127aa0 2024-09-17T05:40:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3700200e80 con 0x56466f40c6d0 2024-09-17T05:40:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56466f03f680 con 0x56466f063890 2024-09-17T05:40:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 10 client.0 _ll_register_callbacks cb 0x7f36ec0117e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:40:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ee980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:42138/0 (socket says 172.21.15.44:42138) 2024-09-17T05:40:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 -- 172.21.15.44:0/964102154 learned_addr learned my addr 172.21.15.44:0/964102154 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:40:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f3704c00640 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f5ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f3705600640 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f5eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 -- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 msgr2=0x56466f5ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f5ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 -- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 msgr2=0x56466f5eeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f5eeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 -- 172.21.15.44:0/964102154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56466f3440b0 con 0x56466f127aa0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36ffe00640 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ee980 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f36ec005c50 tx=0x7f36ec05b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a36d0aca0a23c25 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36e5600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36e5600640 1 -- 172.21.15.44:0/964102154 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec06d020 con 0x56466f127aa0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36e5600640 1 -- 172.21.15.44:0/964102154 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f36ec05ed60 con 0x56466f127aa0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36ec0645e0 con 0x56466f127aa0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36e5600640 1 -- 172.21.15.44:0/964102154 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f36ec05f450 con 0x56466f127aa0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 10 client.6567 fetch_fsmap learned FSMap version 52 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x56466f310610 con 0x56466f127aa0 2024-09-17T05:40:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36e5600640 1 -- 172.21.15.44:0/964102154 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36ec0645e0 con 0x56466f127aa0 2024-09-17T05:40:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f36e5600640 1 -- 172.21.15.44:0/964102154 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7f36ec018030 con 0x56466f127aa0 2024-09-17T05:40:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 10 client.6567 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T05:40:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 10 client.6567 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:40:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.012+0000 7f370ee49000 20 client.6567 populate_metadata read hostname 'smithi044' 2024-09-17T05:40:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f00a990 0x56466f52f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:40:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 4 client.6567 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:40:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56466f3885b0 con 0x56466f00a990 2024-09-17T05:40:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3704c00640 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f00a990 0x56466f52f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:40:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3704c00640 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f00a990 0x56466f52f8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8990cdd4dd3195a server_cookie=6cb86020c67e22a8 in_seq=0 out_seq=0 2024-09-17T05:40:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f36e5600640 10 client.6567 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f36e5600640 1 -- 172.21.15.44:0/964102154 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+576 (crc 0 0 0) 0x56466f3885b0 con 0x56466f00a990 2024-09-17T05:40:41.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f36e5600640 10 client.6567 handle_command_reply: tid=0 2024-09-17T05:40:41.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 client.6567 shutdown 2024-09-17T05:40:41.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 msgr2=0x56466f5ee980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:41.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ee980 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f36ec005c50 tx=0x7f36ec05b9a0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 shutdown_connections 2024-09-17T05:40:41.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x56466f00a990 0x56466f52f8f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56466f40c6d0 0x56466f5eeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56466f127aa0 0x56466f5ee980 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f36e5600640 0 client.6567 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:40:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 --2- 172.21.15.44:0/964102154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56466f063890 0x56466f5ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 >> 172.21.15.44:0/964102154 conn(0x56466f0375c0 msgr2=0x56466f53a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 shutdown_connections 2024-09-17T05:40:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 1 -- 172.21.15.44:0/964102154 wait complete. 2024-09-17T05:40:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f370ee49000 20 client.6567 trim_cache size 0 max 16384 2024-09-17T05:40:41.025 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:40:41.025 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:40:41.025 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:40:41.025 INFO:teuthology.orchestra.run.smithi044.stdout: "a2e333e2-57f6-4b12-968e-f9095df34174": { 2024-09-17T05:40:41.025 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "a2e333e2-57f6-4b12-968e-f9095df34174", 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive" 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: "a2e333e2-57f6-4b12-968e-f9095df34174": { 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:40:40.784638+0000", 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:40:41.026 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:40:41.027 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:40:41.027 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:40:41.027 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:40:41.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:41.027 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:40:41.027 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e0073230 msgr2=0x7f36e0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e0073230 0x7f36e0075740 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f36f4006e10 tx=0x7f36f40062f0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370009c340 msgr2=0x7f37001f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370009c340 0x7f37001f4da0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f36ec011890 tx=0x7f36ec011d50 comp rx=0 tx=0).stop 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 shutdown_connections 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f370009d250 0x7f370009ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f370009c340 0x7f37001f4da0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f36e0073230 0x7f36e0075740 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 --2- 172.21.15.44:0/3738941412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e8005290 0x7f370009f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:40:41.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 >> 172.21.15.44:0/3738941412 conn(0x7f37000ccaa0 msgr2=0x7f37000b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:40:41.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 shutdown_connections 2024-09-17T05:40:41.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:40:41.016+0000 7f3707600640 1 -- 172.21.15.44:0/3738941412 wait complete. 2024-09-17T05:40:41.037 INFO:tasks.cephfs.filesystem:scrub status for tag:a2e333e2-57f6-4b12-968e-f9095df34174 - {'path': '/subdir', 'tag': 'a2e333e2-57f6-4b12-968e-f9095df34174', 'options': 'recursive'} 2024-09-17T05:40:42.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:42.179 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:40:44.062 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:40:44.060+0000 7f2ed9000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T05:41:11.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:11.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-09-17T05:41:11.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.212+0000 7fa594600640 1 -- 172.21.15.44:0/1273209161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 msgr2=0x7fa57400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.212+0000 7fa594600640 1 --2- 172.21.15.44:0/1273209161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa57400b9d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa584001dc0 tx=0x7fa58401cb30 comp rx=0 tx=0).stop 2024-09-17T05:41:11.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.212+0000 7fa594600640 1 -- 172.21.15.44:0/1273209161 shutdown_connections 2024-09-17T05:41:11.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.212+0000 7fa594600640 1 --2- 172.21.15.44:0/1273209161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa57400b9d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.212+0000 7fa594600640 1 -- 172.21.15.44:0/1273209161 >> 172.21.15.44:0/1273209161 conn(0x7fa58c0ccaa0 msgr2=0x7fa58c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.212+0000 7fa594600640 1 -- 172.21.15.44:0/1273209161 shutdown_connections 2024-09-17T05:41:11.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.212+0000 7fa594600640 1 -- 172.21.15.44:0/1273209161 wait complete. 2024-09-17T05:41:11.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 Processor -- start 2024-09-17T05:41:11.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 -- start start 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa58c0c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa58c15d580 0x7fa58c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa58c1f5930 0x7fa58c1f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06e5f0 con 0x7fa574005360 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06e470 con 0x7fa58c15d580 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa594600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c15e990 con 0x7fa58c1f5930 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa591c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa58c0c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa591c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa58c0c4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59980/0 (socket says 172.21.15.44:59980) 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.216+0000 7fa591c00640 1 -- 172.21.15.44:0/1590423011 learned_addr learned my addr 172.21.15.44:0/1590423011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591200640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa58c15d580 0x7fa58c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591c00640 1 -- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa58c1f5930 msgr2=0x7fa58c1f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa592600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa58c1f5930 0x7fa58c1f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591c00640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa58c1f5930 0x7fa58c1f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591c00640 1 -- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa58c15d580 msgr2=0x7fa58c0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591c00640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa58c15d580 0x7fa58c0c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591c00640 1 -- 172.21.15.44:0/1590423011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c0c3cd0 con 0x7fa574005360 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591200640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa58c15d580 0x7fa58c0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa592600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa58c1f5930 0x7fa58c1f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa591c00640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa58c0c4e90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa580001980 tx=0x7fa5800127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa589600640 1 -- 172.21.15.44:0/1590423011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580013860 con 0x7fa574005360 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa589600640 1 -- 172.21.15.44:0/1590423011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa580013a00 con 0x7fa574005360 2024-09-17T05:41:11.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa589600640 1 -- 172.21.15.44:0/1590423011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580013e50 con 0x7fa574005360 2024-09-17T05:41:11.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c0c3f90 con 0x7fa574005360 2024-09-17T05:41:11.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c0c4550 con 0x7fa574005360 2024-09-17T05:41:11.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.220+0000 7fa589600640 1 -- 172.21.15.44:0/1590423011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa58001e480 con 0x7fa574005360 2024-09-17T05:41:11.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa589600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa56c0733a0 0x7fa56c0758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa589600640 1 -- 172.21.15.44:0/1590423011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fa580097da0 con 0x7fa574005360 2024-09-17T05:41:11.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591200640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa56c0733a0 0x7fa56c0758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 Processor -- start 2024-09-17T05:41:11.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 -- start start 2024-09-17T05:41:11.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591200640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa56c0733a0 0x7fa56c0758b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa578009a40 tx=0x7fa5780091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fae29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f5cd890 0x55747fae2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f691aa0 0x55747fae3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55747f981cd0 con 0x55747f9766d0 2024-09-17T05:41:11.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55747f897330 con 0x55747f5cd890 2024-09-17T05:41:11.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55747f8f4bb0 con 0x55747f691aa0 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f5cd890 0x55747fae2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f5cd890 0x55747fae2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:44318/0 (socket says 172.21.15.44:44318) 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591200640 1 -- 172.21.15.44:0/1104826295 learned_addr learned my addr 172.21.15.44:0/1104826295 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fae29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa592600640 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f691aa0 0x55747fae3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591c00640 1 -- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f691aa0 msgr2=0x55747fae3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591c00640 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f691aa0 0x55747fae3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591c00640 1 -- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f5cd890 msgr2=0x55747fae2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591c00640 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f5cd890 0x55747fae2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591c00640 1 -- 172.21.15.44:0/1104826295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747f898c80 con 0x55747f9766d0 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591200640 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f5cd890 0x55747fae2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa591c00640 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fae29f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa5800621d0 tx=0x7fa580061f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703042151fc59464 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.224+0000 7fa57e000640 1 -- 172.21.15.44:0/1104826295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5800624d0 con 0x55747f9766d0 2024-09-17T05:41:11.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa57e000640 1 -- 172.21.15.44:0/1104826295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa580066fb0 con 0x55747f9766d0 2024-09-17T05:41:11.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa57e000640 1 -- 172.21.15.44:0/1104826295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa580069400 con 0x55747f9766d0 2024-09-17T05:41:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 -- 172.21.15.44:0/1104826295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 msgr2=0x55747fae29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fae29f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa5800621d0 tx=0x7fa580061f50 comp rx=0 tx=0).stop 2024-09-17T05:41:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 -- 172.21.15.44:0/1104826295 shutdown_connections 2024-09-17T05:41:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f691aa0 0x55747fae3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f5cd890 0x55747fae2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1104826295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fae29f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 -- 172.21.15.44:0/1104826295 >> 172.21.15.44:0/1104826295 conn(0x55747f5a15c0 msgr2=0x55747fa9fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 -- 172.21.15.44:0/1104826295 shutdown_connections 2024-09-17T05:41:11.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 -- 172.21.15.44:0/1104826295 wait complete. 2024-09-17T05:41:11.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 -- start start 2024-09-17T05:41:11.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.228+0000 7fa59be5c000 1 Processor -- start 2024-09-17T05:41:11.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747fa9e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 0x55747fa9ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747faa55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55747f8e7df0 con 0x55747f9766d0 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55747f8e3fe0 con 0x55747f691aa0 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55747f8894d0 con 0x55747f5cd890 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 10 client.0 _ll_register_callbacks cb 0x55747f8677f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747faa55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747faa55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59990/0 (socket says 172.21.15.44:59990) 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 -- 172.21.15.44:0/1675360746 learned_addr learned my addr 172.21.15.44:0/1675360746 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa591c00640 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747fa9e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa591200640 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 0x55747fa9ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 -- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 msgr2=0x55747fa9e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747fa9e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 -- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 msgr2=0x55747fa9ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 0x55747fa9ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 -- 172.21.15.44:0/1675360746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55747f882210 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa592600640 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747faa55f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa584006040 tx=0x7fa584004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7e3160b9bf595b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 1 -- 172.21.15.44:0/1675360746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584006cb0 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 1 -- 172.21.15.44:0/1675360746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fa5840bacb0 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55747f87c350 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 1 -- 172.21.15.44:0/1675360746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa5840019f0 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 10 client.6579 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55747f868fc0 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 1 -- 172.21.15.44:0/1675360746 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55747f87c350 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 1 -- 172.21.15.44:0/1675360746 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fa5840a5890 con 0x55747f9766d0 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 10 client.6579 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:11.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 10 client.6579 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 20 client.6579 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f586930 0x55747fae9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 4 client.6579 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:41:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55747f8f6b00 con 0x55747f586930 2024-09-17T05:41:11.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa591c00640 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f586930 0x55747fae9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa591c00640 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f586930 0x55747fae9e80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=751935d23fd606b5 server_cookie=6ef90448812e1088 in_seq=0 out_seq=0 2024-09-17T05:41:11.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 10 client.6579 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 1 -- 172.21.15.44:0/1675360746 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55747f8f6b00 con 0x55747f586930 2024-09-17T05:41:11.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa572a00640 10 client.6579 handle_command_reply: tid=0 2024-09-17T05:41:11.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 client.6579 shutdown 2024-09-17T05:41:11.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 msgr2=0x55747faa55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.232+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747faa55f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa584006040 tx=0x7fa584004db0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 shutdown_connections 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f586930 0x55747fae9e80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747faa55f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 0x55747fa9ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1675360746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747fa9e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa572a00640 0 client.6579 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 >> 172.21.15.44:0/1675360746 conn(0x55747f5a15c0 msgr2=0x55747fa97d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 shutdown_connections 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 1 -- 172.21.15.44:0/1675360746 wait complete. 2024-09-17T05:41:11.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.236+0000 7fa59be5c000 20 client.6579 trim_cache size 0 max 16384 2024-09-17T05:41:11.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.252+0000 7fa59be5c000 1 Processor -- start 2024-09-17T05:41:11.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.252+0000 7fa59be5c000 1 -- start start 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747faa4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f691aa0 0x55747faa54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f9766d0 0x55747fa98370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55747fa9daf0 con 0x55747f691aa0 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c203010 con 0x55747f9766d0 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c202020 con 0x55747f5cd890 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f691aa0 0x55747faa54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f691aa0 0x55747faa54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60004/0 (socket says 172.21.15.44:60004) 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 -- 172.21.15.44:0/1590446345 learned_addr learned my addr 172.21.15.44:0/1590446345 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591c00640 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747faa4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa592600640 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f9766d0 0x55747fa98370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 -- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 msgr2=0x55747faa4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747faa4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 -- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f9766d0 msgr2=0x55747fa98370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f9766d0 0x55747fa98370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 -- 172.21.15.44:0/1590446345 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55747f941680 con 0x55747f691aa0 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa592600640 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f9766d0 0x55747fa98370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa591200640 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f691aa0 0x55747faa54a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa5780117c0 tx=0x7fa578016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5591bd9cd02984c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa57d600640 1 -- 172.21.15.44:0/1590446345 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa578004050 con 0x55747f691aa0 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa57d600640 1 -- 172.21.15.44:0/1590446345 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5780041f0 con 0x55747f691aa0 2024-09-17T05:41:11.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa57d600640 1 -- 172.21.15.44:0/1590446345 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57801d970 con 0x55747f691aa0 2024-09-17T05:41:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- 172.21.15.44:0/1590446345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f691aa0 msgr2=0x55747faa54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f691aa0 0x55747faa54a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa5780117c0 tx=0x7fa578016000 comp rx=0 tx=0).stop 2024-09-17T05:41:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- 172.21.15.44:0/1590446345 shutdown_connections 2024-09-17T05:41:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f9766d0 0x55747fa98370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f691aa0 0x55747faa54a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 --2- 172.21.15.44:0/1590446345 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747faa4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- 172.21.15.44:0/1590446345 >> 172.21.15.44:0/1590446345 conn(0x55747f5a15c0 msgr2=0x55747faf3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- 172.21.15.44:0/1590446345 shutdown_connections 2024-09-17T05:41:11.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- 172.21.15.44:0/1590446345 wait complete. 2024-09-17T05:41:11.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 -- start start 2024-09-17T05:41:11.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.256+0000 7fa59be5c000 1 Processor -- start 2024-09-17T05:41:11.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747fa9a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 0x55747fa9ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fb14400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c2019d0 con 0x55747f9766d0 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c201380 con 0x55747f691aa0 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55747f5a9680 con 0x55747f5cd890 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 10 client.0 _ll_register_callbacks cb 0x7fa578005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fb14400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fb14400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60020/0 (socket says 172.21.15.44:60020) 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 -- 172.21.15.44:0/937220566 learned_addr learned my addr 172.21.15.44:0/937220566 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 -- 172.21.15.44:0/937220566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 msgr2=0x55747fa9a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747fa9a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 -- 172.21.15.44:0/937220566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 msgr2=0x55747fa9ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 0x55747fa9ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 -- 172.21.15.44:0/937220566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55747f8ae0b0 con 0x55747f9766d0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa592600640 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fb14400 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa584007010 tx=0x7fa5840a5570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce2a5a4d447affa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa572a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa572a00640 1 -- 172.21.15.44:0/937220566 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584006340 con 0x55747f9766d0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa572a00640 1 -- 172.21.15.44:0/937220566 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fa5840064e0 con 0x55747f9766d0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5780041f0 con 0x55747f9766d0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa572a00640 1 -- 172.21.15.44:0/937220566 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fa5840d3050 con 0x55747f9766d0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 10 client.6585 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55747f87a610 con 0x55747f9766d0 2024-09-17T05:41:11.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa572a00640 1 -- 172.21.15.44:0/937220566 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5780041f0 con 0x55747f9766d0 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa572a00640 1 -- 172.21.15.44:0/937220566 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fa5840d6020 con 0x55747f9766d0 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 10 client.6585 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 10 client.6585 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 20 client.6585 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f574990 0x55747fb14940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 4 client.6585 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55747f8f25b0 con 0x55747f574990 2024-09-17T05:41:11.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa591c00640 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f574990 0x55747fb14940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa591c00640 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f574990 0x55747fb14940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2b397e42ecc5cd server_cookie=96002fc5f48286a4 in_seq=0 out_seq=0 2024-09-17T05:41:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.260+0000 7fa572a00640 10 client.6585 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa572a00640 1 -- 172.21.15.44:0/937220566 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+380 (crc 0 0 0) 0x55747f8f25b0 con 0x55747f574990 2024-09-17T05:41:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa572a00640 10 client.6585 handle_command_reply: tid=0 2024-09-17T05:41:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 client.6585 shutdown 2024-09-17T05:41:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 msgr2=0x55747fb14400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fb14400 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa584007010 tx=0x7fa5840a5570 comp rx=0 tx=0).stop 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 shutdown_connections 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55747f574990 0x55747fb14940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55747f9766d0 0x55747fb14400 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55747f691aa0 0x55747fa9ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 --2- 172.21.15.44:0/937220566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55747f5cd890 0x55747fa9a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa572a00640 0 client.6585 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 >> 172.21.15.44:0/937220566 conn(0x55747f5a15c0 msgr2=0x55747faa4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 shutdown_connections 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 1 -- 172.21.15.44:0/937220566 wait complete. 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa59be5c000 20 client.6585 trim_cache size 0 max 16384 2024-09-17T05:41:11.267 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "a2e333e2-57f6-4b12-968e-f9095df34174": { 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:40:40.784638+0000", 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:41:11.268 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:11.269 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:11.269 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:41:11.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa56c0733a0 msgr2=0x7fa56c0758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa56c0733a0 0x7fa56c0758b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa578009a40 tx=0x7fa5780091e0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 msgr2=0x7fa58c0c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa58c0c4e90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa580001980 tx=0x7fa5800127b0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 shutdown_connections 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa58c1f5930 0x7fa58c1f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa56c0733a0 0x7fa56c0758b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa58c15d580 0x7fa58c0c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 --2- 172.21.15.44:0/1590423011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa574005360 0x7fa58c0c4e90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 >> 172.21.15.44:0/1590423011 conn(0x7fa58c0ccaa0 msgr2=0x7fa58c06f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 shutdown_connections 2024-09-17T05:41:11.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.264+0000 7fa594600640 1 -- 172.21.15.44:0/1590423011 wait complete. 2024-09-17T05:41:11.284 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:41:11.284 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 -- 172.21.15.44:0/3125506278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e406dd30 msgr2=0x7f50e415c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 --2- 172.21.15.44:0/3125506278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e406dd30 0x7f50e415c430 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009870 tx=0x7f50d801c820 comp rx=0 tx=0).stop 2024-09-17T05:41:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 -- 172.21.15.44:0/3125506278 shutdown_connections 2024-09-17T05:41:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 --2- 172.21.15.44:0/3125506278 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e4160720 0x7f50e40ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 --2- 172.21.15.44:0/3125506278 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e406dd30 0x7f50e415c430 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 -- 172.21.15.44:0/3125506278 >> 172.21.15.44:0/3125506278 conn(0x7f50e40d1120 msgr2=0x7f50e40d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 -- 172.21.15.44:0/3125506278 shutdown_connections 2024-09-17T05:41:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 -- 172.21.15.44:0/3125506278 wait complete. 2024-09-17T05:41:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 Processor -- start 2024-09-17T05:41:11.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.444+0000 7f50ec800640 1 -- start start 2024-09-17T05:41:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e406dd30 0x7f50e40b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e40cf700 0x7f50e415e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e40b5d80 0x7f50e415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4169ba0 con 0x7f50e40b5d80 2024-09-17T05:41:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4169a20 con 0x7f50e406dd30 2024-09-17T05:41:11.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f50e4169d20 con 0x7f50e40cf700 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e40b5d80 0x7f50e415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e40b5d80 0x7f50e415ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60042/0 (socket says 172.21.15.44:60042) 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 -- 172.21.15.44:0/1191891036 learned_addr learned my addr 172.21.15.44:0/1191891036 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50e9e00640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e406dd30 0x7f50e40b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50e9400640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e40cf700 0x7f50e415e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 -- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e40cf700 msgr2=0x7f50e415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e40cf700 0x7f50e415e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 -- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e406dd30 msgr2=0x7f50e40b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e406dd30 0x7f50e40b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 -- 172.21.15.44:0/1191891036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40b6d10 con 0x7f50e40b5d80 2024-09-17T05:41:11.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ea800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e40b5d80 0x7f50e415ed40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f50e000e940 tx=0x7f50e000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50de000640 1 -- 172.21.15.44:0/1191891036 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0004d30 con 0x7f50e40b5d80 2024-09-17T05:41:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50de000640 1 -- 172.21.15.44:0/1191891036 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50e000cb20 con 0x7f50e40b5d80 2024-09-17T05:41:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50de000640 1 -- 172.21.15.44:0/1191891036 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0005020 con 0x7f50e40b5d80 2024-09-17T05:41:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e41f67d0 con 0x7f50e40b5d80 2024-09-17T05:41:11.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e41f6d90 con 0x7f50e40b5d80 2024-09-17T05:41:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e415c430 con 0x7f50e40b5d80 2024-09-17T05:41:11.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.448+0000 7f50de000640 1 -- 172.21.15.44:0/1191891036 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f50e00051c0 con 0x7f50e40b5d80 2024-09-17T05:41:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.452+0000 7f50de000640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f50c8073230 0x7f50c8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.452+0000 7f50de000640 1 -- 172.21.15.44:0/1191891036 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f50e0094af0 con 0x7f50e40b5d80 2024-09-17T05:41:11.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.452+0000 7f50e9e00640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f50c8073230 0x7f50c8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.452+0000 7f50e9e00640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f50c8073230 0x7f50c8075740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50d80af000 tx=0x7f50d801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.456+0000 7f50de000640 1 -- 172.21.15.44:0/1191891036 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f50e0016030 con 0x7f50e40b5d80 2024-09-17T05:41:11.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.668+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50e40b6aa0 con 0x7f50e40b5d80 2024-09-17T05:41:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.668+0000 7f50de000640 1 -- 172.21.15.44:0/1191891036 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5226 (secure 0 0 0) 0x7f50e005f360 con 0x7f50e40b5d80 2024-09-17T05:41:11.670 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:11.670 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":53,"btime":"2024-09-17T05:40:44:065351+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:40:43.810132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6337,"qdb_cluster":[6337]},"id":5}]} 2024-09-17T05:41:11.670 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 53 2024-09-17T05:41:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f50c8073230 msgr2=0x7f50c8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f50c8073230 0x7f50c8075740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50d80af000 tx=0x7f50d801b060 comp rx=0 tx=0).stop 2024-09-17T05:41:11.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e40b5d80 msgr2=0x7f50e415ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e40b5d80 0x7f50e415ed40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f50e000e940 tx=0x7f50e000ee00 comp rx=0 tx=0).stop 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 shutdown_connections 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50e40b5d80 0x7f50e415ed40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f50e40cf700 0x7f50e415e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f50c8073230 0x7f50c8075740 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 --2- 172.21.15.44:0/1191891036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50e406dd30 0x7f50e40b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 >> 172.21.15.44:0/1191891036 conn(0x7f50e40d1120 msgr2=0x7f50e40b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 shutdown_connections 2024-09-17T05:41:11.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.672+0000 7f50ec800640 1 -- 172.21.15.44:0/1191891036 wait complete. 2024-09-17T05:41:11.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-09-17T05:41:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 -- 172.21.15.44:0/847533989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 msgr2=0x7f160c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 --2- 172.21.15.44:0/847533989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c06e260 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f160c06ace0 tx=0x7f15f801c770 comp rx=0 tx=0).stop 2024-09-17T05:41:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 -- 172.21.15.44:0/847533989 shutdown_connections 2024-09-17T05:41:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 --2- 172.21.15.44:0/847533989 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c06e260 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 --2- 172.21.15.44:0/847533989 >> v2:172.21.15.86:3300/0 conn(0x7f160c072e50 0x7f160c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 -- 172.21.15.44:0/847533989 >> 172.21.15.44:0/847533989 conn(0x7f160c0ccaa0 msgr2=0x7f160c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 -- 172.21.15.44:0/847533989 shutdown_connections 2024-09-17T05:41:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.852+0000 7f1611a00640 1 -- 172.21.15.44:0/847533989 wait complete. 2024-09-17T05:41:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 Processor -- start 2024-09-17T05:41:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 -- start start 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f160c072e50 0x7f160c0c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160c0ced00 0x7f160c0c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f160c169360 con 0x7f160c06de50 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1691e0 con 0x7f160c0ced00 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f160c1694e0 con 0x7f160c072e50 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c0b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60064/0 (socket says 172.21.15.44:60064) 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 -- 172.21.15.44:0/1208541057 learned_addr learned my addr 172.21.15.44:0/1208541057 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160b400640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160c0ced00 0x7f160c0c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160a000640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f160c072e50 0x7f160c0c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 -- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f160c072e50 msgr2=0x7f160c0c2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f160c072e50 0x7f160c0c2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 -- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160c0ced00 msgr2=0x7f160c0c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160c0ced00 0x7f160c0c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 -- 172.21.15.44:0/1208541057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c151f70 con 0x7f160c06de50 2024-09-17T05:41:11.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f160aa00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c0b0f10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00d750 tx=0x7f15fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1602a00640 1 -- 172.21.15.44:0/1208541057 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc017070 con 0x7f160c06de50 2024-09-17T05:41:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1602a00640 1 -- 172.21.15.44:0/1208541057 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15fc009d20 con 0x7f160c06de50 2024-09-17T05:41:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1602a00640 1 -- 172.21.15.44:0/1208541057 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00de60 con 0x7f160c06de50 2024-09-17T05:41:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c15d6a0 con 0x7f160c06de50 2024-09-17T05:41:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.856+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c15d3c0 con 0x7f160c06de50 2024-09-17T05:41:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.860+0000 7f1602a00640 1 -- 172.21.15.44:0/1208541057 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f15fc004280 con 0x7f160c06de50 2024-09-17T05:41:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.860+0000 7f1602a00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15ec073200 0x7f15ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.860+0000 7f1602a00640 1 -- 172.21.15.44:0/1208541057 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f15fc094750 con 0x7f160c06de50 2024-09-17T05:41:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.860+0000 7f160a000640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15ec073200 0x7f15ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.860+0000 7f161920e000 1 Processor -- start 2024-09-17T05:41:11.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.860+0000 7f161920e000 1 -- start start 2024-09-17T05:41:11.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.860+0000 7f160a000640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15ec073200 0x7f15ec075710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15f80af000 tx=0x7f15f801afb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380f28820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dc1d90 0x55f380f28d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f380dc6d00 con 0x55f380de2b60 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f380d3ac90 con 0x55f380dc1d90 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f380d2a0c0 con 0x55f380dd81c0 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f282e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60070/0 (socket says 172.21.15.44:60070) 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 -- 172.21.15.44:0/3487028772 learned_addr learned my addr 172.21.15.44:0/3487028772 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 -- 172.21.15.44:0/3487028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 msgr2=0x55f380f28820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 --2- 172.21.15.44:0/3487028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380f28820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 -- 172.21.15.44:0/3487028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dc1d90 msgr2=0x55f380f28d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 --2- 172.21.15.44:0/3487028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dc1d90 0x55f380f28d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 -- 172.21.15.44:0/3487028772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f380d05290 con 0x55f380de2b60 2024-09-17T05:41:11.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f160aa00640 1 --2- 172.21.15.44:0/3487028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f282e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f15fc05c1a0 tx=0x7f15fc05e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7f6ab1a6715f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f15f7400640 1 -- 172.21.15.44:0/3487028772 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc084020 con 0x55f380de2b60 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f15f7400640 1 -- 172.21.15.44:0/3487028772 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15fc068810 con 0x55f380de2b60 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f15f7400640 1 -- 172.21.15.44:0/3487028772 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc092e60 con 0x55f380de2b60 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- 172.21.15.44:0/3487028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 msgr2=0x55f380f282e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 --2- 172.21.15.44:0/3487028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f282e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f15fc05c1a0 tx=0x7f15fc05e760 comp rx=0 tx=0).stop 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- 172.21.15.44:0/3487028772 shutdown_connections 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 --2- 172.21.15.44:0/3487028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dc1d90 0x55f380f28d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 --2- 172.21.15.44:0/3487028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380f28820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 --2- 172.21.15.44:0/3487028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f282e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- 172.21.15.44:0/3487028772 >> 172.21.15.44:0/3487028772 conn(0x55f3809e7760 msgr2=0x55f380f0b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- 172.21.15.44:0/3487028772 shutdown_connections 2024-09-17T05:41:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- 172.21.15.44:0/3487028772 wait complete. 2024-09-17T05:41:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.864+0000 7f161920e000 1 -- start start 2024-09-17T05:41:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 Processor -- start 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380ee40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380ee4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380de2b60 0x55f380f0a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f380cc4940 con 0x55f380dc1d90 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f380d2ded0 con 0x55f380de2b60 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f3809ef820 con 0x55f380dd81c0 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 10 client.0 _ll_register_callbacks cb 0x55f380d087f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380ee40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380ee40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60078/0 (socket says 172.21.15.44:60078) 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 -- 172.21.15.44:0/3609331408 learned_addr learned my addr 172.21.15.44:0/3609331408 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160b400640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380de2b60 0x55f380f0a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160a000640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380ee4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 -- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 msgr2=0x55f380ee4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380ee4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 -- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380de2b60 msgr2=0x55f380f0a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380de2b60 0x55f380f0a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 -- 172.21.15.44:0/3609331408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f380cdd550 con 0x55f380dc1d90 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160b400640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380de2b60 0x55f380f0a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160a000640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380ee4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160aa00640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380ee40d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f15fc05c1a0 tx=0x7f15fc05b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c4d573d220c4db server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f15ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f15ebe00640 1 -- 172.21.15.44:0/3609331408 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc092e60 con 0x55f380dc1d90 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f15ebe00640 1 -- 172.21.15.44:0/3609331408 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f15fc05e3a0 con 0x55f380dc1d90 2024-09-17T05:41:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f380cc2400 con 0x55f380dc1d90 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f15ebe00640 1 -- 172.21.15.44:0/3609331408 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f15fc084040 con 0x55f380dc1d90 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 10 client.6609 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55f380cc8480 con 0x55f380dc1d90 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f15ebe00640 1 -- 172.21.15.44:0/3609331408 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f380cc2400 con 0x55f380dc1d90 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f15ebe00640 1 -- 172.21.15.44:0/3609331408 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f15fc064af0 con 0x55f380dc1d90 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 10 client.6609 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 10 client.6609 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 20 client.6609 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809ccad0 0x55f380f398a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 4 client.6609 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f380d3cbe0 con 0x55f3809ccad0 2024-09-17T05:41:11.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.868+0000 7f160a000640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809ccad0 0x55f380f398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f160a000640 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809ccad0 0x55f380f398a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a760302a9edd8 server_cookie=b0a5c672e47af8a1 in_seq=0 out_seq=0 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f15ebe00640 10 client.6609 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f15ebe00640 1 -- 172.21.15.44:0/3609331408 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f380d3cbe0 con 0x55f3809ccad0 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f15ebe00640 10 client.6609 handle_command_reply: tid=0 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 client.6609 shutdown 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 msgr2=0x55f380ee40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380ee40d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f15fc05c1a0 tx=0x7f15fc05b450 comp rx=0 tx=0).stop 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 shutdown_connections 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809ccad0 0x55f380f398a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380de2b60 0x55f380f0a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dd81c0 0x55f380ee4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 --2- 172.21.15.44:0/3609331408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380ee40d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f15ebe00640 0 client.6609 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 >> 172.21.15.44:0/3609331408 conn(0x55f3809e7760 msgr2=0x55f380edc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 shutdown_connections 2024-09-17T05:41:11.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 1 -- 172.21.15.44:0/3609331408 wait complete. 2024-09-17T05:41:11.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.872+0000 7f161920e000 20 client.6609 trim_cache size 0 max 16384 2024-09-17T05:41:11.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 Processor -- start 2024-09-17T05:41:11.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- start start 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380edf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380edfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380de2b60 0x55f380ee2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f380cd5300 con 0x55f380dc1d90 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f380ce7670 con 0x55f380dd81c0 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f380de9fc0 con 0x55f380de2b60 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380edf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380edf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60080/0 (socket says 172.21.15.44:60080) 2024-09-17T05:41:11.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 -- 172.21.15.44:0/2397478873 learned_addr learned my addr 172.21.15.44:0/2397478873 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160a000640 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380edfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160b400640 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380de2b60 0x55f380ee2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 -- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380de2b60 msgr2=0x55f380ee2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380de2b60 0x55f380ee2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 -- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 msgr2=0x55f380edfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380edfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 -- 172.21.15.44:0/2397478873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f380dafd10 con 0x55f380dc1d90 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160b400640 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380de2b60 0x55f380ee2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f160aa00640 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380edf6a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f15fc05e950 tx=0x7f15fc05ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef810ae443e6ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f15f6a00640 1 -- 172.21.15.44:0/2397478873 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc079070 con 0x55f380dc1d90 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f15f6a00640 1 -- 172.21.15.44:0/2397478873 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15fc064af0 con 0x55f380dc1d90 2024-09-17T05:41:11.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f15f6a00640 1 -- 172.21.15.44:0/2397478873 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc092e60 con 0x55f380dc1d90 2024-09-17T05:41:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- 172.21.15.44:0/2397478873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 msgr2=0x55f380edf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380edf6a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f15fc05e950 tx=0x7f15fc05ae50 comp rx=0 tx=0).stop 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- 172.21.15.44:0/2397478873 shutdown_connections 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380de2b60 0x55f380ee2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380edfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 --2- 172.21.15.44:0/2397478873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380dc1d90 0x55f380edf6a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- 172.21.15.44:0/2397478873 >> 172.21.15.44:0/2397478873 conn(0x55f3809e7760 msgr2=0x55f380f0a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- 172.21.15.44:0/2397478873 shutdown_connections 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.888+0000 7f161920e000 1 -- 172.21.15.44:0/2397478873 wait complete. 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 -- start start 2024-09-17T05:41:11.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 Processor -- start 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dc1d90 0x55f380f9d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380f9d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f9dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f380d39a60 con 0x55f380de2b60 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f380d2d1e0 con 0x55f380dd81c0 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f380d32500 con 0x55f380dc1d90 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 10 client.0 _ll_register_callbacks cb 0x7f15fc05e880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f9dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f9dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60096/0 (socket says 172.21.15.44:60096) 2024-09-17T05:41:11.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 -- 172.21.15.44:0/4294350751 learned_addr learned my addr 172.21.15.44:0/4294350751 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160a000640 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380f9d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160aa00640 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dc1d90 0x55f380f9d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 -- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dc1d90 msgr2=0x55f380f9d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dc1d90 0x55f380f9d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 -- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 msgr2=0x55f380f9d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380f9d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 -- 172.21.15.44:0/4294350751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f380ce0e50 con 0x55f380de2b60 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f160b400640 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f9dc60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f16040057d0 tx=0x7f1604001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c82ecac7cfce09 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f15ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f15ebe00640 1 -- 172.21.15.44:0/4294350751 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160401b030 con 0x55f380de2b60 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f15ebe00640 1 -- 172.21.15.44:0/4294350751 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f1604010040 con 0x55f380de2b60 2024-09-17T05:41:11.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15fc064af0 con 0x55f380de2b60 2024-09-17T05:41:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.892+0000 7f15ebe00640 1 -- 172.21.15.44:0/4294350751 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f1604006b40 con 0x55f380de2b60 2024-09-17T05:41:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 10 client.6615 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:11.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55f380ccf2d0 con 0x55f380de2b60 2024-09-17T05:41:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f15ebe00640 1 -- 172.21.15.44:0/4294350751 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15fc064af0 con 0x55f380de2b60 2024-09-17T05:41:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f15ebe00640 1 -- 172.21.15.44:0/4294350751 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f1604006ce0 con 0x55f380de2b60 2024-09-17T05:41:11.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 10 client.6615 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 10 client.6615 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 20 client.6615 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809bab30 0x55f380f3bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 4 client.6615 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55f380d38690 con 0x55f3809bab30 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f160aa00640 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809bab30 0x55f380f3bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f160aa00640 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809bab30 0x55f380f3bb50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb631f8f63d05b62 server_cookie=2267ff4429b03c3f in_seq=0 out_seq=0 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f15ebe00640 10 client.6615 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f15ebe00640 1 -- 172.21.15.44:0/4294350751 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+237 (crc 0 0 0) 0x55f380d38690 con 0x55f3809bab30 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f15ebe00640 10 client.6615 handle_command_reply: tid=0 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 client.6615 shutdown 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 msgr2=0x55f380f9dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f9dc60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f16040057d0 tx=0x7f1604001c30 comp rx=0 tx=0).stop 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 shutdown_connections 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55f3809bab30 0x55f380f3bb50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f380de2b60 0x55f380f9dc60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f380dd81c0 0x55f380f9d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 --2- 172.21.15.44:0/4294350751 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f380dc1d90 0x55f380f9d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f15ebe00640 0 client.6615 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 >> 172.21.15.44:0/4294350751 conn(0x55f3809e7760 msgr2=0x55f380f0a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 shutdown_connections 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 1 -- 172.21.15.44:0/4294350751 wait complete. 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f161920e000 20 client.6615 trim_cache size 0 max 16384 2024-09-17T05:41:11.900 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_type": "dentry", 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 3246592935, 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627776, 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "frag": "*", 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "dname": "file_to_be_damaged", 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "snap_id": "head", 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir/file_to_be_damaged" 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:11.901 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:41:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15ec073200 msgr2=0x7f15ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15ec073200 0x7f15ec075710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15f80af000 tx=0x7f15f801afb0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 msgr2=0x7f160c0b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c0b0f10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00d750 tx=0x7f15fc00dc10 comp rx=0 tx=0).stop 2024-09-17T05:41:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 shutdown_connections 2024-09-17T05:41:11.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15ec073200 0x7f15ec075710 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f160c0ced00 0x7f160c0c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f160c072e50 0x7f160c0c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 --2- 172.21.15.44:0/1208541057 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f160c06de50 0x7f160c0b0f10 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 >> 172.21.15.44:0/1208541057 conn(0x7f160c0ccaa0 msgr2=0x7f160c1579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 shutdown_connections 2024-09-17T05:41:11.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:11.896+0000 7f1611a00640 1 -- 172.21.15.44:0/1208541057 wait complete. 2024-09-17T05:41:11.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:41:12.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.072+0000 7fada1600640 1 -- 172.21.15.44:0/2382216732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c15a080 msgr2=0x7fad9c0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.072+0000 7fada1600640 1 --2- 172.21.15.44:0/2382216732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c15a080 0x7fad9c0cbca0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fad84009900 tx=0x7fad8401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- 172.21.15.44:0/2382216732 shutdown_connections 2024-09-17T05:41:12.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 --2- 172.21.15.44:0/2382216732 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c15a080 0x7fad9c0cbca0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- 172.21.15.44:0/2382216732 >> 172.21.15.44:0/2382216732 conn(0x7fad9c0cd930 msgr2=0x7fad9c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- 172.21.15.44:0/2382216732 shutdown_connections 2024-09-17T05:41:12.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- 172.21.15.44:0/2382216732 wait complete. 2024-09-17T05:41:12.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 Processor -- start 2024-09-17T05:41:12.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- start start 2024-09-17T05:41:12.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c0cc1e0 0x7fad9c1f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c15a080 0x7fad9c1fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad9c15d560 0x7fad9c14eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c16b080 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c16af00 con 0x7fad9c15a080 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.076+0000 7fada1600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c16b200 con 0x7fad9c15d560 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c0cc1e0 0x7fad9c1f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c0cc1e0 0x7fad9c1f8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60114/0 (socket says 172.21.15.44:60114) 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 -- 172.21.15.44:0/4073805532 learned_addr learned my addr 172.21.15.44:0/4073805532 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad93e00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c15a080 0x7fad9c1fcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9b400640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad9c15d560 0x7fad9c14eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 -- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad9c15d560 msgr2=0x7fad9c14eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad9c15d560 0x7fad9c14eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 -- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c15a080 msgr2=0x7fad9c1fcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c15a080 0x7fad9c1fcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 -- 172.21.15.44:0/4073805532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c155810 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad93e00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c15a080 0x7fad9c1fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad9aa00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c0cc1e0 0x7fad9c1f8ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c3c0 tx=0x7fad8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad92a00640 1 -- 172.21.15.44:0/4073805532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c017070 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad92a00640 1 -- 172.21.15.44:0/4073805532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad8c0053c0 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad92a00640 1 -- 172.21.15.44:0/4073805532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c003860 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9c155310 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9c0d0290 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad9c167f10 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.080+0000 7fad92a00640 1 -- 172.21.15.44:0/4073805532 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fad8c01a070 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.084+0000 7fad92a00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad78073230 0x7fad78075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.084+0000 7fad92a00640 1 -- 172.21.15.44:0/4073805532 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fad8c0936e0 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.084+0000 7fad93e00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad78073230 0x7fad78075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.084+0000 7fad93e00640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad78073230 0x7fad78075740 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad840af000 tx=0x7fad8401b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.088+0000 7fad92a00640 1 -- 172.21.15.44:0/4073805532 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fad8c05e5a0 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:12.232 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fad9c0cbc20 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fad92a00640 1 -- 172.21.15.44:0/4073805532 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7fad8c05dea0 con 0x7fad9c0cc1e0 2024-09-17T05:41:12.300 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:12.300 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-09-17T05:41:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad78073230 msgr2=0x7fad78075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad78073230 0x7fad78075740 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad840af000 tx=0x7fad8401b120 comp rx=0 tx=0).stop 2024-09-17T05:41:12.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c0cc1e0 msgr2=0x7fad9c1f8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c0cc1e0 0x7fad9c1f8ac0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c3c0 tx=0x7fad8c00c880 comp rx=0 tx=0).stop 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 shutdown_connections 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fad9c15d560 0x7fad9c14eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fad78073230 0x7fad78075740 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c15a080 0x7fad9c1fcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 --2- 172.21.15.44:0/4073805532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fad9c0cc1e0 0x7fad9c1f8ac0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 >> 172.21.15.44:0/4073805532 conn(0x7fad9c0cd930 msgr2=0x7fad9c15dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 shutdown_connections 2024-09-17T05:41:12.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.300+0000 7fada1600640 1 -- 172.21.15.44:0/4073805532 wait complete. 2024-09-17T05:41:12.322 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:41:12.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:12.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 -- 172.21.15.44:0/3859554803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 msgr2=0x7fe08406f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 --2- 172.21.15.44:0/3859554803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe08406f800 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe0840d0e00 tx=0x7fe07c01f580 comp rx=0 tx=0).stop 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 -- 172.21.15.44:0/3859554803 shutdown_connections 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 --2- 172.21.15.44:0/3859554803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe08406f800 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 --2- 172.21.15.44:0/3859554803 >> v2:172.21.15.86:3300/0 conn(0x7fe08406df80 0x7fe08406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 -- 172.21.15.44:0/3859554803 >> 172.21.15.44:0/3859554803 conn(0x7fe0840b35f0 msgr2=0x7fe0840b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 -- 172.21.15.44:0/3859554803 shutdown_connections 2024-09-17T05:41:12.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 -- 172.21.15.44:0/3859554803 wait complete. 2024-09-17T05:41:12.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 Processor -- start 2024-09-17T05:41:12.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.532+0000 7fe08c600640 1 -- start start 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe08406df80 0x7fe084153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe0840b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe084155b10 0x7fe0840b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe0840ce450 con 0x7fe08406f3f0 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0840ce2d0 con 0x7fe08406df80 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe0840ce5d0 con 0x7fe084155b10 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe0840b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe0840b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60140/0 (socket says 172.21.15.44:60140) 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 -- 172.21.15.44:0/2921689826 learned_addr learned my addr 172.21.15.44:0/2921689826 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08a600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe084155b10 0x7fe0840b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089c00640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe08406df80 0x7fe084153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 -- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe084155b10 msgr2=0x7fe0840b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe084155b10 0x7fe0840b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 -- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe08406df80 msgr2=0x7fe084153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe08406df80 0x7fe084153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 -- 172.21.15.44:0/2921689826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08415b000 con 0x7fe08406f3f0 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08a600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe084155b10 0x7fe0840b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089c00640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe08406df80 0x7fe084153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:12.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe089200640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe0840b1690 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe07000d720 tx=0x7fe07000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe081600640 1 -- 172.21.15.44:0/2921689826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070017070 con 0x7fe08406f3f0 2024-09-17T05:41:12.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe081600640 1 -- 172.21.15.44:0/2921689826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe070009d20 con 0x7fe08406f3f0 2024-09-17T05:41:12.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe081600640 1 -- 172.21.15.44:0/2921689826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070005280 con 0x7fe08406f3f0 2024-09-17T05:41:12.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08415b2e0 con 0x7fe08406f3f0 2024-09-17T05:41:12.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.536+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0841f5710 con 0x7fe08406f3f0 2024-09-17T05:41:12.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe081600640 1 -- 172.21.15.44:0/2921689826 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe070005420 con 0x7fe08406f3f0 2024-09-17T05:41:12.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe081600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe064073200 0x7fe064075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe081600640 1 -- 172.21.15.44:0/2921689826 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fe070094540 con 0x7fe08406f3f0 2024-09-17T05:41:12.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe089c00640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe064073200 0x7fe064075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 Processor -- start 2024-09-17T05:41:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 -- start start 2024-09-17T05:41:12.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe089c00640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe064073200 0x7fe064075710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe0780016b0 tx=0x7fe078009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x559194823e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948243a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946bd640 0x5591948248e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559194636bd0 con 0x5591946bd640 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559194626000 con 0x5591946d3a40 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559194629e10 con 0x5591946e2ae0 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946bd640 0x5591948248e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946bd640 0x5591948248e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60156/0 (socket says 172.21.15.44:60156) 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 -- 172.21.15.44:0/1078748439 learned_addr learned my addr 172.21.15.44:0/1078748439 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe089c00640 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x559194823e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe089200640 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948243a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 -- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 msgr2=0x559194823e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x559194823e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 -- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 msgr2=0x5591948243a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948243a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe08a600640 1 -- 172.21.15.44:0/1078748439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591946014c0 con 0x5591946bd640 2024-09-17T05:41:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.540+0000 7fe089200640 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948243a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe08a600640 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946bd640 0x5591948248e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe07c01d1b0 tx=0x7fe07c01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361a9e11c295a200 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe076000640 1 -- 172.21.15.44:0/1078748439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c004a50 con 0x5591946bd640 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe076000640 1 -- 172.21.15.44:0/1078748439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe07c0b4070 con 0x5591946bd640 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe076000640 1 -- 172.21.15.44:0/1078748439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c003980 con 0x5591946bd640 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- 172.21.15.44:0/1078748439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946bd640 msgr2=0x5591948248e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946bd640 0x5591948248e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe07c01d1b0 tx=0x7fe07c01c320 comp rx=0 tx=0).stop 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- 172.21.15.44:0/1078748439 shutdown_connections 2024-09-17T05:41:12.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946bd640 0x5591948248e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948243a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1078748439 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x559194823e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- 172.21.15.44:0/1078748439 >> 172.21.15.44:0/1078748439 conn(0x5591942e2b30 msgr2=0x5591947d8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- 172.21.15.44:0/1078748439 shutdown_connections 2024-09-17T05:41:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- 172.21.15.44:0/1078748439 wait complete. 2024-09-17T05:41:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- start start 2024-09-17T05:41:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 Processor -- start 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946bd640 0x55919480f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946d3a40 0x55919480f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x55919480fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5591946e1a30 con 0x5591946d3a40 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.544+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5591945cfb50 con 0x5591946bd640 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5591945cc9b0 con 0x5591946e2ae0 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 10 client.0 _ll_register_callbacks cb 0x5591946dccb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946d3a40 0x55919480f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946bd640 0x55919480f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe08a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x55919480fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946d3a40 0x55919480f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60162/0 (socket says 172.21.15.44:60162) 2024-09-17T05:41:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 -- 172.21.15.44:0/2709976036 learned_addr learned my addr 172.21.15.44:0/2709976036 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 -- 172.21.15.44:0/2709976036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 msgr2=0x55919480fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x55919480fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 -- 172.21.15.44:0/2709976036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946bd640 msgr2=0x55919480f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946bd640 0x55919480f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 -- 172.21.15.44:0/2709976036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55919466f620 con 0x5591946d3a40 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089c00640 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946bd640 0x55919480f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089200640 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946d3a40 0x55919480f960 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe070005fd0 tx=0x7fe07005e3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1557b43e0c962b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 1 -- 172.21.15.44:0/2709976036 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070084020 con 0x5591946d3a40 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 1 -- 172.21.15.44:0/2709976036 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fe07004c1b0 con 0x5591946d3a40 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591945be260 con 0x5591946d3a40 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 1 -- 172.21.15.44:0/2709976036 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe070020070 con 0x5591946d3a40 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 10 client.6639 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x5591945d9370 con 0x5591946d3a40 2024-09-17T05:41:12.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 1 -- 172.21.15.44:0/2709976036 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5591945be260 con 0x5591946d3a40 2024-09-17T05:41:12.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 1 -- 172.21.15.44:0/2709976036 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fe0700841c0 con 0x5591946d3a40 2024-09-17T05:41:12.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 10 client.6639 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:12.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 10 client.6639 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:12.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 20 client.6639 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942c8bd0 0x5591948108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 4 client.6639 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559194638b20 con 0x5591942c8bd0 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089c00640 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942c8bd0 0x5591948108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe089c00640 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942c8bd0 0x5591948108b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b8a7a8a92bd4d8e server_cookie=fdfc1c0e6d3f5e5a in_seq=0 out_seq=0 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 10 client.6639 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 1 -- 172.21.15.44:0/2709976036 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559194638b20 con 0x5591942c8bd0 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe06aa00640 10 client.6639 handle_command_reply: tid=0 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.548+0000 7fe093ba0000 1 client.6639 shutdown 2024-09-17T05:41:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946d3a40 msgr2=0x55919480f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946d3a40 0x55919480f960 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe070005fd0 tx=0x7fe07005e3e0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 shutdown_connections 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942c8bd0 0x5591948108b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946e2ae0 0x55919480fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946d3a40 0x55919480f960 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2709976036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946bd640 0x55919480f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe06aa00640 0 client.6639 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 >> 172.21.15.44:0/2709976036 conn(0x5591942e2b30 msgr2=0x5591947d95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 shutdown_connections 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 1 -- 172.21.15.44:0/2709976036 wait complete. 2024-09-17T05:41:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.552+0000 7fe093ba0000 20 client.6639 trim_cache size 0 max 16384 2024-09-17T05:41:12.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.568+0000 7fe093ba0000 1 Processor -- start 2024-09-17T05:41:12.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.568+0000 7fe093ba0000 1 -- start start 2024-09-17T05:41:12.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x5591947e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x55919480e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x55919480eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe084201bf0 con 0x5591946e2ae0 2024-09-17T05:41:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe084200f50 con 0x5591946d3a40 2024-09-17T05:41:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe0842015a0 con 0x5591946bd640 2024-09-17T05:41:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x55919480eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x55919480eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60174/0 (socket says 172.21.15.44:60174) 2024-09-17T05:41:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 -- 172.21.15.44:0/2719886284 learned_addr learned my addr 172.21.15.44:0/2719886284 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe089c00640 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x5591947e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe089200640 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x55919480e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 -- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 msgr2=0x5591947e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x5591947e0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 -- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 msgr2=0x55919480e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x55919480e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 -- 172.21.15.44:0/2719886284 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591945c4120 con 0x5591946e2ae0 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe089c00640 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x5591947e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe089200640 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x55919480e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe08a600640 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x55919480eae0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe07c0262d0 tx=0x7fe07c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec688af7d55b273 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe075600640 1 -- 172.21.15.44:0/2719886284 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0c7070 con 0x5591946e2ae0 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe075600640 1 -- 172.21.15.44:0/2719886284 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe07c0b4040 con 0x5591946e2ae0 2024-09-17T05:41:12.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe075600640 1 -- 172.21.15.44:0/2719886284 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0af880 con 0x5591946e2ae0 2024-09-17T05:41:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- 172.21.15.44:0/2719886284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 msgr2=0x55919480eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x55919480eae0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe07c0262d0 tx=0x7fe07c0095c0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- 172.21.15.44:0/2719886284 shutdown_connections 2024-09-17T05:41:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x55919480eae0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x55919480e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 --2- 172.21.15.44:0/2719886284 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x5591947e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- 172.21.15.44:0/2719886284 >> 172.21.15.44:0/2719886284 conn(0x5591942e2b30 msgr2=0x559194833410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- 172.21.15.44:0/2719886284 shutdown_connections 2024-09-17T05:41:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.572+0000 7fe093ba0000 1 -- 172.21.15.44:0/2719886284 wait complete. 2024-09-17T05:41:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 -- start start 2024-09-17T05:41:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 Processor -- start 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x559194899270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948997b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x559194899cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559194629120 con 0x5591946e2ae0 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5591945f3ab0 con 0x5591946d3a40 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55919462e440 con 0x5591946bd640 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 10 client.0 _ll_register_callbacks cb 0x7fe070005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x559194899cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x559194899cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60176/0 (socket says 172.21.15.44:60176) 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 -- 172.21.15.44:0/1334858268 learned_addr learned my addr 172.21.15.44:0/1334858268 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe089200640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe089c00640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x559194899270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 -- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 msgr2=0x559194899270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x559194899270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 -- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 msgr2=0x5591948997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 -- 172.21.15.44:0/1334858268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591946ab2b0 con 0x5591946e2ae0 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe089c00640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x559194899270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe08a600640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x559194899cf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe07c01c190 tx=0x7fe07c0afd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1e44087192d429 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe06aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe06aa00640 1 -- 172.21.15.44:0/1334858268 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0c7040 con 0x5591946e2ae0 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe06aa00640 1 -- 172.21.15.44:0/1334858268 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fe07c0c3480 con 0x5591946e2ae0 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe07c0b4040 con 0x5591946e2ae0 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe06aa00640 1 -- 172.21.15.44:0/1334858268 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fe07c0d9050 con 0x5591946e2ae0 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 10 client.6645 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x5591945bc620 con 0x5591946e2ae0 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe06aa00640 1 -- 172.21.15.44:0/1334858268 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe07c0b4040 con 0x5591946e2ae0 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe06aa00640 1 -- 172.21.15.44:0/1334858268 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7fe07c0dc020 con 0x5591946e2ae0 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 10 client.6645 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 10 client.6645 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 20 client.6645 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942b6c30 0x5591947d9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 4 client.6645 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-09-17T05:41:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.576+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) -- 0x5591946345d0 con 0x5591942b6c30 2024-09-17T05:41:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe089c00640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942b6c30 0x5591947d9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe089c00640 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942b6c30 0x5591947d9e00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe81576fc127bc7 server_cookie=7fc6c76a2782ef99 in_seq=0 out_seq=0 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe06aa00640 10 client.6645 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe06aa00640 1 -- 172.21.15.44:0/1334858268 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5591946345d0 con 0x5591942b6c30 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe06aa00640 10 client.6645 handle_command_reply: tid=0 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 client.6645 shutdown 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 msgr2=0x559194899cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x559194899cf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe07c01c190 tx=0x7fe07c0afd30 comp rx=0 tx=0).stop 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 shutdown_connections 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x5591942b6c30 0x5591947d9e00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5591946e2ae0 0x559194899cf0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591946d3a40 0x5591948997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe06aa00640 0 client.6645 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 --2- 172.21.15.44:0/1334858268 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5591946bd640 0x559194899270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 >> 172.21.15.44:0/1334858268 conn(0x5591942e2b30 msgr2=0x559194833dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 shutdown_connections 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 1 -- 172.21.15.44:0/1334858268 wait complete. 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe093ba0000 20 client.6645 trim_cache size 0 max 16384 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "e7dcfe0b-b516-49ac-a243-4088022dc873", 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:41:12.584 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe064073200 msgr2=0x7fe064075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe064073200 0x7fe064075710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe0780016b0 tx=0x7fe078009040 comp rx=0 tx=0).stop 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 msgr2=0x7fe0840b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe0840b1690 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe07000d720 tx=0x7fe07000dbe0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 shutdown_connections 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe084155b10 0x7fe0840b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe08406f3f0 0x7fe0840b1690 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe064073200 0x7fe064075710 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 --2- 172.21.15.44:0/2921689826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe08406df80 0x7fe084153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 >> 172.21.15.44:0/2921689826 conn(0x7fe0840b35f0 msgr2=0x7fe084153d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 shutdown_connections 2024-09-17T05:41:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.580+0000 7fe08c600640 1 -- 172.21.15.44:0/2921689826 wait complete. 2024-09-17T05:41:12.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:12.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-09-17T05:41:12.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 -- 172.21.15.44:0/2257035361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cac30 msgr2=0x7f73640cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 --2- 172.21.15.44:0/2257035361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cac30 0x7f73640cec50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7358009840 tx=0x7f735801c820 comp rx=0 tx=0).stop 2024-09-17T05:41:12.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 -- 172.21.15.44:0/2257035361 shutdown_connections 2024-09-17T05:41:12.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 --2- 172.21.15.44:0/2257035361 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73640cb040 0x7f73640cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 --2- 172.21.15.44:0/2257035361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cac30 0x7f73640cec50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 -- 172.21.15.44:0/2257035361 >> 172.21.15.44:0/2257035361 conn(0x7f73640ccaa0 msgr2=0x7f73640cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 -- 172.21.15.44:0/2257035361 shutdown_connections 2024-09-17T05:41:12.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.760+0000 7f736c200640 1 -- 172.21.15.44:0/2257035361 wait complete. 2024-09-17T05:41:12.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 Processor -- start 2024-09-17T05:41:12.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 -- start start 2024-09-17T05:41:12.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73640cac30 0x7f73641fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73640cb040 0x7f73640b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f736415e8c0 0x7f73641ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7364168470 con 0x7f73640cac30 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f73641682f0 con 0x7f736415e8c0 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.764+0000 7f736c200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f73641685f0 con 0x7f73640cb040 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73640cac30 0x7f73641fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73640cac30 0x7f73641fd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60184/0 (socket says 172.21.15.44:60184) 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 -- 172.21.15.44:0/1380354150 learned_addr learned my addr 172.21.15.44:0/1380354150 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7368e00640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73640cb040 0x7f73640b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f736a200640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f736415e8c0 0x7f73641ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 -- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73640cb040 msgr2=0x7f73640b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73640cb040 0x7f73640b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 -- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f736415e8c0 msgr2=0x7f73641ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f736415e8c0 0x7f73641ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 -- 172.21.15.44:0/1380354150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73641fde10 con 0x7f73640cac30 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7369800640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73640cac30 0x7f73641fd8d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7358009790 tx=0x7f73580a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7361600640 1 -- 172.21.15.44:0/1380354150 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73580bb070 con 0x7f73640cac30 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7361600640 1 -- 172.21.15.44:0/1380354150 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7358004470 con 0x7f73640cac30 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7361600640 1 -- 172.21.15.44:0/1380354150 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73580b2040 con 0x7f73640cac30 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73641f9be0 con 0x7f73640cac30 2024-09-17T05:41:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73641fa1a0 con 0x7f73640cac30 2024-09-17T05:41:12.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.768+0000 7f7361600640 1 -- 172.21.15.44:0/1380354150 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7358005290 con 0x7f73640cac30 2024-09-17T05:41:12.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7361600640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7361600640 1 -- 172.21.15.44:0/1380354150 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f735812dc40 con 0x7f73640cac30 2024-09-17T05:41:12.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 Processor -- start 2024-09-17T05:41:12.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 -- start start 2024-09-17T05:41:12.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f736409e890 tx=0x7f7350010040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58dbe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b588a9890 0x557b58dbef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b5896daa0 0x557b58dbf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557b58c5dcd0 con 0x557b588a9890 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557b58b73330 con 0x557b58c526d0 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x557b58bd0bb0 con 0x557b5896daa0 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b588a9890 0x557b58dbef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b588a9890 0x557b58dbef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60198/0 (socket says 172.21.15.44:60198) 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 -- 172.21.15.44:0/3321726106 learned_addr learned my addr 172.21.15.44:0/3321726106 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7369800640 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58dbe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f736a200640 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b5896daa0 0x557b58dbf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 -- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b5896daa0 msgr2=0x557b58dbf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b5896daa0 0x557b58dbf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 -- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 msgr2=0x557b58dbe9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58dbe9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 -- 172.21.15.44:0/3321726106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b58b74c80 con 0x557b588a9890 2024-09-17T05:41:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.772+0000 7f7368e00640 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b588a9890 0x557b58dbef30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f735001b420 tx=0x7f7350014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10113e0b77f69bd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7356000640 1 -- 172.21.15.44:0/3321726106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735001b0d0 con 0x557b588a9890 2024-09-17T05:41:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7356000640 1 -- 172.21.15.44:0/3321726106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f735001b270 con 0x557b588a9890 2024-09-17T05:41:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7356000640 1 -- 172.21.15.44:0/3321726106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350004030 con 0x557b588a9890 2024-09-17T05:41:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- 172.21.15.44:0/3321726106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b588a9890 msgr2=0x557b58dbef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b588a9890 0x557b58dbef30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f735001b420 tx=0x7f7350014000 comp rx=0 tx=0).stop 2024-09-17T05:41:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- 172.21.15.44:0/3321726106 shutdown_connections 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b5896daa0 0x557b58dbf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b588a9890 0x557b58dbef30 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 --2- 172.21.15.44:0/3321726106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58dbe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- 172.21.15.44:0/3321726106 >> 172.21.15.44:0/3321726106 conn(0x557b5887d5c0 msgr2=0x557b58d7bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- 172.21.15.44:0/3321726106 shutdown_connections 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- 172.21.15.44:0/3321726106 wait complete. 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- start start 2024-09-17T05:41:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 Processor -- start 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58d7aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58d7af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58d815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557b58bc3df0 con 0x557b58c526d0 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557b58bbffe0 con 0x557b5896daa0 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x557b58b654d0 con 0x557b588a9890 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.776+0000 7f7373a07000 10 client.0 _ll_register_callbacks cb 0x557b58b437f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58d815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58d815f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60204/0 (socket says 172.21.15.44:60204) 2024-09-17T05:41:12.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 -- 172.21.15.44:0/438369544 learned_addr learned my addr 172.21.15.44:0/438369544 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7368e00640 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58d7af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7369800640 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58d7aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 -- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 msgr2=0x557b58d7aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58d7aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 -- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 msgr2=0x557b58d7af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58d7af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 -- 172.21.15.44:0/438369544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b58b5e210 con 0x557b58c526d0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f736a200640 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58d815f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f735c012d50 tx=0x7f735c012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5512d96c3cb6bcba server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 1 -- 172.21.15.44:0/438369544 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c01a070 con 0x557b58c526d0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 1 -- 172.21.15.44:0/438369544 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f735c010a30 con 0x557b58c526d0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b58b58350 con 0x557b58c526d0 2024-09-17T05:41:12.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 1 -- 172.21.15.44:0/438369544 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f735c025050 con 0x557b58c526d0 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 10 client.6654 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x557b58b44fc0 con 0x557b58c526d0 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 1 -- 172.21.15.44:0/438369544 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557b58b58350 con 0x557b58c526d0 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 1 -- 172.21.15.44:0/438369544 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f735c028020 con 0x557b58c526d0 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 10 client.6654 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 10 client.6654 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 20 client.6654 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58862930 0x557b58dc5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 4 client.6654 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b58bd2b00 con 0x557b58862930 2024-09-17T05:41:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7369800640 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58862930 0x557b58dc5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 10 client.6654 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7369800640 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58862930 0x557b58dc5e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da04b92f702611f server_cookie=ecf3b7ad35746432 in_seq=0 out_seq=0 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 1 -- 172.21.15.44:0/438369544 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b58bd2b00 con 0x557b58862930 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 10 client.6654 handle_command_reply: tid=0 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 client.6654 shutdown 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 msgr2=0x557b58d815f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58d815f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f735c012d50 tx=0x7f735c012e40 comp rx=0 tx=0).stop 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 shutdown_connections 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58862930 0x557b58dc5e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58d815f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58d7af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 --2- 172.21.15.44:0/438369544 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58d7aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f734aa00640 0 client.6654 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 >> 172.21.15.44:0/438369544 conn(0x557b5887d5c0 msgr2=0x557b58d73d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 shutdown_connections 2024-09-17T05:41:12.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 1 -- 172.21.15.44:0/438369544 wait complete. 2024-09-17T05:41:12.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.780+0000 7f7373a07000 20 client.6654 trim_cache size 0 max 16384 2024-09-17T05:41:12.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 Processor -- start 2024-09-17T05:41:12.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 -- start start 2024-09-17T05:41:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e30400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b5896daa0 0x557b58e30940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58e30e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557b58d79b20 con 0x557b5896daa0 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f73640b3ac0 con 0x557b58c526d0 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.800+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f73640b5000 con 0x557b588a9890 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b5896daa0 0x557b58e30940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b5896daa0 0x557b58e30940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60214/0 (socket says 172.21.15.44:60214) 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 -- 172.21.15.44:0/1528451323 learned_addr learned my addr 172.21.15.44:0/1528451323 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7369800640 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e30400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f736a200640 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58e30e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 -- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 msgr2=0x557b58e30400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e30400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 -- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 msgr2=0x557b58e30e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58e30e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 -- 172.21.15.44:0/1528451323 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b58c1d680 con 0x557b5896daa0 2024-09-17T05:41:12.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7368e00640 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b5896daa0 0x557b58e30940 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7350004000 tx=0x7f735000a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f80995549ca5f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7355600640 1 -- 172.21.15.44:0/1528451323 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350004030 con 0x557b5896daa0 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7355600640 1 -- 172.21.15.44:0/1528451323 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73500041d0 con 0x557b5896daa0 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7355600640 1 -- 172.21.15.44:0/1528451323 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350004460 con 0x557b5896daa0 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 -- 172.21.15.44:0/1528451323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b5896daa0 msgr2=0x557b58e30940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b5896daa0 0x557b58e30940 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7350004000 tx=0x7f735000a2f0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 -- 172.21.15.44:0/1528451323 shutdown_connections 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b58c526d0 0x557b58e30e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b5896daa0 0x557b58e30940 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 --2- 172.21.15.44:0/1528451323 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e30400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 -- 172.21.15.44:0/1528451323 >> 172.21.15.44:0/1528451323 conn(0x557b5887d5c0 msgr2=0x557b58dd0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 -- 172.21.15.44:0/1528451323 shutdown_connections 2024-09-17T05:41:12.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 -- 172.21.15.44:0/1528451323 wait complete. 2024-09-17T05:41:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 -- start start 2024-09-17T05:41:12.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.804+0000 7f7373a07000 1 Processor -- start 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e34440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58e34980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58e34ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f73640b49b0 con 0x557b58c526d0 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f73640b4360 con 0x557b5896daa0 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x557b58885680 con 0x557b588a9890 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 10 client.0 _ll_register_callbacks cb 0x7f735c001e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58e34ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58e34ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60216/0 (socket says 172.21.15.44:60216) 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 -- 172.21.15.44:0/3905814449 learned_addr learned my addr 172.21.15.44:0/3905814449 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:12.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7369800640 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e34440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7368e00640 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58e34980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 -- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 msgr2=0x557b58e34440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e34440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 -- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 msgr2=0x557b58e34980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58e34980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 -- 172.21.15.44:0/3905814449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b58b8a0b0 con 0x557b58c526d0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f736a200640 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58e34ec0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f735c001b40 tx=0x7f735c012990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f687fcacd99f6006 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 1 -- 172.21.15.44:0/3905814449 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c02e060 con 0x557b58c526d0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 1 -- 172.21.15.44:0/3905814449 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f735c010cc0 con 0x557b58c526d0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73500041d0 con 0x557b58c526d0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 1 -- 172.21.15.44:0/3905814449 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f735c034050 con 0x557b58c526d0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 10 client.6660 fetch_fsmap learned FSMap version 53 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x557b58b56610 con 0x557b58c526d0 2024-09-17T05:41:12.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 1 -- 172.21.15.44:0/3905814449 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73500041d0 con 0x557b58c526d0 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 1 -- 172.21.15.44:0/3905814449 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f735c037020 con 0x557b58c526d0 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 10 client.6660 fetch_fsmap finished waiting for FSMap version 53 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 10 client.6660 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 20 client.6660 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58850990 0x557b58d758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 4 client.6660 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b58bce5b0 con 0x557b58850990 2024-09-17T05:41:12.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7369800640 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58850990 0x557b58d758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7369800640 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58850990 0x557b58d758f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5217f2367bdf420f server_cookie=8da6f27ae0596566 in_seq=0 out_seq=0 2024-09-17T05:41:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 10 client.6660 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 1 -- 172.21.15.44:0/3905814449 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+873 (crc 0 0 0) 0x557b58bce5b0 con 0x557b58850990 2024-09-17T05:41:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 10 client.6660 handle_command_reply: tid=0 2024-09-17T05:41:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 client.6660 shutdown 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 msgr2=0x557b58e34ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58e34ec0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f735c001b40 tx=0x7f735c012990 comp rx=0 tx=0).stop 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 shutdown_connections 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x557b58850990 0x557b58d758f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557b58c526d0 0x557b58e34ec0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557b5896daa0 0x557b58e34980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 --2- 172.21.15.44:0/3905814449 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557b588a9890 0x557b58e34440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f734aa00640 0 client.6660 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.808+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 >> 172.21.15.44:0/3905814449 conn(0x557b5887d5c0 msgr2=0x557b58d805a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 shutdown_connections 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f7373a07000 1 -- 172.21.15.44:0/3905814449 wait complete. 2024-09-17T05:41:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f7373a07000 20 client.6660 trim_cache size 0 max 16384 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "e7dcfe0b-b516-49ac-a243-4088022dc873": { 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "e7dcfe0b-b516-49ac-a243-4088022dc873", 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive,repair" 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:41:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: "e7dcfe0b-b516-49ac-a243-4088022dc873": { 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:41:12.580369+0000", 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "a2e333e2-57f6-4b12-968e-f9095df34174": { 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:40:40.784638+0000", 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:41:12.816 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:41:12.817 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:12.817 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:12.817 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:41:12.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 msgr2=0x7f7344075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f736409e890 tx=0x7f7350010040 comp rx=0 tx=0).stop 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73640cac30 msgr2=0x7f73641fd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73640cac30 0x7f73641fd8d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7358009790 tx=0x7f73580a5670 comp rx=0 tx=0).stop 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 shutdown_connections 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f736415e8c0 0x7f73641ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73640cb040 0x7f73640b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 --2- 172.21.15.44:0/1380354150 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f73640cac30 0x7f73641fd8d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 >> 172.21.15.44:0/1380354150 conn(0x7f73640ccaa0 msgr2=0x7f7364158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 shutdown_connections 2024-09-17T05:41:12.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:12.812+0000 7f736c200640 1 -- 172.21.15.44:0/1380354150 wait complete. 2024-09-17T05:41:12.831 INFO:tasks.cephfs.filesystem:scrub status for tag:e7dcfe0b-b516-49ac-a243-4088022dc873 - {'path': '/subdir', 'tag': 'e7dcfe0b-b516-49ac-a243-4088022dc873', 'options': 'recursive,repair'} 2024-09-17T05:41:42.287 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:42.291 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:41:42.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:42.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-09-17T05:41:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 -- 172.21.15.44:0/1811408126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 msgr2=0x7f4dbc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 --2- 172.21.15.44:0/1811408126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 0x7f4dbc003e20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80017f0 tx=0x7f4dc801c900 comp rx=0 tx=0).stop 2024-09-17T05:41:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4dda200640 1 -- 172.21.15.44:0/1811408126 reap_dead start 2024-09-17T05:41:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 -- 172.21.15.44:0/1811408126 shutdown_connections 2024-09-17T05:41:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 -- 172.21.15.44:0/1811408126 >> 172.21.15.44:0/1811408126 conn(0x7f4dd40d1120 msgr2=0x7f4dd40d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 -- 172.21.15.44:0/1811408126 shutdown_connections 2024-09-17T05:41:43.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 -- 172.21.15.44:0/1811408126 wait complete. 2024-09-17T05:41:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 Processor -- start 2024-09-17T05:41:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.007+0000 7f4ddc200640 1 -- start start 2024-09-17T05:41:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 0x7f4dd40b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4dd40b20f0 0x7f4dd40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dd415d840 0x7f4dd415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd415fc00 con 0x7f4dbc0039f0 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd406e450 con 0x7f4dd415d840 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd415fd80 con 0x7f4dd40b20f0 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 0x7f4dd40b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 0x7f4dd40b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33136/0 (socket says 172.21.15.44:33136) 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 -- 172.21.15.44:0/2923311080 learned_addr learned my addr 172.21.15.44:0/2923311080 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4dd40b20f0 0x7f4dd40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dda200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dd415d840 0x7f4dd415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 -- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4dd40b20f0 msgr2=0x7f4dd40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4dd40b20f0 0x7f4dd40b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 -- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dd415d840 msgr2=0x7f4dd415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dd415d840 0x7f4dd415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 -- 172.21.15.44:0/2923311080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd40b2a40 con 0x7f4dbc0039f0 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4dd40b20f0 0x7f4dd40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dda200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dd415d840 0x7f4dd415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd9800640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 0x7f4dd40b3f50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8000c10 tx=0x7f4dc8004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd1600640 1 -- 172.21.15.44:0/2923311080 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc80bd070 con 0x7f4dbc0039f0 2024-09-17T05:41:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd1600640 1 -- 172.21.15.44:0/2923311080 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dc8006130 con 0x7f4dbc0039f0 2024-09-17T05:41:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd40b4490 con 0x7f4dbc0039f0 2024-09-17T05:41:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4dd1600640 1 -- 172.21.15.44:0/2923311080 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc80aa040 con 0x7f4dbc0039f0 2024-09-17T05:41:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.011+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd40b4bf0 con 0x7f4dbc0039f0 2024-09-17T05:41:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.015+0000 7f4dd1600640 1 -- 172.21.15.44:0/2923311080 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4dc80c0070 con 0x7f4dbc0039f0 2024-09-17T05:41:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.015+0000 7f4dd1600640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4db4073200 0x7f4db4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.015+0000 7f4dd1600640 1 -- 172.21.15.44:0/2923311080 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f4dc812deb0 con 0x7f4dbc0039f0 2024-09-17T05:41:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.015+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4db4073200 0x7f4db4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.015+0000 7f4de37d8000 1 Processor -- start 2024-09-17T05:41:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.015+0000 7f4de37d8000 1 -- start start 2024-09-17T05:41:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.015+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4db4073200 0x7f4db4075710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4dd415b560 tx=0x7f4dc00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf54c86d0 0x55faf56349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf5634f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf5635470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55faf54d3cd0 con 0x55faf51e3aa0 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55faf53e9330 con 0x55faf54c86d0 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55faf5446bb0 con 0x55faf511f890 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf5635470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf5635470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33144/0 (socket says 172.21.15.44:33144) 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 -- 172.21.15.44:0/2989165090 learned_addr learned my addr 172.21.15.44:0/2989165090 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf5634f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dd9800640 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf54c86d0 0x55faf56349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 -- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 msgr2=0x55faf5634f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf5634f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 -- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf54c86d0 msgr2=0x55faf56349f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf54c86d0 0x55faf56349f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 -- 172.21.15.44:0/2989165090 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faf53eac80 con 0x55faf51e3aa0 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dda200640 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf5635470 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc001360 tx=0x7f4dcc010360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16e4b40ba67cd93 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dc6000640 1 -- 172.21.15.44:0/2989165090 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc016070 con 0x55faf51e3aa0 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dc6000640 1 -- 172.21.15.44:0/2989165090 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dcc010e50 con 0x55faf51e3aa0 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4dc6000640 1 -- 172.21.15.44:0/2989165090 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc012660 con 0x55faf51e3aa0 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- 172.21.15.44:0/2989165090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 msgr2=0x55faf5635470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf5635470 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc001360 tx=0x7f4dcc010360 comp rx=0 tx=0).stop 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- 172.21.15.44:0/2989165090 shutdown_connections 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf5635470 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf5634f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2989165090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf54c86d0 0x55faf56349f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- 172.21.15.44:0/2989165090 >> 172.21.15.44:0/2989165090 conn(0x55faf50f35c0 msgr2=0x55faf55f1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- 172.21.15.44:0/2989165090 shutdown_connections 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- 172.21.15.44:0/2989165090 wait complete. 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.019+0000 7f4de37d8000 1 -- start start 2024-09-17T05:41:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 Processor -- start 2024-09-17T05:41:43.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf511f890 0x55faf55f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf55f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf55f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55faf5439df0 con 0x55faf51e3aa0 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55faf5435fe0 con 0x55faf511f890 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55faf53db4d0 con 0x55faf54c86d0 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 10 client.0 _ll_register_callbacks cb 0x55faf53b97f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf55f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf55f0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33154/0 (socket says 172.21.15.44:33154) 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 -- 172.21.15.44:0/2888625330 learned_addr learned my addr 172.21.15.44:0/2888625330 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd9800640 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf511f890 0x55faf55f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dda200640 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf55f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 -- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 msgr2=0x55faf55f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf55f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 -- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf511f890 msgr2=0x55faf55f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf511f890 0x55faf55f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 -- 172.21.15.44:0/2888625330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faf53d4210 con 0x55faf51e3aa0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf55f0f00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40b71d0 tx=0x7f4dc0015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7745bf592d8275 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dbaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dbaa00640 1 -- 172.21.15.44:0/2888625330 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc002c060 con 0x55faf51e3aa0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55faf53ce350 con 0x55faf51e3aa0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dbaa00640 1 -- 172.21.15.44:0/2888625330 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f4dc001dd50 con 0x55faf51e3aa0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dbaa00640 1 -- 172.21.15.44:0/2888625330 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4dc0032050 con 0x55faf51e3aa0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 10 client.6672 fetch_fsmap learned FSMap version 54 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55faf53bafc0 con 0x55faf51e3aa0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dbaa00640 1 -- 172.21.15.44:0/2888625330 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55faf53ce350 con 0x55faf51e3aa0 2024-09-17T05:41:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4dbaa00640 1 -- 172.21.15.44:0/2888625330 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7f4dc0035020 con 0x55faf51e3aa0 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 10 client.6672 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 10 client.6672 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 20 client.6672 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50d8930 0x55faf563be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 4 client.6672 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.023+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faf5448b00 con 0x55faf50d8930 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4dd9800640 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50d8930 0x55faf563be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4dd9800640 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50d8930 0x55faf563be80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f61fbd0b63025da server_cookie=b0e6850c18ba5c1d in_seq=0 out_seq=0 2024-09-17T05:41:43.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4dbaa00640 10 client.6672 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4dbaa00640 1 -- 172.21.15.44:0/2888625330 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55faf5448b00 con 0x55faf50d8930 2024-09-17T05:41:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4dbaa00640 10 client.6672 handle_command_reply: tid=0 2024-09-17T05:41:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 client.6672 shutdown 2024-09-17T05:41:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 msgr2=0x55faf55f0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf55f0f00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40b71d0 tx=0x7f4dc0015040 comp rx=0 tx=0).stop 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 shutdown_connections 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50d8930 0x55faf563be80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf55f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf51e3aa0 0x55faf55f0f00 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 --2- 172.21.15.44:0/2888625330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf511f890 0x55faf55f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4dbaa00640 0 client.6672 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 >> 172.21.15.44:0/2888625330 conn(0x55faf50f35c0 msgr2=0x55faf55e9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 shutdown_connections 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 1 -- 172.21.15.44:0/2888625330 wait complete. 2024-09-17T05:41:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.027+0000 7f4de37d8000 20 client.6672 trim_cache size 0 max 16384 2024-09-17T05:41:43.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 Processor -- start 2024-09-17T05:41:43.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 -- start start 2024-09-17T05:41:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf511f890 0x55faf56a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56a6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf56a6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55faf55efae0 con 0x55faf511f890 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4205b50 con 0x55faf51e3aa0 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd4204b70 con 0x55faf54c86d0 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf511f890 0x55faf56a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf511f890 0x55faf56a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33164/0 (socket says 172.21.15.44:33164) 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 -- 172.21.15.44:0/1806687334 learned_addr learned my addr 172.21.15.44:0/1806687334 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dda200640 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf56a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 -- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 msgr2=0x55faf56a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf56a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 -- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 msgr2=0x55faf56a6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56a6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 -- 172.21.15.44:0/1806687334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faf5493680 con 0x55faf511f890 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dd9800640 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf511f890 0x55faf56a5bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80f58d0 tx=0x7f4dc801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bb5b4f8fe4df2f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dc5600640 1 -- 172.21.15.44:0/1806687334 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8006300 con 0x55faf511f890 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dc5600640 1 -- 172.21.15.44:0/1806687334 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dc80fd0c0 con 0x55faf511f890 2024-09-17T05:41:43.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4dc5600640 1 -- 172.21.15.44:0/1806687334 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8101f70 con 0x55faf511f890 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 -- 172.21.15.44:0/1806687334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf511f890 msgr2=0x55faf56a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.047+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf511f890 0x55faf56a5bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4dc80f58d0 tx=0x7f4dc801c900 comp rx=0 tx=0).stop 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- 172.21.15.44:0/1806687334 shutdown_connections 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf54c86d0 0x55faf56a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56a6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1806687334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf511f890 0x55faf56a5bd0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- 172.21.15.44:0/1806687334 >> 172.21.15.44:0/1806687334 conn(0x55faf50f35c0 msgr2=0x55faf5645d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- 172.21.15.44:0/1806687334 shutdown_connections 2024-09-17T05:41:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- 172.21.15.44:0/1806687334 wait complete. 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- start start 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 Processor -- start 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf56a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf54c86d0 0x55faf56aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4204520 con 0x55faf54c86d0 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4204020 con 0x55faf51e3aa0 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55faf50fb680 con 0x55faf511f890 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4de37d8000 10 client.0 _ll_register_callbacks cb 0x7f4dc00115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf54c86d0 0x55faf56aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf54c86d0 0x55faf56aa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33176/0 (socket says 172.21.15.44:33176) 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 -- 172.21.15.44:0/1301662095 learned_addr learned my addr 172.21.15.44:0/1301662095 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dd9800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf56a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 -- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 msgr2=0x55faf56a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf56a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 -- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 msgr2=0x55faf56aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 -- 172.21.15.44:0/1301662095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faf54000b0 con 0x55faf54c86d0 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dd8e00640 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dda200640 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf54c86d0 0x55faf56aa5d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc001380 tx=0x7f4dcc010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550ac730990cc359 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.051+0000 7f4dbaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 1 -- 172.21.15.44:0/1301662095 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc016040 con 0x55faf54c86d0 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 1 -- 172.21.15.44:0/1301662095 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f4dcc01b860 con 0x55faf54c86d0 2024-09-17T05:41:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dc80fd0c0 con 0x55faf54c86d0 2024-09-17T05:41:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 1 -- 172.21.15.44:0/1301662095 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f4dcc02f050 con 0x55faf54c86d0 2024-09-17T05:41:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 10 client.6678 fetch_fsmap learned FSMap version 54 2024-09-17T05:41:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55faf53cc610 con 0x55faf54c86d0 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 1 -- 172.21.15.44:0/1301662095 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dc80fd0c0 con 0x55faf54c86d0 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 1 -- 172.21.15.44:0/1301662095 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7f4dcc032020 con 0x55faf54c86d0 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 10 client.6678 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 10 client.6678 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 20 client.6678 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50c6990 0x55faf5665a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 4 client.6678 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55faf54445b0 con 0x55faf50c6990 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dd9800640 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50c6990 0x55faf5665a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 10 client.6678 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dd9800640 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50c6990 0x55faf5665a40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae245608eebe067 server_cookie=78e846cd4f61642b in_seq=0 out_seq=0 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 1 -- 172.21.15.44:0/1301662095 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+670 (crc 0 0 0) 0x55faf54445b0 con 0x55faf50c6990 2024-09-17T05:41:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 10 client.6678 handle_command_reply: tid=0 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 client.6678 shutdown 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf54c86d0 msgr2=0x55faf56aa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf54c86d0 0x55faf56aa5d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc001380 tx=0x7f4dcc010d90 comp rx=0 tx=0).stop 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 shutdown_connections 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55faf50c6990 0x55faf5665a40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55faf54c86d0 0x55faf56aa5d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faf51e3aa0 0x55faf56aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 --2- 172.21.15.44:0/1301662095 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55faf511f890 0x55faf56a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4dbaa00640 0 client.6678 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 >> 172.21.15.44:0/1301662095 conn(0x55faf50f35c0 msgr2=0x55faf55f65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 shutdown_connections 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 1 -- 172.21.15.44:0/1301662095 wait complete. 2024-09-17T05:41:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4de37d8000 20 client.6678 trim_cache size 0 max 16384 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "e7dcfe0b-b516-49ac-a243-4088022dc873": { 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:41:12.580369+0000", 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:41:43.062 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "a2e333e2-57f6-4b12-968e-f9095df34174": { 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:40:40.784638+0000", 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/subdir", 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:43.063 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:41:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4db4073200 msgr2=0x7f4db4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4db4073200 0x7f4db4075710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4dd415b560 tx=0x7f4dc00091e0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 msgr2=0x7f4dd40b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 0x7f4dd40b3f50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8000c10 tx=0x7f4dc8004bf0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 shutdown_connections 2024-09-17T05:41:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4db4073200 0x7f4db4075710 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4dd415d840 0x7f4dd415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4dd40b20f0 0x7f4dd40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 --2- 172.21.15.44:0/2923311080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0039f0 0x7f4dd40b3f50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 >> 172.21.15.44:0/2923311080 conn(0x7f4dd40d1120 msgr2=0x7f4dd40cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 shutdown_connections 2024-09-17T05:41:43.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.055+0000 7f4ddc200640 1 -- 172.21.15.44:0/2923311080 wait complete. 2024-09-17T05:41:43.077 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:41:43.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:43.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 -- 172.21.15.44:0/256811731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdab0004810 msgr2=0x7fdab0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 --2- 172.21.15.44:0/256811731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdab0004810 0x7fdab0004c20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009b10 tx=0x7fdab401d230 comp rx=0 tx=0).stop 2024-09-17T05:41:43.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 -- 172.21.15.44:0/256811731 shutdown_connections 2024-09-17T05:41:43.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 --2- 172.21.15.44:0/256811731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdab0004810 0x7fdab0004c20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 -- 172.21.15.44:0/256811731 >> 172.21.15.44:0/256811731 conn(0x7fdacc0b4240 msgr2=0x7fdacc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 -- 172.21.15.44:0/256811731 shutdown_connections 2024-09-17T05:41:43.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 -- 172.21.15.44:0/256811731 wait complete. 2024-09-17T05:41:43.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 Processor -- start 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.235+0000 7fdad1400640 1 -- start start 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdab0004810 0x7fdacc1f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdacc153360 0x7fdacc1527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdacc0b6800 0x7fdacc0b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc0cf1f0 con 0x7fdacc0b6800 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdacc0cf070 con 0x7fdab0004810 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fdacc0cf370 con 0x7fdacc153360 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdacc0b6800 0x7fdacc0b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdacc0b6800 0x7fdacc0b6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33194/0 (socket says 172.21.15.44:33194) 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 -- 172.21.15.44:0/4273737017 learned_addr learned my addr 172.21.15.44:0/4273737017 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdaca800640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdab0004810 0x7fdacc1f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdac1e00640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdacc153360 0x7fdacc1527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 -- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdacc153360 msgr2=0x7fdacc1527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdacc153360 0x7fdacc1527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 -- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdab0004810 msgr2=0x7fdacc1f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdab0004810 0x7fdacc1f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 -- 172.21.15.44:0/4273737017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc0b7150 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdacb200640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdacc0b6800 0x7fdacc0b6c10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdacc161250 tx=0x7fdac4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdac3400640 1 -- 172.21.15.44:0/4273737017 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4003d90 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdac3400640 1 -- 172.21.15.44:0/4273737017 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdac40118a0 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdac3400640 1 -- 172.21.15.44:0/4273737017 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011cd0 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdacc0ae690 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdacc0adba0 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.239+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdacc0b1e60 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.243+0000 7fdac3400640 1 -- 172.21.15.44:0/4273737017 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdac4005070 con 0x7fdacc0b6800 2024-09-17T05:41:43.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.243+0000 7fdac3400640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdaa8073230 0x7fdaa8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.243+0000 7fdac3400640 1 -- 172.21.15.44:0/4273737017 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fdac4097e40 con 0x7fdacc0b6800 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.243+0000 7fdaca800640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdaa8073230 0x7fdaa8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.243+0000 7fdaca800640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdaa8073230 0x7fdaa8075740 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdacc077520 tx=0x7fdabc001270 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.247+0000 7fdac3400640 1 -- 172.21.15.44:0/4273737017 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fdacc0b7150 con 0x7fdacc0b6800 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.455+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdacc0767a0 con 0x7fdacc0b6800 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.455+0000 7fdac3400640 1 -- 172.21.15.44:0/4273737017 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5227 (secure 0 0 0) 0x7fdac4062620 con 0x7fdacc0b6800 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:43.734 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":54,"btime":"2024-09-17T05:41:16:452297+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:41:15.814585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6337,"qdb_cluster":[6337]},"id":5}]} 2024-09-17T05:41:43.735 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 54 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdaa8073230 msgr2=0x7fdaa8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdaa8073230 0x7fdaa8075740 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdacc077520 tx=0x7fdabc001270 comp rx=0 tx=0).stop 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdacc0b6800 msgr2=0x7fdacc0b6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdacc0b6800 0x7fdacc0b6c10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdacc161250 tx=0x7fdac4005f90 comp rx=0 tx=0).stop 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 shutdown_connections 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdacc0b6800 0x7fdacc0b6c10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdacc153360 0x7fdacc1527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdaa8073230 0x7fdaa8075740 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 --2- 172.21.15.44:0/4273737017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdab0004810 0x7fdacc1f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 >> 172.21.15.44:0/4273737017 conn(0x7fdacc0b4240 msgr2=0x7fdacc15dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 shutdown_connections 2024-09-17T05:41:43.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.459+0000 7fdad1400640 1 -- 172.21.15.44:0/4273737017 wait complete. 2024-09-17T05:41:43.738 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 -- 172.21.15.44:0/830644671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 msgr2=0x7f736415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 --2- 172.21.15.44:0/830644671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f736415e990 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7354009c80 tx=0x7f735401cd10 comp rx=0 tx=0).stop 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 -- 172.21.15.44:0/830644671 shutdown_connections 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 --2- 172.21.15.44:0/830644671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73640cb470 0x7f73640cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 --2- 172.21.15.44:0/830644671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f736415e990 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 -- 172.21.15.44:0/830644671 >> 172.21.15.44:0/830644671 conn(0x7f73640ccaa0 msgr2=0x7f73640cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 -- 172.21.15.44:0/830644671 shutdown_connections 2024-09-17T05:41:43.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 -- 172.21.15.44:0/830644671 wait complete. 2024-09-17T05:41:43.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 Processor -- start 2024-09-17T05:41:43.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.899+0000 7f7369e00640 1 -- start start 2024-09-17T05:41:43.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f736406de50 0x7f73641f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f73641fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cb470 0x7f73640a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7364168ed0 con 0x7f7364072e50 2024-09-17T05:41:43.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7364168d50 con 0x7f73640cb470 2024-09-17T05:41:43.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7364169050 con 0x7f736406de50 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f73641fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f73641fa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33222/0 (socket says 172.21.15.44:33222) 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 -- 172.21.15.44:0/988045367 learned_addr learned my addr 172.21.15.44:0/988045367 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7362a00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f736406de50 0x7f73641f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7363400640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cb470 0x7f73640a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 -- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f736406de50 msgr2=0x7f73641f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f736406de50 0x7f73641f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 -- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cb470 msgr2=0x7f73640a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cb470 0x7f73640a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 -- 172.21.15.44:0/988045367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73640a0300 con 0x7f7364072e50 2024-09-17T05:41:43.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735a000640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f73641fa3d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f734c00c3c0 tx=0x7f734c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735be00640 1 -- 172.21.15.44:0/988045367 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c017070 con 0x7f7364072e50 2024-09-17T05:41:43.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735be00640 1 -- 172.21.15.44:0/988045367 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f734c0053c0 con 0x7f7364072e50 2024-09-17T05:41:43.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f735be00640 1 -- 172.21.15.44:0/988045367 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c003860 con 0x7f7364072e50 2024-09-17T05:41:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73641f9ad0 con 0x7f7364072e50 2024-09-17T05:41:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.903+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73641fa090 con 0x7f7364072e50 2024-09-17T05:41:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f735be00640 1 -- 172.21.15.44:0/988045367 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f734c01a070 con 0x7f7364072e50 2024-09-17T05:41:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f735be00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7340073230 0x7f7340075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f735be00640 1 -- 172.21.15.44:0/988045367 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f734c093670 con 0x7f7364072e50 2024-09-17T05:41:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f7362a00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7340073230 0x7f7340075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 Processor -- start 2024-09-17T05:41:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 -- start start 2024-09-17T05:41:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f7362a00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7340073230 0x7f7340075740 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f73540af000 tx=0x7f73540a5f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026681b60 0x55b0267c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b0266771c0 0x55b0267c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b026665d00 con 0x55b026660d90 2024-09-17T05:41:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b0265d9c90 con 0x55b0266771c0 2024-09-17T05:41:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.907+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b0265c90c0 con 0x55b026681b60 2024-09-17T05:41:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33228/0 (socket says 172.21.15.44:33228) 2024-09-17T05:41:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 -- 172.21.15.44:0/1902151649 learned_addr learned my addr 172.21.15.44:0/1902151649 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7362a00640 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026681b60 0x55b0267c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f735a000640 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b0266771c0 0x55b0267c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 -- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026681b60 msgr2=0x55b0267c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026681b60 0x55b0267c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 -- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b0266771c0 msgr2=0x55b0267c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b0266771c0 0x55b0267c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 -- 172.21.15.44:0/1902151649 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0265a4290 con 0x55b026660d90 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f735a000640 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b0266771c0 0x55b0267c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7363400640 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267c7d60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f735c0036b0 tx=0x7f735c003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62574a549846670b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7353400640 1 -- 172.21.15.44:0/1902151649 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00bb00 con 0x55b026660d90 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7353400640 1 -- 172.21.15.44:0/1902151649 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f735c015070 con 0x55b026660d90 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f7353400640 1 -- 172.21.15.44:0/1902151649 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c005020 con 0x55b026660d90 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 -- 172.21.15.44:0/1902151649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 msgr2=0x55b0267c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267c7d60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f735c0036b0 tx=0x7f735c003b70 comp rx=0 tx=0).stop 2024-09-17T05:41:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 -- 172.21.15.44:0/1902151649 shutdown_connections 2024-09-17T05:41:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267c7d60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b0266771c0 0x55b0267c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 --2- 172.21.15.44:0/1902151649 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026681b60 0x55b0267c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 -- 172.21.15.44:0/1902151649 >> 172.21.15.44:0/1902151649 conn(0x55b026286760 msgr2=0x55b0267aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 -- 172.21.15.44:0/1902151649 shutdown_connections 2024-09-17T05:41:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 -- 172.21.15.44:0/1902151649 wait complete. 2024-09-17T05:41:43.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 -- start start 2024-09-17T05:41:43.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.911+0000 7f737154c000 1 Processor -- start 2024-09-17T05:41:43.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267830d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b0266771c0 0x55b026783610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b026563940 con 0x55b026660d90 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b0265cced0 con 0x55b026681b60 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b02628e820 con 0x55b0266771c0 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 10 client.0 _ll_register_callbacks cb 0x55b0265a77f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267830d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33244/0 (socket says 172.21.15.44:33244) 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 -- 172.21.15.44:0/729377338 learned_addr learned my addr 172.21.15.44:0/729377338 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f735a000640 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b0266771c0 0x55b026783610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7363400640 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 -- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b0266771c0 msgr2=0x55b026783610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b0266771c0 0x55b026783610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 -- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 msgr2=0x55b0267a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 -- 172.21.15.44:0/729377338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02657c550 con 0x55b026660d90 2024-09-17T05:41:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7362a00640 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267830d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f735401c780 tx=0x7f735401b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ba9a8ecd0af81a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7347e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7347e00640 1 -- 172.21.15.44:0/729377338 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73540c7070 con 0x55b026660d90 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7347e00640 1 -- 172.21.15.44:0/729377338 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f7354004240 con 0x55b026660d90 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b026561400 con 0x55b026660d90 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7347e00640 1 -- 172.21.15.44:0/729377338 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f73540b2040 con 0x55b026660d90 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 10 client.6699 fetch_fsmap learned FSMap version 54 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55b026567480 con 0x55b026660d90 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7347e00640 1 -- 172.21.15.44:0/729377338 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b026561400 con 0x55b026660d90 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7347e00640 1 -- 172.21.15.44:0/729377338 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7f73540d5080 con 0x55b026660d90 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 10 client.6699 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 10 client.6699 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 20 client.6699 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b02626bad0 0x55b0267d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 4 client.6699 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0265dbbe0 con 0x55b02626bad0 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f735a000640 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b02626bad0 0x55b0267d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f735a000640 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b02626bad0 0x55b0267d88a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7bd3a8af1aad6d7 server_cookie=becd017b0f07711b in_seq=0 out_seq=0 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.915+0000 7f7347e00640 10 client.6699 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f7347e00640 1 -- 172.21.15.44:0/729377338 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0265dbbe0 con 0x55b02626bad0 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f7347e00640 10 client.6699 handle_command_reply: tid=0 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 client.6699 shutdown 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 msgr2=0x55b0267830d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267830d0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f735401c780 tx=0x7f735401b550 comp rx=0 tx=0).stop 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 shutdown_connections 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b02626bad0 0x55b0267d88a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b0266771c0 0x55b026783610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f7347e00640 0 client.6699 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 --2- 172.21.15.44:0/729377338 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b026660d90 0x55b0267830d0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 >> 172.21.15.44:0/729377338 conn(0x55b026286760 msgr2=0x55b02677b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 shutdown_connections 2024-09-17T05:41:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 1 -- 172.21.15.44:0/729377338 wait complete. 2024-09-17T05:41:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.919+0000 7f737154c000 20 client.6699 trim_cache size 0 max 16384 2024-09-17T05:41:43.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.931+0000 7f737154c000 1 Processor -- start 2024-09-17T05:41:43.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.931+0000 7f737154c000 1 -- start start 2024-09-17T05:41:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b02677d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b02677dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b02677e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b026787510 con 0x55b0266771c0 2024-09-17T05:41:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b026574300 con 0x55b026681b60 2024-09-17T05:41:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b0265d8a60 con 0x55b026660d90 2024-09-17T05:41:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b02677dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b02677dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33258/0 (socket says 172.21.15.44:33258) 2024-09-17T05:41:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 -- 172.21.15.44:0/1462002050 learned_addr learned my addr 172.21.15.44:0/1462002050 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f7362a00640 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b02677d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 -- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 msgr2=0x55b02677d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f7363400640 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b02677e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b02677d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 -- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 msgr2=0x55b02677e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b02677e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 -- 172.21.15.44:0/1462002050 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02664ed10 con 0x55b0266771c0 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f7362a00640 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b02677d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f7363400640 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b02677e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f735a000640 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b02677dbd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f734c05dde0 tx=0x7f734c0917f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b48c16e9e0621ea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f7352a00640 1 -- 172.21.15.44:0/1462002050 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c065b70 con 0x55b0266771c0 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f7352a00640 1 -- 172.21.15.44:0/1462002050 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f734c077070 con 0x55b0266771c0 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f7352a00640 1 -- 172.21.15.44:0/1462002050 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c05d0b0 con 0x55b0266771c0 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- 172.21.15.44:0/1462002050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 msgr2=0x55b02677dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b02677dbd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f734c05dde0 tx=0x7f734c0917f0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- 172.21.15.44:0/1462002050 shutdown_connections 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b02677e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b02677dbd0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 --2- 172.21.15.44:0/1462002050 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b02677d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- 172.21.15.44:0/1462002050 >> 172.21.15.44:0/1462002050 conn(0x55b026286760 msgr2=0x55b0267a94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- 172.21.15.44:0/1462002050 shutdown_connections 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.935+0000 7f737154c000 1 -- 172.21.15.44:0/1462002050 wait complete. 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 -- start start 2024-09-17T05:41:43.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 Processor -- start 2024-09-17T05:41:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b0267daed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b0267db410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b026595300 con 0x55b0266771c0 2024-09-17T05:41:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b026586670 con 0x55b026681b60 2024-09-17T05:41:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b0265cc1e0 con 0x55b026660d90 2024-09-17T05:41:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 10 client.0 _ll_register_callbacks cb 0x7f7354004e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b0267db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b0267db410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33260/0 (socket says 172.21.15.44:33260) 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 -- 172.21.15.44:0/1039373188 learned_addr learned my addr 172.21.15.44:0/1039373188 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7362a00640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b0267daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7363400640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 -- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 msgr2=0x55b0267daed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b0267daed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 -- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 msgr2=0x55b0267f8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267f8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 -- 172.21.15.44:0/1039373188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02657fe50 con 0x55b0266771c0 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7363400640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f735a000640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b0267db410 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f734c05b0c0 tx=0x7f734c091c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b641dd93636f4f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7347e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:41:43.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7347e00640 1 -- 172.21.15.44:0/1039373188 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734c0831a0 con 0x55b0266771c0 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7347e00640 1 -- 172.21.15.44:0/1039373188 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f734c083340 con 0x55b0266771c0 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f734c077070 con 0x55b0266771c0 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7347e00640 1 -- 172.21.15.44:0/1039373188 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f734c0597a0 con 0x55b0266771c0 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 10 client.6705 fetch_fsmap learned FSMap version 54 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x55b02656e2d0 con 0x55b0266771c0 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7347e00640 1 -- 172.21.15.44:0/1039373188 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f734c077070 con 0x55b0266771c0 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7347e00640 1 -- 172.21.15.44:0/1039373188 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 54) ==== 3502+0+0 (secure 0 0 0) 0x7f734c059940 con 0x55b0266771c0 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 10 client.6705 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T05:41:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 10 client.6705 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 20 client.6705 populate_metadata read hostname 'smithi044' 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b026259b30 0x55b0267f9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 4 client.6705 mds_command: new command op to 6337 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 --> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55b0265d7690 con 0x55b026259b30 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.939+0000 7f7362a00640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b026259b30 0x55b0267f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7362a00640 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b026259b30 0x55b0267f9780 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab16c5ec1bdfb6e7 server_cookie=ab17faee3a590f7c in_seq=0 out_seq=0 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7347e00640 10 client.6705 ms_handle_connect on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7347e00640 1 -- 172.21.15.44:0/1039373188 <== mds.0 v2:172.21.15.44:6832/2539887819 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0265d7690 con 0x55b026259b30 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7347e00640 10 client.6705 handle_command_reply: tid=0 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 client.6705 shutdown 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 msgr2=0x55b0267db410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b0267db410 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f734c05b0c0 tx=0x7f734c091c30 comp rx=0 tx=0).stop 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 shutdown_connections 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:6832/2539887819,v1:172.21.15.44:6834/2539887819] conn(0x55b026259b30 0x55b0267f9780 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b026681b60 0x55b0267f8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0266771c0 0x55b0267db410 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 --2- 172.21.15.44:0/1039373188 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b026660d90 0x55b0267daed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7347e00640 0 client.6705 ms_handle_reset on v2:172.21.15.44:6832/2539887819 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 >> 172.21.15.44:0/1039373188 conn(0x55b026286760 msgr2=0x55b0267d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 shutdown_connections 2024-09-17T05:41:43.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 1 -- 172.21.15.44:0/1039373188 wait complete. 2024-09-17T05:41:43.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f737154c000 20 client.6705 trim_cache size 0 max 16384 2024-09-17T05:41:43.950 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:43.950 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7340073230 msgr2=0x7f7340075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7340073230 0x7f7340075740 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f73540af000 tx=0x7f73540a5f90 comp rx=0 tx=0).stop 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 msgr2=0x7f73641fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f73641fa3d0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f734c00c3c0 tx=0x7f734c00c880 comp rx=0 tx=0).stop 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 shutdown_connections 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7340073230 0x7f7340075740 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73640cb470 0x7f73640a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7364072e50 0x7f73641fa3d0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 --2- 172.21.15.44:0/988045367 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f736406de50 0x7f73641f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 >> 172.21.15.44:0/988045367 conn(0x7f73640ccaa0 msgr2=0x7f736406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:43.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 shutdown_connections 2024-09-17T05:41:43.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:43.943+0000 7f7369e00640 1 -- 172.21.15.44:0/988045367 wait complete. 2024-09-17T05:41:43.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:41:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.119+0000 7f78c3600640 1 -- 172.21.15.44:0/1126067722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d18f0 msgr2=0x7f78bc0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.119+0000 7f78c3600640 1 --2- 172.21.15.44:0/1126067722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d18f0 0x7f78bc0b1be0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009840 tx=0x7f78b001c760 comp rx=0 tx=0).stop 2024-09-17T05:41:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.119+0000 7f78c3600640 1 -- 172.21.15.44:0/1126067722 shutdown_connections 2024-09-17T05:41:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.119+0000 7f78c3600640 1 --2- 172.21.15.44:0/1126067722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d18f0 0x7f78bc0b1be0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.119+0000 7f78c3600640 1 -- 172.21.15.44:0/1126067722 >> 172.21.15.44:0/1126067722 conn(0x7f78bc0b4240 msgr2=0x7f78bc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.119+0000 7f78c3600640 1 -- 172.21.15.44:0/1126067722 shutdown_connections 2024-09-17T05:41:44.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.119+0000 7f78c3600640 1 -- 172.21.15.44:0/1126067722 wait complete. 2024-09-17T05:41:44.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 Processor -- start 2024-09-17T05:41:44.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 -- start start 2024-09-17T05:41:44.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78bc0d18f0 0x7f78bc157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d1d00 0x7f78bc0b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b7a20 0x7f78bc165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc16b0a0 con 0x7f78bc0d1d00 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc16af20 con 0x7f78bc0d18f0 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78c3600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc16b220 con 0x7f78bc0b7a20 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78bbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d1d00 0x7f78bc0b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78bbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d1d00 0x7f78bc0b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33276/0 (socket says 172.21.15.44:33276) 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.123+0000 7f78bbe00640 1 -- 172.21.15.44:0/680242506 learned_addr learned my addr 172.21.15.44:0/680242506 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78c1600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b7a20 0x7f78bc165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78c0c00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78bc0d18f0 0x7f78bc157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78bbe00640 1 -- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b7a20 msgr2=0x7f78bc165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78bbe00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b7a20 0x7f78bc165690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78bbe00640 1 -- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78bc0d18f0 msgr2=0x7f78bc157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78bbe00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78bc0d18f0 0x7f78bc157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78bbe00640 1 -- 172.21.15.44:0/680242506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc158360 con 0x7f78bc0d1d00 2024-09-17T05:41:44.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78c1600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b7a20 0x7f78bc165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78c0c00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78bc0d18f0 0x7f78bc157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78bbe00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d1d00 0x7f78bc0b74e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f78a800c430 tx=0x7f78a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78b8c00640 1 -- 172.21.15.44:0/680242506 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8017070 con 0x7f78bc0d1d00 2024-09-17T05:41:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78b8c00640 1 -- 172.21.15.44:0/680242506 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78a80053c0 con 0x7f78bc0d1d00 2024-09-17T05:41:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78b8c00640 1 -- 172.21.15.44:0/680242506 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8003860 con 0x7f78bc0d1d00 2024-09-17T05:41:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78bc158870 con 0x7f78bc0d1d00 2024-09-17T05:41:44.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc158e30 con 0x7f78bc0d1d00 2024-09-17T05:41:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78bc0b1be0 con 0x7f78bc0d1d00 2024-09-17T05:41:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.127+0000 7f78b8c00640 1 -- 172.21.15.44:0/680242506 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f78a801a070 con 0x7f78bc0d1d00 2024-09-17T05:41:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.131+0000 7f78b8c00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f789c073200 0x7f789c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.131+0000 7f78b8c00640 1 -- 172.21.15.44:0/680242506 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f78a8093990 con 0x7f78bc0d1d00 2024-09-17T05:41:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.131+0000 7f78c0c00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f789c073200 0x7f789c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.131+0000 7f78c0c00640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f789c073200 0x7f789c075710 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f78b00af000 tx=0x7f78b001afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:44.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.135+0000 7f78b8c00640 1 -- 172.21.15.44:0/680242506 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f78a805e6b0 con 0x7f78bc0d1d00 2024-09-17T05:41:44.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.343+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f78bc158600 con 0x7f78bc0d1d00 2024-09-17T05:41:44.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.343+0000 7f78b8c00640 1 -- 172.21.15.44:0/680242506 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f78a805dfb0 con 0x7f78bc0d1d00 2024-09-17T05:41:44.346 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:44.346 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:41:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f789c073200 msgr2=0x7f789c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f789c073200 0x7f789c075710 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f78b00af000 tx=0x7f78b001afa0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d1d00 msgr2=0x7f78bc0b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d1d00 0x7f78bc0b74e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f78a800c430 tx=0x7f78a800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 shutdown_connections 2024-09-17T05:41:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f78bc0b7a20 0x7f78bc165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78bc0d1d00 0x7f78bc0b74e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f789c073200 0x7f789c075710 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 --2- 172.21.15.44:0/680242506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78bc0d18f0 0x7f78bc157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 >> 172.21.15.44:0/680242506 conn(0x7f78bc0b4240 msgr2=0x7f78bc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 shutdown_connections 2024-09-17T05:41:44.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.347+0000 7f78c3600640 1 -- 172.21.15.44:0/680242506 wait complete. 2024-09-17T05:41:44.367 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:41:44.368 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:41:44.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 -- 172.21.15.44:0/1864423671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 msgr2=0x7f8c9015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 --2- 172.21.15.44:0/1864423671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 0x7f8c9015e990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009870 tx=0x7f8c8001c7f0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 -- 172.21.15.44:0/1864423671 shutdown_connections 2024-09-17T05:41:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 --2- 172.21.15.44:0/1864423671 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 0x7f8c9015e990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 -- 172.21.15.44:0/1864423671 >> 172.21.15.44:0/1864423671 conn(0x7f8c900ccaa0 msgr2=0x7f8c900cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 -- 172.21.15.44:0/1864423671 shutdown_connections 2024-09-17T05:41:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 -- 172.21.15.44:0/1864423671 wait complete. 2024-09-17T05:41:44.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 Processor -- start 2024-09-17T05:41:44.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.527+0000 7f8c94e00640 1 -- start start 2024-09-17T05:41:44.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c9006de50 0x7f8c901fbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 0x7f8c900a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c900cb470 0x7f8c900a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8c90169f80 con 0x7f8c900cb470 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8c90169e00 con 0x7f8c9006de50 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9016a100 con 0x7f8c90072e50 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c900cb470 0x7f8c900a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c900cb470 0x7f8c900a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33278/0 (socket says 172.21.15.44:33278) 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 -- 172.21.15.44:0/508637315 learned_addr learned my addr 172.21.15.44:0/508637315 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8de00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c9006de50 0x7f8c901fbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c87e00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 0x7f8c900a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 -- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 msgr2=0x7f8c900a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 0x7f8c900a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 -- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c9006de50 msgr2=0x7f8c901fbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c9006de50 0x7f8c901fbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 -- 172.21.15.44:0/508637315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9009f300 con 0x7f8c900cb470 2024-09-17T05:41:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c8e800640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c900cb470 0x7f8c900a0910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800cb10 tx=0x7f8c8800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c86000640 1 -- 172.21.15.44:0/508637315 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c88016020 con 0x7f8c900cb470 2024-09-17T05:41:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9009f5c0 con 0x7f8c900cb470 2024-09-17T05:41:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c86000640 1 -- 172.21.15.44:0/508637315 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c8800ce50 con 0x7f8c900cb470 2024-09-17T05:41:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c86000640 1 -- 172.21.15.44:0/508637315 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800ad80 con 0x7f8c900cb470 2024-09-17T05:41:44.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9009fb80 con 0x7f8c900cb470 2024-09-17T05:41:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9015e990 con 0x7f8c900cb470 2024-09-17T05:41:44.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.531+0000 7f8c86000640 1 -- 172.21.15.44:0/508637315 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8c88019020 con 0x7f8c900cb470 2024-09-17T05:41:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.535+0000 7f8c86000640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8c6c073230 0x7f8c6c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.535+0000 7f8c86000640 1 -- 172.21.15.44:0/508637315 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f8c880942b0 con 0x7f8c900cb470 2024-09-17T05:41:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.535+0000 7f8c8de00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8c6c073230 0x7f8c6c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.535+0000 7f8c8de00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8c6c073230 0x7f8c6c075740 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8c800af000 tx=0x7f8c8001b030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:44.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.539+0000 7f8c86000640 1 -- 172.21.15.44:0/508637315 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8c88020030 con 0x7f8c900cb470 2024-09-17T05:41:44.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.747+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8c900b5fa0 con 0x7f8c900cb470 2024-09-17T05:41:44.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.747+0000 7f8c86000640 1 -- 172.21.15.44:0/508637315 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) ==== 53+0+73 (secure 0 0 0) 0x7f8c8805ea10 con 0x7f8c900cb470 2024-09-17T05:41:44.751 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:41:44.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8c6c073230 msgr2=0x7f8c6c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8c6c073230 0x7f8c6c075740 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8c800af000 tx=0x7f8c8001b030 comp rx=0 tx=0).stop 2024-09-17T05:41:44.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c900cb470 msgr2=0x7f8c900a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:44.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c900cb470 0x7f8c900a0910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800cb10 tx=0x7f8c8800cc00 comp rx=0 tx=0).stop 2024-09-17T05:41:44.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 shutdown_connections 2024-09-17T05:41:44.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8c900cb470 0x7f8c900a0910 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8c90072e50 0x7f8c900a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8c6c073230 0x7f8c6c075740 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 --2- 172.21.15.44:0/508637315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c9006de50 0x7f8c901fbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:44.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 >> 172.21.15.44:0/508637315 conn(0x7f8c900ccaa0 msgr2=0x7f8c900afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:44.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 shutdown_connections 2024-09-17T05:41:44.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:44.751+0000 7f8c94e00640 1 -- 172.21.15.44:0/508637315 wait complete. 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:41:44.773 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:41:44.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:44.774 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:41:44.784 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42101sec preferred_lft 42101sec 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:41:44.785 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:41:44.786 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:41:44.786 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.786 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:41:44.786 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:41:44.786 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:41:44.786 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.786 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:41:44.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:44.788 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:41:44.849 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:41:44.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:44.851 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:41:44.908 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:41:44.908 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:41:44.908 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:41:44.908 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:41:44.909 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:41:44.909 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:41:44.909 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:41:44.909 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:41:44.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:41:44.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:41:44.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:41:44.910 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:41:44.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:41:45.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:41:45.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:45.048 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:41:45.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:41:45.057 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:41:45.057 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:41:45.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:45.058 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:41:45.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:41:45.119 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:41:45.175 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:41:45.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:41:45.175 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:41:45.226 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:41:45.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:45.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:41:45.328 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:41:45.328 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:41:45.328 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:41:45.346 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:41:45.346 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:41:45.346 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:41:45.346 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:41:45.346 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:41:45.356 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:41:45.360 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:41:45.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:45.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:41:45.380 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:41:45.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:41:45.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:41:45.484 INFO:teuthology.orchestra.run.smithi044.stdout:client6723 2024-09-17T05:41:45.485 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:41:45.485 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:45.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:45.494 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-09-17T05:41:45.545 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:41:45.545 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-09-17T05:41:45.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 Processor -- start 2024-09-17T05:41:45.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 -- start start 2024-09-17T05:41:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075991480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 0x5600759919c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 0x560075a6a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56007593ff40 con 0x560075a50370 2024-09-17T05:41:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56007594cd00 con 0x560075a52ed0 2024-09-17T05:41:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cc130e080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5600758e1a00 con 0x560075a6a570 2024-09-17T05:41:45.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075991480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075991480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33304/0 (socket says 172.21.15.44:33304) 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 -- 172.21.15.44:0/1726275883 learned_addr learned my addr 172.21.15.44:0/1726275883 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cbae00640 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 0x560075a6a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cb9a00640 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 0x5600759919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 -- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 msgr2=0x560075a6a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 0x560075a6a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 -- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 msgr2=0x5600759919c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 0x5600759919c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 -- 172.21.15.44:0/1726275883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560075a6c640 con 0x560075a50370 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cba400640 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075991480 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0cac001dd0 tx=0x7f0cac00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730f1a0efcb4f39a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cb3e00640 1 -- 172.21.15.44:0/1726275883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac012070 con 0x560075a50370 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cb3e00640 1 -- 172.21.15.44:0/1726275883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cac00e950 con 0x560075a50370 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.651+0000 7f0cb3e00640 1 -- 172.21.15.44:0/1726275883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00eda0 con 0x560075a50370 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- 172.21.15.44:0/1726275883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 msgr2=0x560075991480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075991480 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f0cac001dd0 tx=0x7f0cac00b680 comp rx=0 tx=0).stop 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- 172.21.15.44:0/1726275883 shutdown_connections 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 0x560075a6a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 0x5600759919c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1726275883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075991480 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- 172.21.15.44:0/1726275883 >> 172.21.15.44:0/1726275883 conn(0x56007597fd20 msgr2=0x560075a52230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:45.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- 172.21.15.44:0/1726275883 shutdown_connections 2024-09-17T05:41:45.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- 172.21.15.44:0/1726275883 wait complete. 2024-09-17T05:41:45.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 Processor -- start 2024-09-17T05:41:45.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- start start 2024-09-17T05:41:45.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075a676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 0x5600759d5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 0x5600759d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560075a6c8e0 con 0x560075a50370 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560075a69bd0 con 0x560075a52ed0 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cc130e080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560075a6cb80 con 0x560075a6a570 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075a676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075a676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33318/0 (socket says 172.21.15.44:33318) 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 -- 172.21.15.44:0/1482598904 learned_addr learned my addr 172.21.15.44:0/1482598904 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cbae00640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 0x5600759d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cb9a00640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 0x5600759d5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 -- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 msgr2=0x5600759d5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560075a6a570 0x5600759d5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 -- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 msgr2=0x5600759d5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:45.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560075a52ed0 0x5600759d5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.655+0000 7f0cba400640 1 -- 172.21.15.44:0/1482598904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600759dc450 con 0x560075a50370 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cba400640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075a676d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0cac002fb0 tx=0x7f0cac017680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cb2a00640 1 -- 172.21.15.44:0/1482598904 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac025070 con 0x560075a50370 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cb2a00640 1 -- 172.21.15.44:0/1482598904 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cac00e640 con 0x560075a50370 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600759dc6f0 con 0x560075a50370 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cb2a00640 1 -- 172.21.15.44:0/1482598904 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cac012040 con 0x560075a50370 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560075a51a30 con 0x560075a50370 2024-09-17T05:41:45.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cb2a00640 1 -- 172.21.15.44:0/1482598904 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0cac028070 con 0x560075a50370 2024-09-17T05:41:45.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cb2a00640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c9c071be0 0x7f0c9c0740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.659+0000 7f0cb2a00640 1 -- 172.21.15.44:0/1482598904 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f0cac094650 con 0x560075a50370 2024-09-17T05:41:45.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cb9a00640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c9c071be0 0x7f0c9c0740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5600759d6f70 0x5600759d7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:45.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) -- 0x5600759dbaf0 con 0x5600759d6f70 2024-09-17T05:41:45.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cbae00640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5600759d6f70 0x5600759d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:45.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cb9a00640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c9c071be0 0x7f0c9c0740f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8000c10 tx=0x7f0ca80017a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:45.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cbae00640 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5600759d6f70 0x5600759d7380 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cbae00640 1 -- 172.21.15.44:0/1482598904 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v78'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0cb4002050 con 0x5600759d6f70 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5600759d6f70 msgr2=0x5600759d7380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5600759d6f70 0x5600759d7380 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c9c071be0 msgr2=0x7f0c9c0740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0c9c071be0 0x7f0c9c0740f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8000c10 tx=0x7f0ca80017a0 comp rx=0 tx=0).stop 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 msgr2=0x560075a676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 --2- 172.21.15.44:0/1482598904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560075a50370 0x560075a676d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0cac002fb0 tx=0x7f0cac017680 comp rx=0 tx=0).stop 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cbae00640 1 -- 172.21.15.44:0/1482598904 reap_dead start 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 shutdown_connections 2024-09-17T05:41:45.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 >> 172.21.15.44:0/1482598904 conn(0x56007597fd20 msgr2=0x5600759c61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:45.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 shutdown_connections 2024-09-17T05:41:45.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:45.663+0000 7f0cc130e080 1 -- 172.21.15.44:0/1482598904 wait complete. 2024-09-17T05:41:45.672 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:41:45.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:41:45.765 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:41:45.862 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:41:45.862 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:41:45.863 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:41:45.863 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:45.871 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:41:45.872 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:45.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 -- 172.21.15.44:0/2993962213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d40ccb60 msgr2=0x7f98d406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 --2- 172.21.15.44:0/2993962213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d40ccb60 0x7f98d406df50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f98d40b0420 tx=0x7f98bc01c830 comp rx=0 tx=0).stop 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 -- 172.21.15.44:0/2993962213 shutdown_connections 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 --2- 172.21.15.44:0/2993962213 >> v2:172.21.15.86:3300/0 conn(0x7f98d406e490 0x7f98d4151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 --2- 172.21.15.44:0/2993962213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d40ccb60 0x7f98d406df50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 --2- 172.21.15.44:0/2993962213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98d4070e00 0x7f98d4071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 -- 172.21.15.44:0/2993962213 >> 172.21.15.44:0/2993962213 conn(0x7f98d40cd930 msgr2=0x7f98d40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 -- 172.21.15.44:0/2993962213 shutdown_connections 2024-09-17T05:41:46.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 -- 172.21.15.44:0/2993962213 wait complete. 2024-09-17T05:41:46.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 Processor -- start 2024-09-17T05:41:46.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.127+0000 7f98d9a00640 1 -- start start 2024-09-17T05:41:46.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d406e490 0x7f98d4152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d4070e00 0x7f98d413d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98d40ccb60 0x7f98d414f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f98d40cecc0 con 0x7f98d4070e00 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f98d40ceb40 con 0x7f98d406e490 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f98d40cee40 con 0x7f98d40ccb60 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d4070e00 0x7f98d413d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d4070e00 0x7f98d413d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33344/0 (socket says 172.21.15.44:33344) 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 -- 172.21.15.44:0/176972102 learned_addr learned my addr 172.21.15.44:0/176972102 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d2a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d406e490 0x7f98d4152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d3400640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98d40ccb60 0x7f98d414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 -- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98d40ccb60 msgr2=0x7f98d414f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98d40ccb60 0x7f98d414f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 -- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d406e490 msgr2=0x7f98d4152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d406e490 0x7f98d4152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 -- 172.21.15.44:0/176972102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d41532c0 con 0x7f98d4070e00 2024-09-17T05:41:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98ca000640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d4070e00 0x7f98d413d200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f98bc01aee0 tx=0x7f98bc0a6730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98cb400640 1 -- 172.21.15.44:0/176972102 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0bd070 con 0x7f98d4070e00 2024-09-17T05:41:46.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98cb400640 1 -- 172.21.15.44:0/176972102 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98bc004430 con 0x7f98d4070e00 2024-09-17T05:41:46.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98cb400640 1 -- 172.21.15.44:0/176972102 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc005290 con 0x7f98d4070e00 2024-09-17T05:41:46.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d41535a0 con 0x7f98d4070e00 2024-09-17T05:41:46.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d41540a0 con 0x7f98d4070e00 2024-09-17T05:41:46.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.131+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d4153010 con 0x7f98d4070e00 2024-09-17T05:41:46.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.135+0000 7f98cb400640 1 -- 172.21.15.44:0/176972102 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f98bc005430 con 0x7f98d4070e00 2024-09-17T05:41:46.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.135+0000 7f98cb400640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98b0073200 0x7f98b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.135+0000 7f98cb400640 1 -- 172.21.15.44:0/176972102 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f98bc12e880 con 0x7f98d4070e00 2024-09-17T05:41:46.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.135+0000 7f98d2a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98b0073200 0x7f98b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.135+0000 7f98d2a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98b0073200 0x7f98b0075710 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f98c40045b0 tx=0x7f98c400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:46.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.139+0000 7f98cb400640 1 -- 172.21.15.44:0/176972102 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f98bc0c6080 con 0x7f98d4070e00 2024-09-17T05:41:46.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f98d4071c60 con 0x7f98d4070e00 2024-09-17T05:41:46.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98cb400640 1 -- 172.21.15.44:0/176972102 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v78) ==== 80+0+120 (secure 0 0 0) 0x7f98bc0164b0 con 0x7f98d4070e00 2024-09-17T05:41:46.328 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/330558786 2024-09-18T05:40:32.791517+0000 2024-09-17T05:41:46.328 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6832/330558786 2024-09-18T05:40:32.791517+0000 2024-09-17T05:41:46.329 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-17T05:41:46.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98b0073200 msgr2=0x7f98b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98b0073200 0x7f98b0075710 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f98c40045b0 tx=0x7f98c400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d4070e00 msgr2=0x7f98d413d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d4070e00 0x7f98d413d200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f98bc01aee0 tx=0x7f98bc0a6730 comp rx=0 tx=0).stop 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 shutdown_connections 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f98d40ccb60 0x7f98d414f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f98d4070e00 0x7f98d413d200 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f98b0073200 0x7f98b0075710 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 --2- 172.21.15.44:0/176972102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d406e490 0x7f98d4152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 >> 172.21.15.44:0/176972102 conn(0x7f98d40cd930 msgr2=0x7f98d40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:46.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 shutdown_connections 2024-09-17T05:41:46.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.327+0000 7f98d9a00640 1 -- 172.21.15.44:0/176972102 wait complete. 2024-09-17T05:41:46.351 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:41:46.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:46.351 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:41:46.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:41:46.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:41:46.377 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:41:46.433 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:41:46.433 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:41:46.433 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:46.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:41:46.443 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:41:46.443 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:41:46.443 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:46.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:41:46.483 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:41:46.483 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:41:46.483 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:46.492 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:41:46.493 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.683+0000 7f4cfa800640 1 -- 172.21.15.44:0/747180545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd80041d0 msgr2=0x7f4cd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.683+0000 7f4cfa800640 1 --2- 172.21.15.44:0/747180545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd80041d0 0x7f4cd8004810 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc006fa0 tx=0x7f4cdc01cec0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.683+0000 7f4cf3e00640 1 -- 172.21.15.44:0/747180545 reap_dead start 2024-09-17T05:41:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.683+0000 7f4cfa800640 1 -- 172.21.15.44:0/747180545 shutdown_connections 2024-09-17T05:41:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.683+0000 7f4cfa800640 1 -- 172.21.15.44:0/747180545 >> 172.21.15.44:0/747180545 conn(0x7f4cf40ccaa0 msgr2=0x7f4cf40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.683+0000 7f4cfa800640 1 -- 172.21.15.44:0/747180545 shutdown_connections 2024-09-17T05:41:46.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.683+0000 7f4cfa800640 1 -- 172.21.15.44:0/747180545 wait complete. 2024-09-17T05:41:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 Processor -- start 2024-09-17T05:41:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 -- start start 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd80041d0 0x7f4cf41f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf40b5630 0x7f4cf41fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cf40cb3e0 0x7f4cf40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf4167590 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf4167410 con 0x7f4cf40b5630 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf4167710 con 0x7f4cd80041d0 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cf40cb3e0 0x7f4cf40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cf40cb3e0 0x7f4cf40cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33360/0 (socket says 172.21.15.44:33360) 2024-09-17T05:41:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 -- 172.21.15.44:0/233014197 learned_addr learned my addr 172.21.15.44:0/233014197 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cebe00640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf40b5630 0x7f4cf41fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3400640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd80041d0 0x7f4cf41f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 -- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd80041d0 msgr2=0x7f4cf41f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd80041d0 0x7f4cf41f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 -- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf40b5630 msgr2=0x7f4cf41fc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf40b5630 0x7f4cf41fc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 -- 172.21.15.44:0/233014197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40cbd30 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cebe00640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf40b5630 0x7f4cf41fc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:46.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cf3e00640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cf40cb3e0 0x7f4cf40cb7f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4072de0 tx=0x7f4cec010de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:46.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4ceb400640 1 -- 172.21.15.44:0/233014197 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec017070 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4ceb400640 1 -- 172.21.15.44:0/233014197 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cec015070 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf40b5d60 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4ceb400640 1 -- 172.21.15.44:0/233014197 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec004d90 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.687+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf415aef0 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.691+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf415e990 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.691+0000 7f4ceb400640 1 -- 172.21.15.44:0/233014197 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4cec00e820 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.691+0000 7f4ceb400640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cd0073230 0x7f4cd0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:46.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.691+0000 7f4ceb400640 1 -- 172.21.15.44:0/233014197 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f4cec094bc0 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.691+0000 7f4cf3400640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cd0073230 0x7f4cd0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:46.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.695+0000 7f4cf3400640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cd0073230 0x7f4cd0075740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4000c10 tx=0x7f4ce4006b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:46.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.695+0000 7f4ceb400640 1 -- 172.21.15.44:0/233014197 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4cf40cbd30 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cf40b5fa0 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4ceb400640 1 -- 172.21.15.44:0/233014197 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5227 (secure 0 0 0) 0x7f4cec05fa70 con 0x7f4cf40cb3e0 2024-09-17T05:41:46.908 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:46.909 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":54,"btime":"2024-09-17T05:41:16:452297+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:41:15.814585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6337,"qdb_cluster":[6337]},"id":5}]} 2024-09-17T05:41:46.909 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 54 2024-09-17T05:41:46.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cd0073230 msgr2=0x7f4cd0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cd0073230 0x7f4cd0075740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4000c10 tx=0x7f4ce4006b20 comp rx=0 tx=0).stop 2024-09-17T05:41:46.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cf40cb3e0 msgr2=0x7f4cf40cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:46.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cf40cb3e0 0x7f4cf40cb7f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4072de0 tx=0x7f4cec010de0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 shutdown_connections 2024-09-17T05:41:46.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cf40cb3e0 0x7f4cf40cb7f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cd0073230 0x7f4cd0075740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cf40b5630 0x7f4cf41fc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 --2- 172.21.15.44:0/233014197 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd80041d0 0x7f4cf41f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:46.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 >> 172.21.15.44:0/233014197 conn(0x7f4cf40ccaa0 msgr2=0x7f4cf4070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:46.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 shutdown_connections 2024-09-17T05:41:46.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:46.907+0000 7f4cfa800640 1 -- 172.21.15.44:0/233014197 wait complete. 2024-09-17T05:41:46.931 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:47.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.091+0000 7f59b7a00640 1 -- 172.21.15.44:0/3383431803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59980051b0 msgr2=0x7f599800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.091+0000 7f59b7a00640 1 --2- 172.21.15.44:0/3383431803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59980051b0 0x7f599800b9d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f59a8001f50 tx=0x7f59a801cc40 comp rx=0 tx=0).stop 2024-09-17T05:41:47.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.091+0000 7f59b5a00640 1 -- 172.21.15.44:0/3383431803 reap_dead start 2024-09-17T05:41:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.091+0000 7f59b7a00640 1 -- 172.21.15.44:0/3383431803 shutdown_connections 2024-09-17T05:41:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.091+0000 7f59b7a00640 1 -- 172.21.15.44:0/3383431803 >> 172.21.15.44:0/3383431803 conn(0x7f59b00ccaa0 msgr2=0x7f59b00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.091+0000 7f59b7a00640 1 -- 172.21.15.44:0/3383431803 shutdown_connections 2024-09-17T05:41:47.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.091+0000 7f59b7a00640 1 -- 172.21.15.44:0/3383431803 wait complete. 2024-09-17T05:41:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 Processor -- start 2024-09-17T05:41:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 -- start start 2024-09-17T05:41:47.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59980051b0 0x7f59b00c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59b00a05f0 0x7f59b009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59b00a0a00 0x7f59b009c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59b0074770 con 0x7f59b00a05f0 2024-09-17T05:41:47.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f59b00745f0 con 0x7f59980051b0 2024-09-17T05:41:47.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b7a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f59b006e560 con 0x7f59b00a0a00 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59b00a05f0 0x7f59b009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59b00a05f0 0x7f59b009c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33384/0 (socket says 172.21.15.44:33384) 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 -- 172.21.15.44:0/2259716902 learned_addr learned my addr 172.21.15.44:0/2259716902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b5000640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59980051b0 0x7f59b00c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59b5a00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59b00a0a00 0x7f59b009c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 -- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59b00a0a00 msgr2=0x7f59b009c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59b00a0a00 0x7f59b009c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 -- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59980051b0 msgr2=0x7f59b00c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59980051b0 0x7f59b00c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 -- 172.21.15.44:0/2259716902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b009d690 con 0x7f59b00a05f0 2024-09-17T05:41:47.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59afe00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59b00a05f0 0x7f59b009c0c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f599c011ae0 tx=0x7f599c009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:47.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.095+0000 7f59acc00640 1 -- 172.21.15.44:0/2259716902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c004460 con 0x7f59b00a05f0 2024-09-17T05:41:47.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59acc00640 1 -- 172.21.15.44:0/2259716902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f599c00f940 con 0x7f59b00a05f0 2024-09-17T05:41:47.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59acc00640 1 -- 172.21.15.44:0/2259716902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c00fd50 con 0x7f59b00a05f0 2024-09-17T05:41:47.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b01f3460 con 0x7f59b00a05f0 2024-09-17T05:41:47.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b01f3a20 con 0x7f59b00a05f0 2024-09-17T05:41:47.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b00cfca0 con 0x7f59b00a05f0 2024-09-17T05:41:47.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59acc00640 1 -- 172.21.15.44:0/2259716902 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f599c005020 con 0x7f59b00a05f0 2024-09-17T05:41:47.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59acc00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5990073230 0x7f5990075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.099+0000 7f59acc00640 1 -- 172.21.15.44:0/2259716902 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f599c095910 con 0x7f59b00a05f0 2024-09-17T05:41:47.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.103+0000 7f59b5000640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5990073230 0x7f5990075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.103+0000 7f59b5000640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5990073230 0x7f5990075740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f59a4001250 tx=0x7f59a4001120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:47.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.103+0000 7f59acc00640 1 -- 172.21.15.44:0/2259716902 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f599c0607c0 con 0x7f59b00a05f0 2024-09-17T05:41:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.315+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59b0070c30 con 0x7f59b00a05f0 2024-09-17T05:41:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59acc00640 1 -- 172.21.15.44:0/2259716902 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5227 (secure 0 0 0) 0x7f599c0670c0 con 0x7f59b00a05f0 2024-09-17T05:41:47.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:47.320 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":54,"btime":"2024-09-17T05:41:16:452297+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:41:15.814585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6337,"qdb_cluster":[6337]},"id":5}]} 2024-09-17T05:41:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 54 2024-09-17T05:41:47.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5990073230 msgr2=0x7f5990075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5990073230 0x7f5990075740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f59a4001250 tx=0x7f59a4001120 comp rx=0 tx=0).stop 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59b00a05f0 msgr2=0x7f59b009c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59b00a05f0 0x7f59b009c0c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f599c011ae0 tx=0x7f599c009e10 comp rx=0 tx=0).stop 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 shutdown_connections 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f59b00a0a00 0x7f59b009c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f59b00a05f0 0x7f59b009c0c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5990073230 0x7f5990075740 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 --2- 172.21.15.44:0/2259716902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59980051b0 0x7f59b00c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 >> 172.21.15.44:0/2259716902 conn(0x7f59b00ccaa0 msgr2=0x7f59b00c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 shutdown_connections 2024-09-17T05:41:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.319+0000 7f59b7a00640 1 -- 172.21.15.44:0/2259716902 wait complete. 2024-09-17T05:41:47.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:47.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 -- 172.21.15.44:0/4047146274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf006de50 msgr2=0x7fbaf006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 --2- 172.21.15.44:0/4047146274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf006de50 0x7fbaf006e260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009840 tx=0x7fbadc01c6b0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 -- 172.21.15.44:0/4047146274 shutdown_connections 2024-09-17T05:41:47.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 --2- 172.21.15.44:0/4047146274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf006de50 0x7fbaf006e260 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 -- 172.21.15.44:0/4047146274 >> 172.21.15.44:0/4047146274 conn(0x7fbaf00ccaa0 msgr2=0x7fbaf00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:47.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 -- 172.21.15.44:0/4047146274 shutdown_connections 2024-09-17T05:41:47.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 -- 172.21.15.44:0/4047146274 wait complete. 2024-09-17T05:41:47.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.499+0000 7fbaf5000640 1 Processor -- start 2024-09-17T05:41:47.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 -- start start 2024-09-17T05:41:47.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf006de50 0x7fbaf0166d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf0072e50 0x7fbaf0070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf00cb470 0x7fbaf0070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0169f80 con 0x7fbaf006de50 2024-09-17T05:41:47.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0169e00 con 0x7fbaf00cb470 2024-09-17T05:41:47.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf016a100 con 0x7fbaf0072e50 2024-09-17T05:41:47.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf006de50 0x7fbaf0166d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf006de50 0x7fbaf0166d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33386/0 (socket says 172.21.15.44:33386) 2024-09-17T05:41:47.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 -- 172.21.15.44:0/877735023 learned_addr learned my addr 172.21.15.44:0/877735023 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:47.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaed400640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf0072e50 0x7fbaf0070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaee800640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf00cb470 0x7fbaf0070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 -- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf0072e50 msgr2=0x7fbaf0070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf0072e50 0x7fbaf0070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 -- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf00cb470 msgr2=0x7fbaf0070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf00cb470 0x7fbaf0070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 -- 172.21.15.44:0/877735023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf00bfec0 con 0x7fbaf006de50 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaee800640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf00cb470 0x7fbaf0070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaede00640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf006de50 0x7fbaf0166d20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbae000cab0 tx=0x7fbae000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbae6000640 1 -- 172.21.15.44:0/877735023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0016020 con 0x7fbaf006de50 2024-09-17T05:41:47.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbae6000640 1 -- 172.21.15.44:0/877735023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbae000ab00 con 0x7fbaf006de50 2024-09-17T05:41:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbae6000640 1 -- 172.21.15.44:0/877735023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0012420 con 0x7fbaf006de50 2024-09-17T05:41:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf00c01a0 con 0x7fbaf006de50 2024-09-17T05:41:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.503+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf0152ba0 con 0x7fbaf006de50 2024-09-17T05:41:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.507+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf006e260 con 0x7fbaf006de50 2024-09-17T05:41:47.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.507+0000 7fbae6000640 1 -- 172.21.15.44:0/877735023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbae0019020 con 0x7fbaf006de50 2024-09-17T05:41:47.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.507+0000 7fbae6000640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbad0073230 0x7fbad0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.507+0000 7fbae6000640 1 -- 172.21.15.44:0/877735023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7fbae0094690 con 0x7fbaf006de50 2024-09-17T05:41:47.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.507+0000 7fbaed400640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbad0073230 0x7fbad0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.507+0000 7fbaed400640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbad0073230 0x7fbad0075740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0af000 tx=0x7fbadc0b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:47.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.511+0000 7fbae6000640 1 -- 172.21.15.44:0/877735023 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbae0020020 con 0x7fbaf006de50 2024-09-17T05:41:47.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.687+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaf00af8c0 con 0x7fbaf006de50 2024-09-17T05:41:47.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.687+0000 7fbae6000640 1 -- 172.21.15.44:0/877735023 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+17024 (secure 0 0 0) 0x7fbaf006e7a0 con 0x7fbaf006de50 2024-09-17T05:41:47.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:47.691 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:40:32.791559+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:40:16.116014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T05:40:17.345384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/330558786":"2024-09-18T05:40:32.791517+0000","172.21.15.44:6832/330558786":"2024-09-18T05:40:32.791517+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:47.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbad0073230 msgr2=0x7fbad0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbad0073230 0x7fbad0075740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0af000 tx=0x7fbadc0b2040 comp rx=0 tx=0).stop 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf006de50 msgr2=0x7fbaf0166d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf006de50 0x7fbaf0166d20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fbae000cab0 tx=0x7fbae000cf70 comp rx=0 tx=0).stop 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 shutdown_connections 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbad0073230 0x7fbad0075740 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbaf00cb470 0x7fbaf0070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbaf0072e50 0x7fbaf0070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 --2- 172.21.15.44:0/877735023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbaf006de50 0x7fbaf0166d20 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 >> 172.21.15.44:0/877735023 conn(0x7fbaf00ccaa0 msgr2=0x7fbaf00c2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 shutdown_connections 2024-09-17T05:41:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.691+0000 7fbaf5000640 1 -- 172.21.15.44:0/877735023 wait complete. 2024-09-17T05:41:47.714 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:41:47.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:47.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 -- 172.21.15.44:0/2834786651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b68073910 msgr2=0x7f6b6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/2834786651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b68073910 0x7f6b6806d9c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6b680698f0 tx=0x7f6b6001c830 comp rx=0 tx=0).stop 2024-09-17T05:41:47.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 -- 172.21.15.44:0/2834786651 shutdown_connections 2024-09-17T05:41:47.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/2834786651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b68073910 0x7f6b6806d9c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/2834786651 >> v2:172.21.15.86:3300/0 conn(0x7f6b6815dcf0 0x7f6b6815e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 -- 172.21.15.44:0/2834786651 >> 172.21.15.44:0/2834786651 conn(0x7f6b680ccf30 msgr2=0x7f6b680cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 -- 172.21.15.44:0/2834786651 shutdown_connections 2024-09-17T05:41:47.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 -- 172.21.15.44:0/2834786651 wait complete. 2024-09-17T05:41:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 Processor -- start 2024-09-17T05:41:47.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.871+0000 7f6b6cc00640 1 -- start start 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b6806d5b0 0x7f6b681444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6815dcf0 0x7f6b6814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b68146060 0x7f6b681472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68169b20 con 0x7f6b6806d5b0 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b681699a0 con 0x7f6b6815dcf0 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6b68169ca0 con 0x7f6b68146060 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b6806d5b0 0x7f6b681444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b6806d5b0 0x7f6b681444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33398/0 (socket says 172.21.15.44:33398) 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 -- 172.21.15.44:0/1060420888 learned_addr learned my addr 172.21.15.44:0/1060420888 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b5d400640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6815dcf0 0x7f6b6814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b66800640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b68146060 0x7f6b681472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 -- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b68146060 msgr2=0x7f6b681472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b68146060 0x7f6b681472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 -- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6815dcf0 msgr2=0x7f6b6814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6815dcf0 0x7f6b6814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 -- 172.21.15.44:0/1060420888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68145ad0 con 0x7f6b6806d5b0 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b65e00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b6806d5b0 0x7f6b681444a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800eb30 tx=0x7f6b5800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b5ea00640 1 -- 172.21.15.44:0/1060420888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58004b30 con 0x7f6b6806d5b0 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b5ea00640 1 -- 172.21.15.44:0/1060420888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b58004cf0 con 0x7f6b6806d5b0 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b5ea00640 1 -- 172.21.15.44:0/1060420888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b58005280 con 0x7f6b6806d5b0 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b68145db0 con 0x7f6b6806d5b0 2024-09-17T05:41:47.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b68146ad0 con 0x7f6b6806d5b0 2024-09-17T05:41:47.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.875+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6806d9c0 con 0x7f6b6806d5b0 2024-09-17T05:41:47.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.879+0000 7f6b5ea00640 1 -- 172.21.15.44:0/1060420888 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6b58005420 con 0x7f6b6806d5b0 2024-09-17T05:41:47.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.879+0000 7f6b5ea00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6b44073200 0x7f6b44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:47.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.879+0000 7f6b5ea00640 1 -- 172.21.15.44:0/1060420888 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f6b58095020 con 0x7f6b6806d5b0 2024-09-17T05:41:47.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.879+0000 7f6b5d400640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6b44073200 0x7f6b44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:47.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.879+0000 7f6b5d400640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6b44073200 0x7f6b44075710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6b680cd440 tx=0x7f6b50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:47.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:47.883+0000 7f6b5ea00640 1 -- 172.21.15.44:0/1060420888 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6b5805f800 con 0x7f6b6806d5b0 2024-09-17T05:41:48.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.095+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b680ccca0 con 0x7f6b6806d5b0 2024-09-17T05:41:48.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.095+0000 7f6b5ea00640 1 -- 172.21.15.44:0/1060420888 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5227 (secure 0 0 0) 0x7f6b58064230 con 0x7f6b6806d5b0 2024-09-17T05:41:48.099 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:48.099 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":54,"btime":"2024-09-17T05:41:16:452297+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:41:15.814585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6337,"qdb_cluster":[6337]},"id":5}]} 2024-09-17T05:41:48.099 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 54 2024-09-17T05:41:48.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6b44073200 msgr2=0x7f6b44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6b44073200 0x7f6b44075710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6b680cd440 tx=0x7f6b50009040 comp rx=0 tx=0).stop 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b6806d5b0 msgr2=0x7f6b681444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b6806d5b0 0x7f6b681444a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800eb30 tx=0x7f6b5800c2d0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 shutdown_connections 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6b68146060 0x7f6b681472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6b44073200 0x7f6b44075710 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b6815dcf0 0x7f6b6814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 --2- 172.21.15.44:0/1060420888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6b6806d5b0 0x7f6b681444a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 >> 172.21.15.44:0/1060420888 conn(0x7f6b680ccf30 msgr2=0x7f6b680d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 shutdown_connections 2024-09-17T05:41:48.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.099+0000 7f6b6cc00640 1 -- 172.21.15.44:0/1060420888 wait complete. 2024-09-17T05:41:48.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 -- 172.21.15.44:0/2860371177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9400c9be0 msgr2=0x7ff9400c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 --2- 172.21.15.44:0/2860371177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9400c9be0 0x7ff9400c9ff0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff928009840 tx=0x7ff92801c820 comp rx=0 tx=0).stop 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 -- 172.21.15.44:0/2860371177 shutdown_connections 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 --2- 172.21.15.44:0/2860371177 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff94006d5b0 0x7ff94006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 --2- 172.21.15.44:0/2860371177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff9400c9be0 0x7ff9400c9ff0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 -- 172.21.15.44:0/2860371177 >> 172.21.15.44:0/2860371177 conn(0x7ff9400cd930 msgr2=0x7ff9400cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 -- 172.21.15.44:0/2860371177 shutdown_connections 2024-09-17T05:41:48.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 -- 172.21.15.44:0/2860371177 wait complete. 2024-09-17T05:41:48.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 Processor -- start 2024-09-17T05:41:48.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.279+0000 7ff944a00640 1 -- start start 2024-09-17T05:41:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff94006d5b0 0x7ff940070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9400c9be0 0x7ff94014ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9400d00b0 0x7ff940150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff94016bb40 con 0x7ff94006d5b0 2024-09-17T05:41:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff94016b9c0 con 0x7ff9400c9be0 2024-09-17T05:41:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff94016bcc0 con 0x7ff9400d00b0 2024-09-17T05:41:48.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff94006d5b0 0x7ff940070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff94006d5b0 0x7ff940070e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33422/0 (socket says 172.21.15.44:33422) 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 -- 172.21.15.44:0/1084982104 learned_addr learned my addr 172.21.15.44:0/1084982104 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93e800640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9400d00b0 0x7ff940150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff937e00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9400c9be0 0x7ff94014ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 -- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9400d00b0 msgr2=0x7ff940150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9400d00b0 0x7ff940150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 -- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9400c9be0 msgr2=0x7ff94014ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9400c9be0 0x7ff94014ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 -- 172.21.15.44:0/1084982104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9400b4d20 con 0x7ff94006d5b0 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff937e00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9400c9be0 0x7ff94014ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93e800640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9400d00b0 0x7ff940150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:48.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff93de00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff94006d5b0 0x7ff940070e80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff930001ec0 tx=0x7ff93000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:48.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff936000640 1 -- 172.21.15.44:0/1084982104 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930017070 con 0x7ff94006d5b0 2024-09-17T05:41:48.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff936000640 1 -- 172.21.15.44:0/1084982104 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff930003600 con 0x7ff94006d5b0 2024-09-17T05:41:48.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff936000640 1 -- 172.21.15.44:0/1084982104 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff930003a50 con 0x7ff94006d5b0 2024-09-17T05:41:48.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9400b5000 con 0x7ff94006d5b0 2024-09-17T05:41:48.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9400b55c0 con 0x7ff94006d5b0 2024-09-17T05:41:48.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.283+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94006d9c0 con 0x7ff94006d5b0 2024-09-17T05:41:48.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.287+0000 7ff936000640 1 -- 172.21.15.44:0/1084982104 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff93001a070 con 0x7ff94006d5b0 2024-09-17T05:41:48.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.287+0000 7ff936000640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff91c073200 0x7ff91c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.287+0000 7ff936000640 1 -- 172.21.15.44:0/1084982104 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7ff930093b20 con 0x7ff94006d5b0 2024-09-17T05:41:48.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.287+0000 7ff937e00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff91c073200 0x7ff91c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.287+0000 7ff937e00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff91c073200 0x7ff91c075710 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff9280af000 tx=0x7ff92801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:48.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.291+0000 7ff936000640 1 -- 172.21.15.44:0/1084982104 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff930021020 con 0x7ff94006d5b0 2024-09-17T05:41:48.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.499+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff940152ea0 con 0x7ff94006d5b0 2024-09-17T05:41:48.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.499+0000 7ff936000640 1 -- 172.21.15.44:0/1084982104 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5227 (secure 0 0 0) 0x7ff9400ca530 con 0x7ff94006d5b0 2024-09-17T05:41:48.502 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:48.502 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":54,"btime":"2024-09-17T05:41:16:452297+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:40:18.372314+0000","modified":"2024-09-17T05:41:15.814585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6337":{"gid":6337,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":14,"addr":"172.21.15.44:6834/2539887819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2539887819},{"type":"v1","addr":"172.21.15.44:6834","nonce":2539887819}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6337,"qdb_cluster":[6337]},"id":5}]} 2024-09-17T05:41:48.502 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 54 2024-09-17T05:41:48.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff91c073200 msgr2=0x7ff91c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff91c073200 0x7ff91c075710 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff9280af000 tx=0x7ff92801b060 comp rx=0 tx=0).stop 2024-09-17T05:41:48.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff94006d5b0 msgr2=0x7ff940070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff94006d5b0 0x7ff940070e80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff930001ec0 tx=0x7ff93000c890 comp rx=0 tx=0).stop 2024-09-17T05:41:48.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 shutdown_connections 2024-09-17T05:41:48.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff9400d00b0 0x7ff940150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff91c073200 0x7ff91c075710 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9400c9be0 0x7ff94014ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 --2- 172.21.15.44:0/1084982104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff94006d5b0 0x7ff940070e80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 >> 172.21.15.44:0/1084982104 conn(0x7ff9400cd930 msgr2=0x7ff94006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:48.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 shutdown_connections 2024-09-17T05:41:48.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.503+0000 7ff944a00640 1 -- 172.21.15.44:0/1084982104 wait complete. 2024-09-17T05:41:48.524 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:48.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 -- 172.21.15.44:0/1576715086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 msgr2=0x7f616800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 --2- 172.21.15.44:0/1576715086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f616800ba60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f61840752c0 tx=0x7f617c01d5d0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 -- 172.21.15.44:0/1576715086 shutdown_connections 2024-09-17T05:41:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 --2- 172.21.15.44:0/1576715086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f616800ba60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 -- 172.21.15.44:0/1576715086 >> 172.21.15.44:0/1576715086 conn(0x7f61840d1120 msgr2=0x7f61840d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 -- 172.21.15.44:0/1576715086 shutdown_connections 2024-09-17T05:41:48.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 -- 172.21.15.44:0/1576715086 wait complete. 2024-09-17T05:41:48.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 Processor -- start 2024-09-17T05:41:48.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.683+0000 7f618b600640 1 -- start start 2024-09-17T05:41:48.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f6184159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f618415a7c0 0x7f61840c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f618415a270 0x7f61840c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f61840cf080 con 0x7f61680053b0 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61840cef00 con 0x7f618415a7c0 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f61840cf200 con 0x7f618415a270 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f6184159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f6184159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33448/0 (socket says 172.21.15.44:33448) 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 -- 172.21.15.44:0/2266859867 learned_addr learned my addr 172.21.15.44:0/2266859867 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f617be00640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f618415a7c0 0x7f61840c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6189600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f618415a270 0x7f61840c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 -- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f618415a270 msgr2=0x7f61840c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f618415a270 0x7f61840c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 -- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f618415a7c0 msgr2=0x7f61840c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f618415a7c0 0x7f61840c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 -- 172.21.15.44:0/2266859867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618415a080 con 0x7f61680053b0 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6188c00640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f6184159b40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6174006450 tx=0x7f61740039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6181600640 1 -- 172.21.15.44:0/2266859867 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174015070 con 0x7f61680053b0 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6181600640 1 -- 172.21.15.44:0/2266859867 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6174011920 con 0x7f61680053b0 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61840c4630 con 0x7f61680053b0 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f6181600640 1 -- 172.21.15.44:0/2266859867 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174011d70 con 0x7f61680053b0 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61840c8fb0 con 0x7f61680053b0 2024-09-17T05:41:48.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.687+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618415f0e0 con 0x7f61680053b0 2024-09-17T05:41:48.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.691+0000 7f6181600640 1 -- 172.21.15.44:0/2266859867 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6174018070 con 0x7f61680053b0 2024-09-17T05:41:48.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.691+0000 7f6181600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6160073200 0x7f6160075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:48.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.691+0000 7f6181600640 1 -- 172.21.15.44:0/2266859867 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f61740950e0 con 0x7f61680053b0 2024-09-17T05:41:48.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.691+0000 7f617be00640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6160073200 0x7f6160075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:48.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.691+0000 7f617be00640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6160073200 0x7f6160075710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f616c000c10 tx=0x7f616c006b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:48.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.695+0000 7f6181600640 1 -- 172.21.15.44:0/2266859867 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f617405ff10 con 0x7f61680053b0 2024-09-17T05:41:48.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.875+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61840d1db0 con 0x7f61680053b0 2024-09-17T05:41:48.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.875+0000 7f6181600640 1 -- 172.21.15.44:0/2266859867 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+17024 (secure 0 0 0) 0x7f617405f810 con 0x7f61680053b0 2024-09-17T05:41:48.877 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:48.877 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":78,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:40:32.791559+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:40:16.116014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-17T05:40:17.345384+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/330558786":"2024-09-18T05:40:32.791517+0000","172.21.15.44:6832/330558786":"2024-09-18T05:40:32.791517+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:48.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.875+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6160073200 msgr2=0x7f6160075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.875+0000 7f618b600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6160073200 0x7f6160075710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f616c000c10 tx=0x7f616c006b80 comp rx=0 tx=0).stop 2024-09-17T05:41:48.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.875+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 msgr2=0x7f6184159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:48.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.875+0000 7f618b600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f6184159b40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6174006450 tx=0x7f61740039d0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 shutdown_connections 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f618415a270 0x7f61840c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6160073200 0x7f6160075710 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f618415a7c0 0x7f61840c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 --2- 172.21.15.44:0/2266859867 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f61680053b0 0x7f6184159b40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 >> 172.21.15.44:0/2266859867 conn(0x7f61840d1120 msgr2=0x7f61840b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 shutdown_connections 2024-09-17T05:41:48.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:48.879+0000 7f618b600640 1 -- 172.21.15.44:0/2266859867 wait complete. 2024-09-17T05:41:48.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:41:49.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 -- 172.21.15.44:0/4076431644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b00d0010 msgr2=0x7f94b015ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 --2- 172.21.15.44:0/4076431644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b00d0010 0x7f94b015ee60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9498009900 tx=0x7f949801c820 comp rx=0 tx=0).stop 2024-09-17T05:41:49.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 -- 172.21.15.44:0/4076431644 shutdown_connections 2024-09-17T05:41:49.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 --2- 172.21.15.44:0/4076431644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b00d0010 0x7f94b015ee60 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 -- 172.21.15.44:0/4076431644 >> 172.21.15.44:0/4076431644 conn(0x7f94b00cda70 msgr2=0x7f94b00cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:49.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 -- 172.21.15.44:0/4076431644 shutdown_connections 2024-09-17T05:41:49.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 -- 172.21.15.44:0/4076431644 wait complete. 2024-09-17T05:41:49.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 Processor -- start 2024-09-17T05:41:49.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.059+0000 7f94afe00640 1 -- start start 2024-09-17T05:41:49.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94b00cfc00 0x7f94b015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94b00d0010 0x7f94b015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b015f3a0 0x7f94b015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94b016a010 con 0x7f94b015f3a0 2024-09-17T05:41:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0155c70 con 0x7f94b00cfc00 2024-09-17T05:41:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f94b016a190 con 0x7f94b00d0010 2024-09-17T05:41:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b015f3a0 0x7f94b015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94aea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94b00cfc00 0x7f94b015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b015f3a0 0x7f94b015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49202/0 (socket says 172.21.15.44:49202) 2024-09-17T05:41:49.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 -- 172.21.15.44:0/3609842342 learned_addr learned my addr 172.21.15.44:0/3609842342 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:49.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94a7e00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94b00d0010 0x7f94b015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 -- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94b00d0010 msgr2=0x7f94b015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94b00d0010 0x7f94b015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 -- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94b00cfc00 msgr2=0x7f94b015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94b00cfc00 0x7f94b015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 -- 172.21.15.44:0/3609842342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b015e220 con 0x7f94b015f3a0 2024-09-17T05:41:49.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94af400640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b015f3a0 0x7f94b015a5a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c740 tx=0x7f94a800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:49.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94a6a00640 1 -- 172.21.15.44:0/3609842342 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8003b80 con 0x7f94b015f3a0 2024-09-17T05:41:49.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94a6a00640 1 -- 172.21.15.44:0/3609842342 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94a800ce50 con 0x7f94b015f3a0 2024-09-17T05:41:49.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94a6a00640 1 -- 172.21.15.44:0/3609842342 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a800a850 con 0x7f94b015f3a0 2024-09-17T05:41:49.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b015e4c0 con 0x7f94b015f3a0 2024-09-17T05:41:49.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b00ad8b0 con 0x7f94b015f3a0 2024-09-17T05:41:49.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b015ee60 con 0x7f94b015f3a0 2024-09-17T05:41:49.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.063+0000 7f94a6a00640 1 -- 172.21.15.44:0/3609842342 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f94a800a9f0 con 0x7f94b015f3a0 2024-09-17T05:41:49.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.067+0000 7f94a6a00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f948c073200 0x7f948c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.067+0000 7f94a6a00640 1 -- 172.21.15.44:0/3609842342 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6187+0+0 (secure 0 0 0) 0x7f94a8094200 con 0x7f94b015f3a0 2024-09-17T05:41:49.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.067+0000 7f94aea00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f948c073200 0x7f948c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.067+0000 7f94aea00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f948c073200 0x7f948c075710 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f94a0007fd0 tx=0x7f94a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:49.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.071+0000 7f94a6a00640 1 -- 172.21.15.44:0/3609842342 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f94a805e950 con 0x7f94b015f3a0 2024-09-17T05:41:49.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.279+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f94b0151d30 con 0x7f94b015f3a0 2024-09-17T05:41:49.282 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:41:49.279+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:41:49.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.283+0000 7f94a6a00640 1 -- 172.21.15.44:0/3609842342 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) ==== 161+0+0 (secure 0 0 0) 0x7f94a8063380 con 0x7f94b015f3a0 2024-09-17T05:41:49.284 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:41:49.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f948c073200 msgr2=0x7f948c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f948c073200 0x7f948c075710 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f94a0007fd0 tx=0x7f94a0009040 comp rx=0 tx=0).stop 2024-09-17T05:41:49.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b015f3a0 msgr2=0x7f94b015a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b015f3a0 0x7f94b015a5a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c740 tx=0x7f94a800cc00 comp rx=0 tx=0).stop 2024-09-17T05:41:49.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 shutdown_connections 2024-09-17T05:41:49.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94b015f3a0 0x7f94b015a5a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94b00d0010 0x7f94b015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f948c073200 0x7f948c075710 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 --2- 172.21.15.44:0/3609842342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94b00cfc00 0x7f94b015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 >> 172.21.15.44:0/3609842342 conn(0x7f94b00cda70 msgr2=0x7f94b0159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:49.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 shutdown_connections 2024-09-17T05:41:49.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.287+0000 7f94afe00640 1 -- 172.21.15.44:0/3609842342 wait complete. 2024-09-17T05:41:49.298 INFO:tasks.ceph.mds.c.smithi044.stderr: -4413> 2024-09-17T05:40:38.804+0000 7fa106800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:41:49.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:41:49.424 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:41:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 -- 172.21.15.44:0/877977918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d80cb470 msgr2=0x7ff3d80cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 --2- 172.21.15.44:0/877977918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d80cb470 0x7ff3d80cb880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009bc0 tx=0x7ff3d001cb10 comp rx=0 tx=0).stop 2024-09-17T05:41:49.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 -- 172.21.15.44:0/877977918 shutdown_connections 2024-09-17T05:41:49.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 --2- 172.21.15.44:0/877977918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d80cb470 0x7ff3d80cb880 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 --2- 172.21.15.44:0/877977918 >> v2:172.21.15.86:3300/0 conn(0x7ff3d806de50 0x7ff3d806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 -- 172.21.15.44:0/877977918 >> 172.21.15.44:0/877977918 conn(0x7ff3d80ccaa0 msgr2=0x7ff3d80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:49.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 -- 172.21.15.44:0/877977918 shutdown_connections 2024-09-17T05:41:49.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.471+0000 7ff3de800640 1 -- 172.21.15.44:0/877977918 wait complete. 2024-09-17T05:41:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 Processor -- start 2024-09-17T05:41:49.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 -- start start 2024-09-17T05:41:49.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d806de50 0x7ff3d8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8072e50 0x7ff3d8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d80cb470 0x7ff3d81f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8168f70 con 0x7ff3d8072e50 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8168df0 con 0x7ff3d80cb470 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3de800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d81690f0 con 0x7ff3d806de50 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8072e50 0x7ff3d8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8072e50 0x7ff3d8157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49220/0 (socket says 172.21.15.44:49220) 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 -- 172.21.15.44:0/689937559 learned_addr learned my addr 172.21.15.44:0/689937559 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d7e00640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d80cb470 0x7ff3d81f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d7400640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d806de50 0x7ff3d8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 -- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d806de50 msgr2=0x7ff3d8157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d806de50 0x7ff3d8157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 -- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d80cb470 msgr2=0x7ff3d81f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d80cb470 0x7ff3d81f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 -- 172.21.15.44:0/689937559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d81f72f0 con 0x7ff3d8072e50 2024-09-17T05:41:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d7400640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d806de50 0x7ff3d8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.475+0000 7ff3d6a00640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8072e50 0x7ff3d8157c90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400e7a0 tx=0x7ff3c400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3cf400640 1 -- 172.21.15.44:0/689937559 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400ccc0 con 0x7ff3d8072e50 2024-09-17T05:41:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3cf400640 1 -- 172.21.15.44:0/689937559 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3c4010430 con 0x7ff3d8072e50 2024-09-17T05:41:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d81f75d0 con 0x7ff3d8072e50 2024-09-17T05:41:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3cf400640 1 -- 172.21.15.44:0/689937559 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4010860 con 0x7ff3d8072e50 2024-09-17T05:41:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d81f7b90 con 0x7ff3d8072e50 2024-09-17T05:41:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d806e260 con 0x7ff3d8072e50 2024-09-17T05:41:49.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3cf400640 1 -- 172.21.15.44:0/689937559 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff3c4010a00 con 0x7ff3d8072e50 2024-09-17T05:41:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3cf400640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3cf400640 1 -- 172.21.15.44:0/689937559 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6273+0+0 (secure 0 0 0) 0x7ff3c4094ec0 con 0x7ff3d8072e50 2024-09-17T05:41:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.479+0000 7ff3d7400640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:49.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.483+0000 7ff3d7400640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8001400 tx=0x7ff3c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.483+0000 7ff3cf400640 1 -- 172.21.15.44:0/689937559 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff3c405f5b0 con 0x7ff3d8072e50 2024-09-17T05:41:49.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:49.695+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff3d809fd80 con 0x7ff3d8072e50 2024-09-17T05:41:50.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.283+0000 7ff3cf400640 1 -- 172.21.15.44:0/689937559 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) ==== 104+0+0 (secure 0 0 0) 0x7ff3c4063fe0 con 0x7ff3d8072e50 2024-09-17T05:41:50.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 msgr2=0x7ff3b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8001400 tx=0x7ff3c8009040 comp rx=0 tx=0).stop 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8072e50 msgr2=0x7ff3d8157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8072e50 0x7ff3d8157c90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400e7a0 tx=0x7ff3c400ec60 comp rx=0 tx=0).stop 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 shutdown_connections 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d80cb470 0x7ff3d81f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d8072e50 0x7ff3d8157c90 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 --2- 172.21.15.44:0/689937559 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d806de50 0x7ff3d8157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 >> 172.21.15.44:0/689937559 conn(0x7ff3d80ccaa0 msgr2=0x7ff3d815a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 shutdown_connections 2024-09-17T05:41:50.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.287+0000 7ff3de800640 1 -- 172.21.15.44:0/689937559 wait complete. 2024-09-17T05:41:50.311 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:41:50.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 -- 172.21.15.44:0/3909922148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c071c40 msgr2=0x7feb7c072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:50.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 --2- 172.21.15.44:0/3909922148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c071c40 0x7feb7c072640 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0098f0 tx=0x7feb6c01c870 comp rx=0 tx=0).stop 2024-09-17T05:41:50.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 -- 172.21.15.44:0/3909922148 shutdown_connections 2024-09-17T05:41:50.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 --2- 172.21.15.44:0/3909922148 >> v2:172.21.15.86:3300/0 conn(0x7feb7c160710 0x7feb7c167180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 --2- 172.21.15.44:0/3909922148 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c071c40 0x7feb7c072640 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 -- 172.21.15.44:0/3909922148 >> 172.21.15.44:0/3909922148 conn(0x7feb7c0d2040 msgr2=0x7feb7c0d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:50.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 -- 172.21.15.44:0/3909922148 shutdown_connections 2024-09-17T05:41:50.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 -- 172.21.15.44:0/3909922148 wait complete. 2024-09-17T05:41:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 Processor -- start 2024-09-17T05:41:50.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.475+0000 7feb7be00640 1 -- start start 2024-09-17T05:41:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb7c071c40 0x7feb7c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb7c072b80 0x7feb7c14f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c160710 0x7feb7c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:50.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0d18a0 con 0x7feb7c160710 2024-09-17T05:41:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c0d1720 con 0x7feb7c071c40 2024-09-17T05:41:50.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c169ee0 con 0x7feb7c072b80 2024-09-17T05:41:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb7c071c40 0x7feb7c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb7c071c40 0x7feb7c154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:46750/0 (socket says 172.21.15.44:46750) 2024-09-17T05:41:50.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7aa00640 1 -- 172.21.15.44:0/1902296311 learned_addr learned my addr 172.21.15.44:0/1902296311 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb72000640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb7c072b80 0x7feb7c14f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7b400640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c160710 0x7feb7c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7b400640 1 -- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb7c072b80 msgr2=0x7feb7c14f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7b400640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb7c072b80 0x7feb7c14f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7b400640 1 -- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb7c071c40 msgr2=0x7feb7c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7b400640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb7c071c40 0x7feb7c154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7b400640 1 -- 172.21.15.44:0/1902296311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c1f8a70 con 0x7feb7c160710 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7aa00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb7c071c40 0x7feb7c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7b400640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c160710 0x7feb7c1561b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0b57c0 tx=0x7feb7400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb73400640 1 -- 172.21.15.44:0/1902296311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74007d70 con 0x7feb7c160710 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb73400640 1 -- 172.21.15.44:0/1902296311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb7400f450 con 0x7feb7c160710 2024-09-17T05:41:50.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb73400640 1 -- 172.21.15.44:0/1902296311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7400f880 con 0x7feb7c160710 2024-09-17T05:41:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7c162f30 con 0x7feb7c160710 2024-09-17T05:41:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7c1634f0 con 0x7feb7c160710 2024-09-17T05:41:50.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.479+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7c162ca0 con 0x7feb7c160710 2024-09-17T05:41:50.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.483+0000 7feb73400640 1 -- 172.21.15.44:0/1902296311 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feb7400fa20 con 0x7feb7c160710 2024-09-17T05:41:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.483+0000 7feb73400640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb58073260 0x7feb58075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.483+0000 7feb73400640 1 -- 172.21.15.44:0/1902296311 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6273+0+0 (secure 0 0 0) 0x7feb74094df0 con 0x7feb7c160710 2024-09-17T05:41:50.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.483+0000 7feb7aa00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb58073260 0x7feb58075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:50.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.483+0000 7feb7aa00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb58073260 0x7feb58075770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feb6c01a4a0 tx=0x7feb6c01b0b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:50.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.487+0000 7feb73400640 1 -- 172.21.15.44:0/1902296311 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7feb7c1f8a70 con 0x7feb7c160710 2024-09-17T05:41:50.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:50.663+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7feb7c072640 con 0x7feb7c160710 2024-09-17T05:41:51.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.543+0000 7feb73400640 1 -- 172.21.15.44:0/1902296311 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) ==== 181+0+0 (secure 0 0 0) 0x7feb74014070 con 0x7feb7c160710 2024-09-17T05:41:51.547 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:41:51.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.547+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb58073260 msgr2=0x7feb58075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.547+0000 7feb7be00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb58073260 0x7feb58075770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feb6c01a4a0 tx=0x7feb6c01b0b0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.547+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c160710 msgr2=0x7feb7c1561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.547+0000 7feb7be00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c160710 0x7feb7c1561b0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0b57c0 tx=0x7feb7400cf10 comp rx=0 tx=0).stop 2024-09-17T05:41:51.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 shutdown_connections 2024-09-17T05:41:51.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb7c160710 0x7feb7c1561b0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb7c072b80 0x7feb7c14f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb58073260 0x7feb58075770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 --2- 172.21.15.44:0/1902296311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb7c071c40 0x7feb7c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 >> 172.21.15.44:0/1902296311 conn(0x7feb7c0d2040 msgr2=0x7feb7c0704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 shutdown_connections 2024-09-17T05:41:51.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.551+0000 7feb7be00640 1 -- 172.21.15.44:0/1902296311 wait complete. 2024-09-17T05:41:51.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:41:51.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 -- 172.21.15.44:0/1834292596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380039f0 msgr2=0x7f9e38003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 --2- 172.21.15.44:0/1834292596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e380039f0 0x7f9e38003e20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9e44006f70 tx=0x7f9e4401cec0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e56200640 1 -- 172.21.15.44:0/1834292596 reap_dead start 2024-09-17T05:41:51.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 -- 172.21.15.44:0/1834292596 shutdown_connections 2024-09-17T05:41:51.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 -- 172.21.15.44:0/1834292596 >> 172.21.15.44:0/1834292596 conn(0x7f9e500b35f0 msgr2=0x7f9e500b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:51.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 -- 172.21.15.44:0/1834292596 shutdown_connections 2024-09-17T05:41:51.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 -- 172.21.15.44:0/1834292596 wait complete. 2024-09-17T05:41:51.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 Processor -- start 2024-09-17T05:41:51.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.747+0000 7f9e58200640 1 -- start start 2024-09-17T05:41:51.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e380039f0 0x7f9e501f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e501520c0 0x7f9e501524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e501ebda0 0x7f9e501ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5006fb90 con 0x7f9e501520c0 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5006fa10 con 0x7f9e380039f0 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5015c5f0 con 0x7f9e501ebda0 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e501520c0 0x7f9e501524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e501520c0 0x7f9e501524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49254/0 (socket says 172.21.15.44:49254) 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 -- 172.21.15.44:0/1575668780 learned_addr learned my addr 172.21.15.44:0/1575668780 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e55800640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e380039f0 0x7f9e501f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e56200640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e501ebda0 0x7f9e501ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 -- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e501ebda0 msgr2=0x7f9e501ec1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e501ebda0 0x7f9e501ec1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 -- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e380039f0 msgr2=0x7f9e501f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:51.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e380039f0 0x7f9e501f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:51.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 -- 172.21.15.44:0/1575668780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5009dc20 con 0x7f9e501520c0 2024-09-17T05:41:51.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e54e00640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e501520c0 0x7f9e501524d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c011800 tx=0x7f9e3c011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:51.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e4d600640 1 -- 172.21.15.44:0/1575668780 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c01f070 con 0x7f9e501520c0 2024-09-17T05:41:51.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e4d600640 1 -- 172.21.15.44:0/1575668780 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e3c00fe40 con 0x7f9e501520c0 2024-09-17T05:41:51.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e501f9d70 con 0x7f9e501520c0 2024-09-17T05:41:51.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e4d600640 1 -- 172.21.15.44:0/1575668780 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0126b0 con 0x7f9e501520c0 2024-09-17T05:41:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e500b2820 con 0x7f9e501520c0 2024-09-17T05:41:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.751+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e500b07c0 con 0x7f9e501520c0 2024-09-17T05:41:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.755+0000 7f9e4d600640 1 -- 172.21.15.44:0/1575668780 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e3c022070 con 0x7f9e501520c0 2024-09-17T05:41:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.755+0000 7f9e4d600640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e30073230 0x7f9e30075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.755+0000 7f9e4d600640 1 -- 172.21.15.44:0/1575668780 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5835+0+0 (secure 0 0 0) 0x7f9e3c094cb0 con 0x7f9e501520c0 2024-09-17T05:41:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.755+0000 7f9e55800640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e30073230 0x7f9e30075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:51.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.755+0000 7f9e55800640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e30073230 0x7f9e30075740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e440ab000 tx=0x7f9e44019d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:51.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.759+0000 7f9e4d600640 1 -- 172.21.15.44:0/1575668780 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9e501f9d70 con 0x7f9e501520c0 2024-09-17T05:41:51.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:51.935+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9e501f5a80 con 0x7f9e501520c0 2024-09-17T05:41:52.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.551+0000 7f9e4d600640 1 -- 172.21.15.44:0/1575668780 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) ==== 169+0+0 (secure 0 0 0) 0x7f9e5009dc20 con 0x7f9e501520c0 2024-09-17T05:41:52.554 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:41:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.555+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e30073230 msgr2=0x7f9e30075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.555+0000 7f9e58200640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e30073230 0x7f9e30075740 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e440ab000 tx=0x7f9e44019d00 comp rx=0 tx=0).stop 2024-09-17T05:41:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.555+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e501520c0 msgr2=0x7f9e501524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.555+0000 7f9e58200640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e501520c0 0x7f9e501524d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c011800 tx=0x7f9e3c011c00 comp rx=0 tx=0).stop 2024-09-17T05:41:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 shutdown_connections 2024-09-17T05:41:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9e501ebda0 0x7f9e501ec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e501520c0 0x7f9e501524d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e30073230 0x7f9e30075740 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 --2- 172.21.15.44:0/1575668780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e380039f0 0x7f9e501f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 >> 172.21.15.44:0/1575668780 conn(0x7f9e500b35f0 msgr2=0x7f9e50074930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:52.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 shutdown_connections 2024-09-17T05:41:52.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.559+0000 7f9e58200640 1 -- 172.21.15.44:0/1575668780 wait complete. 2024-09-17T05:41:52.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:41:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff6c00640 1 -- 172.21.15.44:0/3794091450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 msgr2=0x7f1fd4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff6c00640 1 --2- 172.21.15.44:0/3794091450 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 0x7f1fd4003e80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c750 tx=0x7f1fe001d300 comp rx=0 tx=0).stop 2024-09-17T05:41:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff4c00640 1 -- 172.21.15.44:0/3794091450 reap_dead start 2024-09-17T05:41:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff6c00640 1 -- 172.21.15.44:0/3794091450 shutdown_connections 2024-09-17T05:41:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff6c00640 1 -- 172.21.15.44:0/3794091450 >> 172.21.15.44:0/3794091450 conn(0x7f1ff00ccaa0 msgr2=0x7f1ff00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff6c00640 1 -- 172.21.15.44:0/3794091450 shutdown_connections 2024-09-17T05:41:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff6c00640 1 -- 172.21.15.44:0/3794091450 wait complete. 2024-09-17T05:41:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.763+0000 7f1ff6c00640 1 Processor -- start 2024-09-17T05:41:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 -- start start 2024-09-17T05:41:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 0x7f1ff00b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ff0156a50 0x7f1ff00b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ff01ecb10 0x7f1ff01ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0166810 con 0x7f1fd4003a10 2024-09-17T05:41:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff0166690 con 0x7f1ff01ecb10 2024-09-17T05:41:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff0166990 con 0x7f1ff0156a50 2024-09-17T05:41:52.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 0x7f1ff00b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 0x7f1ff00b4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49274/0 (socket says 172.21.15.44:49274) 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 -- 172.21.15.44:0/4206099234 learned_addr learned my addr 172.21.15.44:0/4206099234 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fe7400640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ff0156a50 0x7f1ff00b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff4c00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ff01ecb10 0x7f1ff01ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 -- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ff0156a50 msgr2=0x7f1ff00b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ff0156a50 0x7f1ff00b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 -- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ff01ecb10 msgr2=0x7f1ff01ecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ff01ecb10 0x7f1ff01ecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 -- 172.21.15.44:0/4206099234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff00b55a0 con 0x7f1fd4003a10 2024-09-17T05:41:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fefe00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 0x7f1ff00b4b20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0098dc0 tx=0x7f1fe0004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fecc00640 1 -- 172.21.15.44:0/4206099234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00014a0 con 0x7f1fd4003a10 2024-09-17T05:41:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fecc00640 1 -- 172.21.15.44:0/4206099234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fe0006140 con 0x7f1fd4003a10 2024-09-17T05:41:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff00b3350 con 0x7f1fd4003a10 2024-09-17T05:41:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1fecc00640 1 -- 172.21.15.44:0/4206099234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0006570 con 0x7f1fd4003a10 2024-09-17T05:41:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff00b5b40 con 0x7f1fd4003a10 2024-09-17T05:41:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.767+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff006e260 con 0x7f1fd4003a10 2024-09-17T05:41:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.771+0000 7f1fecc00640 1 -- 172.21.15.44:0/4206099234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1fe00b8070 con 0x7f1fd4003a10 2024-09-17T05:41:52.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.771+0000 7f1fecc00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1fcc073230 0x7f1fcc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:52.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.771+0000 7f1fecc00640 1 -- 172.21.15.44:0/4206099234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7f1fe012f240 con 0x7f1fd4003a10 2024-09-17T05:41:52.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.771+0000 7f1fe7400640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1fcc073230 0x7f1fcc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.771+0000 7f1fe7400640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1fcc073230 0x7f1fcc075740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ff01574a0 tx=0x7f1fd80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:52.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.775+0000 7f1fecc00640 1 -- 172.21.15.44:0/4206099234 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1fe00c1060 con 0x7f1fd4003a10 2024-09-17T05:41:52.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.951+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f1ff00b5fa0 con 0x7f1fd4003a10 2024-09-17T05:41:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.955+0000 7f1fecc00640 1 -- 172.21.15.44:0/4206099234 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f1ff006e7a0 con 0x7f1fd4003a10 2024-09-17T05:41:52.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1fcc073230 msgr2=0x7f1fcc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1fcc073230 0x7f1fcc075740 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ff01574a0 tx=0x7f1fd80091e0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 msgr2=0x7f1ff00b4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 0x7f1ff00b4b20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0098dc0 tx=0x7f1fe0004a20 comp rx=0 tx=0).stop 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 shutdown_connections 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1fcc073230 0x7f1fcc075740 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ff01ecb10 0x7f1ff01ecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ff0156a50 0x7f1ff00b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 --2- 172.21.15.44:0/4206099234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1fd4003a10 0x7f1ff00b4b20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 >> 172.21.15.44:0/4206099234 conn(0x7f1ff00ccaa0 msgr2=0x7f1ff006f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 shutdown_connections 2024-09-17T05:41:52.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:52.959+0000 7f1ff6c00640 1 -- 172.21.15.44:0/4206099234 wait complete. 2024-09-17T05:41:52.980 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-09-17T05:41:53.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.135+0000 7f050d000640 1 -- 172.21.15.44:0/1919931519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f050806e160 msgr2=0x7f050815f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.135+0000 7f050d000640 1 --2- 172.21.15.44:0/1919931519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f050806e160 0x7f050815f7f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0500009bf0 tx=0x7f050001cac0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- 172.21.15.44:0/1919931519 shutdown_connections 2024-09-17T05:41:53.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 --2- 172.21.15.44:0/1919931519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f050806e160 0x7f050815f7f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- 172.21.15.44:0/1919931519 >> 172.21.15.44:0/1919931519 conn(0x7f05080d1120 msgr2=0x7f05080d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:53.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- 172.21.15.44:0/1919931519 shutdown_connections 2024-09-17T05:41:53.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- 172.21.15.44:0/1919931519 wait complete. 2024-09-17T05:41:53.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 Processor -- start 2024-09-17T05:41:53.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- start start 2024-09-17T05:41:53.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f050806e160 0x7f05080c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0508072190 0x7f0508157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05081fad40 0x7f05080b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f050816a010 con 0x7f0508072190 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0508169e90 con 0x7f050806e160 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.139+0000 7f050d000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f050816a190 con 0x7f05081fad40 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0508072190 0x7f0508157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0508072190 0x7f0508157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49278/0 (socket says 172.21.15.44:49278) 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 -- 172.21.15.44:0/1443784888 learned_addr learned my addr 172.21.15.44:0/1443784888 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f0506800640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05081fad40 0x7f05080b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f0505e00640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f050806e160 0x7f05080c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 -- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05081fad40 msgr2=0x7f05080b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05081fad40 0x7f05080b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 -- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f050806e160 msgr2=0x7f05080c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f050806e160 0x7f05080c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 -- 172.21.15.44:0/1443784888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080c7c70 con 0x7f0508072190 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04ffe00640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0508072190 0x7f0508157130 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c400 tx=0x7f04f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04fe000640 1 -- 172.21.15.44:0/1443784888 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0017070 con 0x7f0508072190 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04fe000640 1 -- 172.21.15.44:0/1443784888 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04f0005400 con 0x7f0508072190 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04fe000640 1 -- 172.21.15.44:0/1443784888 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0003860 con 0x7f0508072190 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05080c7990 con 0x7f0508072190 2024-09-17T05:41:53.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05081fa540 con 0x7f0508072190 2024-09-17T05:41:53.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05080c7700 con 0x7f0508072190 2024-09-17T05:41:53.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.143+0000 7f04fe000640 1 -- 172.21.15.44:0/1443784888 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f04f001a070 con 0x7f0508072190 2024-09-17T05:41:53.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.147+0000 7f04fe000640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04e4073200 0x7f04e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.147+0000 7f04fe000640 1 -- 172.21.15.44:0/1443784888 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7f04f00934f0 con 0x7f0508072190 2024-09-17T05:41:53.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.147+0000 7f0505e00640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04e4073200 0x7f04e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.147+0000 7f0505e00640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04e4073200 0x7f04e4075710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f04f8007fd0 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:53.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.151+0000 7f04fe000640 1 -- 172.21.15.44:0/1443784888 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f04f005df40 con 0x7f0508072190 2024-09-17T05:41:53.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.387+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f05080d1db0 con 0x7f0508072190 2024-09-17T05:41:53.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f04fe000640 1 -- 172.21.15.44:0/1443784888 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v281) ==== 166+0+0 (secure 0 0 0) 0x7f04f0062970 con 0x7f0508072190 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04e4073200 msgr2=0x7f04e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04e4073200 0x7f04e4075710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f04f8007fd0 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0508072190 msgr2=0x7f0508157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0508072190 0x7f0508157130 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c400 tx=0x7f04f000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 shutdown_connections 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f05081fad40 0x7f05080b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0508072190 0x7f0508157130 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04e4073200 0x7f04e4075710 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 --2- 172.21.15.44:0/1443784888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f050806e160 0x7f05080c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 >> 172.21.15.44:0/1443784888 conn(0x7f05080d1120 msgr2=0x7f05080cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 shutdown_connections 2024-09-17T05:41:53.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.555+0000 7f050d000640 1 -- 172.21.15.44:0/1443784888 wait complete. 2024-09-17T05:41:53.578 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-09-17T05:41:53.578 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-09-17T05:41:53.578 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-17T05:41:53.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:41:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.735+0000 7f1dfb000640 1 -- 172.21.15.44:0/1716116014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 msgr2=0x7f1dd8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.735+0000 7f1dfb000640 1 --2- 172.21.15.44:0/1716116014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 0x7f1dd8005230 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1dec001f50 tx=0x7f1dec01cc40 comp rx=0 tx=0).stop 2024-09-17T05:41:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.735+0000 7f1df9000640 1 -- 172.21.15.44:0/1716116014 reap_dead start 2024-09-17T05:41:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.735+0000 7f1dfb000640 1 -- 172.21.15.44:0/1716116014 shutdown_connections 2024-09-17T05:41:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.735+0000 7f1dfb000640 1 -- 172.21.15.44:0/1716116014 >> 172.21.15.44:0/1716116014 conn(0x7f1df40cd930 msgr2=0x7f1df40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.735+0000 7f1dfb000640 1 -- 172.21.15.44:0/1716116014 shutdown_connections 2024-09-17T05:41:53.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.735+0000 7f1dfb000640 1 -- 172.21.15.44:0/1716116014 wait complete. 2024-09-17T05:41:53.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 Processor -- start 2024-09-17T05:41:53.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 -- start start 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 0x7f1df40b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1df414a260 0x7f1df40c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df40ca120 0x7f1df40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1df40ccb60 con 0x7f1dd8004da0 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1df415c8a0 con 0x7f1df40ca120 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1dfb000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1df40ccce0 con 0x7f1df414a260 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1df3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 0x7f1df40b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1df3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 0x7f1df40b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49306/0 (socket says 172.21.15.44:49306) 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1df3e00640 1 -- 172.21.15.44:0/319747914 learned_addr learned my addr 172.21.15.44:0/319747914 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:53.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1df9000640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df40ca120 0x7f1df40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.739+0000 7f1df3400640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1df414a260 0x7f1df40c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1df3e00640 1 -- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1df414a260 msgr2=0x7f1df40c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1df3e00640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1df414a260 0x7f1df40c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1df3e00640 1 -- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df40ca120 msgr2=0x7f1df40b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1df3e00640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df40ca120 0x7f1df40b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1df3e00640 1 -- 172.21.15.44:0/319747914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df40ca530 con 0x7f1dd8004da0 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1df3e00640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 0x7f1df40b5240 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1de4011b10 tx=0x7f1de4009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1debe00640 1 -- 172.21.15.44:0/319747914 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de401e070 con 0x7f1dd8004da0 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1debe00640 1 -- 172.21.15.44:0/319747914 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1de4004050 con 0x7f1dd8004da0 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1debe00640 1 -- 172.21.15.44:0/319747914 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de400fea0 con 0x7f1dd8004da0 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df40b5780 con 0x7f1dd8004da0 2024-09-17T05:41:53.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df41f8ea0 con 0x7f1dd8004da0 2024-09-17T05:41:53.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df415bf80 con 0x7f1dd8004da0 2024-09-17T05:41:53.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.743+0000 7f1debe00640 1 -- 172.21.15.44:0/319747914 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1de4021070 con 0x7f1dd8004da0 2024-09-17T05:41:53.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.747+0000 7f1debe00640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dd4073230 0x7f1dd4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:53.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.747+0000 7f1debe00640 1 -- 172.21.15.44:0/319747914 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7f1de4094b30 con 0x7f1dd8004da0 2024-09-17T05:41:53.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.747+0000 7f1df3400640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dd4073230 0x7f1dd4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:53.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.747+0000 7f1df3400640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dd4073230 0x7f1dd4075740 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1df4150870 tx=0x7f1de0000ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:53.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.751+0000 7f1debe00640 1 -- 172.21.15.44:0/319747914 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1df40ca530 con 0x7f1dd8004da0 2024-09-17T05:41:53.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.923+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1df406da60 con 0x7f1dd8004da0 2024-09-17T05:41:53.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.923+0000 7f1debe00640 1 -- 172.21.15.44:0/319747914 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+13386 (secure 0 0 0) 0x7f1de405f770 con 0x7f1dd8004da0 2024-09-17T05:41:53.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:53.927 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":81,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:41:52.550830+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6834/2539887819":"2024-09-18T05:41:49.285627+0000","172.21.15.44:6832/2539887819":"2024-09-18T05:41:49.285627+0000","172.21.15.44:6834/330558786":"2024-09-18T05:40:32.791517+0000","172.21.15.44:6832/330558786":"2024-09-18T05:40:32.791517+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dd4073230 msgr2=0x7f1dd4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dd4073230 0x7f1dd4075740 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1df4150870 tx=0x7f1de0000ee0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 msgr2=0x7f1df40b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 0x7f1df40b5240 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1de4011b10 tx=0x7f1de4009ea0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 shutdown_connections 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dd4073230 0x7f1dd4075740 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1df40ca120 0x7f1df40b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1df414a260 0x7f1df40c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 --2- 172.21.15.44:0/319747914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dd8004da0 0x7f1df40b5240 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:53.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 >> 172.21.15.44:0/319747914 conn(0x7f1df40cd930 msgr2=0x7f1df40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:53.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 shutdown_connections 2024-09-17T05:41:53.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:53.927+0000 7f1dfb000640 1 -- 172.21.15.44:0/319747914 wait complete. 2024-09-17T05:41:53.950 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:36:06.284181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:41:53.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:41:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 -- 172.21.15.44:0/1959489073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40440cac30 msgr2=0x7f40440cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 --2- 172.21.15.44:0/1959489073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40440cac30 0x7f40440cec50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f4034009840 tx=0x7f403401c820 comp rx=0 tx=0).stop 2024-09-17T05:41:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 -- 172.21.15.44:0/1959489073 shutdown_connections 2024-09-17T05:41:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 --2- 172.21.15.44:0/1959489073 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f404415bd30 0x7f40440cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 --2- 172.21.15.44:0/1959489073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40440cac30 0x7f40440cec50 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 -- 172.21.15.44:0/1959489073 >> 172.21.15.44:0/1959489073 conn(0x7f40440ccaa0 msgr2=0x7f40440cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 -- 172.21.15.44:0/1959489073 shutdown_connections 2024-09-17T05:41:54.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 -- 172.21.15.44:0/1959489073 wait complete. 2024-09-17T05:41:54.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 Processor -- start 2024-09-17T05:41:54.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.111+0000 7f404a600640 1 -- start start 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40440cac30 0x7f404409be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40440cb040 0x7f4044156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404415bd30 0x7f404406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4044167c60 con 0x7f404415bd30 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f404415f760 con 0x7f40440cb040 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4044167de0 con 0x7f40440cac30 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404415bd30 0x7f404406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404415bd30 0x7f404406fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49314/0 (socket says 172.21.15.44:49314) 2024-09-17T05:41:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 -- 172.21.15.44:0/3786738389 learned_addr learned my addr 172.21.15.44:0/3786738389 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043400640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40440cac30 0x7f404409be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f403be00640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40440cb040 0x7f4044156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 -- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40440cac30 msgr2=0x7f404409be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40440cac30 0x7f404409be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 -- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40440cb040 msgr2=0x7f4044156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40440cb040 0x7f4044156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 -- 172.21.15.44:0/3786738389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40441fa310 con 0x7f404415bd30 2024-09-17T05:41:54.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f403be00640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40440cb040 0x7f4044156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f4043e00640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404415bd30 0x7f404406fc00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f403c00ddf0 tx=0x7f403c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f403b400640 1 -- 172.21.15.44:0/3786738389 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c004d30 con 0x7f404415bd30 2024-09-17T05:41:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f403b400640 1 -- 172.21.15.44:0/3786738389 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f403c005020 con 0x7f404415bd30 2024-09-17T05:41:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f403b400640 1 -- 172.21.15.44:0/3786738389 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c005430 con 0x7f404415bd30 2024-09-17T05:41:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40440b2e70 con 0x7f404415bd30 2024-09-17T05:41:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40441faaf0 con 0x7f404415bd30 2024-09-17T05:41:54.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.115+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40441fa580 con 0x7f404415bd30 2024-09-17T05:41:54.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.119+0000 7f403b400640 1 -- 172.21.15.44:0/3786738389 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f403c0055d0 con 0x7f404415bd30 2024-09-17T05:41:54.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.119+0000 7f403b400640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4020073200 0x7f4020075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.119+0000 7f403b400640 1 -- 172.21.15.44:0/3786738389 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7f403c094a60 con 0x7f404415bd30 2024-09-17T05:41:54.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.119+0000 7f4043400640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4020073200 0x7f4020075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.119+0000 7f4043400640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4020073200 0x7f4020075710 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f40340af000 tx=0x7f403401b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.123+0000 7f403b400640 1 -- 172.21.15.44:0/3786738389 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f403c05f4b0 con 0x7f404415bd30 2024-09-17T05:41:54.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f404415e8c0 con 0x7f404415bd30 2024-09-17T05:41:54.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f403b400640 1 -- 172.21.15.44:0/3786738389 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f403c063ee0 con 0x7f404415bd30 2024-09-17T05:41:54.300 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4020073200 msgr2=0x7f4020075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4020073200 0x7f4020075710 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f40340af000 tx=0x7f403401b060 comp rx=0 tx=0).stop 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404415bd30 msgr2=0x7f404406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404415bd30 0x7f404406fc00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f403c00ddf0 tx=0x7f403c00b730 comp rx=0 tx=0).stop 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 shutdown_connections 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f404415bd30 0x7f404406fc00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4020073200 0x7f4020075710 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40440cb040 0x7f4044156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 --2- 172.21.15.44:0/3786738389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f40440cac30 0x7f404409be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 >> 172.21.15.44:0/3786738389 conn(0x7f40440ccaa0 msgr2=0x7f40441586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 shutdown_connections 2024-09-17T05:41:54.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.299+0000 7f404a600640 1 -- 172.21.15.44:0/3786738389 wait complete. 2024-09-17T05:41:54.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-09-17T05:41:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.479+0000 7ff3df600640 1 -- 172.21.15.44:0/41811196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d806e560 msgr2=0x7ff3d80700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.479+0000 7ff3df600640 1 --2- 172.21.15.44:0/41811196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d806e560 0x7ff3d80700d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009840 tx=0x7ff3c401c820 comp rx=0 tx=0).stop 2024-09-17T05:41:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.479+0000 7ff3df600640 1 -- 172.21.15.44:0/41811196 shutdown_connections 2024-09-17T05:41:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.479+0000 7ff3df600640 1 --2- 172.21.15.44:0/41811196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d806e560 0x7ff3d80700d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.479+0000 7ff3df600640 1 -- 172.21.15.44:0/41811196 >> 172.21.15.44:0/41811196 conn(0x7ff3d80ccaa0 msgr2=0x7ff3d80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.479+0000 7ff3df600640 1 -- 172.21.15.44:0/41811196 shutdown_connections 2024-09-17T05:41:54.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.479+0000 7ff3df600640 1 -- 172.21.15.44:0/41811196 wait complete. 2024-09-17T05:41:54.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 Processor -- start 2024-09-17T05:41:54.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 -- start start 2024-09-17T05:41:54.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d8070610 0x7ff3d81549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b5880 0x7ff3d8154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d8155630 0x7ff3d80aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d816ace0 con 0x7ff3d80b5880 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d816ab60 con 0x7ff3d8070610 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d816ae60 con 0x7ff3d8155630 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b5880 0x7ff3d8154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b5880 0x7ff3d8154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49328/0 (socket says 172.21.15.44:49328) 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 -- 172.21.15.44:0/1831914154 learned_addr learned my addr 172.21.15.44:0/1831914154 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3dd600640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d8155630 0x7ff3d80aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3dcc00640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d8070610 0x7ff3d81549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 -- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d8155630 msgr2=0x7ff3d80aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d8155630 0x7ff3d80aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 -- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d8070610 msgr2=0x7ff3d81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:54.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d8070610 0x7ff3d81549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 -- 172.21.15.44:0/1831914154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d80ada40 con 0x7ff3d80b5880 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d7e00640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b5880 0x7ff3d8154ee0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009790 tx=0x7ff3c40a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d4c00640 1 -- 172.21.15.44:0/1831914154 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4004100 con 0x7ff3d80b5880 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d4c00640 1 -- 172.21.15.44:0/1831914154 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3c40043b0 con 0x7ff3d80b5880 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d80add20 con 0x7ff3d80b5880 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3d4c00640 1 -- 172.21.15.44:0/1831914154 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4005050 con 0x7ff3d80b5880 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.483+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d80ae2e0 con 0x7ff3d80b5880 2024-09-17T05:41:54.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.487+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d80700d0 con 0x7ff3d80b5880 2024-09-17T05:41:54.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.487+0000 7ff3d4c00640 1 -- 172.21.15.44:0/1831914154 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff3c40c0070 con 0x7ff3d80b5880 2024-09-17T05:41:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.487+0000 7ff3d4c00640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.487+0000 7ff3d4c00640 1 -- 172.21.15.44:0/1831914154 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7ff3c412e190 con 0x7ff3d80b5880 2024-09-17T05:41:54.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.487+0000 7ff3dcc00640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:54.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.491+0000 7ff3dcc00640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc007fd0 tx=0x7ff3cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:54.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.491+0000 7ff3d4c00640 1 -- 172.21.15.44:0/1831914154 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff3c4016410 con 0x7ff3d80b5880 2024-09-17T05:41:54.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:54.739+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7ff3d80b0a30 con 0x7ff3d80b5880 2024-09-17T05:41:55.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3d4c00640 1 -- 172.21.15.44:0/1831914154 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v283) ==== 170+0+0 (secure 0 0 0) 0x7ff3c40f8be0 con 0x7ff3d80b5880 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 msgr2=0x7ff3b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc007fd0 tx=0x7ff3cc009040 comp rx=0 tx=0).stop 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b5880 msgr2=0x7ff3d8154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b5880 0x7ff3d8154ee0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009790 tx=0x7ff3c40a6600 comp rx=0 tx=0).stop 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 shutdown_connections 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3d8155630 0x7ff3d80aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b5880 0x7ff3d8154ee0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3b8073200 0x7ff3b8075710 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 --2- 172.21.15.44:0/1831914154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3d8070610 0x7ff3d81549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 >> 172.21.15.44:0/1831914154 conn(0x7ff3d80ccaa0 msgr2=0x7ff3d8072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 shutdown_connections 2024-09-17T05:41:55.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.563+0000 7ff3df600640 1 -- 172.21.15.44:0/1831914154 wait complete. 2024-09-17T05:41:55.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:41:55.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.751+0000 7fc80d400640 1 -- 172.21.15.44:0/1913841184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8080cf400 msgr2=0x7fc80806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.751+0000 7fc80d400640 1 --2- 172.21.15.44:0/1913841184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8080cf400 0x7fc80806e160 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009900 tx=0x7fc7f001c7c0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.751+0000 7fc80d400640 1 -- 172.21.15.44:0/1913841184 shutdown_connections 2024-09-17T05:41:55.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.751+0000 7fc80d400640 1 --2- 172.21.15.44:0/1913841184 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8080cf400 0x7fc80806e160 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.751+0000 7fc80d400640 1 -- 172.21.15.44:0/1913841184 >> 172.21.15.44:0/1913841184 conn(0x7fc8080d1120 msgr2=0x7fc8080d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:55.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.751+0000 7fc80d400640 1 -- 172.21.15.44:0/1913841184 shutdown_connections 2024-09-17T05:41:55.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.751+0000 7fc80d400640 1 -- 172.21.15.44:0/1913841184 wait complete. 2024-09-17T05:41:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 Processor -- start 2024-09-17T05:41:55.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 -- start start 2024-09-17T05:41:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc808072190 0x7fc8080c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80815f0e0 0x7fc8080c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808157950 0x7fc8081f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc80816a030 con 0x7fc808157950 2024-09-17T05:41:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc808169eb0 con 0x7fc808072190 2024-09-17T05:41:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc80d400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc80816a1b0 con 0x7fc80815f0e0 2024-09-17T05:41:55.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc807200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808157950 0x7fc8081f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc807200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808157950 0x7fc8081f91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49348/0 (socket says 172.21.15.44:49348) 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.755+0000 7fc807200640 1 -- 172.21.15.44:0/380548310 learned_addr learned my addr 172.21.15.44:0/380548310 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc7fde00640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80815f0e0 0x7fc8080c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc806800640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc808072190 0x7fc8080c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc807200640 1 -- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80815f0e0 msgr2=0x7fc8080c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc807200640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80815f0e0 0x7fc8080c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc807200640 1 -- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc808072190 msgr2=0x7fc8080c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc807200640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc808072190 0x7fc8080c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc807200640 1 -- 172.21.15.44:0/380548310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8080b0db0 con 0x7fc808157950 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc807200640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808157950 0x7fc8081f91a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc80000be60 tx=0x7fc80000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc7ff400640 1 -- 172.21.15.44:0/380548310 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800019070 con 0x7fc808157950 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc7ff400640 1 -- 172.21.15.44:0/380548310 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc800014440 con 0x7fc808157950 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8081fc760 con 0x7fc808157950 2024-09-17T05:41:55.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc7ff400640 1 -- 172.21.15.44:0/380548310 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800014890 con 0x7fc808157950 2024-09-17T05:41:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8081fcd20 con 0x7fc808157950 2024-09-17T05:41:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8081fc4d0 con 0x7fc808157950 2024-09-17T05:41:55.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.759+0000 7fc7ff400640 1 -- 172.21.15.44:0/380548310 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc80001c070 con 0x7fc808157950 2024-09-17T05:41:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.763+0000 7fc7ff400640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:55.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.763+0000 7fc7ff400640 1 -- 172.21.15.44:0/380548310 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7fc800094300 con 0x7fc808157950 2024-09-17T05:41:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.763+0000 7fc806800640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:55.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.763+0000 7fc806800640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8007fd0 tx=0x7fc7f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:55.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.763+0000 7fc7ff400640 1 -- 172.21.15.44:0/380548310 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc800023080 con 0x7fc808157950 2024-09-17T05:41:55.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.939+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc8081fcf60 con 0x7fc808157950 2024-09-17T05:41:55.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.939+0000 7fc7ff400640 1 -- 172.21.15.44:0/380548310 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+2294 (secure 0 0 0) 0x7fc8081fcf60 con 0x7fc808157950 2024-09-17T05:41:55.941 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:41:55.941 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:41:55.941 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:41:55.941 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:41:55.941 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:41:55.941 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3062.155679 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3184.697297 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3313.522676 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3406.954625 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4320.207875 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.313189 2024-09-17T05:41:55.942 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7119.006184 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4437.685284 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:41:55.943 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:41:55.944 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:41:55.944 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:41:55.944 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 msgr2=0x7fc7e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8007fd0 tx=0x7fc7f8009040 comp rx=0 tx=0).stop 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808157950 msgr2=0x7fc8081f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808157950 0x7fc8081f91a0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fc80000be60 tx=0x7fc80000bf50 comp rx=0 tx=0).stop 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 shutdown_connections 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808157950 0x7fc8081f91a0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc80815f0e0 0x7fc8080c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc7e4073200 0x7fc7e4075710 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 --2- 172.21.15.44:0/380548310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc808072190 0x7fc8080c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:55.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 >> 172.21.15.44:0/380548310 conn(0x7fc8080d1120 msgr2=0x7fc80815a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:55.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 shutdown_connections 2024-09-17T05:41:55.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:55.943+0000 7fc80d400640 1 -- 172.21.15.44:0/380548310 wait complete. 2024-09-17T05:41:55.964 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:41:56.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 -- 172.21.15.44:0/1250066613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c072e50 msgr2=0x7f273c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 --2- 172.21.15.44:0/1250066613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c072e50 0x7f273c15e990 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f272c009900 tx=0x7f272c01c850 comp rx=0 tx=0).stop 2024-09-17T05:41:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 -- 172.21.15.44:0/1250066613 shutdown_connections 2024-09-17T05:41:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 --2- 172.21.15.44:0/1250066613 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f273c0cb470 0x7f273c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 --2- 172.21.15.44:0/1250066613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c072e50 0x7f273c15e990 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 -- 172.21.15.44:0/1250066613 >> 172.21.15.44:0/1250066613 conn(0x7f273c0ccaa0 msgr2=0x7f273c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 -- 172.21.15.44:0/1250066613 shutdown_connections 2024-09-17T05:41:56.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.123+0000 7f2741400640 1 -- 172.21.15.44:0/1250066613 wait complete. 2024-09-17T05:41:56.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 Processor -- start 2024-09-17T05:41:56.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 -- start start 2024-09-17T05:41:56.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f273c06de50 0x7f273c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f273c072e50 0x7f273c1f9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c0cb470 0x7f273c1f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f273c168f70 con 0x7f273c072e50 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f273c168df0 con 0x7f273c0cb470 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2741400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f273c1690f0 con 0x7f273c06de50 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f273c072e50 0x7f273c1f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f273c072e50 0x7f273c1f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49360/0 (socket says 172.21.15.44:49360) 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 -- 172.21.15.44:0/746222611 learned_addr learned my addr 172.21.15.44:0/746222611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f273a800640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f273c06de50 0x7f273c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f273b200640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c0cb470 0x7f273c1f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 -- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f273c06de50 msgr2=0x7f273c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f273c06de50 0x7f273c155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 -- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c0cb470 msgr2=0x7f273c1f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c0cb470 0x7f273c1f6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.127+0000 7f2733e00640 1 -- 172.21.15.44:0/746222611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c15dd50 con 0x7f273c072e50 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2733e00640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f273c072e50 0x7f273c1f9810 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f272400c3f0 tx=0x7f272400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2732a00640 1 -- 172.21.15.44:0/746222611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724017070 con 0x7f273c072e50 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2732a00640 1 -- 172.21.15.44:0/746222611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27240053c0 con 0x7f273c072e50 2024-09-17T05:41:56.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c0a0c70 con 0x7f273c072e50 2024-09-17T05:41:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2732a00640 1 -- 172.21.15.44:0/746222611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724003860 con 0x7f273c072e50 2024-09-17T05:41:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c0a1210 con 0x7f273c072e50 2024-09-17T05:41:56.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c15ba70 con 0x7f273c072e50 2024-09-17T05:41:56.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2732a00640 1 -- 172.21.15.44:0/746222611 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f272401a070 con 0x7f273c072e50 2024-09-17T05:41:56.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2732a00640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2718073230 0x7f2718075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.131+0000 7f2732a00640 1 -- 172.21.15.44:0/746222611 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7f2724093460 con 0x7f273c072e50 2024-09-17T05:41:56.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.135+0000 7f273a800640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2718073230 0x7f2718075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.135+0000 7f273a800640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2718073230 0x7f2718075740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f272c0af000 tx=0x7f272c01b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:56.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.139+0000 7f2732a00640 1 -- 172.21.15.44:0/746222611 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f272405def0 con 0x7f273c072e50 2024-09-17T05:41:56.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.315+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f273c15e990 con 0x7f273c072e50 2024-09-17T05:41:56.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2732a00640 1 -- 172.21.15.44:0/746222611 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f2724062920 con 0x7f273c072e50 2024-09-17T05:41:56.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2718073230 msgr2=0x7f2718075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2718073230 0x7f2718075740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f272c0af000 tx=0x7f272c01b090 comp rx=0 tx=0).stop 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f273c072e50 msgr2=0x7f273c1f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f273c072e50 0x7f273c1f9810 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f272400c3f0 tx=0x7f272400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 shutdown_connections 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2718073230 0x7f2718075740 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f273c0cb470 0x7f273c1f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f273c072e50 0x7f273c1f9810 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 --2- 172.21.15.44:0/746222611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f273c06de50 0x7f273c155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 >> 172.21.15.44:0/746222611 conn(0x7f273c0ccaa0 msgr2=0x7f273c156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 shutdown_connections 2024-09-17T05:41:56.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.319+0000 7f2741400640 1 -- 172.21.15.44:0/746222611 wait complete. 2024-09-17T05:41:56.342 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:41:56.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:41:56.434 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:41:56.538 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:41:56.538 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:41:56.538 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:56.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:41:56.547 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:41:56.547 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:56.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:41:56.556 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:41:56.556 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:56.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:41:56.604 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:41:56.604 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:41:56.614 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:41:56.614 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:41:56.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:41:56.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.803+0000 7fcb2ce00640 1 -- 172.21.15.44:0/341419077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb0c003a40 msgr2=0x7fcb0c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.803+0000 7fcb2ce00640 1 --2- 172.21.15.44:0/341419077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb0c003a40 0x7fcb0c003eb0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009b40 tx=0x7fcb1801d270 comp rx=0 tx=0).stop 2024-09-17T05:41:56.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.803+0000 7fcb26800640 1 -- 172.21.15.44:0/341419077 reap_dead start 2024-09-17T05:41:56.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.803+0000 7fcb2ce00640 1 -- 172.21.15.44:0/341419077 shutdown_connections 2024-09-17T05:41:56.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.803+0000 7fcb2ce00640 1 -- 172.21.15.44:0/341419077 >> 172.21.15.44:0/341419077 conn(0x7fcb280cd930 msgr2=0x7fcb280cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:56.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.803+0000 7fcb2ce00640 1 -- 172.21.15.44:0/341419077 shutdown_connections 2024-09-17T05:41:56.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.803+0000 7fcb2ce00640 1 -- 172.21.15.44:0/341419077 wait complete. 2024-09-17T05:41:56.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 Processor -- start 2024-09-17T05:41:56.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 -- start start 2024-09-17T05:41:56.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb0c003a40 0x7fcb28146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb281630b0 0x7fcb280b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcb281634c0 0x7fcb280b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcb28167890 con 0x7fcb281630b0 2024-09-17T05:41:56.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcb28167710 con 0x7fcb0c003a40 2024-09-17T05:41:56.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb2ce00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fcb28167a10 con 0x7fcb281634c0 2024-09-17T05:41:56.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb281630b0 0x7fcb280b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb281630b0 0x7fcb280b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49382/0 (socket says 172.21.15.44:49382) 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb25e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb0c003a40 0x7fcb28146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 -- 172.21.15.44:0/3988406856 learned_addr learned my addr 172.21.15.44:0/3988406856 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb26800640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcb281634c0 0x7fcb280b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 -- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcb281634c0 msgr2=0x7fcb280b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcb281634c0 0x7fcb280b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 -- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb0c003a40 msgr2=0x7fcb28146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb0c003a40 0x7fcb28146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 -- 172.21.15.44:0/3988406856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb28163c90 con 0x7fcb281630b0 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.807+0000 7fcb1fe00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb281630b0 0x7fcb280b5720 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fcb10006640 tx=0x7fcb10001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb1e000640 1 -- 172.21.15.44:0/3988406856 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10015020 con 0x7fcb281630b0 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb1e000640 1 -- 172.21.15.44:0/3988406856 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb10011960 con 0x7fcb281630b0 2024-09-17T05:41:56.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb28163f70 con 0x7fcb281630b0 2024-09-17T05:41:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb1e000640 1 -- 172.21.15.44:0/3988406856 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10011d70 con 0x7fcb281630b0 2024-09-17T05:41:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb28164530 con 0x7fcb281630b0 2024-09-17T05:41:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb28163a00 con 0x7fcb281630b0 2024-09-17T05:41:56.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb1e000640 1 -- 172.21.15.44:0/3988406856 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcb10018020 con 0x7fcb281630b0 2024-09-17T05:41:56.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb1e000640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb04073200 0x7fcb04075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:56.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb1e000640 1 -- 172.21.15.44:0/3988406856 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7fcb10094a80 con 0x7fcb281630b0 2024-09-17T05:41:56.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.811+0000 7fcb25e00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb04073200 0x7fcb04075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:56.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.815+0000 7fcb25e00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb04073200 0x7fcb04075710 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcb180ad000 tx=0x7fcb1801a010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:56.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:56.815+0000 7fcb1e000640 1 -- 172.21.15.44:0/3988406856 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fcb1001f020 con 0x7fcb281630b0 2024-09-17T05:41:57.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb28151b00 con 0x7fcb281630b0 2024-09-17T05:41:57.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb1e000640 1 -- 172.21.15.44:0/3988406856 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+3908 (secure 0 0 0) 0x7fcb1005f6d0 con 0x7fcb281630b0 2024-09-17T05:41:57.028 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:57.028 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":56,"btime":"2024-09-17T05:41:50:287983+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5690,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3679398791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3679398791},{"type":"v1","addr":"172.21.15.44:6835","nonce":3679398791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5693,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/2899467133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":2899467133},{"type":"v1","addr":"172.21.15.86:6836","nonce":2899467133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5696,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2459537322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":2459537322},{"type":"v1","addr":"172.21.15.86:6837","nonce":2459537322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/509177974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":509177974},{"type":"v1","addr":"172.21.15.44:6834","nonce":509177974}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[]} 2024-09-17T05:41:57.029 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 56 2024-09-17T05:41:57.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb04073200 msgr2=0x7fcb04075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb04073200 0x7fcb04075710 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcb180ad000 tx=0x7fcb1801a010 comp rx=0 tx=0).stop 2024-09-17T05:41:57.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb281630b0 msgr2=0x7fcb280b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb281630b0 0x7fcb280b5720 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fcb10006640 tx=0x7fcb10001640 comp rx=0 tx=0).stop 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 shutdown_connections 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fcb281634c0 0x7fcb280b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb281630b0 0x7fcb280b5720 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb04073200 0x7fcb04075710 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 --2- 172.21.15.44:0/3988406856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb0c003a40 0x7fcb28146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 >> 172.21.15.44:0/3988406856 conn(0x7fcb280cd930 msgr2=0x7fcb280b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 shutdown_connections 2024-09-17T05:41:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.027+0000 7fcb2ce00640 1 -- 172.21.15.44:0/3988406856 wait complete. 2024-09-17T05:41:57.050 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:41:57.050 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:41:57.051 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:41:57.051 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:41:57.051 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:41:57.051 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:41:57.051 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:41:57.051 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:41:57.052 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:41:57.052 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:41:57.052 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:41:57.052 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:41:57.052 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:41:57.052 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:41:57.052 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:41:57.053 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:41:57.062 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:41:57.062 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:41:57.066 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:41:57.066 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:41:57.068 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:41:57.068 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:41:57.073 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:41:57.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:41:57.117 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:41:57.117 DEBUG:teuthology.parallel:result is None 2024-09-17T05:41:57.118 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:41:57.118 DEBUG:teuthology.parallel:result is None 2024-09-17T05:41:57.119 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:41:57.119 DEBUG:teuthology.parallel:result is None 2024-09-17T05:41:57.120 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:41:57.120 DEBUG:teuthology.parallel:result is None 2024-09-17T05:41:57.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:41:57.217 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:41:57.218 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:41:57.218 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:41:57.219 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:41:57.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 -- 172.21.15.44:0/136795299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 msgr2=0x7f71940cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 --2- 172.21.15.44:0/136795299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f71940cec50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f71940af830 tx=0x7f718401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 -- 172.21.15.44:0/136795299 shutdown_connections 2024-09-17T05:41:57.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 --2- 172.21.15.44:0/136795299 >> v2:172.21.15.86:3300/0 conn(0x7f71940cb040 0x7f71940cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 --2- 172.21.15.44:0/136795299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f71940cec50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 -- 172.21.15.44:0/136795299 >> 172.21.15.44:0/136795299 conn(0x7f71940ccaa0 msgr2=0x7f71940cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 -- 172.21.15.44:0/136795299 shutdown_connections 2024-09-17T05:41:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.283+0000 7f7199400640 1 -- 172.21.15.44:0/136795299 wait complete. 2024-09-17T05:41:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 Processor -- start 2024-09-17T05:41:57.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 -- start start 2024-09-17T05:41:57.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f719415c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71940cb040 0x7f7194151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719415e8c0 0x7f719406fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7194166490 con 0x7f71940cac30 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7194166310 con 0x7f71940cb040 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7194166610 con 0x7f719415e8c0 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f719415c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f719415c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49436/0 (socket says 172.21.15.44:49436) 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 -- 172.21.15.44:0/997399346 learned_addr learned my addr 172.21.15.44:0/997399346 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7189e00640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71940cb040 0x7f7194151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7193200640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719415e8c0 0x7f719406fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 -- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719415e8c0 msgr2=0x7f719406fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719415e8c0 0x7f719406fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 -- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71940cb040 msgr2=0x7f7194151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71940cb040 0x7f7194151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:57.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 -- 172.21.15.44:0/997399346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941515b0 con 0x7f71940cac30 2024-09-17T05:41:57.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7189e00640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71940cb040 0x7f7194151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:57.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7192800640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f719415c5f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f71840b0040 tx=0x7f71840a5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:57.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f718b400640 1 -- 172.21.15.44:0/997399346 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71840b2040 con 0x7f71940cac30 2024-09-17T05:41:57.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f718b400640 1 -- 172.21.15.44:0/997399346 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71840043b0 con 0x7f71940cac30 2024-09-17T05:41:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f718b400640 1 -- 172.21.15.44:0/997399346 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184005280 con 0x7f71940cac30 2024-09-17T05:41:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719406ec50 con 0x7f71940cac30 2024-09-17T05:41:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.287+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719406f210 con 0x7f71940cac30 2024-09-17T05:41:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.291+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719415ecd0 con 0x7f71940cac30 2024-09-17T05:41:57.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.291+0000 7f718b400640 1 -- 172.21.15.44:0/997399346 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7184005420 con 0x7f71940cac30 2024-09-17T05:41:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.291+0000 7f718b400640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7170073230 0x7f7170075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.291+0000 7f718b400640 1 -- 172.21.15.44:0/997399346 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5421+0+0 (secure 0 0 0) 0x7f718412dc10 con 0x7f71940cac30 2024-09-17T05:41:57.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.291+0000 7f7189e00640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7170073230 0x7f7170075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.291+0000 7f7189e00640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7170073230 0x7f7170075740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f71940b5a90 tx=0x7f717c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:57.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.295+0000 7f718b400640 1 -- 172.21.15.44:0/997399346 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f71840164b0 con 0x7f71940cac30 2024-09-17T05:41:57.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:57.495+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f71940cd9f0 con 0x7f71940cac30 2024-09-17T05:41:58.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.339+0000 7f718b400640 1 -- 172.21.15.44:0/997399346 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) ==== 97+0+0 (secure 0 0 0) 0x7f71940cd9f0 con 0x7f71940cac30 2024-09-17T05:41:58.342 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-17T05:41:58.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7170073230 msgr2=0x7f7170075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7170073230 0x7f7170075740 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f71940b5a90 tx=0x7f717c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 msgr2=0x7f719415c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f719415c5f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f71840b0040 tx=0x7f71840a5710 comp rx=0 tx=0).stop 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 shutdown_connections 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f719415e8c0 0x7f719406fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7170073230 0x7f7170075740 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71940cb040 0x7f7194151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 --2- 172.21.15.44:0/997399346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71940cac30 0x7f719415c5f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 >> 172.21.15.44:0/997399346 conn(0x7f71940ccaa0 msgr2=0x7f7194155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 shutdown_connections 2024-09-17T05:41:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.343+0000 7f7199400640 1 -- 172.21.15.44:0/997399346 wait complete. 2024-09-17T05:41:58.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:41:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.531+0000 7f29ac200640 1 -- 172.21.15.44:0/1620520575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a40cc3b0 msgr2=0x7f29a406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.531+0000 7f29ac200640 1 --2- 172.21.15.44:0/1620520575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a40cc3b0 0x7f29a406ff50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f299c009bf0 tx=0x7f299c01cad0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.531+0000 7f29ac200640 1 -- 172.21.15.44:0/1620520575 shutdown_connections 2024-09-17T05:41:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.531+0000 7f29ac200640 1 --2- 172.21.15.44:0/1620520575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a40cc3b0 0x7f29a406ff50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.531+0000 7f29ac200640 1 -- 172.21.15.44:0/1620520575 >> 172.21.15.44:0/1620520575 conn(0x7f29a40cd930 msgr2=0x7f29a40cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.531+0000 7f29ac200640 1 -- 172.21.15.44:0/1620520575 shutdown_connections 2024-09-17T05:41:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.531+0000 7f29ac200640 1 -- 172.21.15.44:0/1620520575 wait complete. 2024-09-17T05:41:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 Processor -- start 2024-09-17T05:41:58.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 -- start start 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a406ce40 0x7f29a4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a415a1f0 0x7f29a4152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a4155880 0x7f29a4150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29a416b570 con 0x7f29a415a1f0 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f29a416b3f0 con 0x7f29a4155880 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29ac200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f29a416b6f0 con 0x7f29a406ce40 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a415a1f0 0x7f29a4152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a415a1f0 0x7f29a4152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49442/0 (socket says 172.21.15.44:49442) 2024-09-17T05:41:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 -- 172.21.15.44:0/3046267624 learned_addr learned my addr 172.21.15.44:0/3046267624 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29aa200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a4155880 0x7f29a4150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a9800640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a406ce40 0x7f29a4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 -- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a406ce40 msgr2=0x7f29a4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a406ce40 0x7f29a4152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 -- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a4155880 msgr2=0x7f29a4150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a4155880 0x7f29a4150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29a8e00640 1 -- 172.21.15.44:0/3046267624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a41547e0 con 0x7f29a415a1f0 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.535+0000 7f29aa200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a4155880 0x7f29a4150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:58.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29a8e00640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a415a1f0 0x7f29a4152460 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f299000c460 tx=0x7f299000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29a1600640 1 -- 172.21.15.44:0/3046267624 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29900052d0 con 0x7f29a415a1f0 2024-09-17T05:41:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a4154ac0 con 0x7f29a415a1f0 2024-09-17T05:41:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29a1600640 1 -- 172.21.15.44:0/3046267624 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29900054b0 con 0x7f29a415a1f0 2024-09-17T05:41:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29a1600640 1 -- 172.21.15.44:0/3046267624 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990012890 con 0x7f29a415a1f0 2024-09-17T05:41:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a4155080 con 0x7f29a415a1f0 2024-09-17T05:41:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a406ff50 con 0x7f29a415a1f0 2024-09-17T05:41:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29a1600640 1 -- 172.21.15.44:0/3046267624 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2990012a30 con 0x7f29a415a1f0 2024-09-17T05:41:58.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29a1600640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2984073230 0x7f2984075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.539+0000 7f29a1600640 1 -- 172.21.15.44:0/3046267624 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5249+0+0 (secure 0 0 0) 0x7f2990093c00 con 0x7f29a415a1f0 2024-09-17T05:41:58.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.543+0000 7f29a9800640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2984073230 0x7f2984075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.543+0000 7f29a9800640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2984073230 0x7f2984075740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f29980078b0 tx=0x7f2998009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.543+0000 7f29a1600640 1 -- 172.21.15.44:0/3046267624 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f299005ed40 con 0x7f29a415a1f0 2024-09-17T05:41:58.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f29a415ef80 con 0x7f29a415a1f0 2024-09-17T05:41:58.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29a1600640 1 -- 172.21.15.44:0/3046267624 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f299005e640 con 0x7f29a415a1f0 2024-09-17T05:41:58.788 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:58.788 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:41:58.788 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-17T05:41:58.788 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw==", 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-17T05:41:58.789 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow==", 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ==", 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.790 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA==", 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.791 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw==", 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.792 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA==", 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.793 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg==", 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q==", 2024-09-17T05:41:58.794 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg==", 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.795 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew==", 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.796 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA==", 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw==", 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.797 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow==", 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-17T05:41:58.798 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ==", 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.799 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw==", 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-17T05:41:58.800 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A==", 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQARFelmev8SKhAAoaY75HymG92N8LNMMAUl6g==", 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:41:58.801 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA==", 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:41:58.802 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw==", 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:41:58.803 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:41:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2984073230 msgr2=0x7f2984075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2984073230 0x7f2984075740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f29980078b0 tx=0x7f2998009040 comp rx=0 tx=0).stop 2024-09-17T05:41:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a415a1f0 msgr2=0x7f29a4152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a415a1f0 0x7f29a4152460 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f299000c460 tx=0x7f299000c920 comp rx=0 tx=0).stop 2024-09-17T05:41:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 shutdown_connections 2024-09-17T05:41:58.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2984073230 0x7f2984075740 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29a4155880 0x7f29a4150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a415a1f0 0x7f29a4152460 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 --2- 172.21.15.44:0/3046267624 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29a406ce40 0x7f29a4152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 >> 172.21.15.44:0/3046267624 conn(0x7f29a40cd930 msgr2=0x7f29a41673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 shutdown_connections 2024-09-17T05:41:58.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.787+0000 7f29ac200640 1 -- 172.21.15.44:0/3046267624 wait complete. 2024-09-17T05:41:58.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:41:58.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.967+0000 7f9eaba00640 1 -- 172.21.15.44:0/1754765182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea40b5880 msgr2=0x7f9ea406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.967+0000 7f9eaba00640 1 --2- 172.21.15.44:0/1754765182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea40b5880 0x7f9ea406de50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009870 tx=0x7f9e9801c860 comp rx=0 tx=0).stop 2024-09-17T05:41:58.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.967+0000 7f9eaba00640 1 -- 172.21.15.44:0/1754765182 shutdown_connections 2024-09-17T05:41:58.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.967+0000 7f9eaba00640 1 --2- 172.21.15.44:0/1754765182 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea40b5880 0x7f9ea406de50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.967+0000 7f9eaba00640 1 -- 172.21.15.44:0/1754765182 >> 172.21.15.44:0/1754765182 conn(0x7f9ea40ccaa0 msgr2=0x7f9ea40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:58.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.967+0000 7f9eaba00640 1 -- 172.21.15.44:0/1754765182 shutdown_connections 2024-09-17T05:41:58.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.967+0000 7f9eaba00640 1 -- 172.21.15.44:0/1754765182 wait complete. 2024-09-17T05:41:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 Processor -- start 2024-09-17T05:41:58.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 -- start start 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea406e390 0x7f9ea4156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea40b5880 0x7f9ea4157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ea40ce300 0x7f9ea409be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea416b5f0 con 0x7f9ea40b5880 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea416b470 con 0x7f9ea40ce300 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea416b770 con 0x7f9ea406e390 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea40b5880 0x7f9ea4157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea40b5880 0x7f9ea4157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47374/0 (socket says 172.21.15.44:47374) 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 -- 172.21.15.44:0/2599583675 learned_addr learned my addr 172.21.15.44:0/2599583675 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:58.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea9000640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea406e390 0x7f9ea4156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea9a00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ea40ce300 0x7f9ea409be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 -- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea406e390 msgr2=0x7f9ea4156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea406e390 0x7f9ea4156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 -- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ea40ce300 msgr2=0x7f9ea409be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ea40ce300 0x7f9ea409be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 -- 172.21.15.44:0/2599583675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea409e1d0 con 0x7f9ea40b5880 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea9a00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ea40ce300 0x7f9ea409be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:41:58.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea3e00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea40b5880 0x7f9ea4157390 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c3f0 tx=0x7f9e9000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea0c00640 1 -- 172.21.15.44:0/2599583675 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90017070 con 0x7f9ea40b5880 2024-09-17T05:41:58.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea0c00640 1 -- 172.21.15.44:0/2599583675 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e900053c0 con 0x7f9ea40b5880 2024-09-17T05:41:58.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9ea0c00640 1 -- 172.21.15.44:0/2599583675 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90003860 con 0x7f9ea40b5880 2024-09-17T05:41:58.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea409e6d0 con 0x7f9ea40b5880 2024-09-17T05:41:58.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.971+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea409b860 con 0x7f9ea40b5880 2024-09-17T05:41:58.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.975+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea406de50 con 0x7f9ea40b5880 2024-09-17T05:41:58.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.975+0000 7f9ea0c00640 1 -- 172.21.15.44:0/2599583675 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e9001a070 con 0x7f9ea40b5880 2024-09-17T05:41:58.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.975+0000 7f9ea0c00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e84073200 0x7f9e84075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:58.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.975+0000 7f9ea0c00640 1 -- 172.21.15.44:0/2599583675 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5249+0+0 (secure 0 0 0) 0x7f9e900932d0 con 0x7f9ea40b5880 2024-09-17T05:41:58.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.975+0000 7f9ea9000640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e84073200 0x7f9e84075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:58.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.979+0000 7f9ea9000640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e84073200 0x7f9e84075710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af000 tx=0x7f9e9801b0a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:58.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:58.979+0000 7f9ea0c00640 1 -- 172.21.15.44:0/2599583675 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9e9005dee0 con 0x7f9ea40b5880 2024-09-17T05:41:59.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.155+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9ea409e460 con 0x7f9ea40b5880 2024-09-17T05:41:59.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.155+0000 7f9ea0c00640 1 -- 172.21.15.44:0/2599583675 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) ==== 84+0+65 (secure 0 0 0) 0x7f9e90062910 con 0x7f9ea40b5880 2024-09-17T05:41:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:41:59.158 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:41:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:41:59.158 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:41:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:41:59.159 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:41:59.159 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:41:59.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e84073200 msgr2=0x7f9e84075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e84073200 0x7f9e84075710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9e980af000 tx=0x7f9e9801b0a0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea40b5880 msgr2=0x7f9ea4157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea40b5880 0x7f9ea4157390 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000c3f0 tx=0x7f9e9000c8b0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 shutdown_connections 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9e84073200 0x7f9e84075710 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ea40ce300 0x7f9ea409be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ea40b5880 0x7f9ea4157390 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 --2- 172.21.15.44:0/2599583675 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ea406e390 0x7f9ea4156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 >> 172.21.15.44:0/2599583675 conn(0x7f9ea40ccaa0 msgr2=0x7f9ea4158850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 shutdown_connections 2024-09-17T05:41:59.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.159+0000 7f9eaba00640 1 -- 172.21.15.44:0/2599583675 wait complete. 2024-09-17T05:41:59.180 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:41:59.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:41:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 -- 172.21.15.44:0/3981074250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f903806e390 msgr2=0x7f90380cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 --2- 172.21.15.44:0/3981074250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f903806e390 0x7f90380cdfe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9030009b70 tx=0x7f903001caa0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 -- 172.21.15.44:0/3981074250 shutdown_connections 2024-09-17T05:41:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 --2- 172.21.15.44:0/3981074250 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f903806e390 0x7f90380cdfe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 -- 172.21.15.44:0/3981074250 >> 172.21.15.44:0/3981074250 conn(0x7f90380b35f0 msgr2=0x7f90380b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:41:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 -- 172.21.15.44:0/3981074250 shutdown_connections 2024-09-17T05:41:59.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 -- 172.21.15.44:0/3981074250 wait complete. 2024-09-17T05:41:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 Processor -- start 2024-09-17T05:41:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.343+0000 7f903f400640 1 -- start start 2024-09-17T05:41:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f903806df80 0x7f903814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f903806e390 0x7f9038154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9038155b10 0x7f903809d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f90380ce8b0 con 0x7f903806e390 2024-09-17T05:41:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90380ce730 con 0x7f903806df80 2024-09-17T05:41:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9038167540 con 0x7f9038155b10 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f903806e390 0x7f9038154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f903806e390 0x7f9038154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47390/0 (socket says 172.21.15.44:47390) 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 -- 172.21.15.44:0/2858685080 learned_addr learned my addr 172.21.15.44:0/2858685080 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903d400640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9038155b10 0x7f903809d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903ca00640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f903806df80 0x7f903814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 -- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9038155b10 msgr2=0x7f903809d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9038155b10 0x7f903809d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 -- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f903806df80 msgr2=0x7f903814fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f903806df80 0x7f903814fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 -- 172.21.15.44:0/2858685080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9038150570 con 0x7f903806e390 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9037e00640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f903806e390 0x7f9038154960 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f902400c430 tx=0x7f902400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9034c00640 1 -- 172.21.15.44:0/2858685080 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024011790 con 0x7f903806e390 2024-09-17T05:41:59.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9034c00640 1 -- 172.21.15.44:0/2858685080 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9024017070 con 0x7f903806e390 2024-09-17T05:41:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f9034c00640 1 -- 172.21.15.44:0/2858685080 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024011ca0 con 0x7f903806e390 2024-09-17T05:41:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9038150850 con 0x7f903806e390 2024-09-17T05:41:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9038150e10 con 0x7f903806e390 2024-09-17T05:41:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.347+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90380cdfe0 con 0x7f903806e390 2024-09-17T05:41:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.351+0000 7f9034c00640 1 -- 172.21.15.44:0/2858685080 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f902401c460 con 0x7f903806e390 2024-09-17T05:41:59.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.351+0000 7f9034c00640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9018073200 0x7f9018075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:41:59.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.351+0000 7f9034c00640 1 -- 172.21.15.44:0/2858685080 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5249+0+0 (secure 0 0 0) 0x7f9024093e30 con 0x7f903806e390 2024-09-17T05:41:59.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.351+0000 7f903ca00640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9018073200 0x7f9018075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:41:59.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.351+0000 7f903ca00640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9018073200 0x7f9018075710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f902c000f70 tx=0x7f902c00c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:41:59.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.355+0000 7f9034c00640 1 -- 172.21.15.44:0/2858685080 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f902405e920 con 0x7f903806e390 2024-09-17T05:41:59.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:41:59.531+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f90380d0e30 con 0x7f903806e390 2024-09-17T05:42:00.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.343+0000 7f9034c00640 1 -- 172.21.15.44:0/2858685080 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) ==== 138+0+0 (secure 0 0 0) 0x7f9024063350 con 0x7f903806e390 2024-09-17T05:42:00.346 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:42:00.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9018073200 msgr2=0x7f9018075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9018073200 0x7f9018075710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f902c000f70 tx=0x7f902c00c040 comp rx=0 tx=0).stop 2024-09-17T05:42:00.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f903806e390 msgr2=0x7f9038154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f903806e390 0x7f9038154960 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f902400c430 tx=0x7f902400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 shutdown_connections 2024-09-17T05:42:00.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9038155b10 0x7f903809d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f903806e390 0x7f9038154960 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9018073200 0x7f9018075710 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 --2- 172.21.15.44:0/2858685080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f903806df80 0x7f903814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.347+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 >> 172.21.15.44:0/2858685080 conn(0x7f90380b35f0 msgr2=0x7f90380ad0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.351+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 shutdown_connections 2024-09-17T05:42:00.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.351+0000 7f903f400640 1 -- 172.21.15.44:0/2858685080 wait complete. 2024-09-17T05:42:00.381 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:42:00.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 -- 172.21.15.44:0/3857464607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f960006e390 msgr2=0x7f96000cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 --2- 172.21.15.44:0/3857464607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f960006e390 0x7f96000cdbf0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f960006ace0 tx=0x7f95e801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 -- 172.21.15.44:0/3857464607 shutdown_connections 2024-09-17T05:42:00.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 --2- 172.21.15.44:0/3857464607 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f960006e390 0x7f96000cdbf0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 --2- 172.21.15.44:0/3857464607 >> v2:172.21.15.86:3300/0 conn(0x7f96000b5880 0x7f960006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 -- 172.21.15.44:0/3857464607 >> 172.21.15.44:0/3857464607 conn(0x7f96000ccaa0 msgr2=0x7f96000cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:00.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 -- 172.21.15.44:0/3857464607 shutdown_connections 2024-09-17T05:42:00.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 -- 172.21.15.44:0/3857464607 wait complete. 2024-09-17T05:42:00.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 Processor -- start 2024-09-17T05:42:00.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.551+0000 7f9605600640 1 -- start start 2024-09-17T05:42:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f960006e390 0x7f96000c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96000b5880 0x7f96000cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96000ce130 0x7f96000c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f960016a2c0 con 0x7f96000ce130 2024-09-17T05:42:00.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f960016a140 con 0x7f96000b5880 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f960016a440 con 0x7f960006e390 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96000ce130 0x7f96000c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96000ce130 0x7f96000c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47406/0 (socket says 172.21.15.44:47406) 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 -- 172.21.15.44:0/2589330429 learned_addr learned my addr 172.21.15.44:0/2589330429 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95fea00640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f960006e390 0x7f96000c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95f6000640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96000b5880 0x7f96000cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 -- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f960006e390 msgr2=0x7f96000c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f960006e390 0x7f96000c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 -- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96000b5880 msgr2=0x7f96000cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96000b5880 0x7f96000cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:00.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 -- 172.21.15.44:0/2589330429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96000ca820 con 0x7f96000ce130 2024-09-17T05:42:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95ff400640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96000ce130 0x7f96000c7f60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c760 tx=0x7f95f800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95f7400640 1 -- 172.21.15.44:0/2589330429 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8003b80 con 0x7f96000ce130 2024-09-17T05:42:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95f7400640 1 -- 172.21.15.44:0/2589330429 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95f8003d20 con 0x7f96000ce130 2024-09-17T05:42:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f95f7400640 1 -- 172.21.15.44:0/2589330429 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f800aab0 con 0x7f96000ce130 2024-09-17T05:42:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96000cab00 con 0x7f96000ce130 2024-09-17T05:42:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96000c89c0 con 0x7f96000ce130 2024-09-17T05:42:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.555+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96000af5f0 con 0x7f96000ce130 2024-09-17T05:42:00.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.559+0000 7f95f7400640 1 -- 172.21.15.44:0/2589330429 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f95f800ac50 con 0x7f96000ce130 2024-09-17T05:42:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.559+0000 7f95f7400640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95dc073200 0x7f95dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:00.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.559+0000 7f95f7400640 1 -- 172.21.15.44:0/2589330429 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5619+0+0 (secure 0 0 0) 0x7f95f8093ef0 con 0x7f96000ce130 2024-09-17T05:42:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.559+0000 7f95fea00640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95dc073200 0x7f95dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:00.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.559+0000 7f95fea00640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95dc073200 0x7f95dc075710 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f95f000bb50 tx=0x7f95f000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:00.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.563+0000 7f95f7400640 1 -- 172.21.15.44:0/2589330429 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f96000af5f0 con 0x7f96000ce130 2024-09-17T05:42:00.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:00.735+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f96000cdbf0 con 0x7f96000ce130 2024-09-17T05:42:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.355+0000 7f95f7400640 1 -- 172.21.15.44:0/2589330429 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) ==== 170+0+0 (secure 0 0 0) 0x7f960006e7a0 con 0x7f96000ce130 2024-09-17T05:42:01.358 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:42:01.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95dc073200 msgr2=0x7f95dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95dc073200 0x7f95dc075710 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f95f000bb50 tx=0x7f95f000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96000ce130 msgr2=0x7f96000c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96000ce130 0x7f96000c7f60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c760 tx=0x7f95f800cc20 comp rx=0 tx=0).stop 2024-09-17T05:42:01.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 shutdown_connections 2024-09-17T05:42:01.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f96000ce130 0x7f96000c7f60 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95dc073200 0x7f95dc075710 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96000b5880 0x7f96000cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 --2- 172.21.15.44:0/2589330429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f960006e390 0x7f96000c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 >> 172.21.15.44:0/2589330429 conn(0x7f96000ccaa0 msgr2=0x7f96000b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 shutdown_connections 2024-09-17T05:42:01.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.359+0000 7f9605600640 1 -- 172.21.15.44:0/2589330429 wait complete. 2024-09-17T05:42:01.401 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:42:01.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 -- 172.21.15.44:0/2134425458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 msgr2=0x7f7e7006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 --2- 172.21.15.44:0/2134425458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e7006e260 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7e7006ace0 tx=0x7f7e5801c830 comp rx=0 tx=0).stop 2024-09-17T05:42:01.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 -- 172.21.15.44:0/2134425458 shutdown_connections 2024-09-17T05:42:01.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 --2- 172.21.15.44:0/2134425458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e700ced00 0x7f7e700cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 --2- 172.21.15.44:0/2134425458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e7006e260 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 --2- 172.21.15.44:0/2134425458 >> v2:172.21.15.86:3300/0 conn(0x7f7e70072e50 0x7f7e7015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 -- 172.21.15.44:0/2134425458 >> 172.21.15.44:0/2134425458 conn(0x7f7e700ccaa0 msgr2=0x7f7e700cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:01.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 -- 172.21.15.44:0/2134425458 shutdown_connections 2024-09-17T05:42:01.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.563+0000 7f7e77200640 1 -- 172.21.15.44:0/2134425458 wait complete. 2024-09-17T05:42:01.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 Processor -- start 2024-09-17T05:42:01.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 -- start start 2024-09-17T05:42:01.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e70070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e70072e50 0x7f7e70165a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e700ced00 0x7f7e70164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700cc280 con 0x7f7e7006de50 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700cc100 con 0x7f7e700ced00 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e77200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7e700cc400 con 0x7f7e70072e50 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e70070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e70070030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47420/0 (socket says 172.21.15.44:47420) 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 -- 172.21.15.44:0/3348553069 learned_addr learned my addr 172.21.15.44:0/3348553069 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e67e00640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e70072e50 0x7f7e70165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e75200640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e700ced00 0x7f7e70164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 -- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e70072e50 msgr2=0x7f7e70165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e70072e50 0x7f7e70165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 -- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e700ced00 msgr2=0x7f7e70164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:01.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e700ced00 0x7f7e70164650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:01.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 -- 172.21.15.44:0/3348553069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e70070570 con 0x7f7e7006de50 2024-09-17T05:42:01.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.567+0000 7f7e6fe00640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e70070030 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000d6a0 tx=0x7f7e6000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e6cc00640 1 -- 172.21.15.44:0/3348553069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60017070 con 0x7f7e7006de50 2024-09-17T05:42:01.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e6cc00640 1 -- 172.21.15.44:0/3348553069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e60004310 con 0x7f7e7006de50 2024-09-17T05:42:01.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e6cc00640 1 -- 172.21.15.44:0/3348553069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60005280 con 0x7f7e7006de50 2024-09-17T05:42:01.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7006f270 con 0x7f7e7006de50 2024-09-17T05:42:01.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7006f830 con 0x7f7e7006de50 2024-09-17T05:42:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e700b5fa0 con 0x7f7e7006de50 2024-09-17T05:42:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e6cc00640 1 -- 172.21.15.44:0/3348553069 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7e60005420 con 0x7f7e7006de50 2024-09-17T05:42:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e6cc00640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e4c073200 0x7f7e4c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:01.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.571+0000 7f7e6cc00640 1 -- 172.21.15.44:0/3348553069 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6001+0+0 (secure 0 0 0) 0x7f7e60094b40 con 0x7f7e7006de50 2024-09-17T05:42:01.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.575+0000 7f7e67e00640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e4c073200 0x7f7e4c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:01.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.575+0000 7f7e67e00640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e4c073200 0x7f7e4c075710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e580af000 tx=0x7f7e580a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:01.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.575+0000 7f7e6cc00640 1 -- 172.21.15.44:0/3348553069 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7e60020020 con 0x7f7e7006de50 2024-09-17T05:42:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:01.787+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7e70156f30 con 0x7f7e7006de50 2024-09-17T05:42:02.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.367+0000 7f7e6cc00640 1 -- 172.21.15.44:0/3348553069 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v58) ==== 174+0+0 (secure 0 0 0) 0x7f7e6005f4e0 con 0x7f7e7006de50 2024-09-17T05:42:02.375 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 13 and data pool 14 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e4c073200 msgr2=0x7f7e4c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e4c073200 0x7f7e4c075710 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e580af000 tx=0x7f7e580a7040 comp rx=0 tx=0).stop 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 msgr2=0x7f7e70070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e70070030 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000d6a0 tx=0x7f7e6000db60 comp rx=0 tx=0).stop 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 shutdown_connections 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e4c073200 0x7f7e4c075710 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e700ced00 0x7f7e70164650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e70072e50 0x7f7e70165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 --2- 172.21.15.44:0/3348553069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e7006de50 0x7f7e70070030 secure :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000d6a0 tx=0x7f7e6000db60 comp rx=0 tx=0).stop 2024-09-17T05:42:02.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.379+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 >> 172.21.15.44:0/3348553069 conn(0x7f7e700ccaa0 msgr2=0x7f7e700cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:02.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.387+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 shutdown_connections 2024-09-17T05:42:02.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.387+0000 7f7e77200640 1 -- 172.21.15.44:0/3348553069 wait complete. 2024-09-17T05:42:02.425 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:02.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.583+0000 7fb4f6000640 1 -- 172.21.15.44:0/1660530443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f006de50 msgr2=0x7fb4f006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.583+0000 7fb4f6000640 1 --2- 172.21.15.44:0/1660530443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f006de50 0x7fb4f006e260 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00ca7b0 tx=0x7fb4d801c830 comp rx=0 tx=0).stop 2024-09-17T05:42:02.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 -- 172.21.15.44:0/1660530443 shutdown_connections 2024-09-17T05:42:02.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 --2- 172.21.15.44:0/1660530443 >> v2:172.21.15.86:3300/0 conn(0x7fb4f00cb470 0x7fb4f00cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 --2- 172.21.15.44:0/1660530443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f006de50 0x7fb4f006e260 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 -- 172.21.15.44:0/1660530443 >> 172.21.15.44:0/1660530443 conn(0x7fb4f00ccaa0 msgr2=0x7fb4f00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:02.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 -- 172.21.15.44:0/1660530443 shutdown_connections 2024-09-17T05:42:02.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 -- 172.21.15.44:0/1660530443 wait complete. 2024-09-17T05:42:02.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 Processor -- start 2024-09-17T05:42:02.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.587+0000 7fb4f6000640 1 -- start start 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4f006de50 0x7fb4f0153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4f0072e50 0x7fb4f0157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f00cb470 0x7fb4f01582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0168ed0 con 0x7fb4f00cb470 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0168d50 con 0x7fb4f006de50 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f0169050 con 0x7fb4f0072e50 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f00cb470 0x7fb4f01582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f00cb470 0x7fb4f01582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47428/0 (socket says 172.21.15.44:47428) 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 -- 172.21.15.44:0/2428503991 learned_addr learned my addr 172.21.15.44:0/2428503991 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4ef400640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4f006de50 0x7fb4f0153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4e7e00640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4f0072e50 0x7fb4f0157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 -- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4f0072e50 msgr2=0x7fb4f0157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4f0072e50 0x7fb4f0157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 -- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4f006de50 msgr2=0x7fb4f0153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4f006de50 0x7fb4f0153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 -- 172.21.15.44:0/2428503991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00b09b0 con 0x7fb4f00cb470 2024-09-17T05:42:02.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4ef400640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4f006de50 0x7fb4f0153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:02.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4efe00640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f00cb470 0x7fb4f01582a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800ea80 tx=0x7fb4e800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:02.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4e7400640 1 -- 172.21.15.44:0/2428503991 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8004b30 con 0x7fb4f00cb470 2024-09-17T05:42:02.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4e7400640 1 -- 172.21.15.44:0/2428503991 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4e8004cf0 con 0x7fb4f00cb470 2024-09-17T05:42:02.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4e7400640 1 -- 172.21.15.44:0/2428503991 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8005280 con 0x7fb4f00cb470 2024-09-17T05:42:02.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f00b3920 con 0x7fb4f00cb470 2024-09-17T05:42:02.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f00c7320 con 0x7fb4f00cb470 2024-09-17T05:42:02.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.591+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f006e260 con 0x7fb4f00cb470 2024-09-17T05:42:02.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.595+0000 7fb4e7400640 1 -- 172.21.15.44:0/2428503991 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb4e8005420 con 0x7fb4f00cb470 2024-09-17T05:42:02.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.595+0000 7fb4e7400640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4cc073230 0x7fb4cc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.595+0000 7fb4e7400640 1 -- 172.21.15.44:0/2428503991 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6101+0+0 (secure 0 0 0) 0x7fb4e80953b0 con 0x7fb4f00cb470 2024-09-17T05:42:02.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.595+0000 7fb4ef400640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4cc073230 0x7fb4cc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.595+0000 7fb4ef400640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4cc073230 0x7fb4cc075740 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0007fd0 tx=0x7fb4e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:02.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.599+0000 7fb4e7400640 1 -- 172.21.15.44:0/2428503991 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb4e805fc50 con 0x7fb4f00cb470 2024-09-17T05:42:02.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.771+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4f00b5bc0 con 0x7fb4f00cb470 2024-09-17T05:42:02.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4e7400640 1 -- 172.21.15.44:0/2428503991 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16958 (secure 0 0 0) 0x7fb4e8064680 con 0x7fb4f00cb470 2024-09-17T05:42:02.776 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:02.777 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:42:01.792370+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:59.546897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:00.752532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4cc073230 msgr2=0x7fb4cc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4cc073230 0x7fb4cc075740 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0007fd0 tx=0x7fb4e0009040 comp rx=0 tx=0).stop 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f00cb470 msgr2=0x7fb4f01582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f00cb470 0x7fb4f01582a0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800ea80 tx=0x7fb4e800ef40 comp rx=0 tx=0).stop 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 shutdown_connections 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb4f00cb470 0x7fb4f01582a0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb4f0072e50 0x7fb4f0157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4cc073230 0x7fb4cc075740 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 --2- 172.21.15.44:0/2428503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4f006de50 0x7fb4f0153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 >> 172.21.15.44:0/2428503991 conn(0x7fb4f00ccaa0 msgr2=0x7fb4f0154980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 shutdown_connections 2024-09-17T05:42:02.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.775+0000 7fb4f6000640 1 -- 172.21.15.44:0/2428503991 wait complete. 2024-09-17T05:42:02.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 -- 172.21.15.44:0/2223702692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e00cb470 msgr2=0x7f04e00cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 --2- 172.21.15.44:0/2223702692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e00cb470 0x7f04e00cb880 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009c80 tx=0x7f04d801cd10 comp rx=0 tx=0).stop 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 -- 172.21.15.44:0/2223702692 shutdown_connections 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 --2- 172.21.15.44:0/2223702692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e00cb470 0x7f04e00cb880 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 --2- 172.21.15.44:0/2223702692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e006de50 0x7f04e006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 -- 172.21.15.44:0/2223702692 >> 172.21.15.44:0/2223702692 conn(0x7f04e00ccaa0 msgr2=0x7f04e00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 -- 172.21.15.44:0/2223702692 shutdown_connections 2024-09-17T05:42:02.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.955+0000 7f04e4e00640 1 -- 172.21.15.44:0/2223702692 wait complete. 2024-09-17T05:42:02.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 Processor -- start 2024-09-17T05:42:02.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 -- start start 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e006de50 0x7f04e01fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e0072e50 0x7f04e01653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e00cb470 0x7f04e014b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04e0168ff0 con 0x7f04e0072e50 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04e0168e70 con 0x7f04e006de50 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f04e0169170 con 0x7f04e00cb470 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e0072e50 0x7f04e01653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e0072e50 0x7f04e01653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47434/0 (socket says 172.21.15.44:47434) 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 -- 172.21.15.44:0/1547354104 learned_addr learned my addr 172.21.15.44:0/1547354104 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04de800640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e00cb470 0x7f04e014b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dde00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e006de50 0x7f04e01fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 -- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e00cb470 msgr2=0x7f04e014b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e00cb470 0x7f04e014b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 -- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e006de50 msgr2=0x7f04e01fcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e006de50 0x7f04e01fcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 -- 172.21.15.44:0/1547354104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e00af9a0 con 0x7f04e0072e50 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04dd400640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e0072e50 0x7f04e01653a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d720 tx=0x7f04cc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04d6000640 1 -- 172.21.15.44:0/1547354104 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc017070 con 0x7f04e0072e50 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04d6000640 1 -- 172.21.15.44:0/1547354104 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04cc004310 con 0x7f04e0072e50 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04d6000640 1 -- 172.21.15.44:0/1547354104 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc005280 con 0x7f04e0072e50 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.959+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e00afc80 con 0x7f04e0072e50 2024-09-17T05:42:02.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.963+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e00b0240 con 0x7f04e0072e50 2024-09-17T05:42:02.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.963+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e006e260 con 0x7f04e0072e50 2024-09-17T05:42:02.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.963+0000 7f04d6000640 1 -- 172.21.15.44:0/1547354104 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f04cc005420 con 0x7f04e0072e50 2024-09-17T05:42:02.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.963+0000 7f04d6000640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04c0073200 0x7f04c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:02.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.963+0000 7f04d6000640 1 -- 172.21.15.44:0/1547354104 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6101+0+0 (secure 0 0 0) 0x7f04cc094810 con 0x7f04e0072e50 2024-09-17T05:42:02.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.963+0000 7f04dde00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04c0073200 0x7f04c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:02.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.967+0000 7f04dde00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04c0073200 0x7f04c0075710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000f70 tx=0x7f04d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:02.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:02.967+0000 7f04d6000640 1 -- 172.21.15.44:0/1547354104 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f04cc020020 con 0x7f04e0072e50 2024-09-17T05:42:03.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.143+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04e00b5fa0 con 0x7f04e0072e50 2024-09-17T05:42:03.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.143+0000 7f04d6000640 1 -- 172.21.15.44:0/1547354104 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16958 (secure 0 0 0) 0x7f04cc05f600 con 0x7f04e0072e50 2024-09-17T05:42:03.146 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:03.147 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:42:01.792370+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:59.546897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:00.752532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04c0073200 msgr2=0x7f04c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04c0073200 0x7f04c0075710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000f70 tx=0x7f04d0009040 comp rx=0 tx=0).stop 2024-09-17T05:42:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e0072e50 msgr2=0x7f04e01653a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e0072e50 0x7f04e01653a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00d720 tx=0x7f04cc00dbe0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 shutdown_connections 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f04e00cb470 0x7f04e014b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04e0072e50 0x7f04e01653a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f04c0073200 0x7f04c0075710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 --2- 172.21.15.44:0/1547354104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04e006de50 0x7f04e01fcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 >> 172.21.15.44:0/1547354104 conn(0x7f04e00ccaa0 msgr2=0x7f04e015a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 shutdown_connections 2024-09-17T05:42:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.147+0000 7f04e4e00640 1 -- 172.21.15.44:0/1547354104 wait complete. 2024-09-17T05:42:03.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:42:03.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 -- 172.21.15.44:0/1730605482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04072e50 msgr2=0x7fea0415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 --2- 172.21.15.44:0/1730605482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04072e50 0x7fea0415e990 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009900 tx=0x7fe9f401c850 comp rx=0 tx=0).stop 2024-09-17T05:42:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 -- 172.21.15.44:0/1730605482 shutdown_connections 2024-09-17T05:42:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 --2- 172.21.15.44:0/1730605482 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea0406de50 0x7fea0406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 --2- 172.21.15.44:0/1730605482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea04072e50 0x7fea0415e990 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 -- 172.21.15.44:0/1730605482 >> 172.21.15.44:0/1730605482 conn(0x7fea040ccaa0 msgr2=0x7fea040cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 -- 172.21.15.44:0/1730605482 shutdown_connections 2024-09-17T05:42:03.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 -- 172.21.15.44:0/1730605482 wait complete. 2024-09-17T05:42:03.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 Processor -- start 2024-09-17T05:42:03.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.331+0000 7fea08e00640 1 -- start start 2024-09-17T05:42:03.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea0406de50 0x7fea04154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea04072e50 0x7fea04155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea040ced00 0x7fea04155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fea041694b0 con 0x7fea0406de50 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fea04169330 con 0x7fea04072e50 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fea04169630 con 0x7fea040ced00 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea0406de50 0x7fea04154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea0406de50 0x7fea04154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47462/0 (socket says 172.21.15.44:47462) 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 -- 172.21.15.44:0/3285356903 learned_addr learned my addr 172.21.15.44:0/3285356903 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fe9fbe00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea04072e50 0x7fea04155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea02800640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea040ced00 0x7fea04155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 -- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea040ced00 msgr2=0x7fea04155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:03.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea040ced00 0x7fea04155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 -- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea04072e50 msgr2=0x7fea04155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea04072e50 0x7fea04155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 -- 172.21.15.44:0/3285356903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea041f9930 con 0x7fea0406de50 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea01e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea0406de50 0x7fea04154a20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40b0040 tx=0x7fe9f40a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fe9fa000640 1 -- 172.21.15.44:0/3285356903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40ba020 con 0x7fea0406de50 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fe9fa000640 1 -- 172.21.15.44:0/3285356903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9f40043b0 con 0x7fea0406de50 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea041f9c10 con 0x7fea0406de50 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fe9fa000640 1 -- 172.21.15.44:0/3285356903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40b2040 con 0x7fea0406de50 2024-09-17T05:42:03.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea041fa1d0 con 0x7fea0406de50 2024-09-17T05:42:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.335+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0406e260 con 0x7fea0406de50 2024-09-17T05:42:03.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.339+0000 7fe9fa000640 1 -- 172.21.15.44:0/3285356903 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe9f4005270 con 0x7fea0406de50 2024-09-17T05:42:03.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.339+0000 7fe9fa000640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe9e0073230 0x7fe9e0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:03.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.339+0000 7fe9fa000640 1 -- 172.21.15.44:0/3285356903 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6101+0+0 (secure 0 0 0) 0x7fe9f412e140 con 0x7fea0406de50 2024-09-17T05:42:03.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.339+0000 7fe9fbe00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe9e0073230 0x7fe9e0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:03.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.339+0000 7fe9fbe00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe9e0073230 0x7fe9e0075740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea04156290 tx=0x7fe9ec0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:03.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.343+0000 7fe9fa000640 1 -- 172.21.15.44:0/3285356903 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe9f40c4060 con 0x7fea0406de50 2024-09-17T05:42:03.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:03.559+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fea040b5fa0 con 0x7fea0406de50 2024-09-17T05:42:04.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.387+0000 7fe9fa000640 1 -- 172.21.15.44:0/3285356903 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) ==== 118+0+0 (secure 0 0 0) 0x7fe9f40164d0 con 0x7fea0406de50 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe9e0073230 msgr2=0x7fe9e0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe9e0073230 0x7fe9e0075740 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fea04156290 tx=0x7fe9ec0091e0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea0406de50 msgr2=0x7fea04154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea0406de50 0x7fea04154a20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40b0040 tx=0x7fe9f40a5620 comp rx=0 tx=0).stop 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 shutdown_connections 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fea040ced00 0x7fea04155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe9e0073230 0x7fe9e0075740 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea04072e50 0x7fea04155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 --2- 172.21.15.44:0/3285356903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fea0406de50 0x7fea04154a20 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 >> 172.21.15.44:0/3285356903 conn(0x7fea040ccaa0 msgr2=0x7fea0415f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 shutdown_connections 2024-09-17T05:42:04.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.391+0000 7fea08e00640 1 -- 172.21.15.44:0/3285356903 wait complete. 2024-09-17T05:42:04.418 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:42:04.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:42:04.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 -- 172.21.15.44:0/1398302970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc0cb470 msgr2=0x7f0edc0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 --2- 172.21.15.44:0/1398302970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc0cb470 0x7f0edc0cb880 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009bc0 tx=0x7f0ed401cb10 comp rx=0 tx=0).stop 2024-09-17T05:42:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 -- 172.21.15.44:0/1398302970 shutdown_connections 2024-09-17T05:42:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 --2- 172.21.15.44:0/1398302970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc0cb470 0x7f0edc0cb880 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 --2- 172.21.15.44:0/1398302970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0edc06de50 0x7f0edc06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 -- 172.21.15.44:0/1398302970 >> 172.21.15.44:0/1398302970 conn(0x7f0edc0ccaa0 msgr2=0x7f0edc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 -- 172.21.15.44:0/1398302970 shutdown_connections 2024-09-17T05:42:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.583+0000 7f0ee2000640 1 -- 172.21.15.44:0/1398302970 wait complete. 2024-09-17T05:42:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 Processor -- start 2024-09-17T05:42:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 -- start start 2024-09-17T05:42:04.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc06de50 0x7f0edc1f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:04.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0edc072e50 0x7f0edc1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:04.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0edc0cb470 0x7f0edc0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:04.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc168ff0 con 0x7f0edc0cb470 2024-09-17T05:42:04.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0edc168e70 con 0x7f0edc06de50 2024-09-17T05:42:04.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0edc169170 con 0x7f0edc072e50 2024-09-17T05:42:04.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0edc0cb470 0x7f0edc0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0edc0cb470 0x7f0edc0c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47478/0 (socket says 172.21.15.44:47478) 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 -- 172.21.15.44:0/419892992 learned_addr learned my addr 172.21.15.44:0/419892992 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ed3e00640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0edc072e50 0x7f0edc1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edb400640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc06de50 0x7f0edc1f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 -- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0edc072e50 msgr2=0x7f0edc1f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0edc072e50 0x7f0edc1f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 -- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc06de50 msgr2=0x7f0edc1f79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc06de50 0x7f0edc1f79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 -- 172.21.15.44:0/419892992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0edc0b4110 con 0x7f0edc0cb470 2024-09-17T05:42:04.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0edbe00640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0edc0cb470 0x7f0edc0c9260 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a740 tx=0x7f0ed4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ed3400640 1 -- 172.21.15.44:0/419892992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40bb070 con 0x7f0edc0cb470 2024-09-17T05:42:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ed3400640 1 -- 172.21.15.44:0/419892992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ed4004d40 con 0x7f0edc0cb470 2024-09-17T05:42:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0edc0b43f0 con 0x7f0edc0cb470 2024-09-17T05:42:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ed3400640 1 -- 172.21.15.44:0/419892992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40b2040 con 0x7f0edc0cb470 2024-09-17T05:42:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.587+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0edc0b49b0 con 0x7f0edc0cb470 2024-09-17T05:42:04.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.591+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0edc06e260 con 0x7f0edc0cb470 2024-09-17T05:42:04.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.591+0000 7f0ed3400640 1 -- 172.21.15.44:0/419892992 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0ed40be070 con 0x7f0edc0cb470 2024-09-17T05:42:04.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.591+0000 7f0ed3400640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0eb8073200 0x7f0eb8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:04.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.591+0000 7f0ed3400640 1 -- 172.21.15.44:0/419892992 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f0ed412df10 con 0x7f0edc0cb470 2024-09-17T05:42:04.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.591+0000 7f0edb400640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0eb8073200 0x7f0eb8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:04.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.595+0000 7f0edb400640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0eb8073200 0x7f0eb8075710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc001400 tx=0x7f0ecc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:04.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.595+0000 7f0ed3400640 1 -- 172.21.15.44:0/419892992 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0ed4016790 con 0x7f0edc0cb470 2024-09-17T05:42:04.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:04.803+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0edc0b5fa0 con 0x7f0edc0cb470 2024-09-17T05:42:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ed3400640 1 -- 172.21.15.44:0/419892992 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) ==== 122+0+0 (secure 0 0 0) 0x7f0ed40f8d80 con 0x7f0edc0cb470 2024-09-17T05:42:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0eb8073200 msgr2=0x7f0eb8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0eb8073200 0x7f0eb8075710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc001400 tx=0x7f0ecc009040 comp rx=0 tx=0).stop 2024-09-17T05:42:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0edc0cb470 msgr2=0x7f0edc0c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0edc0cb470 0x7f0edc0c9260 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401a740 tx=0x7f0ed4003f60 comp rx=0 tx=0).stop 2024-09-17T05:42:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 shutdown_connections 2024-09-17T05:42:05.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0edc0cb470 0x7f0edc0c9260 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0edc072e50 0x7f0edc1f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0eb8073200 0x7f0eb8075710 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 --2- 172.21.15.44:0/419892992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0edc06de50 0x7f0edc1f79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 >> 172.21.15.44:0/419892992 conn(0x7f0edc0ccaa0 msgr2=0x7f0edc0a0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:05.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.391+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 shutdown_connections 2024-09-17T05:42:05.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.395+0000 7f0ee2000640 1 -- 172.21.15.44:0/419892992 wait complete. 2024-09-17T05:42:05.418 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:42:05.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:05.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 -- 172.21.15.44:0/489301054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af8156b90 msgr2=0x7f9af80cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 --2- 172.21.15.44:0/489301054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af8156b90 0x7f9af80cc7f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f9af80cd2f0 tx=0x7f9ae801c5b0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 -- 172.21.15.44:0/489301054 shutdown_connections 2024-09-17T05:42:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 --2- 172.21.15.44:0/489301054 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af8073050 0x7f9af8143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 --2- 172.21.15.44:0/489301054 >> v2:172.21.15.86:3300/0 conn(0x7f9af80ccd30 0x7f9af8072b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 --2- 172.21.15.44:0/489301054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af8156b90 0x7f9af80cc7f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 -- 172.21.15.44:0/489301054 >> 172.21.15.44:0/489301054 conn(0x7f9af80d2450 msgr2=0x7f9af80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 -- 172.21.15.44:0/489301054 shutdown_connections 2024-09-17T05:42:05.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.575+0000 7f9af7200640 1 -- 172.21.15.44:0/489301054 wait complete. 2024-09-17T05:42:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 Processor -- start 2024-09-17T05:42:05.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 -- start start 2024-09-17T05:42:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af8073050 0x7f9af815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af80ccd30 0x7f9af80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af8156b90 0x7f9af81554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9af8160930 con 0x7f9af80ccd30 2024-09-17T05:42:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9af81607b0 con 0x7f9af8156b90 2024-09-17T05:42:05.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af7200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9af8160ab0 con 0x7f9af8073050 2024-09-17T05:42:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af80ccd30 0x7f9af80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af80ccd30 0x7f9af80c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47498/0 (socket says 172.21.15.44:47498) 2024-09-17T05:42:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 -- 172.21.15.44:0/2745531333 learned_addr learned my addr 172.21.15.44:0/2745531333 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af5e00640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af8073050 0x7f9af815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9af6800640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af8156b90 0x7f9af81554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 -- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af8073050 msgr2=0x7f9af815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af8073050 0x7f9af815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 -- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af8156b90 msgr2=0x7f9af81554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af8156b90 0x7f9af81554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.579+0000 7f9aed400640 1 -- 172.21.15.44:0/2745531333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af8152cf0 con 0x7f9af80ccd30 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9aed400640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af80ccd30 0x7f9af80c6d30 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000d720 tx=0x7f9ae000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9aeea00640 1 -- 172.21.15.44:0/2745531333 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0017070 con 0x7f9af80ccd30 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9aeea00640 1 -- 172.21.15.44:0/2745531333 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ae0009d20 con 0x7f9af80ccd30 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9aeea00640 1 -- 172.21.15.44:0/2745531333 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00106c0 con 0x7f9af80ccd30 2024-09-17T05:42:05.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af815fa40 con 0x7f9af80ccd30 2024-09-17T05:42:05.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af815ed00 con 0x7f9af80ccd30 2024-09-17T05:42:05.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af8072b10 con 0x7f9af80ccd30 2024-09-17T05:42:05.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9aeea00640 1 -- 172.21.15.44:0/2745531333 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ae001a070 con 0x7f9af80ccd30 2024-09-17T05:42:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9aeea00640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ad4073230 0x7f9ad4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.583+0000 7f9aeea00640 1 -- 172.21.15.44:0/2745531333 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f9ae00945b0 con 0x7f9af80ccd30 2024-09-17T05:42:05.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.587+0000 7f9af5e00640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ad4073230 0x7f9ad4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.587+0000 7f9af5e00640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ad4073230 0x7f9ad4075740 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80ae000 tx=0x7f9ae801adf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.587+0000 7f9aeea00640 1 -- 172.21.15.44:0/2745531333 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9ae005ed50 con 0x7f9af80ccd30 2024-09-17T05:42:05.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9af815c4b0 con 0x7f9af80ccd30 2024-09-17T05:42:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9aeea00640 1 -- 172.21.15.44:0/2745531333 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5222 (secure 0 0 0) 0x7f9ae0063780 con 0x7f9af80ccd30 2024-09-17T05:42:05.800 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:05.800 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"btime":"2024-09-17T05:42:05:393879+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:04.810540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6700":{"gid":6700,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3305866275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3305866275},{"type":"v1","addr":"172.21.15.44:6835","nonce":3305866275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6700,"qdb_cluster":[6700]},"id":6}]} 2024-09-17T05:42:05.800 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-17T05:42:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ad4073230 msgr2=0x7f9ad4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ad4073230 0x7f9ad4075740 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80ae000 tx=0x7f9ae801adf0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af80ccd30 msgr2=0x7f9af80c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af80ccd30 0x7f9af80c6d30 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000d720 tx=0x7f9ae000dbe0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 shutdown_connections 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9ad4073230 0x7f9ad4075740 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9af8156b90 0x7f9af81554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9af80ccd30 0x7f9af80c6d30 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 --2- 172.21.15.44:0/2745531333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9af8073050 0x7f9af815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 >> 172.21.15.44:0/2745531333 conn(0x7f9af80d2450 msgr2=0x7f9af81533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 shutdown_connections 2024-09-17T05:42:05.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.799+0000 7f9af7200640 1 -- 172.21.15.44:0/2745531333 wait complete. 2024-09-17T05:42:05.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.979+0000 7f9f6da00640 1 -- 172.21.15.44:0/429092532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680d18f0 msgr2=0x7f9f680b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.979+0000 7f9f6da00640 1 --2- 172.21.15.44:0/429092532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680d18f0 0x7f9f680b1be0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9f58009840 tx=0x7f9f5801c760 comp rx=0 tx=0).stop 2024-09-17T05:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.979+0000 7f9f6da00640 1 -- 172.21.15.44:0/429092532 shutdown_connections 2024-09-17T05:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.979+0000 7f9f6da00640 1 --2- 172.21.15.44:0/429092532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680d18f0 0x7f9f680b1be0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.979+0000 7f9f6da00640 1 -- 172.21.15.44:0/429092532 >> 172.21.15.44:0/429092532 conn(0x7f9f680b4240 msgr2=0x7f9f680b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.979+0000 7f9f6da00640 1 -- 172.21.15.44:0/429092532 shutdown_connections 2024-09-17T05:42:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.979+0000 7f9f6da00640 1 -- 172.21.15.44:0/429092532 wait complete. 2024-09-17T05:42:05.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 Processor -- start 2024-09-17T05:42:05.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 -- start start 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f680d18f0 0x7f9f680b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f680d1d00 0x7f9f680b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680cc2e0 0x7f9f680b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6816aff0 con 0x7f9f680cc2e0 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6816ae70 con 0x7f9f680d1d00 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f6da00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6816b170 con 0x7f9f680d18f0 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f67400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680cc2e0 0x7f9f680b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f66a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f680d18f0 0x7f9f680b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f67400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680cc2e0 0x7f9f680b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47508/0 (socket says 172.21.15.44:47508) 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.983+0000 7f9f67400640 1 -- 172.21.15.44:0/4170109883 learned_addr learned my addr 172.21.15.44:0/4170109883 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f66000640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f680d1d00 0x7f9f680b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f67400640 1 -- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f680d18f0 msgr2=0x7f9f680b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f67400640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f680d18f0 0x7f9f680b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f67400640 1 -- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f680d1d00 msgr2=0x7f9f680b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f67400640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f680d1d00 0x7f9f680b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f67400640 1 -- 172.21.15.44:0/4170109883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f68156490 con 0x7f9f680cc2e0 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f66000640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f680d1d00 0x7f9f680b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f66a00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f680d18f0 0x7f9f680b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f67400640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680cc2e0 0x7f9f680b62c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000c760 tx=0x7f9f6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f5ea00640 1 -- 172.21.15.44:0/4170109883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60003b80 con 0x7f9f680cc2e0 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f5ea00640 1 -- 172.21.15.44:0/4170109883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f60003d20 con 0x7f9f680cc2e0 2024-09-17T05:42:05.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f5ea00640 1 -- 172.21.15.44:0/4170109883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000aab0 con 0x7f9f680cc2e0 2024-09-17T05:42:05.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f680b7680 con 0x7f9f680cc2e0 2024-09-17T05:42:05.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f680b68c0 con 0x7f9f680cc2e0 2024-09-17T05:42:05.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f680b5140 con 0x7f9f680cc2e0 2024-09-17T05:42:05.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.987+0000 7f9f5ea00640 1 -- 172.21.15.44:0/4170109883 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9f6000ac50 con 0x7f9f680cc2e0 2024-09-17T05:42:05.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.991+0000 7f9f5ea00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f48073200 0x7f9f48075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:05.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.991+0000 7f9f5ea00640 1 -- 172.21.15.44:0/4170109883 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f9f60094120 con 0x7f9f680cc2e0 2024-09-17T05:42:05.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.991+0000 7f9f66a00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f48073200 0x7f9f48075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:05.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.991+0000 7f9f66a00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f48073200 0x7f9f48075710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9f580af000 tx=0x7f9f5801afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:05.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:05.995+0000 7f9f5ea00640 1 -- 172.21.15.44:0/4170109883 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9f680b5140 con 0x7f9f680cc2e0 2024-09-17T05:42:06.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.171+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f680b1be0 con 0x7f9f680cc2e0 2024-09-17T05:42:06.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.171+0000 7f9f5ea00640 1 -- 172.21.15.44:0/4170109883 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16945 (secure 0 0 0) 0x7f9f6005ef10 con 0x7f9f680cc2e0 2024-09-17T05:42:06.173 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:06.173 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:42:03.373222+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:59.546897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:00.752532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:42:06.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.171+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f48073200 msgr2=0x7f9f48075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.171+0000 7f9f6da00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f48073200 0x7f9f48075710 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9f580af000 tx=0x7f9f5801afa0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680cc2e0 msgr2=0x7f9f680b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680cc2e0 0x7f9f680b62c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000c760 tx=0x7f9f6000cc20 comp rx=0 tx=0).stop 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 shutdown_connections 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9f680cc2e0 0x7f9f680b62c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9f48073200 0x7f9f48075710 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f680d1d00 0x7f9f680b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 --2- 172.21.15.44:0/4170109883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9f680d18f0 0x7f9f680b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 >> 172.21.15.44:0/4170109883 conn(0x7f9f680b4240 msgr2=0x7f9f680d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 shutdown_connections 2024-09-17T05:42:06.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.175+0000 7f9f6da00640 1 -- 172.21.15.44:0/4170109883 wait complete. 2024-09-17T05:42:06.196 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:42:06.197 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:06.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 -- 172.21.15.44:0/3761682910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 msgr2=0x7ffad4166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 --2- 172.21.15.44:0/3761682910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad4166480 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009bc0 tx=0x7ffacc01cb10 comp rx=0 tx=0).stop 2024-09-17T05:42:06.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 -- 172.21.15.44:0/3761682910 shutdown_connections 2024-09-17T05:42:06.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 --2- 172.21.15.44:0/3761682910 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad4166480 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 -- 172.21.15.44:0/3761682910 >> 172.21.15.44:0/3761682910 conn(0x7ffad40ccaa0 msgr2=0x7ffad40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 -- 172.21.15.44:0/3761682910 shutdown_connections 2024-09-17T05:42:06.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 -- 172.21.15.44:0/3761682910 wait complete. 2024-09-17T05:42:06.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 Processor -- start 2024-09-17T05:42:06.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.355+0000 7ffadaa00640 1 -- start start 2024-09-17T05:42:06.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffad406de50 0x7ffad40a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffad4072e50 0x7ffad4158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad40c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4169fe0 con 0x7ffad40cc480 2024-09-17T05:42:06.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4169e60 con 0x7ffad406de50 2024-09-17T05:42:06.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ffad416a160 con 0x7ffad4072e50 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad40c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad40c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47532/0 (socket says 172.21.15.44:47532) 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 -- 172.21.15.44:0/2406964037 learned_addr learned my addr 172.21.15.44:0/2406964037 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad3e00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffad406de50 0x7ffad40a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 -- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffad4072e50 msgr2=0x7ffad4158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffacbe00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffad4072e50 0x7ffad4158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffad4072e50 0x7ffad4158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 -- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffad406de50 msgr2=0x7ffad40a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffad406de50 0x7ffad40a00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 -- 172.21.15.44:0/2406964037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad40aeea0 con 0x7ffad40cc480 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffacbe00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffad4072e50 0x7ffad4158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad3e00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffad406de50 0x7ffad40a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:06.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad8a00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad40c7800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ffacc019720 tx=0x7ffacc0a5b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad0c00640 1 -- 172.21.15.44:0/2406964037 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0b2040 con 0x7ffad40cc480 2024-09-17T05:42:06.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad0c00640 1 -- 172.21.15.44:0/2406964037 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffacc004c50 con 0x7ffad40cc480 2024-09-17T05:42:06.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffad0c00640 1 -- 172.21.15.44:0/2406964037 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0040c0 con 0x7ffad40cc480 2024-09-17T05:42:06.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad4159490 con 0x7ffad40cc480 2024-09-17T05:42:06.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad409fbc0 con 0x7ffad40cc480 2024-09-17T05:42:06.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.359+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad415e990 con 0x7ffad40cc480 2024-09-17T05:42:06.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.363+0000 7ffad0c00640 1 -- 172.21.15.44:0/2406964037 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffacc004260 con 0x7ffad40cc480 2024-09-17T05:42:06.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.363+0000 7ffad0c00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffab0073200 0x7ffab0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.363+0000 7ffad0c00640 1 -- 172.21.15.44:0/2406964037 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7ffacc12ead0 con 0x7ffad40cc480 2024-09-17T05:42:06.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.363+0000 7ffad3e00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffab0073200 0x7ffab0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.363+0000 7ffad3e00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffab0073200 0x7ffab0075710 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000f70 tx=0x7ffac4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.367+0000 7ffad0c00640 1 -- 172.21.15.44:0/2406964037 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ffacc016790 con 0x7ffad40cc480 2024-09-17T05:42:06.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.543+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffad40aec50 con 0x7ffab0073200 2024-09-17T05:42:06.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.547+0000 7ffad0c00640 1 -- 172.21.15.44:0/2406964037 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252066 (secure 0 0 0) 0x7ffad40aec50 con 0x7ffab0073200 2024-09-17T05:42:06.553 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:06.555 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:42:06.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffab0073200 msgr2=0x7ffab0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffab0073200 0x7ffab0075710 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000f70 tx=0x7ffac4009040 comp rx=0 tx=0).stop 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 msgr2=0x7ffad40c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad40c7800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ffacc019720 tx=0x7ffacc0a5b60 comp rx=0 tx=0).stop 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 shutdown_connections 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad40cc480 0x7ffad40c7800 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffad4072e50 0x7ffad4158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffab0073200 0x7ffab0075710 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 --2- 172.21.15.44:0/2406964037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffad406de50 0x7ffad40a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 >> 172.21.15.44:0/2406964037 conn(0x7ffad40ccaa0 msgr2=0x7ffad415eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 shutdown_connections 2024-09-17T05:42:06.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.551+0000 7ffadaa00640 1 -- 172.21.15.44:0/2406964037 wait complete. 2024-09-17T05:42:06.574 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-17T05:42:06.356120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259344,"kb_used_data":9820,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715376,"statfs":{"total":773094113280,"available":772828545024,"internally_reserved":0,"allocated":10055680,"data_stored":5212640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001631"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.407019+0000","last_change":"2024-09-17T05:42:02.400764+0000","last_active":"2024-09-17T05:42:02.407019+0000","last_peered":"2024-09-17T05:42:02.407019+0000","last_clean":"2024-09-17T05:42:02.407019+0000","last_became_active":"2024-09-17T05:42:02.400454+0000","last_became_peered":"2024-09-17T05:42:02.400454+0000","last_unstale":"2024-09-17T05:42:02.407019+0000","last_undegraded":"2024-09-17T05:42:02.407019+0000","last_fullsized":"2024-09-17T05:42:02.407019+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:14.797272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379931+0000","last_change":"2024-09-17T05:42:02.399722+0000","last_active":"2024-09-17T05:42:03.379931+0000","last_peered":"2024-09-17T05:42:03.379931+0000","last_clean":"2024-09-17T05:42:03.379931+0000","last_became_active":"2024-09-17T05:42:02.398906+0000","last_became_peered":"2024-09-17T05:42:02.398906+0000","last_unstale":"2024-09-17T05:42:03.379931+0000","last_undegraded":"2024-09-17T05:42:03.379931+0000","last_fullsized":"2024-09-17T05:42:03.379931+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.925335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462788+0000","last_change":"2024-09-17T05:42:02.382411+0000","last_active":"2024-09-17T05:42:03.462788+0000","last_peered":"2024-09-17T05:42:03.462788+0000","last_clean":"2024-09-17T05:42:03.462788+0000","last_became_active":"2024-09-17T05:42:02.382113+0000","last_became_peered":"2024-09-17T05:42:02.382113+0000","last_unstale":"2024-09-17T05:42:03.462788+0000","last_undegraded":"2024-09-17T05:42:03.462788+0000","last_fullsized":"2024-09-17T05:42:03.462788+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:30.661954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460985+0000","last_change":"2024-09-17T05:42:02.399644+0000","last_active":"2024-09-17T05:42:03.460985+0000","last_peered":"2024-09-17T05:42:03.460985+0000","last_clean":"2024-09-17T05:42:03.460985+0000","last_became_active":"2024-09-17T05:42:02.399084+0000","last_became_peered":"2024-09-17T05:42:02.399084+0000","last_unstale":"2024-09-17T05:42:03.460985+0000","last_undegraded":"2024-09-17T05:42:03.460985+0000","last_fullsized":"2024-09-17T05:42:03.460985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:42.676603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378310+0000","last_change":"2024-09-17T05:42:02.384046+0000","last_active":"2024-09-17T05:42:03.378310+0000","last_peered":"2024-09-17T05:42:03.378310+0000","last_clean":"2024-09-17T05:42:03.378310+0000","last_became_active":"2024-09-17T05:42:02.383740+0000","last_became_peered":"2024-09-17T05:42:02.383740+0000","last_unstale":"2024-09-17T05:42:03.378310+0000","last_undegraded":"2024-09-17T05:42:03.378310+0000","last_fullsized":"2024-09-17T05:42:03.378310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:15.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377498+0000","last_change":"2024-09-17T05:42:02.388254+0000","last_active":"2024-09-17T05:42:03.377498+0000","last_peered":"2024-09-17T05:42:03.377498+0000","last_clean":"2024-09-17T05:42:03.377498+0000","last_became_active":"2024-09-17T05:42:02.387915+0000","last_became_peered":"2024-09-17T05:42:02.387915+0000","last_unstale":"2024-09-17T05:42:03.377498+0000","last_undegraded":"2024-09-17T05:42:03.377498+0000","last_fullsized":"2024-09-17T05:42:03.377498+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.919705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379390+0000","last_change":"2024-09-17T05:42:02.402123+0000","last_active":"2024-09-17T05:42:03.379390+0000","last_peered":"2024-09-17T05:42:03.379390+0000","last_clean":"2024-09-17T05:42:03.379390+0000","last_became_active":"2024-09-17T05:42:02.398914+0000","last_became_peered":"2024-09-17T05:42:02.398914+0000","last_unstale":"2024-09-17T05:42:03.379390+0000","last_undegraded":"2024-09-17T05:42:03.379390+0000","last_fullsized":"2024-09-17T05:42:03.379390+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:24.581599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377308+0000","last_change":"2024-09-17T05:42:02.379375+0000","last_active":"2024-09-17T05:42:03.377308+0000","last_peered":"2024-09-17T05:42:03.377308+0000","last_clean":"2024-09-17T05:42:03.377308+0000","last_became_active":"2024-09-17T05:42:02.379113+0000","last_became_peered":"2024-09-17T05:42:02.379113+0000","last_unstale":"2024-09-17T05:42:03.377308+0000","last_undegraded":"2024-09-17T05:42:03.377308+0000","last_fullsized":"2024-09-17T05:42:03.377308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.479554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379637+0000","last_change":"2024-09-17T05:42:02.413970+0000","last_active":"2024-09-17T05:42:03.379637+0000","last_peered":"2024-09-17T05:42:03.379637+0000","last_clean":"2024-09-17T05:42:03.379637+0000","last_became_active":"2024-09-17T05:42:02.412028+0000","last_became_peered":"2024-09-17T05:42:02.412028+0000","last_unstale":"2024-09-17T05:42:03.379637+0000","last_undegraded":"2024-09-17T05:42:03.379637+0000","last_fullsized":"2024-09-17T05:42:03.379637+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:37.768137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462839+0000","last_change":"2024-09-17T05:42:02.396648+0000","last_active":"2024-09-17T05:42:03.462839+0000","last_peered":"2024-09-17T05:42:03.462839+0000","last_clean":"2024-09-17T05:42:03.462839+0000","last_became_active":"2024-09-17T05:42:02.396322+0000","last_became_peered":"2024-09-17T05:42:02.396322+0000","last_unstale":"2024-09-17T05:42:03.462839+0000","last_undegraded":"2024-09-17T05:42:03.462839+0000","last_fullsized":"2024-09-17T05:42:03.462839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:25.508978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379389+0000","last_change":"2024-09-17T05:42:02.398970+0000","last_active":"2024-09-17T05:42:03.379389+0000","last_peered":"2024-09-17T05:42:03.379389+0000","last_clean":"2024-09-17T05:42:03.379389+0000","last_became_active":"2024-09-17T05:42:02.398167+0000","last_became_peered":"2024-09-17T05:42:02.398167+0000","last_unstale":"2024-09-17T05:42:03.379389+0000","last_undegraded":"2024-09-17T05:42:03.379389+0000","last_fullsized":"2024-09-17T05:42:03.379389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:04.429005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461251+0000","last_change":"2024-09-17T05:42:02.393837+0000","last_active":"2024-09-17T05:42:03.461251+0000","last_peered":"2024-09-17T05:42:03.461251+0000","last_clean":"2024-09-17T05:42:03.461251+0000","last_became_active":"2024-09-17T05:42:02.393516+0000","last_became_peered":"2024-09-17T05:42:02.393516+0000","last_unstale":"2024-09-17T05:42:03.461251+0000","last_undegraded":"2024-09-17T05:42:03.461251+0000","last_fullsized":"2024-09-17T05:42:03.461251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:02.375919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461248+0000","last_change":"2024-09-17T05:42:02.386146+0000","last_active":"2024-09-17T05:42:03.461248+0000","last_peered":"2024-09-17T05:42:03.461248+0000","last_clean":"2024-09-17T05:42:03.461248+0000","last_became_active":"2024-09-17T05:42:02.385842+0000","last_became_peered":"2024-09-17T05:42:02.385842+0000","last_unstale":"2024-09-17T05:42:03.461248+0000","last_undegraded":"2024-09-17T05:42:03.461248+0000","last_fullsized":"2024-09-17T05:42:03.461248+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:40.833553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461398+0000","last_change":"2024-09-17T05:42:02.382523+0000","last_active":"2024-09-17T05:42:03.461398+0000","last_peered":"2024-09-17T05:42:03.461398+0000","last_clean":"2024-09-17T05:42:03.461398+0000","last_became_active":"2024-09-17T05:42:02.382132+0000","last_became_peered":"2024-09-17T05:42:02.382132+0000","last_unstale":"2024-09-17T05:42:03.461398+0000","last_undegraded":"2024-09-17T05:42:03.461398+0000","last_fullsized":"2024-09-17T05:42:03.461398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:33.980351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461155+0000","last_change":"2024-09-17T05:42:02.380505+0000","last_active":"2024-09-17T05:42:03.461155+0000","last_peered":"2024-09-17T05:42:03.461155+0000","last_clean":"2024-09-17T05:42:03.461155+0000","last_became_active":"2024-09-17T05:42:02.380181+0000","last_became_peered":"2024-09-17T05:42:02.380181+0000","last_unstale":"2024-09-17T05:42:03.461155+0000","last_undegraded":"2024-09-17T05:42:03.461155+0000","last_fullsized":"2024-09-17T05:42:03.461155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:14.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378330+0000","last_change":"2024-09-17T05:42:02.382509+0000","last_active":"2024-09-17T05:42:03.378330+0000","last_peered":"2024-09-17T05:42:03.378330+0000","last_clean":"2024-09-17T05:42:03.378330+0000","last_became_active":"2024-09-17T05:42:02.382018+0000","last_became_peered":"2024-09-17T05:42:02.382018+0000","last_unstale":"2024-09-17T05:42:03.378330+0000","last_undegraded":"2024-09-17T05:42:03.378330+0000","last_fullsized":"2024-09-17T05:42:03.378330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:34.617877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378265+0000","last_change":"2024-09-17T05:42:02.389716+0000","last_active":"2024-09-17T05:42:03.378265+0000","last_peered":"2024-09-17T05:42:03.378265+0000","last_clean":"2024-09-17T05:42:03.378265+0000","last_became_active":"2024-09-17T05:42:02.389212+0000","last_became_peered":"2024-09-17T05:42:02.389212+0000","last_unstale":"2024-09-17T05:42:03.378265+0000","last_undegraded":"2024-09-17T05:42:03.378265+0000","last_fullsized":"2024-09-17T05:42:03.378265+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:51.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462195+0000","last_change":"2024-09-17T05:42:02.389278+0000","last_active":"2024-09-17T05:42:03.462195+0000","last_peered":"2024-09-17T05:42:03.462195+0000","last_clean":"2024-09-17T05:42:03.462195+0000","last_became_active":"2024-09-17T05:42:02.388970+0000","last_became_peered":"2024-09-17T05:42:02.388970+0000","last_unstale":"2024-09-17T05:42:03.462195+0000","last_undegraded":"2024-09-17T05:42:03.462195+0000","last_fullsized":"2024-09-17T05:42:03.462195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:53.919010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462578+0000","last_change":"2024-09-17T05:42:02.387718+0000","last_active":"2024-09-17T05:42:03.462578+0000","last_peered":"2024-09-17T05:42:03.462578+0000","last_clean":"2024-09-17T05:42:03.462578+0000","last_became_active":"2024-09-17T05:42:02.386725+0000","last_became_peered":"2024-09-17T05:42:02.386725+0000","last_unstale":"2024-09-17T05:42:03.462578+0000","last_undegraded":"2024-09-17T05:42:03.462578+0000","last_fullsized":"2024-09-17T05:42:03.462578+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:13.736593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377716+0000","last_change":"2024-09-17T05:42:02.392334+0000","last_active":"2024-09-17T05:42:03.377716+0000","last_peered":"2024-09-17T05:42:03.377716+0000","last_clean":"2024-09-17T05:42:03.377716+0000","last_became_active":"2024-09-17T05:42:02.391992+0000","last_became_peered":"2024-09-17T05:42:02.391992+0000","last_unstale":"2024-09-17T05:42:03.377716+0000","last_undegraded":"2024-09-17T05:42:03.377716+0000","last_fullsized":"2024-09-17T05:42:03.377716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.925335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378572+0000","last_change":"2024-09-17T05:42:02.387492+0000","last_active":"2024-09-17T05:42:03.378572+0000","last_peered":"2024-09-17T05:42:03.378572+0000","last_clean":"2024-09-17T05:42:03.378572+0000","last_became_active":"2024-09-17T05:42:02.387143+0000","last_became_peered":"2024-09-17T05:42:02.387143+0000","last_unstale":"2024-09-17T05:42:03.378572+0000","last_undegraded":"2024-09-17T05:42:03.378572+0000","last_fullsized":"2024-09-17T05:42:03.378572+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.479554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462113+0000","last_change":"2024-09-17T05:42:02.376962+0000","last_active":"2024-09-17T05:42:03.462113+0000","last_peered":"2024-09-17T05:42:03.462113+0000","last_clean":"2024-09-17T05:42:03.462113+0000","last_became_active":"2024-09-17T05:42:02.376620+0000","last_became_peered":"2024-09-17T05:42:02.376620+0000","last_unstale":"2024-09-17T05:42:03.462113+0000","last_undegraded":"2024-09-17T05:42:03.462113+0000","last_fullsized":"2024-09-17T05:42:03.462113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:15.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377690+0000","last_change":"2024-09-17T05:42:02.405721+0000","last_active":"2024-09-17T05:42:03.377690+0000","last_peered":"2024-09-17T05:42:03.377690+0000","last_clean":"2024-09-17T05:42:03.377690+0000","last_became_active":"2024-09-17T05:42:02.404768+0000","last_became_peered":"2024-09-17T05:42:02.404768+0000","last_unstale":"2024-09-17T05:42:03.377690+0000","last_undegraded":"2024-09-17T05:42:03.377690+0000","last_fullsized":"2024-09-17T05:42:03.377690+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:46.615900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406640+0000","last_change":"2024-09-17T05:42:02.400903+0000","last_active":"2024-09-17T05:42:02.406640+0000","last_peered":"2024-09-17T05:42:02.406640+0000","last_clean":"2024-09-17T05:42:02.406640+0000","last_became_active":"2024-09-17T05:42:02.400003+0000","last_became_peered":"2024-09-17T05:42:02.400003+0000","last_unstale":"2024-09-17T05:42:02.406640+0000","last_undegraded":"2024-09-17T05:42:02.406640+0000","last_fullsized":"2024-09-17T05:42:02.406640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:06.027710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379305+0000","last_change":"2024-09-17T05:42:02.385527+0000","last_active":"2024-09-17T05:42:03.379305+0000","last_peered":"2024-09-17T05:42:03.379305+0000","last_clean":"2024-09-17T05:42:03.379305+0000","last_became_active":"2024-09-17T05:42:02.385219+0000","last_became_peered":"2024-09-17T05:42:02.385219+0000","last_unstale":"2024-09-17T05:42:03.379305+0000","last_undegraded":"2024-09-17T05:42:03.379305+0000","last_fullsized":"2024-09-17T05:42:03.379305+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:13.736593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.380235+0000","last_change":"2024-09-17T05:42:02.386200+0000","last_active":"2024-09-17T05:42:03.380235+0000","last_peered":"2024-09-17T05:42:03.380235+0000","last_clean":"2024-09-17T05:42:03.380235+0000","last_became_active":"2024-09-17T05:42:02.385889+0000","last_became_peered":"2024-09-17T05:42:02.385889+0000","last_unstale":"2024-09-17T05:42:03.380235+0000","last_undegraded":"2024-09-17T05:42:03.380235+0000","last_fullsized":"2024-09-17T05:42:03.380235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:25.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462149+0000","last_change":"2024-09-17T05:42:02.394501+0000","last_active":"2024-09-17T05:42:03.462149+0000","last_peered":"2024-09-17T05:42:03.462149+0000","last_clean":"2024-09-17T05:42:03.462149+0000","last_became_active":"2024-09-17T05:42:02.393977+0000","last_became_peered":"2024-09-17T05:42:02.393977+0000","last_unstale":"2024-09-17T05:42:03.462149+0000","last_undegraded":"2024-09-17T05:42:03.462149+0000","last_fullsized":"2024-09-17T05:42:03.462149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:27.383404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460913+0000","last_change":"2024-09-17T05:42:02.392748+0000","last_active":"2024-09-17T05:42:03.460913+0000","last_peered":"2024-09-17T05:42:03.460913+0000","last_clean":"2024-09-17T05:42:03.460913+0000","last_became_active":"2024-09-17T05:42:02.392453+0000","last_became_peered":"2024-09-17T05:42:02.392453+0000","last_unstale":"2024-09-17T05:42:03.460913+0000","last_undegraded":"2024-09-17T05:42:03.460913+0000","last_fullsized":"2024-09-17T05:42:03.460913+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:32.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378819+0000","last_change":"2024-09-17T05:42:02.405423+0000","last_active":"2024-09-17T05:42:03.378819+0000","last_peered":"2024-09-17T05:42:03.378819+0000","last_clean":"2024-09-17T05:42:03.378819+0000","last_became_active":"2024-09-17T05:42:02.405064+0000","last_became_peered":"2024-09-17T05:42:02.405064+0000","last_unstale":"2024-09-17T05:42:03.378819+0000","last_undegraded":"2024-09-17T05:42:03.378819+0000","last_fullsized":"2024-09-17T05:42:03.378819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.919705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377878+0000","last_change":"2024-09-17T05:42:02.381901+0000","last_active":"2024-09-17T05:42:03.377878+0000","last_peered":"2024-09-17T05:42:03.377878+0000","last_clean":"2024-09-17T05:42:03.377878+0000","last_became_active":"2024-09-17T05:42:02.381558+0000","last_became_peered":"2024-09-17T05:42:02.381558+0000","last_unstale":"2024-09-17T05:42:03.377878+0000","last_undegraded":"2024-09-17T05:42:03.377878+0000","last_fullsized":"2024-09-17T05:42:03.377878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:58.044362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461830+0000","last_change":"2024-09-17T05:42:02.392427+0000","last_active":"2024-09-17T05:42:03.461830+0000","last_peered":"2024-09-17T05:42:03.461830+0000","last_clean":"2024-09-17T05:42:03.461830+0000","last_became_active":"2024-09-17T05:42:02.392064+0000","last_became_peered":"2024-09-17T05:42:02.392064+0000","last_unstale":"2024-09-17T05:42:03.461830+0000","last_undegraded":"2024-09-17T05:42:03.461830+0000","last_fullsized":"2024-09-17T05:42:03.461830+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:58.044362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377619+0000","last_change":"2024-09-17T05:42:02.382282+0000","last_active":"2024-09-17T05:42:03.377619+0000","last_peered":"2024-09-17T05:42:03.377619+0000","last_clean":"2024-09-17T05:42:03.377619+0000","last_became_active":"2024-09-17T05:42:02.381741+0000","last_became_peered":"2024-09-17T05:42:02.381741+0000","last_unstale":"2024-09-17T05:42:03.377619+0000","last_undegraded":"2024-09-17T05:42:03.377619+0000","last_fullsized":"2024-09-17T05:42:03.377619+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.359713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406594+0000","last_change":"2024-09-17T05:42:02.401314+0000","last_active":"2024-09-17T05:42:02.406594+0000","last_peered":"2024-09-17T05:42:02.406594+0000","last_clean":"2024-09-17T05:42:02.406594+0000","last_became_active":"2024-09-17T05:42:02.400870+0000","last_became_peered":"2024-09-17T05:42:02.400870+0000","last_unstale":"2024-09-17T05:42:02.406594+0000","last_undegraded":"2024-09-17T05:42:02.406594+0000","last_fullsized":"2024-09-17T05:42:02.406594+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:44.538009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"89'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379690+0000","last_change":"2024-09-17T05:42:01.377350+0000","last_active":"2024-09-17T05:42:03.379690+0000","last_peered":"2024-09-17T05:42:03.379690+0000","last_clean":"2024-09-17T05:42:03.379690+0000","last_became_active":"2024-09-17T05:42:01.377033+0000","last_became_peered":"2024-09-17T05:42:01.377033+0000","last_unstale":"2024-09-17T05:42:03.379690+0000","last_undegraded":"2024-09-17T05:42:03.379690+0000","last_fullsized":"2024-09-17T05:42:03.379690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:12.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377693+0000","last_change":"2024-09-17T05:42:02.398902+0000","last_active":"2024-09-17T05:42:03.377693+0000","last_peered":"2024-09-17T05:42:03.377693+0000","last_clean":"2024-09-17T05:42:03.377693+0000","last_became_active":"2024-09-17T05:42:02.398509+0000","last_became_peered":"2024-09-17T05:42:02.398509+0000","last_unstale":"2024-09-17T05:42:03.377693+0000","last_undegraded":"2024-09-17T05:42:03.377693+0000","last_fullsized":"2024-09-17T05:42:03.377693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:36.150790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461395+0000","last_change":"2024-09-17T05:42:01.394241+0000","last_active":"2024-09-17T05:42:03.461395+0000","last_peered":"2024-09-17T05:42:03.461395+0000","last_clean":"2024-09-17T05:42:03.461395+0000","last_became_active":"2024-09-17T05:42:01.393886+0000","last_became_peered":"2024-09-17T05:42:01.393886+0000","last_unstale":"2024-09-17T05:42:03.461395+0000","last_undegraded":"2024-09-17T05:42:03.461395+0000","last_fullsized":"2024-09-17T05:42:03.461395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:52.915565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379410+0000","last_change":"2024-09-17T05:42:02.400684+0000","last_active":"2024-09-17T05:42:03.379410+0000","last_peered":"2024-09-17T05:42:03.379410+0000","last_clean":"2024-09-17T05:42:03.379410+0000","last_became_active":"2024-09-17T05:42:02.400387+0000","last_became_peered":"2024-09-17T05:42:02.400387+0000","last_unstale":"2024-09-17T05:42:03.379410+0000","last_undegraded":"2024-09-17T05:42:03.379410+0000","last_fullsized":"2024-09-17T05:42:03.379410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:15.680350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378851+0000","last_change":"2024-09-17T05:42:01.383164+0000","last_active":"2024-09-17T05:42:03.378851+0000","last_peered":"2024-09-17T05:42:03.378851+0000","last_clean":"2024-09-17T05:42:03.378851+0000","last_became_active":"2024-09-17T05:42:01.382671+0000","last_became_peered":"2024-09-17T05:42:01.382671+0000","last_unstale":"2024-09-17T05:42:03.378851+0000","last_undegraded":"2024-09-17T05:42:03.378851+0000","last_fullsized":"2024-09-17T05:42:03.378851+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:36.574807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462059+0000","last_change":"2024-09-17T05:42:02.395948+0000","last_active":"2024-09-17T05:42:03.462059+0000","last_peered":"2024-09-17T05:42:03.462059+0000","last_clean":"2024-09-17T05:42:03.462059+0000","last_became_active":"2024-09-17T05:42:02.395642+0000","last_became_peered":"2024-09-17T05:42:02.395642+0000","last_unstale":"2024-09-17T05:42:03.462059+0000","last_undegraded":"2024-09-17T05:42:03.462059+0000","last_fullsized":"2024-09-17T05:42:03.462059+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:34.502981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461240+0000","last_change":"2024-09-17T05:42:01.384678+0000","last_active":"2024-09-17T05:42:03.461240+0000","last_peered":"2024-09-17T05:42:03.461240+0000","last_clean":"2024-09-17T05:42:03.461240+0000","last_became_active":"2024-09-17T05:42:01.384361+0000","last_became_peered":"2024-09-17T05:42:01.384361+0000","last_unstale":"2024-09-17T05:42:03.461240+0000","last_undegraded":"2024-09-17T05:42:03.461240+0000","last_fullsized":"2024-09-17T05:42:03.461240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:33.499537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460574+0000","last_change":"2024-09-17T05:42:02.388351+0000","last_active":"2024-09-17T05:42:03.460574+0000","last_peered":"2024-09-17T05:42:03.460574+0000","last_clean":"2024-09-17T05:42:03.460574+0000","last_became_active":"2024-09-17T05:42:02.387995+0000","last_became_peered":"2024-09-17T05:42:02.387995+0000","last_unstale":"2024-09-17T05:42:03.460574+0000","last_undegraded":"2024-09-17T05:42:03.460574+0000","last_fullsized":"2024-09-17T05:42:03.460574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:43.608918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462075+0000","last_change":"2024-09-17T05:42:01.380425+0000","last_active":"2024-09-17T05:42:03.462075+0000","last_peered":"2024-09-17T05:42:03.462075+0000","last_clean":"2024-09-17T05:42:03.462075+0000","last_became_active":"2024-09-17T05:42:01.380099+0000","last_became_peered":"2024-09-17T05:42:01.380099+0000","last_unstale":"2024-09-17T05:42:03.462075+0000","last_undegraded":"2024-09-17T05:42:03.462075+0000","last_fullsized":"2024-09-17T05:42:03.462075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:42.605473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379146+0000","last_change":"2024-09-17T05:42:02.398650+0000","last_active":"2024-09-17T05:42:03.379146+0000","last_peered":"2024-09-17T05:42:03.379146+0000","last_clean":"2024-09-17T05:42:03.379146+0000","last_became_active":"2024-09-17T05:42:02.398283+0000","last_became_peered":"2024-09-17T05:42:02.398283+0000","last_unstale":"2024-09-17T05:42:03.379146+0000","last_undegraded":"2024-09-17T05:42:03.379146+0000","last_fullsized":"2024-09-17T05:42:03.379146+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:15.116583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460425+0000","last_change":"2024-09-17T05:42:01.381949+0000","last_active":"2024-09-17T05:42:03.460425+0000","last_peered":"2024-09-17T05:42:03.460425+0000","last_clean":"2024-09-17T05:42:03.460425+0000","last_became_active":"2024-09-17T05:42:01.381515+0000","last_became_peered":"2024-09-17T05:42:01.381515+0000","last_unstale":"2024-09-17T05:42:03.460425+0000","last_undegraded":"2024-09-17T05:42:03.460425+0000","last_fullsized":"2024-09-17T05:42:03.460425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:36.574807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378026+0000","last_change":"2024-09-17T05:42:02.382120+0000","last_active":"2024-09-17T05:42:03.378026+0000","last_peered":"2024-09-17T05:42:03.378026+0000","last_clean":"2024-09-17T05:42:03.378026+0000","last_became_active":"2024-09-17T05:42:02.381724+0000","last_became_peered":"2024-09-17T05:42:02.381724+0000","last_unstale":"2024-09-17T05:42:03.378026+0000","last_undegraded":"2024-09-17T05:42:03.378026+0000","last_fullsized":"2024-09-17T05:42:03.378026+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:25.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461588+0000","last_change":"2024-09-17T05:42:01.393625+0000","last_active":"2024-09-17T05:42:03.461588+0000","last_peered":"2024-09-17T05:42:03.461588+0000","last_clean":"2024-09-17T05:42:03.461588+0000","last_became_active":"2024-09-17T05:42:01.392737+0000","last_became_peered":"2024-09-17T05:42:01.392737+0000","last_unstale":"2024-09-17T05:42:03.461588+0000","last_undegraded":"2024-09-17T05:42:03.461588+0000","last_fullsized":"2024-09-17T05:42:03.461588+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:53.758596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406789+0000","last_change":"2024-09-17T05:42:02.401506+0000","last_active":"2024-09-17T05:42:02.406789+0000","last_peered":"2024-09-17T05:42:02.406789+0000","last_clean":"2024-09-17T05:42:02.406789+0000","last_became_active":"2024-09-17T05:42:02.401224+0000","last_became_peered":"2024-09-17T05:42:02.401224+0000","last_unstale":"2024-09-17T05:42:02.406789+0000","last_undegraded":"2024-09-17T05:42:02.406789+0000","last_fullsized":"2024-09-17T05:42:02.406789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:36.929805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377514+0000","last_change":"2024-09-17T05:42:01.379486+0000","last_active":"2024-09-17T05:42:03.377514+0000","last_peered":"2024-09-17T05:42:03.377514+0000","last_clean":"2024-09-17T05:42:03.377514+0000","last_became_active":"2024-09-17T05:42:01.379109+0000","last_became_peered":"2024-09-17T05:42:01.379109+0000","last_unstale":"2024-09-17T05:42:03.377514+0000","last_undegraded":"2024-09-17T05:42:03.377514+0000","last_fullsized":"2024-09-17T05:42:03.377514+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:49.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378399+0000","last_change":"2024-09-17T05:42:02.385785+0000","last_active":"2024-09-17T05:42:03.378399+0000","last_peered":"2024-09-17T05:42:03.378399+0000","last_clean":"2024-09-17T05:42:03.378399+0000","last_became_active":"2024-09-17T05:42:02.385452+0000","last_became_peered":"2024-09-17T05:42:02.385452+0000","last_unstale":"2024-09-17T05:42:03.378399+0000","last_undegraded":"2024-09-17T05:42:03.378399+0000","last_fullsized":"2024-09-17T05:42:03.378399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:56.312006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379827+0000","last_change":"2024-09-17T05:42:01.383301+0000","last_active":"2024-09-17T05:42:03.379827+0000","last_peered":"2024-09-17T05:42:03.379827+0000","last_clean":"2024-09-17T05:42:03.379827+0000","last_became_active":"2024-09-17T05:42:01.382176+0000","last_became_peered":"2024-09-17T05:42:01.382176+0000","last_unstale":"2024-09-17T05:42:03.379827+0000","last_undegraded":"2024-09-17T05:42:03.379827+0000","last_fullsized":"2024-09-17T05:42:03.379827+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:04.830724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379745+0000","last_change":"2024-09-17T05:42:02.402518+0000","last_active":"2024-09-17T05:42:03.379745+0000","last_peered":"2024-09-17T05:42:03.379745+0000","last_clean":"2024-09-17T05:42:03.379745+0000","last_became_active":"2024-09-17T05:42:02.401952+0000","last_became_peered":"2024-09-17T05:42:02.401952+0000","last_unstale":"2024-09-17T05:42:03.379745+0000","last_undegraded":"2024-09-17T05:42:03.379745+0000","last_fullsized":"2024-09-17T05:42:03.379745+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:29.385917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462366+0000","last_change":"2024-09-17T05:42:01.391909+0000","last_active":"2024-09-17T05:42:03.462366+0000","last_peered":"2024-09-17T05:42:03.462366+0000","last_clean":"2024-09-17T05:42:03.462366+0000","last_became_active":"2024-09-17T05:42:01.391566+0000","last_became_peered":"2024-09-17T05:42:01.391566+0000","last_unstale":"2024-09-17T05:42:03.462366+0000","last_undegraded":"2024-09-17T05:42:03.462366+0000","last_fullsized":"2024-09-17T05:42:03.462366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:38.797307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.407959+0000","last_change":"2024-09-17T05:42:02.404888+0000","last_active":"2024-09-17T05:42:02.407959+0000","last_peered":"2024-09-17T05:42:02.407959+0000","last_clean":"2024-09-17T05:42:02.407959+0000","last_became_active":"2024-09-17T05:42:02.404579+0000","last_became_peered":"2024-09-17T05:42:02.404579+0000","last_unstale":"2024-09-17T05:42:02.407959+0000","last_undegraded":"2024-09-17T05:42:02.407959+0000","last_fullsized":"2024-09-17T05:42:02.407959+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:23.427202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"89'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.380054+0000","last_change":"2024-09-17T05:42:01.391399+0000","last_active":"2024-09-17T05:42:03.380054+0000","last_peered":"2024-09-17T05:42:03.380054+0000","last_clean":"2024-09-17T05:42:03.380054+0000","last_became_active":"2024-09-17T05:42:01.390504+0000","last_became_peered":"2024-09-17T05:42:01.390504+0000","last_unstale":"2024-09-17T05:42:03.380054+0000","last_undegraded":"2024-09-17T05:42:03.380054+0000","last_fullsized":"2024-09-17T05:42:03.380054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:06.232004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378258+0000","last_change":"2024-09-17T05:42:02.379503+0000","last_active":"2024-09-17T05:42:03.378258+0000","last_peered":"2024-09-17T05:42:03.378258+0000","last_clean":"2024-09-17T05:42:03.378258+0000","last_became_active":"2024-09-17T05:42:02.379059+0000","last_became_peered":"2024-09-17T05:42:02.379059+0000","last_unstale":"2024-09-17T05:42:03.378258+0000","last_undegraded":"2024-09-17T05:42:03.378258+0000","last_fullsized":"2024-09-17T05:42:03.378258+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:53.344031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"89'6","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.417675+0000","last_change":"2024-09-17T05:42:01.392922+0000","last_active":"2024-09-17T05:42:02.417675+0000","last_peered":"2024-09-17T05:42:02.417675+0000","last_clean":"2024-09-17T05:42:02.417675+0000","last_became_active":"2024-09-17T05:42:01.392545+0000","last_became_peered":"2024-09-17T05:42:01.392545+0000","last_unstale":"2024-09-17T05:42:02.417675+0000","last_undegraded":"2024-09-17T05:42:02.417675+0000","last_fullsized":"2024-09-17T05:42:02.417675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:10.566180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406668+0000","last_change":"2024-09-17T05:42:02.402389+0000","last_active":"2024-09-17T05:42:02.406668+0000","last_peered":"2024-09-17T05:42:02.406668+0000","last_clean":"2024-09-17T05:42:02.406668+0000","last_became_active":"2024-09-17T05:42:02.400017+0000","last_became_peered":"2024-09-17T05:42:02.400017+0000","last_unstale":"2024-09-17T05:42:02.406668+0000","last_undegraded":"2024-09-17T05:42:02.406668+0000","last_fullsized":"2024-09-17T05:42:02.406668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:31.496288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378649+0000","last_change":"2024-09-17T05:42:01.385821+0000","last_active":"2024-09-17T05:42:03.378649+0000","last_peered":"2024-09-17T05:42:03.378649+0000","last_clean":"2024-09-17T05:42:03.378649+0000","last_became_active":"2024-09-17T05:42:01.384735+0000","last_became_peered":"2024-09-17T05:42:01.384735+0000","last_unstale":"2024-09-17T05:42:03.378649+0000","last_undegraded":"2024-09-17T05:42:03.378649+0000","last_fullsized":"2024-09-17T05:42:03.378649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.095472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377709+0000","last_change":"2024-09-17T05:42:02.384598+0000","last_active":"2024-09-17T05:42:03.377709+0000","last_peered":"2024-09-17T05:42:03.377709+0000","last_clean":"2024-09-17T05:42:03.377709+0000","last_became_active":"2024-09-17T05:42:02.383432+0000","last_became_peered":"2024-09-17T05:42:02.383432+0000","last_unstale":"2024-09-17T05:42:03.377709+0000","last_undegraded":"2024-09-17T05:42:03.377709+0000","last_fullsized":"2024-09-17T05:42:03.377709+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:55:56.036238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.390694+0000","last_change":"2024-09-17T05:42:01.382299+0000","last_active":"2024-09-17T05:42:02.390694+0000","last_peered":"2024-09-17T05:42:02.390694+0000","last_clean":"2024-09-17T05:42:02.390694+0000","last_became_active":"2024-09-17T05:42:01.379575+0000","last_became_peered":"2024-09-17T05:42:01.379575+0000","last_unstale":"2024-09-17T05:42:02.390694+0000","last_undegraded":"2024-09-17T05:42:02.390694+0000","last_fullsized":"2024-09-17T05:42:02.390694+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:44.433844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406482+0000","last_change":"2024-09-17T05:42:02.398913+0000","last_active":"2024-09-17T05:42:02.406482+0000","last_peered":"2024-09-17T05:42:02.406482+0000","last_clean":"2024-09-17T05:42:02.406482+0000","last_became_active":"2024-09-17T05:42:02.398604+0000","last_became_peered":"2024-09-17T05:42:02.398604+0000","last_unstale":"2024-09-17T05:42:02.406482+0000","last_undegraded":"2024-09-17T05:42:02.406482+0000","last_fullsized":"2024-09-17T05:42:02.406482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:19.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.399190+0000","last_change":"2024-09-17T05:42:01.383282+0000","last_active":"2024-09-17T05:42:02.399190+0000","last_peered":"2024-09-17T05:42:02.399190+0000","last_clean":"2024-09-17T05:42:02.399190+0000","last_became_active":"2024-09-17T05:42:01.382967+0000","last_became_peered":"2024-09-17T05:42:01.382967+0000","last_unstale":"2024-09-17T05:42:02.399190+0000","last_undegraded":"2024-09-17T05:42:02.399190+0000","last_fullsized":"2024-09-17T05:42:02.399190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:45.015065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461495+0000","last_change":"2024-09-17T05:42:02.389461+0000","last_active":"2024-09-17T05:42:03.461495+0000","last_peered":"2024-09-17T05:42:03.461495+0000","last_clean":"2024-09-17T05:42:03.461495+0000","last_became_active":"2024-09-17T05:42:02.389095+0000","last_became_peered":"2024-09-17T05:42:02.389095+0000","last_unstale":"2024-09-17T05:42:03.461495+0000","last_undegraded":"2024-09-17T05:42:03.461495+0000","last_fullsized":"2024-09-17T05:42:03.461495+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:16.136718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"89'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460613+0000","last_change":"2024-09-17T05:42:01.387054+0000","last_active":"2024-09-17T05:42:03.460613+0000","last_peered":"2024-09-17T05:42:03.460613+0000","last_clean":"2024-09-17T05:42:03.460613+0000","last_became_active":"2024-09-17T05:42:01.386519+0000","last_became_peered":"2024-09-17T05:42:01.386519+0000","last_unstale":"2024-09-17T05:42:03.460613+0000","last_undegraded":"2024-09-17T05:42:03.460613+0000","last_fullsized":"2024-09-17T05:42:03.460613+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:39.069559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460945+0000","last_change":"2024-09-17T05:42:02.391758+0000","last_active":"2024-09-17T05:42:03.460945+0000","last_peered":"2024-09-17T05:42:03.460945+0000","last_clean":"2024-09-17T05:42:03.460945+0000","last_became_active":"2024-09-17T05:42:02.391449+0000","last_became_peered":"2024-09-17T05:42:02.391449+0000","last_unstale":"2024-09-17T05:42:03.460945+0000","last_undegraded":"2024-09-17T05:42:03.460945+0000","last_fullsized":"2024-09-17T05:42:03.460945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:45.239653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462542+0000","last_change":"2024-09-17T05:42:01.395085+0000","last_active":"2024-09-17T05:42:03.462542+0000","last_peered":"2024-09-17T05:42:03.462542+0000","last_clean":"2024-09-17T05:42:03.462542+0000","last_became_active":"2024-09-17T05:42:01.394637+0000","last_became_peered":"2024-09-17T05:42:01.394637+0000","last_unstale":"2024-09-17T05:42:03.462542+0000","last_undegraded":"2024-09-17T05:42:03.462542+0000","last_fullsized":"2024-09-17T05:42:03.462542+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:10.448953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379980+0000","last_change":"2024-09-17T05:42:02.399057+0000","last_active":"2024-09-17T05:42:03.379980+0000","last_peered":"2024-09-17T05:42:03.379980+0000","last_clean":"2024-09-17T05:42:03.379980+0000","last_became_active":"2024-09-17T05:42:02.398644+0000","last_became_peered":"2024-09-17T05:42:02.398644+0000","last_unstale":"2024-09-17T05:42:03.379980+0000","last_undegraded":"2024-09-17T05:42:03.379980+0000","last_fullsized":"2024-09-17T05:42:03.379980+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:54.833682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461456+0000","last_change":"2024-09-17T05:42:01.389508+0000","last_active":"2024-09-17T05:42:03.461456+0000","last_peered":"2024-09-17T05:42:03.461456+0000","last_clean":"2024-09-17T05:42:03.461456+0000","last_became_active":"2024-09-17T05:42:01.389169+0000","last_became_peered":"2024-09-17T05:42:01.389169+0000","last_unstale":"2024-09-17T05:42:03.461456+0000","last_undegraded":"2024-09-17T05:42:03.461456+0000","last_fullsized":"2024-09-17T05:42:03.461456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:38.993417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.380077+0000","last_change":"2024-09-17T05:42:02.388705+0000","last_active":"2024-09-17T05:42:03.380077+0000","last_peered":"2024-09-17T05:42:03.380077+0000","last_clean":"2024-09-17T05:42:03.380077+0000","last_became_active":"2024-09-17T05:42:02.388317+0000","last_became_peered":"2024-09-17T05:42:02.388317+0000","last_unstale":"2024-09-17T05:42:03.380077+0000","last_undegraded":"2024-09-17T05:42:03.380077+0000","last_fullsized":"2024-09-17T05:42:03.380077+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.919758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461328+0000","last_change":"2024-09-17T05:42:01.386786+0000","last_active":"2024-09-17T05:42:03.461328+0000","last_peered":"2024-09-17T05:42:03.461328+0000","last_clean":"2024-09-17T05:42:03.461328+0000","last_became_active":"2024-09-17T05:42:01.386470+0000","last_became_peered":"2024-09-17T05:42:01.386470+0000","last_unstale":"2024-09-17T05:42:03.461328+0000","last_undegraded":"2024-09-17T05:42:03.461328+0000","last_fullsized":"2024-09-17T05:42:03.461328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:26.379959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377899+0000","last_change":"2024-09-17T05:42:02.391101+0000","last_active":"2024-09-17T05:42:03.377899+0000","last_peered":"2024-09-17T05:42:03.377899+0000","last_clean":"2024-09-17T05:42:03.377899+0000","last_became_active":"2024-09-17T05:42:02.390616+0000","last_became_peered":"2024-09-17T05:42:02.390616+0000","last_unstale":"2024-09-17T05:42:03.377899+0000","last_undegraded":"2024-09-17T05:42:03.377899+0000","last_fullsized":"2024-09-17T05:42:03.377899+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.919758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379010+0000","last_change":"2024-09-17T05:42:01.392861+0000","last_active":"2024-09-17T05:42:03.379010+0000","last_peered":"2024-09-17T05:42:03.379010+0000","last_clean":"2024-09-17T05:42:03.379010+0000","last_became_active":"2024-09-17T05:42:01.392501+0000","last_became_peered":"2024-09-17T05:42:01.392501+0000","last_unstale":"2024-09-17T05:42:03.379010+0000","last_undegraded":"2024-09-17T05:42:03.379010+0000","last_fullsized":"2024-09-17T05:42:03.379010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:33.614432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461336+0000","last_change":"2024-09-17T05:42:02.382996+0000","last_active":"2024-09-17T05:42:03.461336+0000","last_peered":"2024-09-17T05:42:03.461336+0000","last_clean":"2024-09-17T05:42:03.461336+0000","last_became_active":"2024-09-17T05:42:02.382571+0000","last_became_peered":"2024-09-17T05:42:02.382571+0000","last_unstale":"2024-09-17T05:42:03.461336+0000","last_undegraded":"2024-09-17T05:42:03.461336+0000","last_fullsized":"2024-09-17T05:42:03.461336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:32.571651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377611+0000","last_change":"2024-09-17T05:42:01.380371+0000","last_active":"2024-09-17T05:42:03.377611+0000","last_peered":"2024-09-17T05:42:03.377611+0000","last_clean":"2024-09-17T05:42:03.377611+0000","last_became_active":"2024-09-17T05:42:01.380060+0000","last_became_peered":"2024-09-17T05:42:01.380060+0000","last_unstale":"2024-09-17T05:42:03.377611+0000","last_undegraded":"2024-09-17T05:42:03.377611+0000","last_fullsized":"2024-09-17T05:42:03.377611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:47.789926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462115+0000","last_change":"2024-09-17T05:42:02.387162+0000","last_active":"2024-09-17T05:42:03.462115+0000","last_peered":"2024-09-17T05:42:03.462115+0000","last_clean":"2024-09-17T05:42:03.462115+0000","last_became_active":"2024-09-17T05:42:02.385971+0000","last_became_peered":"2024-09-17T05:42:02.385971+0000","last_unstale":"2024-09-17T05:42:03.462115+0000","last_undegraded":"2024-09-17T05:42:03.462115+0000","last_fullsized":"2024-09-17T05:42:03.462115+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:34:37.885645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461257+0000","last_change":"2024-09-17T05:42:01.384912+0000","last_active":"2024-09-17T05:42:03.461257+0000","last_peered":"2024-09-17T05:42:03.461257+0000","last_clean":"2024-09-17T05:42:03.461257+0000","last_became_active":"2024-09-17T05:42:01.384611+0000","last_became_peered":"2024-09-17T05:42:01.384611+0000","last_unstale":"2024-09-17T05:42:03.461257+0000","last_undegraded":"2024-09-17T05:42:03.461257+0000","last_fullsized":"2024-09-17T05:42:03.461257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.095472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406755+0000","last_change":"2024-09-17T05:42:02.401618+0000","last_active":"2024-09-17T05:42:02.406755+0000","last_peered":"2024-09-17T05:42:02.406755+0000","last_clean":"2024-09-17T05:42:02.406755+0000","last_became_active":"2024-09-17T05:42:02.401300+0000","last_became_peered":"2024-09-17T05:42:02.401300+0000","last_unstale":"2024-09-17T05:42:02.406755+0000","last_undegraded":"2024-09-17T05:42:02.406755+0000","last_fullsized":"2024-09-17T05:42:02.406755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:22.986658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460659+0000","last_change":"2024-09-17T05:42:01.387129+0000","last_active":"2024-09-17T05:42:03.460659+0000","last_peered":"2024-09-17T05:42:03.460659+0000","last_clean":"2024-09-17T05:42:03.460659+0000","last_became_active":"2024-09-17T05:42:01.386812+0000","last_became_peered":"2024-09-17T05:42:01.386812+0000","last_unstale":"2024-09-17T05:42:03.460659+0000","last_undegraded":"2024-09-17T05:42:03.460659+0000","last_fullsized":"2024-09-17T05:42:03.460659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:12.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462230+0000","last_change":"2024-09-17T05:42:02.378921+0000","last_active":"2024-09-17T05:42:03.462230+0000","last_peered":"2024-09-17T05:42:03.462230+0000","last_clean":"2024-09-17T05:42:03.462230+0000","last_became_active":"2024-09-17T05:42:02.378574+0000","last_became_peered":"2024-09-17T05:42:02.378574+0000","last_unstale":"2024-09-17T05:42:03.462230+0000","last_undegraded":"2024-09-17T05:42:03.462230+0000","last_fullsized":"2024-09-17T05:42:03.462230+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.479554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379794+0000","last_change":"2024-09-17T05:42:01.395387+0000","last_active":"2024-09-17T05:42:03.379794+0000","last_peered":"2024-09-17T05:42:03.379794+0000","last_clean":"2024-09-17T05:42:03.379794+0000","last_became_active":"2024-09-17T05:42:01.394460+0000","last_became_peered":"2024-09-17T05:42:01.394460+0000","last_unstale":"2024-09-17T05:42:03.379794+0000","last_undegraded":"2024-09-17T05:42:03.379794+0000","last_fullsized":"2024-09-17T05:42:03.379794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:51.445273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460903+0000","last_change":"2024-09-17T05:42:02.391921+0000","last_active":"2024-09-17T05:42:03.460903+0000","last_peered":"2024-09-17T05:42:03.460903+0000","last_clean":"2024-09-17T05:42:03.460903+0000","last_became_active":"2024-09-17T05:42:02.391477+0000","last_became_peered":"2024-09-17T05:42:02.391477+0000","last_unstale":"2024-09-17T05:42:03.460903+0000","last_undegraded":"2024-09-17T05:42:03.460903+0000","last_fullsized":"2024-09-17T05:42:03.460903+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.452398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379594+0000","last_change":"2024-09-17T05:42:01.389386+0000","last_active":"2024-09-17T05:42:03.379594+0000","last_peered":"2024-09-17T05:42:03.379594+0000","last_clean":"2024-09-17T05:42:03.379594+0000","last_became_active":"2024-09-17T05:42:01.389058+0000","last_became_peered":"2024-09-17T05:42:01.389058+0000","last_unstale":"2024-09-17T05:42:03.379594+0000","last_undegraded":"2024-09-17T05:42:03.379594+0000","last_fullsized":"2024-09-17T05:42:03.379594+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:50.223378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461408+0000","last_change":"2024-09-17T05:42:02.384531+0000","last_active":"2024-09-17T05:42:03.461408+0000","last_peered":"2024-09-17T05:42:03.461408+0000","last_clean":"2024-09-17T05:42:03.461408+0000","last_became_active":"2024-09-17T05:42:02.383833+0000","last_became_peered":"2024-09-17T05:42:02.383833+0000","last_unstale":"2024-09-17T05:42:03.461408+0000","last_undegraded":"2024-09-17T05:42:03.461408+0000","last_fullsized":"2024-09-17T05:42:03.461408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:27.238949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462442+0000","last_change":"2024-09-17T05:42:01.380566+0000","last_active":"2024-09-17T05:42:03.462442+0000","last_peered":"2024-09-17T05:42:03.462442+0000","last_clean":"2024-09-17T05:42:03.462442+0000","last_became_active":"2024-09-17T05:42:01.380254+0000","last_became_peered":"2024-09-17T05:42:01.380254+0000","last_unstale":"2024-09-17T05:42:03.462442+0000","last_undegraded":"2024-09-17T05:42:03.462442+0000","last_fullsized":"2024-09-17T05:42:03.462442+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.460880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379755+0000","last_change":"2024-09-17T05:42:02.388785+0000","last_active":"2024-09-17T05:42:03.379755+0000","last_peered":"2024-09-17T05:42:03.379755+0000","last_clean":"2024-09-17T05:42:03.379755+0000","last_became_active":"2024-09-17T05:42:02.388430+0000","last_became_peered":"2024-09-17T05:42:02.388430+0000","last_unstale":"2024-09-17T05:42:03.379755+0000","last_undegraded":"2024-09-17T05:42:03.379755+0000","last_fullsized":"2024-09-17T05:42:03.379755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:36.150790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379492+0000","last_change":"2024-09-17T05:42:01.391762+0000","last_active":"2024-09-17T05:42:03.379492+0000","last_peered":"2024-09-17T05:42:03.379492+0000","last_clean":"2024-09-17T05:42:03.379492+0000","last_became_active":"2024-09-17T05:42:01.391384+0000","last_became_peered":"2024-09-17T05:42:01.391384+0000","last_unstale":"2024-09-17T05:42:03.379492+0000","last_undegraded":"2024-09-17T05:42:03.379492+0000","last_fullsized":"2024-09-17T05:42:03.379492+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:31.648344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378242+0000","last_change":"2024-09-17T05:42:02.390861+0000","last_active":"2024-09-17T05:42:03.378242+0000","last_peered":"2024-09-17T05:42:03.378242+0000","last_clean":"2024-09-17T05:42:03.378242+0000","last_became_active":"2024-09-17T05:42:02.390231+0000","last_became_peered":"2024-09-17T05:42:02.390231+0000","last_unstale":"2024-09-17T05:42:03.378242+0000","last_undegraded":"2024-09-17T05:42:03.378242+0000","last_fullsized":"2024-09-17T05:42:03.378242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:52.448718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.390481+0000","last_change":"2024-09-17T05:42:01.384399+0000","last_active":"2024-09-17T05:42:02.390481+0000","last_peered":"2024-09-17T05:42:02.390481+0000","last_clean":"2024-09-17T05:42:02.390481+0000","last_became_active":"2024-09-17T05:42:01.383920+0000","last_became_peered":"2024-09-17T05:42:01.383920+0000","last_unstale":"2024-09-17T05:42:02.390481+0000","last_undegraded":"2024-09-17T05:42:02.390481+0000","last_fullsized":"2024-09-17T05:42:02.390481+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:27.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461404+0000","last_change":"2024-09-17T05:42:02.391017+0000","last_active":"2024-09-17T05:42:03.461404+0000","last_peered":"2024-09-17T05:42:03.461404+0000","last_clean":"2024-09-17T05:42:03.461404+0000","last_became_active":"2024-09-17T05:42:02.390542+0000","last_became_peered":"2024-09-17T05:42:02.390542+0000","last_unstale":"2024-09-17T05:42:03.461404+0000","last_undegraded":"2024-09-17T05:42:03.461404+0000","last_fullsized":"2024-09-17T05:42:03.461404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:44.166197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378000+0000","last_change":"2024-09-17T05:42:01.381849+0000","last_active":"2024-09-17T05:42:03.378000+0000","last_peered":"2024-09-17T05:42:03.378000+0000","last_clean":"2024-09-17T05:42:03.378000+0000","last_became_active":"2024-09-17T05:42:01.380680+0000","last_became_peered":"2024-09-17T05:42:01.380680+0000","last_unstale":"2024-09-17T05:42:03.378000+0000","last_undegraded":"2024-09-17T05:42:03.378000+0000","last_fullsized":"2024-09-17T05:42:03.378000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:58.090612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462294+0000","last_change":"2024-09-17T05:42:02.391899+0000","last_active":"2024-09-17T05:42:03.462294+0000","last_peered":"2024-09-17T05:42:03.462294+0000","last_clean":"2024-09-17T05:42:03.462294+0000","last_became_active":"2024-09-17T05:42:02.391575+0000","last_became_peered":"2024-09-17T05:42:02.391575+0000","last_unstale":"2024-09-17T05:42:03.462294+0000","last_undegraded":"2024-09-17T05:42:03.462294+0000","last_fullsized":"2024-09-17T05:42:03.462294+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.919705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377761+0000","last_change":"2024-09-17T05:42:01.383420+0000","last_active":"2024-09-17T05:42:03.377761+0000","last_peered":"2024-09-17T05:42:03.377761+0000","last_clean":"2024-09-17T05:42:03.377761+0000","last_became_active":"2024-09-17T05:42:01.382660+0000","last_became_peered":"2024-09-17T05:42:01.382660+0000","last_unstale":"2024-09-17T05:42:03.377761+0000","last_undegraded":"2024-09-17T05:42:03.377761+0000","last_fullsized":"2024-09-17T05:42:03.377761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:37.304976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377512+0000","last_change":"2024-09-17T05:42:02.392384+0000","last_active":"2024-09-17T05:42:03.377512+0000","last_peered":"2024-09-17T05:42:03.377512+0000","last_clean":"2024-09-17T05:42:03.377512+0000","last_became_active":"2024-09-17T05:42:02.392069+0000","last_became_peered":"2024-09-17T05:42:02.392069+0000","last_unstale":"2024-09-17T05:42:03.377512+0000","last_undegraded":"2024-09-17T05:42:03.377512+0000","last_fullsized":"2024-09-17T05:42:03.377512+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:13.736593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377516+0000","last_change":"2024-09-17T05:42:01.377960+0000","last_active":"2024-09-17T05:42:03.377516+0000","last_peered":"2024-09-17T05:42:03.377516+0000","last_clean":"2024-09-17T05:42:03.377516+0000","last_became_active":"2024-09-17T05:42:01.376618+0000","last_became_peered":"2024-09-17T05:42:01.376618+0000","last_unstale":"2024-09-17T05:42:03.377516+0000","last_undegraded":"2024-09-17T05:42:03.377516+0000","last_fullsized":"2024-09-17T05:42:03.377516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:28.701764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379534+0000","last_change":"2024-09-17T05:42:02.401437+0000","last_active":"2024-09-17T05:42:03.379534+0000","last_peered":"2024-09-17T05:42:03.379534+0000","last_clean":"2024-09-17T05:42:03.379534+0000","last_became_active":"2024-09-17T05:42:02.401106+0000","last_became_peered":"2024-09-17T05:42:02.401106+0000","last_unstale":"2024-09-17T05:42:03.379534+0000","last_undegraded":"2024-09-17T05:42:03.379534+0000","last_fullsized":"2024-09-17T05:42:03.379534+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.359713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.390859+0000","last_change":"2024-09-17T05:42:01.393386+0000","last_active":"2024-09-17T05:42:02.390859+0000","last_peered":"2024-09-17T05:42:02.390859+0000","last_clean":"2024-09-17T05:42:02.390859+0000","last_became_active":"2024-09-17T05:42:01.392846+0000","last_became_peered":"2024-09-17T05:42:01.392846+0000","last_unstale":"2024-09-17T05:42:02.390859+0000","last_undegraded":"2024-09-17T05:42:02.390859+0000","last_fullsized":"2024-09-17T05:42:02.390859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:20.593732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":242,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377656+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:42:03.377656+0000","last_peered":"2024-09-17T05:42:03.377656+0000","last_clean":"2024-09-17T05:42:03.377656+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:42:03.377656+0000","last_undegraded":"2024-09-17T05:42:03.377656+0000","last_fullsized":"2024-09-17T05:42:03.377656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":504222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1695744,"data_stored":1094590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":504222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1122304,"data_stored":505946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1110016,"data_stored":504826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1708032,"data_stored":1095276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":504292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1110016,"data_stored":499266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:06.579 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:42:06.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.771+0000 7f4745000640 1 -- 172.21.15.44:0/201974987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47400cc480 msgr2=0x7f4740166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.771+0000 7f4745000640 1 --2- 172.21.15.44:0/201974987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47400cc480 0x7f4740166480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4738009bf0 tx=0x7f473801ca70 comp rx=0 tx=0).stop 2024-09-17T05:42:06.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.771+0000 7f4745000640 1 -- 172.21.15.44:0/201974987 shutdown_connections 2024-09-17T05:42:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.771+0000 7f4745000640 1 --2- 172.21.15.44:0/201974987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47400cc480 0x7f4740166480 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.771+0000 7f4745000640 1 -- 172.21.15.44:0/201974987 >> 172.21.15.44:0/201974987 conn(0x7f47400ccaa0 msgr2=0x7f47400cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.771+0000 7f4745000640 1 -- 172.21.15.44:0/201974987 shutdown_connections 2024-09-17T05:42:06.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.771+0000 7f4745000640 1 -- 172.21.15.44:0/201974987 wait complete. 2024-09-17T05:42:06.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 Processor -- start 2024-09-17T05:42:06.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 -- start start 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f474006de50 0x7f47400aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4740072e50 0x7f4740154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47400cc480 0x7f4740155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f474016a020 con 0x7f474006de50 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4740169ea0 con 0x7f47400cc480 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f474016a1a0 con 0x7f4740072e50 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f474006de50 0x7f47400aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f474006de50 0x7f47400aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47542/0 (socket says 172.21.15.44:47542) 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 -- 172.21.15.44:0/2801614601 learned_addr learned my addr 172.21.15.44:0/2801614601 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473e800640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47400cc480 0x7f4740155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4737e00640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4740072e50 0x7f4740154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 -- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4740072e50 msgr2=0x7f4740154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4740072e50 0x7f4740154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 -- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47400cc480 msgr2=0x7f4740155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47400cc480 0x7f4740155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 -- 172.21.15.44:0/2801614601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47400a0770 con 0x7f474006de50 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4737e00640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4740072e50 0x7f4740154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f473de00640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f474006de50 0x7f47400aee50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f473000c400 tx=0x7f473000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4736000640 1 -- 172.21.15.44:0/2801614601 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730017070 con 0x7f474006de50 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4736000640 1 -- 172.21.15.44:0/2801614601 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4730005400 con 0x7f474006de50 2024-09-17T05:42:06.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4736000640 1 -- 172.21.15.44:0/2801614601 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730003860 con 0x7f474006de50 2024-09-17T05:42:06.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47400a0a50 con 0x7f474006de50 2024-09-17T05:42:06.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.775+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47400a1010 con 0x7f474006de50 2024-09-17T05:42:06.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.779+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47400a04d0 con 0x7f474006de50 2024-09-17T05:42:06.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.779+0000 7f4736000640 1 -- 172.21.15.44:0/2801614601 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f473001a070 con 0x7f474006de50 2024-09-17T05:42:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.779+0000 7f4736000640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f471c073230 0x7f471c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.779+0000 7f4736000640 1 -- 172.21.15.44:0/2801614601 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f4730093700 con 0x7f474006de50 2024-09-17T05:42:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.779+0000 7f4737e00640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f471c073230 0x7f471c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.783+0000 7f4737e00640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f471c073230 0x7f471c075740 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4728000c10 tx=0x7f4728009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.783+0000 7f4736000640 1 -- 172.21.15.44:0/2801614601 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f47400a04d0 con 0x7f474006de50 2024-09-17T05:42:06.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.955+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f474015e990 con 0x7f471c073230 2024-09-17T05:42:06.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4736000640 1 -- 172.21.15.44:0/2801614601 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252066 (secure 0 0 0) 0x7f474015e990 con 0x7f471c073230 2024-09-17T05:42:06.966 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:06.967 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:42:06.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f471c073230 msgr2=0x7f471c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f471c073230 0x7f471c075740 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4728000c10 tx=0x7f4728009040 comp rx=0 tx=0).stop 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f474006de50 msgr2=0x7f47400aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f474006de50 0x7f47400aee50 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f473000c400 tx=0x7f473000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 shutdown_connections 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f471c073230 0x7f471c075740 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47400cc480 0x7f4740155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4740072e50 0x7f4740154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 --2- 172.21.15.44:0/2801614601 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f474006de50 0x7f47400aee50 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 >> 172.21.15.44:0/2801614601 conn(0x7f47400ccaa0 msgr2=0x7f474015eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 shutdown_connections 2024-09-17T05:42:06.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:06.963+0000 7f4745000640 1 -- 172.21.15.44:0/2801614601 wait complete. 2024-09-17T05:42:06.987 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-17T05:42:06.356120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259344,"kb_used_data":9820,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715376,"statfs":{"total":773094113280,"available":772828545024,"internally_reserved":0,"allocated":10055680,"data_stored":5212640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001631"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.407019+0000","last_change":"2024-09-17T05:42:02.400764+0000","last_active":"2024-09-17T05:42:02.407019+0000","last_peered":"2024-09-17T05:42:02.407019+0000","last_clean":"2024-09-17T05:42:02.407019+0000","last_became_active":"2024-09-17T05:42:02.400454+0000","last_became_peered":"2024-09-17T05:42:02.400454+0000","last_unstale":"2024-09-17T05:42:02.407019+0000","last_undegraded":"2024-09-17T05:42:02.407019+0000","last_fullsized":"2024-09-17T05:42:02.407019+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:14.797272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379931+0000","last_change":"2024-09-17T05:42:02.399722+0000","last_active":"2024-09-17T05:42:03.379931+0000","last_peered":"2024-09-17T05:42:03.379931+0000","last_clean":"2024-09-17T05:42:03.379931+0000","last_became_active":"2024-09-17T05:42:02.398906+0000","last_became_peered":"2024-09-17T05:42:02.398906+0000","last_unstale":"2024-09-17T05:42:03.379931+0000","last_undegraded":"2024-09-17T05:42:03.379931+0000","last_fullsized":"2024-09-17T05:42:03.379931+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.925335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462788+0000","last_change":"2024-09-17T05:42:02.382411+0000","last_active":"2024-09-17T05:42:03.462788+0000","last_peered":"2024-09-17T05:42:03.462788+0000","last_clean":"2024-09-17T05:42:03.462788+0000","last_became_active":"2024-09-17T05:42:02.382113+0000","last_became_peered":"2024-09-17T05:42:02.382113+0000","last_unstale":"2024-09-17T05:42:03.462788+0000","last_undegraded":"2024-09-17T05:42:03.462788+0000","last_fullsized":"2024-09-17T05:42:03.462788+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:30.661954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460985+0000","last_change":"2024-09-17T05:42:02.399644+0000","last_active":"2024-09-17T05:42:03.460985+0000","last_peered":"2024-09-17T05:42:03.460985+0000","last_clean":"2024-09-17T05:42:03.460985+0000","last_became_active":"2024-09-17T05:42:02.399084+0000","last_became_peered":"2024-09-17T05:42:02.399084+0000","last_unstale":"2024-09-17T05:42:03.460985+0000","last_undegraded":"2024-09-17T05:42:03.460985+0000","last_fullsized":"2024-09-17T05:42:03.460985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:42.676603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378310+0000","last_change":"2024-09-17T05:42:02.384046+0000","last_active":"2024-09-17T05:42:03.378310+0000","last_peered":"2024-09-17T05:42:03.378310+0000","last_clean":"2024-09-17T05:42:03.378310+0000","last_became_active":"2024-09-17T05:42:02.383740+0000","last_became_peered":"2024-09-17T05:42:02.383740+0000","last_unstale":"2024-09-17T05:42:03.378310+0000","last_undegraded":"2024-09-17T05:42:03.378310+0000","last_fullsized":"2024-09-17T05:42:03.378310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:15.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377498+0000","last_change":"2024-09-17T05:42:02.388254+0000","last_active":"2024-09-17T05:42:03.377498+0000","last_peered":"2024-09-17T05:42:03.377498+0000","last_clean":"2024-09-17T05:42:03.377498+0000","last_became_active":"2024-09-17T05:42:02.387915+0000","last_became_peered":"2024-09-17T05:42:02.387915+0000","last_unstale":"2024-09-17T05:42:03.377498+0000","last_undegraded":"2024-09-17T05:42:03.377498+0000","last_fullsized":"2024-09-17T05:42:03.377498+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.919705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379390+0000","last_change":"2024-09-17T05:42:02.402123+0000","last_active":"2024-09-17T05:42:03.379390+0000","last_peered":"2024-09-17T05:42:03.379390+0000","last_clean":"2024-09-17T05:42:03.379390+0000","last_became_active":"2024-09-17T05:42:02.398914+0000","last_became_peered":"2024-09-17T05:42:02.398914+0000","last_unstale":"2024-09-17T05:42:03.379390+0000","last_undegraded":"2024-09-17T05:42:03.379390+0000","last_fullsized":"2024-09-17T05:42:03.379390+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:24.581599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377308+0000","last_change":"2024-09-17T05:42:02.379375+0000","last_active":"2024-09-17T05:42:03.377308+0000","last_peered":"2024-09-17T05:42:03.377308+0000","last_clean":"2024-09-17T05:42:03.377308+0000","last_became_active":"2024-09-17T05:42:02.379113+0000","last_became_peered":"2024-09-17T05:42:02.379113+0000","last_unstale":"2024-09-17T05:42:03.377308+0000","last_undegraded":"2024-09-17T05:42:03.377308+0000","last_fullsized":"2024-09-17T05:42:03.377308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.479554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379637+0000","last_change":"2024-09-17T05:42:02.413970+0000","last_active":"2024-09-17T05:42:03.379637+0000","last_peered":"2024-09-17T05:42:03.379637+0000","last_clean":"2024-09-17T05:42:03.379637+0000","last_became_active":"2024-09-17T05:42:02.412028+0000","last_became_peered":"2024-09-17T05:42:02.412028+0000","last_unstale":"2024-09-17T05:42:03.379637+0000","last_undegraded":"2024-09-17T05:42:03.379637+0000","last_fullsized":"2024-09-17T05:42:03.379637+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:37.768137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462839+0000","last_change":"2024-09-17T05:42:02.396648+0000","last_active":"2024-09-17T05:42:03.462839+0000","last_peered":"2024-09-17T05:42:03.462839+0000","last_clean":"2024-09-17T05:42:03.462839+0000","last_became_active":"2024-09-17T05:42:02.396322+0000","last_became_peered":"2024-09-17T05:42:02.396322+0000","last_unstale":"2024-09-17T05:42:03.462839+0000","last_undegraded":"2024-09-17T05:42:03.462839+0000","last_fullsized":"2024-09-17T05:42:03.462839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:25.508978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379389+0000","last_change":"2024-09-17T05:42:02.398970+0000","last_active":"2024-09-17T05:42:03.379389+0000","last_peered":"2024-09-17T05:42:03.379389+0000","last_clean":"2024-09-17T05:42:03.379389+0000","last_became_active":"2024-09-17T05:42:02.398167+0000","last_became_peered":"2024-09-17T05:42:02.398167+0000","last_unstale":"2024-09-17T05:42:03.379389+0000","last_undegraded":"2024-09-17T05:42:03.379389+0000","last_fullsized":"2024-09-17T05:42:03.379389+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:04.429005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461251+0000","last_change":"2024-09-17T05:42:02.393837+0000","last_active":"2024-09-17T05:42:03.461251+0000","last_peered":"2024-09-17T05:42:03.461251+0000","last_clean":"2024-09-17T05:42:03.461251+0000","last_became_active":"2024-09-17T05:42:02.393516+0000","last_became_peered":"2024-09-17T05:42:02.393516+0000","last_unstale":"2024-09-17T05:42:03.461251+0000","last_undegraded":"2024-09-17T05:42:03.461251+0000","last_fullsized":"2024-09-17T05:42:03.461251+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:02.375919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461248+0000","last_change":"2024-09-17T05:42:02.386146+0000","last_active":"2024-09-17T05:42:03.461248+0000","last_peered":"2024-09-17T05:42:03.461248+0000","last_clean":"2024-09-17T05:42:03.461248+0000","last_became_active":"2024-09-17T05:42:02.385842+0000","last_became_peered":"2024-09-17T05:42:02.385842+0000","last_unstale":"2024-09-17T05:42:03.461248+0000","last_undegraded":"2024-09-17T05:42:03.461248+0000","last_fullsized":"2024-09-17T05:42:03.461248+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:40.833553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461398+0000","last_change":"2024-09-17T05:42:02.382523+0000","last_active":"2024-09-17T05:42:03.461398+0000","last_peered":"2024-09-17T05:42:03.461398+0000","last_clean":"2024-09-17T05:42:03.461398+0000","last_became_active":"2024-09-17T05:42:02.382132+0000","last_became_peered":"2024-09-17T05:42:02.382132+0000","last_unstale":"2024-09-17T05:42:03.461398+0000","last_undegraded":"2024-09-17T05:42:03.461398+0000","last_fullsized":"2024-09-17T05:42:03.461398+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:33.980351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461155+0000","last_change":"2024-09-17T05:42:02.380505+0000","last_active":"2024-09-17T05:42:03.461155+0000","last_peered":"2024-09-17T05:42:03.461155+0000","last_clean":"2024-09-17T05:42:03.461155+0000","last_became_active":"2024-09-17T05:42:02.380181+0000","last_became_peered":"2024-09-17T05:42:02.380181+0000","last_unstale":"2024-09-17T05:42:03.461155+0000","last_undegraded":"2024-09-17T05:42:03.461155+0000","last_fullsized":"2024-09-17T05:42:03.461155+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:14.309843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378330+0000","last_change":"2024-09-17T05:42:02.382509+0000","last_active":"2024-09-17T05:42:03.378330+0000","last_peered":"2024-09-17T05:42:03.378330+0000","last_clean":"2024-09-17T05:42:03.378330+0000","last_became_active":"2024-09-17T05:42:02.382018+0000","last_became_peered":"2024-09-17T05:42:02.382018+0000","last_unstale":"2024-09-17T05:42:03.378330+0000","last_undegraded":"2024-09-17T05:42:03.378330+0000","last_fullsized":"2024-09-17T05:42:03.378330+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:34.617877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378265+0000","last_change":"2024-09-17T05:42:02.389716+0000","last_active":"2024-09-17T05:42:03.378265+0000","last_peered":"2024-09-17T05:42:03.378265+0000","last_clean":"2024-09-17T05:42:03.378265+0000","last_became_active":"2024-09-17T05:42:02.389212+0000","last_became_peered":"2024-09-17T05:42:02.389212+0000","last_unstale":"2024-09-17T05:42:03.378265+0000","last_undegraded":"2024-09-17T05:42:03.378265+0000","last_fullsized":"2024-09-17T05:42:03.378265+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:51.226823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462195+0000","last_change":"2024-09-17T05:42:02.389278+0000","last_active":"2024-09-17T05:42:03.462195+0000","last_peered":"2024-09-17T05:42:03.462195+0000","last_clean":"2024-09-17T05:42:03.462195+0000","last_became_active":"2024-09-17T05:42:02.388970+0000","last_became_peered":"2024-09-17T05:42:02.388970+0000","last_unstale":"2024-09-17T05:42:03.462195+0000","last_undegraded":"2024-09-17T05:42:03.462195+0000","last_fullsized":"2024-09-17T05:42:03.462195+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:53.919010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462578+0000","last_change":"2024-09-17T05:42:02.387718+0000","last_active":"2024-09-17T05:42:03.462578+0000","last_peered":"2024-09-17T05:42:03.462578+0000","last_clean":"2024-09-17T05:42:03.462578+0000","last_became_active":"2024-09-17T05:42:02.386725+0000","last_became_peered":"2024-09-17T05:42:02.386725+0000","last_unstale":"2024-09-17T05:42:03.462578+0000","last_undegraded":"2024-09-17T05:42:03.462578+0000","last_fullsized":"2024-09-17T05:42:03.462578+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:13.736593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377716+0000","last_change":"2024-09-17T05:42:02.392334+0000","last_active":"2024-09-17T05:42:03.377716+0000","last_peered":"2024-09-17T05:42:03.377716+0000","last_clean":"2024-09-17T05:42:03.377716+0000","last_became_active":"2024-09-17T05:42:02.391992+0000","last_became_peered":"2024-09-17T05:42:02.391992+0000","last_unstale":"2024-09-17T05:42:03.377716+0000","last_undegraded":"2024-09-17T05:42:03.377716+0000","last_fullsized":"2024-09-17T05:42:03.377716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:26.925335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378572+0000","last_change":"2024-09-17T05:42:02.387492+0000","last_active":"2024-09-17T05:42:03.378572+0000","last_peered":"2024-09-17T05:42:03.378572+0000","last_clean":"2024-09-17T05:42:03.378572+0000","last_became_active":"2024-09-17T05:42:02.387143+0000","last_became_peered":"2024-09-17T05:42:02.387143+0000","last_unstale":"2024-09-17T05:42:03.378572+0000","last_undegraded":"2024-09-17T05:42:03.378572+0000","last_fullsized":"2024-09-17T05:42:03.378572+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.479554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462113+0000","last_change":"2024-09-17T05:42:02.376962+0000","last_active":"2024-09-17T05:42:03.462113+0000","last_peered":"2024-09-17T05:42:03.462113+0000","last_clean":"2024-09-17T05:42:03.462113+0000","last_became_active":"2024-09-17T05:42:02.376620+0000","last_became_peered":"2024-09-17T05:42:02.376620+0000","last_unstale":"2024-09-17T05:42:03.462113+0000","last_undegraded":"2024-09-17T05:42:03.462113+0000","last_fullsized":"2024-09-17T05:42:03.462113+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:15.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377690+0000","last_change":"2024-09-17T05:42:02.405721+0000","last_active":"2024-09-17T05:42:03.377690+0000","last_peered":"2024-09-17T05:42:03.377690+0000","last_clean":"2024-09-17T05:42:03.377690+0000","last_became_active":"2024-09-17T05:42:02.404768+0000","last_became_peered":"2024-09-17T05:42:02.404768+0000","last_unstale":"2024-09-17T05:42:03.377690+0000","last_undegraded":"2024-09-17T05:42:03.377690+0000","last_fullsized":"2024-09-17T05:42:03.377690+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:46.615900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406640+0000","last_change":"2024-09-17T05:42:02.400903+0000","last_active":"2024-09-17T05:42:02.406640+0000","last_peered":"2024-09-17T05:42:02.406640+0000","last_clean":"2024-09-17T05:42:02.406640+0000","last_became_active":"2024-09-17T05:42:02.400003+0000","last_became_peered":"2024-09-17T05:42:02.400003+0000","last_unstale":"2024-09-17T05:42:02.406640+0000","last_undegraded":"2024-09-17T05:42:02.406640+0000","last_fullsized":"2024-09-17T05:42:02.406640+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:06.027710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379305+0000","last_change":"2024-09-17T05:42:02.385527+0000","last_active":"2024-09-17T05:42:03.379305+0000","last_peered":"2024-09-17T05:42:03.379305+0000","last_clean":"2024-09-17T05:42:03.379305+0000","last_became_active":"2024-09-17T05:42:02.385219+0000","last_became_peered":"2024-09-17T05:42:02.385219+0000","last_unstale":"2024-09-17T05:42:03.379305+0000","last_undegraded":"2024-09-17T05:42:03.379305+0000","last_fullsized":"2024-09-17T05:42:03.379305+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:13.736593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.380235+0000","last_change":"2024-09-17T05:42:02.386200+0000","last_active":"2024-09-17T05:42:03.380235+0000","last_peered":"2024-09-17T05:42:03.380235+0000","last_clean":"2024-09-17T05:42:03.380235+0000","last_became_active":"2024-09-17T05:42:02.385889+0000","last_became_peered":"2024-09-17T05:42:02.385889+0000","last_unstale":"2024-09-17T05:42:03.380235+0000","last_undegraded":"2024-09-17T05:42:03.380235+0000","last_fullsized":"2024-09-17T05:42:03.380235+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:25.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462149+0000","last_change":"2024-09-17T05:42:02.394501+0000","last_active":"2024-09-17T05:42:03.462149+0000","last_peered":"2024-09-17T05:42:03.462149+0000","last_clean":"2024-09-17T05:42:03.462149+0000","last_became_active":"2024-09-17T05:42:02.393977+0000","last_became_peered":"2024-09-17T05:42:02.393977+0000","last_unstale":"2024-09-17T05:42:03.462149+0000","last_undegraded":"2024-09-17T05:42:03.462149+0000","last_fullsized":"2024-09-17T05:42:03.462149+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:27.383404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460913+0000","last_change":"2024-09-17T05:42:02.392748+0000","last_active":"2024-09-17T05:42:03.460913+0000","last_peered":"2024-09-17T05:42:03.460913+0000","last_clean":"2024-09-17T05:42:03.460913+0000","last_became_active":"2024-09-17T05:42:02.392453+0000","last_became_peered":"2024-09-17T05:42:02.392453+0000","last_unstale":"2024-09-17T05:42:03.460913+0000","last_undegraded":"2024-09-17T05:42:03.460913+0000","last_fullsized":"2024-09-17T05:42:03.460913+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:32.279817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378819+0000","last_change":"2024-09-17T05:42:02.405423+0000","last_active":"2024-09-17T05:42:03.378819+0000","last_peered":"2024-09-17T05:42:03.378819+0000","last_clean":"2024-09-17T05:42:03.378819+0000","last_became_active":"2024-09-17T05:42:02.405064+0000","last_became_peered":"2024-09-17T05:42:02.405064+0000","last_unstale":"2024-09-17T05:42:03.378819+0000","last_undegraded":"2024-09-17T05:42:03.378819+0000","last_fullsized":"2024-09-17T05:42:03.378819+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.919705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377878+0000","last_change":"2024-09-17T05:42:02.381901+0000","last_active":"2024-09-17T05:42:03.377878+0000","last_peered":"2024-09-17T05:42:03.377878+0000","last_clean":"2024-09-17T05:42:03.377878+0000","last_became_active":"2024-09-17T05:42:02.381558+0000","last_became_peered":"2024-09-17T05:42:02.381558+0000","last_unstale":"2024-09-17T05:42:03.377878+0000","last_undegraded":"2024-09-17T05:42:03.377878+0000","last_fullsized":"2024-09-17T05:42:03.377878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:58.044362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461830+0000","last_change":"2024-09-17T05:42:02.392427+0000","last_active":"2024-09-17T05:42:03.461830+0000","last_peered":"2024-09-17T05:42:03.461830+0000","last_clean":"2024-09-17T05:42:03.461830+0000","last_became_active":"2024-09-17T05:42:02.392064+0000","last_became_peered":"2024-09-17T05:42:02.392064+0000","last_unstale":"2024-09-17T05:42:03.461830+0000","last_undegraded":"2024-09-17T05:42:03.461830+0000","last_fullsized":"2024-09-17T05:42:03.461830+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:58.044362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377619+0000","last_change":"2024-09-17T05:42:02.382282+0000","last_active":"2024-09-17T05:42:03.377619+0000","last_peered":"2024-09-17T05:42:03.377619+0000","last_clean":"2024-09-17T05:42:03.377619+0000","last_became_active":"2024-09-17T05:42:02.381741+0000","last_became_peered":"2024-09-17T05:42:02.381741+0000","last_unstale":"2024-09-17T05:42:03.377619+0000","last_undegraded":"2024-09-17T05:42:03.377619+0000","last_fullsized":"2024-09-17T05:42:03.377619+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.359713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406594+0000","last_change":"2024-09-17T05:42:02.401314+0000","last_active":"2024-09-17T05:42:02.406594+0000","last_peered":"2024-09-17T05:42:02.406594+0000","last_clean":"2024-09-17T05:42:02.406594+0000","last_became_active":"2024-09-17T05:42:02.400870+0000","last_became_peered":"2024-09-17T05:42:02.400870+0000","last_unstale":"2024-09-17T05:42:02.406594+0000","last_undegraded":"2024-09-17T05:42:02.406594+0000","last_fullsized":"2024-09-17T05:42:02.406594+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:44.538009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"89'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379690+0000","last_change":"2024-09-17T05:42:01.377350+0000","last_active":"2024-09-17T05:42:03.379690+0000","last_peered":"2024-09-17T05:42:03.379690+0000","last_clean":"2024-09-17T05:42:03.379690+0000","last_became_active":"2024-09-17T05:42:01.377033+0000","last_became_peered":"2024-09-17T05:42:01.377033+0000","last_unstale":"2024-09-17T05:42:03.379690+0000","last_undegraded":"2024-09-17T05:42:03.379690+0000","last_fullsized":"2024-09-17T05:42:03.379690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:12.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377693+0000","last_change":"2024-09-17T05:42:02.398902+0000","last_active":"2024-09-17T05:42:03.377693+0000","last_peered":"2024-09-17T05:42:03.377693+0000","last_clean":"2024-09-17T05:42:03.377693+0000","last_became_active":"2024-09-17T05:42:02.398509+0000","last_became_peered":"2024-09-17T05:42:02.398509+0000","last_unstale":"2024-09-17T05:42:03.377693+0000","last_undegraded":"2024-09-17T05:42:03.377693+0000","last_fullsized":"2024-09-17T05:42:03.377693+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:36.150790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461395+0000","last_change":"2024-09-17T05:42:01.394241+0000","last_active":"2024-09-17T05:42:03.461395+0000","last_peered":"2024-09-17T05:42:03.461395+0000","last_clean":"2024-09-17T05:42:03.461395+0000","last_became_active":"2024-09-17T05:42:01.393886+0000","last_became_peered":"2024-09-17T05:42:01.393886+0000","last_unstale":"2024-09-17T05:42:03.461395+0000","last_undegraded":"2024-09-17T05:42:03.461395+0000","last_fullsized":"2024-09-17T05:42:03.461395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:52.915565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379410+0000","last_change":"2024-09-17T05:42:02.400684+0000","last_active":"2024-09-17T05:42:03.379410+0000","last_peered":"2024-09-17T05:42:03.379410+0000","last_clean":"2024-09-17T05:42:03.379410+0000","last_became_active":"2024-09-17T05:42:02.400387+0000","last_became_peered":"2024-09-17T05:42:02.400387+0000","last_unstale":"2024-09-17T05:42:03.379410+0000","last_undegraded":"2024-09-17T05:42:03.379410+0000","last_fullsized":"2024-09-17T05:42:03.379410+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:15.680350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378851+0000","last_change":"2024-09-17T05:42:01.383164+0000","last_active":"2024-09-17T05:42:03.378851+0000","last_peered":"2024-09-17T05:42:03.378851+0000","last_clean":"2024-09-17T05:42:03.378851+0000","last_became_active":"2024-09-17T05:42:01.382671+0000","last_became_peered":"2024-09-17T05:42:01.382671+0000","last_unstale":"2024-09-17T05:42:03.378851+0000","last_undegraded":"2024-09-17T05:42:03.378851+0000","last_fullsized":"2024-09-17T05:42:03.378851+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:36.574807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462059+0000","last_change":"2024-09-17T05:42:02.395948+0000","last_active":"2024-09-17T05:42:03.462059+0000","last_peered":"2024-09-17T05:42:03.462059+0000","last_clean":"2024-09-17T05:42:03.462059+0000","last_became_active":"2024-09-17T05:42:02.395642+0000","last_became_peered":"2024-09-17T05:42:02.395642+0000","last_unstale":"2024-09-17T05:42:03.462059+0000","last_undegraded":"2024-09-17T05:42:03.462059+0000","last_fullsized":"2024-09-17T05:42:03.462059+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:34.502981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461240+0000","last_change":"2024-09-17T05:42:01.384678+0000","last_active":"2024-09-17T05:42:03.461240+0000","last_peered":"2024-09-17T05:42:03.461240+0000","last_clean":"2024-09-17T05:42:03.461240+0000","last_became_active":"2024-09-17T05:42:01.384361+0000","last_became_peered":"2024-09-17T05:42:01.384361+0000","last_unstale":"2024-09-17T05:42:03.461240+0000","last_undegraded":"2024-09-17T05:42:03.461240+0000","last_fullsized":"2024-09-17T05:42:03.461240+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:33.499537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460574+0000","last_change":"2024-09-17T05:42:02.388351+0000","last_active":"2024-09-17T05:42:03.460574+0000","last_peered":"2024-09-17T05:42:03.460574+0000","last_clean":"2024-09-17T05:42:03.460574+0000","last_became_active":"2024-09-17T05:42:02.387995+0000","last_became_peered":"2024-09-17T05:42:02.387995+0000","last_unstale":"2024-09-17T05:42:03.460574+0000","last_undegraded":"2024-09-17T05:42:03.460574+0000","last_fullsized":"2024-09-17T05:42:03.460574+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:43.608918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462075+0000","last_change":"2024-09-17T05:42:01.380425+0000","last_active":"2024-09-17T05:42:03.462075+0000","last_peered":"2024-09-17T05:42:03.462075+0000","last_clean":"2024-09-17T05:42:03.462075+0000","last_became_active":"2024-09-17T05:42:01.380099+0000","last_became_peered":"2024-09-17T05:42:01.380099+0000","last_unstale":"2024-09-17T05:42:03.462075+0000","last_undegraded":"2024-09-17T05:42:03.462075+0000","last_fullsized":"2024-09-17T05:42:03.462075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:42.605473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379146+0000","last_change":"2024-09-17T05:42:02.398650+0000","last_active":"2024-09-17T05:42:03.379146+0000","last_peered":"2024-09-17T05:42:03.379146+0000","last_clean":"2024-09-17T05:42:03.379146+0000","last_became_active":"2024-09-17T05:42:02.398283+0000","last_became_peered":"2024-09-17T05:42:02.398283+0000","last_unstale":"2024-09-17T05:42:03.379146+0000","last_undegraded":"2024-09-17T05:42:03.379146+0000","last_fullsized":"2024-09-17T05:42:03.379146+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:15.116583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460425+0000","last_change":"2024-09-17T05:42:01.381949+0000","last_active":"2024-09-17T05:42:03.460425+0000","last_peered":"2024-09-17T05:42:03.460425+0000","last_clean":"2024-09-17T05:42:03.460425+0000","last_became_active":"2024-09-17T05:42:01.381515+0000","last_became_peered":"2024-09-17T05:42:01.381515+0000","last_unstale":"2024-09-17T05:42:03.460425+0000","last_undegraded":"2024-09-17T05:42:03.460425+0000","last_fullsized":"2024-09-17T05:42:03.460425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:36.574807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378026+0000","last_change":"2024-09-17T05:42:02.382120+0000","last_active":"2024-09-17T05:42:03.378026+0000","last_peered":"2024-09-17T05:42:03.378026+0000","last_clean":"2024-09-17T05:42:03.378026+0000","last_became_active":"2024-09-17T05:42:02.381724+0000","last_became_peered":"2024-09-17T05:42:02.381724+0000","last_unstale":"2024-09-17T05:42:03.378026+0000","last_undegraded":"2024-09-17T05:42:03.378026+0000","last_fullsized":"2024-09-17T05:42:03.378026+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:25.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461588+0000","last_change":"2024-09-17T05:42:01.393625+0000","last_active":"2024-09-17T05:42:03.461588+0000","last_peered":"2024-09-17T05:42:03.461588+0000","last_clean":"2024-09-17T05:42:03.461588+0000","last_became_active":"2024-09-17T05:42:01.392737+0000","last_became_peered":"2024-09-17T05:42:01.392737+0000","last_unstale":"2024-09-17T05:42:03.461588+0000","last_undegraded":"2024-09-17T05:42:03.461588+0000","last_fullsized":"2024-09-17T05:42:03.461588+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:53.758596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406789+0000","last_change":"2024-09-17T05:42:02.401506+0000","last_active":"2024-09-17T05:42:02.406789+0000","last_peered":"2024-09-17T05:42:02.406789+0000","last_clean":"2024-09-17T05:42:02.406789+0000","last_became_active":"2024-09-17T05:42:02.401224+0000","last_became_peered":"2024-09-17T05:42:02.401224+0000","last_unstale":"2024-09-17T05:42:02.406789+0000","last_undegraded":"2024-09-17T05:42:02.406789+0000","last_fullsized":"2024-09-17T05:42:02.406789+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:36.929805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377514+0000","last_change":"2024-09-17T05:42:01.379486+0000","last_active":"2024-09-17T05:42:03.377514+0000","last_peered":"2024-09-17T05:42:03.377514+0000","last_clean":"2024-09-17T05:42:03.377514+0000","last_became_active":"2024-09-17T05:42:01.379109+0000","last_became_peered":"2024-09-17T05:42:01.379109+0000","last_unstale":"2024-09-17T05:42:03.377514+0000","last_undegraded":"2024-09-17T05:42:03.377514+0000","last_fullsized":"2024-09-17T05:42:03.377514+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:49.017421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378399+0000","last_change":"2024-09-17T05:42:02.385785+0000","last_active":"2024-09-17T05:42:03.378399+0000","last_peered":"2024-09-17T05:42:03.378399+0000","last_clean":"2024-09-17T05:42:03.378399+0000","last_became_active":"2024-09-17T05:42:02.385452+0000","last_became_peered":"2024-09-17T05:42:02.385452+0000","last_unstale":"2024-09-17T05:42:03.378399+0000","last_undegraded":"2024-09-17T05:42:03.378399+0000","last_fullsized":"2024-09-17T05:42:03.378399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:56.312006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379827+0000","last_change":"2024-09-17T05:42:01.383301+0000","last_active":"2024-09-17T05:42:03.379827+0000","last_peered":"2024-09-17T05:42:03.379827+0000","last_clean":"2024-09-17T05:42:03.379827+0000","last_became_active":"2024-09-17T05:42:01.382176+0000","last_became_peered":"2024-09-17T05:42:01.382176+0000","last_unstale":"2024-09-17T05:42:03.379827+0000","last_undegraded":"2024-09-17T05:42:03.379827+0000","last_fullsized":"2024-09-17T05:42:03.379827+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:04.830724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379745+0000","last_change":"2024-09-17T05:42:02.402518+0000","last_active":"2024-09-17T05:42:03.379745+0000","last_peered":"2024-09-17T05:42:03.379745+0000","last_clean":"2024-09-17T05:42:03.379745+0000","last_became_active":"2024-09-17T05:42:02.401952+0000","last_became_peered":"2024-09-17T05:42:02.401952+0000","last_unstale":"2024-09-17T05:42:03.379745+0000","last_undegraded":"2024-09-17T05:42:03.379745+0000","last_fullsized":"2024-09-17T05:42:03.379745+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:29.385917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462366+0000","last_change":"2024-09-17T05:42:01.391909+0000","last_active":"2024-09-17T05:42:03.462366+0000","last_peered":"2024-09-17T05:42:03.462366+0000","last_clean":"2024-09-17T05:42:03.462366+0000","last_became_active":"2024-09-17T05:42:01.391566+0000","last_became_peered":"2024-09-17T05:42:01.391566+0000","last_unstale":"2024-09-17T05:42:03.462366+0000","last_undegraded":"2024-09-17T05:42:03.462366+0000","last_fullsized":"2024-09-17T05:42:03.462366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:38.797307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.407959+0000","last_change":"2024-09-17T05:42:02.404888+0000","last_active":"2024-09-17T05:42:02.407959+0000","last_peered":"2024-09-17T05:42:02.407959+0000","last_clean":"2024-09-17T05:42:02.407959+0000","last_became_active":"2024-09-17T05:42:02.404579+0000","last_became_peered":"2024-09-17T05:42:02.404579+0000","last_unstale":"2024-09-17T05:42:02.407959+0000","last_undegraded":"2024-09-17T05:42:02.407959+0000","last_fullsized":"2024-09-17T05:42:02.407959+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:10:23.427202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"89'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.380054+0000","last_change":"2024-09-17T05:42:01.391399+0000","last_active":"2024-09-17T05:42:03.380054+0000","last_peered":"2024-09-17T05:42:03.380054+0000","last_clean":"2024-09-17T05:42:03.380054+0000","last_became_active":"2024-09-17T05:42:01.390504+0000","last_became_peered":"2024-09-17T05:42:01.390504+0000","last_unstale":"2024-09-17T05:42:03.380054+0000","last_undegraded":"2024-09-17T05:42:03.380054+0000","last_fullsized":"2024-09-17T05:42:03.380054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:06.232004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378258+0000","last_change":"2024-09-17T05:42:02.379503+0000","last_active":"2024-09-17T05:42:03.378258+0000","last_peered":"2024-09-17T05:42:03.378258+0000","last_clean":"2024-09-17T05:42:03.378258+0000","last_became_active":"2024-09-17T05:42:02.379059+0000","last_became_peered":"2024-09-17T05:42:02.379059+0000","last_unstale":"2024-09-17T05:42:03.378258+0000","last_undegraded":"2024-09-17T05:42:03.378258+0000","last_fullsized":"2024-09-17T05:42:03.378258+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:53.344031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"89'6","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.417675+0000","last_change":"2024-09-17T05:42:01.392922+0000","last_active":"2024-09-17T05:42:02.417675+0000","last_peered":"2024-09-17T05:42:02.417675+0000","last_clean":"2024-09-17T05:42:02.417675+0000","last_became_active":"2024-09-17T05:42:01.392545+0000","last_became_peered":"2024-09-17T05:42:01.392545+0000","last_unstale":"2024-09-17T05:42:02.417675+0000","last_undegraded":"2024-09-17T05:42:02.417675+0000","last_fullsized":"2024-09-17T05:42:02.417675+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:10.566180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406668+0000","last_change":"2024-09-17T05:42:02.402389+0000","last_active":"2024-09-17T05:42:02.406668+0000","last_peered":"2024-09-17T05:42:02.406668+0000","last_clean":"2024-09-17T05:42:02.406668+0000","last_became_active":"2024-09-17T05:42:02.400017+0000","last_became_peered":"2024-09-17T05:42:02.400017+0000","last_unstale":"2024-09-17T05:42:02.406668+0000","last_undegraded":"2024-09-17T05:42:02.406668+0000","last_fullsized":"2024-09-17T05:42:02.406668+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:31.496288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378649+0000","last_change":"2024-09-17T05:42:01.385821+0000","last_active":"2024-09-17T05:42:03.378649+0000","last_peered":"2024-09-17T05:42:03.378649+0000","last_clean":"2024-09-17T05:42:03.378649+0000","last_became_active":"2024-09-17T05:42:01.384735+0000","last_became_peered":"2024-09-17T05:42:01.384735+0000","last_unstale":"2024-09-17T05:42:03.378649+0000","last_undegraded":"2024-09-17T05:42:03.378649+0000","last_fullsized":"2024-09-17T05:42:03.378649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.095472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377709+0000","last_change":"2024-09-17T05:42:02.384598+0000","last_active":"2024-09-17T05:42:03.377709+0000","last_peered":"2024-09-17T05:42:03.377709+0000","last_clean":"2024-09-17T05:42:03.377709+0000","last_became_active":"2024-09-17T05:42:02.383432+0000","last_became_peered":"2024-09-17T05:42:02.383432+0000","last_unstale":"2024-09-17T05:42:03.377709+0000","last_undegraded":"2024-09-17T05:42:03.377709+0000","last_fullsized":"2024-09-17T05:42:03.377709+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:55:56.036238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.390694+0000","last_change":"2024-09-17T05:42:01.382299+0000","last_active":"2024-09-17T05:42:02.390694+0000","last_peered":"2024-09-17T05:42:02.390694+0000","last_clean":"2024-09-17T05:42:02.390694+0000","last_became_active":"2024-09-17T05:42:01.379575+0000","last_became_peered":"2024-09-17T05:42:01.379575+0000","last_unstale":"2024-09-17T05:42:02.390694+0000","last_undegraded":"2024-09-17T05:42:02.390694+0000","last_fullsized":"2024-09-17T05:42:02.390694+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:44.433844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406482+0000","last_change":"2024-09-17T05:42:02.398913+0000","last_active":"2024-09-17T05:42:02.406482+0000","last_peered":"2024-09-17T05:42:02.406482+0000","last_clean":"2024-09-17T05:42:02.406482+0000","last_became_active":"2024-09-17T05:42:02.398604+0000","last_became_peered":"2024-09-17T05:42:02.398604+0000","last_unstale":"2024-09-17T05:42:02.406482+0000","last_undegraded":"2024-09-17T05:42:02.406482+0000","last_fullsized":"2024-09-17T05:42:02.406482+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:19.524186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.399190+0000","last_change":"2024-09-17T05:42:01.383282+0000","last_active":"2024-09-17T05:42:02.399190+0000","last_peered":"2024-09-17T05:42:02.399190+0000","last_clean":"2024-09-17T05:42:02.399190+0000","last_became_active":"2024-09-17T05:42:01.382967+0000","last_became_peered":"2024-09-17T05:42:01.382967+0000","last_unstale":"2024-09-17T05:42:02.399190+0000","last_undegraded":"2024-09-17T05:42:02.399190+0000","last_fullsized":"2024-09-17T05:42:02.399190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:45.015065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461495+0000","last_change":"2024-09-17T05:42:02.389461+0000","last_active":"2024-09-17T05:42:03.461495+0000","last_peered":"2024-09-17T05:42:03.461495+0000","last_clean":"2024-09-17T05:42:03.461495+0000","last_became_active":"2024-09-17T05:42:02.389095+0000","last_became_peered":"2024-09-17T05:42:02.389095+0000","last_unstale":"2024-09-17T05:42:03.461495+0000","last_undegraded":"2024-09-17T05:42:03.461495+0000","last_fullsized":"2024-09-17T05:42:03.461495+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:16.136718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"89'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460613+0000","last_change":"2024-09-17T05:42:01.387054+0000","last_active":"2024-09-17T05:42:03.460613+0000","last_peered":"2024-09-17T05:42:03.460613+0000","last_clean":"2024-09-17T05:42:03.460613+0000","last_became_active":"2024-09-17T05:42:01.386519+0000","last_became_peered":"2024-09-17T05:42:01.386519+0000","last_unstale":"2024-09-17T05:42:03.460613+0000","last_undegraded":"2024-09-17T05:42:03.460613+0000","last_fullsized":"2024-09-17T05:42:03.460613+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:39.069559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460945+0000","last_change":"2024-09-17T05:42:02.391758+0000","last_active":"2024-09-17T05:42:03.460945+0000","last_peered":"2024-09-17T05:42:03.460945+0000","last_clean":"2024-09-17T05:42:03.460945+0000","last_became_active":"2024-09-17T05:42:02.391449+0000","last_became_peered":"2024-09-17T05:42:02.391449+0000","last_unstale":"2024-09-17T05:42:03.460945+0000","last_undegraded":"2024-09-17T05:42:03.460945+0000","last_fullsized":"2024-09-17T05:42:03.460945+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:45.239653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462542+0000","last_change":"2024-09-17T05:42:01.395085+0000","last_active":"2024-09-17T05:42:03.462542+0000","last_peered":"2024-09-17T05:42:03.462542+0000","last_clean":"2024-09-17T05:42:03.462542+0000","last_became_active":"2024-09-17T05:42:01.394637+0000","last_became_peered":"2024-09-17T05:42:01.394637+0000","last_unstale":"2024-09-17T05:42:03.462542+0000","last_undegraded":"2024-09-17T05:42:03.462542+0000","last_fullsized":"2024-09-17T05:42:03.462542+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:10.448953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379980+0000","last_change":"2024-09-17T05:42:02.399057+0000","last_active":"2024-09-17T05:42:03.379980+0000","last_peered":"2024-09-17T05:42:03.379980+0000","last_clean":"2024-09-17T05:42:03.379980+0000","last_became_active":"2024-09-17T05:42:02.398644+0000","last_became_peered":"2024-09-17T05:42:02.398644+0000","last_unstale":"2024-09-17T05:42:03.379980+0000","last_undegraded":"2024-09-17T05:42:03.379980+0000","last_fullsized":"2024-09-17T05:42:03.379980+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:54.833682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461456+0000","last_change":"2024-09-17T05:42:01.389508+0000","last_active":"2024-09-17T05:42:03.461456+0000","last_peered":"2024-09-17T05:42:03.461456+0000","last_clean":"2024-09-17T05:42:03.461456+0000","last_became_active":"2024-09-17T05:42:01.389169+0000","last_became_peered":"2024-09-17T05:42:01.389169+0000","last_unstale":"2024-09-17T05:42:03.461456+0000","last_undegraded":"2024-09-17T05:42:03.461456+0000","last_fullsized":"2024-09-17T05:42:03.461456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:38.993417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.380077+0000","last_change":"2024-09-17T05:42:02.388705+0000","last_active":"2024-09-17T05:42:03.380077+0000","last_peered":"2024-09-17T05:42:03.380077+0000","last_clean":"2024-09-17T05:42:03.380077+0000","last_became_active":"2024-09-17T05:42:02.388317+0000","last_became_peered":"2024-09-17T05:42:02.388317+0000","last_unstale":"2024-09-17T05:42:03.380077+0000","last_undegraded":"2024-09-17T05:42:03.380077+0000","last_fullsized":"2024-09-17T05:42:03.380077+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.919758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"89'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461328+0000","last_change":"2024-09-17T05:42:01.386786+0000","last_active":"2024-09-17T05:42:03.461328+0000","last_peered":"2024-09-17T05:42:03.461328+0000","last_clean":"2024-09-17T05:42:03.461328+0000","last_became_active":"2024-09-17T05:42:01.386470+0000","last_became_peered":"2024-09-17T05:42:01.386470+0000","last_unstale":"2024-09-17T05:42:03.461328+0000","last_undegraded":"2024-09-17T05:42:03.461328+0000","last_fullsized":"2024-09-17T05:42:03.461328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:26.379959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377899+0000","last_change":"2024-09-17T05:42:02.391101+0000","last_active":"2024-09-17T05:42:03.377899+0000","last_peered":"2024-09-17T05:42:03.377899+0000","last_clean":"2024-09-17T05:42:03.377899+0000","last_became_active":"2024-09-17T05:42:02.390616+0000","last_became_peered":"2024-09-17T05:42:02.390616+0000","last_unstale":"2024-09-17T05:42:03.377899+0000","last_undegraded":"2024-09-17T05:42:03.377899+0000","last_fullsized":"2024-09-17T05:42:03.377899+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:58.919758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379010+0000","last_change":"2024-09-17T05:42:01.392861+0000","last_active":"2024-09-17T05:42:03.379010+0000","last_peered":"2024-09-17T05:42:03.379010+0000","last_clean":"2024-09-17T05:42:03.379010+0000","last_became_active":"2024-09-17T05:42:01.392501+0000","last_became_peered":"2024-09-17T05:42:01.392501+0000","last_unstale":"2024-09-17T05:42:03.379010+0000","last_undegraded":"2024-09-17T05:42:03.379010+0000","last_fullsized":"2024-09-17T05:42:03.379010+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:33.614432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461336+0000","last_change":"2024-09-17T05:42:02.382996+0000","last_active":"2024-09-17T05:42:03.461336+0000","last_peered":"2024-09-17T05:42:03.461336+0000","last_clean":"2024-09-17T05:42:03.461336+0000","last_became_active":"2024-09-17T05:42:02.382571+0000","last_became_peered":"2024-09-17T05:42:02.382571+0000","last_unstale":"2024-09-17T05:42:03.461336+0000","last_undegraded":"2024-09-17T05:42:03.461336+0000","last_fullsized":"2024-09-17T05:42:03.461336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:32.571651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377611+0000","last_change":"2024-09-17T05:42:01.380371+0000","last_active":"2024-09-17T05:42:03.377611+0000","last_peered":"2024-09-17T05:42:03.377611+0000","last_clean":"2024-09-17T05:42:03.377611+0000","last_became_active":"2024-09-17T05:42:01.380060+0000","last_became_peered":"2024-09-17T05:42:01.380060+0000","last_unstale":"2024-09-17T05:42:03.377611+0000","last_undegraded":"2024-09-17T05:42:03.377611+0000","last_fullsized":"2024-09-17T05:42:03.377611+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:47.789926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462115+0000","last_change":"2024-09-17T05:42:02.387162+0000","last_active":"2024-09-17T05:42:03.462115+0000","last_peered":"2024-09-17T05:42:03.462115+0000","last_clean":"2024-09-17T05:42:03.462115+0000","last_became_active":"2024-09-17T05:42:02.385971+0000","last_became_peered":"2024-09-17T05:42:02.385971+0000","last_unstale":"2024-09-17T05:42:03.462115+0000","last_undegraded":"2024-09-17T05:42:03.462115+0000","last_fullsized":"2024-09-17T05:42:03.462115+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:34:37.885645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461257+0000","last_change":"2024-09-17T05:42:01.384912+0000","last_active":"2024-09-17T05:42:03.461257+0000","last_peered":"2024-09-17T05:42:03.461257+0000","last_clean":"2024-09-17T05:42:03.461257+0000","last_became_active":"2024-09-17T05:42:01.384611+0000","last_became_peered":"2024-09-17T05:42:01.384611+0000","last_unstale":"2024-09-17T05:42:03.461257+0000","last_undegraded":"2024-09-17T05:42:03.461257+0000","last_fullsized":"2024-09-17T05:42:03.461257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.095472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.406755+0000","last_change":"2024-09-17T05:42:02.401618+0000","last_active":"2024-09-17T05:42:02.406755+0000","last_peered":"2024-09-17T05:42:02.406755+0000","last_clean":"2024-09-17T05:42:02.406755+0000","last_became_active":"2024-09-17T05:42:02.401300+0000","last_became_peered":"2024-09-17T05:42:02.401300+0000","last_unstale":"2024-09-17T05:42:02.406755+0000","last_undegraded":"2024-09-17T05:42:02.406755+0000","last_fullsized":"2024-09-17T05:42:02.406755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:22.986658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460659+0000","last_change":"2024-09-17T05:42:01.387129+0000","last_active":"2024-09-17T05:42:03.460659+0000","last_peered":"2024-09-17T05:42:03.460659+0000","last_clean":"2024-09-17T05:42:03.460659+0000","last_became_active":"2024-09-17T05:42:01.386812+0000","last_became_peered":"2024-09-17T05:42:01.386812+0000","last_unstale":"2024-09-17T05:42:03.460659+0000","last_undegraded":"2024-09-17T05:42:03.460659+0000","last_fullsized":"2024-09-17T05:42:03.460659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:12.942239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462230+0000","last_change":"2024-09-17T05:42:02.378921+0000","last_active":"2024-09-17T05:42:03.462230+0000","last_peered":"2024-09-17T05:42:03.462230+0000","last_clean":"2024-09-17T05:42:03.462230+0000","last_became_active":"2024-09-17T05:42:02.378574+0000","last_became_peered":"2024-09-17T05:42:02.378574+0000","last_unstale":"2024-09-17T05:42:03.462230+0000","last_undegraded":"2024-09-17T05:42:03.462230+0000","last_fullsized":"2024-09-17T05:42:03.462230+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.479554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"89'2","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379794+0000","last_change":"2024-09-17T05:42:01.395387+0000","last_active":"2024-09-17T05:42:03.379794+0000","last_peered":"2024-09-17T05:42:03.379794+0000","last_clean":"2024-09-17T05:42:03.379794+0000","last_became_active":"2024-09-17T05:42:01.394460+0000","last_became_peered":"2024-09-17T05:42:01.394460+0000","last_unstale":"2024-09-17T05:42:03.379794+0000","last_undegraded":"2024-09-17T05:42:03.379794+0000","last_fullsized":"2024-09-17T05:42:03.379794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:51.445273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.460903+0000","last_change":"2024-09-17T05:42:02.391921+0000","last_active":"2024-09-17T05:42:03.460903+0000","last_peered":"2024-09-17T05:42:03.460903+0000","last_clean":"2024-09-17T05:42:03.460903+0000","last_became_active":"2024-09-17T05:42:02.391477+0000","last_became_peered":"2024-09-17T05:42:02.391477+0000","last_unstale":"2024-09-17T05:42:03.460903+0000","last_undegraded":"2024-09-17T05:42:03.460903+0000","last_fullsized":"2024-09-17T05:42:03.460903+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.452398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"90'1","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379594+0000","last_change":"2024-09-17T05:42:01.389386+0000","last_active":"2024-09-17T05:42:03.379594+0000","last_peered":"2024-09-17T05:42:03.379594+0000","last_clean":"2024-09-17T05:42:03.379594+0000","last_became_active":"2024-09-17T05:42:01.389058+0000","last_became_peered":"2024-09-17T05:42:01.389058+0000","last_unstale":"2024-09-17T05:42:03.379594+0000","last_undegraded":"2024-09-17T05:42:03.379594+0000","last_fullsized":"2024-09-17T05:42:03.379594+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:50.223378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461408+0000","last_change":"2024-09-17T05:42:02.384531+0000","last_active":"2024-09-17T05:42:03.461408+0000","last_peered":"2024-09-17T05:42:03.461408+0000","last_clean":"2024-09-17T05:42:03.461408+0000","last_became_active":"2024-09-17T05:42:02.383833+0000","last_became_peered":"2024-09-17T05:42:02.383833+0000","last_unstale":"2024-09-17T05:42:03.461408+0000","last_undegraded":"2024-09-17T05:42:03.461408+0000","last_fullsized":"2024-09-17T05:42:03.461408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:27.238949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462442+0000","last_change":"2024-09-17T05:42:01.380566+0000","last_active":"2024-09-17T05:42:03.462442+0000","last_peered":"2024-09-17T05:42:03.462442+0000","last_clean":"2024-09-17T05:42:03.462442+0000","last_became_active":"2024-09-17T05:42:01.380254+0000","last_became_peered":"2024-09-17T05:42:01.380254+0000","last_unstale":"2024-09-17T05:42:03.462442+0000","last_undegraded":"2024-09-17T05:42:03.462442+0000","last_fullsized":"2024-09-17T05:42:03.462442+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:06.460880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379755+0000","last_change":"2024-09-17T05:42:02.388785+0000","last_active":"2024-09-17T05:42:03.379755+0000","last_peered":"2024-09-17T05:42:03.379755+0000","last_clean":"2024-09-17T05:42:03.379755+0000","last_became_active":"2024-09-17T05:42:02.388430+0000","last_became_peered":"2024-09-17T05:42:02.388430+0000","last_unstale":"2024-09-17T05:42:03.379755+0000","last_undegraded":"2024-09-17T05:42:03.379755+0000","last_fullsized":"2024-09-17T05:42:03.379755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:36.150790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379492+0000","last_change":"2024-09-17T05:42:01.391762+0000","last_active":"2024-09-17T05:42:03.379492+0000","last_peered":"2024-09-17T05:42:03.379492+0000","last_clean":"2024-09-17T05:42:03.379492+0000","last_became_active":"2024-09-17T05:42:01.391384+0000","last_became_peered":"2024-09-17T05:42:01.391384+0000","last_unstale":"2024-09-17T05:42:03.379492+0000","last_undegraded":"2024-09-17T05:42:03.379492+0000","last_fullsized":"2024-09-17T05:42:03.379492+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:31.648344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378242+0000","last_change":"2024-09-17T05:42:02.390861+0000","last_active":"2024-09-17T05:42:03.378242+0000","last_peered":"2024-09-17T05:42:03.378242+0000","last_clean":"2024-09-17T05:42:03.378242+0000","last_became_active":"2024-09-17T05:42:02.390231+0000","last_became_peered":"2024-09-17T05:42:02.390231+0000","last_unstale":"2024-09-17T05:42:03.378242+0000","last_undegraded":"2024-09-17T05:42:03.378242+0000","last_fullsized":"2024-09-17T05:42:03.378242+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:52.448718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.390481+0000","last_change":"2024-09-17T05:42:01.384399+0000","last_active":"2024-09-17T05:42:02.390481+0000","last_peered":"2024-09-17T05:42:02.390481+0000","last_clean":"2024-09-17T05:42:02.390481+0000","last_became_active":"2024-09-17T05:42:01.383920+0000","last_became_peered":"2024-09-17T05:42:01.383920+0000","last_unstale":"2024-09-17T05:42:02.390481+0000","last_undegraded":"2024-09-17T05:42:02.390481+0000","last_fullsized":"2024-09-17T05:42:02.390481+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:27.566821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.461404+0000","last_change":"2024-09-17T05:42:02.391017+0000","last_active":"2024-09-17T05:42:03.461404+0000","last_peered":"2024-09-17T05:42:03.461404+0000","last_clean":"2024-09-17T05:42:03.461404+0000","last_became_active":"2024-09-17T05:42:02.390542+0000","last_became_peered":"2024-09-17T05:42:02.390542+0000","last_unstale":"2024-09-17T05:42:03.461404+0000","last_undegraded":"2024-09-17T05:42:03.461404+0000","last_fullsized":"2024-09-17T05:42:03.461404+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:44.166197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.378000+0000","last_change":"2024-09-17T05:42:01.381849+0000","last_active":"2024-09-17T05:42:03.378000+0000","last_peered":"2024-09-17T05:42:03.378000+0000","last_clean":"2024-09-17T05:42:03.378000+0000","last_became_active":"2024-09-17T05:42:01.380680+0000","last_became_peered":"2024-09-17T05:42:01.380680+0000","last_unstale":"2024-09-17T05:42:03.378000+0000","last_undegraded":"2024-09-17T05:42:03.378000+0000","last_fullsized":"2024-09-17T05:42:03.378000+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:58.090612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.462294+0000","last_change":"2024-09-17T05:42:02.391899+0000","last_active":"2024-09-17T05:42:03.462294+0000","last_peered":"2024-09-17T05:42:03.462294+0000","last_clean":"2024-09-17T05:42:03.462294+0000","last_became_active":"2024-09-17T05:42:02.391575+0000","last_became_peered":"2024-09-17T05:42:02.391575+0000","last_unstale":"2024-09-17T05:42:03.462294+0000","last_undegraded":"2024-09-17T05:42:03.462294+0000","last_fullsized":"2024-09-17T05:42:03.462294+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.919705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377761+0000","last_change":"2024-09-17T05:42:01.383420+0000","last_active":"2024-09-17T05:42:03.377761+0000","last_peered":"2024-09-17T05:42:03.377761+0000","last_clean":"2024-09-17T05:42:03.377761+0000","last_became_active":"2024-09-17T05:42:01.382660+0000","last_became_peered":"2024-09-17T05:42:01.382660+0000","last_unstale":"2024-09-17T05:42:03.377761+0000","last_undegraded":"2024-09-17T05:42:03.377761+0000","last_fullsized":"2024-09-17T05:42:03.377761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:37.304976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377512+0000","last_change":"2024-09-17T05:42:02.392384+0000","last_active":"2024-09-17T05:42:03.377512+0000","last_peered":"2024-09-17T05:42:03.377512+0000","last_clean":"2024-09-17T05:42:03.377512+0000","last_became_active":"2024-09-17T05:42:02.392069+0000","last_became_peered":"2024-09-17T05:42:02.392069+0000","last_unstale":"2024-09-17T05:42:03.377512+0000","last_undegraded":"2024-09-17T05:42:03.377512+0000","last_fullsized":"2024-09-17T05:42:03.377512+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:13.736593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377516+0000","last_change":"2024-09-17T05:42:01.377960+0000","last_active":"2024-09-17T05:42:03.377516+0000","last_peered":"2024-09-17T05:42:03.377516+0000","last_clean":"2024-09-17T05:42:03.377516+0000","last_became_active":"2024-09-17T05:42:01.376618+0000","last_became_peered":"2024-09-17T05:42:01.376618+0000","last_unstale":"2024-09-17T05:42:03.377516+0000","last_undegraded":"2024-09-17T05:42:03.377516+0000","last_fullsized":"2024-09-17T05:42:03.377516+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:28.701764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.379534+0000","last_change":"2024-09-17T05:42:02.401437+0000","last_active":"2024-09-17T05:42:03.379534+0000","last_peered":"2024-09-17T05:42:03.379534+0000","last_clean":"2024-09-17T05:42:03.379534+0000","last_became_active":"2024-09-17T05:42:02.401106+0000","last_became_peered":"2024-09-17T05:42:02.401106+0000","last_unstale":"2024-09-17T05:42:03.379534+0000","last_undegraded":"2024-09-17T05:42:03.379534+0000","last_fullsized":"2024-09-17T05:42:03.379534+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:01.349987+0000","last_clean_scrub_stamp":"2024-09-17T05:42:01.349987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:10.359713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-17T05:42:02.390859+0000","last_change":"2024-09-17T05:42:01.393386+0000","last_active":"2024-09-17T05:42:02.390859+0000","last_peered":"2024-09-17T05:42:02.390859+0000","last_clean":"2024-09-17T05:42:02.390859+0000","last_became_active":"2024-09-17T05:42:01.392846+0000","last_became_peered":"2024-09-17T05:42:01.392846+0000","last_unstale":"2024-09-17T05:42:02.390859+0000","last_undegraded":"2024-09-17T05:42:02.390859+0000","last_fullsized":"2024-09-17T05:42:02.390859+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:42:00.346542+0000","last_clean_scrub_stamp":"2024-09-17T05:42:00.346542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:20.593732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":242,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-17T05:42:03.377656+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:42:03.377656+0000","last_peered":"2024-09-17T05:42:03.377656+0000","last_clean":"2024-09-17T05:42:03.377656+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:42:03.377656+0000","last_undegraded":"2024-09-17T05:42:03.377656+0000","last_fullsized":"2024-09-17T05:42:03.377656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1101824,"data_stored":504222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509515,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1695744,"data_stored":1094590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509514,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":504222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509515,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1122304,"data_stored":505946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1110016,"data_stored":504826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1708032,"data_stored":1095276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509516,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":504292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1110016,"data_stored":499266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:42:06.991 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:42:06.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:42:07.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 -- 172.21.15.44:0/4276749119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40d1d00 msgr2=0x7f54b40cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 --2- 172.21.15.44:0/4276749119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40d1d00 0x7f54b40cf070 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009840 tx=0x7f54a001c760 comp rx=0 tx=0).stop 2024-09-17T05:42:07.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 -- 172.21.15.44:0/4276749119 shutdown_connections 2024-09-17T05:42:07.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 --2- 172.21.15.44:0/4276749119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40d1d00 0x7f54b40cf070 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 --2- 172.21.15.44:0/4276749119 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b40d18f0 0x7f54b40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 -- 172.21.15.44:0/4276749119 >> 172.21.15.44:0/4276749119 conn(0x7f54b40b4240 msgr2=0x7f54b40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 -- 172.21.15.44:0/4276749119 shutdown_connections 2024-09-17T05:42:07.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 -- 172.21.15.44:0/4276749119 wait complete. 2024-09-17T05:42:07.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 Processor -- start 2024-09-17T05:42:07.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.195+0000 7f54bc400640 1 -- start start 2024-09-17T05:42:07.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40cf5b0 0x7f54b41fcf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b40d18f0 0x7f54b4152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b40d1d00 0x7f54b4152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4169e80 con 0x7f54b40d18f0 2024-09-17T05:42:07.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4169d00 con 0x7f54b40cf5b0 2024-09-17T05:42:07.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f54b416a000 con 0x7f54b40d1d00 2024-09-17T05:42:07.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b40d18f0 0x7f54b4152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b40d18f0 0x7f54b4152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47548/0 (socket says 172.21.15.44:47548) 2024-09-17T05:42:07.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 -- 172.21.15.44:0/2023049076 learned_addr learned my addr 172.21.15.44:0/2023049076 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:07.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9a00640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40cf5b0 0x7f54b41fcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54ba400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b40d1d00 0x7f54b4152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 -- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b40d1d00 msgr2=0x7f54b4152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b40d1d00 0x7f54b4152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 -- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40cf5b0 msgr2=0x7f54b41fcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40cf5b0 0x7f54b41fcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 -- 172.21.15.44:0/2023049076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b41fd440 con 0x7f54b40d18f0 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54ba400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b40d1d00 0x7f54b4152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b9000640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b40d18f0 0x7f54b4152570 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009790 tx=0x7f54a0005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b1600640 1 -- 172.21.15.44:0/2023049076 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a00b2040 con 0x7f54b40d18f0 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b1600640 1 -- 172.21.15.44:0/2023049076 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54a0004330 con 0x7f54b40d18f0 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b41f9530 con 0x7f54b40d18f0 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54b1600640 1 -- 172.21.15.44:0/2023049076 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0003820 con 0x7f54b40d18f0 2024-09-17T05:42:07.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b41f9af0 con 0x7f54b40d18f0 2024-09-17T05:42:07.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.199+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b40b1be0 con 0x7f54b40d18f0 2024-09-17T05:42:07.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.203+0000 7f54b1600640 1 -- 172.21.15.44:0/2023049076 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f54a00bd060 con 0x7f54b40d18f0 2024-09-17T05:42:07.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.203+0000 7f54b1600640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5494073200 0x7f5494075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.203+0000 7f54b1600640 1 -- 172.21.15.44:0/2023049076 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f54a012dc20 con 0x7f54b40d18f0 2024-09-17T05:42:07.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.203+0000 7f54b9a00640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5494073200 0x7f5494075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.203+0000 7f54b9a00640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5494073200 0x7f5494075710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009bc0 tx=0x7f54a80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.207+0000 7f54b1600640 1 -- 172.21.15.44:0/2023049076 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f54b41fd440 con 0x7f54b40d18f0 2024-09-17T05:42:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.451+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f54b415b530 con 0x7f54b40d18f0 2024-09-17T05:42:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.455+0000 7f54b1600640 1 -- 172.21.15.44:0/2023049076 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f54a0016410 con 0x7f54b40d18f0 2024-09-17T05:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-09-17T05:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-09-17T05:42:07.457 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:42:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5494073200 msgr2=0x7f5494075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5494073200 0x7f5494075710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009bc0 tx=0x7f54a80091e0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b40d18f0 msgr2=0x7f54b4152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b40d18f0 0x7f54b4152570 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009790 tx=0x7f54a0005ca0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 shutdown_connections 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54b40d1d00 0x7f54b4152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54b40d18f0 0x7f54b4152570 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5494073200 0x7f5494075710 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 --2- 172.21.15.44:0/2023049076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54b40cf5b0 0x7f54b41fcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 >> 172.21.15.44:0/2023049076 conn(0x7f54b40b4240 msgr2=0x7f54b40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 shutdown_connections 2024-09-17T05:42:07.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.459+0000 7f54bc400640 1 -- 172.21.15.44:0/2023049076 wait complete. 2024-09-17T05:42:07.480 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:07.580 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:42:07.579+0000 7fbac0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:42:07.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 -- 172.21.15.44:0/69991558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923015ab40 msgr2=0x7f923015af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 --2- 172.21.15.44:0/69991558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923015ab40 0x7f923015af50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f923006f200 tx=0x7f922801cd50 comp rx=0 tx=0).stop 2024-09-17T05:42:07.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 -- 172.21.15.44:0/69991558 shutdown_connections 2024-09-17T05:42:07.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 --2- 172.21.15.44:0/69991558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923015ab40 0x7f923015af50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 --2- 172.21.15.44:0/69991558 >> v2:172.21.15.86:3300/0 conn(0x7f923006f400 0x7f923006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 -- 172.21.15.44:0/69991558 >> 172.21.15.44:0/69991558 conn(0x7f923006ce40 msgr2=0x7f923006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 -- 172.21.15.44:0/69991558 shutdown_connections 2024-09-17T05:42:07.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.635+0000 7f922fe00640 1 -- 172.21.15.44:0/69991558 wait complete. 2024-09-17T05:42:07.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 Processor -- start 2024-09-17T05:42:07.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 -- start start 2024-09-17T05:42:07.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923006f400 0x7f92300afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9230151070 0x7f92300b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923015ab40 0x7f92301fc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f923015c520 con 0x7f923006f400 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f923015c3a0 con 0x7f9230151070 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922fe00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f923015c6a0 con 0x7f923015ab40 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923006f400 0x7f92300afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923006f400 0x7f92300afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47576/0 (socket says 172.21.15.44:47576) 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 -- 172.21.15.44:0/429261423 learned_addr learned my addr 172.21.15.44:0/429261423 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 -- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923015ab40 msgr2=0x7f92301fc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923015ab40 0x7f92301fc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 -- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9230151070 msgr2=0x7f92300b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9230151070 0x7f92300b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 -- 172.21.15.44:0/429261423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92301f9980 con 0x7f923006f400 2024-09-17T05:42:07.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f922ea00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923006f400 0x7f92300afd50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f922000d950 tx=0x7f922000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.639+0000 7f9226a00640 1 -- 172.21.15.44:0/429261423 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220017070 con 0x7f923006f400 2024-09-17T05:42:07.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f9226a00640 1 -- 172.21.15.44:0/429261423 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9220009d20 con 0x7f923006f400 2024-09-17T05:42:07.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92300cdfd0 con 0x7f923006f400 2024-09-17T05:42:07.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f9226a00640 1 -- 172.21.15.44:0/429261423 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92200106c0 con 0x7f923006f400 2024-09-17T05:42:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92300b3180 con 0x7f923006f400 2024-09-17T05:42:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923015af50 con 0x7f923006f400 2024-09-17T05:42:07.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f9226a00640 1 -- 172.21.15.44:0/429261423 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f922001a070 con 0x7f923006f400 2024-09-17T05:42:07.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f9226a00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9210073200 0x7f9210075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:07.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f9226a00640 1 -- 172.21.15.44:0/429261423 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f9220094510 con 0x7f923006f400 2024-09-17T05:42:07.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.643+0000 7f922e000640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9210073200 0x7f9210075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:07.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.647+0000 7f922e000640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9210073200 0x7f9210075710 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f921c000f70 tx=0x7f921c0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:07.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.647+0000 7f9226a00640 1 -- 172.21.15.44:0/429261423 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f922005f420 con 0x7f923006f400 2024-09-17T05:42:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.859+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9230151890 con 0x7f923006f400 2024-09-17T05:42:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.859+0000 7f9226a00640 1 -- 172.21.15.44:0/429261423 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5222 (secure 0 0 0) 0x7f922005ed20 con 0x7f923006f400 2024-09-17T05:42:07.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:07.862 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"btime":"2024-09-17T05:42:05:393879+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:04.810540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6700":{"gid":6700,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3305866275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3305866275},{"type":"v1","addr":"172.21.15.44:6835","nonce":3305866275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6700,"qdb_cluster":[6700]},"id":6}]} 2024-09-17T05:42:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-17T05:42:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9210073200 msgr2=0x7f9210075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9210073200 0x7f9210075710 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f921c000f70 tx=0x7f921c0079c0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923006f400 msgr2=0x7f92300afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923006f400 0x7f92300afd50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f922000d950 tx=0x7f922000de10 comp rx=0 tx=0).stop 2024-09-17T05:42:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 shutdown_connections 2024-09-17T05:42:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f923015ab40 0x7f92301fc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9210073200 0x7f9210075710 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9230151070 0x7f92300b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 --2- 172.21.15.44:0/429261423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f923006f400 0x7f92300afd50 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 >> 172.21.15.44:0/429261423 conn(0x7f923006ce40 msgr2=0x7f92300ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 shutdown_connections 2024-09-17T05:42:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:07.863+0000 7f922fe00640 1 -- 172.21.15.44:0/429261423 wait complete. 2024-09-17T05:42:08.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:01.792332+0000', 'modified': '2024-09-17T05:42:04.810540+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6700}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6700': {'gid': 6700, 'name': 'a', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/3305866275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 3305866275}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3305866275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6700, 'qdb_cluster': [6700]} 2024-09-17T05:42:08.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:42:08.287 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 -- 172.21.15.44:0/2330565927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a8072e50 msgr2=0x7f92a815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 --2- 172.21.15.44:0/2330565927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a8072e50 0x7f92a815e990 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9298009900 tx=0x7f929801c850 comp rx=0 tx=0).stop 2024-09-17T05:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 -- 172.21.15.44:0/2330565927 shutdown_connections 2024-09-17T05:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 --2- 172.21.15.44:0/2330565927 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92a806de50 0x7f92a806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 --2- 172.21.15.44:0/2330565927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a8072e50 0x7f92a815e990 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 -- 172.21.15.44:0/2330565927 >> 172.21.15.44:0/2330565927 conn(0x7f92a80ccaa0 msgr2=0x7f92a80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 -- 172.21.15.44:0/2330565927 shutdown_connections 2024-09-17T05:42:08.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 -- 172.21.15.44:0/2330565927 wait complete. 2024-09-17T05:42:08.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 Processor -- start 2024-09-17T05:42:08.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.451+0000 7f92ade00640 1 -- start start 2024-09-17T05:42:08.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92a806de50 0x7f92a8158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a8072e50 0x7f92a8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a80ced00 0x7f92a8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8169410 con 0x7f92a80ced00 2024-09-17T05:42:08.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8169290 con 0x7f92a8072e50 2024-09-17T05:42:08.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f92a8169590 con 0x7f92a806de50 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a80ced00 0x7f92a8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a80ced00 0x7f92a8158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47590/0 (socket says 172.21.15.44:47590) 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 -- 172.21.15.44:0/1448008773 learned_addr learned my addr 172.21.15.44:0/1448008773 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a6a00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92a806de50 0x7f92a8158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f929fe00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a8072e50 0x7f92a8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 -- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92a806de50 msgr2=0x7f92a8158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92a806de50 0x7f92a8158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 -- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a8072e50 msgr2=0x7f92a8157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a8072e50 0x7f92a8157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 -- 172.21.15.44:0/1448008773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a815bd50 con 0x7f92a80ced00 2024-09-17T05:42:08.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92a7400640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a80ced00 0x7f92a8158480 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f92a000c760 tx=0x7f92a000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f929f400640 1 -- 172.21.15.44:0/1448008773 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0003b80 con 0x7f92a80ced00 2024-09-17T05:42:08.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f929f400640 1 -- 172.21.15.44:0/1448008773 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92a0003d20 con 0x7f92a80ced00 2024-09-17T05:42:08.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a815c030 con 0x7f92a80ced00 2024-09-17T05:42:08.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f929f400640 1 -- 172.21.15.44:0/1448008773 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a000aab0 con 0x7f92a80ced00 2024-09-17T05:42:08.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.455+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a80c7b70 con 0x7f92a80ced00 2024-09-17T05:42:08.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.459+0000 7f929f400640 1 -- 172.21.15.44:0/1448008773 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f92a000ac50 con 0x7f92a80ced00 2024-09-17T05:42:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.459+0000 7f929f400640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073200 0x7f9284075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.459+0000 7f929f400640 1 -- 172.21.15.44:0/1448008773 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f92a0094190 con 0x7f92a80ced00 2024-09-17T05:42:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.459+0000 7f92b54cc000 1 Processor -- start 2024-09-17T05:42:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.459+0000 7f92b54cc000 1 -- start start 2024-09-17T05:42:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.459+0000 7f92a6a00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073200 0x7f9284075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.459+0000 7f92a6a00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073200 0x7f9284075710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f92980af000 tx=0x7f929801b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc564546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc56454be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc562ecca0 0x55bc56455120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc56329410 con 0x55bc55f13460 2024-09-17T05:42:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bc56266b40 con 0x55bc562ecca0 2024-09-17T05:42:08.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55bc56255f70 con 0x55bc56303950 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc564546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc564546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47600/0 (socket says 172.21.15.44:47600) 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 -- 172.21.15.44:0/936923199 learned_addr learned my addr 172.21.15.44:0/936923199 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f929fe00640 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc56454be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a7400640 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc562ecca0 0x55bc56455120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 -- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 msgr2=0x55bc56454be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc56454be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 -- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc562ecca0 msgr2=0x55bc56455120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc562ecca0 0x55bc56455120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 -- 172.21.15.44:0/936923199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc5621d5b0 con 0x55bc55f13460 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f929fe00640 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc56454be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:08.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92a6a00640 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc564546a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9298009850 tx=0x7f92980b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ba656993c6f805 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f9297400640 1 -- 172.21.15.44:0/936923199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92980c8070 con 0x55bc55f13460 2024-09-17T05:42:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f9297400640 1 -- 172.21.15.44:0/936923199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92980b3040 con 0x55bc55f13460 2024-09-17T05:42:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f9297400640 1 -- 172.21.15.44:0/936923199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92980a5c10 con 0x55bc55f13460 2024-09-17T05:42:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- 172.21.15.44:0/936923199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 msgr2=0x55bc564546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc564546a0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9298009850 tx=0x7f92980b5000 comp rx=0 tx=0).stop 2024-09-17T05:42:08.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- 172.21.15.44:0/936923199 shutdown_connections 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc562ecca0 0x55bc56455120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc56454be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 --2- 172.21.15.44:0/936923199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc564546a0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- 172.21.15.44:0/936923199 >> 172.21.15.44:0/936923199 conn(0x55bc563d9d90 msgr2=0x55bc56409690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- 172.21.15.44:0/936923199 shutdown_connections 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- 172.21.15.44:0/936923199 wait complete. 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 -- start start 2024-09-17T05:42:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.463+0000 7f92b54cc000 1 Processor -- start 2024-09-17T05:42:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc5645fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc564602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc56303950 0x55bc56460800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc561f05f0 con 0x55bc55f13460 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bc56259d80 con 0x55bc56303950 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55bc561fc520 con 0x55bc562ecca0 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 10 client.0 _ll_register_callbacks cb 0x55bc56200830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc5645fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc5645fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47616/0 (socket says 172.21.15.44:47616) 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 -- 172.21.15.44:0/3977028772 learned_addr learned my addr 172.21.15.44:0/3977028772 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a7400640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc56303950 0x55bc56460800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f929fe00640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc564602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 -- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 msgr2=0x55bc564602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc564602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 -- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc56303950 msgr2=0x55bc56460800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc56303950 0x55bc56460800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 -- 172.21.15.44:0/3977028772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc561f4190 con 0x55bc55f13460 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a7400640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc56303950 0x55bc56460800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f929fe00640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc564602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92a6a00640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc5645fd80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f92980096c0 tx=0x7f92980a6e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf5c54b6f040b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f928be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f928be00640 1 -- 172.21.15.44:0/3977028772 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92980c8070 con 0x55bc55f13460 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f928be00640 1 -- 172.21.15.44:0/3977028772 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f9298005030 con 0x55bc55f13460 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc561ee110 con 0x55bc55f13460 2024-09-17T05:42:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f928be00640 1 -- 172.21.15.44:0/3977028772 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f92980d5050 con 0x55bc55f13460 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 10 client.7017 fetch_fsmap learned FSMap version 62 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55bc562daf10 con 0x55bc55f13460 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f928be00640 1 -- 172.21.15.44:0/3977028772 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55bc561ee110 con 0x55bc55f13460 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f928be00640 1 -- 172.21.15.44:0/3977028772 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7f92980d8020 con 0x55bc55f13460 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 10 client.7017 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 10 client.7017 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 20 client.7017 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ef87d0 0x55bc5646a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 4 client.7017 mds_command: new command op to 6700 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 --> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc56268a90 con 0x55bc55ef87d0 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.467+0000 7f929fe00640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ef87d0 0x55bc5646a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f929fe00640 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ef87d0 0x55bc5646a160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9954351869af59c server_cookie=984dcfa4d7c1dc77 in_seq=0 out_seq=0 2024-09-17T05:42:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f928be00640 10 client.7017 ms_handle_connect on v2:172.21.15.44:6833/3305866275 2024-09-17T05:42:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f928be00640 1 -- 172.21.15.44:0/3977028772 <== mds.0 v2:172.21.15.44:6833/3305866275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc56268a90 con 0x55bc55ef87d0 2024-09-17T05:42:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f928be00640 10 client.7017 handle_command_reply: tid=0 2024-09-17T05:42:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 client.7017 shutdown 2024-09-17T05:42:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 msgr2=0x55bc5645fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc5645fd80 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f92980096c0 tx=0x7f92980a6e40 comp rx=0 tx=0).stop 2024-09-17T05:42:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 shutdown_connections 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ef87d0 0x55bc5646a160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc56303950 0x55bc56460800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc564602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3977028772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc55f13460 0x55bc5645fd80 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f928be00640 0 client.7017 ms_handle_reset on v2:172.21.15.44:6833/3305866275 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 >> 172.21.15.44:0/3977028772 conn(0x55bc563d9d90 msgr2=0x55bc56410440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 shutdown_connections 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 1 -- 172.21.15.44:0/3977028772 wait complete. 2024-09-17T05:42:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.471+0000 7f92b54cc000 20 client.7017 trim_cache size 0 max 16384 2024-09-17T05:42:08.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 Processor -- start 2024-09-17T05:42:08.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 -- start start 2024-09-17T05:42:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc56453a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc56453f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc56303950 0x55bc56408cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8201dc0 con 0x55bc56303950 2024-09-17T05:42:08.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80705c0 con 0x55bc55f13460 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f92a8157670 con 0x55bc562ecca0 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc56303950 0x55bc56408cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc56303950 0x55bc56408cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47626/0 (socket says 172.21.15.44:47626) 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 -- 172.21.15.44:0/2865427797 learned_addr learned my addr 172.21.15.44:0/2865427797 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a6a00640 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc56453a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f929fe00640 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc56453f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 -- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 msgr2=0x55bc56453f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc56453f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 -- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 msgr2=0x55bc56453a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc56453a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 -- 172.21.15.44:0/2865427797 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc562b1db0 con 0x55bc56303950 2024-09-17T05:42:08.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f92a7400640 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc56303950 0x55bc56408cd0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f92a005bbb0 tx=0x7f92a0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0905376c47075a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f9296a00640 1 -- 172.21.15.44:0/2865427797 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a005e020 con 0x55bc56303950 2024-09-17T05:42:08.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f9296a00640 1 -- 172.21.15.44:0/2865427797 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92a005e3c0 con 0x55bc56303950 2024-09-17T05:42:08.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.491+0000 7f9296a00640 1 -- 172.21.15.44:0/2865427797 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a005fd50 con 0x55bc56303950 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- 172.21.15.44:0/2865427797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc56303950 msgr2=0x55bc56408cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc56303950 0x55bc56408cd0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f92a005bbb0 tx=0x7f92a0001260 comp rx=0 tx=0).stop 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- 172.21.15.44:0/2865427797 shutdown_connections 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc56303950 0x55bc56408cd0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc562ecca0 0x55bc56453f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 --2- 172.21.15.44:0/2865427797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc56453a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- 172.21.15.44:0/2865427797 >> 172.21.15.44:0/2865427797 conn(0x55bc563d9d90 msgr2=0x55bc56469370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- 172.21.15.44:0/2865427797 shutdown_connections 2024-09-17T05:42:08.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- 172.21.15.44:0/2865427797 wait complete. 2024-09-17T05:42:08.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- start start 2024-09-17T05:42:08.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 Processor -- start 2024-09-17T05:42:08.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc5640bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc562ecca0 0x55bc5640c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc5648a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc561f05f0 con 0x55bc562ecca0 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bc56315750 con 0x55bc55f13460 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55bc562daa80 con 0x55bc56303950 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92b54cc000 10 client.0 _ll_register_callbacks cb 0x7f92980c6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc562ecca0 0x55bc5640c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc562ecca0 0x55bc5640c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47632/0 (socket says 172.21.15.44:47632) 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92a7400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc5648a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92a6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc5640bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 -- 172.21.15.44:0/3246937934 learned_addr learned my addr 172.21.15.44:0/3246937934 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:08.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 -- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 msgr2=0x55bc5648a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc5648a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 -- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 msgr2=0x55bc5640bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:08.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc5640bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f929fe00640 1 -- 172.21.15.44:0/3246937934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc5621cab0 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92a7400640 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc5648a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.495+0000 7f92a6a00640 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc5640bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f929fe00640 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc562ecca0 0x55bc5640c210 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f92a80c7020 tx=0x7f929000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9700b33d05939c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 1 -- 172.21.15.44:0/3246937934 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9290025470 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 1 -- 172.21.15.44:0/3246937934 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f9290012450 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92a005e3c0 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 1 -- 172.21.15.44:0/3246937934 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9290012650 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 10 client.7023 fetch_fsmap learned FSMap version 62 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) -- 0x55bc561fb070 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 1 -- 172.21.15.44:0/3246937934 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92a005e3c0 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 1 -- 172.21.15.44:0/3246937934 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 62) ==== 3502+0+0 (secure 0 0 0) 0x7f92900127f0 con 0x55bc562ecca0 2024-09-17T05:42:08.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 10 client.7023 fetch_fsmap finished waiting for FSMap version 62 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 10 client.7023 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 20 client.7023 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ee6830 0x55bc564ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 4 client.7023 mds_command: new command op to 6700 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 --> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] -- command(tid 0: {"prefix": "status"}) -- 0x55bc56264540 con 0x55bc55ee6830 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92a6a00640 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ee6830 0x55bc564ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 10 client.7023 ms_handle_connect on v2:172.21.15.44:6833/3305866275 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92a6a00640 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ee6830 0x55bc564ce0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dd4a5a6f03dbe1e server_cookie=c959e58034703606 in_seq=0 out_seq=0 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 1 -- 172.21.15.44:0/3246937934 <== mds.0 v2:172.21.15.44:6833/3305866275 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55bc56264540 con 0x55bc55ee6830 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 10 client.7023 handle_command_reply: tid=0 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 client.7023 shutdown 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc562ecca0 msgr2=0x55bc5640c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc562ecca0 0x55bc5640c210 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f92a80c7020 tx=0x7f929000bd70 comp rx=0 tx=0).stop 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 shutdown_connections 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:6833/3305866275,v1:172.21.15.44:6835/3305866275] conn(0x55bc55ee6830 0x55bc564ce0e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55bc56303950 0x55bc5648a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc562ecca0 0x55bc5640c210 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 --2- 172.21.15.44:0/3246937934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc55f13460 0x55bc5640bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f928be00640 0 client.7023 ms_handle_reset on v2:172.21.15.44:6833/3305866275 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 >> 172.21.15.44:0/3246937934 conn(0x55bc563d9d90 msgr2=0x55bc56469d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 shutdown_connections 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 1 -- 172.21.15.44:0/3246937934 wait complete. 2024-09-17T05:42:08.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92b54cc000 20 client.7023 trim_cache size 0 max 16384 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 6700, 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.127936074, 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 62, 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 90, 2024-09-17T05:42:08.508 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 90, 2024-09-17T05:42:08.509 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 11.279662619 2024-09-17T05:42:08.509 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:42:08.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073200 msgr2=0x7f9284075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073200 0x7f9284075710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f92980af000 tx=0x7f929801b090 comp rx=0 tx=0).stop 2024-09-17T05:42:08.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a80ced00 msgr2=0x7f92a8158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a80ced00 0x7f92a8158480 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f92a000c760 tx=0x7f92a000cc20 comp rx=0 tx=0).stop 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 shutdown_connections 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92a80ced00 0x7f92a8158480 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9284073200 0x7f9284075710 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92a8072e50 0x7f92a8157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 --2- 172.21.15.44:0/1448008773 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92a806de50 0x7f92a8158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 >> 172.21.15.44:0/1448008773 conn(0x7f92a80ccaa0 msgr2=0x7f92a8155900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 shutdown_connections 2024-09-17T05:42:08.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.499+0000 7f92ade00640 1 -- 172.21.15.44:0/1448008773 wait complete. 2024-09-17T05:42:08.522 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:42:08.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 -- 172.21.15.44:0/454309244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d1d00 msgr2=0x7f3ec40cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 --2- 172.21.15.44:0/454309244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d1d00 0x7f3ec40cf070 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009840 tx=0x7f3eb001c760 comp rx=0 tx=0).stop 2024-09-17T05:42:08.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 -- 172.21.15.44:0/454309244 shutdown_connections 2024-09-17T05:42:08.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 --2- 172.21.15.44:0/454309244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d1d00 0x7f3ec40cf070 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 --2- 172.21.15.44:0/454309244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ec40d18f0 0x7f3ec40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 -- 172.21.15.44:0/454309244 >> 172.21.15.44:0/454309244 conn(0x7f3ec40b4240 msgr2=0x7f3ec40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 -- 172.21.15.44:0/454309244 shutdown_connections 2024-09-17T05:42:08.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.679+0000 7f3eca800640 1 -- 172.21.15.44:0/454309244 wait complete. 2024-09-17T05:42:08.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 Processor -- start 2024-09-17T05:42:08.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 -- start start 2024-09-17T05:42:08.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ec40cf5b0 0x7f3ec406e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d18f0 0x7f3ec415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec40d1d00 0x7f3ec4155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec4169e80 con 0x7f3ec40d18f0 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec4169d00 con 0x7f3ec40d1d00 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3eca800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec416a000 con 0x7f3ec40cf5b0 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d18f0 0x7f3ec415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d18f0 0x7f3ec415f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47646/0 (socket says 172.21.15.44:47646) 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 -- 172.21.15.44:0/285075767 learned_addr learned my addr 172.21.15.44:0/285075767 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec3400640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ec40cf5b0 0x7f3ec406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec3e00640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec40d1d00 0x7f3ec4155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 -- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ec40cf5b0 msgr2=0x7f3ec406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ec40cf5b0 0x7f3ec406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 -- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec40d1d00 msgr2=0x7f3ec4155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec40d1d00 0x7f3ec4155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 -- 172.21.15.44:0/285075767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec4159720 con 0x7f3ec40d18f0 2024-09-17T05:42:08.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.683+0000 7f3ec2a00640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d18f0 0x7f3ec415f8d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009790 tx=0x7f3eb00a5530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3ebb400640 1 -- 172.21.15.44:0/285075767 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00b2040 con 0x7f3ec40d18f0 2024-09-17T05:42:08.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3ebb400640 1 -- 172.21.15.44:0/285075767 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3eb00043b0 con 0x7f3ec40d18f0 2024-09-17T05:42:08.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec4158560 con 0x7f3ec40d18f0 2024-09-17T05:42:08.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3ebb400640 1 -- 172.21.15.44:0/285075767 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0003860 con 0x7f3ec40d18f0 2024-09-17T05:42:08.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec415eff0 con 0x7f3ec40d18f0 2024-09-17T05:42:08.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec415dce0 con 0x7f3ec40d18f0 2024-09-17T05:42:08.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3ebb400640 1 -- 172.21.15.44:0/285075767 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3eb00bd060 con 0x7f3ec40d18f0 2024-09-17T05:42:08.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3ebb400640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ea4073230 0x7f3ea4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:08.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3ebb400640 1 -- 172.21.15.44:0/285075767 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f3eb012daa0 con 0x7f3ec40d18f0 2024-09-17T05:42:08.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.687+0000 7f3ec3400640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ea4073230 0x7f3ea4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:08.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.691+0000 7f3ec3400640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ea4073230 0x7f3ea4075740 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4005fd0 tx=0x7f3eb4005d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:08.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.695+0000 7f3ebb400640 1 -- 172.21.15.44:0/285075767 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3eb0016410 con 0x7f3ec40d18f0 2024-09-17T05:42:08.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.907+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3ec4158350 con 0x7f3ec40d18f0 2024-09-17T05:42:08.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.907+0000 7f3ebb400640 1 -- 172.21.15.44:0/285075767 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) ==== 53+0+73 (secure 0 0 0) 0x7f3eb00f88a0 con 0x7f3ec40d18f0 2024-09-17T05:42:08.910 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:42:08.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ea4073230 msgr2=0x7f3ea4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ea4073230 0x7f3ea4075740 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4005fd0 tx=0x7f3eb4005d10 comp rx=0 tx=0).stop 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d18f0 msgr2=0x7f3ec415f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d18f0 0x7f3ec415f8d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009790 tx=0x7f3eb00a5530 comp rx=0 tx=0).stop 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 shutdown_connections 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ea4073230 0x7f3ea4075740 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ec40d1d00 0x7f3ec4155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ec40d18f0 0x7f3ec415f8d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 --2- 172.21.15.44:0/285075767 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3ec40cf5b0 0x7f3ec406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 >> 172.21.15.44:0/285075767 conn(0x7f3ec40b4240 msgr2=0x7f3ec4068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 shutdown_connections 2024-09-17T05:42:08.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:08.911+0000 7f3eca800640 1 -- 172.21.15.44:0/285075767 wait complete. 2024-09-17T05:42:08.933 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:42:08.933 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:42:08.933 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:42:08.933 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:42:08.934 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:08.934 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:42:08.934 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:42:08.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:42:08.934 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:08.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:08.934 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:42:08.945 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:08.945 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:08.945 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:08.945 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.945 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:08.945 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.945 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:42:08.946 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42077sec preferred_lft 42077sec 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:42:08.947 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:42:08.948 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.949 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:08.949 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:42:08.949 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:42:08.949 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:08.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:08.949 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:42:09.008 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:42:09.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.011 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:42:09.068 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:42:09.069 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:42:09.069 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:42:09.069 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:42:09.069 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:42:09.069 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:42:09.069 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:09.069 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:42:09.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:42:09.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:42:09.070 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:42:09.070 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:42:09.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:09.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:09.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.210 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:42:09.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:42:09.220 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:42:09.220 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:09.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:42:09.287 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:09.287 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:09.338 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:09.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:09.339 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:09.394 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:42:09.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:09.500 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:09.500 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:09.500 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:42:09.518 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:09.518 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:09.519 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:42:09.519 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:42:09.519 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:42:09.532 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:42:09.536 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:42:09.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.536 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:09.556 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:09.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:09.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:09.661 INFO:teuthology.orchestra.run.smithi044.stdout:client6209 2024-09-17T05:42:09.662 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:42:09.662 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:09.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.671 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-09-17T05:42:09.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.733 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-09-17T05:42:09.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.789 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-17T05:42:09.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:09.841 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-09-17T05:42:09.896 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:42:09.897 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:42:09.897 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:42:09.897 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:42:09.897 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-09-17T05:42:09.897 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:42:10.006 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-17T05:42:10.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:10.015 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:42:10.015 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:10.067 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:42:10.067 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:10.119 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:42:10.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 -- 172.21.15.44:0/472798570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 msgr2=0x7f52940c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 --2- 172.21.15.44:0/472798570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940c7780 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f5284009930 tx=0x7f528401c7c0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 -- 172.21.15.44:0/472798570 shutdown_connections 2024-09-17T05:42:10.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 --2- 172.21.15.44:0/472798570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940c7780 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 -- 172.21.15.44:0/472798570 >> 172.21.15.44:0/472798570 conn(0x7f52940ceaa0 msgr2=0x7f52940ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 -- 172.21.15.44:0/472798570 shutdown_connections 2024-09-17T05:42:10.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 -- 172.21.15.44:0/472798570 wait complete. 2024-09-17T05:42:10.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 Processor -- start 2024-09-17T05:42:10.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.327+0000 7f5298a00640 1 -- start start 2024-09-17T05:42:10.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52940b1fc0 0x7f52940b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5294160060 0x7f52940b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f529416aea0 con 0x7f52940c7370 2024-09-17T05:42:10.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f529416ad20 con 0x7f5294160060 2024-09-17T05:42:10.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f529416b020 con 0x7f52940b1fc0 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54106/0 (socket says 172.21.15.44:54106) 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 -- 172.21.15.44:0/2137458736 learned_addr learned my addr 172.21.15.44:0/2137458736 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5293e00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5294160060 0x7f52940b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5293400640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52940b1fc0 0x7f52940b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 -- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52940b1fc0 msgr2=0x7f52940b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52940b1fc0 0x7f52940b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 -- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5294160060 msgr2=0x7f52940b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5294160060 0x7f52940b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 -- 172.21.15.44:0/2137458736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52941fc130 con 0x7f52940c7370 2024-09-17T05:42:10.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528aa00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940b56f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c430 tx=0x7f527c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528be00640 1 -- 172.21.15.44:0/2137458736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c017070 con 0x7f52940c7370 2024-09-17T05:42:10.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528be00640 1 -- 172.21.15.44:0/2137458736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f527c0053c0 con 0x7f52940c7370 2024-09-17T05:42:10.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f528be00640 1 -- 172.21.15.44:0/2137458736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c003860 con 0x7f52940c7370 2024-09-17T05:42:10.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52941fc3f0 con 0x7f52940c7370 2024-09-17T05:42:10.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941fc9b0 con 0x7f52940c7370 2024-09-17T05:42:10.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.331+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52940c7780 con 0x7f52940c7370 2024-09-17T05:42:10.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.335+0000 7f528be00640 1 -- 172.21.15.44:0/2137458736 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f527c01a070 con 0x7f52940c7370 2024-09-17T05:42:10.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.335+0000 7f528be00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5270073200 0x7f5270075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.335+0000 7f528be00640 1 -- 172.21.15.44:0/2137458736 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f527c093720 con 0x7f52940c7370 2024-09-17T05:42:10.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.335+0000 7f5293400640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5270073200 0x7f5270075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.335+0000 7f5293400640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5270073200 0x7f5270075710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f52840af000 tx=0x7f528401b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.339+0000 7f528be00640 1 -- 172.21.15.44:0/2137458736 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f527c05df50 con 0x7f52940c7370 2024-09-17T05:42:10.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.531+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f52940cf860 con 0x7f52940c7370 2024-09-17T05:42:10.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.531+0000 7f528be00640 1 -- 172.21.15.44:0/2137458736 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v90) ==== 80+0+0 (secure 0 0 0) 0x7f527c062980 con 0x7f52940c7370 2024-09-17T05:42:10.533 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:42:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.531+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5270073200 msgr2=0x7f5270075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5270073200 0x7f5270075710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f52840af000 tx=0x7f528401b000 comp rx=0 tx=0).stop 2024-09-17T05:42:10.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 msgr2=0x7f52940b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940b56f0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f527c00c430 tx=0x7f527c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 shutdown_connections 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5270073200 0x7f5270075710 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5294160060 0x7f52940b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52940c7370 0x7f52940b56f0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 --2- 172.21.15.44:0/2137458736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f52940b1fc0 0x7f52940b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 >> 172.21.15.44:0/2137458736 conn(0x7f52940ceaa0 msgr2=0x7f529413e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 shutdown_connections 2024-09-17T05:42:10.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.535+0000 7f5298a00640 1 -- 172.21.15.44:0/2137458736 wait complete. 2024-09-17T05:42:10.555 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:42:10.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:10.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:10.614 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:42:10.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:10.614 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:42:10.632 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:10.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.831+0000 7ff3ece00640 1 -- 172.21.15.44:0/3620313981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 msgr2=0x7ff3e8166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.831+0000 7ff3ece00640 1 --2- 172.21.15.44:0/3620313981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 0x7ff3e8166480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009bf0 tx=0x7ff3e001cb50 comp rx=0 tx=0).stop 2024-09-17T05:42:10.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.831+0000 7ff3ece00640 1 -- 172.21.15.44:0/3620313981 shutdown_connections 2024-09-17T05:42:10.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.831+0000 7ff3ece00640 1 --2- 172.21.15.44:0/3620313981 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 0x7ff3e8166480 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.831+0000 7ff3ece00640 1 -- 172.21.15.44:0/3620313981 >> 172.21.15.44:0/3620313981 conn(0x7ff3e80ccaa0 msgr2=0x7ff3e80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:10.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.831+0000 7ff3ece00640 1 -- 172.21.15.44:0/3620313981 shutdown_connections 2024-09-17T05:42:10.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.831+0000 7ff3ece00640 1 -- 172.21.15.44:0/3620313981 wait complete. 2024-09-17T05:42:10.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 Processor -- start 2024-09-17T05:42:10.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 -- start start 2024-09-17T05:42:10.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e806de50 0x7ff3e8159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3e8072e50 0x7ff3e8152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 0x7ff3e8153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e816a090 con 0x7ff3e8072e50 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8169f10 con 0x7ff3e806de50 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3ece00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e816a210 con 0x7ff3e80cc480 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3e8072e50 0x7ff3e8152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3e8072e50 0x7ff3e8152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54108/0 (socket says 172.21.15.44:54108) 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 -- 172.21.15.44:0/1560380028 learned_addr learned my addr 172.21.15.44:0/1560380028 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e6800640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 0x7ff3e8153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5e00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e806de50 0x7ff3e8159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 -- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 msgr2=0x7ff3e8153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 0x7ff3e8153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 -- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e806de50 msgr2=0x7ff3e8159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:10.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e806de50 0x7ff3e8159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e5400640 1 -- 172.21.15.44:0/1560380028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e8155000 con 0x7ff3e8072e50 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.835+0000 7ff3e6800640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 0x7ff3e8153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3e5400640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3e8072e50 0x7ff3e8152cc0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c430 tx=0x7ff3d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3de000640 1 -- 172.21.15.44:0/1560380028 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4017070 con 0x7ff3e8072e50 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3de000640 1 -- 172.21.15.44:0/1560380028 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3d40053c0 con 0x7ff3e8072e50 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e809eee0 con 0x7ff3e8072e50 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3de000640 1 -- 172.21.15.44:0/1560380028 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4003860 con 0x7ff3e8072e50 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e809f4a0 con 0x7ff3e8072e50 2024-09-17T05:42:10.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e815e990 con 0x7ff3e8072e50 2024-09-17T05:42:10.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3de000640 1 -- 172.21.15.44:0/1560380028 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff3d401a070 con 0x7ff3e8072e50 2024-09-17T05:42:10.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.839+0000 7ff3de000640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3c8073230 0x7ff3c8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:10.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.843+0000 7ff3de000640 1 -- 172.21.15.44:0/1560380028 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7ff3d4093850 con 0x7ff3e8072e50 2024-09-17T05:42:10.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.843+0000 7ff3e5e00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3c8073230 0x7ff3c8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:10.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.843+0000 7ff3e5e00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3c8073230 0x7ff3c8075740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8007fd0 tx=0x7ff3d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:10.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:10.847+0000 7ff3de000640 1 -- 172.21.15.44:0/1560380028 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff3d405e650 con 0x7ff3e8072e50 2024-09-17T05:42:11.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.055+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3e80b5fa0 con 0x7ff3e8072e50 2024-09-17T05:42:11.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3de000640 1 -- 172.21.15.44:0/1560380028 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5222 (secure 0 0 0) 0x7ff3d405df50 con 0x7ff3e8072e50 2024-09-17T05:42:11.060 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:11.060 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":62,"btime":"2024-09-17T05:42:05:393879+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:04.810540+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6700},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6700":{"gid":6700,"name":"a","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3305866275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3305866275},{"type":"v1","addr":"172.21.15.44:6835","nonce":3305866275}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6700,"qdb_cluster":[6700]},"id":6}]} 2024-09-17T05:42:11.060 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 62 2024-09-17T05:42:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3c8073230 msgr2=0x7ff3c8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3c8073230 0x7ff3c8075740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8007fd0 tx=0x7ff3d8009040 comp rx=0 tx=0).stop 2024-09-17T05:42:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3e8072e50 msgr2=0x7ff3e8152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3e8072e50 0x7ff3e8152cc0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c430 tx=0x7ff3d400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 shutdown_connections 2024-09-17T05:42:11.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3e80cc480 0x7ff3e8153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3e8072e50 0x7ff3e8152cc0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff3c8073230 0x7ff3c8075740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 --2- 172.21.15.44:0/1560380028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e806de50 0x7ff3e8159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 >> 172.21.15.44:0/1560380028 conn(0x7ff3e80ccaa0 msgr2=0x7ff3e815eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 shutdown_connections 2024-09-17T05:42:11.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.059+0000 7ff3ece00640 1 -- 172.21.15.44:0/1560380028 wait complete. 2024-09-17T05:42:11.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T05:42:11.266 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:42:11.266 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:42:11.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:42:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.423+0000 7f67e8c00640 1 -- 172.21.15.44:0/1460542023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e406e560 msgr2=0x7f67e40700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.423+0000 7f67e8c00640 1 --2- 172.21.15.44:0/1460542023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e406e560 0x7f67e40700d0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f67e409e100 tx=0x7f67cc01c800 comp rx=0 tx=0).stop 2024-09-17T05:42:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.423+0000 7f67e8c00640 1 -- 172.21.15.44:0/1460542023 shutdown_connections 2024-09-17T05:42:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.423+0000 7f67e8c00640 1 --2- 172.21.15.44:0/1460542023 >> v2:172.21.15.86:3300/0 conn(0x7f67e4070610 0x7f67e4070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.423+0000 7f67e8c00640 1 --2- 172.21.15.44:0/1460542023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e406e560 0x7f67e40700d0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.423+0000 7f67e8c00640 1 -- 172.21.15.44:0/1460542023 >> 172.21.15.44:0/1460542023 conn(0x7f67e40ccaa0 msgr2=0x7f67e40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 -- 172.21.15.44:0/1460542023 shutdown_connections 2024-09-17T05:42:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 -- 172.21.15.44:0/1460542023 wait complete. 2024-09-17T05:42:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 Processor -- start 2024-09-17T05:42:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 -- start start 2024-09-17T05:42:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67e4070610 0x7f67e415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e40b5880 0x7f67e409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e406dca0 0x7f67e406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4169e90 con 0x7f67e40b5880 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4169d10 con 0x7f67e406dca0 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.427+0000 7f67e8c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f67e416a010 con 0x7f67e4070610 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e40b5880 0x7f67e409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e40b5880 0x7f67e409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54136/0 (socket says 172.21.15.44:54136) 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 -- 172.21.15.44:0/718695561 learned_addr learned my addr 172.21.15.44:0/718695561 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67e1e00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67e4070610 0x7f67e415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67e2800640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e406dca0 0x7f67e406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 -- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67e4070610 msgr2=0x7f67e415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67e4070610 0x7f67e415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 -- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e406dca0 msgr2=0x7f67e406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e406dca0 0x7f67e406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 -- 172.21.15.44:0/718695561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e406e5f0 con 0x7f67e40b5880 2024-09-17T05:42:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67d9400640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e40b5880 0x7f67e409aa40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f67cc000c10 tx=0x7f67cc005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67daa00640 1 -- 172.21.15.44:0/718695561 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0041c0 con 0x7f67e40b5880 2024-09-17T05:42:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67daa00640 1 -- 172.21.15.44:0/718695561 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67cc0be070 con 0x7f67e40b5880 2024-09-17T05:42:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e409b4e0 con 0x7f67e40b5880 2024-09-17T05:42:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67daa00640 1 -- 172.21.15.44:0/718695561 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc005030 con 0x7f67e40b5880 2024-09-17T05:42:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e409baa0 con 0x7f67e40b5880 2024-09-17T05:42:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e40700d0 con 0x7f67e40b5880 2024-09-17T05:42:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.431+0000 7f67daa00640 1 -- 172.21.15.44:0/718695561 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f67cc0051d0 con 0x7f67e40b5880 2024-09-17T05:42:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.435+0000 7f67daa00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f67c0073200 0x7f67c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.435+0000 7f67daa00640 1 -- 172.21.15.44:0/718695561 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6101+0+0 (secure 0 0 0) 0x7f67cc12eb80 con 0x7f67e40b5880 2024-09-17T05:42:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.435+0000 7f67e1e00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f67c0073200 0x7f67c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.435+0000 7f67e1e00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f67c0073200 0x7f67c0075710 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f67d4000f70 tx=0x7f67d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.439+0000 7f67daa00640 1 -- 172.21.15.44:0/718695561 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f67cc0c7020 con 0x7f67e40b5880 2024-09-17T05:42:11.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.647+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f67e406d780 con 0x7f67e40b5880 2024-09-17T05:42:11.650 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:42:11.647+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:42:11.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.651+0000 7f67daa00640 1 -- 172.21.15.44:0/718695561 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7f67e406e5f0 con 0x7f67e40b5880 2024-09-17T05:42:11.652 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:42:11.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.651+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f67c0073200 msgr2=0x7f67c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.651+0000 7f67e8c00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f67c0073200 0x7f67c0075710 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f67d4000f70 tx=0x7f67d4009040 comp rx=0 tx=0).stop 2024-09-17T05:42:11.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.651+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e40b5880 msgr2=0x7f67e409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.651+0000 7f67e8c00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e40b5880 0x7f67e409aa40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f67cc000c10 tx=0x7f67cc005da0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 shutdown_connections 2024-09-17T05:42:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f67c0073200 0x7f67c0075710 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e406dca0 0x7f67e406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f67e40b5880 0x7f67e409aa40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 --2- 172.21.15.44:0/718695561 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f67e4070610 0x7f67e415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 >> 172.21.15.44:0/718695561 conn(0x7f67e40ccaa0 msgr2=0x7f67e40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 shutdown_connections 2024-09-17T05:42:11.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.655+0000 7f67e8c00640 1 -- 172.21.15.44:0/718695561 wait complete. 2024-09-17T05:42:11.672 INFO:tasks.ceph.mds.a.smithi044.stderr: -5470> 2024-09-17T05:42:07.579+0000 7fbac0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:42:11.686 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-09-17T05:42:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 Processor -- start 2024-09-17T05:42:11.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 -- start start 2024-09-17T05:42:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ebdbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432eb50610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432ebde270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56432ea5da00 con 0x56432ebe2070 2024-09-17T05:42:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56432eabbf40 con 0x56432eb564a0 2024-09-17T05:42:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7faba5a38080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56432eb58a00 con 0x56432eb3ac60 2024-09-17T05:42:11.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9ec00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ebdbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432eb50610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9ec00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ebdbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:48022/0 (socket says 172.21.15.44:48022) 2024-09-17T05:42:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9ec00640 1 -- 172.21.15.44:0/4228584031 learned_addr learned my addr 172.21.15.44:0/4228584031 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:11.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9f600640 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432ebde270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9e200640 1 -- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 msgr2=0x56432ebde270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9e200640 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432ebde270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9e200640 1 -- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 msgr2=0x56432ebdbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9e200640 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ebdbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9e200640 1 -- 172.21.15.44:0/4228584031 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ea36c10 con 0x56432ebe2070 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9ec00640 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ebdbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9e200640 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432eb50610 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fab8c001e30 tx=0x7fab8c00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363fea35e354108e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.743+0000 7fab9ce00640 1 -- 172.21.15.44:0/4228584031 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00a040 con 0x56432ebe2070 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7fab9ce00640 1 -- 172.21.15.44:0/4228584031 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab8c00f410 con 0x56432ebe2070 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7fab9ce00640 1 -- 172.21.15.44:0/4228584031 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00f860 con 0x56432ebe2070 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- 172.21.15.44:0/4228584031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 msgr2=0x56432eb50610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432eb50610 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fab8c001e30 tx=0x7fab8c00b680 comp rx=0 tx=0).stop 2024-09-17T05:42:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- 172.21.15.44:0/4228584031 shutdown_connections 2024-09-17T05:42:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432ebde270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432eb50610 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 --2- 172.21.15.44:0/4228584031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ebdbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- 172.21.15.44:0/4228584031 >> 172.21.15.44:0/4228584031 conn(0x56432eafbd20 msgr2=0x56432eb10bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- 172.21.15.44:0/4228584031 shutdown_connections 2024-09-17T05:42:11.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- 172.21.15.44:0/4228584031 wait complete. 2024-09-17T05:42:11.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 Processor -- start 2024-09-17T05:42:11.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- start start 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432eb386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ec81860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432ec81da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56432ebe1340 con 0x56432ebe2070 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56432ebdeed0 con 0x56432eb564a0 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.747+0000 7faba5a38080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56432eb3a7c0 con 0x56432eb3ac60 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432ec81da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432ec81da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54156/0 (socket says 172.21.15.44:54156) 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 -- 172.21.15.44:0/2421684670 learned_addr learned my addr 172.21.15.44:0/2421684670 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9ec00640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432eb386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9e200640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ec81860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 -- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 msgr2=0x56432eb386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432eb386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 -- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 msgr2=0x56432ec81860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56432eb564a0 0x56432ec81860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 -- 172.21.15.44:0/2421684670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432ec80e80 con 0x56432ebe2070 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9ec00640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56432eb3ac60 0x56432eb386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab9f600640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432ec81da0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fab9800c6a0 tx=0x7fab9800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab97400640 1 -- 172.21.15.44:0/2421684670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9800db30 con 0x56432ebe2070 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab97400640 1 -- 172.21.15.44:0/2421684670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab98014070 con 0x56432ebe2070 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab97400640 1 -- 172.21.15.44:0/2421684670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98019470 con 0x56432ebe2070 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432ec81120 con 0x56432ebe2070 2024-09-17T05:42:11.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432ec80910 con 0x56432ebe2070 2024-09-17T05:42:11.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.751+0000 7fab97400640 1 -- 172.21.15.44:0/2421684670 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fab98019610 con 0x56432ebe2070 2024-09-17T05:42:11.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7fab97400640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab80071c10 0x7fab80074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7fab97400640 1 -- 172.21.15.44:0/2421684670 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7fab98094170 con 0x56432ebe2070 2024-09-17T05:42:11.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7faba5a38080 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x56432ec7ed70 0x56432ec7f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e91) -- 0x56432ebdead0 con 0x56432ec7ed70 2024-09-17T05:42:11.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7fab9ec00640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab80071c10 0x7fab80074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7fab9e200640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x56432ec7ed70 0x56432ec7f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7fab9ec00640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab80071c10 0x7fab80074120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fab9000a460 tx=0x7fab900ad040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.755+0000 7fab9e200640 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x56432ec7ed70 0x56432ec7f180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7fab9e200640 1 -- 172.21.15.44:0/2421684670 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v91'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fab8c00d040 con 0x56432ec7ed70 2024-09-17T05:42:11.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x56432ec7ed70 msgr2=0x56432ec7f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x56432ec7ed70 0x56432ec7f180 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab80071c10 msgr2=0x7fab80074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fab80071c10 0x7fab80074120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fab9000a460 tx=0x7fab900ad040 comp rx=0 tx=0).stop 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 msgr2=0x56432ec81da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 --2- 172.21.15.44:0/2421684670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56432ebe2070 0x56432ec81da0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fab9800c6a0 tx=0x7fab9800cb60 comp rx=0 tx=0).stop 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7fab9f600640 1 -- 172.21.15.44:0/2421684670 reap_dead start 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 shutdown_connections 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 >> 172.21.15.44:0/2421684670 conn(0x56432eafbd20 msgr2=0x56432ebde270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 shutdown_connections 2024-09-17T05:42:11.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.759+0000 7faba5a38080 1 -- 172.21.15.44:0/2421684670 wait complete. 2024-09-17T05:42:11.769 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --yes-i-really-really-mean-it 2024-09-17T05:42:11.807 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:42:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 -- start start 2024-09-17T05:42:11.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 Processor -- start 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a09680 0x55b6ba70a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a09b00 0x55b6ba70a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0a400 0x55b6ba70ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0c180 con 0x55b6b9a09680 2024-09-17T05:42:11.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0c300 con 0x55b6b9a09b00 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b6b9a0c480 con 0x55b6b9a0a400 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f397ee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a09680 0x55b6ba70a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f397ee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a09680 0x55b6ba70a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54188/0 (socket says 172.21.15.44:54188) 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.831+0000 7f397ee00640 1 -- 172.21.15.44:0/1749534643 learned_addr learned my addr 172.21.15.44:0/1749534643 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397e400640 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a09b00 0x55b6ba70a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397f800640 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0a400 0x55b6ba70ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397ee00640 1 -- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0a400 msgr2=0x55b6ba70ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397ee00640 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0a400 0x55b6ba70ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397ee00640 1 -- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a09b00 msgr2=0x55b6ba70a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397ee00640 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a09b00 0x55b6ba70a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397ee00640 1 -- 172.21.15.44:0/1749534643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b9a3e960 con 0x55b6b9a09680 2024-09-17T05:42:11.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397f800640 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0a400 0x55b6ba70ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:11.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397e400640 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a09b00 0x55b6ba70a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:11.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397ee00640 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a09680 0x55b6ba70a580 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x55b6ba795c20 tx=0x55b6ba850120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc4dca117d241a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397bc00640 1 -- 172.21.15.44:0/1749534643 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995d520 con 0x55b6b9a09680 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 -- 172.21.15.44:0/1749534643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b9a3ed20 con 0x55b6b9a09680 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397bc00640 1 -- 172.21.15.44:0/1749534643 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b6b997a540 con 0x55b6b9a09680 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397bc00640 1 -- 172.21.15.44:0/1749534643 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995d1e0 con 0x55b6b9a09680 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 -- 172.21.15.44:0/1749534643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b6b9a3ef00 con 0x55b6b9a09680 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 4 waiting for MDS map... 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397bc00640 1 -- 172.21.15.44:0/1749534643 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x55b6ba709000 con 0x55b6b9a09680 2024-09-17T05:42:11.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f397bc00640 1 -- 172.21.15.44:0/1749534643 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 63) ==== 2893+0+0 (secure 0 0 0) 0x55b6b997d180 con 0x55b6b9a09680 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 4 Got MDS map 63 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 10 main: JournalTool::main 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 4 main: JournalTool: connecting to RADOS... 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 Processor -- start 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 -- start start 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0c600 con 0x55b6b9a08480 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0c780 con 0x55b6b9a08900 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.835+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b6b9a0c900 con 0x55b6b9a08d80 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54202/0 (socket says 172.21.15.44:54202) 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 -- 172.21.15.44:0/3635151122 learned_addr learned my addr 172.21.15.44:0/3635151122 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397f800640 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397ee00640 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 -- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 msgr2=0x55b6ba70b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 -- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 msgr2=0x55b6ba70b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 -- 172.21.15.44:0/3635151122 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b9a3ed20 con 0x55b6b9a08480 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397ee00640 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f397e400640 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x55b6ba795230 tx=0x55b6b9a439e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84a1cc8f22a9b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3979400640 1 -- 172.21.15.44:0/3635151122 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995d380 con 0x55b6b9a08480 2024-09-17T05:42:11.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3979400640 1 -- 172.21.15.44:0/3635151122 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b6b997afc0 con 0x55b6b9a08480 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3979400640 1 -- 172.21.15.44:0/3635151122 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995d520 con 0x55b6b9a08480 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 -- 172.21.15.44:0/3635151122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 msgr2=0x55b6ba70bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x55b6ba795230 tx=0x55b6b9a439e0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 -- 172.21.15.44:0/3635151122 shutdown_connections 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3635151122 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 -- 172.21.15.44:0/3635151122 >> 172.21.15.44:0/3635151122 conn(0x55b6b9a09200 msgr2=0x55b6b9c5e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 -- 172.21.15.44:0/3635151122 shutdown_connections 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 -- 172.21.15.44:0/3635151122 wait complete. 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 Processor -- start 2024-09-17T05:42:11.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.839+0000 7f3980d4f400 1 -- start start 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0db00 con 0x55b6b9a08480 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0d980 con 0x55b6b9a08900 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b6b9a0d800 con 0x55b6b9a08d80 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54206/0 (socket says 172.21.15.44:54206) 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 -- 172.21.15.44:0/2599299868 learned_addr learned my addr 172.21.15.44:0/2599299868 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397ee00640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397e400640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 -- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 msgr2=0x55b6ba70b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 -- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 msgr2=0x55b6ba70b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 -- 172.21.15.44:0/2599299868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b9a3fa40 con 0x55b6b9a08480 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f397f800640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x55b6ba86bdd0 tx=0x55b6ba878f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3977600640 1 -- 172.21.15.44:0/2599299868 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995d380 con 0x55b6b9a08480 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3977600640 1 -- 172.21.15.44:0/2599299868 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b6b997ac40 con 0x55b6b9a08480 2024-09-17T05:42:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6b9a3fc20 con 0x55b6b9a08480 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3977600640 1 -- 172.21.15.44:0/2599299868 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995d520 con 0x55b6b9a08480 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b9a3fc20 con 0x55b6b9a08480 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3980d4f400 4 main: JournalTool: resolving pool 13 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.843+0000 7f3977600640 1 -- 172.21.15.44:0/2599299868 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x55b6b9c6cc00 con 0x55b6b9a08480 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3977600640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b6b9a0b180 0x55b6ba70c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3977600640 1 -- 172.21.15.44:0/2599299868 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x55b6b9c72600 con 0x55b6b9a08480 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 4 main: JournalTool: creating IoCtx.. 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 4 main: Executing for rank 0 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f397ee00640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b6b9a0b180 0x55b6ba70c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f397ee00640 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b6b9a0b180 0x55b6ba70c100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55b6b995f350 tx=0x55b6ba850420 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 -- start start 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 Processor -- start 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a0a880 0x55b6ba70c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0ad00 0x55b6ba70cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a0b600 0x55b6ba70d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0d500 con 0x55b6b9a0b600 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9a0c780 con 0x55b6b9a0a880 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f3980d4f400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b6b9a0ca80 con 0x55b6b9a0ad00 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f397e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a0b600 0x55b6ba70d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f397e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a0b600 0x55b6ba70d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54214/0 (socket says 172.21.15.44:54214) 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f397ee00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0ad00 0x55b6ba70cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f397e400640 1 -- 172.21.15.44:0/3571636454 learned_addr learned my addr 172.21.15.44:0/3571636454 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.847+0000 7f397f800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a0a880 0x55b6ba70c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397e400640 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0ad00 msgr2=0x55b6ba70cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397e400640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0ad00 0x55b6ba70cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397e400640 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a0a880 msgr2=0x55b6ba70c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397e400640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a0a880 0x55b6ba70c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397e400640 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b9dc41e0 con 0x55b6b9a0b600 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397ee00640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0ad00 0x55b6ba70cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397f800640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a0a880 0x55b6ba70c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397e400640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a0b600 0x55b6ba70d180 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x55b6ba86b140 tx=0x55b6ba878cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51ee1aca86c4eee server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3973a00640 1 -- 172.21.15.44:0/3571636454 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995d1e0 con 0x55b6b9a0b600 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3973a00640 1 -- 172.21.15.44:0/3571636454 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b6b997ae00 con 0x55b6b9a0b600 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b9dc43c0 con 0x55b6b9a0b600 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b6b9dc45a0 con 0x55b6b9a0b600 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 4 waiting for MDS map... 2024-09-17T05:42:11.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3973a00640 1 -- 172.21.15.44:0/3571636454 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b6b995c820 con 0x55b6b9a0b600 2024-09-17T05:42:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3973a00640 1 -- 172.21.15.44:0/3571636454 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x55b6b9dd4400 con 0x55b6b9a0b600 2024-09-17T05:42:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3973a00640 1 -- 172.21.15.44:0/3571636454 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 63) ==== 2893+0+0 (secure 0 0 0) 0x55b6b997d500 con 0x55b6b9a0b600 2024-09-17T05:42:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 4 Got MDS map 63 2024-09-17T05:42:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b6b9a0ba80 0x55b6ba70d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9ddf800 con 0x55b6b9a0ba80 2024-09-17T05:42:11.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397f800640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b6b9a0ba80 0x55b6ba70d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397f800640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b6b9a0ba80 0x55b6ba70d700 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=d8a8acef7143fa75 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397f800640 1 -- 172.21.15.44:0/3571636454 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55b6b9a30000 con 0x55b6b9a0ba80 2024-09-17T05:42:11.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b6b9de8000 0x55b6b9df0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:2 13.14 13:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9ddfc00 con 0x55b6b9de8000 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397ee00640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b6b9de8000 0x55b6b9df0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.851+0000 7f397ee00640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b6b9de8000 0x55b6b9df0000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=5e9253fab7471f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397ee00640 1 -- 172.21.15.44:0/3571636454 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55b6b9a30500 con 0x55b6b9de8000 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3971c00640 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:3 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9df4000 con 0x55b6b9de8000 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3971c00640 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:4 13.1b 13:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9df4400 con 0x55b6b9a0ba80 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397f800640 1 -- 172.21.15.44:0/3571636454 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30000 con 0x55b6b9a0ba80 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397ee00640 1 -- 172.21.15.44:0/3571636454 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55b6b9a30500 con 0x55b6b9de8000 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stdout:old journal was 4211434~2544 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stdout:new journal start will be 8388608 (4174630 bytes past old end) 2024-09-17T05:42:11.857 INFO:teuthology.orchestra.run.smithi044.stdout:writing journal head 2024-09-17T05:42:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:5 13.14 13:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9df4c00 con 0x55b6b9de8000 2024-09-17T05:42:11.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397ee00640 1 -- 172.21.15.44:0/3571636454 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v91'20 uv20 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30500 con 0x55b6b9de8000 2024-09-17T05:42:11.858 INFO:teuthology.orchestra.run.smithi044.stdout:writing EResetJournal entry 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:6 13.1b 13:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9df5000 con 0x55b6b9a0ba80 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b6b9de8480 0x55b6b9df0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:7 13.b 13:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9df5400 con 0x55b6b9de8480 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b6b9de8900 0x55b6b9df0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:8 13.1f 13:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9df4400 con 0x55b6b9de8900 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b6b9de8d80 0x55b6b9df1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:9 13.1a 13:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9ddf800 con 0x55b6b9de8d80 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b6b9de9200 0x55b6b9df1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:10 13.1e 13:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9c75000 con 0x55b6b9de9200 2024-09-17T05:42:11.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:11 13.1d 13:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9c74c00 con 0x55b6b9de8900 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397f800640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b6b9de8480 0x55b6b9df0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397e400640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b6b9de8d80 0x55b6b9df1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397ee00640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b6b9de8900 0x55b6b9df0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.855+0000 7f397f800640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b6b9de9200 0x55b6b9df1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f397f800640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b6b9de8480 0x55b6b9df0580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=f1abc8aac35b4c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f397f800640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b6b9de9200 0x55b6b9df1600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=623ad4107f876b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f397f800640 1 -- 172.21.15.44:0/3571636454 <== osd.2 v2:172.21.15.44:6808/1191521276 3 ==== osd_op_reply(6 200.00000002 [delete] v91'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30000 con 0x55b6b9a0ba80 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f397e400640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b6b9de8d80 0x55b6b9df1080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=d645ce49a8c0ebac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f397ee00640 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b6b9de8900 0x55b6b9df0b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=2bc7a15b4f46e582 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f397f800640 1 -- 172.21.15.44:0/3571636454 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(7 200.00000003 [delete] v91'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30000 con 0x55b6b9de8480 2024-09-17T05:42:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f3971c00640 1 -- 172.21.15.44:0/3571636454 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:12 13.1b 13:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55b6b9df4800 con 0x55b6b9a0ba80 2024-09-17T05:42:11.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.859+0000 7f397f800640 1 -- 172.21.15.44:0/3571636454 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(10 200.00000006 [delete] v91'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30000 con 0x55b6b9de9200 2024-09-17T05:42:11.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f397f800640 1 -- 172.21.15.44:0/3571636454 <== osd.2 v2:172.21.15.44:6808/1191521276 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v91'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30000 con 0x55b6b9a0ba80 2024-09-17T05:42:11.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f397ee00640 1 -- 172.21.15.44:0/3571636454 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(8 200.00000004 [delete] v91'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30500 con 0x55b6b9de8900 2024-09-17T05:42:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f397e400640 1 -- 172.21.15.44:0/3571636454 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(9 200.00000005 [delete] v91'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30780 con 0x55b6b9de8d80 2024-09-17T05:42:11.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f397ee00640 1 -- 172.21.15.44:0/3571636454 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== osd_op_reply(11 200.00000007 [delete] v91'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55b6b9a30500 con 0x55b6b9de8900 2024-09-17T05:42:11.867 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b6b9de9200 msgr2=0x55b6b9df1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b6b9de9200 0x55b6b9df1600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b6b9de8900 msgr2=0x55b6b9df0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b6b9de8900 0x55b6b9df0b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b6b9a0ba80 msgr2=0x55b6ba70d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b6b9a0ba80 0x55b6ba70d700 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b6b9de8480 msgr2=0x55b6b9df0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b6b9de8480 0x55b6b9df0580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b6b9de8d80 msgr2=0x55b6b9df1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f397e400640 1 -- 172.21.15.44:0/3571636454 reap_dead start 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b6b9de8d80 0x55b6b9df1080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b6b9de8000 msgr2=0x55b6b9df0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b6b9de8000 0x55b6b9df0000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a0b600 msgr2=0x55b6ba70d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a0b600 0x55b6ba70d180 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x55b6ba86b140 tx=0x55b6ba878cc0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 shutdown_connections 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b6b9de8d80 0x55b6b9df1080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b6b9de8000 0x55b6b9df0000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 --2- 172.21.15.44:0/3571636454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a0b600 0x55b6ba70d180 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.863+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 >> 172.21.15.44:0/3571636454 conn(0x55b6b9a08000 msgr2=0x55b6b9c5f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 shutdown_connections 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/3571636454 wait complete. 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b6b9a0b180 msgr2=0x55b6ba70c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b6b9a0b180 0x55b6ba70c100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55b6b995f350 tx=0x55b6ba850420 comp rx=0 tx=0).stop 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 msgr2=0x55b6ba70bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x55b6ba86bdd0 tx=0x55b6ba878f60 comp rx=0 tx=0).stop 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 shutdown_connections 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a08d80 0x55b6ba70b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b6b9a0b180 0x55b6ba70c100 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a08900 0x55b6ba70b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/2599299868 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a08480 0x55b6ba70bb80 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 >> 172.21.15.44:0/2599299868 conn(0x55b6b9a09200 msgr2=0x55b6b9c5e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 shutdown_connections 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/2599299868 wait complete. 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/1749534643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a09680 msgr2=0x55b6ba70a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a09680 0x55b6ba70a580 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x55b6ba795c20 tx=0x55b6ba850120 comp rx=0 tx=0).stop 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/1749534643 shutdown_connections 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b6b9a0a400 0x55b6ba70ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b6b9a09b00 0x55b6ba70a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 --2- 172.21.15.44:0/1749534643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b6b9a09680 0x55b6ba70a580 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/1749534643 >> 172.21.15.44:0/1749534643 conn(0x55b6b9a09f80 msgr2=0x55b6b5923800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/1749534643 shutdown_connections 2024-09-17T05:42:11.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:11.867+0000 7f3980d4f400 1 -- 172.21.15.44:0/1749534643 wait complete. 2024-09-17T05:42:11.874 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--yes-i-really-really-mean-it'] in time 0:00:00.105496, result: old journal was 4211434~2544 new journal start will be 8388608 (4174630 bytes past old end) writing journal head writing EResetJournal entry done 2024-09-17T05:42:11.874 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T05:42:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.079+0000 7f933b200640 1 -- 172.21.15.44:0/3636284353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9320003c20 msgr2=0x7f9320004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.079+0000 7f933b200640 1 --2- 172.21.15.44:0/3636284353 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9320003c20 0x7f9320004030 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f932c006fc0 tx=0x7f932c01f680 comp rx=0 tx=0).stop 2024-09-17T05:42:12.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.079+0000 7f933a800640 1 -- 172.21.15.44:0/3636284353 reap_dead start 2024-09-17T05:42:12.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.079+0000 7f933b200640 1 -- 172.21.15.44:0/3636284353 shutdown_connections 2024-09-17T05:42:12.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.079+0000 7f933b200640 1 -- 172.21.15.44:0/3636284353 >> 172.21.15.44:0/3636284353 conn(0x7f933c06ce40 msgr2=0x7f933c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.079+0000 7f933b200640 1 -- 172.21.15.44:0/3636284353 shutdown_connections 2024-09-17T05:42:12.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.079+0000 7f933b200640 1 -- 172.21.15.44:0/3636284353 wait complete. 2024-09-17T05:42:12.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 Processor -- start 2024-09-17T05:42:12.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 -- start start 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9320003c20 0x7f933c14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f933c151b00 0x7f933c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f933c0702b0 0x7f933c1f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f933c15b8e0 con 0x7f933c151b00 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f933c0cf9a0 con 0x7f933c0702b0 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933b200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f933c15ba60 con 0x7f9320003c20 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f933c151b00 0x7f933c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f933c151b00 0x7f933c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54240/0 (socket says 172.21.15.44:54240) 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 -- 172.21.15.44:0/159040652 learned_addr learned my addr 172.21.15.44:0/159040652 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9339e00640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9320003c20 0x7f933c14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f933a800640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f933c0702b0 0x7f933c1f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 -- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9320003c20 msgr2=0x7f933c14e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9320003c20 0x7f933c14e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 -- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f933c0702b0 msgr2=0x7f933c1f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f933c0702b0 0x7f933c1f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.083+0000 7f9333e00640 1 -- 172.21.15.44:0/159040652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c0706c0 con 0x7f933c151b00 2024-09-17T05:42:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f9333e00640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f933c151b00 0x7f933c06fd70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9324011b10 tx=0x7f9324009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f9332000640 1 -- 172.21.15.44:0/159040652 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932401e070 con 0x7f933c151b00 2024-09-17T05:42:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f9332000640 1 -- 172.21.15.44:0/159040652 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9324004050 con 0x7f933c151b00 2024-09-17T05:42:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f9332000640 1 -- 172.21.15.44:0/159040652 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932400fea0 con 0x7f933c151b00 2024-09-17T05:42:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c1588d0 con 0x7f933c151b00 2024-09-17T05:42:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c0b4640 con 0x7f933c151b00 2024-09-17T05:42:12.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c0cf080 con 0x7f933c151b00 2024-09-17T05:42:12.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f9332000640 1 -- 172.21.15.44:0/159040652 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9324021070 con 0x7f933c151b00 2024-09-17T05:42:12.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f9332000640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9318073200 0x7f9318075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.087+0000 7f9332000640 1 -- 172.21.15.44:0/159040652 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f93240956c0 con 0x7f933c151b00 2024-09-17T05:42:12.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.091+0000 7f9339e00640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9318073200 0x7f9318075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.091+0000 7f9339e00640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9318073200 0x7f9318075710 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f932c0b0000 tx=0x7f932c005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.091+0000 7f9332000640 1 -- 172.21.15.44:0/159040652 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f933c0706c0 con 0x7f933c151b00 2024-09-17T05:42:12.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.307+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f933c0b2e50 con 0x7f933c151b00 2024-09-17T05:42:12.577 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:12.581 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:12.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.659+0000 7f9332000640 1 -- 172.21.15.44:0/159040652 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v64) ==== 162+0+0 (secure 0 0 0) 0x7f932405ffe0 con 0x7f933c151b00 2024-09-17T05:42:12.661 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T05:42:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9318073200 msgr2=0x7f9318075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9318073200 0x7f9318075710 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f932c0b0000 tx=0x7f932c005040 comp rx=0 tx=0).stop 2024-09-17T05:42:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f933c151b00 msgr2=0x7f933c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f933c151b00 0x7f933c06fd70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9324011b10 tx=0x7f9324009eb0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 shutdown_connections 2024-09-17T05:42:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9318073200 0x7f9318075710 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f933c0702b0 0x7f933c1f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f933c151b00 0x7f933c06fd70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 --2- 172.21.15.44:0/159040652 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9320003c20 0x7f933c14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 >> 172.21.15.44:0/159040652 conn(0x7f933c06ce40 msgr2=0x7f933c06e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 shutdown_connections 2024-09-17T05:42:12.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.663+0000 7f933b200640 1 -- 172.21.15.44:0/159040652 wait complete. 2024-09-17T05:42:12.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 -- 172.21.15.44:0/198272745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800ce300 msgr2=0x7ff380167120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 --2- 172.21.15.44:0/198272745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800ce300 0x7ff380167120 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7ff378009c80 tx=0x7ff37801cda0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 -- 172.21.15.44:0/198272745 shutdown_connections 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 --2- 172.21.15.44:0/198272745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800ce300 0x7ff380167120 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 --2- 172.21.15.44:0/198272745 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800b5880 0x7ff38006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 -- 172.21.15.44:0/198272745 >> 172.21.15.44:0/198272745 conn(0x7ff3800ccaa0 msgr2=0x7ff3800cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 -- 172.21.15.44:0/198272745 shutdown_connections 2024-09-17T05:42:12.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.891+0000 7ff387600640 1 -- 172.21.15.44:0/198272745 wait complete. 2024-09-17T05:42:12.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 Processor -- start 2024-09-17T05:42:12.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 -- start start 2024-09-17T05:42:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff38006e390 0x7ff3800c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b5880 0x7ff38015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800ce300 0x7ff3800a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff38016a000 con 0x7ff3800b5880 2024-09-17T05:42:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff380169e80 con 0x7ff38006e390 2024-09-17T05:42:12.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff387600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff38016a180 con 0x7ff3800ce300 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b5880 0x7ff38015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b5880 0x7ff38015ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54252/0 (socket says 172.21.15.44:54252) 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 -- 172.21.15.44:0/3939745006 learned_addr learned my addr 172.21.15.44:0/3939745006 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff385600640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800ce300 0x7ff3800a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff384c00640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff38006e390 0x7ff3800c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 -- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800ce300 msgr2=0x7ff3800a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800ce300 0x7ff3800a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 -- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff38006e390 msgr2=0x7ff3800c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff38006e390 0x7ff3800c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 -- 172.21.15.44:0/3939745006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38009faa0 con 0x7ff3800b5880 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37fe00640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b5880 0x7ff38015ab90 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c3c0 tx=0x7ff36c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.895+0000 7ff37cc00640 1 -- 172.21.15.44:0/3939745006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c017070 con 0x7ff3800b5880 2024-09-17T05:42:12.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff37cc00640 1 -- 172.21.15.44:0/3939745006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff36c0053c0 con 0x7ff3800b5880 2024-09-17T05:42:12.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff37cc00640 1 -- 172.21.15.44:0/3939745006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c003840 con 0x7ff3800b5880 2024-09-17T05:42:12.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38009fd80 con 0x7ff3800b5880 2024-09-17T05:42:12.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3800a0340 con 0x7ff3800b5880 2024-09-17T05:42:12.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38006de50 con 0x7ff3800b5880 2024-09-17T05:42:12.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff37cc00640 1 -- 172.21.15.44:0/3939745006 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff36c01a070 con 0x7ff3800b5880 2024-09-17T05:42:12.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff37cc00640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff360073230 0x7ff360075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:12.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff37cc00640 1 -- 172.21.15.44:0/3939745006 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7ff36c0939f0 con 0x7ff3800b5880 2024-09-17T05:42:12.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.899+0000 7ff384c00640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff360073230 0x7ff360075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:12.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.903+0000 7ff384c00640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff360073230 0x7ff360075740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff374009b40 tx=0x7ff3740091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:12.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:12.903+0000 7ff37cc00640 1 -- 172.21.15.44:0/3939745006 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff36c021020 con 0x7ff3800b5880 2024-09-17T05:42:13.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.111+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3800cdc90 con 0x7ff3800b5880 2024-09-17T05:42:13.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.111+0000 7ff37cc00640 1 -- 172.21.15.44:0/3939745006 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5216 (secure 0 0 0) 0x7ff38006e7a0 con 0x7ff3800b5880 2024-09-17T05:42:13.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:13.114 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":65,"btime":"2024-09-17T05:42:12:667489+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:12.667473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7071},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7071":{"gid":7071,"name":"a","rank":0,"incarnation":65,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/3231247769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3231247769},{"type":"v1","addr":"172.21.15.44:6835","nonce":3231247769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T05:42:13.114 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 65 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff360073230 msgr2=0x7ff360075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff360073230 0x7ff360075740 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff374009b40 tx=0x7ff3740091e0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b5880 msgr2=0x7ff38015ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b5880 0x7ff38015ab90 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c3c0 tx=0x7ff36c00c880 comp rx=0 tx=0).stop 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 shutdown_connections 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3800ce300 0x7ff3800a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b5880 0x7ff38015ab90 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff360073230 0x7ff360075740 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 --2- 172.21.15.44:0/3939745006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff38006e390 0x7ff3800c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:13.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 >> 172.21.15.44:0/3939745006 conn(0x7ff3800ccaa0 msgr2=0x7ff38015f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:13.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 shutdown_connections 2024-09-17T05:42:13.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:13.115+0000 7ff387600640 1 -- 172.21.15.44:0/3939745006 wait complete. 2024-09-17T05:42:13.538 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:01.792332+0000', 'modified': '2024-09-17T05:42:12.667473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7071}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7071': {'gid': 7071, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/3231247769', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 3231247769}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3231247769}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:42:13.539 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7071:up:replay 2024-09-17T05:42:14.539 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:14.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 -- 172.21.15.44:0/3394009391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac072190 msgr2=0x7f2fac06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:14.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 --2- 172.21.15.44:0/3394009391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac072190 0x7f2fac06e160 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009900 tx=0x7f2f9c01c7c0 comp rx=0 tx=0).stop 2024-09-17T05:42:14.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 -- 172.21.15.44:0/3394009391 shutdown_connections 2024-09-17T05:42:14.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 --2- 172.21.15.44:0/3394009391 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fac0cecf0 0x7f2fac0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:14.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 --2- 172.21.15.44:0/3394009391 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac072190 0x7f2fac06e160 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:14.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 -- 172.21.15.44:0/3394009391 >> 172.21.15.44:0/3394009391 conn(0x7f2fac0d1120 msgr2=0x7f2fac0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:14.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 -- 172.21.15.44:0/3394009391 shutdown_connections 2024-09-17T05:42:14.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.795+0000 7f2fb3200640 1 -- 172.21.15.44:0/3394009391 wait complete. 2024-09-17T05:42:14.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 Processor -- start 2024-09-17T05:42:14.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 -- start start 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fac072190 0x7f2fac0cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fac0ae3e0 0x7f2fac149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac0cecf0 0x7f2fac0cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac168ea0 con 0x7f2fac0cecf0 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2fac168d20 con 0x7f2fac072190 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2fac169020 con 0x7f2fac0ae3e0 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac0cecf0 0x7f2fac0cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac0cecf0 0x7f2fac0cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54268/0 (socket says 172.21.15.44:54268) 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fabe00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fac072190 0x7f2fac0cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 -- 172.21.15.44:0/183488894 learned_addr learned my addr 172.21.15.44:0/183488894 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fa3e00640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fac0ae3e0 0x7f2fac149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:14.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 -- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fac0ae3e0 msgr2=0x7f2fac149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:14.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fac0ae3e0 0x7f2fac149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:14.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 -- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fac072190 msgr2=0x7f2fac0cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:14.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fac072190 0x7f2fac0cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:14.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 -- 172.21.15.44:0/183488894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac0b3ff0 con 0x7f2fac0cecf0 2024-09-17T05:42:14.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb1200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac0cecf0 0x7f2fac0cc5a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c6e0 tx=0x7f2fa400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fa8c00640 1 -- 172.21.15.44:0/183488894 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4003b80 con 0x7f2fac0cecf0 2024-09-17T05:42:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fa8c00640 1 -- 172.21.15.44:0/183488894 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fa4003d20 con 0x7f2fac0cecf0 2024-09-17T05:42:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fa8c00640 1 -- 172.21.15.44:0/183488894 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4005330 con 0x7f2fac0cecf0 2024-09-17T05:42:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fac0cb770 con 0x7f2fac0cecf0 2024-09-17T05:42:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.799+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fac0b4290 con 0x7f2fac0cecf0 2024-09-17T05:42:14.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.803+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fac06e160 con 0x7f2fac0cecf0 2024-09-17T05:42:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.803+0000 7f2fa8c00640 1 -- 172.21.15.44:0/183488894 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2fa40054d0 con 0x7f2fac0cecf0 2024-09-17T05:42:14.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.803+0000 7f2fa8c00640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f88073200 0x7f2f88075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:14.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.803+0000 7f2fa8c00640 1 -- 172.21.15.44:0/183488894 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f2fa4094150 con 0x7f2fac0cecf0 2024-09-17T05:42:14.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.803+0000 7f2fabe00640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f88073200 0x7f2f88075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.807+0000 7f2fabe00640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f88073200 0x7f2f88075710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0af000 tx=0x7f2f9c01b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:14.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:14.807+0000 7f2fa8c00640 1 -- 172.21.15.44:0/183488894 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2fac0cf640 con 0x7f2fac0cecf0 2024-09-17T05:42:15.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fac0c8c50 con 0x7f2fac0cecf0 2024-09-17T05:42:15.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fa8c00640 1 -- 172.21.15.44:0/183488894 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5216 (secure 0 0 0) 0x7f2fa405e8a0 con 0x7f2fac0cecf0 2024-09-17T05:42:15.020 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:15.020 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":67,"btime":"2024-09-17T05:42:14:674415+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:13.676376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7071},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7071":{"gid":7071,"name":"a","rank":0,"incarnation":65,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.44:6835/3231247769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3231247769},{"type":"v1","addr":"172.21.15.44:6835","nonce":3231247769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T05:42:15.020 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 67 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f88073200 msgr2=0x7f2f88075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f88073200 0x7f2f88075710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c0af000 tx=0x7f2f9c01b000 comp rx=0 tx=0).stop 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac0cecf0 msgr2=0x7f2fac0cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac0cecf0 0x7f2fac0cc5a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c6e0 tx=0x7f2fa400cba0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 shutdown_connections 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2fac0cecf0 0x7f2fac0cc5a0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2fac0ae3e0 0x7f2fac149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2f88073200 0x7f2f88075710 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 --2- 172.21.15.44:0/183488894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2fac072190 0x7f2fac0cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:15.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 >> 172.21.15.44:0/183488894 conn(0x7f2fac0d1120 msgr2=0x7f2fac15b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:15.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 shutdown_connections 2024-09-17T05:42:15.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:15.019+0000 7f2fb3200640 1 -- 172.21.15.44:0/183488894 wait complete. 2024-09-17T05:42:15.444 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:01.792332+0000', 'modified': '2024-09-17T05:42:13.676376+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7071}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7071': {'gid': 7071, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.44:6835/3231247769', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 3231247769}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3231247769}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:42:15.445 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7071:up:rejoin 2024-09-17T05:42:16.445 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 -- 172.21.15.44:0/2239977519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 msgr2=0x7fa3240cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 --2- 172.21.15.44:0/2239977519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 0x7fa3240cb880 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009bc0 tx=0x7fa31c01cb10 comp rx=0 tx=0).stop 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 -- 172.21.15.44:0/2239977519 shutdown_connections 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 --2- 172.21.15.44:0/2239977519 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 0x7fa3240cb880 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 --2- 172.21.15.44:0/2239977519 >> v2:172.21.15.86:3300/0 conn(0x7fa32406de50 0x7fa32406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 -- 172.21.15.44:0/2239977519 >> 172.21.15.44:0/2239977519 conn(0x7fa3240ccaa0 msgr2=0x7fa3240cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 -- 172.21.15.44:0/2239977519 shutdown_connections 2024-09-17T05:42:16.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.615+0000 7fa329000640 1 -- 172.21.15.44:0/2239977519 wait complete. 2024-09-17T05:42:16.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 Processor -- start 2024-09-17T05:42:16.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 -- start start 2024-09-17T05:42:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32406de50 0x7fa324153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa324072e50 0x7fa3241f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 0x7fa3240cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa324168f70 con 0x7fa324072e50 2024-09-17T05:42:16.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa324168df0 con 0x7fa32406de50 2024-09-17T05:42:16.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa329000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa3241690f0 con 0x7fa3240cb470 2024-09-17T05:42:16.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa31be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa324072e50 0x7fa3241f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:16.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa321e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32406de50 0x7fa324153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:16.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa31be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa324072e50 0x7fa3241f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54280/0 (socket says 172.21.15.44:54280) 2024-09-17T05:42:16.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa31be00640 1 -- 172.21.15.44:0/3477949269 learned_addr learned my addr 172.21.15.44:0/3477949269 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:16.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa322800640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 0x7fa3240cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:16.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa321e00640 1 -- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 msgr2=0x7fa3240cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:16.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa321e00640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 0x7fa3240cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa321e00640 1 -- 172.21.15.44:0/3477949269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa324072e50 msgr2=0x7fa3241f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa321e00640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa324072e50 0x7fa3241f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa321e00640 1 -- 172.21.15.44:0/3477949269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa324154fc0 con 0x7fa32406de50 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa321e00640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32406de50 0x7fa324153e60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c3c0 tx=0x7fa314001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa31a000640 1 -- 172.21.15.44:0/3477949269 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314011790 con 0x7fa32406de50 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.619+0000 7fa31a000640 1 -- 172.21.15.44:0/3477949269 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa314017070 con 0x7fa32406de50 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.623+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa324154720 con 0x7fa32406de50 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.623+0000 7fa31a000640 1 -- 172.21.15.44:0/3477949269 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314011cc0 con 0x7fa32406de50 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.623+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa324154ce0 con 0x7fa32406de50 2024-09-17T05:42:16.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.623+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3240b5fa0 con 0x7fa32406de50 2024-09-17T05:42:16.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.623+0000 7fa31a000640 1 -- 172.21.15.44:0/3477949269 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa31401c460 con 0x7fa32406de50 2024-09-17T05:42:16.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.623+0000 7fa31a000640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa300073200 0x7fa300075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:16.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.623+0000 7fa31a000640 1 -- 172.21.15.44:0/3477949269 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7fa314093de0 con 0x7fa32406de50 2024-09-17T05:42:16.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.627+0000 7fa31be00640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa300073200 0x7fa300075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:16.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.627+0000 7fa31be00640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa300073200 0x7fa300075710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa32415a610 tx=0x7fa30c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:16.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.631+0000 7fa31a000640 1 -- 172.21.15.44:0/3477949269 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa314021020 con 0x7fa32406de50 2024-09-17T05:42:16.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.843+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3240af9c0 con 0x7fa32406de50 2024-09-17T05:42:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.843+0000 7fa31a000640 1 -- 172.21.15.44:0/3477949269 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5223 (secure 0 0 0) 0x7fa32406e7a0 con 0x7fa32406de50 2024-09-17T05:42:16.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:16.845 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":68,"btime":"2024-09-17T05:42:15:681605+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:15.681592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7071},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7071":{"gid":7071,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/3231247769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3231247769},{"type":"v1","addr":"172.21.15.44:6835","nonce":3231247769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7071,"qdb_cluster":[7071]},"id":6}]} 2024-09-17T05:42:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 68 2024-09-17T05:42:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.843+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa300073200 msgr2=0x7fa300075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.843+0000 7fa329000640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa300073200 0x7fa300075710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa32415a610 tx=0x7fa30c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.843+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32406de50 msgr2=0x7fa324153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.843+0000 7fa329000640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32406de50 0x7fa324153e60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c3c0 tx=0x7fa314001e80 comp rx=0 tx=0).stop 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 shutdown_connections 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa3240cb470 0x7fa3240cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa324072e50 0x7fa3241f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa300073200 0x7fa300075710 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 --2- 172.21.15.44:0/3477949269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32406de50 0x7fa324153e60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 >> 172.21.15.44:0/3477949269 conn(0x7fa3240ccaa0 msgr2=0x7fa3241552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 shutdown_connections 2024-09-17T05:42:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:16.847+0000 7fa329000640 1 -- 172.21.15.44:0/3477949269 wait complete. 2024-09-17T05:42:17.270 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:01.792332+0000', 'modified': '2024-09-17T05:42:15.681592+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7071}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7071': {'gid': 7071, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6835/3231247769', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 3231247769}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3231247769}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7071, 'qdb_cluster': [7071]} 2024-09-17T05:42:17.270 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:42:17.270 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:42:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 -- 172.21.15.44:0/780156842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 msgr2=0x7ffbcc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 --2- 172.21.15.44:0/780156842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 0x7ffbcc004810 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0001770 tx=0x7ffbd001efd0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbe7e00640 1 -- 172.21.15.44:0/780156842 reap_dead start 2024-09-17T05:42:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 -- 172.21.15.44:0/780156842 shutdown_connections 2024-09-17T05:42:17.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 -- 172.21.15.44:0/780156842 >> 172.21.15.44:0/780156842 conn(0x7ffbe80ccaa0 msgr2=0x7ffbe80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 -- 172.21.15.44:0/780156842 shutdown_connections 2024-09-17T05:42:17.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 -- 172.21.15.44:0/780156842 wait complete. 2024-09-17T05:42:17.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 Processor -- start 2024-09-17T05:42:17.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.435+0000 7ffbee800640 1 -- start start 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 0x7ffbe806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbe815b100 0x7ffbe80cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbe81f9820 0x7ffbe809cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe8070d70 con 0x7ffbcc003fa0 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe8070bf0 con 0x7ffbe815b100 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe8070ef0 con 0x7ffbe81f9820 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 0x7ffbe806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 0x7ffbe806d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54304/0 (socket says 172.21.15.44:54304) 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 -- 172.21.15.44:0/443378735 learned_addr learned my addr 172.21.15.44:0/443378735 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbdea00640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbe815b100 0x7ffbe80cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbe81f9820 0x7ffbe809cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 -- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbe81f9820 msgr2=0x7ffbe809cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbe81f9820 0x7ffbe809cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 -- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbe815b100 msgr2=0x7ffbe80cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbe815b100 0x7ffbe80cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 -- 172.21.15.44:0/443378735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe809e270 con 0x7ffbcc003fa0 2024-09-17T05:42:17.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbe7400640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 0x7ffbe806d3e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8006630 tx=0x7ffbd80039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbdfe00640 1 -- 172.21.15.44:0/443378735 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8015020 con 0x7ffbcc003fa0 2024-09-17T05:42:17.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbdfe00640 1 -- 172.21.15.44:0/443378735 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbd8011900 con 0x7ffbcc003fa0 2024-09-17T05:42:17.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe809e4e0 con 0x7ffbcc003fa0 2024-09-17T05:42:17.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbdfe00640 1 -- 172.21.15.44:0/443378735 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8011d50 con 0x7ffbcc003fa0 2024-09-17T05:42:17.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.439+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe81fa0c0 con 0x7ffbcc003fa0 2024-09-17T05:42:17.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.443+0000 7ffbdfe00640 1 -- 172.21.15.44:0/443378735 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffbd8018020 con 0x7ffbcc003fa0 2024-09-17T05:42:17.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.443+0000 7ffbdfe00640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffbc4073230 0x7ffbc4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.443+0000 7ffbdfe00640 1 -- 172.21.15.44:0/443378735 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7ffbd8094b40 con 0x7ffbcc003fa0 2024-09-17T05:42:17.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.443+0000 7ffbf5ef9000 1 Processor -- start 2024-09-17T05:42:17.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.443+0000 7ffbdea00640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffbc4073230 0x7ffbc4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.443+0000 7ffbf5ef9000 1 -- start start 2024-09-17T05:42:17.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.443+0000 7ffbdea00640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffbc4073230 0x7ffbc4075740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0005000 tx=0x7ffbd001bd70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b4006cb410 con 0x55b4006a5950 2024-09-17T05:42:17.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b400608b40 con 0x55b4002b5460 2024-09-17T05:42:17.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b4005f7f70 con 0x55b40068eca0 2024-09-17T05:42:17.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007f6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54306/0 (socket says 172.21.15.44:54306) 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 -- 172.21.15.44:0/3435839903 learned_addr learned my addr 172.21.15.44:0/3435839903 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbe7400640 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 -- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 msgr2=0x55b4007f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 -- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 msgr2=0x55b4007f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 -- 172.21.15.44:0/3435839903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4005bf5b0 con 0x55b4006a5950 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbe7400640 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:17.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbdea00640 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007f6be0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ffbd001ee00 tx=0x7ffbd00b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7060261faf79f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbd7e00640 1 -- 172.21.15.44:0/3435839903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00064e0 con 0x55b4006a5950 2024-09-17T05:42:17.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbd7e00640 1 -- 172.21.15.44:0/3435839903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbd0003ad0 con 0x55b4006a5950 2024-09-17T05:42:17.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbd7e00640 1 -- 172.21.15.44:0/3435839903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0003ca0 con 0x55b4006a5950 2024-09-17T05:42:17.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3435839903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 msgr2=0x55b4007f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007f6be0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ffbd001ee00 tx=0x7ffbd00b6000 comp rx=0 tx=0).stop 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3435839903 shutdown_connections 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007f6be0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3435839903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3435839903 >> 172.21.15.44:0/3435839903 conn(0x55b40077bd90 msgr2=0x55b4007ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3435839903 shutdown_connections 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3435839903 wait complete. 2024-09-17T05:42:17.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.447+0000 7ffbf5ef9000 1 -- start start 2024-09-17T05:42:17.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 Processor -- start 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007fd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007fde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b4005925f0 con 0x55b4006a5950 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b4005fbd80 con 0x55b4002b5460 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b40059e520 con 0x55b40068eca0 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 10 client.0 _ll_register_callbacks cb 0x55b4005a2830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007fe3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54308/0 (socket says 172.21.15.44:54308) 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 -- 172.21.15.44:0/3543457003 learned_addr learned my addr 172.21.15.44:0/3543457003 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7400640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007fd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbdea00640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 -- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 msgr2=0x55b4007fde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007fde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 -- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 msgr2=0x55b4007fd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007fd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 -- 172.21.15.44:0/3543457003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b400596190 con 0x55b4006a5950 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7400640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007fe3a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc004790 tx=0x7ffbe000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbde788725fefb91 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbd4c00640 1 -- 172.21.15.44:0/3543457003 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0004b30 con 0x55b4006a5950 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbd4c00640 1 -- 172.21.15.44:0/3543457003 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7ffbe0004cd0 con 0x55b4006a5950 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b400590110 con 0x55b4006a5950 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbd4c00640 1 -- 172.21.15.44:0/3543457003 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ffbe0003980 con 0x55b4006a5950 2024-09-17T05:42:17.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 10 client.7122 fetch_fsmap learned FSMap version 68 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55b40067cf10 con 0x55b4006a5950 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbd4c00640 1 -- 172.21.15.44:0/3543457003 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b400590110 con 0x55b4006a5950 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbd4c00640 1 -- 172.21.15.44:0/3543457003 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7ffbe0028080 con 0x55b4006a5950 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 10 client.7122 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 10 client.7122 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 20 client.7122 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b40029a7d0 0x55b400807d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 4 client.7122 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.451+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b40060aa90 con 0x55b40029a7d0 2024-09-17T05:42:17.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbe7400640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b40029a7d0 0x55b400807d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbe7400640 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b40029a7d0 0x55b400807d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31d3d15d4b5e13f0 server_cookie=69529db1b8951e16 in_seq=0 out_seq=0 2024-09-17T05:42:17.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbd4c00640 10 client.7122 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbd4c00640 1 -- 172.21.15.44:0/3543457003 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b40060aa90 con 0x55b40029a7d0 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbd4c00640 10 client.7122 handle_command_reply: tid=0 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 client.7122 shutdown 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 msgr2=0x55b4007fe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007fe3a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc004790 tx=0x7ffbe000f790 comp rx=0 tx=0).stop 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 shutdown_connections 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4007fe3a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b4007fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b40029a7d0 0x55b400807d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/3543457003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b4007fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 >> 172.21.15.44:0/3543457003 conn(0x55b40077bd90 msgr2=0x55b4007b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbd4c00640 0 client.7122 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:17.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 shutdown_connections 2024-09-17T05:42:17.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/3543457003 wait complete. 2024-09-17T05:42:17.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.455+0000 7ffbf5ef9000 20 client.7122 trim_cache size 0 max 16384 2024-09-17T05:42:17.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 Processor -- start 2024-09-17T05:42:17.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 -- start start 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b400868620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b400868b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4008690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe8206e40 con 0x55b4006a5950 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe8205e60 con 0x55b4002b5460 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe82051f0 con 0x55b40068eca0 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4008690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4008690a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54320/0 (socket says 172.21.15.44:54320) 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 -- 172.21.15.44:0/1841654730 learned_addr learned my addr 172.21.15.44:0/1841654730 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbdea00640 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b400868b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7400640 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b400868620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 -- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 msgr2=0x55b400868b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b400868b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 -- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 msgr2=0x55b400868620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b400868620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 -- 172.21.15.44:0/1841654730 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b400653db0 con 0x55b4006a5950 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.475+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4008690a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000ff30 tx=0x7ffbe0009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4ba5926f998920 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbd7400640 1 -- 172.21.15.44:0/1841654730 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe001d650 con 0x55b4006a5950 2024-09-17T05:42:17.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbd7400640 1 -- 172.21.15.44:0/1841654730 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbe002b070 con 0x55b4006a5950 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbd7400640 1 -- 172.21.15.44:0/1841654730 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe001da70 con 0x55b4006a5950 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/1841654730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 msgr2=0x55b4008690a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4008690a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000ff30 tx=0x7ffbe0009590 comp rx=0 tx=0).stop 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/1841654730 shutdown_connections 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b4006a5950 0x55b4008690a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b40068eca0 0x55b400868b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/1841654730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b400868620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/1841654730 >> 172.21.15.44:0/1841654730 conn(0x55b40077bd90 msgr2=0x55b4007f4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/1841654730 shutdown_connections 2024-09-17T05:42:17.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/1841654730 wait complete. 2024-09-17T05:42:17.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- start start 2024-09-17T05:42:17.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 Processor -- start 2024-09-17T05:42:17.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b40086c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b40068eca0 0x55b40086c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b4006a5950 0x55b40086ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b400607910 con 0x55b40068eca0 2024-09-17T05:42:17.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b4005c3ee0 con 0x55b4002b5460 2024-09-17T05:42:17.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b4006b7750 con 0x55b4006a5950 2024-09-17T05:42:17.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbf5ef9000 10 client.0 _ll_register_callbacks cb 0x7ffbe0009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbdea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b40068eca0 0x55b40086c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbdea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b40068eca0 0x55b40086c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54330/0 (socket says 172.21.15.44:54330) 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbdea00640 1 -- 172.21.15.44:0/214802049 learned_addr learned my addr 172.21.15.44:0/214802049 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbe7400640 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b40086c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.479+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b4006a5950 0x55b40086ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbdea00640 1 -- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b4006a5950 msgr2=0x55b40086ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbdea00640 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b4006a5950 0x55b40086ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbdea00640 1 -- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 msgr2=0x55b40086c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbdea00640 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b40086c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbdea00640 1 -- 172.21.15.44:0/214802049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4005beab0 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbdea00640 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b40068eca0 0x55b40086c8d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ffbd001ee00 tx=0x7ffbd00a8c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcf28316b754dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 1 -- 172.21.15.44:0/214802049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00d3030 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 1 -- 172.21.15.44:0/214802049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7ffbd00c2040 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbe002b070 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 1 -- 172.21.15.44:0/214802049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7ffbd00bb440 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 10 client.7128 fetch_fsmap learned FSMap version 68 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55b40059d070 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 1 -- 172.21.15.44:0/214802049 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbe002b070 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 1 -- 172.21.15.44:0/214802049 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7ffbd00bb5e0 con 0x55b40068eca0 2024-09-17T05:42:17.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 10 client.7128 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 10 client.7128 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 20 client.7128 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b400288830 0x55b400828640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 4 client.7128 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "status"}) -- 0x55b400606540 con 0x55b400288830 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbe7400640 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b400288830 0x55b400828640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbe7400640 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b400288830 0x55b400828640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf4e109adf45c7 server_cookie=143db631ee1296de in_seq=0 out_seq=0 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 10 client.7128 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 1 -- 172.21.15.44:0/214802049 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b400606540 con 0x55b400288830 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 10 client.7128 handle_command_reply: tid=0 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 client.7128 shutdown 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b40068eca0 msgr2=0x55b40086c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b40068eca0 0x55b40086c8d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ffbd001ee00 tx=0x7ffbd00a8c60 comp rx=0 tx=0).stop 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 shutdown_connections 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b4006a5950 0x55b40086ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b40068eca0 0x55b40086c8d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55b400288830 0x55b400828640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 --2- 172.21.15.44:0/214802049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4002b5460 0x55b40086c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbd4c00640 0 client.7128 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 >> 172.21.15.44:0/214802049 conn(0x55b40077bd90 msgr2=0x55b4007f4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 shutdown_connections 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 1 -- 172.21.15.44:0/214802049 wait complete. 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbf5ef9000 20 client.7128 trim_cache size 0 max 16384 2024-09-17T05:42:17.489 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7071, 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.8158508900000001, 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 68, 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 91, 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 91, 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 5.6741741790000004 2024-09-17T05:42:17.490 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:42:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.483+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffbc4073230 msgr2=0x7ffbc4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffbc4073230 0x7ffbc4075740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0005000 tx=0x7ffbd001bd70 comp rx=0 tx=0).stop 2024-09-17T05:42:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 msgr2=0x7ffbe806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 0x7ffbe806d3e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8006630 tx=0x7ffbd80039d0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 shutdown_connections 2024-09-17T05:42:17.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ffbe81f9820 0x7ffbe809cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ffbc4073230 0x7ffbc4075740 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffbe815b100 0x7ffbe80cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 --2- 172.21.15.44:0/443378735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbcc003fa0 0x7ffbe806d3e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 >> 172.21.15.44:0/443378735 conn(0x7ffbe80ccaa0 msgr2=0x7ffbe806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 shutdown_connections 2024-09-17T05:42:17.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.487+0000 7ffbee800640 1 -- 172.21.15.44:0/443378735 wait complete. 2024-09-17T05:42:17.506 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 -- 172.21.15.44:0/1741231918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f58072e50 msgr2=0x7f3f5815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 --2- 172.21.15.44:0/1741231918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f58072e50 0x7f3f5815e990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009840 tx=0x7f3f4801c6b0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 -- 172.21.15.44:0/1741231918 shutdown_connections 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 --2- 172.21.15.44:0/1741231918 >> v2:172.21.15.86:3300/0 conn(0x7f3f5806de50 0x7f3f5806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 --2- 172.21.15.44:0/1741231918 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f58072e50 0x7f3f5815e990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 -- 172.21.15.44:0/1741231918 >> 172.21.15.44:0/1741231918 conn(0x7f3f580ccaa0 msgr2=0x7f3f580cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 -- 172.21.15.44:0/1741231918 shutdown_connections 2024-09-17T05:42:17.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.663+0000 7f3f5e400640 1 -- 172.21.15.44:0/1741231918 wait complete. 2024-09-17T05:42:17.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 Processor -- start 2024-09-17T05:42:17.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 -- start start 2024-09-17T05:42:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f5806de50 0x7f3f581562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f58072e50 0x7f3f5809edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f580ced00 0x7f3f5809f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3f58169410 con 0x7f3f58072e50 2024-09-17T05:42:17.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3f58169290 con 0x7f3f5806de50 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3f58169590 con 0x7f3f580ced00 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f58072e50 0x7f3f5809edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f58072e50 0x7f3f5809edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54346/0 (socket says 172.21.15.44:54346) 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 -- 172.21.15.44:0/273650464 learned_addr learned my addr 172.21.15.44:0/273650464 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f57e00640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f580ced00 0x7f3f5809f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f57400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f5806de50 0x7f3f581562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 -- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f580ced00 msgr2=0x7f3f5809f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f580ced00 0x7f3f5809f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 -- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f5806de50 msgr2=0x7f3f581562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f5806de50 0x7f3f581562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 -- 172.21.15.44:0/273650464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f580c70d0 con 0x7f3f58072e50 2024-09-17T05:42:17.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4fe00640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f58072e50 0x7f3f5809edf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e740 tx=0x7f3f4000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4f400640 1 -- 172.21.15.44:0/273650464 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4000ccc0 con 0x7f3f58072e50 2024-09-17T05:42:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4f400640 1 -- 172.21.15.44:0/273650464 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f4000ce60 con 0x7f3f58072e50 2024-09-17T05:42:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f580c9e70 con 0x7f3f58072e50 2024-09-17T05:42:17.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f4f400640 1 -- 172.21.15.44:0/273650464 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40005260 con 0x7f3f58072e50 2024-09-17T05:42:17.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.667+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f58156db0 con 0x7f3f58072e50 2024-09-17T05:42:17.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.671+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5806e260 con 0x7f3f58072e50 2024-09-17T05:42:17.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.671+0000 7f3f4f400640 1 -- 172.21.15.44:0/273650464 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3f40005400 con 0x7f3f58072e50 2024-09-17T05:42:17.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.671+0000 7f3f4f400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3f34073200 0x7f3f34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:17.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.671+0000 7f3f4f400640 1 -- 172.21.15.44:0/273650464 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f3f40095100 con 0x7f3f58072e50 2024-09-17T05:42:17.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.671+0000 7f3f57400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3f34073200 0x7f3f34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:17.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.675+0000 7f3f57400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3f34073200 0x7f3f34075710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3f480af000 tx=0x7f3f480b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:17.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.675+0000 7f3f4f400640 1 -- 172.21.15.44:0/273650464 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3f40060040 con 0x7f3f58072e50 2024-09-17T05:42:17.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.883+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f580b5fa0 con 0x7f3f58072e50 2024-09-17T05:42:17.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f4f400640 1 -- 172.21.15.44:0/273650464 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f3f4005f940 con 0x7f3f58072e50 2024-09-17T05:42:17.888 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:42:17.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3f34073200 msgr2=0x7f3f34075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3f34073200 0x7f3f34075710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3f480af000 tx=0x7f3f480b2040 comp rx=0 tx=0).stop 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f58072e50 msgr2=0x7f3f5809edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f58072e50 0x7f3f5809edf0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e740 tx=0x7f3f4000ec00 comp rx=0 tx=0).stop 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 shutdown_connections 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3f580ced00 0x7f3f5809f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f58072e50 0x7f3f5809edf0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3f34073200 0x7f3f34075710 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 --2- 172.21.15.44:0/273650464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f5806de50 0x7f3f581562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 >> 172.21.15.44:0/273650464 conn(0x7f3f580ccaa0 msgr2=0x7f3f580ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 shutdown_connections 2024-09-17T05:42:17.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:17.887+0000 7f3f5e400640 1 -- 172.21.15.44:0/273650464 wait complete. 2024-09-17T05:42:17.909 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:42:17.909 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:42:17.909 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:42:17.909 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:42:17.909 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:17.909 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:42:17.910 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:42:17.910 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:42:17.910 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:17.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:17.910 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:42:17.919 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:42:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:42:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:42:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:42:17.919 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42068sec preferred_lft 42068sec 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:42:17.920 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:42:17.921 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:42:17.922 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:42:17.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:17.923 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:42:17.988 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:42:17.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:17.990 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:42:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:42:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:42:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:42:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:42:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:42:18.044 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:42:18.045 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:42:18.045 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:42:18.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:42:18.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:42:18.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:42:18.045 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:42:18.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:42:18.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:18.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.183 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:42:18.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:42:18.192 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:42:18.192 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:18.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.193 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:42:18.254 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:18.255 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:18.307 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:42:18.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:42:18.307 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:18.358 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:42:18.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.358 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:18.460 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:18.460 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:18.461 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:42:18.479 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:18.479 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:18.479 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:42:18.479 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:42:18.479 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:42:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:42:18.490 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:42:18.491 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:42:18.491 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:42:18.491 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:42:18.491 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:42:18.491 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:42:18.494 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:42:18.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:42:18.514 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:42:18.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:42:18.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:42:18.620 INFO:teuthology.orchestra.run.smithi044.stdout:client6916 2024-09-17T05:42:18.621 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:42:18.621 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:42:18.670 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:42:18.667+0000 7f3837e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:42:18.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.672 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-09-17T05:42:18.727 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:42:18.723+0000 7f3832e00640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-09-17T05:42:18.727 INFO:teuthology.orchestra.run.smithi044.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-09-17T05:42:18.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:42:18.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:18.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-09-17T05:42:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.931+0000 7f402ae00640 1 -- 172.21.15.44:0/2596623745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f402406e390 msgr2=0x7f40240cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.931+0000 7f402ae00640 1 --2- 172.21.15.44:0/2596623745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f402406e390 0x7f40240cdfe0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f401c009bc0 tx=0x7f401c01f3b0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.931+0000 7f402ae00640 1 -- 172.21.15.44:0/2596623745 shutdown_connections 2024-09-17T05:42:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.931+0000 7f402ae00640 1 --2- 172.21.15.44:0/2596623745 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f402406e390 0x7f40240cdfe0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.931+0000 7f402ae00640 1 -- 172.21.15.44:0/2596623745 >> 172.21.15.44:0/2596623745 conn(0x7f40240b35f0 msgr2=0x7f40240b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.931+0000 7f402ae00640 1 -- 172.21.15.44:0/2596623745 shutdown_connections 2024-09-17T05:42:18.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.931+0000 7f402ae00640 1 -- 172.21.15.44:0/2596623745 wait complete. 2024-09-17T05:42:18.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 Processor -- start 2024-09-17T05:42:18.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 -- start start 2024-09-17T05:42:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406df80 0x7f402414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f402406e390 0x7f40240ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4024155b10 0x7f402414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40240ce8b0 con 0x7f4024155b10 2024-09-17T05:42:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f40240ce730 con 0x7f402406df80 2024-09-17T05:42:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f402406fd20 con 0x7f402406e390 2024-09-17T05:42:18.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4024155b10 0x7f402414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4024155b10 0x7f402414fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53604/0 (socket says 172.21.15.44:53604) 2024-09-17T05:42:18.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 -- 172.21.15.44:0/1989357710 learned_addr learned my addr 172.21.15.44:0/1989357710 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:18.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f401b400640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f402406e390 0x7f40240ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4023e00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406df80 0x7f402414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 -- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f402406e390 msgr2=0x7f40240ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f402406e390 0x7f40240ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 -- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406df80 msgr2=0x7f402414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406df80 0x7f402414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 -- 172.21.15.44:0/1989357710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40240ad9e0 con 0x7f4024155b10 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4023e00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406df80 0x7f402414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4028e00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4024155b10 0x7f402414fc70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f401c01bfc0 tx=0x7f401c0af560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4020c00640 1 -- 172.21.15.44:0/1989357710 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c0b4040 con 0x7f4024155b10 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4020c00640 1 -- 172.21.15.44:0/1989357710 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f401c0bf070 con 0x7f4024155b10 2024-09-17T05:42:18.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f4020c00640 1 -- 172.21.15.44:0/1989357710 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c0b0930 con 0x7f4024155b10 2024-09-17T05:42:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402415b000 con 0x7f4024155b10 2024-09-17T05:42:18.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.935+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4024153240 con 0x7f4024155b10 2024-09-17T05:42:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.939+0000 7f4020c00640 1 -- 172.21.15.44:0/1989357710 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f401c0b0ad0 con 0x7f4024155b10 2024-09-17T05:42:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.939+0000 7f4020c00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4000073230 0x7f4000075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.939+0000 7f4020c00640 1 -- 172.21.15.44:0/1989357710 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f401c132740 con 0x7f4024155b10 2024-09-17T05:42:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.939+0000 7f4032531000 1 Processor -- start 2024-09-17T05:42:18.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.939+0000 7f4023e00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4000073230 0x7f4000075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.939+0000 7f4032531000 1 -- start start 2024-09-17T05:42:18.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4023e00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4000073230 0x7f4000075740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f40140046c0 tx=0x7f4014009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b78448db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782cfdb0 0x560b78449830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560b781fd460 con 0x560b782d6140 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560b7825ace0 con 0x560b782e9a50 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560b7824a110 con 0x560b782cfdb0 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53620/0 (socket says 172.21.15.44:53620) 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 -- 172.21.15.44:0/1478651060 learned_addr learned my addr 172.21.15.44:0/1478651060 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:18.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4028e00640 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782cfdb0 0x560b78449830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4023e00640 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b78448db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 -- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782cfdb0 msgr2=0x560b78449830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782cfdb0 0x560b78449830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 -- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 msgr2=0x560b78448db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b78448db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 -- 172.21.15.44:0/1478651060 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b781e8340 con 0x560b782d6140 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4023e00640 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b78448db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f401b400640 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784492f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f400c0017b0 tx=0x7f400c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2816287af0f80b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4018c00640 1 -- 172.21.15.44:0/1478651060 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c0052e0 con 0x560b782d6140 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4018c00640 1 -- 172.21.15.44:0/1478651060 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f400c018070 con 0x560b782d6140 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4018c00640 1 -- 172.21.15.44:0/1478651060 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00f9b0 con 0x560b782d6140 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- 172.21.15.44:0/1478651060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 msgr2=0x560b784492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784492f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f400c0017b0 tx=0x7f400c007e40 comp rx=0 tx=0).stop 2024-09-17T05:42:18.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- 172.21.15.44:0/1478651060 shutdown_connections 2024-09-17T05:42:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782cfdb0 0x560b78449830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784492f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 --2- 172.21.15.44:0/1478651060 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b78448db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- 172.21.15.44:0/1478651060 >> 172.21.15.44:0/1478651060 conn(0x560b77f08590 msgr2=0x560b783fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- 172.21.15.44:0/1478651060 shutdown_connections 2024-09-17T05:42:18.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- 172.21.15.44:0/1478651060 wait complete. 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.943+0000 7f4032531000 1 -- start start 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 Processor -- start 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b78404c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b78405180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78434680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560b781ef600 con 0x560b782d6140 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560b7824df20 con 0x560b782cfdb0 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560b77f0f810 con 0x560b782e9a50 2024-09-17T05:42:18.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 10 client.0 _ll_register_callbacks cb 0x560b783eacc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b78405180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b78405180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53626/0 (socket says 172.21.15.44:53626) 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 -- 172.21.15.44:0/2349597864 learned_addr learned my addr 172.21.15.44:0/2349597864 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4023e00640 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b78404c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4028e00640 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78434680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 -- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 msgr2=0x560b78434680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78434680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 -- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 msgr2=0x560b78404c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b78404c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 -- 172.21.15.44:0/2349597864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b781cf1f0 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f401b400640 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b78405180 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f400c014000 tx=0x7f400c00fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576e545a3b1011f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4011600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4011600640 1 -- 172.21.15.44:0/2349597864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00fe60 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b781e2480 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4011600640 1 -- 172.21.15.44:0/2349597864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f400c003800 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4011600640 1 -- 172.21.15.44:0/2349597864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f400c003a00 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 10 client.7149 fetch_fsmap learned FSMap version 68 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x560b782cf1f0 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4011600640 1 -- 172.21.15.44:0/2349597864 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560b781e2480 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4011600640 1 -- 172.21.15.44:0/2349597864 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f400c003ba0 con 0x560b782d6140 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 10 client.7149 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 10 client.7149 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 20 client.7149 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77eecac0 0x560b78435090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 4 client.7149 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.947+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b7825cc30 con 0x560b77eecac0 2024-09-17T05:42:18.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4023e00640 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77eecac0 0x560b78435090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4023e00640 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77eecac0 0x560b78435090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c42670b45fab24 server_cookie=5d75f06dde213043 in_seq=0 out_seq=0 2024-09-17T05:42:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4011600640 10 client.7149 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4011600640 1 -- 172.21.15.44:0/2349597864 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b7825cc30 con 0x560b77eecac0 2024-09-17T05:42:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4011600640 10 client.7149 handle_command_reply: tid=0 2024-09-17T05:42:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 client.7149 shutdown 2024-09-17T05:42:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 msgr2=0x560b78405180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b78405180 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f400c014000 tx=0x7f400c00fa60 comp rx=0 tx=0).stop 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 shutdown_connections 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78434680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b78405180 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77eecac0 0x560b78435090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 --2- 172.21.15.44:0/2349597864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b78404c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4011600640 0 client.7149 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 >> 172.21.15.44:0/2349597864 conn(0x560b77f08590 msgr2=0x560b783fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 shutdown_connections 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 1 -- 172.21.15.44:0/2349597864 wait complete. 2024-09-17T05:42:18.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.951+0000 7f4032531000 20 client.7149 trim_cache size 0 max 16384 2024-09-17T05:42:18.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 Processor -- start 2024-09-17T05:42:18.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 -- start start 2024-09-17T05:42:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b784017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78460f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560b78403d60 con 0x560b782d6140 2024-09-17T05:42:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4024202ae0 con 0x560b782cfdb0 2024-09-17T05:42:18.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4024201b40 con 0x560b782e9a50 2024-09-17T05:42:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53640/0 (socket says 172.21.15.44:53640) 2024-09-17T05:42:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 -- 172.21.15.44:0/3270295322 learned_addr learned my addr 172.21.15.44:0/3270295322 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4028e00640 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78460f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4023e00640 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b784017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 -- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 msgr2=0x560b78460f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78460f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 -- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 msgr2=0x560b784017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b784017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 -- 172.21.15.44:0/3270295322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b78435400 con 0x560b782d6140 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4028e00640 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78460f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4023e00640 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b784017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f401b400640 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784609f0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f400c025480 tx=0x7f400c007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed587e4d6439f07f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4013e00640 1 -- 172.21.15.44:0/3270295322 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00fe60 con 0x560b782d6140 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4013e00640 1 -- 172.21.15.44:0/3270295322 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f400c018040 con 0x560b782d6140 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.971+0000 7f4013e00640 1 -- 172.21.15.44:0/3270295322 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c003840 con 0x560b782d6140 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- 172.21.15.44:0/3270295322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 msgr2=0x560b784609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784609f0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f400c025480 tx=0x7f400c007be0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- 172.21.15.44:0/3270295322 shutdown_connections 2024-09-17T05:42:18.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782e9a50 0x560b78460f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782d6140 0x560b784609f0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 --2- 172.21.15.44:0/3270295322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782cfdb0 0x560b784017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- 172.21.15.44:0/3270295322 >> 172.21.15.44:0/3270295322 conn(0x560b77f08590 msgr2=0x560b78448070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- 172.21.15.44:0/3270295322 shutdown_connections 2024-09-17T05:42:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- 172.21.15.44:0/3270295322 wait complete. 2024-09-17T05:42:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- start start 2024-09-17T05:42:18.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 Processor -- start 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782cfdb0 0x560b784be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782d6140 0x560b784be920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b784bee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560b7824d230 con 0x560b782cfdb0 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560b7825d850 con 0x560b782e9a50 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560b78215df0 con 0x560b782d6140 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4032531000 10 client.0 _ll_register_callbacks cb 0x7f400c001680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782cfdb0 0x560b784be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782cfdb0 0x560b784be3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53650/0 (socket says 172.21.15.44:53650) 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 -- 172.21.15.44:0/399225737 learned_addr learned my addr 172.21.15.44:0/399225737 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f401b400640 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782d6140 0x560b784be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4028e00640 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b784bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 -- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782d6140 msgr2=0x560b784be920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782d6140 0x560b784be920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 -- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 msgr2=0x560b784bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b784bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.975+0000 7f4023e00640 1 -- 172.21.15.44:0/399225737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b782a64f0 con 0x560b782cfdb0 2024-09-17T05:42:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4023e00640 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782cfdb0 0x560b784be3e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f401400ed20 tx=0x7f4014000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca4f444f0aeac73 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 1 -- 172.21.15.44:0/399225737 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401402e070 con 0x560b782cfdb0 2024-09-17T05:42:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 1 -- 172.21.15.44:0/399225737 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f4014010040 con 0x560b782cfdb0 2024-09-17T05:42:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f400c018040 con 0x560b782cfdb0 2024-09-17T05:42:18.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 1 -- 172.21.15.44:0/399225737 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f4014039050 con 0x560b782cfdb0 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 10 client.7155 fetch_fsmap learned FSMap version 68 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x560b781cfa10 con 0x560b782cfdb0 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 1 -- 172.21.15.44:0/399225737 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f400c018040 con 0x560b782cfdb0 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 1 -- 172.21.15.44:0/399225737 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f401403c020 con 0x560b782cfdb0 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 10 client.7155 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 10 client.7155 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 20 client.7155 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77edab20 0x560b78400c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 4 client.7155 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) -- 0x560b782586e0 con 0x560b77edab20 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f401b400640 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77edab20 0x560b78400c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f401b400640 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77edab20 0x560b78400c60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f704d808e6759 server_cookie=fbff1db7e3f793cf in_seq=0 out_seq=0 2024-09-17T05:42:18.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 10 client.7155 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 1 -- 172.21.15.44:0/399225737 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560b782586e0 con 0x560b77edab20 2024-09-17T05:42:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 10 client.7155 handle_command_reply: tid=0 2024-09-17T05:42:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 client.7155 shutdown 2024-09-17T05:42:18.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782cfdb0 msgr2=0x560b784be3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782cfdb0 0x560b784be3e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f401400ed20 tx=0x7f4014000ee0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 shutdown_connections 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x560b77edab20 0x560b78400c60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b782e9a50 0x560b784bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560b782d6140 0x560b784be920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 --2- 172.21.15.44:0/399225737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560b782cfdb0 0x560b784be3e0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4011600640 0 client.7155 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:18.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 >> 172.21.15.44:0/399225737 conn(0x560b77f08590 msgr2=0x560b7845f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:18.984 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f3832e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0) n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5585de78bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-09-17T05:42:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 shutdown_connections 2024-09-17T05:42:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 1 -- 172.21.15.44:0/399225737 wait complete. 2024-09-17T05:42:18.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.979+0000 7f4032531000 20 client.7155 trim_cache size 0 max 16384 2024-09-17T05:42:18.986 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:42:18.986 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:42:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "7cc1a22e-0b43-46bb-a0d6-c18286c24672", 2024-09-17T05:42:18.987 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:42:18.987 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:42:18.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4000073230 msgr2=0x7f4000075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4000073230 0x7f4000075740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f40140046c0 tx=0x7f4014009040 comp rx=0 tx=0).stop 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4024155b10 msgr2=0x7f402414fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4024155b10 0x7f402414fc70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f401c01bfc0 tx=0x7f401c0af560 comp rx=0 tx=0).stop 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 shutdown_connections 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4024155b10 0x7f402414fc70 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f402406e390 0x7f40240ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4000073230 0x7f4000075740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 --2- 172.21.15.44:0/1989357710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f402406df80 0x7f402414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 >> 172.21.15.44:0/1989357710 conn(0x7f40240b35f0 msgr2=0x7f402415d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 shutdown_connections 2024-09-17T05:42:18.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:18.983+0000 7f402ae00640 1 -- 172.21.15.44:0/1989357710 wait complete. 2024-09-17T05:42:19.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:19.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T05:42:19.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 -- 172.21.15.44:0/117678906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 msgr2=0x7faa24073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 --2- 172.21.15.44:0/117678906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa24073240 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009cb0 tx=0x7faa1c01cd70 comp rx=0 tx=0).stop 2024-09-17T05:42:19.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 -- 172.21.15.44:0/117678906 shutdown_connections 2024-09-17T05:42:19.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 --2- 172.21.15.44:0/117678906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa24073240 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 --2- 172.21.15.44:0/117678906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa2406f7f0 0x7faa24144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 -- 172.21.15.44:0/117678906 >> 172.21.15.44:0/117678906 conn(0x7faa2406ce40 msgr2=0x7faa2406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 -- 172.21.15.44:0/117678906 shutdown_connections 2024-09-17T05:42:19.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 -- 172.21.15.44:0/117678906 wait complete. 2024-09-17T05:42:19.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 Processor -- start 2024-09-17T05:42:19.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.167+0000 7faa29000640 1 -- start start 2024-09-17T05:42:19.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa2406f7f0 0x7faa24156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa2413d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa241455b0 0x7faa2415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa24169ae0 con 0x7faa24072e30 2024-09-17T05:42:19.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa24169960 con 0x7faa241455b0 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faa24169c60 con 0x7faa2406f7f0 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa2413d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa2413d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53670/0 (socket says 172.21.15.44:53670) 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 -- 172.21.15.44:0/4140528245 learned_addr learned my addr 172.21.15.44:0/4140528245 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa23400640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa2406f7f0 0x7faa24156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa23e00640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa241455b0 0x7faa2415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 -- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa2406f7f0 msgr2=0x7faa24156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa2406f7f0 0x7faa24156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 -- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa241455b0 msgr2=0x7faa2415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa241455b0 0x7faa2415db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 -- 172.21.15.44:0/4140528245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa241f9b90 con 0x7faa24072e30 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1be00640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa2413d330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e7c0 tx=0x7faa0c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1b400640 1 -- 172.21.15.44:0/4140528245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00ccc0 con 0x7faa24072e30 2024-09-17T05:42:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1b400640 1 -- 172.21.15.44:0/4140528245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa0c00ce80 con 0x7faa24072e30 2024-09-17T05:42:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa1b400640 1 -- 172.21.15.44:0/4140528245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c005280 con 0x7faa24072e30 2024-09-17T05:42:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa241569c0 con 0x7faa24072e30 2024-09-17T05:42:19.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.171+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa241fa110 con 0x7faa24072e30 2024-09-17T05:42:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.175+0000 7faa1b400640 1 -- 172.21.15.44:0/4140528245 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa0c005420 con 0x7faa24072e30 2024-09-17T05:42:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.175+0000 7faa1b400640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa00073230 0x7faa00075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.175+0000 7faa31b68000 1 Processor -- start 2024-09-17T05:42:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.175+0000 7faa1b400640 1 -- 172.21.15.44:0/4140528245 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7faa0c094c70 con 0x7faa24072e30 2024-09-17T05:42:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.175+0000 7faa31b68000 1 -- start start 2024-09-17T05:42:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.175+0000 7faa23400640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa00073230 0x7faa00075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.175+0000 7faa23400640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa00073230 0x7faa00075740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa14007fd0 tx=0x7faa14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556c0b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c0bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5567baaa0 0x55e556c0c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e556aaacd0 con 0x55e556a9f6d0 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e5569c0330 con 0x55e5566f6890 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e556a1dbb0 con 0x55e5567baaa0 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556c0b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556c0b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53684/0 (socket says 172.21.15.44:53684) 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 -- 172.21.15.44:0/3055426143 learned_addr learned my addr 172.21.15.44:0/3055426143 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa1be00640 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c0bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23e00640 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5567baaa0 0x55e556c0c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 -- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5567baaa0 msgr2=0x55e556c0c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5567baaa0 0x55e556c0c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 -- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 msgr2=0x55e556c0bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c0bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 -- 172.21.15.44:0/3055426143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5569c1c80 con 0x55e556a9f6d0 2024-09-17T05:42:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa23400640 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556c0b9f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7faa1400f990 tx=0x7faa14012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaa67ea5c726bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa13e00640 1 -- 172.21.15.44:0/3055426143 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14025070 con 0x55e556a9f6d0 2024-09-17T05:42:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa13e00640 1 -- 172.21.15.44:0/3055426143 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa1401b050 con 0x55e556a9f6d0 2024-09-17T05:42:19.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa13e00640 1 -- 172.21.15.44:0/3055426143 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14014e40 con 0x55e556a9f6d0 2024-09-17T05:42:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- 172.21.15.44:0/3055426143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 msgr2=0x55e556c0b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556c0b9f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7faa1400f990 tx=0x7faa14012000 comp rx=0 tx=0).stop 2024-09-17T05:42:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- 172.21.15.44:0/3055426143 shutdown_connections 2024-09-17T05:42:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5567baaa0 0x55e556c0c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c0bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 --2- 172.21.15.44:0/3055426143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556c0b9f0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- 172.21.15.44:0/3055426143 >> 172.21.15.44:0/3055426143 conn(0x55e5566ca5c0 msgr2=0x55e556bc8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- 172.21.15.44:0/3055426143 shutdown_connections 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- 172.21.15.44:0/3055426143 wait complete. 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 -- start start 2024-09-17T05:42:19.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.179+0000 7faa31b68000 1 Processor -- start 2024-09-17T05:42:19.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556bc79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5567baaa0 0x55e556bc7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556bd2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e556a10df0 con 0x55e556a9f6d0 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e556a0cfe0 con 0x55e5567baaa0 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e5569b24d0 con 0x55e5566f6890 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 10 client.0 _ll_register_callbacks cb 0x55e5569907f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556bd2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556bd2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53700/0 (socket says 172.21.15.44:53700) 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 -- 172.21.15.44:0/2008767828 learned_addr learned my addr 172.21.15.44:0/2008767828 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23400640 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556bc79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa1be00640 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5567baaa0 0x55e556bc7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 -- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 msgr2=0x55e556bc79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556bc79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 -- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5567baaa0 msgr2=0x55e556bc7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5567baaa0 0x55e556bc7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 -- 172.21.15.44:0/2008767828 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5569ab210 con 0x55e556a9f6d0 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23e00640 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556bd2a00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0b0040 tx=0x7faa1c004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a694244df84271 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa10c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa10c00640 1 -- 172.21.15.44:0/2008767828 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c0bb020 con 0x55e556a9f6d0 2024-09-17T05:42:19.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e5569a5350 con 0x55e556a9f6d0 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa10c00640 1 -- 172.21.15.44:0/2008767828 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7faa1c003980 con 0x55e556a9f6d0 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa10c00640 1 -- 172.21.15.44:0/2008767828 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7faa1c0c5050 con 0x55e556a9f6d0 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 10 client.7167 fetch_fsmap learned FSMap version 68 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55e556991fc0 con 0x55e556a9f6d0 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa10c00640 1 -- 172.21.15.44:0/2008767828 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e5569a5350 con 0x55e556a9f6d0 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa10c00640 1 -- 172.21.15.44:0/2008767828 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7faa1c0c8020 con 0x55e556a9f6d0 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 10 client.7167 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 10 client.7167 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 20 client.7167 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e5566af930 0x55e556c172e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 4 client.7167 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e556a1fb00 con 0x55e5566af930 2024-09-17T05:42:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.183+0000 7faa23400640 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e5566af930 0x55e556c172e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa23400640 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e5566af930 0x55e556c172e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e8c1ca6474fafd server_cookie=941af8f31d32b2b4 in_seq=0 out_seq=0 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa10c00640 10 client.7167 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa10c00640 1 -- 172.21.15.44:0/2008767828 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e556a1fb00 con 0x55e5566af930 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa10c00640 10 client.7167 handle_command_reply: tid=0 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 client.7167 shutdown 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 msgr2=0x55e556bd2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556bd2a00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0b0040 tx=0x7faa1c004f90 comp rx=0 tx=0).stop 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 shutdown_connections 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e556a9f6d0 0x55e556bd2a00 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e5566af930 0x55e556c172e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5567baaa0 0x55e556bc7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 --2- 172.21.15.44:0/2008767828 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556bc79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 >> 172.21.15.44:0/2008767828 conn(0x55e5566ca5c0 msgr2=0x55e556bc0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa10c00640 0 client.7167 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 shutdown_connections 2024-09-17T05:42:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 1 -- 172.21.15.44:0/2008767828 wait complete. 2024-09-17T05:42:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.187+0000 7faa31b68000 20 client.7167 trim_cache size 0 max 16384 2024-09-17T05:42:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 Processor -- start 2024-09-17T05:42:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- start start 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556c27ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c281e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e556a9f6d0 0x55e556c0ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e556bc6af0 con 0x55e5567baaa0 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa24201490 con 0x55e556a9f6d0 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faa240b4ac0 con 0x55e5566f6890 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c281e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c281e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53706/0 (socket says 172.21.15.44:53706) 2024-09-17T05:42:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 -- 172.21.15.44:0/1340332862 learned_addr learned my addr 172.21.15.44:0/1340332862 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa23400640 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556c27ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa23e00640 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e556a9f6d0 0x55e556c0ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 -- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 msgr2=0x55e556c27ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556c27ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 -- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e556a9f6d0 msgr2=0x55e556c0ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e556a9f6d0 0x55e556c0ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 -- 172.21.15.44:0/1340332862 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e556a6a680 con 0x55e5567baaa0 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa1be00640 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c281e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00f010 tx=0x7faa0c00ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8a7d9bc85244c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa13400640 1 -- 172.21.15.44:0/1340332862 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c068040 con 0x55e5567baaa0 2024-09-17T05:42:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa13400640 1 -- 172.21.15.44:0/1340332862 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa0c05f450 con 0x55e5567baaa0 2024-09-17T05:42:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa13400640 1 -- 172.21.15.44:0/1340332862 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c068ae0 con 0x55e5567baaa0 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- 172.21.15.44:0/1340332862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 msgr2=0x55e556c281e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c281e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00f010 tx=0x7faa0c00ef80 comp rx=0 tx=0).stop 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- 172.21.15.44:0/1340332862 shutdown_connections 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e556a9f6d0 0x55e556c0ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c281e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 --2- 172.21.15.44:0/1340332862 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e5566f6890 0x55e556c27ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- 172.21.15.44:0/1340332862 >> 172.21.15.44:0/1340332862 conn(0x55e5566ca5c0 msgr2=0x55e556c21a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- 172.21.15.44:0/1340332862 shutdown_connections 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.207+0000 7faa31b68000 1 -- 172.21.15.44:0/1340332862 wait complete. 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 -- start start 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 Processor -- start 2024-09-17T05:42:19.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c85e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c86390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e556a9f6d0 0x55e556c868d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faa240b4470 con 0x55e5567baaa0 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa2415d5f0 con 0x55e5566f6890 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e5566d2680 con 0x55e556a9f6d0 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 10 client.0 _ll_register_callbacks cb 0x7faa0c005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c86390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c86390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53720/0 (socket says 172.21.15.44:53720) 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 -- 172.21.15.44:0/3186968365 learned_addr learned my addr 172.21.15.44:0/3186968365 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa23400640 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c85e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa23e00640 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e556a9f6d0 0x55e556c868d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 -- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e556a9f6d0 msgr2=0x55e556c868d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e556a9f6d0 0x55e556c868d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 -- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 msgr2=0x55e556c85e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c85e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 -- 172.21.15.44:0/3186968365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5569d70b0 con 0x55e5567baaa0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa1be00640 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c86390 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c6a0 tx=0x7faa0c068ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30e6c6563a6aed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa10c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa10c00640 1 -- 172.21.15.44:0/3186968365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c068040 con 0x55e5567baaa0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa10c00640 1 -- 172.21.15.44:0/3186968365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7faa0c05e8c0 con 0x55e5567baaa0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa0c05f450 con 0x55e5567baaa0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa10c00640 1 -- 172.21.15.44:0/3186968365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7faa0c068d30 con 0x55e5567baaa0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 10 client.7173 fetch_fsmap learned FSMap version 68 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55e5569a3610 con 0x55e5567baaa0 2024-09-17T05:42:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa10c00640 1 -- 172.21.15.44:0/3186968365 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa0c05f450 con 0x55e5567baaa0 2024-09-17T05:42:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.211+0000 7faa10c00640 1 -- 172.21.15.44:0/3186968365 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7faa0c066090 con 0x55e5567baaa0 2024-09-17T05:42:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 10 client.7173 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:42:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 10 client.7173 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 20 client.7173 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e55669d990 0x55e556bc1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 4 client.7173 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:42:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e556a1b5b0 con 0x55e55669d990 2024-09-17T05:42:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa23400640 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e55669d990 0x55e556bc1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa23400640 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e55669d990 0x55e556bc1c60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54a1b9a538fd7e7 server_cookie=8240e8375d99960c in_seq=0 out_seq=0 2024-09-17T05:42:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa10c00640 10 client.7173 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa10c00640 1 -- 172.21.15.44:0/3186968365 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55e556a1b5b0 con 0x55e55669d990 2024-09-17T05:42:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa10c00640 10 client.7173 handle_command_reply: tid=0 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 client.7173 shutdown 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 msgr2=0x55e556c86390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c86390 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c6a0 tx=0x7faa0c068ad0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 shutdown_connections 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e556a9f6d0 0x55e556c868d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e5567baaa0 0x55e556c86390 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55e55669d990 0x55e556bc1c60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 --2- 172.21.15.44:0/3186968365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e5566f6890 0x55e556c85e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa10c00640 0 client.7173 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 >> 172.21.15.44:0/3186968365 conn(0x55e5566ca5c0 msgr2=0x55e556c22410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 shutdown_connections 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 1 -- 172.21.15.44:0/3186968365 wait complete. 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa31b68000 20 client.7173 trim_cache size 0 max 16384 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: "7cc1a22e-0b43-46bb-a0d6-c18286c24672": { 2024-09-17T05:42:19.221 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "7cc1a22e-0b43-46bb-a0d6-c18286c24672", 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive" 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "7cc1a22e-0b43-46bb-a0d6-c18286c24672": { 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:42:18.979472+0000", 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:19.222 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:19.223 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:42:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa00073230 msgr2=0x7faa00075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa00073230 0x7faa00075740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa14007fd0 tx=0x7faa14009040 comp rx=0 tx=0).stop 2024-09-17T05:42:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 msgr2=0x7faa2413d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa2413d330 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e7c0 tx=0x7faa0c00ec80 comp rx=0 tx=0).stop 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 shutdown_connections 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faa00073230 0x7faa00075740 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa241455b0 0x7faa2415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faa24072e30 0x7faa2413d330 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 --2- 172.21.15.44:0/4140528245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faa2406f7f0 0x7faa24156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 >> 172.21.15.44:0/4140528245 conn(0x7faa2406ce40 msgr2=0x7faa24143dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 shutdown_connections 2024-09-17T05:42:19.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:19.215+0000 7faa29000640 1 -- 172.21.15.44:0/4140528245 wait complete. 2024-09-17T05:42:19.236 INFO:tasks.cephfs.filesystem:scrub status for tag:7cc1a22e-0b43-46bb-a0d6-c18286c24672 - {'path': '/dir', 'tag': '7cc1a22e-0b43-46bb-a0d6-c18286c24672', 'options': 'recursive'} 2024-09-17T05:42:22.713 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:42:22.711+0000 7f2ed9000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T05:42:42.625 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:42.630 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:42:49.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:49.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T05:42:49.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.410+0000 7fc511e00640 1 -- 172.21.15.44:0/2731199523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c0cf790 msgr2=0x7fc50c15b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.410+0000 7fc511e00640 1 --2- 172.21.15.44:0/2731199523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c0cf790 0x7fc50c15b8e0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009900 tx=0x7fc4f401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.410+0000 7fc511e00640 1 -- 172.21.15.44:0/2731199523 shutdown_connections 2024-09-17T05:42:49.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.410+0000 7fc511e00640 1 --2- 172.21.15.44:0/2731199523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50c15be20 0x7fc50c072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.410+0000 7fc511e00640 1 --2- 172.21.15.44:0/2731199523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c0cf790 0x7fc50c15b8e0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.410+0000 7fc511e00640 1 -- 172.21.15.44:0/2731199523 >> 172.21.15.44:0/2731199523 conn(0x7fc50c06ce40 msgr2=0x7fc50c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 -- 172.21.15.44:0/2731199523 shutdown_connections 2024-09-17T05:42:49.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 -- 172.21.15.44:0/2731199523 wait complete. 2024-09-17T05:42:49.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 Processor -- start 2024-09-17T05:42:49.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 -- start start 2024-09-17T05:42:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50c0ce870 0x7fc50c1fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc50c15be20 0x7fc50c140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c14c9b0 0x7fc50c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c168790 con 0x7fc50c14c9b0 2024-09-17T05:42:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c168610 con 0x7fc50c15be20 2024-09-17T05:42:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c168910 con 0x7fc50c0ce870 2024-09-17T05:42:49.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.414+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c14c9b0 0x7fc50c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c14c9b0 0x7fc50c0b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48892/0 (socket says 172.21.15.44:48892) 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 -- 172.21.15.44:0/523293488 learned_addr learned my addr 172.21.15.44:0/523293488 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc510a00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50c0ce870 0x7fc50c1fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc503e00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc50c15be20 0x7fc50c140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 -- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50c0ce870 msgr2=0x7fc50c1fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50c0ce870 0x7fc50c1fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 -- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc50c15be20 msgr2=0x7fc50c140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc50c15be20 0x7fc50c140840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 -- 172.21.15.44:0/523293488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c151050 con 0x7fc50c14c9b0 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511400640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c14c9b0 0x7fc50c0b32e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc50400eae0 tx=0x7fc504009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc509600640 1 -- 172.21.15.44:0/523293488 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50400ce40 con 0x7fc50c14c9b0 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc509600640 1 -- 172.21.15.44:0/523293488 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc504004c20 con 0x7fc50c14c9b0 2024-09-17T05:42:49.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c1fc460 con 0x7fc50c14c9b0 2024-09-17T05:42:49.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc509600640 1 -- 172.21.15.44:0/523293488 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504005020 con 0x7fc50c14c9b0 2024-09-17T05:42:49.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50c1fb720 con 0x7fc50c14c9b0 2024-09-17T05:42:49.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.418+0000 7fc509600640 1 -- 172.21.15.44:0/523293488 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc5040051c0 con 0x7fc50c14c9b0 2024-09-17T05:42:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc509600640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc4e8073200 0x7fc4e8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc509600640 1 -- 172.21.15.44:0/523293488 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7fc504095170 con 0x7fc50c14c9b0 2024-09-17T05:42:49.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 Processor -- start 2024-09-17T05:42:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 -- start start 2024-09-17T05:42:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc510a00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc4e8073200 0x7fc4e8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc510a00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc4e8073200 0x7fc4e8075710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc007fd0 tx=0x7fc4fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fea0b6d0 0x5624feb779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624feb77f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe726aa0 0x5624feb78470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5624fea16cd0 con 0x5624fe726aa0 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5624fe92c330 con 0x5624fea0b6d0 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5624fe989bb0 con 0x5624fe662890 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe726aa0 0x5624feb78470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe726aa0 0x5624feb78470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48894/0 (socket says 172.21.15.44:48894) 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 -- 172.21.15.44:0/1550686564 learned_addr learned my addr 172.21.15.44:0/1550686564 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc510a00640 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fea0b6d0 0x5624feb779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc503e00640 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624feb77f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 -- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 msgr2=0x5624feb77f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624feb77f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 -- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fea0b6d0 msgr2=0x5624feb779f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fea0b6d0 0x5624feb779f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 -- 172.21.15.44:0/1550686564 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624fe92dc80 con 0x5624fe726aa0 2024-09-17T05:42:49.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc511400640 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe726aa0 0x5624feb78470 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc50405f8f0 tx=0x7fc50405f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd1e16411020327 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc501200640 1 -- 172.21.15.44:0/1550686564 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50401d030 con 0x5624fe726aa0 2024-09-17T05:42:49.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc501200640 1 -- 172.21.15.44:0/1550686564 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc50405bbd0 con 0x5624fe726aa0 2024-09-17T05:42:49.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.422+0000 7fc501200640 1 -- 172.21.15.44:0/1550686564 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504064030 con 0x5624fe726aa0 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- 172.21.15.44:0/1550686564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe726aa0 msgr2=0x5624feb78470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe726aa0 0x5624feb78470 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc50405f8f0 tx=0x7fc50405f960 comp rx=0 tx=0).stop 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- 172.21.15.44:0/1550686564 shutdown_connections 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe726aa0 0x5624feb78470 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624feb77f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1550686564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fea0b6d0 0x5624feb779f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- 172.21.15.44:0/1550686564 >> 172.21.15.44:0/1550686564 conn(0x5624fe6365c0 msgr2=0x5624feb34ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- 172.21.15.44:0/1550686564 shutdown_connections 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- 172.21.15.44:0/1550686564 wait complete. 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- start start 2024-09-17T05:42:49.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 Processor -- start 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe662890 0x5624feb339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624feb33ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fea0b6d0 0x5624feb3a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5624fe97cdf0 con 0x5624fe662890 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5624fe978fe0 con 0x5624fe726aa0 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5624fe91e4d0 con 0x5624fea0b6d0 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc51aadf000 10 client.0 _ll_register_callbacks cb 0x5624fe8fc7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc510a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe662890 0x5624feb339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc510a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe662890 0x5624feb339b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48904/0 (socket says 172.21.15.44:48904) 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc510a00640 1 -- 172.21.15.44:0/280488763 learned_addr learned my addr 172.21.15.44:0/280488763 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:49.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc503e00640 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624feb33ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.426+0000 7fc511400640 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fea0b6d0 0x5624feb3a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc510a00640 1 -- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fea0b6d0 msgr2=0x5624feb3a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc510a00640 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fea0b6d0 0x5624feb3a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc510a00640 1 -- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 msgr2=0x5624feb33ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc510a00640 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624feb33ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc510a00640 1 -- 172.21.15.44:0/280488763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624fe917210 con 0x5624fe662890 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc510a00640 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe662890 0x5624feb339b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc014700 tx=0x7fc4fc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f06d09b34d662a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 1 -- 172.21.15.44:0/280488763 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0135c0 con 0x5624fe662890 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 1 -- 172.21.15.44:0/280488763 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7fc4fc013760 con 0x5624fe662890 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5624fe911350 con 0x5624fe662890 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 1 -- 172.21.15.44:0/280488763 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fc4fc02e050 con 0x5624fe662890 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 10 client.7185 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:49.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x5624fe8fdfc0 con 0x5624fe662890 2024-09-17T05:42:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 1 -- 172.21.15.44:0/280488763 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5624fe911350 con 0x5624fe662890 2024-09-17T05:42:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 1 -- 172.21.15.44:0/280488763 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7fc4fc031020 con 0x5624fe662890 2024-09-17T05:42:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 10 client.7185 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 10 client.7185 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 20 client.7185 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe61b930 0x5624feb7ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 4 client.7185 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624fe98bb00 con 0x5624fe61b930 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc503e00640 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe61b930 0x5624feb7ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc503e00640 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe61b930 0x5624feb7ee80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d9d1f86968da277 server_cookie=d9493e6c4a21003c in_seq=0 out_seq=0 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 10 client.7185 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 1 -- 172.21.15.44:0/280488763 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624fe98bb00 con 0x5624fe61b930 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 10 client.7185 handle_command_reply: tid=0 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 client.7185 shutdown 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe662890 msgr2=0x5624feb339b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe662890 0x5624feb339b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc014700 tx=0x7fc4fc000ee0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 shutdown_connections 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fea0b6d0 0x5624feb3a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe61b930 0x5624feb7ee80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624feb33ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 --2- 172.21.15.44:0/280488763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fe662890 0x5624feb339b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 >> 172.21.15.44:0/280488763 conn(0x5624fe6365c0 msgr2=0x5624feb2cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc4f9600640 0 client.7185 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:49.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 shutdown_connections 2024-09-17T05:42:49.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 1 -- 172.21.15.44:0/280488763 wait complete. 2024-09-17T05:42:49.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.430+0000 7fc51aadf000 20 client.7185 trim_cache size 0 max 16384 2024-09-17T05:42:49.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 Processor -- start 2024-09-17T05:42:49.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 -- start start 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624febe9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624febe9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febe9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5624feb32b20 con 0x5624fea0b6d0 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c205a10 con 0x5624fe726aa0 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc50c204a50 con 0x5624fe662890 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.450+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febe9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febe9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48918/0 (socket says 172.21.15.44:48918) 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 -- 172.21.15.44:0/1776060831 learned_addr learned my addr 172.21.15.44:0/1776060831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc510a00640 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624febe9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 -- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 msgr2=0x5624febe9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624febe9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 -- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 msgr2=0x5624febe9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc503e00640 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624febe9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624febe9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 -- 172.21.15.44:0/1776060831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624fe9d6680 con 0x5624fea0b6d0 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc510a00640 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624febe9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc503e00640 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624febe9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc511400640 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febe9e80 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc504064550 tx=0x7fc504093380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53de5af006d07600 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc4fbe00640 1 -- 172.21.15.44:0/1776060831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50401d040 con 0x5624fea0b6d0 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc4fbe00640 1 -- 172.21.15.44:0/1776060831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc504060be0 con 0x5624fea0b6d0 2024-09-17T05:42:49.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc4fbe00640 1 -- 172.21.15.44:0/1776060831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504064040 con 0x5624fea0b6d0 2024-09-17T05:42:49.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 -- 172.21.15.44:0/1776060831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 msgr2=0x5624febe9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febe9e80 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fc504064550 tx=0x7fc504093380 comp rx=0 tx=0).stop 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 -- 172.21.15.44:0/1776060831 shutdown_connections 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febe9e80 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe726aa0 0x5624febe9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 --2- 172.21.15.44:0/1776060831 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe662890 0x5624febe9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 -- 172.21.15.44:0/1776060831 >> 172.21.15.44:0/1776060831 conn(0x5624fe6365c0 msgr2=0x5624feb89fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 -- 172.21.15.44:0/1776060831 shutdown_connections 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 -- 172.21.15.44:0/1776060831 wait complete. 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 -- start start 2024-09-17T05:42:49.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.454+0000 7fc51aadf000 1 Processor -- start 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe662890 0x5624febed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe726aa0 0x5624febed980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febedec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c204400 con 0x5624fea0b6d0 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc50c14ff60 con 0x5624fe662890 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5624fe63e680 con 0x5624fe726aa0 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 10 client.0 _ll_register_callbacks cb 0x7fc4fc017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febedec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febedec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48920/0 (socket says 172.21.15.44:48920) 2024-09-17T05:42:49.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 -- 172.21.15.44:0/453608963 learned_addr learned my addr 172.21.15.44:0/453608963 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc503e00640 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe726aa0 0x5624febed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc510a00640 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe662890 0x5624febed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 -- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe726aa0 msgr2=0x5624febed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe726aa0 0x5624febed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 -- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe662890 msgr2=0x5624febed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe662890 0x5624febed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 -- 172.21.15.44:0/453608963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624fe9430b0 con 0x5624fea0b6d0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc511400640 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febedec0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc5040934b0 tx=0x7fc50405f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3242b474ad0698 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 1 -- 172.21.15.44:0/453608963 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50401d070 con 0x5624fea0b6d0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 1 -- 172.21.15.44:0/453608963 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7fc50405ebc0 con 0x5624fea0b6d0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc504060be0 con 0x5624fea0b6d0 2024-09-17T05:42:49.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 1 -- 172.21.15.44:0/453608963 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fc504064040 con 0x5624fea0b6d0 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 10 client.7191 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x5624fe90f610 con 0x5624fea0b6d0 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 1 -- 172.21.15.44:0/453608963 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc504060be0 con 0x5624fea0b6d0 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 1 -- 172.21.15.44:0/453608963 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7fc50405b2b0 con 0x5624fea0b6d0 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 10 client.7191 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 10 client.7191 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 20 client.7191 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe609990 0x5624feb2e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 4 client.7191 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5624fe9875b0 con 0x5624fe609990 2024-09-17T05:42:49.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc510a00640 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe609990 0x5624feb2e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc510a00640 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe609990 0x5624feb2e830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fc49ab8aa054d7 server_cookie=7c5b6b2a3a458197 in_seq=0 out_seq=0 2024-09-17T05:42:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 10 client.7191 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 1 -- 172.21.15.44:0/453608963 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+377 (crc 0 0 0) 0x5624fe9875b0 con 0x5624fe609990 2024-09-17T05:42:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 10 client.7191 handle_command_reply: tid=0 2024-09-17T05:42:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 client.7191 shutdown 2024-09-17T05:42:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 msgr2=0x5624febedec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febedec0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc5040934b0 tx=0x7fc50405f470 comp rx=0 tx=0).stop 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 shutdown_connections 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5624fea0b6d0 0x5624febedec0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5624fe726aa0 0x5624febed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5624fe609990 0x5624feb2e830 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 --2- 172.21.15.44:0/453608963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624fe662890 0x5624febed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc4f9600640 0 client.7191 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.458+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 >> 172.21.15.44:0/453608963 conn(0x5624fe6365c0 msgr2=0x5624feb395a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 shutdown_connections 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc51aadf000 1 -- 172.21.15.44:0/453608963 wait complete. 2024-09-17T05:42:49.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc51aadf000 20 client.7191 trim_cache size 0 max 16384 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "7cc1a22e-0b43-46bb-a0d6-c18286c24672": { 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:42:18.979472+0000", 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:49.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:49.469 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:42:49.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc4e8073200 msgr2=0x7fc4e8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc4e8073200 0x7fc4e8075710 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc007fd0 tx=0x7fc4fc009040 comp rx=0 tx=0).stop 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c14c9b0 msgr2=0x7fc50c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c14c9b0 0x7fc50c0b32e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc50400eae0 tx=0x7fc504009f70 comp rx=0 tx=0).stop 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 shutdown_connections 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc50c14c9b0 0x7fc50c0b32e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc4e8073200 0x7fc4e8075710 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc50c15be20 0x7fc50c140840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 --2- 172.21.15.44:0/523293488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc50c0ce870 0x7fc50c1fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 >> 172.21.15.44:0/523293488 conn(0x7fc50c06ce40 msgr2=0x7fc50c0cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 shutdown_connections 2024-09-17T05:42:49.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.462+0000 7fc511e00640 1 -- 172.21.15.44:0/523293488 wait complete. 2024-09-17T05:42:49.483 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:42:49.484 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:42:49.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.638+0000 7faf63e00640 1 -- 172.21.15.44:0/63333743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 msgr2=0x7faf4800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.638+0000 7faf63e00640 1 --2- 172.21.15.44:0/63333743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf4800b9d0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7faf5c001dc0 tx=0x7faf5c01cb30 comp rx=0 tx=0).stop 2024-09-17T05:42:49.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.638+0000 7faf63e00640 1 -- 172.21.15.44:0/63333743 shutdown_connections 2024-09-17T05:42:49.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.638+0000 7faf63e00640 1 --2- 172.21.15.44:0/63333743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf4800b9d0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.638+0000 7faf63e00640 1 -- 172.21.15.44:0/63333743 >> 172.21.15.44:0/63333743 conn(0x7faf6406ce40 msgr2=0x7faf6406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.638+0000 7faf63e00640 1 -- 172.21.15.44:0/63333743 shutdown_connections 2024-09-17T05:42:49.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.638+0000 7faf63e00640 1 -- 172.21.15.44:0/63333743 wait complete. 2024-09-17T05:42:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 Processor -- start 2024-09-17T05:42:49.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 -- start start 2024-09-17T05:42:49.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf6413e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf641f5760 0x7faf6415df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf6415e4c0 0x7faf641f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faf64073920 con 0x7faf48005260 2024-09-17T05:42:49.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf64073aa0 con 0x7faf6415e4c0 2024-09-17T05:42:49.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf63e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faf64072c10 con 0x7faf641f5760 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf62a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf6413e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf62a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf6413e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48938/0 (socket says 172.21.15.44:48938) 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf62a00640 1 -- 172.21.15.44:0/3809897526 learned_addr learned my addr 172.21.15.44:0/3809897526 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.642+0000 7faf5be00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf641f5760 0x7faf6415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf63400640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf6415e4c0 0x7faf641f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf62a00640 1 -- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf641f5760 msgr2=0x7faf6415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf62a00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf641f5760 0x7faf6415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf62a00640 1 -- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf6415e4c0 msgr2=0x7faf641f8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf62a00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf6415e4c0 0x7faf641f8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf62a00640 1 -- 172.21.15.44:0/3809897526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6415e8d0 con 0x7faf48005260 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf63400640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf6415e4c0 0x7faf641f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf62a00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf6413e820 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7faf54011b10 tx=0x7faf54009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf5aa00640 1 -- 172.21.15.44:0/3809897526 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5400fe20 con 0x7faf48005260 2024-09-17T05:42:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf5aa00640 1 -- 172.21.15.44:0/3809897526 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf54004020 con 0x7faf48005260 2024-09-17T05:42:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf5aa00640 1 -- 172.21.15.44:0/3809897526 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54004470 con 0x7faf48005260 2024-09-17T05:42:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6413ed60 con 0x7faf48005260 2024-09-17T05:42:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf641f6550 con 0x7faf48005260 2024-09-17T05:42:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6415eda0 con 0x7faf48005260 2024-09-17T05:42:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf5aa00640 1 -- 172.21.15.44:0/3809897526 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faf54020020 con 0x7faf48005260 2024-09-17T05:42:49.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.646+0000 7faf5aa00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faf40073230 0x7faf40075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:49.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.650+0000 7faf5aa00640 1 -- 172.21.15.44:0/3809897526 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7faf54094e80 con 0x7faf48005260 2024-09-17T05:42:49.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.650+0000 7faf5be00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faf40073230 0x7faf40075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:49.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.650+0000 7faf5be00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faf40073230 0x7faf40075740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faf6414d350 tx=0x7faf4c006960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:49.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.654+0000 7faf5aa00640 1 -- 172.21.15.44:0/3809897526 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faf6415e8d0 con 0x7faf48005260 2024-09-17T05:42:49.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.858+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf640cc610 con 0x7faf48005260 2024-09-17T05:42:49.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf5aa00640 1 -- 172.21.15.44:0/3809897526 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5223 (secure 0 0 0) 0x7faf5405fc20 con 0x7faf48005260 2024-09-17T05:42:49.864 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:49.864 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":69,"btime":"2024-09-17T05:42:22:716908+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:22.683080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7071},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7071":{"gid":7071,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6835/3231247769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3231247769},{"type":"v1","addr":"172.21.15.44:6835","nonce":3231247769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7071,"qdb_cluster":[7071]},"id":6}]} 2024-09-17T05:42:49.865 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 69 2024-09-17T05:42:49.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faf40073230 msgr2=0x7faf40075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faf40073230 0x7faf40075740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faf6414d350 tx=0x7faf4c006960 comp rx=0 tx=0).stop 2024-09-17T05:42:49.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 msgr2=0x7faf6413e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:49.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf6413e820 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7faf54011b10 tx=0x7faf54009f60 comp rx=0 tx=0).stop 2024-09-17T05:42:49.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 shutdown_connections 2024-09-17T05:42:49.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faf40073230 0x7faf40075740 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf6415e4c0 0x7faf641f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faf641f5760 0x7faf6415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 --2- 172.21.15.44:0/3809897526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf48005260 0x7faf6413e820 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:49.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 >> 172.21.15.44:0/3809897526 conn(0x7faf6406ce40 msgr2=0x7faf64151540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:49.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 shutdown_connections 2024-09-17T05:42:49.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:49.862+0000 7faf63e00640 1 -- 172.21.15.44:0/3809897526 wait complete. 2024-09-17T05:42:49.886 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-09-17T05:42:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 -- 172.21.15.44:0/2941142845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9448072e50 msgr2=0x7f944815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 --2- 172.21.15.44:0/2941142845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9448072e50 0x7f944815e990 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9438009840 tx=0x7f943801c790 comp rx=0 tx=0).stop 2024-09-17T05:42:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 -- 172.21.15.44:0/2941142845 shutdown_connections 2024-09-17T05:42:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 --2- 172.21.15.44:0/2941142845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94480cb470 0x7f94480cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 --2- 172.21.15.44:0/2941142845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9448072e50 0x7f944815e990 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 -- 172.21.15.44:0/2941142845 >> 172.21.15.44:0/2941142845 conn(0x7f94480ccaa0 msgr2=0x7f94480cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 -- 172.21.15.44:0/2941142845 shutdown_connections 2024-09-17T05:42:50.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 -- 172.21.15.44:0/2941142845 wait complete. 2024-09-17T05:42:50.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 Processor -- start 2024-09-17T05:42:50.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.046+0000 7f944d400640 1 -- start start 2024-09-17T05:42:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f944806de50 0x7f94480b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9448072e50 0x7f94480b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94480cb470 0x7f94480b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9448168ed0 con 0x7f94480cb470 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9448168d50 con 0x7f944806de50 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9448169050 con 0x7f9448072e50 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94480cb470 0x7f94480b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94480cb470 0x7f94480b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48946/0 (socket says 172.21.15.44:48946) 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 -- 172.21.15.44:0/3187316147 learned_addr learned my addr 172.21.15.44:0/3187316147 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9446800640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f944806de50 0x7f94480b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f943fe00640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9448072e50 0x7f94480b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 -- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9448072e50 msgr2=0x7f94480b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9448072e50 0x7f94480b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 -- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f944806de50 msgr2=0x7f94480b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f944806de50 0x7f94480b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 -- 172.21.15.44:0/3187316147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94480b57a0 con 0x7f94480cb470 2024-09-17T05:42:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f943fe00640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9448072e50 0x7f94480b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f9447200640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94480cb470 0x7f94480b1440 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f944000ef60 tx=0x7f944000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f943ea00640 1 -- 172.21.15.44:0/3187316147 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440003980 con 0x7f94480cb470 2024-09-17T05:42:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f943ea00640 1 -- 172.21.15.44:0/3187316147 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9440003c30 con 0x7f94480cb470 2024-09-17T05:42:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f943ea00640 1 -- 172.21.15.44:0/3187316147 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440004280 con 0x7f94480cb470 2024-09-17T05:42:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94480b5a80 con 0x7f94480cb470 2024-09-17T05:42:50.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.050+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9448154e90 con 0x7f94480cb470 2024-09-17T05:42:50.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.054+0000 7f943ea00640 1 -- 172.21.15.44:0/3187316147 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f944001d020 con 0x7f94480cb470 2024-09-17T05:42:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.054+0000 7f943ea00640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073230 0x7f9424075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.054+0000 7f943ea00640 1 -- 172.21.15.44:0/3187316147 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f94400948e0 con 0x7f94480cb470 2024-09-17T05:42:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.054+0000 7f9454c41000 1 Processor -- start 2024-09-17T05:42:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.054+0000 7f9446800640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073230 0x7f9424075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.054+0000 7f9454c41000 1 -- start start 2024-09-17T05:42:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.054+0000 7f9446800640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073230 0x7f9424075740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94380af000 tx=0x7f943801afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae57b60 0x562b2af9d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af9d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae36d90 0x562b2af9dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b2ae3bd00 con 0x562b2ae4d1c0 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562b2adafc90 con 0x562b2ae57b60 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562b2ad9f0c0 con 0x562b2ae36d90 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af9d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af9d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48948/0 (socket says 172.21.15.44:48948) 2024-09-17T05:42:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9446800640 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae57b60 0x562b2af9d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 -- 172.21.15.44:0/185950308 learned_addr learned my addr 172.21.15.44:0/185950308 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9447200640 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae36d90 0x562b2af9dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 -- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae36d90 msgr2=0x562b2af9dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae36d90 0x562b2af9dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 -- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae57b60 msgr2=0x562b2af9d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae57b60 0x562b2af9d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 -- 172.21.15.44:0/185950308 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2ad7a290 con 0x562b2ae4d1c0 2024-09-17T05:42:50.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f943fe00640 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af9d820 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f94300015f0 tx=0x7f9430001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83a932a7a40b812 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9437000640 1 -- 172.21.15.44:0/185950308 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430019070 con 0x562b2ae4d1c0 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9437000640 1 -- 172.21.15.44:0/185950308 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9430001d00 con 0x562b2ae4d1c0 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9437000640 1 -- 172.21.15.44:0/185950308 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943000e740 con 0x562b2ae4d1c0 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- 172.21.15.44:0/185950308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 msgr2=0x562b2af9d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af9d820 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f94300015f0 tx=0x7f9430001ab0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- 172.21.15.44:0/185950308 shutdown_connections 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae36d90 0x562b2af9dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af9d820 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 --2- 172.21.15.44:0/185950308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae57b60 0x562b2af9d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- 172.21.15.44:0/185950308 >> 172.21.15.44:0/185950308 conn(0x562b2aa5c760 msgr2=0x562b2af80790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- 172.21.15.44:0/185950308 shutdown_connections 2024-09-17T05:42:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- 172.21.15.44:0/185950308 wait complete. 2024-09-17T05:42:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 -- start start 2024-09-17T05:42:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.058+0000 7f9454c41000 1 Processor -- start 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2af590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af59610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2af7f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b2ad39940 con 0x562b2ae4d1c0 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562b2ada2ed0 con 0x562b2ae36d90 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562b2aa64820 con 0x562b2ae57b60 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 10 client.0 _ll_register_callbacks cb 0x562b2ad7d7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af59610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af59610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48962/0 (socket says 172.21.15.44:48962) 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 -- 172.21.15.44:0/3887227063 learned_addr learned my addr 172.21.15.44:0/3887227063 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9446800640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2af590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9447200640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2af7f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 -- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 msgr2=0x562b2af7f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2af7f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 -- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 msgr2=0x562b2af590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2af590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 -- 172.21.15.44:0/3887227063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2ad52550 con 0x562b2ae4d1c0 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9447200640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2af7f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f943fe00640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af59610 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9430017040 tx=0x7f9430005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38ed49c5e1904a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f942b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f942b400640 1 -- 172.21.15.44:0/3887227063 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430019040 con 0x562b2ae4d1c0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f942b400640 1 -- 172.21.15.44:0/3887227063 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f943000e740 con 0x562b2ae4d1c0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b2ad37400 con 0x562b2ae4d1c0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f942b400640 1 -- 172.21.15.44:0/3887227063 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f943002c050 con 0x562b2ae4d1c0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 10 client.7206 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x562b2ad3d480 con 0x562b2ae4d1c0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f942b400640 1 -- 172.21.15.44:0/3887227063 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562b2ad37400 con 0x562b2ae4d1c0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f942b400640 1 -- 172.21.15.44:0/3887227063 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f943002f020 con 0x562b2ae4d1c0 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 10 client.7206 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 10 client.7206 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 20 client.7206 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa41ad0 0x562b2afae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 4 client.7206 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.062+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b2adb1be0 con 0x562b2aa41ad0 2024-09-17T05:42:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9446800640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa41ad0 0x562b2afae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9446800640 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa41ad0 0x562b2afae8a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c80cdc60e880b4bb server_cookie=30a218270137a575 in_seq=0 out_seq=0 2024-09-17T05:42:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f942b400640 10 client.7206 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f942b400640 1 -- 172.21.15.44:0/3887227063 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b2adb1be0 con 0x562b2aa41ad0 2024-09-17T05:42:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f942b400640 10 client.7206 handle_command_reply: tid=0 2024-09-17T05:42:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 client.7206 shutdown 2024-09-17T05:42:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 msgr2=0x562b2af59610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af59610 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9430017040 tx=0x7f9430005510 comp rx=0 tx=0).stop 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 shutdown_connections 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2af7f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2af59610 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa41ad0 0x562b2afae8a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 --2- 172.21.15.44:0/3887227063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2af590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f942b400640 0 client.7206 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 >> 172.21.15.44:0/3887227063 conn(0x562b2aa5c760 msgr2=0x562b2af51680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 shutdown_connections 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 1 -- 172.21.15.44:0/3887227063 wait complete. 2024-09-17T05:42:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.066+0000 7f9454c41000 20 client.7206 trim_cache size 0 max 16384 2024-09-17T05:42:50.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 Processor -- start 2024-09-17T05:42:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 -- start start 2024-09-17T05:42:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae36d90 0x562b2b00e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae4d1c0 0x562b2b00eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b00f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b2ada21e0 con 0x562b2ae36d90 2024-09-17T05:42:50.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562b2adaea60 con 0x562b2ae4d1c0 2024-09-17T05:42:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562b2ad6b300 con 0x562b2ae57b60 2024-09-17T05:42:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae36d90 0x562b2b00e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae36d90 0x562b2b00e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48968/0 (socket says 172.21.15.44:48968) 2024-09-17T05:42:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 -- 172.21.15.44:0/3865273658 learned_addr learned my addr 172.21.15.44:0/3865273658 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f943fe00640 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae4d1c0 0x562b2b00eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 -- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 msgr2=0x562b2b00f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9447200640 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b00f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b00f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 -- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae4d1c0 msgr2=0x562b2b00eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae4d1c0 0x562b2b00eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 -- 172.21.15.44:0/3865273658 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2ae24d10 con 0x562b2ae36d90 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f943fe00640 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae4d1c0 0x562b2b00eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9447200640 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b00f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9446800640 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae36d90 0x562b2b00e5c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f943801a3c0 tx=0x7f94380b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53de23c6eac1845 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9436600640 1 -- 172.21.15.44:0/3865273658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94380d3070 con 0x562b2ae36d90 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9436600640 1 -- 172.21.15.44:0/3865273658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94380a5850 con 0x562b2ae36d90 2024-09-17T05:42:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.082+0000 7f9436600640 1 -- 172.21.15.44:0/3865273658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94380b2040 con 0x562b2ae36d90 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- 172.21.15.44:0/3865273658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae36d90 msgr2=0x562b2b00e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae36d90 0x562b2b00e5c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f943801a3c0 tx=0x7f94380b7000 comp rx=0 tx=0).stop 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- 172.21.15.44:0/3865273658 shutdown_connections 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b00f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae4d1c0 0x562b2b00eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 --2- 172.21.15.44:0/3865273658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae36d90 0x562b2b00e5c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- 172.21.15.44:0/3865273658 >> 172.21.15.44:0/3865273658 conn(0x562b2aa5c760 msgr2=0x562b2af53690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- 172.21.15.44:0/3865273658 shutdown_connections 2024-09-17T05:42:50.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- 172.21.15.44:0/3865273658 wait complete. 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- start start 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 Processor -- start 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2b012810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2b012d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b013290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562b2ada7500 con 0x562b2ae4d1c0 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562b2ad4a300 con 0x562b2ae36d90 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562b2ad5c670 con 0x562b2ae57b60 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9454c41000 10 client.0 _ll_register_callbacks cb 0x7f9430017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2b012d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2b012d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48984/0 (socket says 172.21.15.44:48984) 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 -- 172.21.15.44:0/887782912 learned_addr learned my addr 172.21.15.44:0/887782912 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9446800640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2b012810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9447200640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b013290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 -- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 msgr2=0x562b2b013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b013290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 -- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 msgr2=0x562b2b012810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2b012810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 -- 172.21.15.44:0/887782912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2ad55e50 con 0x562b2ae4d1c0 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f9447200640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b013290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f943fe00640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2b012d50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9430007f80 tx=0x7f943000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfaef6dcb0e9e8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.086+0000 7f942b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 1 -- 172.21.15.44:0/887782912 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430034020 con 0x562b2ae4d1c0 2024-09-17T05:42:50.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 1 -- 172.21.15.44:0/887782912 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f94300218d0 con 0x562b2ae4d1c0 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94380a5850 con 0x562b2ae4d1c0 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 1 -- 172.21.15.44:0/887782912 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f9430019040 con 0x562b2ae4d1c0 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 10 client.7212 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x562b2ad442d0 con 0x562b2ae4d1c0 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 1 -- 172.21.15.44:0/887782912 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94380a5850 con 0x562b2ae4d1c0 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 1 -- 172.21.15.44:0/887782912 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f943002f040 con 0x562b2ae4d1c0 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 10 client.7212 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 10 client.7212 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 20 client.7212 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa2fb30 0x562b2afb1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 4 client.7212 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x562b2adad690 con 0x562b2aa2fb30 2024-09-17T05:42:50.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9446800640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa2fb30 0x562b2afb1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 10 client.7212 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9446800640 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa2fb30 0x562b2afb1320 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76edfe0c29cd975a server_cookie=6b25dce858fe8adc in_seq=0 out_seq=0 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 1 -- 172.21.15.44:0/887782912 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+418 (crc 0 0 0) 0x562b2adad690 con 0x562b2aa2fb30 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 10 client.7212 handle_command_reply: tid=0 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 client.7212 shutdown 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 msgr2=0x562b2b012d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2b012d50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9430007f80 tx=0x7f943000ef60 comp rx=0 tx=0).stop 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 shutdown_connections 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562b2ae57b60 0x562b2b013290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562b2ae4d1c0 0x562b2b012d50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562b2aa2fb30 0x562b2afb1320 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 --2- 172.21.15.44:0/887782912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562b2ae36d90 0x562b2b012810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f942b400640 0 client.7212 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 >> 172.21.15.44:0/887782912 conn(0x562b2aa5c760 msgr2=0x562b2af54050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 shutdown_connections 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 1 -- 172.21.15.44:0/887782912 wait complete. 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f9454c41000 20 client.7212 trim_cache size 0 max 16384 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_type": "backtrace", 2024-09-17T05:42:50.098 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 102619091, 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627777, 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/testdir/hardlink" 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_type": "backtrace", 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 822357571, 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627776, 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir" 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:42:50.099 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:42:50.100 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_type": "dir_frag", 2024-09-17T05:42:50.100 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 1594228631, 2024-09-17T05:42:50.100 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627776, 2024-09-17T05:42:50.100 INFO:teuthology.orchestra.run.smithi044.stdout: "frag": "*", 2024-09-17T05:42:50.100 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir" 2024-09-17T05:42:50.100 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:50.100 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073230 msgr2=0x7f9424075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073230 0x7f9424075740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94380af000 tx=0x7f943801afd0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94480cb470 msgr2=0x7f94480b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94480cb470 0x7f94480b1440 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f944000ef60 tx=0x7f944000ef90 comp rx=0 tx=0).stop 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 shutdown_connections 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f94480cb470 0x7f94480b1440 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9448072e50 0x7f94480b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073230 0x7f9424075740 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 --2- 172.21.15.44:0/3187316147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f944806de50 0x7f94480b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 >> 172.21.15.44:0/3187316147 conn(0x7f94480ccaa0 msgr2=0x7f9448157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 shutdown_connections 2024-09-17T05:42:50.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.090+0000 7f944d400640 1 -- 172.21.15.44:0/3187316147 wait complete. 2024-09-17T05:42:50.114 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:42:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 -- 172.21.15.44:0/4191423383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e0072e50 msgr2=0x7fc1e015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 --2- 172.21.15.44:0/4191423383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e0072e50 0x7fc1e015e990 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00cb0b0 tx=0x7fc1d001c770 comp rx=0 tx=0).stop 2024-09-17T05:42:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 -- 172.21.15.44:0/4191423383 shutdown_connections 2024-09-17T05:42:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 --2- 172.21.15.44:0/4191423383 >> v2:172.21.15.86:3300/0 conn(0x7fc1e006de50 0x7fc1e006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 --2- 172.21.15.44:0/4191423383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e0072e50 0x7fc1e015e990 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 -- 172.21.15.44:0/4191423383 >> 172.21.15.44:0/4191423383 conn(0x7fc1e00ccaa0 msgr2=0x7fc1e00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 -- 172.21.15.44:0/4191423383 shutdown_connections 2024-09-17T05:42:50.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 -- 172.21.15.44:0/4191423383 wait complete. 2024-09-17T05:42:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.270+0000 7fc1e6400640 1 Processor -- start 2024-09-17T05:42:50.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 -- start start 2024-09-17T05:42:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1e006de50 0x7fc1e01f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e0072e50 0x7fc1e015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00ced00 0x7fc1e0156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e0169360 con 0x7fc1e00ced00 2024-09-17T05:42:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e01691e0 con 0x7fc1e0072e50 2024-09-17T05:42:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e01694e0 con 0x7fc1e006de50 2024-09-17T05:42:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00ced00 0x7fc1e0156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00ced00 0x7fc1e0156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49014/0 (socket says 172.21.15.44:49014) 2024-09-17T05:42:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 -- 172.21.15.44:0/930786687 learned_addr learned my addr 172.21.15.44:0/930786687 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1df400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1e006de50 0x7fc1e01f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1d6a00640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e0072e50 0x7fc1e015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 -- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1e006de50 msgr2=0x7fc1e01f0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1e006de50 0x7fc1e01f0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 -- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e0072e50 msgr2=0x7fc1e015a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e0072e50 0x7fc1e015a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 -- 172.21.15.44:0/930786687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e009dfb0 con 0x7fc1e00ced00 2024-09-17T05:42:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1d6a00640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e0072e50 0x7fc1e015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:50.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1dfe00640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00ced00 0x7fc1e0156190 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800caa0 tx=0x7fc1d800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1d7e00640 1 -- 172.21.15.44:0/930786687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8016020 con 0x7fc1e00ced00 2024-09-17T05:42:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1d7e00640 1 -- 172.21.15.44:0/930786687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1d800a930 con 0x7fc1e00ced00 2024-09-17T05:42:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e01f9690 con 0x7fc1e00ced00 2024-09-17T05:42:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1d7e00640 1 -- 172.21.15.44:0/930786687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800adc0 con 0x7fc1e00ced00 2024-09-17T05:42:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e01f9c30 con 0x7fc1e00ced00 2024-09-17T05:42:50.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.274+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e01fa5d0 con 0x7fc1e00ced00 2024-09-17T05:42:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.278+0000 7fc1d7e00640 1 -- 172.21.15.44:0/930786687 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc1d8019020 con 0x7fc1e00ced00 2024-09-17T05:42:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.278+0000 7fc1d7e00640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc1bc073200 0x7fc1bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.278+0000 7fc1d7e00640 1 -- 172.21.15.44:0/930786687 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7fc1d8094920 con 0x7fc1e00ced00 2024-09-17T05:42:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.278+0000 7fc1df400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc1bc073200 0x7fc1bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.278+0000 7fc1df400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc1bc073200 0x7fc1bc075710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00af000 tx=0x7fc1d001afb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.282+0000 7fc1d7e00640 1 -- 172.21.15.44:0/930786687 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc1e01fa5d0 con 0x7fc1e00ced00 2024-09-17T05:42:50.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc1e006e260 con 0x7fc1e00ced00 2024-09-17T05:42:50.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1d7e00640 1 -- 172.21.15.44:0/930786687 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7fc1d8066e20 con 0x7fc1e00ced00 2024-09-17T05:42:50.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:42:50.501 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-09-17T05:42:50.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc1bc073200 msgr2=0x7fc1bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc1bc073200 0x7fc1bc075710 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00af000 tx=0x7fc1d001afb0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00ced00 msgr2=0x7fc1e0156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00ced00 0x7fc1e0156190 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800caa0 tx=0x7fc1d800cb90 comp rx=0 tx=0).stop 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 shutdown_connections 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1e00ced00 0x7fc1e0156190 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc1bc073200 0x7fc1bc075710 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1e0072e50 0x7fc1e015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 --2- 172.21.15.44:0/930786687 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc1e006de50 0x7fc1e01f0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 >> 172.21.15.44:0/930786687 conn(0x7fc1e00ccaa0 msgr2=0x7fc1e00cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 shutdown_connections 2024-09-17T05:42:50.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.498+0000 7fc1e6400640 1 -- 172.21.15.44:0/930786687 wait complete. 2024-09-17T05:42:50.523 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:42:50.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:50.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-09-17T05:42:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.682+0000 7f0c19400640 1 -- 172.21.15.44:0/3256163176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf8003c40 msgr2=0x7f0bf8004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.682+0000 7f0c19400640 1 --2- 172.21.15.44:0/3256163176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf8003c40 0x7f0bf8004090 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009b40 tx=0x7f0c0401d250 comp rx=0 tx=0).stop 2024-09-17T05:42:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.682+0000 7f0c19400640 1 -- 172.21.15.44:0/3256163176 shutdown_connections 2024-09-17T05:42:50.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.682+0000 7f0c19400640 1 --2- 172.21.15.44:0/3256163176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf8003c40 0x7f0bf8004090 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.682+0000 7f0c19400640 1 -- 172.21.15.44:0/3256163176 >> 172.21.15.44:0/3256163176 conn(0x7f0c140b35f0 msgr2=0x7f0c140b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 -- 172.21.15.44:0/3256163176 shutdown_connections 2024-09-17T05:42:50.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 -- 172.21.15.44:0/3256163176 wait complete. 2024-09-17T05:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 Processor -- start 2024-09-17T05:42:50.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 -- start start 2024-09-17T05:42:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bf8003c40 0x7f0c1414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c1414c5a0 0x7f0c140b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1414c9b0 0x7f0c140b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14155790 con 0x7f0c1414c9b0 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14070e00 con 0x7f0c1414c5a0 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.686+0000 7f0c19400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1415b840 con 0x7f0bf8003c40 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1414c9b0 0x7f0c140b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1414c9b0 0x7f0c140b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49036/0 (socket says 172.21.15.44:49036) 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 -- 172.21.15.44:0/2978565949 learned_addr learned my addr 172.21.15.44:0/2978565949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c11e00640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c1414c5a0 0x7f0c140b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c12800640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bf8003c40 0x7f0c1414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 -- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bf8003c40 msgr2=0x7f0c1414fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bf8003c40 0x7f0c1414fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 -- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c1414c5a0 msgr2=0x7f0c140b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c1414c5a0 0x7f0c140b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 -- 172.21.15.44:0/2978565949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c141502f0 con 0x7f0c1414c9b0 2024-09-17T05:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c13200640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1414c9b0 0x7f0c140b0630 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0c140cf660 tx=0x7f0c0c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c0aa00640 1 -- 172.21.15.44:0/2978565949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c010890 con 0x7f0c1414c9b0 2024-09-17T05:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c0aa00640 1 -- 172.21.15.44:0/2978565949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c0c017070 con 0x7f0c1414c9b0 2024-09-17T05:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c0aa00640 1 -- 172.21.15.44:0/2978565949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c010da0 con 0x7f0c1414c9b0 2024-09-17T05:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c141f9c80 con 0x7f0c1414c9b0 2024-09-17T05:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c141fa240 con 0x7f0c1414c9b0 2024-09-17T05:42:50.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.690+0000 7f0c0aa00640 1 -- 172.21.15.44:0/2978565949 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0c0c01c460 con 0x7f0c1414c9b0 2024-09-17T05:42:50.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c0aa00640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0bf4073200 0x7f0bf4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c0aa00640 1 -- 172.21.15.44:0/2978565949 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f0c0c094530 con 0x7f0c1414c9b0 2024-09-17T05:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c12800640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0bf4073200 0x7f0bf4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 Processor -- start 2024-09-17T05:42:50.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 -- start start 2024-09-17T05:42:50.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c12800640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0bf4073200 0x7f0bf4075710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad000 tx=0x7f0c04019ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb53aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcb53fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb54520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562bfc914bd0 con 0x562bfc9feae0 2024-09-17T05:42:50.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562bfc905430 con 0x562bfca061a0 2024-09-17T05:42:50.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562bfc962ce0 con 0x562bfc9e8970 2024-09-17T05:42:50.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcb53fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcb53fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49040/0 (socket says 172.21.15.44:49040) 2024-09-17T05:42:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c12800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb53aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 -- 172.21.15.44:0/1227233483 learned_addr learned my addr 172.21.15.44:0/1227233483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c13200640 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb54520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 -- 172.21.15.44:0/1227233483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 msgr2=0x562bfcb54520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb54520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 -- 172.21.15.44:0/1227233483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 msgr2=0x562bfcb53aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb53aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 -- 172.21.15.44:0/1227233483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bfc906d80 con 0x562bfc9feae0 2024-09-17T05:42:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.694+0000 7f0c11e00640 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcb53fe0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f0c00006570 tx=0x7f0c000049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e55f38f007c5e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0bff000640 1 -- 172.21.15.44:0/1227233483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00001840 con 0x562bfc9feae0 2024-09-17T05:42:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0bff000640 1 -- 172.21.15.44:0/1227233483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c00016030 con 0x562bfc9feae0 2024-09-17T05:42:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0bff000640 1 -- 172.21.15.44:0/1227233483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00001cd0 con 0x562bfc9feae0 2024-09-17T05:42:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- 172.21.15.44:0/1227233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 msgr2=0x562bfcb53fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcb53fe0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f0c00006570 tx=0x7f0c000049e0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- 172.21.15.44:0/1227233483 shutdown_connections 2024-09-17T05:42:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb54520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcb53fe0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 --2- 172.21.15.44:0/1227233483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb53aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- 172.21.15.44:0/1227233483 >> 172.21.15.44:0/1227233483 conn(0x562bfca0c8c0 msgr2=0x562bfcb044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- 172.21.15.44:0/1227233483 shutdown_connections 2024-09-17T05:42:50.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- 172.21.15.44:0/1227233483 wait complete. 2024-09-17T05:42:50.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- start start 2024-09-17T05:42:50.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 Processor -- start 2024-09-17T05:42:50.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9e8970 0x562bfcb59d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9feae0 0x562bfcb5a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb5a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562bfc955f20 con 0x562bfc9e8970 2024-09-17T05:42:50.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562bfc952110 con 0x562bfca061a0 2024-09-17T05:42:50.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562bfc8f76d0 con 0x562bfc9feae0 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.698+0000 7f0c209c8000 10 client.0 _ll_register_callbacks cb 0x562bfc8f6330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9e8970 0x562bfcb59d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9e8970 0x562bfcb59d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49054/0 (socket says 172.21.15.44:49054) 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 -- 172.21.15.44:0/3286294085 learned_addr learned my addr 172.21.15.44:0/3286294085 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c13200640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb5a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c11e00640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9feae0 0x562bfcb5a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 -- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9feae0 msgr2=0x562bfcb5a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9feae0 0x562bfcb5a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 -- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 msgr2=0x562bfcb5a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb5a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 -- 172.21.15.44:0/3286294085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bfc8f0310 con 0x562bfc9e8970 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c13200640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb5a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c12800640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9e8970 0x562bfcb59d10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009b40 tx=0x7f0c040091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ae1111570e420b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 1 -- 172.21.15.44:0/3286294085 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c040c6430 con 0x562bfc9e8970 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 1 -- 172.21.15.44:0/3286294085 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f0c040c65d0 con 0x562bfc9e8970 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562bfc8ea450 con 0x562bfc9e8970 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 1 -- 172.21.15.44:0/3286294085 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f0c040d6050 con 0x562bfc9e8970 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 10 client.7233 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x562bfc90df60 con 0x562bfc9e8970 2024-09-17T05:42:50.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 1 -- 172.21.15.44:0/3286294085 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x562bfc8ea450 con 0x562bfc9e8970 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 1 -- 172.21.15.44:0/3286294085 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f0c040d9020 con 0x562bfc9e8970 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 10 client.7233 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 10 client.7233 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 20 client.7233 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5f4b80 0x562bfcb640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 4 client.7233 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bfc964c30 con 0x562bfc5f4b80 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c11e00640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5f4b80 0x562bfcb640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0c11e00640 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5f4b80 0x562bfcb640f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa2c1e66e476f6b server_cookie=a0794db175d4b9f5 in_seq=0 out_seq=0 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 10 client.7233 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 1 -- 172.21.15.44:0/3286294085 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bfc964c30 con 0x562bfc5f4b80 2024-09-17T05:42:50.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.702+0000 7f0bf3400640 10 client.7233 handle_command_reply: tid=0 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 client.7233 shutdown 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9e8970 msgr2=0x562bfcb59d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9e8970 0x562bfcb59d10 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009b40 tx=0x7f0c040091e0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 shutdown_connections 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5f4b80 0x562bfcb640f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfca061a0 0x562bfcb5a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9feae0 0x562bfcb5a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 --2- 172.21.15.44:0/3286294085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9e8970 0x562bfcb59d10 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 >> 172.21.15.44:0/3286294085 conn(0x562bfca0c8c0 msgr2=0x562bfcb0b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0bf3400640 0 client.7233 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 shutdown_connections 2024-09-17T05:42:50.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 1 -- 172.21.15.44:0/3286294085 wait complete. 2024-09-17T05:42:50.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.706+0000 7f0c209c8000 20 client.7233 trim_cache size 0 max 16384 2024-09-17T05:42:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.722+0000 7f0c209c8000 1 Processor -- start 2024-09-17T05:42:50.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.722+0000 7f0c209c8000 1 -- start start 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb0b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9feae0 0x562bfcb51f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfca061a0 0x562bfcb52470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14201db0 con 0x562bfca061a0 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0c14200dc0 con 0x562bfc9feae0 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1415d850 con 0x562bfc9e8970 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfca061a0 0x562bfcb52470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfca061a0 0x562bfcb52470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49056/0 (socket says 172.21.15.44:49056) 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 -- 172.21.15.44:0/4083731413 learned_addr learned my addr 172.21.15.44:0/4083731413 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c12800640 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb0b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c11e00640 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9feae0 0x562bfcb51f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 -- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 msgr2=0x562bfcb0b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb0b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 -- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9feae0 msgr2=0x562bfcb51f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9feae0 0x562bfcb51f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 -- 172.21.15.44:0/4083731413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bfc9d6f30 con 0x562bfca061a0 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c12800640 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb0b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c11e00640 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9feae0 0x562bfcb51f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:42:50.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c13200640 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfca061a0 0x562bfcb52470 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c05eca0 tx=0x7f0c0c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3a1e271a3c6595 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0bfe600640 1 -- 172.21.15.44:0/4083731413 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c063740 con 0x562bfca061a0 2024-09-17T05:42:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0bfe600640 1 -- 172.21.15.44:0/4083731413 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c0c0685f0 con 0x562bfca061a0 2024-09-17T05:42:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0bfe600640 1 -- 172.21.15.44:0/4083731413 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c068160 con 0x562bfca061a0 2024-09-17T05:42:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- 172.21.15.44:0/4083731413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfca061a0 msgr2=0x562bfcb52470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfca061a0 0x562bfcb52470 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c05eca0 tx=0x7f0c0c01e040 comp rx=0 tx=0).stop 2024-09-17T05:42:50.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- 172.21.15.44:0/4083731413 shutdown_connections 2024-09-17T05:42:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfca061a0 0x562bfcb52470 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9feae0 0x562bfcb51f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 --2- 172.21.15.44:0/4083731413 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfc9e8970 0x562bfcb0b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- 172.21.15.44:0/4083731413 >> 172.21.15.44:0/4083731413 conn(0x562bfca0c8c0 msgr2=0x562bfcb04d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- 172.21.15.44:0/4083731413 shutdown_connections 2024-09-17T05:42:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- 172.21.15.44:0/4083731413 wait complete. 2024-09-17T05:42:50.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 -- start start 2024-09-17T05:42:50.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.726+0000 7f0c209c8000 1 Processor -- start 2024-09-17T05:42:50.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9e8970 0x562bfcbc9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcbc99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfca061a0 0x562bfcbc9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562bfc6178d0 con 0x562bfc9feae0 2024-09-17T05:42:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1415dea0 con 0x562bfc9e8970 2024-09-17T05:42:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562bfca108e0 con 0x562bfca061a0 2024-09-17T05:42:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 10 client.0 _ll_register_callbacks cb 0x7f0bf800c1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:50.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcbc99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcbc99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49062/0 (socket says 172.21.15.44:49062) 2024-09-17T05:42:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 -- 172.21.15.44:0/2170202827 learned_addr learned my addr 172.21.15.44:0/2170202827 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c12800640 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9e8970 0x562bfcbc9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c13200640 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfca061a0 0x562bfcbc9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 -- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfca061a0 msgr2=0x562bfcbc9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfca061a0 0x562bfcbc9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 -- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9e8970 msgr2=0x562bfcbc9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9e8970 0x562bfcbc9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 -- 172.21.15.44:0/2170202827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bfc9addd0 con 0x562bfc9feae0 2024-09-17T05:42:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c11e00640 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcbc99c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x562bfca03ca0 tx=0x7f0c00001300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2419d98f29cdb8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0bf3400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0bf3400640 1 -- 172.21.15.44:0/2170202827 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00001be0 con 0x562bfc9feae0 2024-09-17T05:42:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0bf3400640 1 -- 172.21.15.44:0/2170202827 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f0c00012440 con 0x562bfc9feae0 2024-09-17T05:42:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c0c0685f0 con 0x562bfc9feae0 2024-09-17T05:42:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0bf3400640 1 -- 172.21.15.44:0/2170202827 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f0c00035050 con 0x562bfc9feae0 2024-09-17T05:42:50.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 10 client.7239 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:50.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x562bfc8e8840 con 0x562bfc9feae0 2024-09-17T05:42:50.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0bf3400640 1 -- 172.21.15.44:0/2170202827 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c0c0685f0 con 0x562bfc9feae0 2024-09-17T05:42:50.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0bf3400640 1 -- 172.21.15.44:0/2170202827 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f0c00038020 con 0x562bfc9feae0 2024-09-17T05:42:50.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 10 client.7239 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:50.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 10 client.7239 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:50.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 20 client.7239 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5e2be0 0x562bfcb655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 4 client.7239 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-09-17T05:42:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x562bfc9606e0 con 0x562bfc5e2be0 2024-09-17T05:42:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c12800640 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5e2be0 0x562bfcb655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0bf3400640 10 client.7239 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.730+0000 7f0c12800640 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5e2be0 0x562bfcb655c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45bf9c913682c30e server_cookie=ecacbace4d897019 in_seq=0 out_seq=0 2024-09-17T05:42:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0bf3400640 1 -- 172.21.15.44:0/2170202827 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562bfc9606e0 con 0x562bfc5e2be0 2024-09-17T05:42:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0bf3400640 10 client.7239 handle_command_reply: tid=0 2024-09-17T05:42:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 client.7239 shutdown 2024-09-17T05:42:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 msgr2=0x562bfcbc99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcbc99c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x562bfca03ca0 tx=0x7f0c00001300 comp rx=0 tx=0).stop 2024-09-17T05:42:50.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 shutdown_connections 2024-09-17T05:42:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562bfca061a0 0x562bfcbc9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562bfc9feae0 0x562bfcbc99c0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x562bfc5e2be0 0x562bfcb655c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 --2- 172.21.15.44:0/2170202827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bfc9e8970 0x562bfcbc9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0bf3400640 0 client.7239 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 >> 172.21.15.44:0/2170202827 conn(0x562bfca0c8c0 msgr2=0x562bfcb044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 shutdown_connections 2024-09-17T05:42:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 1 -- 172.21.15.44:0/2170202827 wait complete. 2024-09-17T05:42:50.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c209c8000 20 client.7239 trim_cache size 0 max 16384 2024-09-17T05:42:50.751 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:42:50.751 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:42:50.751 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "be621aff-75f0-445e-86a9-c223a488f5e3", 2024-09-17T05:42:50.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:42:50.751 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:42:50.752 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f3832e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0)->f(v1 m2024-09-17T05:42:09.787593+0000) n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1)->n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5585de78bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-09-17T05:42:50.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0bf4073200 msgr2=0x7f0bf4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0bf4073200 0x7f0bf4075710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0c040ad000 tx=0x7f0c04019ff0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1414c9b0 msgr2=0x7f0c140b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1414c9b0 0x7f0c140b0630 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0c140cf660 tx=0x7f0c0c00ea10 comp rx=0 tx=0).stop 2024-09-17T05:42:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 shutdown_connections 2024-09-17T05:42:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1414c9b0 0x7f0c140b0630 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0bf4073200 0x7f0bf4075710 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c1414c5a0 0x7f0c140b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 --2- 172.21.15.44:0/2978565949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0bf8003c40 0x7f0c1414fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 >> 172.21.15.44:0/2978565949 conn(0x7f0c140b35f0 msgr2=0x7f0c1406ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 shutdown_connections 2024-09-17T05:42:50.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.734+0000 7f0c19400640 1 -- 172.21.15.44:0/2978565949 wait complete. 2024-09-17T05:42:50.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:42:50.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T05:42:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 -- 172.21.15.44:0/613073410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c072e50 msgr2=0x7f021c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 --2- 172.21.15.44:0/613073410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c072e50 0x7f021c15e990 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f021c0cb0b0 tx=0x7f020c01c770 comp rx=0 tx=0).stop 2024-09-17T05:42:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 -- 172.21.15.44:0/613073410 shutdown_connections 2024-09-17T05:42:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 --2- 172.21.15.44:0/613073410 >> v2:172.21.15.86:3300/0 conn(0x7f021c06de50 0x7f021c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 --2- 172.21.15.44:0/613073410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c072e50 0x7f021c15e990 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 -- 172.21.15.44:0/613073410 >> 172.21.15.44:0/613073410 conn(0x7f021c0ccaa0 msgr2=0x7f021c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 -- 172.21.15.44:0/613073410 shutdown_connections 2024-09-17T05:42:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 -- 172.21.15.44:0/613073410 wait complete. 2024-09-17T05:42:50.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 Processor -- start 2024-09-17T05:42:50.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.922+0000 7f0221a00640 1 -- start start 2024-09-17T05:42:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c06de50 0x7f021c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021c072e50 0x7f021c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0ced00 0x7f021c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f021c169360 con 0x7f021c06de50 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f021c1691e0 con 0x7f021c0ced00 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f021c1694e0 con 0x7f021c072e50 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c06de50 0x7f021c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c06de50 0x7f021c1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49082/0 (socket says 172.21.15.44:49082) 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 -- 172.21.15.44:0/2106782536 learned_addr learned my addr 172.21.15.44:0/2106782536 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 -- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021c072e50 msgr2=0x7f021c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021c072e50 0x7f021c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 -- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0ced00 msgr2=0x7f021c0ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0ced00 0x7f021c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 -- 172.21.15.44:0/2106782536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021c1f8190 con 0x7f021c06de50 2024-09-17T05:42:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f021aa00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c06de50 0x7f021c1598e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f020c01cc50 tx=0x7f020c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0212a00640 1 -- 172.21.15.44:0/2106782536 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c0b2040 con 0x7f021c06de50 2024-09-17T05:42:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0212a00640 1 -- 172.21.15.44:0/2106782536 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f020c004040 con 0x7f021c06de50 2024-09-17T05:42:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0212a00640 1 -- 172.21.15.44:0/2106782536 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c004470 con 0x7f021c06de50 2024-09-17T05:42:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021c15a660 con 0x7f021c06de50 2024-09-17T05:42:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.926+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021c15ac20 con 0x7f021c06de50 2024-09-17T05:42:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0212a00640 1 -- 172.21.15.44:0/2106782536 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f020c0bd030 con 0x7f021c06de50 2024-09-17T05:42:50.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0212a00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f8073200 0x7f01f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0212a00640 1 -- 172.21.15.44:0/2106782536 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f020c12dd40 con 0x7f021c06de50 2024-09-17T05:42:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 Processor -- start 2024-09-17T05:42:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f8073200 0x7f01f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 -- start start 2024-09-17T05:42:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f8073200 0x7f01f8075710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02040058d0 tx=0x7f0204005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55755603f6d0 0x5575561afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557555c96890 0x5575561b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55755604acd0 con 0x557555c96890 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557555f60330 con 0x55755603f6d0 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x557555fbdbb0 con 0x557555d5aaa0 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557555c96890 0x5575561b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557555c96890 0x5575561b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49086/0 (socket says 172.21.15.44:49086) 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 -- 172.21.15.44:0/996684783 learned_addr learned my addr 172.21.15.44:0/996684783 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f021aa00640 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55755603f6d0 0x5575561afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f021b400640 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 -- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 msgr2=0x5575561b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 -- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55755603f6d0 msgr2=0x5575561afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55755603f6d0 0x5575561afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f0213e00640 1 -- 172.21.15.44:0/996684783 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557555f61c80 con 0x557555c96890 2024-09-17T05:42:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.930+0000 7f021aa00640 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55755603f6d0 0x5575561afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f0213e00640 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557555c96890 0x5575561b0530 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f020400ed30 tx=0x7f0204011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b953d66d78fd2b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f020b400640 1 -- 172.21.15.44:0/996684783 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204020070 con 0x557555c96890 2024-09-17T05:42:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f020b400640 1 -- 172.21.15.44:0/996684783 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0204025460 con 0x557555c96890 2024-09-17T05:42:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f020b400640 1 -- 172.21.15.44:0/996684783 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02040258b0 con 0x557555c96890 2024-09-17T05:42:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 -- 172.21.15.44:0/996684783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557555c96890 msgr2=0x5575561b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557555c96890 0x5575561b0530 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f020400ed30 tx=0x7f0204011000 comp rx=0 tx=0).stop 2024-09-17T05:42:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 -- 172.21.15.44:0/996684783 shutdown_connections 2024-09-17T05:42:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557555c96890 0x5575561b0530 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 --2- 172.21.15.44:0/996684783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55755603f6d0 0x5575561afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 -- 172.21.15.44:0/996684783 >> 172.21.15.44:0/996684783 conn(0x557555c6a5c0 msgr2=0x557556168ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 -- 172.21.15.44:0/996684783 shutdown_connections 2024-09-17T05:42:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 -- 172.21.15.44:0/996684783 wait complete. 2024-09-17T05:42:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 -- start start 2024-09-17T05:42:50.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.934+0000 7f022913b000 1 Processor -- start 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x557556171cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x5575561721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556172730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557555fb0df0 con 0x55755603f6d0 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557555facfe0 con 0x557555d5aaa0 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x557555f524d0 con 0x557555c96890 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 10 client.0 _ll_register_callbacks cb 0x557555f307f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556172730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021aa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x557556171cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556172730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49098/0 (socket says 172.21.15.44:49098) 2024-09-17T05:42:50.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021b400640 1 -- 172.21.15.44:0/2307237396 learned_addr learned my addr 172.21.15.44:0/2307237396 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f0213e00640 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x5575561721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021aa00640 1 -- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 msgr2=0x5575561721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021aa00640 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x5575561721f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021aa00640 1 -- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 msgr2=0x557556172730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021aa00640 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556172730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021aa00640 1 -- 172.21.15.44:0/2307237396 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x557555f4b210 con 0x557555c96890 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021b400640 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556172730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f021aa00640 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x557556171cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f020c098260 tx=0x7f020c0f7ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee02f7145178be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3301/0 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 1 -- 172.21.15.44:0/2307237396 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c0f8b70 con 0x557555c96890 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 1 -- 172.21.15.44:0/2307237396 <== mon.2 v2:172.21.15.86:3301/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f020c0f76d0 con 0x557555c96890 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x557555f45350 con 0x557555c96890 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 1 -- 172.21.15.44:0/2307237396 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f020c119050 con 0x557555c96890 2024-09-17T05:42:50.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 10 client.6380 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x557555f31fc0 con 0x557555c96890 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 1 -- 172.21.15.44:0/2307237396 <== mon.2 v2:172.21.15.86:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557555f45350 con 0x557555c96890 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 1 -- 172.21.15.44:0/2307237396 <== mon.2 v2:172.21.15.86:3301/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f020c0b5070 con 0x557555c96890 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 10 client.6380 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 10 client.6380 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 20 client.6380 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c4f930 0x5575561c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 4 client.6380 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557555fbfb00 con 0x557555c4f930 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f0213e00640 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c4f930 0x5575561c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f0213e00640 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c4f930 0x5575561c15b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28ab092f475bc5b server_cookie=2aa59a7f11ee54c1 in_seq=0 out_seq=0 2024-09-17T05:42:50.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 10 client.6380 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 1 -- 172.21.15.44:0/2307237396 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557555fbfb00 con 0x557555c4f930 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 10 client.6380 handle_command_reply: tid=0 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 client.6380 shutdown 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 msgr2=0x557556171cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x557556171cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f020c098260 tx=0x7f020c0f7ca0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 shutdown_connections 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556172730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c4f930 0x5575561c15b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x5575561721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 --2- 172.21.15.44:0/2307237396 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x557556171cb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 >> 172.21.15.44:0/2307237396 conn(0x557555c6a5c0 msgr2=0x557556160360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.938+0000 7f01ffe00640 0 client.6380 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.942+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 shutdown_connections 2024-09-17T05:42:50.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.942+0000 7f022913b000 1 -- 172.21.15.44:0/2307237396 wait complete. 2024-09-17T05:42:50.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.942+0000 7f022913b000 20 client.6380 trim_cache size 0 max 16384 2024-09-17T05:42:50.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.958+0000 7f022913b000 1 Processor -- start 2024-09-17T05:42:50.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.958+0000 7f022913b000 1 -- start start 2024-09-17T05:42:50.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x5575562214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x557556221a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556221f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55755616fd80 con 0x55755603f6d0 2024-09-17T05:42:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f021c1fb290 con 0x557555d5aaa0 2024-09-17T05:42:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f021c0a04b0 con 0x557555c96890 2024-09-17T05:42:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556221f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556221f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49100/0 (socket says 172.21.15.44:49100) 2024-09-17T05:42:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 -- 172.21.15.44:0/1446010103 learned_addr learned my addr 172.21.15.44:0/1446010103 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f0213e00640 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x557556221a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021aa00640 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x5575562214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 -- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 msgr2=0x5575562214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x5575562214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 -- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 msgr2=0x557556221a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x557556221a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 -- 172.21.15.44:0/1446010103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755600a680 con 0x55755603f6d0 2024-09-17T05:42:50.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021aa00640 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x5575562214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:42:50.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f021b400640 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556221f70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0214005a50 tx=0x7f02140126d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82bc389e1b9921e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f020aa00640 1 -- 172.21.15.44:0/1446010103 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214019070 con 0x55755603f6d0 2024-09-17T05:42:50.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f020aa00640 1 -- 172.21.15.44:0/1446010103 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0214015650 con 0x55755603f6d0 2024-09-17T05:42:50.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f020aa00640 1 -- 172.21.15.44:0/1446010103 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214015aa0 con 0x55755603f6d0 2024-09-17T05:42:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- 172.21.15.44:0/1446010103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 msgr2=0x557556221f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556221f70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0214005a50 tx=0x7f02140126d0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- 172.21.15.44:0/1446010103 shutdown_connections 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x557556221f70 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555d5aaa0 0x557556221a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 --2- 172.21.15.44:0/1446010103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555c96890 0x5575562214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- 172.21.15.44:0/1446010103 >> 172.21.15.44:0/1446010103 conn(0x557555c6a5c0 msgr2=0x557556168b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- 172.21.15.44:0/1446010103 shutdown_connections 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- 172.21.15.44:0/1446010103 wait complete. 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 -- start start 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.962+0000 7f022913b000 1 Processor -- start 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555c96890 0x5575561c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x5575561e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f021c09fe60 con 0x55755603f6d0 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f021c1538a0 con 0x557555c96890 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x557555c72680 con 0x557555d5aaa0 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 10 client.0 _ll_register_callbacks cb 0x7f020c0f7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x5575561e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x5575561e1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49110/0 (socket says 172.21.15.44:49110) 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555c96890 0x5575561c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 -- 172.21.15.44:0/1042283190 learned_addr learned my addr 172.21.15.44:0/1042283190 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f0213e00640 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 -- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 msgr2=0x5575561c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 -- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555c96890 msgr2=0x5575561c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:42:50.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555c96890 0x5575561c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 -- 172.21.15.44:0/1042283190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557555f770b0 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021aa00640 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555c96890 0x5575561c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021b400640 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x5575561e1ad0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0214001340 tx=0x7f0214015ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf67b402851ab575 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f01ffe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f01ffe00640 1 -- 172.21.15.44:0/1042283190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214019040 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0214015650 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f01ffe00640 1 -- 172.21.15.44:0/1042283190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 6187+0+0 (secure 0 0 0) 0x7f021401e860 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f01ffe00640 1 -- 172.21.15.44:0/1042283190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f021402b050 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 10 client.7260 fetch_fsmap learned FSMap version 69 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x557555f43610 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f01ffe00640 1 -- 172.21.15.44:0/1042283190 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0214015650 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f01ffe00640 1 -- 172.21.15.44:0/1042283190 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f021402e020 con 0x55755603f6d0 2024-09-17T05:42:50.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 10 client.7260 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 10 client.7260 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 20 client.7260 populate_metadata read hostname 'smithi044' 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c3d990 0x557556225740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 4 client.7260 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557555fbb5b0 con 0x557555c3d990 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021aa00640 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c3d990 0x557556225740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f021aa00640 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c3d990 0x557556225740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ed42b033b7add8 server_cookie=7be75cb63553f798 in_seq=0 out_seq=0 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.966+0000 7f01ffe00640 10 client.7260 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f01ffe00640 1 -- 172.21.15.44:0/1042283190 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+864 (crc 0 0 0) 0x557555fbb5b0 con 0x557555c3d990 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f01ffe00640 10 client.7260 handle_command_reply: tid=0 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 client.7260 shutdown 2024-09-17T05:42:50.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 msgr2=0x5575561e1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x5575561e1ad0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0214001340 tx=0x7f0214015ec0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 shutdown_connections 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55755603f6d0 0x5575561e1ad0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x557555d5aaa0 0x5575561c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x557555c3d990 0x557556225740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 --2- 172.21.15.44:0/1042283190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557555c96890 0x5575561c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f01ffe00640 0 client.7260 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 >> 172.21.15.44:0/1042283190 conn(0x557555c6a5c0 msgr2=0x557556160360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 shutdown_connections 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 1 -- 172.21.15.44:0/1042283190 wait complete. 2024-09-17T05:42:50.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f022913b000 20 client.7260 trim_cache size 0 max 16384 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "be621aff-75f0-445e-86a9-c223a488f5e3": { 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "be621aff-75f0-445e-86a9-c223a488f5e3", 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive,repair" 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:42:50.980 INFO:teuthology.orchestra.run.smithi044.stdout: "be621aff-75f0-445e-86a9-c223a488f5e3": { 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:42:50.734950+0000", 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "7cc1a22e-0b43-46bb-a0d6-c18286c24672": { 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:42:18.979472+0000", 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:42:50.981 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:42:50.982 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:42:50.982 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:50.982 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:42:50.982 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f8073200 msgr2=0x7f01f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f8073200 0x7f01f8075710 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02040058d0 tx=0x7f0204005860 comp rx=0 tx=0).stop 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c06de50 msgr2=0x7f021c1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c06de50 0x7f021c1598e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f020c01cc50 tx=0x7f020c005760 comp rx=0 tx=0).stop 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 shutdown_connections 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f01f8073200 0x7f01f8075710 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0ced00 0x7f021c0ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f021c072e50 0x7f021c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 --2- 172.21.15.44:0/2106782536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f021c06de50 0x7f021c1598e0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 >> 172.21.15.44:0/2106782536 conn(0x7f021c0ccaa0 msgr2=0x7f021c154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:42:50.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 shutdown_connections 2024-09-17T05:42:50.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:42:50.970+0000 7f0221a00640 1 -- 172.21.15.44:0/2106782536 wait complete. 2024-09-17T05:42:50.992 INFO:tasks.cephfs.filesystem:scrub status for tag:be621aff-75f0-445e-86a9-c223a488f5e3 - {'path': '/dir', 'tag': 'be621aff-75f0-445e-86a9-c223a488f5e3', 'options': 'recursive,repair'} 2024-09-17T05:43:12.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:43:12.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:43:20.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:20.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T05:43:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 -- 172.21.15.44:0/938438209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f455c004d50 msgr2=0x7f455c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 --2- 172.21.15.44:0/938438209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f455c004d50 0x7f455c005160 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f457000e400 tx=0x7f457001d7d0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f4577e00640 1 -- 172.21.15.44:0/938438209 reap_dead start 2024-09-17T05:43:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 -- 172.21.15.44:0/938438209 shutdown_connections 2024-09-17T05:43:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 -- 172.21.15.44:0/938438209 >> 172.21.15.44:0/938438209 conn(0x7f45780ccaa0 msgr2=0x7f45780cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 -- 172.21.15.44:0/938438209 shutdown_connections 2024-09-17T05:43:21.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 -- 172.21.15.44:0/938438209 wait complete. 2024-09-17T05:43:21.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 Processor -- start 2024-09-17T05:43:21.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.170+0000 7f457e000640 1 -- start start 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f455c004d50 0x7f4578157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45781583f0 0x7f45781f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45780a0d20 0x7f45781e9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4578075180 con 0x7f45780a0d20 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4578075000 con 0x7f45781583f0 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f45780745f0 con 0x7f455c004d50 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45780a0d20 0x7f45781e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45780a0d20 0x7f45781e9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39956/0 (socket says 172.21.15.44:39956) 2024-09-17T05:43:21.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 -- 172.21.15.44:0/963588258 learned_addr learned my addr 172.21.15.44:0/963588258 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 -- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f455c004d50 msgr2=0x7f4578157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f455c004d50 0x7f4578157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 -- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45781583f0 msgr2=0x7f45781f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45781583f0 0x7f45781f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 -- 172.21.15.44:0/963588258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45781581a0 con 0x7f45780a0d20 2024-09-17T05:43:21.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f4577e00640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45780a0d20 0x7f45781e9190 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f45700b1040 tx=0x7f45700a6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f456fe00640 1 -- 172.21.15.44:0/963588258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700bc070 con 0x7f45780a0d20 2024-09-17T05:43:21.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f456fe00640 1 -- 172.21.15.44:0/963588258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45700a66a0 con 0x7f45780a0d20 2024-09-17T05:43:21.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457815bd90 con 0x7f45780a0d20 2024-09-17T05:43:21.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f456fe00640 1 -- 172.21.15.44:0/963588258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700b3040 con 0x7f45780a0d20 2024-09-17T05:43:21.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.174+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f457809d620 con 0x7f45780a0d20 2024-09-17T05:43:21.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.178+0000 7f456fe00640 1 -- 172.21.15.44:0/963588258 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f45700bf070 con 0x7f45780a0d20 2024-09-17T05:43:21.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.178+0000 7f456fe00640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4554073200 0x7f4554075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.178+0000 7f456fe00640 1 -- 172.21.15.44:0/963588258 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7f457012e850 con 0x7f45780a0d20 2024-09-17T05:43:21.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.178+0000 7f45856d9000 1 Processor -- start 2024-09-17T05:43:21.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.178+0000 7f4577400640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4554073200 0x7f4554075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.178+0000 7f45856d9000 1 -- start start 2024-09-17T05:43:21.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.178+0000 7f4577400640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4554073200 0x7f4554075710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4568009b50 tx=0x7f4568009650 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b58de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b58def30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b58df470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5595b577dcd0 con 0x5595b53c9890 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5595b5693330 con 0x5595b548daa0 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5595b56f0bb0 con 0x5595b57726d0 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b58def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b58def30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39966/0 (socket says 172.21.15.44:39966) 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 -- 172.21.15.44:0/3314818693 learned_addr learned my addr 172.21.15.44:0/3314818693 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f4577e00640 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b58df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f4577400640 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b58de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 -- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 msgr2=0x5595b58de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b58de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 -- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 msgr2=0x5595b58df470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b58df470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 -- 172.21.15.44:0/3314818693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b5694c80 con 0x5595b53c9890 2024-09-17T05:43:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f4577400640 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b58de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f456ea00640 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b58def30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f4560006210 tx=0x7f45600066d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3ab2dfa6837722 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f4567400640 1 -- 172.21.15.44:0/3314818693 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560003600 con 0x5595b53c9890 2024-09-17T05:43:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f4567400640 1 -- 172.21.15.44:0/3314818693 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45600038b0 con 0x5595b53c9890 2024-09-17T05:43:21.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f4567400640 1 -- 172.21.15.44:0/3314818693 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4560003d00 con 0x5595b53c9890 2024-09-17T05:43:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- 172.21.15.44:0/3314818693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 msgr2=0x5595b58def30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b58def30 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f4560006210 tx=0x7f45600066d0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- 172.21.15.44:0/3314818693 shutdown_connections 2024-09-17T05:43:21.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b58df470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b58def30 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 --2- 172.21.15.44:0/3314818693 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b58de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- 172.21.15.44:0/3314818693 >> 172.21.15.44:0/3314818693 conn(0x5595b539d5c0 msgr2=0x5595b589bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- 172.21.15.44:0/3314818693 shutdown_connections 2024-09-17T05:43:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- 172.21.15.44:0/3314818693 wait complete. 2024-09-17T05:43:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 -- start start 2024-09-17T05:43:21.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.182+0000 7f45856d9000 1 Processor -- start 2024-09-17T05:43:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b589a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b548daa0 0x5595b589aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b57726d0 0x5595b58a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5595b56e3df0 con 0x5595b53c9890 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5595b56dffe0 con 0x5595b57726d0 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5595b56854d0 con 0x5595b548daa0 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 10 client.0 _ll_register_callbacks cb 0x5595b56637f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b589a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b589a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39970/0 (socket says 172.21.15.44:39970) 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 -- 172.21.15.44:0/2691112013 learned_addr learned my addr 172.21.15.44:0/2691112013 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577e00640 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b57726d0 0x5595b58a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f456ea00640 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b548daa0 0x5595b589aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 -- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b548daa0 msgr2=0x5595b589aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b548daa0 0x5595b589aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 -- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b57726d0 msgr2=0x5595b58a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b57726d0 0x5595b58a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 -- 172.21.15.44:0/2691112013 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b567e210 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f4577400640 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b589a9b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f45680058d0 tx=0x7f45680091e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b208ba7aedf59c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f455be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f455be00640 1 -- 172.21.15.44:0/2691112013 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568005220 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f455be00640 1 -- 172.21.15.44:0/2691112013 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7f45680053c0 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595b5678350 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f455be00640 1 -- 172.21.15.44:0/2691112013 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f4568030050 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 10 client.7272 fetch_fsmap learned FSMap version 69 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x5595b5664fc0 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f455be00640 1 -- 172.21.15.44:0/2691112013 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5595b5678350 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f455be00640 1 -- 172.21.15.44:0/2691112013 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f4568033020 con 0x5595b53c9890 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 10 client.7272 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:43:21.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 10 client.7272 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:43:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 20 client.7272 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5382930 0x5595b58e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 4 client.7272 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:43:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595b56f2b00 con 0x5595b5382930 2024-09-17T05:43:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.186+0000 7f456ea00640 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5382930 0x5595b58e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f456ea00640 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5382930 0x5595b58e5e80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76b539e18d02e1b1 server_cookie=ff48366c3ebd18db in_seq=0 out_seq=0 2024-09-17T05:43:21.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f455be00640 10 client.7272 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f455be00640 1 -- 172.21.15.44:0/2691112013 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595b56f2b00 con 0x5595b5382930 2024-09-17T05:43:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f455be00640 10 client.7272 handle_command_reply: tid=0 2024-09-17T05:43:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 client.7272 shutdown 2024-09-17T05:43:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 msgr2=0x5595b589a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b589a9b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f45680058d0 tx=0x7f45680091e0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 shutdown_connections 2024-09-17T05:43:21.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5382930 0x5595b58e5e80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b57726d0 0x5595b58a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b548daa0 0x5595b589aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 --2- 172.21.15.44:0/2691112013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b589a9b0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f455be00640 0 client.7272 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 >> 172.21.15.44:0/2691112013 conn(0x5595b539d5c0 msgr2=0x5595b5893d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 shutdown_connections 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 1 -- 172.21.15.44:0/2691112013 wait complete. 2024-09-17T05:43:21.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.190+0000 7f45856d9000 20 client.7272 trim_cache size 0 max 16384 2024-09-17T05:43:21.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 Processor -- start 2024-09-17T05:43:21.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- start start 2024-09-17T05:43:21.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5950400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b5950940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b5950e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5595b5899b20 con 0x5595b53c9890 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4578203360 con 0x5595b548daa0 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4578202340 con 0x5595b57726d0 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5950400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5950400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39972/0 (socket says 172.21.15.44:39972) 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 -- 172.21.15.44:0/669391311 learned_addr learned my addr 172.21.15.44:0/669391311 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 -- 172.21.15.44:0/669391311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 msgr2=0x5595b5950e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 --2- 172.21.15.44:0/669391311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b5950e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 -- 172.21.15.44:0/669391311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 msgr2=0x5595b5950940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 --2- 172.21.15.44:0/669391311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b5950940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 -- 172.21.15.44:0/669391311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b573d680 con 0x5595b53c9890 2024-09-17T05:43:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4577400640 1 --2- 172.21.15.44:0/669391311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5950400 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f45680118d0 tx=0x7f4568005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef974ab2acf8b6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4566a00640 1 -- 172.21.15.44:0/669391311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456803a070 con 0x5595b53c9890 2024-09-17T05:43:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4566a00640 1 -- 172.21.15.44:0/669391311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f456801c640 con 0x5595b53c9890 2024-09-17T05:43:21.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f4566a00640 1 -- 172.21.15.44:0/669391311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456801ca90 con 0x5595b53c9890 2024-09-17T05:43:21.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- 172.21.15.44:0/669391311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 msgr2=0x5595b5950400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 --2- 172.21.15.44:0/669391311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5950400 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f45680118d0 tx=0x7f4568005780 comp rx=0 tx=0).stop 2024-09-17T05:43:21.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- 172.21.15.44:0/669391311 shutdown_connections 2024-09-17T05:43:21.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 --2- 172.21.15.44:0/669391311 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b5950e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 --2- 172.21.15.44:0/669391311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b5950940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 --2- 172.21.15.44:0/669391311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5950400 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- 172.21.15.44:0/669391311 >> 172.21.15.44:0/669391311 conn(0x5595b539d5c0 msgr2=0x5595b58f0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- 172.21.15.44:0/669391311 shutdown_connections 2024-09-17T05:43:21.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.210+0000 7f45856d9000 1 -- 172.21.15.44:0/669391311 wait complete. 2024-09-17T05:43:21.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 -- start start 2024-09-17T05:43:21.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 Processor -- start 2024-09-17T05:43:21.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5954650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b5954b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b59550d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4578201cd0 con 0x5595b53c9890 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f45781f9a30 con 0x5595b548daa0 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5595b53a5680 con 0x5595b57726d0 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 10 client.0 _ll_register_callbacks cb 0x7f45680097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5954650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5954650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39978/0 (socket says 172.21.15.44:39978) 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 -- 172.21.15.44:0/3006136746 learned_addr learned my addr 172.21.15.44:0/3006136746 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f456ea00640 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b5954b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577e00640 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b59550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 -- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 msgr2=0x5595b59550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b59550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 -- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 msgr2=0x5595b5954b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b5954b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 -- 172.21.15.44:0/3006136746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b56aa0b0 con 0x5595b53c9890 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f4577400640 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5954650 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x5595b571cfe0 tx=0x7f456801ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92faf81fe9867b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f455be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f455be00640 1 -- 172.21.15.44:0/3006136746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f456803a040 con 0x5595b53c9890 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f456801c640 con 0x5595b53c9890 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f455be00640 1 -- 172.21.15.44:0/3006136746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7f456803f860 con 0x5595b53c9890 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f455be00640 1 -- 172.21.15.44:0/3006136746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7f456804d050 con 0x5595b53c9890 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.214+0000 7f45856d9000 10 client.7278 fetch_fsmap learned FSMap version 69 2024-09-17T05:43:21.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x5595b5676610 con 0x5595b53c9890 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f455be00640 1 -- 172.21.15.44:0/3006136746 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f456801c640 con 0x5595b53c9890 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f455be00640 1 -- 172.21.15.44:0/3006136746 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7f4568050020 con 0x5595b53c9890 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 10 client.7278 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 10 client.7278 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 20 client.7278 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5370990 0x5595b58957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 4 client.7278 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595b56ee5b0 con 0x5595b5370990 2024-09-17T05:43:21.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f456ea00640 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5370990 0x5595b58957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f456ea00640 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5370990 0x5595b58957d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d862a09504b21884 server_cookie=3d6aa8715507879b in_seq=0 out_seq=0 2024-09-17T05:43:21.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f455be00640 10 client.7278 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f455be00640 1 -- 172.21.15.44:0/3006136746 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+664 (crc 0 0 0) 0x5595b56ee5b0 con 0x5595b5370990 2024-09-17T05:43:21.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f455be00640 10 client.7278 handle_command_reply: tid=0 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 client.7278 shutdown 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 msgr2=0x5595b5954650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5954650 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x5595b571cfe0 tx=0x7f456801ced0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 shutdown_connections 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5595b57726d0 0x5595b59550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x5595b5370990 0x5595b58957d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5595b548daa0 0x5595b5954b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f455be00640 0 client.7278 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 --2- 172.21.15.44:0/3006136746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5595b53c9890 0x5595b5954650 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 >> 172.21.15.44:0/3006136746 conn(0x5595b539d5c0 msgr2=0x5595b58a05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 shutdown_connections 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 1 -- 172.21.15.44:0/3006136746 wait complete. 2024-09-17T05:43:21.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f45856d9000 20 client.7278 trim_cache size 0 max 16384 2024-09-17T05:43:21.221 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:43:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:43:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:43:21.221 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "be621aff-75f0-445e-86a9-c223a488f5e3": { 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:42:50.734950+0000", 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:43:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: "7cc1a22e-0b43-46bb-a0d6-c18286c24672": { 2024-09-17T05:43:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:42:18.979472+0000", 2024-09-17T05:43:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:43:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:43:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:43:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:43:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:43:21.223 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:43:21.224 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:43:21.224 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:43:21.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4554073200 msgr2=0x7f4554075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4554073200 0x7f4554075710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4568009b50 tx=0x7f4568009650 comp rx=0 tx=0).stop 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45780a0d20 msgr2=0x7f45781e9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45780a0d20 0x7f45781e9190 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f45700b1040 tx=0x7f45700a6f50 comp rx=0 tx=0).stop 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 shutdown_connections 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f45780a0d20 0x7f45781e9190 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4554073200 0x7f4554075710 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45781583f0 0x7f45781f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 --2- 172.21.15.44:0/963588258 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f455c004d50 0x7f4578157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 >> 172.21.15.44:0/963588258 conn(0x7f45780ccaa0 msgr2=0x7f45780b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 shutdown_connections 2024-09-17T05:43:21.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.218+0000 7f457e000640 1 -- 172.21.15.44:0/963588258 wait complete. 2024-09-17T05:43:21.237 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:43:21.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:21.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.398+0000 7f9579c00640 1 -- 172.21.15.44:0/1053928279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95740cf7d0 msgr2=0x7f9574072c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.398+0000 7f9579c00640 1 --2- 172.21.15.44:0/1053928279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95740cf7d0 0x7f9574072c10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f956c009bc0 tx=0x7f956c01cb10 comp rx=0 tx=0).stop 2024-09-17T05:43:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.398+0000 7f9579c00640 1 -- 172.21.15.44:0/1053928279 shutdown_connections 2024-09-17T05:43:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.398+0000 7f9579c00640 1 --2- 172.21.15.44:0/1053928279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95740cf7d0 0x7f9574072c10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.398+0000 7f9579c00640 1 -- 172.21.15.44:0/1053928279 >> 172.21.15.44:0/1053928279 conn(0x7f957406ce40 msgr2=0x7f957406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.398+0000 7f9579c00640 1 -- 172.21.15.44:0/1053928279 shutdown_connections 2024-09-17T05:43:21.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.398+0000 7f9579c00640 1 -- 172.21.15.44:0/1053928279 wait complete. 2024-09-17T05:43:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 Processor -- start 2024-09-17T05:43:21.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 -- start start 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95740ce940 0x7f957413e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95741523f0 0x7f957415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957415ae30 0x7f957415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f957416a210 con 0x7f95740ce940 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f957416a090 con 0x7f95741523f0 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f957416a390 con 0x7f957415ae30 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95740ce940 0x7f957413e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95740ce940 0x7f957413e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39982/0 (socket says 172.21.15.44:39982) 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 -- 172.21.15.44:0/2819734569 learned_addr learned my addr 172.21.15.44:0/2819734569 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f956be00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95741523f0 0x7f957415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579200640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957415ae30 0x7f957415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 -- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957415ae30 msgr2=0x7f957415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957415ae30 0x7f957415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 -- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95741523f0 msgr2=0x7f957415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95741523f0 0x7f957415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 -- 172.21.15.44:0/2819734569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957415b510 con 0x7f95740ce940 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9573e00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95740ce940 0x7f957413e700 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f956400c460 tx=0x7f956400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9570c00640 1 -- 172.21.15.44:0/2819734569 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95640052d0 con 0x7f95740ce940 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9570c00640 1 -- 172.21.15.44:0/2819734569 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9564005470 con 0x7f95740ce940 2024-09-17T05:43:21.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957415b7f0 con 0x7f95740ce940 2024-09-17T05:43:21.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.402+0000 7f9570c00640 1 -- 172.21.15.44:0/2819734569 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564012870 con 0x7f95740ce940 2024-09-17T05:43:21.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.406+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957415bdb0 con 0x7f95740ce940 2024-09-17T05:43:21.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.406+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9574072c10 con 0x7f95740ce940 2024-09-17T05:43:21.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.406+0000 7f9570c00640 1 -- 172.21.15.44:0/2819734569 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9564003600 con 0x7f95740ce940 2024-09-17T05:43:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.406+0000 7f9570c00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9550073230 0x7f9550075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.406+0000 7f9570c00640 1 -- 172.21.15.44:0/2819734569 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7f9564093e30 con 0x7f95740ce940 2024-09-17T05:43:21.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.406+0000 7f956be00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9550073230 0x7f9550075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.410+0000 7f956be00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9550073230 0x7f9550075740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f957413f3e0 tx=0x7f955c007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.410+0000 7f9570c00640 1 -- 172.21.15.44:0/2819734569 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f956405e580 con 0x7f95740ce940 2024-09-17T05:43:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.622+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9574070900 con 0x7f95740ce940 2024-09-17T05:43:21.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.622+0000 7f9570c00640 1 -- 172.21.15.44:0/2819734569 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5223 (secure 0 0 0) 0x7f9564062fb0 con 0x7f95740ce940 2024-09-17T05:43:21.622 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:43:21.622 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":69,"btime":"2024-09-17T05:42:22:716908+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:22.683080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7071},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7071":{"gid":7071,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6835/3231247769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3231247769},{"type":"v1","addr":"172.21.15.44:6835","nonce":3231247769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7071,"qdb_cluster":[7071]},"id":6}]} 2024-09-17T05:43:21.622 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 69 2024-09-17T05:43:21.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9550073230 msgr2=0x7f9550075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9550073230 0x7f9550075740 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f957413f3e0 tx=0x7f955c007cd0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95740ce940 msgr2=0x7f957413e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95740ce940 0x7f957413e700 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f956400c460 tx=0x7f956400c920 comp rx=0 tx=0).stop 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 shutdown_connections 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f957415ae30 0x7f957415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9550073230 0x7f9550075740 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95741523f0 0x7f957415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 --2- 172.21.15.44:0/2819734569 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95740ce940 0x7f957413e700 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 >> 172.21.15.44:0/2819734569 conn(0x7f957406ce40 msgr2=0x7f957406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 shutdown_connections 2024-09-17T05:43:21.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.626+0000 7f9579c00640 1 -- 172.21.15.44:0/2819734569 wait complete. 2024-09-17T05:43:21.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-09-17T05:43:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.806+0000 7fe4b9600640 1 -- 172.21.15.44:0/1010005881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 msgr2=0x7fe4b40cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.806+0000 7fe4b9600640 1 --2- 172.21.15.44:0/1010005881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 0x7fe4b40cec50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009870 tx=0x7fe49c01c780 comp rx=0 tx=0).stop 2024-09-17T05:43:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.806+0000 7fe4b9600640 1 -- 172.21.15.44:0/1010005881 shutdown_connections 2024-09-17T05:43:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.806+0000 7fe4b9600640 1 --2- 172.21.15.44:0/1010005881 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 0x7fe4b40cec50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.806+0000 7fe4b9600640 1 -- 172.21.15.44:0/1010005881 >> 172.21.15.44:0/1010005881 conn(0x7fe4b40ccaa0 msgr2=0x7fe4b40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.806+0000 7fe4b9600640 1 -- 172.21.15.44:0/1010005881 shutdown_connections 2024-09-17T05:43:21.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.806+0000 7fe4b9600640 1 -- 172.21.15.44:0/1010005881 wait complete. 2024-09-17T05:43:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 Processor -- start 2024-09-17T05:43:21.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 -- start start 2024-09-17T05:43:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 0x7fe4b40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b40cb040 0x7fe4b406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b415be30 0x7fe4b4070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b416a250 con 0x7fe4b415be30 2024-09-17T05:43:21.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b416a0d0 con 0x7fe4b40cb040 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b9600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b416a3d0 con 0x7fe4b40cac30 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b415be30 0x7fe4b4070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b415be30 0x7fe4b4070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39996/0 (socket says 172.21.15.44:39996) 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.810+0000 7fe4b3400640 1 -- 172.21.15.44:0/3957052445 learned_addr learned my addr 172.21.15.44:0/3957052445 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 0x7fe4b40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4aa000640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b40cb040 0x7fe4b406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b3400640 1 -- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 msgr2=0x7fe4b40c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b3400640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 0x7fe4b40c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b3400640 1 -- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b40cb040 msgr2=0x7fe4b406fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b3400640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b40cb040 0x7fe4b406fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b3400640 1 -- 172.21.15.44:0/3957052445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b415c3f0 con 0x7fe4b415be30 2024-09-17T05:43:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b3400640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b415be30 0x7fe4b4070260 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00cbc0 tx=0x7fe4ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4ab400640 1 -- 172.21.15.44:0/3957052445 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac016020 con 0x7fe4b415be30 2024-09-17T05:43:21.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4ab400640 1 -- 172.21.15.44:0/3957052445 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4ac00ab40 con 0x7fe4b415be30 2024-09-17T05:43:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4ab400640 1 -- 172.21.15.44:0/3957052445 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac012420 con 0x7fe4b415be30 2024-09-17T05:43:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b41f97e0 con 0x7fe4b415be30 2024-09-17T05:43:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b41f9da0 con 0x7fe4b415be30 2024-09-17T05:43:21.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.814+0000 7fe4ab400640 1 -- 172.21.15.44:0/3957052445 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe4ac019020 con 0x7fe4b415be30 2024-09-17T05:43:21.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4ab400640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe490073230 0x7fe490075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4ab400640 1 -- 172.21.15.44:0/3957052445 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7fe4ac094880 con 0x7fe4b415be30 2024-09-17T05:43:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 Processor -- start 2024-09-17T05:43:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe490073230 0x7fe490075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 -- start start 2024-09-17T05:43:21.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe490073230 0x7fe490075740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4001130 tx=0x7fe4a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b63b60 0x55c907ca92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907ca9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b42d90 0x55c907ca9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c907b47d00 con 0x55c907b42d90 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c907abbc90 con 0x55c907b63b60 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55c907aab0c0 con 0x55c907b591c0 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b42d90 0x55c907ca9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b42d90 0x55c907ca9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40008/0 (socket says 172.21.15.44:40008) 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 -- 172.21.15.44:0/1561167853 learned_addr learned my addr 172.21.15.44:0/1561167853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4aa000640 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907ca9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b63b60 0x55c907ca92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 -- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 msgr2=0x55c907ca9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907ca9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 -- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b63b60 msgr2=0x55c907ca92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b63b60 0x55c907ca92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 -- 172.21.15.44:0/1561167853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c907a86290 con 0x55c907b42d90 2024-09-17T05:43:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4aa000640 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907ca9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4b3400640 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b42d90 0x55c907ca9d60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00cb90 tx=0x7fe4ac05e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcfa7e340f10707 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4a3000640 1 -- 172.21.15.44:0/1561167853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac079070 con 0x55c907b42d90 2024-09-17T05:43:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4a3000640 1 -- 172.21.15.44:0/1561167853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4ac063950 con 0x55c907b42d90 2024-09-17T05:43:21.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.818+0000 7fe4a3000640 1 -- 172.21.15.44:0/1561167853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac084020 con 0x55c907b42d90 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1561167853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b42d90 msgr2=0x55c907ca9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b42d90 0x55c907ca9d60 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00cb90 tx=0x7fe4ac05e980 comp rx=0 tx=0).stop 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1561167853 shutdown_connections 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b42d90 0x55c907ca9d60 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907ca9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1561167853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b63b60 0x55c907ca92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1561167853 >> 172.21.15.44:0/1561167853 conn(0x55c907768760 msgr2=0x55c907c8c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1561167853 shutdown_connections 2024-09-17T05:43:21.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1561167853 wait complete. 2024-09-17T05:43:21.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- start start 2024-09-17T05:43:21.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 Processor -- start 2024-09-17T05:43:21.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907c650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907c65610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907c8b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c907a45940 con 0x55c907b63b60 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c907aaeed0 con 0x55c907b42d90 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55c907770820 con 0x55c907b591c0 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4c0b91000 10 client.0 _ll_register_callbacks cb 0x55c907a897f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907c8b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907c8b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40016/0 (socket says 172.21.15.44:40016) 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 -- 172.21.15.44:0/2791250517 learned_addr learned my addr 172.21.15.44:0/2791250517 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b2a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907c650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4aa000640 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907c65610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 -- 172.21.15.44:0/2791250517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 msgr2=0x55c907c65610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907c65610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 -- 172.21.15.44:0/2791250517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 msgr2=0x55c907c650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907c650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.822+0000 7fe4b3400640 1 -- 172.21.15.44:0/2791250517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c907a5e550 con 0x55c907b63b60 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4b3400640 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907c8b8d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac05eb70 tx=0x7fe4ac05b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9bc45a508286a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 1 -- 172.21.15.44:0/2791250517 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac084040 con 0x55c907b63b60 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 1 -- 172.21.15.44:0/2791250517 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7fe4ac068ae0 con 0x55c907b63b60 2024-09-17T05:43:21.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c907a43400 con 0x55c907b63b60 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 1 -- 172.21.15.44:0/2791250517 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fe4ac06f050 con 0x55c907b63b60 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 10 client.7296 fetch_fsmap learned FSMap version 69 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55c907a49480 con 0x55c907b63b60 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 1 -- 172.21.15.44:0/2791250517 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55c907a43400 con 0x55c907b63b60 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 1 -- 172.21.15.44:0/2791250517 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7fe4ac072020 con 0x55c907b63b60 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 10 client.7296 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 10 client.7296 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 20 client.7296 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90774dad0 0x55c907cba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 4 client.7296 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:43:21.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c907abdbe0 con 0x55c90774dad0 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90774dad0 0x55c907cba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90774dad0 0x55c907cba8a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722b4ddf295f5cd0 server_cookie=778dce329f8334f9 in_seq=0 out_seq=0 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 10 client.7296 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 1 -- 172.21.15.44:0/2791250517 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c907abdbe0 con 0x55c90774dad0 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 10 client.7296 handle_command_reply: tid=0 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 client.7296 shutdown 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 msgr2=0x55c907c8b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907c8b8d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac05eb70 tx=0x7fe4ac05b390 comp rx=0 tx=0).stop 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 shutdown_connections 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907c8b8d0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907c65610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90774dad0 0x55c907cba8a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/2791250517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907c650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 >> 172.21.15.44:0/2791250517 conn(0x55c907768760 msgr2=0x55c907c5d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe497400640 0 client.7296 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 shutdown_connections 2024-09-17T05:43:21.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 1 -- 172.21.15.44:0/2791250517 wait complete. 2024-09-17T05:43:21.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.826+0000 7fe4c0b91000 20 client.7296 trim_cache size 0 max 16384 2024-09-17T05:43:21.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 Processor -- start 2024-09-17T05:43:21.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 -- start start 2024-09-17T05:43:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c907770820 con 0x55c907b63b60 2024-09-17T05:43:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c907b6afc0 con 0x55c907b42d90 2024-09-17T05:43:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55c907abaa60 con 0x55c907b591c0 2024-09-17T05:43:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40028/0 (socket says 172.21.15.44:40028) 2024-09-17T05:43:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 -- 172.21.15.44:0/3165760768 learned_addr learned my addr 172.21.15.44:0/3165760768 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4aa000640 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 -- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 msgr2=0x55c907d1b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 -- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 msgr2=0x55c907d1ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b3400640 1 -- 172.21.15.44:0/3165760768 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c907b30d10 con 0x55c907b63b60 2024-09-17T05:43:21.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.842+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4b3400640 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1b880 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac001e10 tx=0x7fe4ac05b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a3036ed5e2df16 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4a2600640 1 -- 172.21.15.44:0/3165760768 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac084040 con 0x55c907b63b60 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4a2600640 1 -- 172.21.15.44:0/3165760768 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4ac07f070 con 0x55c907b63b60 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4a2600640 1 -- 172.21.15.44:0/3165760768 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac079040 con 0x55c907b63b60 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- 172.21.15.44:0/3165760768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 msgr2=0x55c907d1b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1b880 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac001e10 tx=0x7fe4ac05b540 comp rx=0 tx=0).stop 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- 172.21.15.44:0/3165760768 shutdown_connections 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1b880 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/3165760768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- 172.21.15.44:0/3165760768 >> 172.21.15.44:0/3165760768 conn(0x55c907768760 msgr2=0x55c907c5f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- 172.21.15.44:0/3165760768 shutdown_connections 2024-09-17T05:43:21.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- 172.21.15.44:0/3165760768 wait complete. 2024-09-17T05:43:21.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- start start 2024-09-17T05:43:21.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 Processor -- start 2024-09-17T05:43:21.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c907a77300 con 0x55c907b63b60 2024-09-17T05:43:21.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c907a68670 con 0x55c907b42d90 2024-09-17T05:43:21.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55c907aae1e0 con 0x55c907b591c0 2024-09-17T05:43:21.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.846+0000 7fe4c0b91000 10 client.0 _ll_register_callbacks cb 0x7fe4ac077070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:21.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40032/0 (socket says 172.21.15.44:40032) 2024-09-17T05:43:21.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 -- 172.21.15.44:0/1686584900 learned_addr learned my addr 172.21.15.44:0/1686584900 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4aa000640 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 -- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 msgr2=0x55c907d1ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 -- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 msgr2=0x55c907d1e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:21.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 -- 172.21.15.44:0/1686584900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c907a61e50 con 0x55c907b63b60 2024-09-17T05:43:21.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b3400640 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1f290 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac092a80 tx=0x7fe4ac05ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa70a38fe844b3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:21.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:21.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 1 -- 172.21.15.44:0/1686584900 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac084050 con 0x55c907b63b60 2024-09-17T05:43:21.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 1 -- 172.21.15.44:0/1686584900 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7fe4ac05dd50 con 0x55c907b63b60 2024-09-17T05:43:21.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4ac07f070 con 0x55c907b63b60 2024-09-17T05:43:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 1 -- 172.21.15.44:0/1686584900 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7fe4ac079040 con 0x55c907b63b60 2024-09-17T05:43:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 10 client.7302 fetch_fsmap learned FSMap version 69 2024-09-17T05:43:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x55c907a502d0 con 0x55c907b63b60 2024-09-17T05:43:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 1 -- 172.21.15.44:0/1686584900 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4ac07f070 con 0x55c907b63b60 2024-09-17T05:43:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 1 -- 172.21.15.44:0/1686584900 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7fe4ac072040 con 0x55c907b63b60 2024-09-17T05:43:21.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 10 client.7302 fetch_fsmap finished waiting for FSMap version 69 2024-09-17T05:43:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 10 client.7302 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:43:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 20 client.7302 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90773bb30 0x55c907cbd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 4 client.7302 mds_command: new command op to 7071 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-17T05:43:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 --> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55c907ab9690 con 0x55c90773bb30 2024-09-17T05:43:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90773bb30 0x55c907cbd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:21.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b2a00640 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90773bb30 0x55c907cbd350 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5ed15ed88c43aaa server_cookie=fff84fbb8e98190b in_seq=0 out_seq=0 2024-09-17T05:43:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 10 client.7302 ms_handle_connect on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 1 -- 172.21.15.44:0/1686584900 <== mds.0 v2:172.21.15.44:6833/3231247769 1 ==== command_reply(tid 0: 0 ) ==== 8+0+143 (crc 0 0 0) 0x55c907ab9690 con 0x55c90773bb30 2024-09-17T05:43:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 10 client.7302 handle_command_reply: tid=0 2024-09-17T05:43:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 client.7302 shutdown 2024-09-17T05:43:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 msgr2=0x55c907d1f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1f290 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac092a80 tx=0x7fe4ac05ac70 comp rx=0 tx=0).stop 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 shutdown_connections 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c907b63b60 0x55c907d1f290 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55c907b591c0 0x55c907d1ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.44:6833/3231247769,v1:172.21.15.44:6835/3231247769] conn(0x55c90773bb30 0x55c907cbd350 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 --2- 172.21.15.44:0/1686584900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c907b42d90 0x55c907d1e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 >> 172.21.15.44:0/1686584900 conn(0x55c907768760 msgr2=0x55c907c64600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe497400640 0 client.7302 ms_handle_reset on v2:172.21.15.44:6833/3231247769 2024-09-17T05:43:21.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 shutdown_connections 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 1 -- 172.21.15.44:0/1686584900 wait complete. 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4c0b91000 20 client.7302 trim_cache size 0 max 16384 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_type": "backtrace", 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 102619091, 2024-09-17T05:43:21.863 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627777, 2024-09-17T05:43:21.864 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/testdir/hardlink" 2024-09-17T05:43:21.864 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:43:21.864 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:43:21.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe490073230 msgr2=0x7fe490075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b9600640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe490073230 0x7fe490075740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4001130 tx=0x7fe4a4009040 comp rx=0 tx=0).stop 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b415be30 msgr2=0x7fe4b4070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.850+0000 7fe4b9600640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b415be30 0x7fe4b4070260 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00cbc0 tx=0x7fe4ac00ccb0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 shutdown_connections 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4b415be30 0x7fe4b4070260 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe490073230 0x7fe490075740 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4b40cb040 0x7fe4b406fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 --2- 172.21.15.44:0/3957052445 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4b40cac30 0x7fe4b40c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 >> 172.21.15.44:0/3957052445 conn(0x7fe4b40ccaa0 msgr2=0x7fe4b415a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:21.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 shutdown_connections 2024-09-17T05:43:21.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:21.854+0000 7fe4b9600640 1 -- 172.21.15.44:0/3957052445 wait complete. 2024-09-17T05:43:21.870 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:43:21.870 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:21.879 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:43:21.879 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:21.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 -- 172.21.15.44:0/1508296332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 msgr2=0x7f5c1815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 --2- 172.21.15.44:0/1508296332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 0x7f5c1815e990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009840 tx=0x7f5c0801c790 comp rx=0 tx=0).stop 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 -- 172.21.15.44:0/1508296332 shutdown_connections 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 --2- 172.21.15.44:0/1508296332 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1806de50 0x7f5c1806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 --2- 172.21.15.44:0/1508296332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 0x7f5c1815e990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 -- 172.21.15.44:0/1508296332 >> 172.21.15.44:0/1508296332 conn(0x7f5c180ccaa0 msgr2=0x7f5c180cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 -- 172.21.15.44:0/1508296332 shutdown_connections 2024-09-17T05:43:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.142+0000 7f5c1f200640 1 -- 172.21.15.44:0/1508296332 wait complete. 2024-09-17T05:43:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 Processor -- start 2024-09-17T05:43:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 -- start start 2024-09-17T05:43:22.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1806de50 0x7f5c180c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 0x7f5c180c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c180ced00 0x7f5c180c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181694b0 con 0x7f5c180ced00 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18169330 con 0x7f5c18072e50 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1f200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5c18169630 con 0x7f5c1806de50 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1d200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c180ced00 0x7f5c180c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1d200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c180ced00 0x7f5c180c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40048/0 (socket says 172.21.15.44:40048) 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.146+0000 7f5c1d200640 1 -- 172.21.15.44:0/2948097499 learned_addr learned my addr 172.21.15.44:0/2948097499 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c17e00640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1806de50 0x7f5c180c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c0fe00640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 0x7f5c180c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1d200640 1 -- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1806de50 msgr2=0x7f5c180c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1d200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1806de50 0x7f5c180c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1d200640 1 -- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 msgr2=0x7f5c180c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1d200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 0x7f5c180c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1d200640 1 -- 172.21.15.44:0/2948097499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c180c7b80 con 0x7f5c180ced00 2024-09-17T05:43:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1d200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c180ced00 0x7f5c180c8e90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f5c10010ee0 tx=0x7f5c1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c14c00640 1 -- 172.21.15.44:0/2948097499 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1001d070 con 0x7f5c180ced00 2024-09-17T05:43:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c14c00640 1 -- 172.21.15.44:0/2948097499 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c1000ab60 con 0x7f5c180ced00 2024-09-17T05:43:22.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c14c00640 1 -- 172.21.15.44:0/2948097499 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10018410 con 0x7f5c180ced00 2024-09-17T05:43:22.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c180c7e60 con 0x7f5c180ced00 2024-09-17T05:43:22.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c181569a0 con 0x7f5c180ced00 2024-09-17T05:43:22.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.150+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1806e260 con 0x7f5c180ced00 2024-09-17T05:43:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.154+0000 7f5c14c00640 1 -- 172.21.15.44:0/2948097499 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5c10020070 con 0x7f5c180ced00 2024-09-17T05:43:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.154+0000 7f5c14c00640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5bf4073230 0x7f5bf4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.154+0000 7f5c14c00640 1 -- 172.21.15.44:0/2948097499 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7f5c10097ca0 con 0x7f5c180ced00 2024-09-17T05:43:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.154+0000 7f5c17e00640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5bf4073230 0x7f5bf4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.154+0000 7f5c17e00640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5bf4073230 0x7f5bf4075740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5c080af000 tx=0x7f5c0801afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.158+0000 7f5c14c00640 1 -- 172.21.15.44:0/2948097499 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f5c1806e7a0 con 0x7f5c180ced00 2024-09-17T05:43:22.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.346+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c180b5fa0 con 0x7f5c180ced00 2024-09-17T05:43:22.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.346+0000 7f5c14c00640 1 -- 172.21.15.44:0/2948097499 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v93) ==== 80+0+122 (secure 0 0 0) 0x7f5c100623c0 con 0x7f5c180ced00 2024-09-17T05:43:22.345 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3305866275 2024-09-18T05:42:11.653403+0000 2024-09-17T05:43:22.346 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/3305866275 2024-09-18T05:42:11.653403+0000 2024-09-17T05:43:22.346 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-17T05:43:22.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5bf4073230 msgr2=0x7f5bf4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5bf4073230 0x7f5bf4075740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5c080af000 tx=0x7f5c0801afd0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c180ced00 msgr2=0x7f5c180c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c180ced00 0x7f5c180c8e90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f5c10010ee0 tx=0x7f5c1000a060 comp rx=0 tx=0).stop 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 shutdown_connections 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c180ced00 0x7f5c180c8e90 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5bf4073230 0x7f5bf4075740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c18072e50 0x7f5c180c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 --2- 172.21.15.44:0/2948097499 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5c1806de50 0x7f5c180c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 >> 172.21.15.44:0/2948097499 conn(0x7f5c180ccaa0 msgr2=0x7f5c18155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 shutdown_connections 2024-09-17T05:43:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.350+0000 7f5c1f200640 1 -- 172.21.15.44:0/2948097499 wait complete. 2024-09-17T05:43:22.367 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:43:22.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:22.368 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:43:22.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:43:22.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:22.395 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:43:22.452 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 -- 172.21.15.44:0/720354723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 msgr2=0x7f79340cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 --2- 172.21.15.44:0/720354723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f79340cb880 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f792c009bc0 tx=0x7f792c01cb10 comp rx=0 tx=0).stop 2024-09-17T05:43:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 -- 172.21.15.44:0/720354723 shutdown_connections 2024-09-17T05:43:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 --2- 172.21.15.44:0/720354723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f79340cb880 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 --2- 172.21.15.44:0/720354723 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7934072e50 0x7f793415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 -- 172.21.15.44:0/720354723 >> 172.21.15.44:0/720354723 conn(0x7f79340ccaa0 msgr2=0x7f79340cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 -- 172.21.15.44:0/720354723 shutdown_connections 2024-09-17T05:43:22.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.658+0000 7f793a800640 1 -- 172.21.15.44:0/720354723 wait complete. 2024-09-17T05:43:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 Processor -- start 2024-09-17T05:43:22.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 -- start start 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f793406de50 0x7f7934165d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7934072e50 0x7f79341fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f793409fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7934168fc0 con 0x7f79340cb470 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7934168e40 con 0x7f793406de50 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7934169140 con 0x7f7934072e50 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f793409fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f793409fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40074/0 (socket says 172.21.15.44:40074) 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 -- 172.21.15.44:0/2171924804 learned_addr learned my addr 172.21.15.44:0/2171924804 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933400640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f793406de50 0x7f7934165d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f792aa00640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7934072e50 0x7f79341fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 -- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7934072e50 msgr2=0x7f79341fc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7934072e50 0x7f79341fc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 -- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f793406de50 msgr2=0x7f7934165d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f793406de50 0x7f7934165d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 -- 172.21.15.44:0/2171924804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7934166240 con 0x7f79340cb470 2024-09-17T05:43:22.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f792aa00640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7934072e50 0x7f79341fc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:22.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f7933e00640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f793409fc10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f792c009b10 tx=0x7f792c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f792be00640 1 -- 172.21.15.44:0/2171924804 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c0bb070 con 0x7f79340cb470 2024-09-17T05:43:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f792be00640 1 -- 172.21.15.44:0/2171924804 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f792c004d40 con 0x7f79340cb470 2024-09-17T05:43:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79341fd4c0 con 0x7f79340cb470 2024-09-17T05:43:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f792be00640 1 -- 172.21.15.44:0/2171924804 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c0b2040 con 0x7f79340cb470 2024-09-17T05:43:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.662+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341f9770 con 0x7f79340cb470 2024-09-17T05:43:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.666+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79341fd230 con 0x7f79340cb470 2024-09-17T05:43:22.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.666+0000 7f792be00640 1 -- 172.21.15.44:0/2171924804 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f792c0be070 con 0x7f79340cb470 2024-09-17T05:43:22.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.666+0000 7f792be00640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7910073230 0x7f7910075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:22.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.666+0000 7f792be00640 1 -- 172.21.15.44:0/2171924804 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7f792c12dfe0 con 0x7f79340cb470 2024-09-17T05:43:22.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.666+0000 7f7933400640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7910073230 0x7f7910075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:22.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.670+0000 7f7933400640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7910073230 0x7f7910075740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7924009ad0 tx=0x7f79240091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:22.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.670+0000 7f792be00640 1 -- 172.21.15.44:0/2171924804 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f792c016790 con 0x7f79340cb470 2024-09-17T05:43:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.882+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79340cb880 con 0x7f79340cb470 2024-09-17T05:43:22.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.882+0000 7f792be00640 1 -- 172.21.15.44:0/2171924804 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5223 (secure 0 0 0) 0x7f792c0f8cf0 con 0x7f79340cb470 2024-09-17T05:43:22.882 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:43:22.883 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":69,"btime":"2024-09-17T05:42:22:716908+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:42:22.683080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7071},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7071":{"gid":7071,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.44:6835/3231247769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3231247769},{"type":"v1","addr":"172.21.15.44:6835","nonce":3231247769}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7071,"qdb_cluster":[7071]},"id":6}]} 2024-09-17T05:43:22.883 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 69 2024-09-17T05:43:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7910073230 msgr2=0x7f7910075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7910073230 0x7f7910075740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7924009ad0 tx=0x7f79240091e0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 msgr2=0x7f793409fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f793409fc10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f792c009b10 tx=0x7f792c003f60 comp rx=0 tx=0).stop 2024-09-17T05:43:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 shutdown_connections 2024-09-17T05:43:22.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79340cb470 0x7f793409fc10 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7934072e50 0x7f79341fc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7910073230 0x7f7910075740 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 --2- 172.21.15.44:0/2171924804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f793406de50 0x7f7934165d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 >> 172.21.15.44:0/2171924804 conn(0x7f79340ccaa0 msgr2=0x7f7934154230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 shutdown_connections 2024-09-17T05:43:22.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:22.886+0000 7f793a800640 1 -- 172.21.15.44:0/2171924804 wait complete. 2024-09-17T05:43:22.905 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-17T05:43:23.092 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:43:23.093 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:43:23.093 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:43:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.254+0000 7f004e600640 1 -- 172.21.15.44:0/1508782703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f002c003c40 msgr2=0x7f002c004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.254+0000 7f004e600640 1 --2- 172.21.15.44:0/1508782703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f002c003c40 0x7f002c004090 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0038001860 tx=0x7f003801c880 comp rx=0 tx=0).stop 2024-09-17T05:43:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.254+0000 7f004e600640 1 -- 172.21.15.44:0/1508782703 shutdown_connections 2024-09-17T05:43:23.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.254+0000 7f004e600640 1 --2- 172.21.15.44:0/1508782703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f002c003c40 0x7f002c004090 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.254+0000 7f004e600640 1 -- 172.21.15.44:0/1508782703 >> 172.21.15.44:0/1508782703 conn(0x7f00480ccaa0 msgr2=0x7f00480cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.254+0000 7f004e600640 1 -- 172.21.15.44:0/1508782703 shutdown_connections 2024-09-17T05:43:23.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.254+0000 7f004e600640 1 -- 172.21.15.44:0/1508782703 wait complete. 2024-09-17T05:43:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 Processor -- start 2024-09-17T05:43:23.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 -- start start 2024-09-17T05:43:23.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f002c003c40 0x7f00481fb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00481f7db0 0x7f00480c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f004809c120 0x7f004809c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f00480cc090 con 0x7f004809c120 2024-09-17T05:43:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00480cbf10 con 0x7f00481f7db0 2024-09-17T05:43:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f00480cc210 con 0x7f002c003c40 2024-09-17T05:43:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f004809c120 0x7f004809c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f004809c120 0x7f004809c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40104/0 (socket says 172.21.15.44:40104) 2024-09-17T05:43:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 -- 172.21.15.44:0/3339477481 learned_addr learned my addr 172.21.15.44:0/3339477481 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047400640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f002c003c40 0x7f00481fb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f003fe00640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00481f7db0 0x7f00480c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 -- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f002c003c40 msgr2=0x7f00481fb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f002c003c40 0x7f00481fb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 -- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00481f7db0 msgr2=0x7f00480c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00481f7db0 0x7f00480c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 -- 172.21.15.44:0/3339477481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00481fb670 con 0x7f004809c120 2024-09-17T05:43:23.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f0047e00640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f004809c120 0x7f004809c530 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f00480c38f0 tx=0x7f0040010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f003f400640 1 -- 172.21.15.44:0/3339477481 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040017070 con 0x7f004809c120 2024-09-17T05:43:23.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f003f400640 1 -- 172.21.15.44:0/3339477481 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0040015070 con 0x7f004809c120 2024-09-17T05:43:23.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f003f400640 1 -- 172.21.15.44:0/3339477481 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004000eb20 con 0x7f004809c120 2024-09-17T05:43:23.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004809ca70 con 0x7f004809c120 2024-09-17T05:43:23.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.258+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0048159040 con 0x7f004809c120 2024-09-17T05:43:23.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.262+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00480ceff0 con 0x7f004809c120 2024-09-17T05:43:23.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.262+0000 7f003f400640 1 -- 172.21.15.44:0/3339477481 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f004000ecc0 con 0x7f004809c120 2024-09-17T05:43:23.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.262+0000 7f003f400640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0024073230 0x7f0024075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.262+0000 7f003f400640 1 -- 172.21.15.44:0/3339477481 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 6361+0+0 (secure 0 0 0) 0x7f0040094ce0 con 0x7f004809c120 2024-09-17T05:43:23.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.262+0000 7f0047400640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0024073230 0x7f0024075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.266+0000 7f0047400640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0024073230 0x7f0024075740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0038001830 tx=0x7f00380196c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.266+0000 7f003f400640 1 -- 172.21.15.44:0/3339477481 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f004809ca70 con 0x7f004809c120 2024-09-17T05:43:23.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.474+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0048159270 con 0x7f004809c120 2024-09-17T05:43:23.475 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:43:23.478+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:43:23.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.478+0000 7f003f400640 1 -- 172.21.15.44:0/3339477481 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7f00481fb670 con 0x7f004809c120 2024-09-17T05:43:23.478 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0024073230 msgr2=0x7f0024075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0024073230 0x7f0024075740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0038001830 tx=0x7f00380196c0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f004809c120 msgr2=0x7f004809c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f004809c120 0x7f004809c530 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f00480c38f0 tx=0x7f0040010e50 comp rx=0 tx=0).stop 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 shutdown_connections 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f004809c120 0x7f004809c530 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0024073230 0x7f0024075740 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f00481f7db0 0x7f00480c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 --2- 172.21.15.44:0/3339477481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f002c003c40 0x7f00481fb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 >> 172.21.15.44:0/3339477481 conn(0x7f00480ccaa0 msgr2=0x7f00480cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 shutdown_connections 2024-09-17T05:43:23.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.482+0000 7f004e600640 1 -- 172.21.15.44:0/3339477481 wait complete. 2024-09-17T05:43:23.492 INFO:tasks.ceph.mds.a.smithi044.stderr: -4637> 2024-09-17T05:42:18.667+0000 7f3837e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:43:23.492 INFO:tasks.ceph.mds.a.smithi044.stderr: -4433> 2024-09-17T05:42:18.723+0000 7f3832e00640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-09-17T05:43:23.493 INFO:tasks.ceph.mds.a.smithi044.stderr: -4245> 2024-09-17T05:42:18.979+0000 7f3832e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0) n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5585de78bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-09-17T05:43:23.496 INFO:tasks.ceph.mds.a.smithi044.stderr: -2299> 2024-09-17T05:42:50.734+0000 7f3832e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0)->f(v1 m2024-09-17T05:42:09.787593+0000) n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1)->n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5585de78bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-09-17T05:42:09.787593+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-17T05:42:09.891592+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-09-17T05:43:23.502 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-09-17T05:43:23.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 -- start start 2024-09-17T05:43:23.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 Processor -- start 2024-09-17T05:43:23.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc1680 0x55a24ed22580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc1b00 0x55a24ed22000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc1f80 0x55a24ed22b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a24ed3a180 con 0x55a24dfc1f80 2024-09-17T05:43:23.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a24ed3a300 con 0x55a24dfc1b00 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a24ed3a480 con 0x55a24dfc1680 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc1f80 0x55a24ed22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc1f80 0x55a24ed22b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40130/0 (socket says 172.21.15.44:40130) 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c4e00640 1 -- 172.21.15.44:0/851842961 learned_addr learned my addr 172.21.15.44:0/851842961 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c4400640 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc1680 0x55a24ed22580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.562+0000 7f41c3a00640 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc1b00 0x55a24ed22000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c4e00640 1 -- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc1680 msgr2=0x55a24ed22580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c4e00640 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc1680 0x55a24ed22580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c4e00640 1 -- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc1b00 msgr2=0x55a24ed22000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c4e00640 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc1b00 0x55a24ed22000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c4e00640 1 -- 172.21.15.44:0/851842961 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a249f341e0 con 0x55a24dfc1f80 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c4e00640 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc1f80 0x55a24ed22b00 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x55a24ed2c0c0 tx=0x55a24e05c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d04fd84b12d1956 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c1200640 1 -- 172.21.15.44:0/851842961 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a24df77520 con 0x55a24dfc1f80 2024-09-17T05:43:23.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c1200640 1 -- 172.21.15.44:0/851842961 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a24df94fc0 con 0x55a24dfc1f80 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c1200640 1 -- 172.21.15.44:0/851842961 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a24df771e0 con 0x55a24dfc1f80 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 -- 172.21.15.44:0/851842961 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a249f354a0 con 0x55a24dfc1f80 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 -- 172.21.15.44:0/851842961 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a249f35a40 con 0x55a24dfc1f80 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 4 waiting for MDS map... 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c1200640 1 -- 172.21.15.44:0/851842961 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x55a24ee7c600 con 0x55a24dfc1f80 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c1200640 1 -- 172.21.15.44:0/851842961 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) ==== 2893+0+0 (secure 0 0 0) 0x55a24df97180 con 0x55a24dfc1f80 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 4 Got MDS map 70 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 4 datascan.main: Using metadata pool output 2024-09-17T05:43:23.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 4 datascan.main: connecting to RADOS... 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 Processor -- start 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 -- start start 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc0d80 0x55a24ed23080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc2880 0x55a24ed23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a24ed3a600 con 0x55a24dfc2880 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a24ed3a780 con 0x55a24dfc0900 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.566+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a24ed3a900 con 0x55a24dfc0d80 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc2880 0x55a24ed23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc2880 0x55a24ed23b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40134/0 (socket says 172.21.15.44:40134) 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 -- 172.21.15.44:0/3161835079 learned_addr learned my addr 172.21.15.44:0/3161835079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c4400640 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc0d80 0x55a24ed23080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 -- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc0d80 msgr2=0x55a24ed23080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc0d80 0x55a24ed23080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 -- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0900 msgr2=0x55a24ed23600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 -- 172.21.15.44:0/3161835079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a249f35c20 con 0x55a24dfc2880 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc2880 0x55a24ed23b80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x55a24eda7800 tx=0x55a24ee88c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1beaf2274f24f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41bea00640 1 -- 172.21.15.44:0/3161835079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a24df77380 con 0x55a24dfc2880 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41bea00640 1 -- 172.21.15.44:0/3161835079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a24df94e00 con 0x55a24dfc2880 2024-09-17T05:43:23.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41bea00640 1 -- 172.21.15.44:0/3161835079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a24df77520 con 0x55a24dfc2880 2024-09-17T05:43:23.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3161835079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc2880 msgr2=0x55a24ed23b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc2880 0x55a24ed23b80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x55a24eda7800 tx=0x55a24ee88c00 comp rx=0 tx=0).stop 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3161835079 shutdown_connections 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc2880 0x55a24ed23b80 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3161835079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc0d80 0x55a24ed23080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3161835079 >> 172.21.15.44:0/3161835079 conn(0x55a24dfc1200 msgr2=0x55a24e26e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3161835079 shutdown_connections 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3161835079 wait complete. 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 Processor -- start 2024-09-17T05:43:23.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.570+0000 7f41c702b8c0 1 -- start start 2024-09-17T05:43:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0d80 0x55a24ed23080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc2880 0x55a24ed23b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a24ed3bb00 con 0x55a24dfc0900 2024-09-17T05:43:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a24ed3b980 con 0x55a24dfc0d80 2024-09-17T05:43:23.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a24ed3b800 con 0x55a24dfc2880 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c3a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c4400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0d80 0x55a24ed23080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c3a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40136/0 (socket says 172.21.15.44:40136) 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 learned_addr learned my addr 172.21.15.44:0/3140366625 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc2880 0x55a24ed23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc2880 msgr2=0x55a24ed23b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c4400640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc2880 0x55a24ed23b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc0900 msgr2=0x55a24ed23600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c4400640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a249f352c0 con 0x55a24dfc0d80 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc0900 0x55a24ed23600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c4400640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0d80 0x55a24ed23080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55a24ee68630 tx=0x55a24ee88f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41bcc00640 1 -- 172.21.15.44:0/3140366625 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a24df77380 con 0x55a24dfc0d80 2024-09-17T05:43:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a249f343c0 con 0x55a24dfc0d80 2024-09-17T05:43:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41bcc00640 1 -- 172.21.15.44:0/3140366625 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a24df94540 con 0x55a24dfc0d80 2024-09-17T05:43:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41bcc00640 1 -- 172.21.15.44:0/3140366625 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a24df77520 con 0x55a24dfc0d80 2024-09-17T05:43:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a249f35c20 con 0x55a24dfc0d80 2024-09-17T05:43:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.574+0000 7f41c702b8c0 4 datascan.init: resolving metadata pool 13 2024-09-17T05:43:23.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41bcc00640 1 -- 172.21.15.44:0/3140366625 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x55a24ee66c00 con 0x55a24dfc0d80 2024-09-17T05:43:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41bcc00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55a24dfc3a80 0x55a24ed24100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41bcc00640 1 -- 172.21.15.44:0/3140366625 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x55a24e296a00 con 0x55a24dfc0d80 2024-09-17T05:43:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c702b8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-09-17T05:43:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c702b8c0 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-09-17T05:43:23.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c702b8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-09-17T05:43:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55a24dfc2d00 0x55a24ed24680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e298800 con 0x55a24dfc2d00 2024-09-17T05:43:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55a24dfc3a80 0x55a24ed24100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55a24dfc2d00 0x55a24ed24680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55a24dfc3a80 0x55a24ed24100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55a24ed2d680 tx=0x55a24ee88d20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55a24dfc2d00 0x55a24ed24680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(1 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:2 14.20 14:04000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299000 con 0x55a24dfc2d00 2024-09-17T05:43:23.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== osd_op_reply(2 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41bea00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a24e39c000 0x55a24e3a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:3 14.10 14:08000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299400 con 0x55a24e39c000 2024-09-17T05:43:23.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.578+0000 7f41c4e00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a24e39c000 0x55a24e3a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41c4e00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a24e39c000 0x55a24e3a4000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(3 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:4 14.30 14:0c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299800 con 0x55a24dfc2d00 2024-09-17T05:43:23.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 3 ==== osd_op_reply(4 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:5 14.8 14:10000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae000 con 0x55a24dfc2d00 2024-09-17T05:43:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 4 ==== osd_op_reply(5 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:6 14.28 14:14000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299c00 con 0x55a24e39c000 2024-09-17T05:43:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(6 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41bea00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55a24e39c480 0x55a24e3a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:7 14.18 14:18000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae400 con 0x55a24e39c480 2024-09-17T05:43:23.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41c4400640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55a24e39c480 0x55a24e3a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.582+0000 7f41c4400640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55a24e39c480 0x55a24e3a4580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.586+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(7 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39c480 2024-09-17T05:43:23.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.586+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:8 14.38 14:1c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae800 con 0x55a24dfc2d00 2024-09-17T05:43:23.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.586+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 5 ==== osd_op_reply(8 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.586+0000 7f41bea00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55a24e39c900 0x55a24e3a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.586+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:9 14.4 14:20000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e298800 con 0x55a24e39c900 2024-09-17T05:43:23.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.586+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55a24e39c900 0x55a24e3a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.586+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55a24e39c900 0x55a24e3a4b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(9 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39c900 2024-09-17T05:43:23.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:10 14.24 14:24000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3aec00 con 0x55a24e39c480 2024-09-17T05:43:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== osd_op_reply(10 [pgnls start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39c480 2024-09-17T05:43:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41bea00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55a24e39cd80 0x55a24e3a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:11 14.14 14:28000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299000 con 0x55a24e39cd80 2024-09-17T05:43:23.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41c4e00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55a24e39cd80 0x55a24e3a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41c4e00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55a24e39cd80 0x55a24e3a5080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(11 [pgnls start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41be000640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55a24e39db00 0x55a24e3a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.590+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:12 14.34 14:2c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af000 con 0x55a24e39db00 2024-09-17T05:43:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.594+0000 7f41c4400640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55a24e39db00 0x55a24e3a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.594+0000 7f41c4400640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55a24e39db00 0x55a24e3a6100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.594+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(12 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39db00 2024-09-17T05:43:23.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.594+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:13 14.c 14:30000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299800 con 0x55a24e39c480 2024-09-17T05:43:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.5 v2:172.21.15.86:6822/2837964024 3 ==== osd_op_reply(13 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39c480 2024-09-17T05:43:23.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:14 14.2c 14:34000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299800 con 0x55a24dfc2d00 2024-09-17T05:43:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 6 ==== osd_op_reply(14 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:15 14.1c 14:38000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299c00 con 0x55a24e39c000 2024-09-17T05:43:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(15 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41be000640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55a24e39df80 0x55a24e3a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:16 14.3c 14:3c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299400 con 0x55a24e39df80 2024-09-17T05:43:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55a24e39df80 0x55a24e3a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41c3a00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55a24e39df80 0x55a24e3a6680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(16 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39df80 2024-09-17T05:43:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:17 14.2 14:40000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299000 con 0x55a24e39c900 2024-09-17T05:43:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== osd_op_reply(17 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39c900 2024-09-17T05:43:23.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.598+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:18 14.22 14:44000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24ee7b400 con 0x55a24e39cd80 2024-09-17T05:43:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== osd_op_reply(18 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:19 14.12 14:48000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae000 con 0x55a24e39c000 2024-09-17T05:43:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 4 ==== osd_op_reply(19 [pgnls start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:20 14.32 14:4c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24ee7b000 con 0x55a24e39db00 2024-09-17T05:43:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== osd_op_reply(20 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39db00 2024-09-17T05:43:23.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:21 14.a 14:50000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae400 con 0x55a24e39c900 2024-09-17T05:43:23.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.2 v2:172.21.15.44:6808/1191521276 3 ==== osd_op_reply(21 [pgnls start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39c900 2024-09-17T05:43:23.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:22 14.2a 14:54000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af400 con 0x55a24e39c900 2024-09-17T05:43:23.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.2 v2:172.21.15.44:6808/1191521276 4 ==== osd_op_reply(22 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39c900 2024-09-17T05:43:23.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:23 14.1a 14:58000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae800 con 0x55a24dfc2d00 2024-09-17T05:43:23.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 7 ==== osd_op_reply(23 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:24 14.3a 14:5c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af800 con 0x55a24dfc2d00 2024-09-17T05:43:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 8 ==== osd_op_reply(24 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:25 14.6 14:60000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3aec00 con 0x55a24e39c480 2024-09-17T05:43:23.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.5 v2:172.21.15.86:6822/2837964024 4 ==== osd_op_reply(25 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39c480 2024-09-17T05:43:23.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:26 14.26 14:64000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3afc00 con 0x55a24e39cd80 2024-09-17T05:43:23.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 3 ==== osd_op_reply(26 [pgnls start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:27 14.16 14:68000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af000 con 0x55a24e39c000 2024-09-17T05:43:23.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 5 ==== osd_op_reply(27 [pgnls start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.602+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:28 14.36 14:6c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae400 con 0x55a24e39df80 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== osd_op_reply(28 [pgnls start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39df80 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:29 14.e 14:70000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ce000 con 0x55a24e39cd80 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 4 ==== osd_op_reply(29 [pgnls start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:30 14.2e 14:74000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af400 con 0x55a24e39df80 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.7 v2:172.21.15.86:6818/3939301135 3 ==== osd_op_reply(30 [pgnls start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39df80 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41bea00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55a24e39d200 0x55a24e3a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:31 14.1e 14:78000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ce400 con 0x55a24e39d200 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c4e00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55a24e39d200 0x55a24e3a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c4e00640 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55a24e39d200 0x55a24e3a5600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(31 [pgnls start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:32 14.3e 14:7c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e298800 con 0x55a24e39db00 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.0 v2:172.21.15.44:6800/3049588557 3 ==== osd_op_reply(32 [pgnls start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39db00 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:33 14.1 14:80000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ce800 con 0x55a24e39df80 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.7 v2:172.21.15.86:6818/3939301135 4 ==== osd_op_reply(33 [pgnls start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39df80 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:34 14.21 14:84000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299800 con 0x55a24e39c900 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.2 v2:172.21.15.44:6808/1191521276 5 ==== osd_op_reply(34 [pgnls start_epoch 94 out=49b] v90'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39c900 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:35 14.11 14:88000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cec00 con 0x55a24e39cd80 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 5 ==== osd_op_reply(35 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:36 14.31 14:8c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299400 con 0x55a24e39db00 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.606+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.0 v2:172.21.15.44:6800/3049588557 4 ==== osd_op_reply(36 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39db00 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:37 14.9 14:90000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cf000 con 0x55a24e39db00 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.0 v2:172.21.15.44:6800/3049588557 5 ==== osd_op_reply(37 [pgnls start_epoch 94 out=49b] v90'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39db00 2024-09-17T05:43:23.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:38 14.29 14:94000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299000 con 0x55a24e39cd80 2024-09-17T05:43:23.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 6 ==== osd_op_reply(38 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:39 14.19 14:98000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cf400 con 0x55a24e39d200 2024-09-17T05:43:23.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(39 [pgnls start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:40 14.39 14:9c000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3aec00 con 0x55a24e39d200 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(40 [pgnls start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:41 14.5 14:a0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cf000 con 0x55a24e39c480 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.5 v2:172.21.15.86:6822/2837964024 5 ==== osd_op_reply(41 [pgnls start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39c480 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:42 14.25 14:a4000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae000 con 0x55a24e39d200 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 4 ==== osd_op_reply(42 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:43 14.15 14:a8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ce000 con 0x55a24e39d200 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 5 ==== osd_op_reply(43 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:44 14.35 14:ac000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24ee7b000 con 0x55a24e39d200 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 6 ==== osd_op_reply(44 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:45 14.d 14:b0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cf800 con 0x55a24e39d200 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 7 ==== osd_op_reply(45 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:46 14.2d 14:b4000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24ee7b400 con 0x55a24e39c900 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.2 v2:172.21.15.44:6808/1191521276 6 ==== osd_op_reply(46 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39c900 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.610+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:47 14.1d 14:b8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cfc00 con 0x55a24dfc2d00 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 9 ==== osd_op_reply(47 [pgnls start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:48 14.3d 14:bc000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e298800 con 0x55a24e39df80 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.7 v2:172.21.15.86:6818/3939301135 5 ==== osd_op_reply(48 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39df80 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:49 14.3 14:c0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3afc00 con 0x55a24dfc2d00 2024-09-17T05:43:23.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 10 ==== osd_op_reply(49 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:50 14.23 14:c4000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299400 con 0x55a24e39cd80 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 7 ==== osd_op_reply(50 [pgnls start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:51 14.13 14:c8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af000 con 0x55a24e39c480 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.5 v2:172.21.15.86:6822/2837964024 6 ==== osd_op_reply(51 [pgnls start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39c480 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:52 14.33 14:cc000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299c00 con 0x55a24e39c480 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 <== osd.5 v2:172.21.15.86:6822/2837964024 7 ==== osd_op_reply(52 [pgnls start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a780 con 0x55a24e39c480 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:53 14.b 14:d0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae800 con 0x55a24e39c000 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 6 ==== osd_op_reply(53 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:54 14.2b 14:d4000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ce800 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 8 ==== osd_op_reply(54 [pgnls start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:55 14.1b 14:d8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af800 con 0x55a24e39c000 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 7 ==== osd_op_reply(55 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:56 14.3b 14:dc000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ce400 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 9 ==== osd_op_reply(56 [pgnls start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.614+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:57 14.7 14:e0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ae400 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 10 ==== osd_op_reply(57 [pgnls start_epoch 94 out=81b] v90'6 uv6 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:58 14.7 14:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55a24e298c00 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 11 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c702b8c0 10 datascan.operator(): handling object 1099511627777.0 2024-09-17T05:43:23.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:59 14.7 14:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cf800 con 0x55a24e39cd80 2024-09-17T05:43:23.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 12 ==== osd_op_reply(59 10000000001.00000000 [call] v94'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:60 14.27 14:e4000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299400 con 0x55a24e39cd80 2024-09-17T05:43:23.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 13 ==== osd_op_reply(60 [pgnls start_epoch 94 out=49b] v90'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:61 14.17 14:e8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3af400 con 0x55a24dfc2d00 2024-09-17T05:43:23.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 11 ==== osd_op_reply(61 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:62 14.37 14:ec000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cec00 con 0x55a24e39d200 2024-09-17T05:43:23.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.3 v2:172.21.15.44:6824/2051542036 8 ==== osd_op_reply(62 [pgnls start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39d200 2024-09-17T05:43:23.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.618+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:63 14.f 14:f0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3aec00 con 0x55a24e39cd80 2024-09-17T05:43:23.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.1 v2:172.21.15.44:6816/298260573 14 ==== osd_op_reply(63 [pgnls start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39cd80 2024-09-17T05:43:23.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:64 14.2f 14:f4000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3cf400 con 0x55a24dfc2d00 2024-09-17T05:43:23.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.4 v2:172.21.15.86:6810/2781128627 12 ==== osd_op_reply(64 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24dfc2d00 2024-09-17T05:43:23.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41bea00640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:65 14.1f 14:f8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e299800 con 0x55a24e39df80 2024-09-17T05:43:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c3a00640 1 -- 172.21.15.44:0/3140366625 <== osd.7 v2:172.21.15.86:6818/3939301135 6 ==== osd_op_reply(65 [pgnls start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a000 con 0x55a24e39df80 2024-09-17T05:43:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41be000640 1 -- 172.21.15.44:0/3140366625 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:66 14.3f 14:fc000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55a24e3ce000 con 0x55a24e39c000 2024-09-17T05:43:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c4e00640 1 -- 172.21.15.44:0/3140366625 <== osd.6 v2:172.21.15.86:6802/218299486 8 ==== osd_op_reply(66 [pgnls start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55a24e04a500 con 0x55a24e39c000 2024-09-17T05:43:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55a24e39db00 msgr2=0x55a24e3a6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55a24e39db00 0x55a24e3a6100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55a24e39cd80 msgr2=0x55a24e3a5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55a24e39cd80 0x55a24e3a5080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55a24e39c900 msgr2=0x55a24e3a4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55a24e39c900 0x55a24e3a4b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55a24e39d200 msgr2=0x55a24e3a5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55a24e39d200 0x55a24e3a5600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55a24dfc2d00 msgr2=0x55a24ed24680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55a24dfc2d00 0x55a24ed24680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55a24e39c480 msgr2=0x55a24e3a4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55a24e39c480 0x55a24e3a4580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a24e39c000 msgr2=0x55a24e3a4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a24e39c000 0x55a24e3a4000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55a24e39df80 msgr2=0x55a24e3a6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55a24e39df80 0x55a24e3a6680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 reap_dead start 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 reap_dead start 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c4400640 1 -- 172.21.15.44:0/3140366625 reap_dead start 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55a24dfc3a80 msgr2=0x55a24ed24100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55a24dfc3a80 0x55a24ed24100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55a24ed2d680 tx=0x55a24ee88d20 comp rx=0 tx=0).stop 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0d80 msgr2=0x55a24ed23080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0d80 0x55a24ed23080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55a24ee68630 tx=0x55a24ee88f60 comp rx=0 tx=0).stop 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 shutdown_connections 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55a24dfc3a80 0x55a24ed24100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/3140366625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc0d80 0x55a24ed23080 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 >> 172.21.15.44:0/3140366625 conn(0x55a24dfc1200 msgr2=0x55a24e26e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 shutdown_connections 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/3140366625 wait complete. 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/851842961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc1f80 msgr2=0x55a24ed22b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc1f80 0x55a24ed22b00 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x55a24ed2c0c0 tx=0x55a24e05c420 comp rx=0 tx=0).stop 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/851842961 shutdown_connections 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a24dfc1f80 0x55a24ed22b00 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a24dfc1b00 0x55a24ed22000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 --2- 172.21.15.44:0/851842961 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a24dfc1680 0x55a24ed22580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/851842961 >> 172.21.15.44:0/851842961 conn(0x55a24dfc2400 msgr2=0x55a249f3d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/851842961 shutdown_connections 2024-09-17T05:43:23.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.622+0000 7f41c702b8c0 1 -- 172.21.15.44:0/851842961 wait complete. 2024-09-17T05:43:23.626 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:43:23.628 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.126293, result: 2024-09-17T05:43:23.628 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-09-17T05:43:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 -- start start 2024-09-17T05:43:23.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 Processor -- start 2024-09-17T05:43:23.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4b680 0x560fcaaa8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4bb00 0x560fcaaa8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4bf80 0x560fcaaa8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560fcaaca780 con 0x560fc9d4bf80 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560fcaaca600 con 0x560fc9d4bb00 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560fcaaca480 con 0x560fc9d4b680 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4bf80 0x560fcaaa8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4bf80 0x560fcaaa8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40176/0 (socket says 172.21.15.44:40176) 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 -- 172.21.15.44:0/1606076746 learned_addr learned my addr 172.21.15.44:0/1606076746 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4b680 0x560fcaaa8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4bb00 0x560fcaaa8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 -- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4b680 msgr2=0x560fcaaa8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4b680 0x560fcaaa8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 -- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4bb00 msgr2=0x560fcaaa8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4bb00 0x560fcaaa8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 -- 172.21.15.44:0/1606076746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc5cbe1e0 con 0x560fc9d4bf80 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4bf80 0x560fcaaa8b00 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x560fc9dba0f0 tx=0x560fc9de6420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d6c5350502e97f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f3600640 1 -- 172.21.15.44:0/1606076746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560fc9d01520 con 0x560fc9d4bf80 2024-09-17T05:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f3600640 1 -- 172.21.15.44:0/1606076746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560fc9d1e540 con 0x560fc9d4bf80 2024-09-17T05:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f3600640 1 -- 172.21.15.44:0/1606076746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560fc9d011e0 con 0x560fc9d4bf80 2024-09-17T05:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1606076746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc5cbf2c0 con 0x560fc9d4bf80 2024-09-17T05:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1606076746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x560fc5cbfa40 con 0x560fc9d4bf80 2024-09-17T05:43:23.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 4 waiting for MDS map... 2024-09-17T05:43:23.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f3600640 1 -- 172.21.15.44:0/1606076746 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x560fcac06600 con 0x560fc9d4bf80 2024-09-17T05:43:23.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f3600640 1 -- 172.21.15.44:0/1606076746 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 70) ==== 2893+0+0 (secure 0 0 0) 0x560fc9d21180 con 0x560fc9d4bf80 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.690+0000 7fa9f9a2d8c0 4 Got MDS map 70 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 4 datascan.main: Using metadata pool output 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 4 datascan.main: connecting to RADOS... 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 Processor -- start 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 -- start start 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4ad80 0x560fcaaa9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560fcaaca300 con 0x560fc9d4ad80 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560fcaaca000 con 0x560fc9d4a900 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560fc9d2b800 con 0x560fc9d4c880 2024-09-17T05:43:23.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4ad80 0x560fcaaa9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4ad80 0x560fcaaa9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40188/0 (socket says 172.21.15.44:40188) 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 -- 172.21.15.44:0/3382774915 learned_addr learned my addr 172.21.15.44:0/3382774915 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f6800640 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 -- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4c880 msgr2=0x560fcaaa9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 -- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 msgr2=0x560fcaaa9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 -- 172.21.15.44:0/3382774915 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc5cbfc20 con 0x560fc9d4ad80 2024-09-17T05:43:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4ad80 0x560fcaaa9080 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x560fc9dbb560 tx=0x560fcaab6cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186a8cfe94f357c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f0e00640 1 -- 172.21.15.44:0/3382774915 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560fc9d01520 con 0x560fc9d4ad80 2024-09-17T05:43:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f0e00640 1 -- 172.21.15.44:0/3382774915 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560fc9d1efc0 con 0x560fc9d4ad80 2024-09-17T05:43:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.694+0000 7fa9f0e00640 1 -- 172.21.15.44:0/3382774915 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560fc9d011e0 con 0x560fc9d4ad80 2024-09-17T05:43:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/3382774915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4ad80 msgr2=0x560fcaaa9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4ad80 0x560fcaaa9080 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x560fc9dbb560 tx=0x560fcaab6cc0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/3382774915 shutdown_connections 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/3382774915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4ad80 0x560fcaaa9080 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/3382774915 >> 172.21.15.44:0/3382774915 conn(0x560fc9d4b200 msgr2=0x560fc9fea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/3382774915 shutdown_connections 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/3382774915 wait complete. 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 Processor -- start 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- start start 2024-09-17T05:43:23.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4cd00 0x560fcaaaa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560fcaaca000 con 0x560fc9d4c880 2024-09-17T05:43:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560fcaacb500 con 0x560fc9d4a900 2024-09-17T05:43:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f9a2d8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x560fcaaca300 con 0x560fc9d4cd00 2024-09-17T05:43:23.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40202/0 (socket says 172.21.15.44:40202) 2024-09-17T05:43:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 learned_addr learned my addr 172.21.15.44:0/1403238495 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4cd00 0x560fcaaaa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4cd00 msgr2=0x560fcaaaa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4cd00 0x560fcaaaa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 msgr2=0x560fcaaa9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc5cbe1e0 con 0x560fc9d4c880 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4a900 0x560fcaaa9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.698+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4c880 0x560fcaaa9b80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x560fcab35770 tx=0x560fc9e4a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9ef000640 1 -- 172.21.15.44:0/1403238495 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560fc9d01380 con 0x560fc9d4c880 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9ef000640 1 -- 172.21.15.44:0/1403238495 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x560fc9d1ee00 con 0x560fc9d4c880 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560fc5cbf2c0 con 0x560fc9d4c880 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9ef000640 1 -- 172.21.15.44:0/1403238495 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x560fc9d01520 con 0x560fc9d4c880 2024-09-17T05:43:23.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc5cbfe00 con 0x560fc9d4c880 2024-09-17T05:43:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 4 datascan.init: resolving metadata pool 13 2024-09-17T05:43:23.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9ef000640 1 -- 172.21.15.44:0/1403238495 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x560fca020c00 con 0x560fc9d4c880 2024-09-17T05:43:23.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9ef000640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x560fc9d4da80 0x560fcaaab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9ef000640 1 -- 172.21.15.44:0/1403238495 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x560fca018c00 con 0x560fc9d4c880 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x560fc9d4d180 0x560fcaaaa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560fca016800 con 0x560fc9d4d180 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x560fc9d4da80 0x560fcaaab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.702+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x560fc9d4d180 0x560fcaaaa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x560fc9d4da80 0x560fcaaab700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x560fcab35ef0 tx=0x560fcaab6f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x560fc9d4d180 0x560fcaaaa680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv24 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x560fc9d4d600 0x560fcaaaac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:2 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560fca016c00 con 0x560fc9d4d600 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x560fc9d4d600 0x560fcaaaac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x560fc9d4d600 0x560fcaaaac00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x560fca136000 0x560fcaaab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:3 14.0 14:00000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017000 con 0x560fca136000 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x560fca136000 0x560fcaaab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x560fca136000 0x560fcaaab180 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:4 14.20 14:04000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017c00 con 0x560fca136000 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.706+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:5 14.10 14:08000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fc9d4d180 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:6 14.30 14:0c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142400 con 0x560fca136000 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 3 ==== osd_op_reply(6 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:7 14.8 14:10000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142c00 con 0x560fca136000 2024-09-17T05:43:23.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 4 ==== osd_op_reply(7 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:8 14.28 14:14000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fc9d4d180 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(8 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x560fca139180 0x560fca14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:9 14.18 14:18000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143000 con 0x560fca139180 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x560fca139180 0x560fca14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x560fca139180 0x560fca14c000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:10 14.38 14:1c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fca136000 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 5 ==== osd_op_reply(10 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x560fca139600 0x560fca14c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:11 14.4 14:20000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142400 con 0x560fca139600 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.710+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x560fca139600 0x560fca14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x560fca139600 0x560fca14c580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(11 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:12 14.24 14:24000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fca139180 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== osd_op_reply(12 [pgnls-filter start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:13 14.14 14:28000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017000 con 0x560fc9d4d600 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== osd_op_reply(13 [pgnls-filter start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0400640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x560fca152000 0x560fca14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:14 14.34 14:2c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016800 con 0x560fca152000 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x560fca152000 0x560fca14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f6800640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x560fca152000 0x560fca14d080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(14 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:15 14.c 14:30000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017c00 con 0x560fca139180 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:16 14.2c 14:34000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016c00 con 0x560fca136000 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 6 ==== osd_op_reply(16 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:17 14.1c 14:38000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142400 con 0x560fc9d4d180 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 4 ==== osd_op_reply(17 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0400640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560fca152480 0x560fca14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.714+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:18 14.3c 14:3c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017000 con 0x560fca152480 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560fca152480 0x560fca14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f5e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560fca152480 0x560fca14d600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:19 14.2 14:40000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142c00 con 0x560fca139600 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:20 14.22 14:44000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05400 con 0x560fc9d4d600 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:21 14.12 14:48000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fc9d4d180 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:22 14.32 14:4c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05000 con 0x560fca152000 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== osd_op_reply(22 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:23 14.a 14:50000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143000 con 0x560fca139600 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:24 14.2a 14:54000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fca139600 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:25 14.1a 14:58000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143400 con 0x560fca136000 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:26 14.3a 14:5c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142400 con 0x560fca136000 2024-09-17T05:43:23.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 8 ==== osd_op_reply(26 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.718+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:27 14.6 14:60000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143800 con 0x560fca139180 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 4 ==== osd_op_reply(27 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:28 14.26 14:64000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fc9d4d600 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 4 ==== osd_op_reply(28 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:29 14.16 14:68000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143c00 con 0x560fc9d4d180 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 6 ==== osd_op_reply(29 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:30 14.36 14:6c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017c00 con 0x560fca152480 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== osd_op_reply(30 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:31 14.e 14:70000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a000 con 0x560fc9d4d600 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 5 ==== osd_op_reply(31 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:32 14.2e 14:74000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017000 con 0x560fca152480 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0e00640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x560fca139a80 0x560fca14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:33 14.1e 14:78000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a400 con 0x560fca139a80 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x560fca139a80 0x560fca14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f7200640 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x560fca139a80 0x560fca14cb00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(33 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:34 14.3e 14:7c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a000 con 0x560fca152000 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.722+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:35 14.1 14:80000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a800 con 0x560fca152480 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:36 14.21 14:84000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142c00 con 0x560fca139600 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 5 ==== osd_op_reply(36 [pgnls-filter start_epoch 94 out=49b] v90'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:37 14.11 14:88000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15ac00 con 0x560fc9d4d600 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:38 14.31 14:8c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143000 con 0x560fca152000 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:39 14.9 14:90000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b000 con 0x560fca152000 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 94 out=49b] v90'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:40 14.29 14:94000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fc9d4d600 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 7 ==== osd_op_reply(40 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:41 14.19 14:98000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b400 con 0x560fca139a80 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(41 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:42 14.39 14:9c000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fca139a80 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(42 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:43 14.5 14:a0000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a000 con 0x560fca139180 2024-09-17T05:43:23.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:44 14.25 14:a4000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05400 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 4 ==== osd_op_reply(44 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:45 14.15 14:a8000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b800 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 5 ==== osd_op_reply(45 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.726+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:46 14.35 14:ac000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017c00 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 6 ==== osd_op_reply(46 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:47 14.d 14:b0000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143400 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:48 14.2d 14:b4000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142c00 con 0x560fca139600 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 6 ==== osd_op_reply(48 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:49 14.1d 14:b8000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142400 con 0x560fca136000 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 9 ==== osd_op_reply(49 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:50 14.3d 14:bc000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fca152480 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:51 14.3 14:c0000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05000 con 0x560fca136000 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 10 ==== osd_op_reply(51 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:52 14.23 14:c4000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fc9d4d600 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 8 ==== osd_op_reply(52 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:53 14.13 14:c8000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016800 con 0x560fca139180 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 6 ==== osd_op_reply(53 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:54 14.33 14:cc000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143800 con 0x560fca139180 2024-09-17T05:43:23.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 7 ==== osd_op_reply(54 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:55 14.b 14:d0000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016c00 con 0x560fc9d4d180 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 7 ==== osd_op_reply(55 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:56 14.2b 14:d4000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143c00 con 0x560fc9d4d600 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.730+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:57 14.1b 14:d8000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a400 con 0x560fc9d4d180 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 8 ==== osd_op_reply(57 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:58 14.3b 14:dc000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05400 con 0x560fc9d4d600 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 10 ==== osd_op_reply(58 [pgnls-filter start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:59 14.7 14:e0000000::::head [pgnls-filter start_epoch 94 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15ac00 con 0x560fc9d4d600 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 11 ==== osd_op_reply(59 [pgnls-filter start_epoch 94 out=81b] v94'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:60 14.0 14:00000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017400 con 0x560fca136000 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 11 ==== osd_op_reply(60 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:61 14.20 14:04000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b400 con 0x560fca136000 2024-09-17T05:43:23.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 12 ==== osd_op_reply(61 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:62 14.10 14:08000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b800 con 0x560fc9d4d180 2024-09-17T05:43:23.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 9 ==== osd_op_reply(62 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:63 14.30 14:0c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a800 con 0x560fca136000 2024-09-17T05:43:23.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 13 ==== osd_op_reply(63 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:64 14.8 14:10000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15ac00 con 0x560fca136000 2024-09-17T05:43:23.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 14 ==== osd_op_reply(64 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:65 14.28 14:14000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a000 con 0x560fc9d4d180 2024-09-17T05:43:23.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 10 ==== osd_op_reply(65 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:66 14.18 14:18000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05400 con 0x560fca139180 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 8 ==== osd_op_reply(66 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:67 14.38 14:1c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15bc00 con 0x560fca136000 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 15 ==== osd_op_reply(67 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.734+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:68 14.4 14:20000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143400 con 0x560fca139600 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:69 14.24 14:24000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017000 con 0x560fca139180 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 9 ==== osd_op_reply(69 [pgnls-filter start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:70 14.14 14:28000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142c00 con 0x560fc9d4d600 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 12 ==== osd_op_reply(70 [pgnls-filter start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:71 14.34 14:2c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a400 con 0x560fca152000 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 6 ==== osd_op_reply(71 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:72 14.c 14:30000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fca139180 2024-09-17T05:43:23.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 10 ==== osd_op_reply(72 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:73 14.2c 14:34000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016800 con 0x560fca136000 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 16 ==== osd_op_reply(73 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:74 14.1c 14:38000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143c00 con 0x560fc9d4d180 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 11 ==== osd_op_reply(74 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:75 14.3c 14:3c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016c00 con 0x560fca152480 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 6 ==== osd_op_reply(75 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:76 14.2 14:40000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017c00 con 0x560fca139600 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.738+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:77 14.22 14:44000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017400 con 0x560fc9d4d600 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 13 ==== osd_op_reply(77 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:78 14.12 14:48000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b800 con 0x560fc9d4d180 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 12 ==== osd_op_reply(78 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:79 14.32 14:4c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05000 con 0x560fca152000 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 7 ==== osd_op_reply(79 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:80 14.a 14:50000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a000 con 0x560fca139600 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 9 ==== osd_op_reply(80 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:81 14.2a 14:54000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fca139600 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 10 ==== osd_op_reply(81 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:82 14.1a 14:58000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b000 con 0x560fca136000 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 17 ==== osd_op_reply(82 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:83 14.3a 14:5c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143800 con 0x560fca136000 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 18 ==== osd_op_reply(83 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:84 14.6 14:60000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b400 con 0x560fca139180 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 11 ==== osd_op_reply(84 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:85 14.26 14:64000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143000 con 0x560fc9d4d600 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 14 ==== osd_op_reply(85 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:86 14.16 14:68000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a800 con 0x560fc9d4d180 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 13 ==== osd_op_reply(86 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:87 14.36 14:6c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142400 con 0x560fca152480 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 7 ==== osd_op_reply(87 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.742+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:88 14.e 14:70000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b800 con 0x560fc9d4d600 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 15 ==== osd_op_reply(88 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:89 14.2e 14:74000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca174000 con 0x560fca152480 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 8 ==== osd_op_reply(89 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:90 14.1e 14:78000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b400 con 0x560fca139a80 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 8 ==== osd_op_reply(90 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:91 14.3e 14:7c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca174400 con 0x560fca152000 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 8 ==== osd_op_reply(91 [pgnls-filter start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:92 14.1 14:80000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a800 con 0x560fca152480 2024-09-17T05:43:23.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 9 ==== osd_op_reply(92 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:93 14.21 14:84000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca174800 con 0x560fca139600 2024-09-17T05:43:23.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 11 ==== osd_op_reply(93 [pgnls-filter start_epoch 94 out=49b] v90'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:94 14.11 14:88000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017000 con 0x560fc9d4d600 2024-09-17T05:43:23.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 16 ==== osd_op_reply(94 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:95 14.31 14:8c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca174c00 con 0x560fca152000 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 9 ==== osd_op_reply(95 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:96 14.9 14:90000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016c00 con 0x560fca152000 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.0 v2:172.21.15.44:6800/3049588557 10 ==== osd_op_reply(96 [pgnls-filter start_epoch 94 out=49b] v90'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca152000 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:97 14.29 14:94000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca175000 con 0x560fc9d4d600 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 17 ==== osd_op_reply(97 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:98 14.19 14:98000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142000 con 0x560fca139a80 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 9 ==== osd_op_reply(98 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.746+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:99 14.39 14:9c000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca175400 con 0x560fca139a80 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 10 ==== osd_op_reply(99 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:100 14.5 14:a0000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143c00 con 0x560fca139180 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 12 ==== osd_op_reply(100 [pgnls-filter start_epoch 94 out=49b] v90'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:101 14.25 14:a4000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca175800 con 0x560fca139a80 2024-09-17T05:43:23.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 11 ==== osd_op_reply(101 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:102 14.15 14:a8000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05400 con 0x560fca139a80 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 12 ==== osd_op_reply(102 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:103 14.35 14:ac000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca175c00 con 0x560fca139a80 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 13 ==== osd_op_reply(103 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:104 14.d 14:b0000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15ac00 con 0x560fca139a80 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 14 ==== osd_op_reply(104 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:105 14.2d 14:b4000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15bc00 con 0x560fca139600 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.2 v2:172.21.15.44:6808/1191521276 12 ==== osd_op_reply(105 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139600 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:106 14.1d 14:b8000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143800 con 0x560fca136000 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 19 ==== osd_op_reply(106 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:107 14.3d 14:bc000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a400 con 0x560fca152480 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:108 14.3 14:c0000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143400 con 0x560fca136000 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 20 ==== osd_op_reply(108 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:109 14.23 14:c4000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b000 con 0x560fc9d4d600 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 18 ==== osd_op_reply(109 [pgnls-filter start_epoch 94 out=49b] v90'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.750+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:110 14.13 14:c8000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142c00 con 0x560fca139180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 13 ==== osd_op_reply(110 [pgnls-filter start_epoch 94 out=49b] v90'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:111 14.33 14:cc000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a000 con 0x560fca139180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.5 v2:172.21.15.86:6822/2837964024 14 ==== osd_op_reply(111 [pgnls-filter start_epoch 94 out=49b] v90'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca139180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:112 14.b 14:d0000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fc9d4d180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 14 ==== osd_op_reply(112 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:113 14.2b 14:d4000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b800 con 0x560fc9d4d600 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 19 ==== osd_op_reply(113 [pgnls-filter start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:114 14.1b 14:d8000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca143000 con 0x560fc9d4d180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 15 ==== osd_op_reply(114 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:115 14.3b 14:dc000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15b400 con 0x560fc9d4d600 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 20 ==== osd_op_reply(115 [pgnls-filter start_epoch 94 out=49b] v90'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:116 14.7 14:e0000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca016800 con 0x560fc9d4d600 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 21 ==== osd_op_reply(116 [pgnls-filter start_epoch 94 out=81b] v94'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 10 datascan.operator(): handling object 10000000001.0 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:117 14.7 14:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560fca142400 con 0x560fc9d4d600 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 22 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) ==== 416+0+157 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:118 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560fca143c00 con 0x560fca152480 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 11 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) ==== 164+0+59 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560fca142c00 con 0x560fc9d4d600 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 23 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) ==== 154+0+520 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 20 datascan.get_frag_of: frag is * 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:120 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560fca017000 con 0x560fca152480 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.754+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 12 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 10 datascan.find_or_create_dirfrag: read_version = 17 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:121 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x560fca174000 con 0x560fca152480 2024-09-17T05:43:23.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 13 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-09-17T05:43:23.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 20 datascan.read_dentry: file_head not found in result 2024-09-17T05:43:23.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-09-17T05:43:23.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:122 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x560fcac05400 con 0x560fca152480 2024-09-17T05:43:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 14 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v94'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-09-17T05:43:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:123 14.27 14:e4000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca142800 con 0x560fc9d4d600 2024-09-17T05:43:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 24 ==== osd_op_reply(123 [pgnls-filter start_epoch 94 out=49b] v90'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:124 14.17 14:e8000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017c00 con 0x560fca136000 2024-09-17T05:43:23.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 21 ==== osd_op_reply(124 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:125 14.37 14:ec000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a800 con 0x560fca139a80 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.3 v2:172.21.15.44:6824/2051542036 15 ==== osd_op_reply(125 [pgnls-filter start_epoch 94 out=49b] v90'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fca139a80 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:126 14.f 14:f0000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca017400 con 0x560fc9d4d600 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f7200640 1 -- 172.21.15.44:0/1403238495 <== osd.1 v2:172.21.15.44:6816/298260573 25 ==== osd_op_reply(126 [pgnls-filter start_epoch 94 out=49b] v90'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4500 con 0x560fc9d4d600 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.758+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:127 14.2f 14:f4000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a400 con 0x560fca136000 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 <== osd.4 v2:172.21.15.86:6810/2781128627 22 ==== osd_op_reply(127 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4780 con 0x560fca136000 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f0400640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:128 14.1f 14:f8000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca174400 con 0x560fca152480 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.7 v2:172.21.15.86:6818/3939301135 15 ==== osd_op_reply(128 [pgnls-filter start_epoch 94 out=49b] v90'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fca152480 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f0e00640 1 -- 172.21.15.44:0/1403238495 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:129 14.3f 14:fc000000::::head [pgnls-filter start_epoch 94 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x560fca15a000 con 0x560fc9d4d180 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f5e00640 1 -- 172.21.15.44:0/1403238495 <== osd.6 v2:172.21.15.86:6802/218299486 16 ==== osd_op_reply(129 [pgnls-filter start_epoch 94 out=49b] v90'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x560fc9dd4000 con 0x560fc9d4d180 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x560fca152000 msgr2=0x560fca14d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x560fca152000 0x560fca14d080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x560fc9d4d600 msgr2=0x560fcaaaac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x560fc9d4d600 0x560fcaaaac00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x560fca139600 msgr2=0x560fca14c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x560fca139600 0x560fca14c580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x560fca139a80 msgr2=0x560fca14cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x560fca139a80 0x560fca14cb00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x560fca136000 msgr2=0x560fcaaab180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x560fca136000 0x560fcaaab180 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x560fca139180 msgr2=0x560fca14c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x560fca139180 0x560fca14c000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x560fc9d4d180 msgr2=0x560fcaaaa680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x560fc9d4d180 0x560fcaaaa680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560fca152480 msgr2=0x560fca14d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x560fca152480 0x560fca14d600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 reap_dead start 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 reap_dead start 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f6800640 1 -- 172.21.15.44:0/1403238495 reap_dead start 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x560fc9d4da80 msgr2=0x560fcaaab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x560fc9d4da80 0x560fcaaab700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x560fcab35ef0 tx=0x560fcaab6f00 comp rx=0 tx=0).stop 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4c880 msgr2=0x560fcaaa9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4c880 0x560fcaaa9b80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x560fcab35770 tx=0x560fc9e4a480 comp rx=0 tx=0).stop 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 shutdown_connections 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4c880 0x560fcaaa9b80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1403238495 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x560fc9d4da80 0x560fcaaab700 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 >> 172.21.15.44:0/1403238495 conn(0x560fc9d4b200 msgr2=0x560fc9fea000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 shutdown_connections 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1403238495 wait complete. 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1606076746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4bf80 msgr2=0x560fcaaa8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4bf80 0x560fcaaa8b00 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x560fc9dba0f0 tx=0x560fc9de6420 comp rx=0 tx=0).stop 2024-09-17T05:43:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1606076746 shutdown_connections 2024-09-17T05:43:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560fc9d4bf80 0x560fcaaa8b00 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560fc9d4bb00 0x560fcaaa8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 --2- 172.21.15.44:0/1606076746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x560fc9d4b680 0x560fcaaa8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1606076746 >> 172.21.15.44:0/1606076746 conn(0x560fc9d4c400 msgr2=0x560fc5cc7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1606076746 shutdown_connections 2024-09-17T05:43:23.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.762+0000 7fa9f9a2d8c0 1 -- 172.21.15.44:0/1606076746 wait complete. 2024-09-17T05:43:23.769 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.140485, result: 2024-09-17T05:43:23.769 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-09-17T05:43:23.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 -- start start 2024-09-17T05:43:23.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 Processor -- start 2024-09-17T05:43:23.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69661680 0x55de6975c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69661b00 0x55de6975c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69661f80 0x55de6975cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55de6a3ce600 con 0x55de69661680 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de6a3ce480 con 0x55de69661f80 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55de6a3ce300 con 0x55de69661b00 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad96e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69661680 0x55de6975c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad97800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69661f80 0x55de6975cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad96e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69661680 0x55de6975c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40228/0 (socket says 172.21.15.44:40228) 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad96400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69661b00 0x55de6975c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad96e00640 1 -- 172.21.15.44:0/2437461108 learned_addr learned my addr 172.21.15.44:0/2437461108 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad97800640 1 -- 172.21.15.44:0/2437461108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69661b00 msgr2=0x55de6975c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad97800640 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69661b00 0x55de6975c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad97800640 1 -- 172.21.15.44:0/2437461108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69661680 msgr2=0x55de6975c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad97800640 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69661680 0x55de6975c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad97800640 1 -- 172.21.15.44:0/2437461108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de655d41e0 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad96e00640 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69661680 0x55de6975c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad97800640 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69661f80 0x55de6975cb00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55de6a439680 tx=0x55de69760360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f034fde08ece2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad93c00640 1 -- 172.21.15.44:0/2437461108 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de69617380 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad93c00640 1 -- 172.21.15.44:0/2437461108 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55de69634c40 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad93c00640 1 -- 172.21.15.44:0/2437461108 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de69617520 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 -- 172.21.15.44:0/2437461108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de655d52c0 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 1 -- 172.21.15.44:0/2437461108 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55de655d43c0 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.826+0000 7fad98dd38c0 4 waiting for MDS map... 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad93c00640 1 -- 172.21.15.44:0/2437461108 <== mon.1 v2:172.21.15.86:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x55de6a524200 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad93c00640 1 -- 172.21.15.44:0/2437461108 <== mon.1 v2:172.21.15.86:3300/0 5 ==== fsmap(e 70) ==== 2893+0+0 (secure 0 0 0) 0x55de69637180 con 0x55de69661f80 2024-09-17T05:43:23.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 4 Got MDS map 70 2024-09-17T05:43:23.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 4 datascan.main: Using metadata pool output 2024-09-17T05:43:23.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 4 datascan.main: connecting to RADOS... 2024-09-17T05:43:23.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 Processor -- start 2024-09-17T05:43:23.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 -- start start 2024-09-17T05:43:23.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660d80 0x55de6975d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69662880 0x55de6975db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55de6a3ce180 con 0x55de69660d80 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de69641380 con 0x55de69660900 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55de69641800 con 0x55de69662880 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660d80 0x55de6975d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660d80 0x55de6975d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40238/0 (socket says 172.21.15.44:40238) 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 -- 172.21.15.44:0/1152219771 learned_addr learned my addr 172.21.15.44:0/1152219771 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96e00640 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 -- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69662880 msgr2=0x55de6975db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69662880 0x55de6975db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 -- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69660900 msgr2=0x55de6975d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 -- 172.21.15.44:0/1152219771 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de655d41e0 con 0x55de69660d80 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96e00640 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:23.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad96400640 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660d80 0x55de6975d080 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x55de6a50b4a0 tx=0x55de6a4fec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276edb3720392ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad91400640 1 -- 172.21.15.44:0/1152219771 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de69617380 con 0x55de69660d80 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad91400640 1 -- 172.21.15.44:0/1152219771 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55de69634540 con 0x55de69660d80 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.830+0000 7fad91400640 1 -- 172.21.15.44:0/1152219771 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de69617520 con 0x55de69660d80 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- 172.21.15.44:0/1152219771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660d80 msgr2=0x55de6975d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660d80 0x55de6975d080 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x55de6a50b4a0 tx=0x55de6a4fec00 comp rx=0 tx=0).stop 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- 172.21.15.44:0/1152219771 shutdown_connections 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69662880 0x55de6975db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/1152219771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660d80 0x55de6975d080 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- 172.21.15.44:0/1152219771 >> 172.21.15.44:0/1152219771 conn(0x55de69661200 msgr2=0x55de655da800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- 172.21.15.44:0/1152219771 shutdown_connections 2024-09-17T05:43:23.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- 172.21.15.44:0/1152219771 wait complete. 2024-09-17T05:43:23.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 Processor -- start 2024-09-17T05:43:23.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- start start 2024-09-17T05:43:23.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69660d80 0x55de6975d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69662880 0x55de6975db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55de6a3cf380 con 0x55de69660900 2024-09-17T05:43:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de6a3ce180 con 0x55de69662880 2024-09-17T05:43:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad98dd38c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55de6a3cf500 con 0x55de69660d80 2024-09-17T05:43:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40250/0 (socket says 172.21.15.44:40250) 2024-09-17T05:43:23.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 learned_addr learned my addr 172.21.15.44:0/3233024835 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96e00640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69660d80 0x55de6975d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69662880 0x55de6975db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69660d80 msgr2=0x55de6975d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69660d80 0x55de6975d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69662880 msgr2=0x55de6975db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69662880 0x55de6975db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de655d54a0 con 0x55de69660900 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.834+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660900 0x55de6975d600 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x55de699266f0 tx=0x55de6a4feea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad8f600640 1 -- 172.21.15.44:0/3233024835 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de69616820 con 0x55de69660900 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad8f600640 1 -- 172.21.15.44:0/3233024835 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55de69635a40 con 0x55de69660900 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad8f600640 1 -- 172.21.15.44:0/3233024835 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55de69617380 con 0x55de69660900 2024-09-17T05:43:23.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de655d5a40 con 0x55de69660900 2024-09-17T05:43:23.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de655d5c20 con 0x55de69660900 2024-09-17T05:43:23.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad98dd38c0 4 datascan.init: resolving metadata pool 13 2024-09-17T05:43:23.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad8f600640 1 -- 172.21.15.44:0/3233024835 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x55de69924c00 con 0x55de69660900 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad8f600640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55de69663a80 0x55de6975e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad8f600640 1 -- 172.21.15.44:0/3233024835 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x55de6991ca00 con 0x55de69660900 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad98dd38c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad98dd38c0 4 datascan.main: resolving metadata pool 13 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55de69662d00 0x55de6975e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad96e00640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55de69663a80 0x55de6975e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.838+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55de69662d00 0x55de6975e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55de69662d00 0x55de6975e680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96e00640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55de69663a80 0x55de6975e100 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55de6a50a090 tx=0x55de69a36480 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(1 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55de69a46000 0x55de69a4a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46000 2024-09-17T05:43:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55de69a46000 0x55de69a4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55de69a46000 0x55de69a4a000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(2 [pgnls start_epoch 94 out=177b] v94'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55de69a46480 0x55de69a4a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46480 2024-09-17T05:43:23.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96e00640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55de69a46480 0x55de69a4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96e00640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55de69a46480 0x55de69a4a580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(3 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a46480 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== osd_op_reply(4 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55de69a46900 0x55de69a4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46900 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.842+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55de69a46900 0x55de69a4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55de69a46900 0x55de69a4ab00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(5 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55de69a46d80 0x55de69a4b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46d80 2024-09-17T05:43:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55de69a46d80 0x55de69a4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55de69a46d80 0x55de69a4b080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(6 [pgnls start_epoch 94 out=149b] v93'26 uv26 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46d80 2024-09-17T05:43:23.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(7 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55de69a47200 0x55de69a4b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47200 2024-09-17T05:43:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96e00640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55de69a47200 0x55de69a4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96e00640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55de69a47200 0x55de69a4b600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(8 [pgnls start_epoch 94 out=73b] v93'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 3 ==== osd_op_reply(9 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46d80 2024-09-17T05:43:23.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.846+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(10 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55de69a47680 0x55de69a4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47680 2024-09-17T05:43:23.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55de69a47680 0x55de69a4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55de69a47680 0x55de69a4bb80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(11 [pgnls start_epoch 94 out=81b] v93'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55de696ea000 con 0x55de69a47680 2024-09-17T05:43:23.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46480 2024-09-17T05:43:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== osd_op_reply(12 [pgnls start_epoch 94 out=49b] v91'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a46480 2024-09-17T05:43:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46900 2024-09-17T05:43:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(13 [pgnls start_epoch 94 out=77b] v93'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46000 2024-09-17T05:43:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== osd_op_reply(14 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47200 2024-09-17T05:43:23.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== osd_op_reply(15 [pgnls start_epoch 94 out=73b] v93'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47200 2024-09-17T05:43:23.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 3 ==== osd_op_reply(16 [pgnls start_epoch 94 out=49b] v91'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 4 ==== osd_op_reply(17 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46d80 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 4 ==== osd_op_reply(18 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.850+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47200 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 4 ==== osd_op_reply(19 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46000 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 3 ==== osd_op_reply(20 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55de69a47b00 0x55de69a4c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47b00 2024-09-17T05:43:23.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55de69a47b00 0x55de69a4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:23.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55de69a47b00 0x55de69a4c100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:23.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(21 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a47b00 2024-09-17T05:43:23.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46900 2024-09-17T05:43:23.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(22 [pgnls start_epoch 94 out=97b] v93'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47200 2024-09-17T05:43:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 5 ==== osd_op_reply(23 [pgnls start_epoch 94 out=74b] v89'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 5 ==== osd_op_reply(24 [pgnls start_epoch 94 out=73b] v93'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46d80 2024-09-17T05:43:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 5 ==== osd_op_reply(25 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 6 ==== osd_op_reply(26 [pgnls start_epoch 94 out=98b] v93'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46900 2024-09-17T05:43:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.854+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 4 ==== osd_op_reply(27 [pgnls start_epoch 94 out=76b] v93'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47b00 2024-09-17T05:43:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== osd_op_reply(28 [pgnls start_epoch 94 out=73b] v93'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea500 con 0x55de69a47b00 2024-09-17T05:43:23.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46900 2024-09-17T05:43:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 5 ==== osd_op_reply(29 [pgnls start_epoch 94 out=73b] v93'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 7 ==== osd_op_reply(30 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a47b00 2024-09-17T05:43:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.2 v2:172.21.15.44:6808/1191521276 3 ==== osd_op_reply(31 [pgnls start_epoch 94 out=73b] v89'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea500 con 0x55de69a47b00 2024-09-17T05:43:23.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 8 ==== osd_op_reply(32 [pgnls start_epoch 94 out=101b] v93'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992d000 con 0x55de69a46000 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 4 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:34 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992dc00 con 0x55de69a46000 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 5 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-09-17T05:43:23.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:35 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68000 con 0x55de69a46000 2024-09-17T05:43:23.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 6 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 20 datascan.scan_links: injected ino detected 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:36 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68400 con 0x55de69a46000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 7 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.858+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:37 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68800 con 0x55de69a46000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 8 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-09-17T05:43:23.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:38 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68c00 con 0x55de69a46d80 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 6 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:39 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992d000 con 0x55de69a47200 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-09-17T05:43:23.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:40 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992dc00 con 0x55de69a47680 2024-09-17T05:43:23.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x55de696ea000 con 0x55de69a47680 2024-09-17T05:43:23.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-09-17T05:43:23.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-09-17T05:43:23.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:41 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6a523000 con 0x55de69a47200 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 7 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:42 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6a522c00 con 0x55de69a46900 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 6 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:43 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6a522800 con 0x55de69662d00 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 9 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:44 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68000 con 0x55de69662d00 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 10 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 200.00000002 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:45 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6a522c00 con 0x55de69a46900 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-09-17T05:43:23.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:46 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c800 con 0x55de69662d00 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 11 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) ==== 154+0+1041 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.862+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:47 13.0 13:00000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 12 ==== osd_op_reply(47 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:48 13.10 13:08000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46000 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 9 ==== osd_op_reply(48 [pgnls start_epoch 94 out=177b] v94'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:49 13.8 13:10000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46480 2024-09-17T05:43:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.5 v2:172.21.15.86:6822/2837964024 3 ==== osd_op_reply(49 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a46480 2024-09-17T05:43:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:50 13.18 13:18000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 13 ==== osd_op_reply(50 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:51 13.4 13:20000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46900 2024-09-17T05:43:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 8 ==== osd_op_reply(51 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:52 13.14 13:28000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46d80 2024-09-17T05:43:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 7 ==== osd_op_reply(52 [pgnls start_epoch 94 out=149b] v93'26 uv26 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:53 13.c 13:30000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46d80 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 8 ==== osd_op_reply(53 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:54 13.1c 13:38000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47200 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 8 ==== osd_op_reply(54 [pgnls start_epoch 94 out=73b] v93'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:55 13.2 13:40000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 14 ==== osd_op_reply(55 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:56 13.12 13:48000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46d80 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 9 ==== osd_op_reply(56 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:57 13.a 13:50000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47680 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.4 v2:172.21.15.86:6810/2781128627 3 ==== osd_op_reply(57 [pgnls start_epoch 94 out=81b] v93'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55de696ea000 con 0x55de69a47680 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.866+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:58 13.1a 13:58000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46480 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.5 v2:172.21.15.86:6822/2837964024 4 ==== osd_op_reply(58 [pgnls start_epoch 94 out=49b] v91'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a46480 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:59 13.6 13:60000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46900 2024-09-17T05:43:23.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 9 ==== osd_op_reply(59 [pgnls start_epoch 94 out=77b] v93'7 uv7 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:60 13.16 13:68000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46000 2024-09-17T05:43:23.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 10 ==== osd_op_reply(60 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:61 13.e 13:70000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47200 2024-09-17T05:43:23.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 9 ==== osd_op_reply(61 [pgnls start_epoch 94 out=73b] v93'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:62 13.1e 13:78000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47200 2024-09-17T05:43:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 10 ==== osd_op_reply(62 [pgnls start_epoch 94 out=49b] v91'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:63 13.1 13:80000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 15 ==== osd_op_reply(63 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:64 13.11 13:88000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46d80 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 10 ==== osd_op_reply(64 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:65 13.9 13:90000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47200 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 11 ==== osd_op_reply(65 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:66 13.19 13:98000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46000 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 11 ==== osd_op_reply(66 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:67 13.5 13:a0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47b00 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.2 v2:172.21.15.44:6808/1191521276 4 ==== osd_op_reply(67 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a47b00 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:68 13.15 13:a8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46900 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 10 ==== osd_op_reply(68 [pgnls start_epoch 94 out=97b] v93'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.870+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:69 13.d 13:b0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47200 2024-09-17T05:43:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 12 ==== osd_op_reply(69 [pgnls start_epoch 94 out=74b] v89'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:70 13.1d 13:b8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 16 ==== osd_op_reply(70 [pgnls start_epoch 94 out=73b] v93'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:71 13.3 13:c0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46d80 2024-09-17T05:43:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 11 ==== osd_op_reply(71 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:72 13.13 13:c8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 17 ==== osd_op_reply(72 [pgnls start_epoch 94 out=98b] v93'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:73 13.b 13:d0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46900 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 11 ==== osd_op_reply(73 [pgnls start_epoch 94 out=76b] v93'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:74 13.1b 13:d8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47b00 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.2 v2:172.21.15.44:6808/1191521276 5 ==== osd_op_reply(74 [pgnls start_epoch 94 out=73b] v93'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea500 con 0x55de69a47b00 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:75 13.7 13:e0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a46900 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 12 ==== osd_op_reply(75 [pgnls start_epoch 94 out=73b] v93'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:76 13.17 13:e8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 18 ==== osd_op_reply(76 [pgnls start_epoch 94 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:77 13.f 13:f0000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69a47b00 2024-09-17T05:43:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.2 v2:172.21.15.44:6808/1191521276 6 ==== osd_op_reply(77 [pgnls start_epoch 94 out=73b] v89'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x55de696ea500 con 0x55de69a47b00 2024-09-17T05:43:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:78 13.1f 13:f8000000::::head [pgnls start_epoch 94 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 19 ==== osd_op_reply(78 [pgnls start_epoch 94 out=101b] v93'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-09-17T05:43:23.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:79 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69a46000 2024-09-17T05:43:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 12 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-09-17T05:43:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.874+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:80 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992dc00 con 0x55de69a46000 2024-09-17T05:43:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 13 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:81 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a69000 con 0x55de69a46000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 14 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 20 datascan.scan_links: injected ino detected 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:82 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a69400 con 0x55de69a46000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 15 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:83 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a69800 con 0x55de69a46000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 16 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-09-17T05:43:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:84 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a69c00 con 0x55de69a46d80 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.6 v2:172.21.15.86:6802/218299486 12 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46d80 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:85 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68400 con 0x55de69a47200 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 13 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-09-17T05:43:23.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:86 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68800 con 0x55de69a47680 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.4 v2:172.21.15.86:6810/2781128627 4 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x55de696ea000 con 0x55de69a47680 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:87 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68c00 con 0x55de69a47200 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 14 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-09-17T05:43:23.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:88 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a69000 con 0x55de69a46900 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 13 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a69400 con 0x55de69662d00 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 20 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.878+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:90 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992cc00 con 0x55de69662d00 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 21 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 200.00000002 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:91 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992dc00 con 0x55de69a46900 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.3 v2:172.21.15.44:6824/2051542036 14 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x55de696ea000 con 0x55de69a46900 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-09-17T05:43:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:92 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68400 con 0x55de69662d00 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 22 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) ==== 154+0+1041 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:93 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68c00 con 0x55de69a46000 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 17 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-09-17T05:43:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:94 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55de69a68000 con 0x55de69a46000 2024-09-17T05:43:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 18 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v94'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-09-17T05:43:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: processing 1 injected_inos 2024-09-17T05:43:23.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.882+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:95 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992d000 con 0x55de69a46000 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 19 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 20 datascan.scan_links: first is now 2 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:96 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c800 con 0x55de69a46000 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad97800640 1 -- 172.21.15.44:0/3233024835 <== osd.7 v2:172.21.15.86:6818/3939301135 20 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v94'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55de696ea500 con 0x55de69a46000 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 10 datascan.scan_links: updating inotable 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6992c400 con 0x55de69662d00 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 23 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-09-17T05:43:23.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-09-17T05:43:23.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.886+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) -- 0x55de6a523000 con 0x55de69662d00 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad96400640 1 -- 172.21.15.44:0/3233024835 <== osd.1 v2:172.21.15.44:6816/298260573 24 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v94'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x55de696ea000 con 0x55de69662d00 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 10 datascan.scan_links: updating snaptable 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:99 13.d 13:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) -- 0x55de6a522800 con 0x55de69a47200 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 <== osd.0 v2:172.21.15.44:6800/3049588557 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x55de696ea780 con 0x55de69a47200 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55de69a47200 msgr2=0x55de69a4b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55de69a47200 0x55de69a4b600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55de69662d00 msgr2=0x55de6975e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55de69662d00 0x55de6975e680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55de69a47b00 msgr2=0x55de69a4c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55de69a47b00 0x55de69a4c100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55de69a46900 msgr2=0x55de69a4ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 reap_dead start 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55de69a46900 0x55de69a4ab00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55de69a47680 msgr2=0x55de69a4bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55de69a47680 0x55de69a4bb80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55de69a46480 msgr2=0x55de69a4a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55de69a46480 0x55de69a4a580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55de69a46d80 msgr2=0x55de69a4b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55de69a46d80 0x55de69a4b080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55de69a46000 msgr2=0x55de69a4a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55de69a46000 0x55de69a4a000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55de69663a80 msgr2=0x55de6975e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad96e00640 1 -- 172.21.15.44:0/3233024835 reap_dead start 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55de69663a80 0x55de6975e100 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55de6a50a090 tx=0x55de69a36480 comp rx=0 tx=0).stop 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660900 msgr2=0x55de6975d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660900 0x55de6975d600 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x55de699266f0 tx=0x55de6a4feea0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 shutdown_connections 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55de69663a80 0x55de6975e100 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/3233024835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69660900 0x55de6975d600 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 >> 172.21.15.44:0/3233024835 conn(0x55de69661200 msgr2=0x55de655da800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 shutdown_connections 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/3233024835 wait complete. 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/2437461108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69661f80 msgr2=0x55de6975cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69661f80 0x55de6975cb00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55de6a439680 tx=0x55de69760360 comp rx=0 tx=0).stop 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/2437461108 shutdown_connections 2024-09-17T05:43:23.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de69661f80 0x55de6975cb00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55de69661b00 0x55de6975c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 --2- 172.21.15.44:0/2437461108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55de69661680 0x55de6975c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/2437461108 >> 172.21.15.44:0/2437461108 conn(0x55de69662400 msgr2=0x55de655db800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/2437461108 shutdown_connections 2024-09-17T05:43:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:23.890+0000 7fad98dd38c0 1 -- 172.21.15.44:0/2437461108 wait complete. 2024-09-17T05:43:23.895 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.125936, result: 2024-09-17T05:43:23.895 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 -- 172.21.15.44:0/2671311429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 msgr2=0x7f8cc00b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 --2- 172.21.15.44:0/2671311429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 0x7f8cc00b1be0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009840 tx=0x7f8cb401c760 comp rx=0 tx=0).stop 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 -- 172.21.15.44:0/2671311429 shutdown_connections 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 --2- 172.21.15.44:0/2671311429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cc00d1d00 0x7f8cc00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 --2- 172.21.15.44:0/2671311429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 0x7f8cc00b1be0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 -- 172.21.15.44:0/2671311429 >> 172.21.15.44:0/2671311429 conn(0x7f8cc00b4240 msgr2=0x7f8cc00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 -- 172.21.15.44:0/2671311429 shutdown_connections 2024-09-17T05:43:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.058+0000 7f8cc8800640 1 -- 172.21.15.44:0/2671311429 wait complete. 2024-09-17T05:43:24.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 Processor -- start 2024-09-17T05:43:24.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 -- start start 2024-09-17T05:43:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cc00cf5b0 0x7f8cc01fb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 0x7f8cc00cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cc00d1d00 0x7f8cc01555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0169ee0 con 0x7f8cc00d1d00 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0169d60 con 0x7f8cc00d18f0 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc8800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc016a060 con 0x7f8cc00cf5b0 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cc00d1d00 0x7f8cc01555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cc00d1d00 0x7f8cc01555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40264/0 (socket says 172.21.15.44:40264) 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc6800640 1 -- 172.21.15.44:0/3706564646 learned_addr learned my addr 172.21.15.44:0/3706564646 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc5400640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 0x7f8cc00cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.062+0000 7f8cc5e00640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cc00cf5b0 0x7f8cc01fb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc6800640 1 -- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cc00cf5b0 msgr2=0x7f8cc01fb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc6800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cc00cf5b0 0x7f8cc01fb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc6800640 1 -- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 msgr2=0x7f8cc00cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc6800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 0x7f8cc00cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc6800640 1 -- 172.21.15.44:0/3706564646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc00cbc00 con 0x7f8cc00d1d00 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc6800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cc00d1d00 0x7f8cc01555e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00caf0 tx=0x7f8cbc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cba000640 1 -- 172.21.15.44:0/3706564646 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc016020 con 0x7f8cc00d1d00 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cba000640 1 -- 172.21.15.44:0/3706564646 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cbc00a930 con 0x7f8cc00d1d00 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cba000640 1 -- 172.21.15.44:0/3706564646 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00ae00 con 0x7f8cc00d1d00 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc00cb9d0 con 0x7f8cc00d1d00 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc0159c60 con 0x7f8cc00d1d00 2024-09-17T05:43:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc00cbe70 con 0x7f8cc00d1d00 2024-09-17T05:43:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.066+0000 7f8cba000640 1 -- 172.21.15.44:0/3706564646 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8cbc019020 con 0x7f8cc00d1d00 2024-09-17T05:43:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.070+0000 7f8cba000640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ca4073200 0x7f8ca4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.070+0000 7f8cba000640 1 -- 172.21.15.44:0/3706564646 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f8cbc0949c0 con 0x7f8cc00d1d00 2024-09-17T05:43:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.070+0000 7f8cc5e00640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ca4073200 0x7f8ca4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.070+0000 7f8cc5e00640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ca4073200 0x7f8ca4075710 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40af000 tx=0x7f8cb401afa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.070+0000 7f8cba000640 1 -- 172.21.15.44:0/3706564646 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8cbc020020 con 0x7f8cc00d1d00 2024-09-17T05:43:24.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.286+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f8cc00b1be0 con 0x7f8cc00d1d00 2024-09-17T05:43:24.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cba000640 1 -- 172.21.15.44:0/3706564646 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v71) ==== 162+0+0 (secure 0 0 0) 0x7f8cc00cf9c0 con 0x7f8cc00d1d00 2024-09-17T05:43:24.480 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ca4073200 msgr2=0x7f8ca4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ca4073200 0x7f8ca4075710 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40af000 tx=0x7f8cb401afa0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cc00d1d00 msgr2=0x7f8cc01555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cc00d1d00 0x7f8cc01555e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00caf0 tx=0x7f8cbc00cbe0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 shutdown_connections 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cc00d1d00 0x7f8cc01555e0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ca4073200 0x7f8ca4075710 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cc00d18f0 0x7f8cc00cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 --2- 172.21.15.44:0/3706564646 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8cc00cf5b0 0x7f8cc01fb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 >> 172.21.15.44:0/3706564646 conn(0x7f8cc00b4240 msgr2=0x7f8cc0068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:24.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 shutdown_connections 2024-09-17T05:43:24.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.482+0000 7f8cc8800640 1 -- 172.21.15.44:0/3706564646 wait complete. 2024-09-17T05:43:24.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 -- 172.21.15.44:0/1823733834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a8072e50 msgr2=0x7f17a815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 --2- 172.21.15.44:0/1823733834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a8072e50 0x7f17a815e990 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f17a80cb0b0 tx=0x7f179c01c830 comp rx=0 tx=0).stop 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 -- 172.21.15.44:0/1823733834 shutdown_connections 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 --2- 172.21.15.44:0/1823733834 >> v2:172.21.15.86:3300/0 conn(0x7f17a806de50 0x7f17a806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 --2- 172.21.15.44:0/1823733834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a8072e50 0x7f17a815e990 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 -- 172.21.15.44:0/1823733834 >> 172.21.15.44:0/1823733834 conn(0x7f17a80ccaa0 msgr2=0x7f17a80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 -- 172.21.15.44:0/1823733834 shutdown_connections 2024-09-17T05:43:24.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.670+0000 7f17b0400640 1 -- 172.21.15.44:0/1823733834 wait complete. 2024-09-17T05:43:24.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 Processor -- start 2024-09-17T05:43:24.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 -- start start 2024-09-17T05:43:24.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a806de50 0x7f17a815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17a8072e50 0x7f17a80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17a80ced00 0x7f17a8070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8169360 con 0x7f17a806de50 2024-09-17T05:43:24.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f17a81691e0 con 0x7f17a80ced00 2024-09-17T05:43:24.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f17a81694e0 con 0x7f17a8072e50 2024-09-17T05:43:24.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ada00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a806de50 0x7f17a815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ad000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17a8072e50 0x7f17a80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ad000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17a8072e50 0x7f17a80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:38446/0 (socket says 172.21.15.44:38446) 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ad000640 1 -- 172.21.15.44:0/3562844461 learned_addr learned my addr 172.21.15.44:0/3562844461 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ae400640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17a80ced00 0x7f17a8070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ada00640 1 -- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17a8072e50 msgr2=0x7f17a80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ada00640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17a8072e50 0x7f17a80702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ada00640 1 -- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17a80ced00 msgr2=0x7f17a8070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ada00640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17a80ced00 0x7f17a8070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ada00640 1 -- 172.21.15.44:0/3562844461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a80c2f20 con 0x7f17a806de50 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ad000640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17a8072e50 0x7f17a80702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:24.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17ada00640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a806de50 0x7f17a815a8d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f179c0ac000 tx=0x7f179c0a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:24.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17a5600640 1 -- 172.21.15.44:0/3562844461 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c0b2040 con 0x7f17a806de50 2024-09-17T05:43:24.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17a5600640 1 -- 172.21.15.44:0/3562844461 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f179c0041b0 con 0x7f17a806de50 2024-09-17T05:43:24.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17a5600640 1 -- 172.21.15.44:0/3562844461 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c003600 con 0x7f17a806de50 2024-09-17T05:43:24.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a80b5280 con 0x7f17a806de50 2024-09-17T05:43:24.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.674+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a8159b10 con 0x7f17a806de50 2024-09-17T05:43:24.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.678+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a80b50a0 con 0x7f17a806de50 2024-09-17T05:43:24.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.678+0000 7f17a5600640 1 -- 172.21.15.44:0/3562844461 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f179c0bf030 con 0x7f17a806de50 2024-09-17T05:43:24.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.678+0000 7f17a5600640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1788073230 0x7f1788075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:24.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.678+0000 7f17a5600640 1 -- 172.21.15.44:0/3562844461 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f179c12e4a0 con 0x7f17a806de50 2024-09-17T05:43:24.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.678+0000 7f17ad000640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1788073230 0x7f1788075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:24.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.682+0000 7f17ad000640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1788073230 0x7f1788075740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17a815dfd0 tx=0x7f179400b390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:24.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.682+0000 7f17a5600640 1 -- 172.21.15.44:0/3562844461 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f17a80b50a0 con 0x7f17a806de50 2024-09-17T05:43:24.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.890+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17a806e260 con 0x7f17a806de50 2024-09-17T05:43:24.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.890+0000 7f17a5600640 1 -- 172.21.15.44:0/3562844461 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5216 (secure 0 0 0) 0x7f179c0164b0 con 0x7f17a806de50 2024-09-17T05:43:24.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:43:24.890 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":72,"btime":"2024-09-17T05:43:24:485815+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:24.485802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T05:43:24.890 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 72 2024-09-17T05:43:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1788073230 msgr2=0x7f1788075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1788073230 0x7f1788075740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17a815dfd0 tx=0x7f179400b390 comp rx=0 tx=0).stop 2024-09-17T05:43:24.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a806de50 msgr2=0x7f17a815a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a806de50 0x7f17a815a8d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f179c0ac000 tx=0x7f179c0a5680 comp rx=0 tx=0).stop 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 shutdown_connections 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1788073230 0x7f1788075740 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17a80ced00 0x7f17a8070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f17a8072e50 0x7f17a80702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 --2- 172.21.15.44:0/3562844461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f17a806de50 0x7f17a815a8d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 >> 172.21.15.44:0/3562844461 conn(0x7f17a80ccaa0 msgr2=0x7f17a80cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 shutdown_connections 2024-09-17T05:43:24.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:24.894+0000 7f17b0400640 1 -- 172.21.15.44:0/3562844461 wait complete. 2024-09-17T05:43:25.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:01.792332+0000', 'modified': '2024-09-17T05:43:24.485802+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7344': {'gid': 7344, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/1038379221', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1038379221}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1038379221}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:43:25.316 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7344:up:replay 2024-09-17T05:43:26.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 -- 172.21.15.44:0/446753532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c806ce40 msgr2=0x7f07c806d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 --2- 172.21.15.44:0/446753532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c806ce40 0x7f07c806d250 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f07c8072160 tx=0x7f07c001cb60 comp rx=0 tx=0).stop 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 -- 172.21.15.44:0/446753532 shutdown_connections 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 --2- 172.21.15.44:0/446753532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c806ce40 0x7f07c806d250 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 --2- 172.21.15.44:0/446753532 >> v2:172.21.15.86:3300/0 conn(0x7f07c80b3fb0 0x7f07c80b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 -- 172.21.15.44:0/446753532 >> 172.21.15.44:0/446753532 conn(0x7f07c806fb90 msgr2=0x7f07c806ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 -- 172.21.15.44:0/446753532 shutdown_connections 2024-09-17T05:43:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.490+0000 7f07c7e00640 1 -- 172.21.15.44:0/446753532 wait complete. 2024-09-17T05:43:26.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 Processor -- start 2024-09-17T05:43:26.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 -- start start 2024-09-17T05:43:26.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c806ce40 0x7f07c813e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:26.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b3fb0 0x7f07c815f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c8144f70 0x7f07c8165430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8169c20 con 0x7f07c8144f70 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f07c8169aa0 con 0x7f07c80b3fb0 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f07c8169da0 con 0x7f07c806ce40 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.494+0000 7f07c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c8144f70 0x7f07c8165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c8144f70 0x7f07c8165430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40322/0 (socket says 172.21.15.44:40322) 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 -- 172.21.15.44:0/2098990132 learned_addr learned my addr 172.21.15.44:0/2098990132 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c6000640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b3fb0 0x7f07c815f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c6a00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c806ce40 0x7f07c813e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 -- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c806ce40 msgr2=0x7f07c813e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c806ce40 0x7f07c813e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 -- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b3fb0 msgr2=0x7f07c815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b3fb0 0x7f07c815f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 -- 172.21.15.44:0/2098990132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c813efd0 con 0x7f07c8144f70 2024-09-17T05:43:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c6a00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c806ce40 0x7f07c813e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7400640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c8144f70 0x7f07c8165430 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f07c001c5d0 tx=0x7f07c0005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:26.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07bea00640 1 -- 172.21.15.44:0/2098990132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c00b2040 con 0x7f07c8144f70 2024-09-17T05:43:26.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07bea00640 1 -- 172.21.15.44:0/2098990132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07c00bb070 con 0x7f07c8144f70 2024-09-17T05:43:26.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c813f2b0 con 0x7f07c8144f70 2024-09-17T05:43:26.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07bea00640 1 -- 172.21.15.44:0/2098990132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c0004530 con 0x7f07c8144f70 2024-09-17T05:43:26.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c813f870 con 0x7f07c8144f70 2024-09-17T05:43:26.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c813ec70 con 0x7f07c8144f70 2024-09-17T05:43:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.498+0000 7f07bea00640 1 -- 172.21.15.44:0/2098990132 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f07c00046d0 con 0x7f07c8144f70 2024-09-17T05:43:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.502+0000 7f07bea00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a8073200 0x7f07a8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.502+0000 7f07bea00640 1 -- 172.21.15.44:0/2098990132 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f07c012efa0 con 0x7f07c8144f70 2024-09-17T05:43:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.502+0000 7f07c6a00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a8073200 0x7f07a8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:26.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.502+0000 7f07c6a00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a8073200 0x7f07a8075710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000f70 tx=0x7f07b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:26.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.506+0000 7f07bea00640 1 -- 172.21.15.44:0/2098990132 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f07c0016750 con 0x7f07c8144f70 2024-09-17T05:43:26.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.714+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07c806d250 con 0x7f07c8144f70 2024-09-17T05:43:26.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.714+0000 7f07bea00640 1 -- 172.21.15.44:0/2098990132 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5216 (secure 0 0 0) 0x7f07c00f9c40 con 0x7f07c8144f70 2024-09-17T05:43:26.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:43:26.715 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":74,"btime":"2024-09-17T05:43:26:490972+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:25.493848+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-17T05:43:26.715 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 74 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a8073200 msgr2=0x7f07a8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a8073200 0x7f07a8075710 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f07b8000f70 tx=0x7f07b8009040 comp rx=0 tx=0).stop 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c8144f70 msgr2=0x7f07c8165430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c8144f70 0x7f07c8165430 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f07c001c5d0 tx=0x7f07c0005a60 comp rx=0 tx=0).stop 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 shutdown_connections 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07c8144f70 0x7f07c8165430 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07a8073200 0x7f07a8075710 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07c80b3fb0 0x7f07c815f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 --2- 172.21.15.44:0/2098990132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07c806ce40 0x7f07c813e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 >> 172.21.15.44:0/2098990132 conn(0x7f07c806fb90 msgr2=0x7f07c813d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:26.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 shutdown_connections 2024-09-17T05:43:26.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:26.718+0000 7f07c7e00640 1 -- 172.21.15.44:0/2098990132 wait complete. 2024-09-17T05:43:27.139 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:01.792332+0000', 'modified': '2024-09-17T05:43:25.493848+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7344': {'gid': 7344, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.44:6835/1038379221', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1038379221}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1038379221}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:43:27.139 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7344:up:rejoin 2024-09-17T05:43:28.140 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:43:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.314+0000 7efe49a00640 1 -- 172.21.15.44:0/3567441194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 msgr2=0x7efe28004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.314+0000 7efe49a00640 1 --2- 172.21.15.44:0/3567441194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe28004c20 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009b40 tx=0x7efe2c01d250 comp rx=0 tx=0).stop 2024-09-17T05:43:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.314+0000 7efe49a00640 1 -- 172.21.15.44:0/3567441194 shutdown_connections 2024-09-17T05:43:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.314+0000 7efe49a00640 1 --2- 172.21.15.44:0/3567441194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe28004c20 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.314+0000 7efe49a00640 1 -- 172.21.15.44:0/3567441194 >> 172.21.15.44:0/3567441194 conn(0x7efe440ccaa0 msgr2=0x7efe440cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.314+0000 7efe49a00640 1 -- 172.21.15.44:0/3567441194 shutdown_connections 2024-09-17T05:43:28.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.314+0000 7efe49a00640 1 -- 172.21.15.44:0/3567441194 wait complete. 2024-09-17T05:43:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 Processor -- start 2024-09-17T05:43:28.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 -- start start 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe441eb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe4406f3c0 0x7efe44158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe440b06d0 0x7efe440b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe440cf9e0 con 0x7efe28004810 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe440cf860 con 0x7efe440b06d0 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efe440cfb60 con 0x7efe4406f3c0 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe441eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:28.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe441eb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40344/0 (socket says 172.21.15.44:40344) 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 -- 172.21.15.44:0/3157067697 learned_addr learned my addr 172.21.15.44:0/3157067697 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe43400640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe440b06d0 0x7efe440b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe3a000640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe4406f3c0 0x7efe44158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 -- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe4406f3c0 msgr2=0x7efe44158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe4406f3c0 0x7efe44158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 -- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe440b06d0 msgr2=0x7efe440b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe440b06d0 0x7efe440b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 -- 172.21.15.44:0/3157067697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe440b1020 con 0x7efe28004810 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe3a000640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe4406f3c0 0x7efe44158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:28.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe42a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe441eb580 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7efe34006e80 tx=0x7efe340049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe3b400640 1 -- 172.21.15.44:0/3157067697 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34015020 con 0x7efe28004810 2024-09-17T05:43:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe3b400640 1 -- 172.21.15.44:0/3157067697 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe34011960 con 0x7efe28004810 2024-09-17T05:43:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe441fa060 con 0x7efe28004810 2024-09-17T05:43:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe3b400640 1 -- 172.21.15.44:0/3157067697 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34011d30 con 0x7efe28004810 2024-09-17T05:43:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.318+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe441ec140 con 0x7efe28004810 2024-09-17T05:43:28.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.322+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe440cbc60 con 0x7efe28004810 2024-09-17T05:43:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.322+0000 7efe3b400640 1 -- 172.21.15.44:0/3157067697 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe34018020 con 0x7efe28004810 2024-09-17T05:43:28.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.322+0000 7efe3b400640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe20073230 0x7efe20075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.322+0000 7efe3b400640 1 -- 172.21.15.44:0/3157067697 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7efe34095140 con 0x7efe28004810 2024-09-17T05:43:28.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.322+0000 7efe3a000640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe20073230 0x7efe20075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:28.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.326+0000 7efe3a000640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe20073230 0x7efe20075740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0ad000 tx=0x7efe2c019ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:28.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.326+0000 7efe3b400640 1 -- 172.21.15.44:0/3157067697 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efe3401f020 con 0x7efe28004810 2024-09-17T05:43:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe440b5fa0 con 0x7efe28004810 2024-09-17T05:43:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe3b400640 1 -- 172.21.15.44:0/3157067697 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5223 (secure 0 0 0) 0x7efe440b1020 con 0x7efe28004810 2024-09-17T05:43:28.540 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:43:28.540 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"btime":"2024-09-17T05:43:27:494628+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:27.494619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7344,"qdb_cluster":[7344]},"id":6}]} 2024-09-17T05:43:28.540 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2024-09-17T05:43:28.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe20073230 msgr2=0x7efe20075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:28.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe20073230 0x7efe20075740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0ad000 tx=0x7efe2c019ff0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 msgr2=0x7efe441eb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:28.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe441eb580 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7efe34006e80 tx=0x7efe340049e0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 shutdown_connections 2024-09-17T05:43:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efe20073230 0x7efe20075740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe440b06d0 0x7efe440b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efe4406f3c0 0x7efe44158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 --2- 172.21.15.44:0/3157067697 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe28004810 0x7efe441eb580 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 >> 172.21.15.44:0/3157067697 conn(0x7efe440ccaa0 msgr2=0x7efe440ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 shutdown_connections 2024-09-17T05:43:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:28.542+0000 7efe49a00640 1 -- 172.21.15.44:0/3157067697 wait complete. 2024-09-17T05:43:28.965 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:42:01.792332+0000', 'modified': '2024-09-17T05:43:27.494619+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7344}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7344': {'gid': 7344, 'name': 'a', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6835/1038379221', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1038379221}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1038379221}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7344, 'qdb_cluster': [7344]} 2024-09-17T05:43:28.965 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:43:28.965 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:43:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 -- 172.21.15.44:0/3270615029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 msgr2=0x7f75240cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 --2- 172.21.15.44:0/3270615029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f75240cbca0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f750c009840 tx=0x7f750c01c820 comp rx=0 tx=0).stop 2024-09-17T05:43:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 -- 172.21.15.44:0/3270615029 shutdown_connections 2024-09-17T05:43:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 --2- 172.21.15.44:0/3270615029 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f75240cbca0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 -- 172.21.15.44:0/3270615029 >> 172.21.15.44:0/3270615029 conn(0x7f75240cd930 msgr2=0x7f75240cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 -- 172.21.15.44:0/3270615029 shutdown_connections 2024-09-17T05:43:29.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 -- 172.21.15.44:0/3270615029 wait complete. 2024-09-17T05:43:29.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 Processor -- start 2024-09-17T05:43:29.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.130+0000 7f752b000640 1 -- start start 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75240cc1e0 0x7f75241f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f752414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f752415d560 0x7f75240b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f752416b020 con 0x7f752415a080 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f752416aea0 con 0x7f752415d560 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f752416b1a0 con 0x7f75240cc1e0 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f752414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f752414f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48428/0 (socket says 172.21.15.44:48428) 2024-09-17T05:43:29.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 -- 172.21.15.44:0/541707694 learned_addr learned my addr 172.21.15.44:0/541707694 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f7523e00640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75240cc1e0 0x7f75241f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f7529000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f752415d560 0x7f75240b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 -- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75240cc1e0 msgr2=0x7f75241f96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75240cc1e0 0x7f75241f96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 -- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f752415d560 msgr2=0x7f75240b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f752415d560 0x7f75240b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 -- 172.21.15.44:0/541707694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7524153440 con 0x7f752415a080 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f7529000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f752415d560 0x7f75240b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:43:29.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f751be00640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f752414f2b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f750c009790 tx=0x7f750c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f7520c00640 1 -- 172.21.15.44:0/541707694 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c0042f0 con 0x7f752415a080 2024-09-17T05:43:29.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f7520c00640 1 -- 172.21.15.44:0/541707694 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f750c0bd070 con 0x7f752415a080 2024-09-17T05:43:29.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f7520c00640 1 -- 172.21.15.44:0/541707694 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c005290 con 0x7f752415a080 2024-09-17T05:43:29.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75241fd0c0 con 0x7f752415a080 2024-09-17T05:43:29.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75240d0270 con 0x7f752415a080 2024-09-17T05:43:29.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.134+0000 7f7520c00640 1 -- 172.21.15.44:0/541707694 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f750c005430 con 0x7f752415a080 2024-09-17T05:43:29.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7520c00640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7500073200 0x7f7500075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7520c00640 1 -- 172.21.15.44:0/541707694 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f750c12eb40 con 0x7f752415a080 2024-09-17T05:43:29.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 Processor -- start 2024-09-17T05:43:29.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7500073200 0x7f7500075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 -- start start 2024-09-17T05:43:29.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7500073200 0x7f7500075710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75140046c0 tx=0x7f7514007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa7026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 0x5566fa702be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 0x5566fa703120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5566fa5d7410 con 0x5566fa1c1460 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5566fa514b40 con 0x5566fa5b1950 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5566fa503f70 con 0x5566fa59aca0 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa7026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa7026a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48432/0 (socket says 172.21.15.44:48432) 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 -- 172.21.15.44:0/3885613911 learned_addr learned my addr 172.21.15.44:0/3885613911 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f751be00640 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 0x5566fa702be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7529000640 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 0x5566fa703120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 -- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 msgr2=0x5566fa703120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 0x5566fa703120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 -- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 msgr2=0x5566fa702be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 0x5566fa702be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 -- 172.21.15.44:0/3885613911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566fa4cb5b0 con 0x5566fa1c1460 2024-09-17T05:43:29.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.138+0000 7f7523e00640 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa7026a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f751400fb20 tx=0x7f7514012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3573d5bfba0d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f7518c00640 1 -- 172.21.15.44:0/3885613911 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751401b050 con 0x5566fa1c1460 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f7518c00640 1 -- 172.21.15.44:0/3885613911 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7514025070 con 0x5566fa1c1460 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f7518c00640 1 -- 172.21.15.44:0/3885613911 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514020440 con 0x5566fa1c1460 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- 172.21.15.44:0/3885613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 msgr2=0x5566fa7026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa7026a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f751400fb20 tx=0x7f7514012000 comp rx=0 tx=0).stop 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- 172.21.15.44:0/3885613911 shutdown_connections 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 0x5566fa703120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 0x5566fa702be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 --2- 172.21.15.44:0/3885613911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa7026a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- 172.21.15.44:0/3885613911 >> 172.21.15.44:0/3885613911 conn(0x5566fa687d90 msgr2=0x5566fa6b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- 172.21.15.44:0/3885613911 shutdown_connections 2024-09-17T05:43:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- 172.21.15.44:0/3885613911 wait complete. 2024-09-17T05:43:29.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- start start 2024-09-17T05:43:29.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 Processor -- start 2024-09-17T05:43:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa709920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa59aca0 0x5566fa709e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa70a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5566fa49e5f0 con 0x5566fa1c1460 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5566fa507d80 con 0x5566fa59aca0 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.142+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5566fa4aa520 con 0x5566fa5b1950 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 10 client.0 _ll_register_callbacks cb 0x5566fa4ae830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa709920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa709920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48436/0 (socket says 172.21.15.44:48436) 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 -- 172.21.15.44:0/3940631684 learned_addr learned my addr 172.21.15.44:0/3940631684 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f751be00640 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa59aca0 0x5566fa709e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7529000640 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa70a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 -- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 msgr2=0x5566fa70a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa70a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 -- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa59aca0 msgr2=0x5566fa709e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa59aca0 0x5566fa709e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 -- 172.21.15.44:0/3940631684 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566fa4a2190 con 0x5566fa1c1460 2024-09-17T05:43:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7523e00640 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa709920 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x5566fa50e7e0 tx=0x7f7514020650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc94f8c7fe7ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 1 -- 172.21.15.44:0/3940631684 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514020c50 con 0x5566fa1c1460 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 1 -- 172.21.15.44:0/3940631684 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f7514020df0 con 0x5566fa1c1460 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566fa49c110 con 0x5566fa1c1460 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 1 -- 172.21.15.44:0/3940631684 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f751401b020 con 0x5566fa1c1460 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 10 client.7410 fetch_fsmap learned FSMap version 75 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5566fa588f10 con 0x5566fa1c1460 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 1 -- 172.21.15.44:0/3940631684 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5566fa49c110 con 0x5566fa1c1460 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 1 -- 172.21.15.44:0/3940631684 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f751403b080 con 0x5566fa1c1460 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 10 client.7410 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 10 client.7410 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 20 client.7410 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa1a67d0 0x5566fa713d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 4 client.7410 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:43:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566fa516a90 con 0x5566fa1a67d0 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f751be00640 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa1a67d0 0x5566fa713d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f751be00640 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa1a67d0 0x5566fa713d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=132c9fdee0b5a8c8 server_cookie=34f71b4542632c38 in_seq=0 out_seq=0 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 10 client.7410 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 1 -- 172.21.15.44:0/3940631684 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5566fa516a90 con 0x5566fa1a67d0 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f7511600640 10 client.7410 handle_command_reply: tid=0 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 client.7410 shutdown 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 msgr2=0x5566fa709920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa709920 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x5566fa50e7e0 tx=0x7f7514020650 comp rx=0 tx=0).stop 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 shutdown_connections 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa1a67d0 0x5566fa713d00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.146+0000 7f753288b000 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa70a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.150+0000 7f753288b000 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa59aca0 0x5566fa709e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.150+0000 7f7511600640 0 client.7410 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.150+0000 7f753288b000 1 --2- 172.21.15.44:0/3940631684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa709920 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.150+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 >> 172.21.15.44:0/3940631684 conn(0x5566fa687d90 msgr2=0x5566fa6be440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.150+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 shutdown_connections 2024-09-17T05:43:29.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.150+0000 7f753288b000 1 -- 172.21.15.44:0/3940631684 wait complete. 2024-09-17T05:43:29.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.150+0000 7f753288b000 20 client.7410 trim_cache size 0 max 16384 2024-09-17T05:43:29.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.166+0000 7f753288b000 1 Processor -- start 2024-09-17T05:43:29.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.166+0000 7f753288b000 1 -- start start 2024-09-17T05:43:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa774620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 0x5566fa774b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 0x5566fa7750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7524206140 con 0x5566fa1c1460 2024-09-17T05:43:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7524205120 con 0x5566fa5b1950 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f75240cf310 con 0x5566fa59aca0 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa774620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa774620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48440/0 (socket says 172.21.15.44:48440) 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 -- 172.21.15.44:0/4142748971 learned_addr learned my addr 172.21.15.44:0/4142748971 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 -- 172.21.15.44:0/4142748971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 msgr2=0x5566fa774b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 --2- 172.21.15.44:0/4142748971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 0x5566fa774b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 -- 172.21.15.44:0/4142748971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 msgr2=0x5566fa7750a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 --2- 172.21.15.44:0/4142748971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 0x5566fa7750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 -- 172.21.15.44:0/4142748971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566fa55fdb0 con 0x5566fa1c1460 2024-09-17T05:43:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7523e00640 1 --2- 172.21.15.44:0/4142748971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa774620 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7514001ec0 tx=0x7f751400f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e16efc1ef52fb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7513e00640 1 -- 172.21.15.44:0/4142748971 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514020a50 con 0x5566fa1c1460 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7513e00640 1 -- 172.21.15.44:0/4142748971 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7514025040 con 0x5566fa1c1460 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f7513e00640 1 -- 172.21.15.44:0/4142748971 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514033390 con 0x5566fa1c1460 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- 172.21.15.44:0/4142748971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 msgr2=0x5566fa774620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 --2- 172.21.15.44:0/4142748971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa774620 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7514001ec0 tx=0x7f751400f9f0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- 172.21.15.44:0/4142748971 shutdown_connections 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 --2- 172.21.15.44:0/4142748971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa5b1950 0x5566fa7750a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 --2- 172.21.15.44:0/4142748971 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa59aca0 0x5566fa774b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 --2- 172.21.15.44:0/4142748971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa1c1460 0x5566fa774620 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- 172.21.15.44:0/4142748971 >> 172.21.15.44:0/4142748971 conn(0x5566fa687d90 msgr2=0x5566fa700620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- 172.21.15.44:0/4142748971 shutdown_connections 2024-09-17T05:43:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- 172.21.15.44:0/4142748971 wait complete. 2024-09-17T05:43:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 -- start start 2024-09-17T05:43:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.170+0000 7f753288b000 1 Processor -- start 2024-09-17T05:43:29.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa1c1460 0x5566fa778390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa59aca0 0x5566fa7788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa778e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5566fa5c3750 con 0x5566fa59aca0 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5566fa513910 con 0x5566fa1c1460 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5566fa4cfee0 con 0x5566fa5b1950 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 10 client.0 _ll_register_callbacks cb 0x7f750c005720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa59aca0 0x5566fa7788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa59aca0 0x5566fa7788d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48450/0 (socket says 172.21.15.44:48450) 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 -- 172.21.15.44:0/1586520970 learned_addr learned my addr 172.21.15.44:0/1586520970 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7523e00640 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa1c1460 0x5566fa778390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7529000640 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa778e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 -- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 msgr2=0x5566fa778e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa778e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 -- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa1c1460 msgr2=0x5566fa778390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa1c1460 0x5566fa778390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 -- 172.21.15.44:0/1586520970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566fa4caab0 con 0x5566fa59aca0 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f751be00640 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa59aca0 0x5566fa7788d0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f750c009840 tx=0x7f750c100040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b071036cd56e86af server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7511600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7511600640 1 -- 172.21.15.44:0/1586520970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c0f9870 con 0x5566fa59aca0 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7511600640 1 -- 172.21.15.44:0/1586520970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f750c0f83d0 con 0x5566fa59aca0 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7514025040 con 0x5566fa59aca0 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7511600640 1 -- 172.21.15.44:0/1586520970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f750c0f9170 con 0x5566fa59aca0 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 10 client.7416 fetch_fsmap learned FSMap version 75 2024-09-17T05:43:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5566fa4a9070 con 0x5566fa59aca0 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7511600640 1 -- 172.21.15.44:0/1586520970 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7514025040 con 0x5566fa59aca0 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7511600640 1 -- 172.21.15.44:0/1586520970 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f750c0f4ac0 con 0x5566fa59aca0 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 10 client.7416 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 10 client.7416 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 20 client.7416 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa194830 0x5566fa734860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 4 client.7416 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "status"}) -- 0x5566fa512540 con 0x5566fa194830 2024-09-17T05:43:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.174+0000 7f7523e00640 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa194830 0x5566fa734860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f7523e00640 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa194830 0x5566fa734860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d4a47751a0b3f2b server_cookie=4334520433190cb0 in_seq=0 out_seq=0 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f7511600640 10 client.7416 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f7511600640 1 -- 172.21.15.44:0/1586520970 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5566fa512540 con 0x5566fa194830 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f7511600640 10 client.7416 handle_command_reply: tid=0 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 client.7416 shutdown 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa59aca0 msgr2=0x5566fa7788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa59aca0 0x5566fa7788d0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f750c009840 tx=0x7f750c100040 comp rx=0 tx=0).stop 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 shutdown_connections 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x5566fa194830 0x5566fa734860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5566fa5b1950 0x5566fa778e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5566fa59aca0 0x5566fa7788d0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 --2- 172.21.15.44:0/1586520970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566fa1c1460 0x5566fa778390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f7511600640 0 client.7416 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 >> 172.21.15.44:0/1586520970 conn(0x5566fa687d90 msgr2=0x5566fa700fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 shutdown_connections 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 1 -- 172.21.15.44:0/1586520970 wait complete. 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f753288b000 20 client.7416 trim_cache size 0 max 16384 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7344, 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:43:29.179 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.6879164920000003, 2024-09-17T05:43:29.180 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 75, 2024-09-17T05:43:29.180 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 94, 2024-09-17T05:43:29.180 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 94, 2024-09-17T05:43:29.180 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 5.5465750680000001 2024-09-17T05:43:29.180 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:43:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7500073200 msgr2=0x7f7500075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7500073200 0x7f7500075710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f75140046c0 tx=0x7f7514007ea0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 msgr2=0x7f752414f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f752414f2b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f750c009790 tx=0x7f750c004040 comp rx=0 tx=0).stop 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 shutdown_connections 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7500073200 0x7f7500075710 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f752415d560 0x7f75240b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752415a080 0x7f752414f2b0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 --2- 172.21.15.44:0/541707694 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75240cc1e0 0x7f75241f96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 >> 172.21.15.44:0/541707694 conn(0x7f75240cd930 msgr2=0x7f75241559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 shutdown_connections 2024-09-17T05:43:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.178+0000 7f752b000640 1 -- 172.21.15.44:0/541707694 wait complete. 2024-09-17T05:43:29.196 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:43:29.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 -- 172.21.15.44:0/3858482053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40004810 msgr2=0x7efc40004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 --2- 172.21.15.44:0/3858482053 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc40004810 0x7efc40004c20 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7efc44001770 tx=0x7efc4401c880 comp rx=0 tx=0).stop 2024-09-17T05:43:29.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc61a00640 1 -- 172.21.15.44:0/3858482053 reap_dead start 2024-09-17T05:43:29.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 -- 172.21.15.44:0/3858482053 shutdown_connections 2024-09-17T05:43:29.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 -- 172.21.15.44:0/3858482053 >> 172.21.15.44:0/3858482053 conn(0x7efc5c0ccaa0 msgr2=0x7efc5c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 -- 172.21.15.44:0/3858482053 shutdown_connections 2024-09-17T05:43:29.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 -- 172.21.15.44:0/3858482053 wait complete. 2024-09-17T05:43:29.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 Processor -- start 2024-09-17T05:43:29.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.358+0000 7efc63a00640 1 -- start start 2024-09-17T05:43:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc40004810 0x7efc5c0c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc5c06f310 0x7efc5c06f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc5c06fc60 0x7efc5c0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c167630 con 0x7efc5c06fc60 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1674b0 con 0x7efc5c06f310 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7efc5c1677b0 con 0x7efc40004810 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc5c06fc60 0x7efc5c0b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc5c06fc60 0x7efc5c0b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48464/0 (socket says 172.21.15.44:48464) 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 -- 172.21.15.44:0/2125443041 learned_addr learned my addr 172.21.15.44:0/2125443041 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc53e00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc5c06f310 0x7efc5c06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61000640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc40004810 0x7efc5c0c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 -- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc40004810 msgr2=0x7efc5c0c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc40004810 0x7efc5c0c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 -- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc5c06f310 msgr2=0x7efc5c06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc5c06f310 0x7efc5c06f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 -- 172.21.15.44:0/2125443041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c070280 con 0x7efc5c06fc60 2024-09-17T05:43:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc61a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc5c06fc60 0x7efc5c0b3530 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7efc40004790 tx=0x7efc5400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc59600640 1 -- 172.21.15.44:0/2125443041 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54004b30 con 0x7efc5c06fc60 2024-09-17T05:43:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc59600640 1 -- 172.21.15.44:0/2125443041 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc54004cd0 con 0x7efc5c06fc60 2024-09-17T05:43:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5c070560 con 0x7efc5c06fc60 2024-09-17T05:43:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc59600640 1 -- 172.21.15.44:0/2125443041 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54003be0 con 0x7efc5c06fc60 2024-09-17T05:43:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5c0b3010 con 0x7efc5c06fc60 2024-09-17T05:43:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.362+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5c15e990 con 0x7efc5c06fc60 2024-09-17T05:43:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.366+0000 7efc59600640 1 -- 172.21.15.44:0/2125443041 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efc54004030 con 0x7efc5c06fc60 2024-09-17T05:43:29.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.366+0000 7efc59600640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc38073230 0x7efc38075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:29.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.366+0000 7efc59600640 1 -- 172.21.15.44:0/2125443041 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7efc54094a70 con 0x7efc5c06fc60 2024-09-17T05:43:29.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.366+0000 7efc61000640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc38073230 0x7efc38075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:29.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.366+0000 7efc61000640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc38073230 0x7efc38075740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc4c000fe0 tx=0x7efc4c006730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:29.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.370+0000 7efc59600640 1 -- 172.21.15.44:0/2125443041 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7efc5405f0c0 con 0x7efc5c06fc60 2024-09-17T05:43:29.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.586+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efc5c0b4b50 con 0x7efc5c06fc60 2024-09-17T05:43:29.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.586+0000 7efc59600640 1 -- 172.21.15.44:0/2125443041 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) ==== 53+0+73 (secure 0 0 0) 0x7efc54063af0 con 0x7efc5c06fc60 2024-09-17T05:43:29.585 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:43:29.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc38073230 msgr2=0x7efc38075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc38073230 0x7efc38075740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc4c000fe0 tx=0x7efc4c006730 comp rx=0 tx=0).stop 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc5c06fc60 msgr2=0x7efc5c0b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc5c06fc60 0x7efc5c0b3530 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7efc40004790 tx=0x7efc5400f3c0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 shutdown_connections 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efc5c06fc60 0x7efc5c0b3530 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efc38073230 0x7efc38075740 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc5c06f310 0x7efc5c06f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 --2- 172.21.15.44:0/2125443041 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7efc40004810 0x7efc5c0c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 >> 172.21.15.44:0/2125443041 conn(0x7efc5c0ccaa0 msgr2=0x7efc5c0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 shutdown_connections 2024-09-17T05:43:29.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29.590+0000 7efc63a00640 1 -- 172.21.15.44:0/2125443041 wait complete. 2024-09-17T05:43:29.608 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:43:29.608 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:43:29.608 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:43:29.608 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:43:29.608 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:43:29.609 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:43:29.609 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:43:29.609 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:43:29.609 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:43:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:29.610 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:43:29.621 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:43:29.622 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41996sec preferred_lft 41996sec 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:43:29.623 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.624 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:43:29.625 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:43:29.626 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:43:29.626 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:43:29.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:29.626 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:43:29.681 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:43:29.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:29.683 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:43:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:43:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:43:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:43:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:43:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:43:29.740 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:43:29.741 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:43:29.741 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:43:29.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:43:29.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:43:29.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:43:29.741 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:43:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:43:29.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:43:29.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:29.884 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:43:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:43:29.939 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:43:29.940 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:43:29.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:29.941 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:43:30.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:43:30.003 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:43:30.059 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:43:30.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:43:30.059 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:43:30.110 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:43:30.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:30.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:43:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:43:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:43:30.212 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:43:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:43:30.232 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:43:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:43:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:43:30.233 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:43:30.240 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:43:30.244 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:43:30.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:30.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:43:30.264 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:43:30.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:43:30.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:43:30.368 INFO:teuthology.orchestra.run.smithi044.stdout:client7425 2024-09-17T05:43:30.369 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:43:30.369 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:43:30.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:30.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-09-17T05:43:30.488 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:43:30.490+0000 7faa59600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:43:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 -- 172.21.15.44:0/94092911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f599006f3f0 msgr2=0x7f599006f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 --2- 172.21.15.44:0/94092911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f599006f3f0 0x7f599006f800 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f59900d0e00 tx=0x7f598801f580 comp rx=0 tx=0).stop 2024-09-17T05:43:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 -- 172.21.15.44:0/94092911 shutdown_connections 2024-09-17T05:43:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 --2- 172.21.15.44:0/94092911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f599006f3f0 0x7f599006f800 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 --2- 172.21.15.44:0/94092911 >> v2:172.21.15.86:3300/0 conn(0x7f599006df80 0x7f599006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 -- 172.21.15.44:0/94092911 >> 172.21.15.44:0/94092911 conn(0x7f59900b35f0 msgr2=0x7f59900b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 -- 172.21.15.44:0/94092911 shutdown_connections 2024-09-17T05:43:30.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.586+0000 7f5998000640 1 -- 172.21.15.44:0/94092911 wait complete. 2024-09-17T05:43:30.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 Processor -- start 2024-09-17T05:43:30.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 -- start start 2024-09-17T05:43:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f599006df80 0x7f59900b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f599006f3f0 0x7f59900ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5990155b10 0x7f599014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59900ce510 con 0x7f5990155b10 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f59900ce390 con 0x7f599006f3f0 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.590+0000 7f5998000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f59900ce690 con 0x7f599006df80 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5995600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f599006df80 0x7f59900b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5996000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5990155b10 0x7f599014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5994c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f599006f3f0 0x7f59900ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5995600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f599006df80 0x7f59900b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:59314/0 (socket says 172.21.15.44:59314) 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5995600640 1 -- 172.21.15.44:0/1763541372 learned_addr learned my addr 172.21.15.44:0/1763541372 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5996000640 1 -- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f599006df80 msgr2=0x7f59900b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5996000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f599006df80 0x7f59900b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5996000640 1 -- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f599006f3f0 msgr2=0x7f59900ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5996000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f599006f3f0 0x7f59900ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5996000640 1 -- 172.21.15.44:0/1763541372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59900afdb0 con 0x7f5990155b10 2024-09-17T05:43:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5994c00640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f599006f3f0 0x7f59900ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5996000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5990155b10 0x7f599014cc60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f59880b0000 tx=0x7f5988009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f598d600640 1 -- 172.21.15.44:0/1763541372 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880b5040 con 0x7f5990155b10 2024-09-17T05:43:30.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f598d600640 1 -- 172.21.15.44:0/1763541372 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5988004b40 con 0x7f5990155b10 2024-09-17T05:43:30.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f598d600640 1 -- 172.21.15.44:0/1763541372 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988004d50 con 0x7f5990155b10 2024-09-17T05:43:30.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59900b0090 con 0x7f5990155b10 2024-09-17T05:43:30.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59900b0650 con 0x7f5990155b10 2024-09-17T05:43:30.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.594+0000 7f598d600640 1 -- 172.21.15.44:0/1763541372 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f59880c0020 con 0x7f5990155b10 2024-09-17T05:43:30.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f598d600640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5970073200 0x7f5970075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f598d600640 1 -- 172.21.15.44:0/1763541372 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f5988131c50 con 0x7f5990155b10 2024-09-17T05:43:30.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 Processor -- start 2024-09-17T05:43:30.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5995600640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5970073200 0x7f5970075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 -- start start 2024-09-17T05:43:30.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5995600640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5970073200 0x7f5970075710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f59840099a0 tx=0x7f59840090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e6653419d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651ecae0 0x55e665341f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651d6970 0x55e665342450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e665102bd0 con 0x55e6651ecae0 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e6650f3430 con 0x55e6651d6970 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e665150ce0 con 0x55e6651f41a0 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651ecae0 0x55e665341f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651ecae0 0x55e665341f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48486/0 (socket says 172.21.15.44:48486) 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 -- 172.21.15.44:0/1994216249 learned_addr learned my addr 172.21.15.44:0/1994216249 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5995600640 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e6653419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5996000640 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651d6970 0x55e665342450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 -- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 msgr2=0x55e6653419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e6653419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 -- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651d6970 msgr2=0x55e665342450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651d6970 0x55e665342450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 -- 172.21.15.44:0/1994216249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6650f4d80 con 0x55e6651ecae0 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5994c00640 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651ecae0 0x55e665341f10 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f597c009d50 tx=0x7f597c00e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73e3fa7729479c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.598+0000 7f5981c00640 1 -- 172.21.15.44:0/1994216249 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c017070 con 0x55e6651ecae0 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f5981c00640 1 -- 172.21.15.44:0/1994216249 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597c013470 con 0x55e6651ecae0 2024-09-17T05:43:30.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f5981c00640 1 -- 172.21.15.44:0/1994216249 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597c013840 con 0x55e6651ecae0 2024-09-17T05:43:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- 172.21.15.44:0/1994216249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651ecae0 msgr2=0x55e665341f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651ecae0 0x55e665341f10 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f597c009d50 tx=0x7f597c00e5a0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- 172.21.15.44:0/1994216249 shutdown_connections 2024-09-17T05:43:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651d6970 0x55e665342450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651ecae0 0x55e665341f10 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 --2- 172.21.15.44:0/1994216249 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e6653419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- 172.21.15.44:0/1994216249 >> 172.21.15.44:0/1994216249 conn(0x55e6651fa8c0 msgr2=0x55e665324e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- 172.21.15.44:0/1994216249 shutdown_connections 2024-09-17T05:43:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- 172.21.15.44:0/1994216249 wait complete. 2024-09-17T05:43:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- start start 2024-09-17T05:43:30.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 Processor -- start 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e665348c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e665349190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e6653496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e665143f20 con 0x55e6651f41a0 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e665140110 con 0x55e6651ecae0 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e6650e56d0 con 0x55e6651d6970 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.602+0000 7f599f57c000 10 client.0 _ll_register_callbacks cb 0x55e6650e4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e6653496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e6653496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48490/0 (socket says 172.21.15.44:48490) 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 -- 172.21.15.44:0/135244997 learned_addr learned my addr 172.21.15.44:0/135244997 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5995600640 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e665348c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5994c00640 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e665349190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 -- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 msgr2=0x55e665348c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e665348c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 -- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 msgr2=0x55e665349190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e665349190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 -- 172.21.15.44:0/135244997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6650de310 con 0x55e6651f41a0 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5996000640 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e6653496d0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f598809be80 tx=0x7f59880f88f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0be77fa0e765ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:30.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 1 -- 172.21.15.44:0/135244997 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880fbdb0 con 0x55e6651f41a0 2024-09-17T05:43:30.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e6650d8450 con 0x55e6651f41a0 2024-09-17T05:43:30.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 1 -- 172.21.15.44:0/135244997 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f59880faf70 con 0x55e6651f41a0 2024-09-17T05:43:30.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 1 -- 172.21.15.44:0/135244997 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f59880fc2a0 con 0x55e6651f41a0 2024-09-17T05:43:30.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 10 client.7437 fetch_fsmap learned FSMap version 75 2024-09-17T05:43:30.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x55e6650fbf60 con 0x55e6651f41a0 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 1 -- 172.21.15.44:0/135244997 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e6650d8450 con 0x55e6651f41a0 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 1 -- 172.21.15.44:0/135244997 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f59880b8070 con 0x55e6651f41a0 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 10 client.7437 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 10 client.7437 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 20 client.7437 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664de2b80 0x55e665353030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 4 client.7437 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e665152c30 con 0x55e664de2b80 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5995600640 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664de2b80 0x55e665353030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 10 client.7437 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5995600640 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664de2b80 0x55e665353030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0bec86917b76205 server_cookie=9568071bebb7c6e4 in_seq=0 out_seq=0 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 1 -- 172.21.15.44:0/135244997 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e665152c30 con 0x55e664de2b80 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 10 client.7437 handle_command_reply: tid=0 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 client.7437 shutdown 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 msgr2=0x55e6653496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e6653496d0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f598809be80 tx=0x7f59880f88f0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 shutdown_connections 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664de2b80 0x55e665353030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e6653496d0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e665349190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 --2- 172.21.15.44:0/135244997 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e665348c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 >> 172.21.15.44:0/135244997 conn(0x55e6651fa8c0 msgr2=0x55e6652f7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f5976000640 0 client.7437 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 shutdown_connections 2024-09-17T05:43:30.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.606+0000 7f599f57c000 1 -- 172.21.15.44:0/135244997 wait complete. 2024-09-17T05:43:30.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.610+0000 7f599f57c000 20 client.7437 trim_cache size 0 max 16384 2024-09-17T05:43:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.626+0000 7f599f57c000 1 Processor -- start 2024-09-17T05:43:30.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.626+0000 7f599f57c000 1 -- start start 2024-09-17T05:43:30.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.626+0000 7f599f57c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651d6970 0x55e6652f9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e6652f9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e665349c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f59901fe870 con 0x55e6651d6970 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5990154a20 con 0x55e6651ecae0 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f59901f7b00 con 0x55e6651f41a0 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651d6970 0x55e6652f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651d6970 0x55e6652f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48506/0 (socket says 172.21.15.44:48506) 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 -- 172.21.15.44:0/3673447131 learned_addr learned my addr 172.21.15.44:0/3673447131 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5994c00640 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e6652f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5996000640 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e665349c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 -- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 msgr2=0x55e665349c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e665349c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 -- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 msgr2=0x55e6652f9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e6652f9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 -- 172.21.15.44:0/3673447131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6651c4f30 con 0x55e6651d6970 2024-09-17T05:43:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5995600640 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651d6970 0x55e6652f9410 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f598400eac0 tx=0x7f5984015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c587743be9a566cd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5981200640 1 -- 172.21.15.44:0/3673447131 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598402f070 con 0x55e6651d6970 2024-09-17T05:43:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5981200640 1 -- 172.21.15.44:0/3673447131 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f598400eaf0 con 0x55e6651d6970 2024-09-17T05:43:30.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f5981200640 1 -- 172.21.15.44:0/3673447131 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598401b040 con 0x55e6651d6970 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- 172.21.15.44:0/3673447131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651d6970 msgr2=0x55e6652f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651d6970 0x55e6652f9410 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f598400eac0 tx=0x7f5984015000 comp rx=0 tx=0).stop 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- 172.21.15.44:0/3673447131 shutdown_connections 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651f41a0 0x55e665349c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e6652f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 --2- 172.21.15.44:0/3673447131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651d6970 0x55e6652f9410 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- 172.21.15.44:0/3673447131 >> 172.21.15.44:0/3673447131 conn(0x55e6651fa8c0 msgr2=0x55e6652f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- 172.21.15.44:0/3673447131 shutdown_connections 2024-09-17T05:43:30.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- 172.21.15.44:0/3673447131 wait complete. 2024-09-17T05:43:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 -- start start 2024-09-17T05:43:30.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.630+0000 7f599f57c000 1 Processor -- start 2024-09-17T05:43:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e66534f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e66534d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e66534dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e6652eb7c0 con 0x55e6651f41a0 2024-09-17T05:43:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e665140110 con 0x55e6651ecae0 2024-09-17T05:43:30.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e6651fe8e0 con 0x55e6651d6970 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 10 client.0 _ll_register_callbacks cb 0x7f59880f89b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e66534dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e66534dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48508/0 (socket says 172.21.15.44:48508) 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 -- 172.21.15.44:0/1399290906 learned_addr learned my addr 172.21.15.44:0/1399290906 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5995600640 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e66534f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5994c00640 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e66534d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 -- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 msgr2=0x55e66534f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e66534f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 -- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 msgr2=0x55e66534d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e66534d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 -- 172.21.15.44:0/1399290906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66519bdd0 con 0x55e6651f41a0 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5996000640 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e66534dc60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f59880f8350 tx=0x7f59880fb1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b165372d1280bd29 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 1 -- 172.21.15.44:0/1399290906 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880fb310 con 0x55e6651f41a0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 1 -- 172.21.15.44:0/1399290906 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f5988105150 con 0x55e6651f41a0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f598400eaf0 con 0x55e6651f41a0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 1 -- 172.21.15.44:0/1399290906 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f59880fbdb0 con 0x55e6651f41a0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 10 client.7443 fetch_fsmap learned FSMap version 75 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x55e6650d6840 con 0x55e6651f41a0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 1 -- 172.21.15.44:0/1399290906 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f598400eaf0 con 0x55e6651f41a0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 1 -- 172.21.15.44:0/1399290906 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f5988105350 con 0x55e6651f41a0 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 10 client.7443 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 10 client.7443 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 20 client.7443 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:30.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664dd0be0 0x55e66534e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 4 client.7443 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-09-17T05:43:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x55e66514e6e0 con 0x55e664dd0be0 2024-09-17T05:43:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5995600640 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664dd0be0 0x55e66534e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 10 client.7443 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5995600640 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664dd0be0 0x55e66534e680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae4692577d4bd3bf server_cookie=468bee4aff6491a4 in_seq=0 out_seq=0 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 1 -- 172.21.15.44:0/1399290906 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e66514e6e0 con 0x55e664dd0be0 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f5976000640 10 client.7443 handle_command_reply: tid=0 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 client.7443 shutdown 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 msgr2=0x55e66534dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e66534dc60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f59880f8350 tx=0x7f59880fb1a0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 shutdown_connections 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x55e664dd0be0 0x55e66534e680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5976000640 0 client.7443 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.634+0000 7f599f57c000 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e6651f41a0 0x55e66534dc60 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f599f57c000 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6651ecae0 0x55e66534d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f599f57c000 1 --2- 172.21.15.44:0/1399290906 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e6651d6970 0x55e66534f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 >> 172.21.15.44:0/1399290906 conn(0x55e6651fa8c0 msgr2=0x55e6652f8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 shutdown_connections 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f599f57c000 1 -- 172.21.15.44:0/1399290906 wait complete. 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f599f57c000 20 client.7443 trim_cache size 0 max 16384 2024-09-17T05:43:30.639 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:43:30.640 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:43:30.640 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "48ff7a85-645c-49f4-8a52-1bbb4b4d0995", 2024-09-17T05:43:30.640 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:43:30.640 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:43:30.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5970073200 msgr2=0x7f5970075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5970073200 0x7f5970075710 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f59840099a0 tx=0x7f59840090e0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5990155b10 msgr2=0x7f599014cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5990155b10 0x7f599014cc60 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f59880b0000 tx=0x7f5988009350 comp rx=0 tx=0).stop 2024-09-17T05:43:30.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 shutdown_connections 2024-09-17T05:43:30.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5990155b10 0x7f599014cc60 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5970073200 0x7f5970075710 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f599006f3f0 0x7f59900ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 --2- 172.21.15.44:0/1763541372 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f599006df80 0x7f59900b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 >> 172.21.15.44:0/1763541372 conn(0x7f59900b35f0 msgr2=0x7f59901517d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 shutdown_connections 2024-09-17T05:43:30.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.638+0000 7f5998000640 1 -- 172.21.15.44:0/1763541372 wait complete. 2024-09-17T05:43:30.646 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-09-17T05:43:30.638+0000 7faa54600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | request=0 lock=0 dirtyparent=1 authpin=1 scrubqueue=0 0x561c7e674100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:43:30.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:43:30.656 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T05:43:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 -- 172.21.15.44:0/1304593949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 msgr2=0x7fd95406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 --2- 172.21.15.44:0/1304593949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95406de50 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fd954072de0 tx=0x7fd94401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 -- 172.21.15.44:0/1304593949 shutdown_connections 2024-09-17T05:43:30.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 --2- 172.21.15.44:0/1304593949 >> v2:172.21.15.86:3300/0 conn(0x7fd9540ce130 0x7fd9540ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 --2- 172.21.15.44:0/1304593949 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd95406e390 0x7fd9540cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 --2- 172.21.15.44:0/1304593949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95406de50 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 -- 172.21.15.44:0/1304593949 >> 172.21.15.44:0/1304593949 conn(0x7fd9540ccaa0 msgr2=0x7fd9540cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 -- 172.21.15.44:0/1304593949 shutdown_connections 2024-09-17T05:43:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.818+0000 7fd959800640 1 -- 172.21.15.44:0/1304593949 wait complete. 2024-09-17T05:43:30.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 Processor -- start 2024-09-17T05:43:30.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 -- start start 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd95406e390 0x7fd95415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95409fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9540ce130 0x7fd9540a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd954070c70 con 0x7fd9540b5880 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd954070af0 con 0x7fd95406e390 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd959800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd954070df0 con 0x7fd9540ce130 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95409fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95409fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48522/0 (socket says 172.21.15.44:48522) 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 -- 172.21.15.44:0/3639171023 learned_addr learned my addr 172.21.15.44:0/3639171023 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952a00640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd95406e390 0x7fd95415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd953400640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9540ce130 0x7fd9540a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 -- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9540ce130 msgr2=0x7fd9540a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9540ce130 0x7fd9540a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 -- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd95406e390 msgr2=0x7fd95415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd95406e390 0x7fd95415a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 -- 172.21.15.44:0/3639171023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95415ab50 con 0x7fd9540b5880 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd952000640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95409fff0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd94000e9c0 tx=0x7fd94000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd94aa00640 1 -- 172.21.15.44:0/3639171023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94000ccc0 con 0x7fd9540b5880 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.822+0000 7fd94aa00640 1 -- 172.21.15.44:0/3639171023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd940004020 con 0x7fd9540b5880 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.826+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9540c1ac0 con 0x7fd9540b5880 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.826+0000 7fd94aa00640 1 -- 172.21.15.44:0/3639171023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94000ce60 con 0x7fd9540b5880 2024-09-17T05:43:30.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.826+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9540c2080 con 0x7fd9540b5880 2024-09-17T05:43:30.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.826+0000 7fd94aa00640 1 -- 172.21.15.44:0/3639171023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd940003600 con 0x7fd9540b5880 2024-09-17T05:43:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd94aa00640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd934073200 0x7fd934075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd94aa00640 1 -- 172.21.15.44:0/3639171023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fd940094cd0 con 0x7fd9540b5880 2024-09-17T05:43:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952a00640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd934073200 0x7fd934075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 Processor -- start 2024-09-17T05:43:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 -- start start 2024-09-17T05:43:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952a00640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd934073200 0x7fd934075710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd9440af000 tx=0x7fd9440a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb492a6d0 0x559fb4a9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4581890 0x559fb4a9b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a9b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559fb4935cd0 con 0x559fb4581890 2024-09-17T05:43:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559fb484b330 con 0x559fb492a6d0 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559fb48a8bb0 con 0x559fb4645aa0 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4581890 0x559fb4a9b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4581890 0x559fb4a9b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48524/0 (socket says 172.21.15.44:48524) 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 -- 172.21.15.44:0/1078091595 learned_addr learned my addr 172.21.15.44:0/1078091595 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952a00640 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb492a6d0 0x559fb4a9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd953400640 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a9b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 -- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 msgr2=0x559fb4a9b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a9b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 -- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb492a6d0 msgr2=0x559fb4a9ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb492a6d0 0x559fb4a9ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 -- 172.21.15.44:0/1078091595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb484cc80 con 0x559fb4581890 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd953400640 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a9b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:43:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd952000640 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4581890 0x559fb4a9b320 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd940092df0 tx=0x7fd94005f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85aa62bcd3fa913 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd93f400640 1 -- 172.21.15.44:0/1078091595 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940084020 con 0x559fb4581890 2024-09-17T05:43:30.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd93f400640 1 -- 172.21.15.44:0/1078091595 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd94005f280 con 0x559fb4581890 2024-09-17T05:43:30.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.830+0000 7fd93f400640 1 -- 172.21.15.44:0/1078091595 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940063d60 con 0x559fb4581890 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- 172.21.15.44:0/1078091595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4581890 msgr2=0x559fb4a9b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4581890 0x559fb4a9b320 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fd940092df0 tx=0x7fd94005f180 comp rx=0 tx=0).stop 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- 172.21.15.44:0/1078091595 shutdown_connections 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a9b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4581890 0x559fb4a9b320 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 --2- 172.21.15.44:0/1078091595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb492a6d0 0x559fb4a9ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- 172.21.15.44:0/1078091595 >> 172.21.15.44:0/1078091595 conn(0x559fb45555c0 msgr2=0x559fb4a50130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- 172.21.15.44:0/1078091595 shutdown_connections 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- 172.21.15.44:0/1078091595 wait complete. 2024-09-17T05:43:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- start start 2024-09-17T05:43:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 Processor -- start 2024-09-17T05:43:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4a88610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a890d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb492a6d0 0x559fb4a89610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559fb489bdf0 con 0x559fb492a6d0 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559fb4897fe0 con 0x559fb4581890 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559fb483d4d0 con 0x559fb4645aa0 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd960ed1000 10 client.0 _ll_register_callbacks cb 0x559fb481b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd953400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb492a6d0 0x559fb4a89610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4a88610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd953400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb492a6d0 0x559fb4a89610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48526/0 (socket says 172.21.15.44:48526) 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4a88610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:33694/0 (socket says 172.21.15.44:33694) 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd953400640 1 -- 172.21.15.44:0/615657505 learned_addr learned my addr 172.21.15.44:0/615657505 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952a00640 1 -- 172.21.15.44:0/615657505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 msgr2=0x559fb4a890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952a00640 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a890d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952a00640 1 -- 172.21.15.44:0/615657505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb492a6d0 msgr2=0x559fb4a89610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952a00640 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb492a6d0 0x559fb4a89610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.834+0000 7fd952a00640 1 -- 172.21.15.44:0/615657505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb4836210 con 0x559fb4581890 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd952a00640 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4a88610 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd9440ac000 tx=0x7fd94401b100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8ac8a6c8cb84312 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 1 -- 172.21.15.44:0/615657505 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9440c8060 con 0x559fb4581890 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 1 -- 172.21.15.44:0/615657505 <== mon.1 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fd9440a5830 con 0x559fb4581890 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559fb4830350 con 0x559fb4581890 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 1 -- 172.21.15.44:0/615657505 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd9440ce050 con 0x559fb4581890 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 10 client.7195 fetch_fsmap learned FSMap version 75 2024-09-17T05:43:30.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x559fb481cfc0 con 0x559fb4581890 2024-09-17T05:43:30.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 1 -- 172.21.15.44:0/615657505 <== mon.1 v2:172.21.15.86:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559fb4830350 con 0x559fb4581890 2024-09-17T05:43:30.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 1 -- 172.21.15.44:0/615657505 <== mon.1 v2:172.21.15.86:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7fd9440d1020 con 0x559fb4581890 2024-09-17T05:43:30.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 10 client.7195 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:43:30.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 10 client.7195 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:43:30.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 20 client.7195 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:30.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb453a930 0x559fb4a8a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 4 client.7195 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fb48aab00 con 0x559fb453a930 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd952000640 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb453a930 0x559fb4a8a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 10 client.7195 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd952000640 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb453a930 0x559fb4a8a020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb3bff21d3215dc server_cookie=ff11e949e592252a in_seq=0 out_seq=0 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 1 -- 172.21.15.44:0/615657505 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559fb48aab00 con 0x559fb453a930 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 10 client.7195 handle_command_reply: tid=0 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 client.7195 shutdown 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 msgr2=0x559fb4a88610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4a88610 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd9440ac000 tx=0x7fd94401b100 comp rx=0 tx=0).stop 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 shutdown_connections 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb453a930 0x559fb4a8a020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb492a6d0 0x559fb4a89610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb4645aa0 0x559fb4a890d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 --2- 172.21.15.44:0/615657505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4a88610 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 >> 172.21.15.44:0/615657505 conn(0x559fb45555c0 msgr2=0x559fb4a50130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd933e00640 0 client.7195 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 shutdown_connections 2024-09-17T05:43:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 1 -- 172.21.15.44:0/615657505 wait complete. 2024-09-17T05:43:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.838+0000 7fd960ed1000 20 client.7195 trim_cache size 0 max 16384 2024-09-17T05:43:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 Processor -- start 2024-09-17T05:43:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 -- start start 2024-09-17T05:43:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4aac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4aac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4aace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd954201b10 con 0x559fb4645aa0 2024-09-17T05:43:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540cc5c0 con 0x559fb4581890 2024-09-17T05:43:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd9540cb8c0 con 0x559fb492a6d0 2024-09-17T05:43:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4aac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4aac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4aac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48536/0 (socket says 172.21.15.44:48536) 2024-09-17T05:43:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952000640 1 -- 172.21.15.44:0/4066654024 learned_addr learned my addr 172.21.15.44:0/4066654024 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd953400640 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4aace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952a00640 1 -- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 msgr2=0x559fb4aace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952a00640 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4aace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952a00640 1 -- 172.21.15.44:0/4066654024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 msgr2=0x559fb4aac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952a00640 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4aac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952a00640 1 -- 172.21.15.44:0/4066654024 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb48f5680 con 0x559fb4581890 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.858+0000 7fd952000640 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4aac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd952a00640 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4aac3a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd94401d160 tx=0x7fd944009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80338ef9f1134faa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd93ea00640 1 -- 172.21.15.44:0/4066654024 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9440a5830 con 0x559fb4581890 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd93ea00640 1 -- 172.21.15.44:0/4066654024 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9440b3040 con 0x559fb4581890 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd93ea00640 1 -- 172.21.15.44:0/4066654024 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9440046d0 con 0x559fb4581890 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 msgr2=0x559fb4aac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4aac3a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd94401d160 tx=0x7fd944009780 comp rx=0 tx=0).stop 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- 172.21.15.44:0/4066654024 shutdown_connections 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4aace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4aac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 --2- 172.21.15.44:0/4066654024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4aac3a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- 172.21.15.44:0/4066654024 >> 172.21.15.44:0/4066654024 conn(0x559fb45555c0 msgr2=0x559fb4aa7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- 172.21.15.44:0/4066654024 shutdown_connections 2024-09-17T05:43:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- 172.21.15.44:0/4066654024 wait complete. 2024-09-17T05:43:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- start start 2024-09-17T05:43:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 Processor -- start 2024-09-17T05:43:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4b107b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4b10cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4b11230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559fb489bdf0 con 0x559fb4645aa0 2024-09-17T05:43:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559fb4897fe0 con 0x559fb4581890 2024-09-17T05:43:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559fb4892ee0 con 0x559fb492a6d0 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.862+0000 7fd960ed1000 10 client.0 _ll_register_callbacks cb 0x7fd94c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4b10cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4b107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4b10cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48540/0 (socket says 172.21.15.44:48540) 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952000640 1 -- 172.21.15.44:0/81233078 learned_addr learned my addr 172.21.15.44:0/81233078 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd953400640 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4b11230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952a00640 1 -- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 msgr2=0x559fb4b11230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952a00640 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4b11230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952a00640 1 -- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 msgr2=0x559fb4b10cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952a00640 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4b10cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952a00640 1 -- 172.21.15.44:0/81233078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb48620b0 con 0x559fb4581890 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952000640 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4b10cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952a00640 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4b107b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd94401a4f0 tx=0x7fd944005a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=320b4c78bf66bc9c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:43:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 1 -- 172.21.15.44:0/81233078 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9440c8040 con 0x559fb4581890 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 1 -- 172.21.15.44:0/81233078 <== mon.1 v2:172.21.15.86:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fd944004ae0 con 0x559fb4581890 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9440b3040 con 0x559fb4581890 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 1 -- 172.21.15.44:0/81233078 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd944004ce0 con 0x559fb4581890 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 10 client.7201 fetch_fsmap learned FSMap version 75 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x559fb482e610 con 0x559fb4581890 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 1 -- 172.21.15.44:0/81233078 <== mon.1 v2:172.21.15.86:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9440b3040 con 0x559fb4581890 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 1 -- 172.21.15.44:0/81233078 <== mon.1 v2:172.21.15.86:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7fd9440d1030 con 0x559fb4581890 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 10 client.7201 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 10 client.7201 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 20 client.7201 populate_metadata read hostname 'smithi044' 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb4528990 0x559fb4aafda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:43:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 4 client.7201 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559fb48a65b0 con 0x559fb4528990 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952000640 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb4528990 0x559fb4aafda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd952000640 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb4528990 0x559fb4aafda0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed54c18079887639 server_cookie=57802169dc2446fe in_seq=0 out_seq=0 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 10 client.7201 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 1 -- 172.21.15.44:0/81233078 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+577 (crc 0 0 0) 0x559fb48a65b0 con 0x559fb4528990 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 10 client.7201 handle_command_reply: tid=0 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 client.7201 shutdown 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 msgr2=0x559fb4b107b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4b107b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd94401a4f0 tx=0x7fd944005a60 comp rx=0 tx=0).stop 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 shutdown_connections 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559fb4528990 0x559fb4aafda0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559fb492a6d0 0x559fb4b11230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559fb4645aa0 0x559fb4b10cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd933e00640 0 client.7201 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 --2- 172.21.15.44:0/81233078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb4581890 0x559fb4b107b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 >> 172.21.15.44:0/81233078 conn(0x559fb45555c0 msgr2=0x559fb4aa7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 shutdown_connections 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 1 -- 172.21.15.44:0/81233078 wait complete. 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.866+0000 7fd960ed1000 20 client.7201 trim_cache size 0 max 16384 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:43:30.870 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "48ff7a85-645c-49f4-8a52-1bbb4b4d0995": { 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "48ff7a85-645c-49f4-8a52-1bbb4b4d0995", 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive,repair" 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "48ff7a85-645c-49f4-8a52-1bbb4b4d0995": { 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:43:30.634327+0000", 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:43:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:43:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:43:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:43:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:43:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:43:30.872 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd934073200 msgr2=0x7fd934075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd934073200 0x7fd934075710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd9440af000 tx=0x7fd9440a7040 comp rx=0 tx=0).stop 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 msgr2=0x7fd95409fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95409fff0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fd94000e9c0 tx=0x7fd94000edc0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 shutdown_connections 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd9540ce130 0x7fd9540a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9540b5880 0x7fd95409fff0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd934073200 0x7fd934075710 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 --2- 172.21.15.44:0/3639171023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd95406e390 0x7fd95415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:43:30.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 >> 172.21.15.44:0/3639171023 conn(0x7fd9540ccaa0 msgr2=0x7fd954068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:43:30.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 shutdown_connections 2024-09-17T05:43:30.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:43:30.870+0000 7fd959800640 1 -- 172.21.15.44:0/3639171023 wait complete. 2024-09-17T05:43:30.887 INFO:tasks.cephfs.filesystem:scrub status for tag:48ff7a85-645c-49f4-8a52-1bbb4b4d0995 - {'path': '/dir', 'tag': '48ff7a85-645c-49f4-8a52-1bbb4b4d0995', 'options': 'recursive,repair'} 2024-09-17T05:43:43.026 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:43:43.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:00.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:00.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T05:44:01.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 -- 172.21.15.44:0/2503785414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff040b4f60 msgr2=0x7eff04072c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 --2- 172.21.15.44:0/2503785414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff040b4f60 0x7eff04072c10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7eff040b5500 tx=0x7efef801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 -- 172.21.15.44:0/2503785414 shutdown_connections 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 --2- 172.21.15.44:0/2503785414 >> v2:172.21.15.86:3300/0 conn(0x7eff0415f2e0 0x7eff0415f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 --2- 172.21.15.44:0/2503785414 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff04073150 0x7eff0415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 --2- 172.21.15.44:0/2503785414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff040b4f60 0x7eff04072c10 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 -- 172.21.15.44:0/2503785414 >> 172.21.15.44:0/2503785414 conn(0x7eff0406ce40 msgr2=0x7eff0406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 -- 172.21.15.44:0/2503785414 shutdown_connections 2024-09-17T05:44:01.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 -- 172.21.15.44:0/2503785414 wait complete. 2024-09-17T05:44:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 Processor -- start 2024-09-17T05:44:01.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.065+0000 7eff0a400640 1 -- start start 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff04073150 0x7eff040ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff040b4f60 0x7eff041f8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0415f2e0 0x7eff04157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff040b4030 con 0x7eff0415f2e0 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff040b3eb0 con 0x7eff040b4f60 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7eff040b41b0 con 0x7eff04073150 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0415f2e0 0x7eff04157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0415f2e0 0x7eff04157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50008/0 (socket says 172.21.15.44:50008) 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 -- 172.21.15.44:0/4073006479 learned_addr learned my addr 172.21.15.44:0/4073006479 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09000640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff04073150 0x7eff040ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff03e00640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff040b4f60 0x7eff041f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 -- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff04073150 msgr2=0x7eff040ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff04073150 0x7eff040ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 -- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff040b4f60 msgr2=0x7eff041f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff040b4f60 0x7eff041f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 -- 172.21.15.44:0/4073006479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff041538d0 con 0x7eff0415f2e0 2024-09-17T05:44:01.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff09a00640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0415f2e0 0x7eff04157cc0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e940 tx=0x7efefc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff00c00640 1 -- 172.21.15.44:0/4073006479 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc004d30 con 0x7eff0415f2e0 2024-09-17T05:44:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff00c00640 1 -- 172.21.15.44:0/4073006479 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efefc00cb20 con 0x7eff0415f2e0 2024-09-17T05:44:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff00c00640 1 -- 172.21.15.44:0/4073006479 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc005020 con 0x7eff0415f2e0 2024-09-17T05:44:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff04153bb0 con 0x7eff0415f2e0 2024-09-17T05:44:01.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.069+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff041535c0 con 0x7eff0415f2e0 2024-09-17T05:44:01.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff00c00640 1 -- 172.21.15.44:0/4073006479 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efefc0051c0 con 0x7eff0415f2e0 2024-09-17T05:44:01.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff00c00640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efee4073230 0x7efee4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff00c00640 1 -- 172.21.15.44:0/4073006479 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7efefc094c20 con 0x7eff0415f2e0 2024-09-17T05:44:01.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff09000640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efee4073230 0x7efee4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 Processor -- start 2024-09-17T05:44:01.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 -- start start 2024-09-17T05:44:01.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff09000640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efee4073230 0x7efee4075740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efef80af000 tx=0x7efef80a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3ac7f6d0 0x556c3adeb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3adebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3a99aaa0 0x556c3adec470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556c3ac8acd0 con 0x556c3a8d6890 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556c3aba0330 con 0x556c3ac7f6d0 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.073+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x556c3abfdbb0 con 0x556c3a99aaa0 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3adebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff09000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3ac7f6d0 0x556c3adeb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff09a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3a99aaa0 0x556c3adec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff09000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3ac7f6d0 0x556c3adeb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:49698/0 (socket says 172.21.15.44:49698) 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff09000640 1 -- 172.21.15.44:0/3262069244 learned_addr learned my addr 172.21.15.44:0/3262069244 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff03e00640 1 -- 172.21.15.44:0/3262069244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3a99aaa0 msgr2=0x556c3adec470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff03e00640 1 --2- 172.21.15.44:0/3262069244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3a99aaa0 0x556c3adec470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff03e00640 1 -- 172.21.15.44:0/3262069244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3ac7f6d0 msgr2=0x556c3adeb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff03e00640 1 --2- 172.21.15.44:0/3262069244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3ac7f6d0 0x556c3adeb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff03e00640 1 -- 172.21.15.44:0/3262069244 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c3aba1c80 con 0x556c3a8d6890 2024-09-17T05:44:01.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff03e00640 1 --2- 172.21.15.44:0/3262069244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3adebf30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7eff04165ef0 tx=0x7efef0009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48743529e8cd2d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7efef5600640 1 -- 172.21.15.44:0/3262069244 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0004050 con 0x556c3a8d6890 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7efef5600640 1 -- 172.21.15.44:0/3262069244 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef00041f0 con 0x556c3a8d6890 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7efef5600640 1 -- 172.21.15.44:0/3262069244 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0003600 con 0x556c3a8d6890 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 -- 172.21.15.44:0/3262069244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 msgr2=0x556c3adebf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 --2- 172.21.15.44:0/3262069244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3adebf30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7eff04165ef0 tx=0x7efef0009f50 comp rx=0 tx=0).stop 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 -- 172.21.15.44:0/3262069244 shutdown_connections 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 --2- 172.21.15.44:0/3262069244 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3a99aaa0 0x556c3adec470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 --2- 172.21.15.44:0/3262069244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3adebf30 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 --2- 172.21.15.44:0/3262069244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3ac7f6d0 0x556c3adeb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 -- 172.21.15.44:0/3262069244 >> 172.21.15.44:0/3262069244 conn(0x556c3a8aa5c0 msgr2=0x556c3ada8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 -- 172.21.15.44:0/3262069244 shutdown_connections 2024-09-17T05:44:01.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 -- 172.21.15.44:0/3262069244 wait complete. 2024-09-17T05:44:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 -- start start 2024-09-17T05:44:01.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.077+0000 7eff130ac000 1 Processor -- start 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ada79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ada7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3adae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556c3abf0df0 con 0x556c3a99aaa0 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556c3abecfe0 con 0x556c3a8d6890 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x556c3ab924d0 con 0x556c3ac7f6d0 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 10 client.0 _ll_register_callbacks cb 0x556c3ab707f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ada7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3adae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ada79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ada7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50030/0 (socket says 172.21.15.44:50030) 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3adae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:56580/0 (socket says 172.21.15.44:56580) 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 -- 172.21.15.44:0/2293221758 learned_addr learned my addr 172.21.15.44:0/2293221758 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 -- 172.21.15.44:0/2293221758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 msgr2=0x556c3ada79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ada79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 -- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 msgr2=0x556c3ada7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ada7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 -- 172.21.15.44:0/2293221758 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x556c3ab8b210 con 0x556c3ac7f6d0 2024-09-17T05:44:01.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff03e00640 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ada7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09a00640 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3adae5f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efefc092dd0 tx=0x7efefc05eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68d997d9279ba385 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7efeea000640 10 client.0 ms_handle_connect on v2:172.21.15.86:3301/0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7efeea000640 1 -- 172.21.15.44:0/2293221758 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc084030 con 0x556c3ac7f6d0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7efeea000640 1 -- 172.21.15.44:0/2293221758 <== mon.2 v2:172.21.15.86:3301/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7efefc05ac50 con 0x556c3ac7f6d0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x556c3ab85350 con 0x556c3ac7f6d0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7efeea000640 1 -- 172.21.15.44:0/2293221758 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7efefc01f040 con 0x556c3ac7f6d0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 10 client.6539 fetch_fsmap learned FSMap version 75 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x556c3ab71fc0 con 0x556c3ac7f6d0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7efeea000640 1 -- 172.21.15.44:0/2293221758 <== mon.2 v2:172.21.15.86:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556c3ab85350 con 0x556c3ac7f6d0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7efeea000640 1 -- 172.21.15.44:0/2293221758 <== mon.2 v2:172.21.15.86:3301/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7efefc022060 con 0x556c3ac7f6d0 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 10 client.6539 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 10 client.6539 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:44:01.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 20 client.6539 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a88f930 0x556c3adf2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 4 client.6539 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c3abffb00 con 0x556c3a88f930 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.081+0000 7eff09000640 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a88f930 0x556c3adf2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff09000640 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a88f930 0x556c3adf2e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc3c1c85ac31379 server_cookie=a8628cf09a9e88ee in_seq=0 out_seq=0 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7efeea000640 10 client.6539 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7efeea000640 1 -- 172.21.15.44:0/2293221758 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c3abffb00 con 0x556c3a88f930 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7efeea000640 10 client.6539 handle_command_reply: tid=0 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 client.6539 shutdown 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 msgr2=0x556c3adae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3adae5f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efefc092dd0 tx=0x7efefc05eb90 comp rx=0 tx=0).stop 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 shutdown_connections 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a88f930 0x556c3adf2e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3adae5f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ada7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 --2- 172.21.15.44:0/2293221758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ada79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7efeea000640 0 client.6539 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 >> 172.21.15.44:0/2293221758 conn(0x556c3a8aa5c0 msgr2=0x556c3ada0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 shutdown_connections 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 1 -- 172.21.15.44:0/2293221758 wait complete. 2024-09-17T05:44:01.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.085+0000 7eff130ac000 20 client.6539 trim_cache size 0 max 16384 2024-09-17T05:44:01.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 Processor -- start 2024-09-17T05:44:01.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 -- start start 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ae5d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ae5d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ae5dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556c3ada6b20 con 0x556c3a99aaa0 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff04205b90 con 0x556c3a8d6890 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7eff04204ba0 con 0x556c3ac7f6d0 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ae5d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ae5d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50034/0 (socket says 172.21.15.44:50034) 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 -- 172.21.15.44:0/1684955583 learned_addr learned my addr 172.21.15.44:0/1684955583 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff09a00640 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ae5dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff09000640 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ae5d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 -- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 msgr2=0x556c3ae5dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ae5dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 -- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 msgr2=0x556c3ae5d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ae5d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 -- 172.21.15.44:0/1684955583 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c3ac4a680 con 0x556c3a99aaa0 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff09000640 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ae5d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7eff03e00640 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ae5d730 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x556c3aca0760 tx=0x7efef00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e28b999cec03793 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7efef4c00640 1 -- 172.21.15.44:0/1684955583 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0029070 con 0x556c3a99aaa0 2024-09-17T05:44:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7efef4c00640 1 -- 172.21.15.44:0/1684955583 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef0021040 con 0x556c3a99aaa0 2024-09-17T05:44:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.105+0000 7efef4c00640 1 -- 172.21.15.44:0/1684955583 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0005590 con 0x556c3a99aaa0 2024-09-17T05:44:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- 172.21.15.44:0/1684955583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 msgr2=0x556c3ae5d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ae5d730 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x556c3aca0760 tx=0x7efef00046d0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- 172.21.15.44:0/1684955583 shutdown_connections 2024-09-17T05:44:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ae5dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a99aaa0 0x556c3ae5d730 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 --2- 172.21.15.44:0/1684955583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a8d6890 0x556c3ae5d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- 172.21.15.44:0/1684955583 >> 172.21.15.44:0/1684955583 conn(0x556c3a8aa5c0 msgr2=0x556c3adad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- 172.21.15.44:0/1684955583 shutdown_connections 2024-09-17T05:44:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- 172.21.15.44:0/1684955583 wait complete. 2024-09-17T05:44:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- start start 2024-09-17T05:44:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 Processor -- start 2024-09-17T05:44:01.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3ae5d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a99aaa0 0x556c3ae5db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ada2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff042044d0 con 0x556c3a8d6890 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff040cf620 con 0x556c3a99aaa0 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x556c3a8b2680 con 0x556c3ac7f6d0 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff130ac000 10 client.0 _ll_register_callbacks cb 0x7efefc00cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3ae5d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3ae5d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50046/0 (socket says 172.21.15.44:50046) 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 -- 172.21.15.44:0/4054014907 learned_addr learned my addr 172.21.15.44:0/4054014907 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09a00640 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ada2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff03e00640 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a99aaa0 0x556c3ae5db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 -- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 msgr2=0x556c3ada2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ada2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 -- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a99aaa0 msgr2=0x556c3ae5db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a99aaa0 0x556c3ae5db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.109+0000 7eff09000640 1 -- 172.21.15.44:0/4054014907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c3abb70b0 con 0x556c3a8d6890 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff09000640 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3ae5d610 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7efef801cda0 tx=0x7efef801b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c5ef4ba0ab7651 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 1 -- 172.21.15.44:0/4054014907 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef80d2060 con 0x556c3a8d6890 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 1 -- 172.21.15.44:0/4054014907 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7efef8003600 con 0x556c3a8d6890 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef0021040 con 0x556c3a8d6890 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 1 -- 172.21.15.44:0/4054014907 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7efef80d8050 con 0x556c3a8d6890 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 10 client.7479 fetch_fsmap learned FSMap version 75 2024-09-17T05:44:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x556c3ab83610 con 0x556c3a8d6890 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 1 -- 172.21.15.44:0/4054014907 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef0021040 con 0x556c3a8d6890 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 1 -- 172.21.15.44:0/4054014907 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7efef80db020 con 0x556c3a8d6890 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 10 client.7479 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 10 client.7479 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 20 client.7479 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a87d990 0x556c3ada3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 4 client.7479 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c3abfb5b0 con 0x556c3a87d990 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff03e00640 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a87d990 0x556c3ada3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff03e00640 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a87d990 0x556c3ada3680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=191d3bd83813717f server_cookie=2440cb3f22bca5b2 in_seq=0 out_seq=0 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 10 client.7479 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 1 -- 172.21.15.44:0/4054014907 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+377 (crc 0 0 0) 0x556c3abfb5b0 con 0x556c3a87d990 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 10 client.7479 handle_command_reply: tid=0 2024-09-17T05:44:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 client.7479 shutdown 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 msgr2=0x556c3ae5d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3ae5d610 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7efef801cda0 tx=0x7efef801b100 comp rx=0 tx=0).stop 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 shutdown_connections 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x556c3a87d990 0x556c3ada3680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x556c3ac7f6d0 0x556c3ada2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556c3a99aaa0 0x556c3ae5db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 --2- 172.21.15.44:0/4054014907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556c3a8d6890 0x556c3ae5d610 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7efeea000640 0 client.7479 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 >> 172.21.15.44:0/4054014907 conn(0x556c3a8aa5c0 msgr2=0x556c3adfdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 shutdown_connections 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 1 -- 172.21.15.44:0/4054014907 wait complete. 2024-09-17T05:44:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff130ac000 20 client.7479 trim_cache size 0 max 16384 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "48ff7a85-645c-49f4-8a52-1bbb4b4d0995": { 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:43:30.634327+0000", 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/dir", 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:44:01.117 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:44:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:01.118 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:01.118 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:44:01.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efee4073230 msgr2=0x7efee4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efee4073230 0x7efee4075740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efef80af000 tx=0x7efef80a7040 comp rx=0 tx=0).stop 2024-09-17T05:44:01.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0415f2e0 msgr2=0x7eff04157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0415f2e0 0x7eff04157cc0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e940 tx=0x7efefc00ee00 comp rx=0 tx=0).stop 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 shutdown_connections 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff0415f2e0 0x7eff04157cc0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7efee4073230 0x7efee4075740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff040b4f60 0x7eff041f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 --2- 172.21.15.44:0/4073006479 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff04073150 0x7eff040ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 >> 172.21.15.44:0/4073006479 conn(0x7eff0406ce40 msgr2=0x7eff04070390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 shutdown_connections 2024-09-17T05:44:01.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.113+0000 7eff0a400640 1 -- 172.21.15.44:0/4073006479 wait complete. 2024-09-17T05:44:01.134 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:44:01.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 -- 172.21.15.44:0/2545873056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f193406de50 msgr2=0x7f193406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 --2- 172.21.15.44:0/2545873056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f193406de50 0x7f193406e260 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f19340ca7b0 tx=0x7f192001c830 comp rx=0 tx=0).stop 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 -- 172.21.15.44:0/2545873056 shutdown_connections 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 --2- 172.21.15.44:0/2545873056 >> v2:172.21.15.86:3300/0 conn(0x7f19340cb470 0x7f19340cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 --2- 172.21.15.44:0/2545873056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f193406de50 0x7f193406e260 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 -- 172.21.15.44:0/2545873056 >> 172.21.15.44:0/2545873056 conn(0x7f19340ccaa0 msgr2=0x7f19340cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 -- 172.21.15.44:0/2545873056 shutdown_connections 2024-09-17T05:44:01.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 -- 172.21.15.44:0/2545873056 wait complete. 2024-09-17T05:44:01.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 Processor -- start 2024-09-17T05:44:01.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.293+0000 7f193be00640 1 -- start start 2024-09-17T05:44:01.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f193406de50 0x7f19340cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1934072e50 0x7f1934153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19340cb470 0x7f1934153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1934168ed0 con 0x7f19340cb470 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1934168d50 con 0x7f193406de50 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1934169050 con 0x7f1934072e50 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19340cb470 0x7f1934153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19340cb470 0x7f1934153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50062/0 (socket says 172.21.15.44:50062) 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 -- 172.21.15.44:0/933887660 learned_addr learned my addr 172.21.15.44:0/933887660 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939400640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f193406de50 0x7f19340cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1938a00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1934072e50 0x7f1934153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 -- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1934072e50 msgr2=0x7f1934153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1934072e50 0x7f1934153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 -- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f193406de50 msgr2=0x7f19340cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f193406de50 0x7f19340cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 -- 172.21.15.44:0/933887660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19340a0ec0 con 0x7f19340cb470 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1939e00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19340cb470 0x7f1934153cb0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f192c00e970 tx=0x7f192c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1931600640 1 -- 172.21.15.44:0/933887660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c004d30 con 0x7f19340cb470 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1931600640 1 -- 172.21.15.44:0/933887660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f192c00cac0 con 0x7f19340cb470 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f1931600640 1 -- 172.21.15.44:0/933887660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c005020 con 0x7f19340cb470 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19340b5990 con 0x7f19340cb470 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1934152f70 con 0x7f19340cb470 2024-09-17T05:44:01.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.297+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19340a0c30 con 0x7f19340cb470 2024-09-17T05:44:01.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.301+0000 7f1931600640 1 -- 172.21.15.44:0/933887660 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f192c0051c0 con 0x7f19340cb470 2024-09-17T05:44:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.301+0000 7f1931600640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1914073260 0x7f1914075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.301+0000 7f1931600640 1 -- 172.21.15.44:0/933887660 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f192c094dd0 con 0x7f19340cb470 2024-09-17T05:44:01.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.301+0000 7f1939400640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1914073260 0x7f1914075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.301+0000 7f1939400640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1914073260 0x7f1914075770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1928007fd0 tx=0x7f1928009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.305+0000 7f1931600640 1 -- 172.21.15.44:0/933887660 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f192c016030 con 0x7f19340cb470 2024-09-17T05:44:01.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.517+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f193406e260 con 0x7f19340cb470 2024-09-17T05:44:01.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.517+0000 7f1931600640 1 -- 172.21.15.44:0/933887660 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5223 (secure 0 0 0) 0x7f192c05f420 con 0x7f19340cb470 2024-09-17T05:44:01.518 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:01.518 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"btime":"2024-09-17T05:43:27:494628+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:27.494619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7344,"qdb_cluster":[7344]},"id":6}]} 2024-09-17T05:44:01.519 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2024-09-17T05:44:01.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1914073260 msgr2=0x7f1914075770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1914073260 0x7f1914075770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1928007fd0 tx=0x7f1928009040 comp rx=0 tx=0).stop 2024-09-17T05:44:01.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19340cb470 msgr2=0x7f1934153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19340cb470 0x7f1934153cb0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f192c00e970 tx=0x7f192c00ee30 comp rx=0 tx=0).stop 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 shutdown_connections 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19340cb470 0x7f1934153cb0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1934072e50 0x7f1934153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1914073260 0x7f1914075770 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 --2- 172.21.15.44:0/933887660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f193406de50 0x7f19340cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 >> 172.21.15.44:0/933887660 conn(0x7f19340ccaa0 msgr2=0x7f193415f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 shutdown_connections 2024-09-17T05:44:01.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.521+0000 7f193be00640 1 -- 172.21.15.44:0/933887660 wait complete. 2024-09-17T05:44:01.541 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 -- 172.21.15.44:0/3909696077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c0cb470 msgr2=0x7f593c0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 --2- 172.21.15.44:0/3909696077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c0cb470 0x7f593c0cb880 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f593c06ace0 tx=0x7f593401ccf0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 -- 172.21.15.44:0/3909696077 shutdown_connections 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 --2- 172.21.15.44:0/3909696077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c0cb470 0x7f593c0cb880 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 --2- 172.21.15.44:0/3909696077 >> v2:172.21.15.86:3300/0 conn(0x7f593c072e50 0x7f593c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 -- 172.21.15.44:0/3909696077 >> 172.21.15.44:0/3909696077 conn(0x7f593c0ccaa0 msgr2=0x7f593c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 -- 172.21.15.44:0/3909696077 shutdown_connections 2024-09-17T05:44:01.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 -- 172.21.15.44:0/3909696077 wait complete. 2024-09-17T05:44:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.701+0000 7f5942200640 1 Processor -- start 2024-09-17T05:44:01.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 -- start start 2024-09-17T05:44:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f593c06de50 0x7f593c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c072e50 0x7f593c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f593c0cb470 0x7f593c154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f593c168e80 con 0x7f593c072e50 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f593c168d00 con 0x7f593c06de50 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f593c169000 con 0x7f593c0cb470 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c072e50 0x7f593c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c072e50 0x7f593c154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50076/0 (socket says 172.21.15.44:50076) 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 -- 172.21.15.44:0/3510242194 learned_addr learned my addr 172.21.15.44:0/3510242194 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f593b400640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f593c06de50 0x7f593c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f593be00640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f593c0cb470 0x7f593c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 -- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f593c0cb470 msgr2=0x7f593c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f593c0cb470 0x7f593c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 -- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f593c06de50 msgr2=0x7f593c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f593c06de50 0x7f593c0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 -- 172.21.15.44:0/3510242194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c154ee0 con 0x7f593c072e50 2024-09-17T05:44:01.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933e00640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c072e50 0x7f593c154100 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f592400c3c0 tx=0x7f592400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933400640 1 -- 172.21.15.44:0/3510242194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924017070 con 0x7f593c072e50 2024-09-17T05:44:01.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933400640 1 -- 172.21.15.44:0/3510242194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59240053c0 con 0x7f593c072e50 2024-09-17T05:44:01.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5933400640 1 -- 172.21.15.44:0/3510242194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924003860 con 0x7f593c072e50 2024-09-17T05:44:01.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c09f7a0 con 0x7f593c072e50 2024-09-17T05:44:01.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.705+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c158080 con 0x7f593c072e50 2024-09-17T05:44:01.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.709+0000 7f5933400640 1 -- 172.21.15.44:0/3510242194 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f592401a070 con 0x7f593c072e50 2024-09-17T05:44:01.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.709+0000 7f5933400640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5918073230 0x7f5918075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.709+0000 7f5933400640 1 -- 172.21.15.44:0/3510242194 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f59240938d0 con 0x7f593c072e50 2024-09-17T05:44:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.709+0000 7f59498d2000 1 Processor -- start 2024-09-17T05:44:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.709+0000 7f59498d2000 1 -- start start 2024-09-17T05:44:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.709+0000 7f593b400640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5918073230 0x7f5918075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.709+0000 7f593b400640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5918073230 0x7f5918075740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f592c00bb50 tx=0x7f592c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324832e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f323331c0 0x559f32483820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f32483d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f32321d00 con 0x559f3233db60 2024-09-17T05:44:01.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f32295c90 con 0x559f3231cd90 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559f322850c0 con 0x559f323331c0 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324832e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324832e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50080/0 (socket says 172.21.15.44:50080) 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 -- 172.21.15.44:0/19019135 learned_addr learned my addr 172.21.15.44:0/19019135 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f5933e00640 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f323331c0 0x559f32483820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593be00640 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f32483d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 -- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f323331c0 msgr2=0x559f32483820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f323331c0 0x559f32483820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 -- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 msgr2=0x559f32483d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f32483d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 -- 172.21.15.44:0/19019135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f32260290 con 0x559f3233db60 2024-09-17T05:44:01.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593be00640 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f32483d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:01.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f593b400640 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324832e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f592c005d10 tx=0x7f592c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932625e90e6f92d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f592b400640 1 -- 172.21.15.44:0/19019135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c01e620 con 0x559f3233db60 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f592b400640 1 -- 172.21.15.44:0/19019135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f592c01e7c0 con 0x559f3233db60 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f592b400640 1 -- 172.21.15.44:0/19019135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c01eb70 con 0x559f3233db60 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- 172.21.15.44:0/19019135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 msgr2=0x559f324832e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324832e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f592c005d10 tx=0x7f592c013000 comp rx=0 tx=0).stop 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- 172.21.15.44:0/19019135 shutdown_connections 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f32483d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f323331c0 0x559f32483820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 --2- 172.21.15.44:0/19019135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324832e0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- 172.21.15.44:0/19019135 >> 172.21.15.44:0/19019135 conn(0x559f31f42760 msgr2=0x559f32466790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- 172.21.15.44:0/19019135 shutdown_connections 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- 172.21.15.44:0/19019135 wait complete. 2024-09-17T05:44:01.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.713+0000 7f59498d2000 1 -- start start 2024-09-17T05:44:01.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 Processor -- start 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f3243f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f3243f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f3221f940 con 0x559f323331c0 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f32288ed0 con 0x559f3231cd90 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559f31f4a820 con 0x559f3233db60 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 10 client.0 _ll_register_callbacks cb 0x559f322637f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f3243f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f3243f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50088/0 (socket says 172.21.15.44:50088) 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 -- 172.21.15.44:0/1876772970 learned_addr learned my addr 172.21.15.44:0/1876772970 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f593b400640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f3243f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f593be00640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 -- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 msgr2=0x559f324658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 -- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 msgr2=0x559f3243f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f3243f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 -- 172.21.15.44:0/1876772970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f32238550 con 0x559f323331c0 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f593b400640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f3243f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f593be00640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f5933e00640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f3243f610 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f592405deb0 tx=0x7f592405daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3474a46ada14725 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f591fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f591fe00640 1 -- 172.21.15.44:0/1876772970 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924067890 con 0x559f323331c0 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f591fe00640 1 -- 172.21.15.44:0/1876772970 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f5924059870 con 0x559f323331c0 2024-09-17T05:44:01.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f3221d400 con 0x559f323331c0 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f591fe00640 1 -- 172.21.15.44:0/1876772970 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f5924059a70 con 0x559f323331c0 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 10 client.7497 fetch_fsmap learned FSMap version 75 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x559f32223480 con 0x559f323331c0 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f591fe00640 1 -- 172.21.15.44:0/1876772970 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559f3221d400 con 0x559f323331c0 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f591fe00640 1 -- 172.21.15.44:0/1876772970 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f5924067ae0 con 0x559f323331c0 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 10 client.7497 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 10 client.7497 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 20 client.7497 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f27ad0 0x559f324948a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 4 client.7497 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.717+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f32297be0 con 0x559f31f27ad0 2024-09-17T05:44:01.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f593b400640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f27ad0 0x559f324948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f593b400640 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f27ad0 0x559f324948a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61253d4ca3238981 server_cookie=34c2773fc33cf1eb in_seq=0 out_seq=0 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f591fe00640 10 client.7497 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f591fe00640 1 -- 172.21.15.44:0/1876772970 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f32297be0 con 0x559f31f27ad0 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f591fe00640 10 client.7497 handle_command_reply: tid=0 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 client.7497 shutdown 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 msgr2=0x559f3243f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f3243f610 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f592405deb0 tx=0x7f592405daf0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 shutdown_connections 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f27ad0 0x559f324948a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f3243f610 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f591fe00640 0 client.7497 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 --2- 172.21.15.44:0/1876772970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f3243f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 >> 172.21.15.44:0/1876772970 conn(0x559f31f42760 msgr2=0x559f32437680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 shutdown_connections 2024-09-17T05:44:01.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 1 -- 172.21.15.44:0/1876772970 wait complete. 2024-09-17T05:44:01.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.721+0000 7f59498d2000 20 client.7497 trim_cache size 0 max 16384 2024-09-17T05:44:01.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 Processor -- start 2024-09-17T05:44:01.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 -- start start 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f324f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f324f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324f5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f322881e0 con 0x559f323331c0 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f32294a60 con 0x559f3231cd90 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559f32251300 con 0x559f3233db60 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f324f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f324f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50100/0 (socket says 172.21.15.44:50100) 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 -- 172.21.15.44:0/2373624240 learned_addr learned my addr 172.21.15.44:0/2373624240 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f593b400640 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f324f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f593be00640 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 -- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 msgr2=0x559f324f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 -- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 msgr2=0x559f324f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f324f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 -- 172.21.15.44:0/2373624240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f3230ad10 con 0x559f323331c0 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f5933e00640 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f324f4b00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f592405dc20 tx=0x7f592405a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48287709909fe4c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f592aa00640 1 -- 172.21.15.44:0/2373624240 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592406b070 con 0x559f323331c0 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f592aa00640 1 -- 172.21.15.44:0/2373624240 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f592405d390 con 0x559f323331c0 2024-09-17T05:44:01.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f592aa00640 1 -- 172.21.15.44:0/2373624240 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592405cbf0 con 0x559f323331c0 2024-09-17T05:44:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 -- 172.21.15.44:0/2373624240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 msgr2=0x559f324f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f324f4b00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f592405dc20 tx=0x7f592405a430 comp rx=0 tx=0).stop 2024-09-17T05:44:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 -- 172.21.15.44:0/2373624240 shutdown_connections 2024-09-17T05:44:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3233db60 0x559f324f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.737+0000 7f59498d2000 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f323331c0 0x559f324f4b00 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 --2- 172.21.15.44:0/2373624240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f3231cd90 0x559f324f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 -- 172.21.15.44:0/2373624240 >> 172.21.15.44:0/2373624240 conn(0x559f31f42760 msgr2=0x559f32439690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 -- 172.21.15.44:0/2373624240 shutdown_connections 2024-09-17T05:44:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 -- 172.21.15.44:0/2373624240 wait complete. 2024-09-17T05:44:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 -- start start 2024-09-17T05:44:01.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 Processor -- start 2024-09-17T05:44:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3231cd90 0x559f324f8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f323331c0 0x559f324f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324f9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559f3228d500 con 0x559f3233db60 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f32230300 con 0x559f323331c0 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x559f32242670 con 0x559f3231cd90 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f59498d2000 10 client.0 _ll_register_callbacks cb 0x7f592400c310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50112/0 (socket says 172.21.15.44:50112) 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 -- 172.21.15.44:0/790971733 learned_addr learned my addr 172.21.15.44:0/790971733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593b400640 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3231cd90 0x559f324f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f5933e00640 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f323331c0 0x559f324f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 -- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3231cd90 msgr2=0x559f324f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3231cd90 0x559f324f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 -- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f323331c0 msgr2=0x559f324f8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f323331c0 0x559f324f8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 -- 172.21.15.44:0/790971733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f3223be50 con 0x559f3233db60 2024-09-17T05:44:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f593be00640 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324f9080 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f59340b0040 tx=0x7f59340a5eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e744a6ea7b45fea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f591fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f591fe00640 1 -- 172.21.15.44:0/790971733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340bc020 con 0x559f3233db60 2024-09-17T05:44:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.741+0000 7f591fe00640 1 -- 172.21.15.44:0/790971733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f5934003980 con 0x559f3233db60 2024-09-17T05:44:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f592405d390 con 0x559f3233db60 2024-09-17T05:44:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f591fe00640 1 -- 172.21.15.44:0/790971733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f59340c6050 con 0x559f3233db60 2024-09-17T05:44:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 10 client.7503 fetch_fsmap learned FSMap version 75 2024-09-17T05:44:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x559f3222a2d0 con 0x559f3233db60 2024-09-17T05:44:01.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f591fe00640 1 -- 172.21.15.44:0/790971733 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f592405d390 con 0x559f3233db60 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f591fe00640 1 -- 172.21.15.44:0/790971733 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f59340c9020 con 0x559f3233db60 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 10 client.7503 fetch_fsmap finished waiting for FSMap version 75 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 10 client.7503 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 20 client.7503 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f15b30 0x559f32496c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 4 client.7503 mds_command: new command op to 7344 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 --> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x559f32293690 con 0x559f31f15b30 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f593b400640 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f15b30 0x559f32496c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f593b400640 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f15b30 0x559f32496c50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa2605a4a4093d2 server_cookie=284b50ce301f722d in_seq=0 out_seq=0 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f591fe00640 10 client.7503 ms_handle_connect on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f591fe00640 1 -- 172.21.15.44:0/790971733 <== mds.0 v2:172.21.15.44:6833/1038379221 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f32293690 con 0x559f31f15b30 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f591fe00640 10 client.7503 handle_command_reply: tid=0 2024-09-17T05:44:01.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 client.7503 shutdown 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 msgr2=0x559f324f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324f9080 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f59340b0040 tx=0x7f59340a5eb0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 shutdown_connections 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:6833/1038379221,v1:172.21.15.44:6835/1038379221] conn(0x559f31f15b30 0x559f32496c50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559f3233db60 0x559f324f9080 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f323331c0 0x559f324f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 --2- 172.21.15.44:0/790971733 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x559f3231cd90 0x559f324f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 >> 172.21.15.44:0/790971733 conn(0x559f31f42760 msgr2=0x559f3248fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f591fe00640 0 client.7503 ms_handle_reset on v2:172.21.15.44:6833/1038379221 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 shutdown_connections 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 1 -- 172.21.15.44:0/790971733 wait complete. 2024-09-17T05:44:01.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f59498d2000 20 client.7503 trim_cache size 0 max 16384 2024-09-17T05:44:01.749 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:01.749 INFO:teuthology.orchestra.run.smithi044.stdout:[] 2024-09-17T05:44:01.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5918073230 msgr2=0x7f5918075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5918073230 0x7f5918075740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f592c00bb50 tx=0x7f592c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c072e50 msgr2=0x7f593c154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c072e50 0x7f593c154100 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f592400c3c0 tx=0x7f592400c880 comp rx=0 tx=0).stop 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 shutdown_connections 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f593c0cb470 0x7f593c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f593c072e50 0x7f593c154100 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5918073230 0x7f5918075740 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 --2- 172.21.15.44:0/3510242194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f593c06de50 0x7f593c0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 >> 172.21.15.44:0/3510242194 conn(0x7f593c0ccaa0 msgr2=0x7f593c09f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 shutdown_connections 2024-09-17T05:44:01.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.745+0000 7f5942200640 1 -- 172.21.15.44:0/3510242194 wait complete. 2024-09-17T05:44:01.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:44:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 -- 172.21.15.44:0/1105851651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e4070610 msgr2=0x7fa2e4070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 --2- 172.21.15.44:0/1105851651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e4070610 0x7fa2e4070a20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4072340 tx=0x7fa2dc01cd80 comp rx=0 tx=0).stop 2024-09-17T05:44:01.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 -- 172.21.15.44:0/1105851651 shutdown_connections 2024-09-17T05:44:01.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 --2- 172.21.15.44:0/1105851651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e4070610 0x7fa2e4070a20 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 --2- 172.21.15.44:0/1105851651 >> v2:172.21.15.86:3300/0 conn(0x7fa2e406e560 0x7fa2e40700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 -- 172.21.15.44:0/1105851651 >> 172.21.15.44:0/1105851651 conn(0x7fa2e40ccaa0 msgr2=0x7fa2e40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:01.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 -- 172.21.15.44:0/1105851651 shutdown_connections 2024-09-17T05:44:01.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 -- 172.21.15.44:0/1105851651 wait complete. 2024-09-17T05:44:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 Processor -- start 2024-09-17T05:44:01.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.925+0000 7fa2e9000640 1 -- start start 2024-09-17T05:44:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e4070610 0x7fa2e40aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b5880 0x7fa2e40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e406d3e0 0x7fa2e406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4169ee0 con 0x7fa2e406d3e0 2024-09-17T05:44:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4169d60 con 0x7fa2e4070610 2024-09-17T05:44:01.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e416a060 con 0x7fa2e40b5880 2024-09-17T05:44:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e406d3e0 0x7fa2e406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e406d3e0 0x7fa2e406d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50140/0 (socket says 172.21.15.44:50140) 2024-09-17T05:44:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 -- 172.21.15.44:0/2691476781 learned_addr learned my addr 172.21.15.44:0/2691476781 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e1e00640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e4070610 0x7fa2e40aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2d9400640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b5880 0x7fa2e40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 -- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b5880 msgr2=0x7fa2e40ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b5880 0x7fa2e40ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 -- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e4070610 msgr2=0x7fa2e40aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e4070610 0x7fa2e40aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 -- 172.21.15.44:0/2691476781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e406dd30 con 0x7fa2e406d3e0 2024-09-17T05:44:01.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e2800640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e406d3e0 0x7fa2e406d7f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc019990 tx=0x7fa2dc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2daa00640 1 -- 172.21.15.44:0/2691476781 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc0bb070 con 0x7fa2e406d3e0 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2daa00640 1 -- 172.21.15.44:0/2691476781 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2dc004d40 con 0x7fa2e406d3e0 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e40b30c0 con 0x7fa2e406d3e0 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2daa00640 1 -- 172.21.15.44:0/2691476781 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc0b2040 con 0x7fa2e406d3e0 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e40b3680 con 0x7fa2e406d3e0 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.929+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e40700d0 con 0x7fa2e406d3e0 2024-09-17T05:44:01.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.933+0000 7fa2daa00640 1 -- 172.21.15.44:0/2691476781 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa2dc0be070 con 0x7fa2e406d3e0 2024-09-17T05:44:01.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.933+0000 7fa2daa00640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa2c0073200 0x7fa2c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:01.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.933+0000 7fa2daa00640 1 -- 172.21.15.44:0/2691476781 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fa2dc12e0e0 con 0x7fa2e406d3e0 2024-09-17T05:44:01.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.933+0000 7fa2e1e00640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa2c0073200 0x7fa2c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:01.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.933+0000 7fa2e1e00640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa2c0073200 0x7fa2c0075710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4001650 tx=0x7fa2d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:01.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:01.937+0000 7fa2daa00640 1 -- 172.21.15.44:0/2691476781 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa2e406dd30 con 0x7fa2e406d3e0 2024-09-17T05:44:02.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.153+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa2e40cb010 con 0x7fa2e406d3e0 2024-09-17T05:44:02.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.153+0000 7fa2daa00640 1 -- 172.21.15.44:0/2691476781 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa2dc016970 con 0x7fa2e406d3e0 2024-09-17T05:44:02.153 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:02.153 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:44:02.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa2c0073200 msgr2=0x7fa2c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa2c0073200 0x7fa2c0075710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4001650 tx=0x7fa2d4009040 comp rx=0 tx=0).stop 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e406d3e0 msgr2=0x7fa2e406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e406d3e0 0x7fa2e406d7f0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc019990 tx=0x7fa2dc005b00 comp rx=0 tx=0).stop 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 shutdown_connections 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2e406d3e0 0x7fa2e406d7f0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa2e40b5880 0x7fa2e40ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa2c0073200 0x7fa2c0075710 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 --2- 172.21.15.44:0/2691476781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2e4070610 0x7fa2e40aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 >> 172.21.15.44:0/2691476781 conn(0x7fa2e40ccaa0 msgr2=0x7fa2e40af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 shutdown_connections 2024-09-17T05:44:02.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.157+0000 7fa2e9000640 1 -- 172.21.15.44:0/2691476781 wait complete. 2024-09-17T05:44:02.175 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:44:02.175 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:44:02.176 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:44:02.273 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:44:02.369 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:44:02.369 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:44:02.370 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:02.370 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:02.379 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:02.379 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:02.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 -- 172.21.15.44:0/1994066315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e5406de50 msgr2=0x7f3e5406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 --2- 172.21.15.44:0/1994066315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e5406de50 0x7f3e5406e260 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3e540cff10 tx=0x7f3e4001c830 comp rx=0 tx=0).stop 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 -- 172.21.15.44:0/1994066315 shutdown_connections 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 --2- 172.21.15.44:0/1994066315 >> v2:172.21.15.86:3300/0 conn(0x7f3e540ced00 0x7f3e540cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 --2- 172.21.15.44:0/1994066315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e5406de50 0x7f3e5406e260 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 --2- 172.21.15.44:0/1994066315 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e54072e50 0x7f3e5415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 -- 172.21.15.44:0/1994066315 >> 172.21.15.44:0/1994066315 conn(0x7f3e540ccaa0 msgr2=0x7f3e540cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 -- 172.21.15.44:0/1994066315 shutdown_connections 2024-09-17T05:44:02.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.633+0000 7f3e5a600640 1 -- 172.21.15.44:0/1994066315 wait complete. 2024-09-17T05:44:02.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 Processor -- start 2024-09-17T05:44:02.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 -- start start 2024-09-17T05:44:02.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e5406de50 0x7f3e540b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e54072e50 0x7f3e540b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e540ced00 0x7f3e5415d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e540cc310 con 0x7f3e54072e50 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3e540cc190 con 0x7f3e5406de50 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e5a600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3e540cc490 con 0x7f3e540ced00 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e54072e50 0x7f3e540b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e54072e50 0x7f3e540b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50162/0 (socket says 172.21.15.44:50162) 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 -- 172.21.15.44:0/3962887109 learned_addr learned my addr 172.21.15.44:0/3962887109 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e53400640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e5406de50 0x7f3e540b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e53e00640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e540ced00 0x7f3e5415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 -- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e540ced00 msgr2=0x7f3e5415d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e540ced00 0x7f3e5415d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 -- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e5406de50 msgr2=0x7f3e540b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e5406de50 0x7f3e540b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 -- 172.21.15.44:0/3962887109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e540b1730 con 0x7f3e54072e50 2024-09-17T05:44:02.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.637+0000 7f3e52a00640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e54072e50 0x7f3e540b2e70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3e4001aee0 tx=0x7f3e400a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:02.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e4b400640 1 -- 172.21.15.44:0/3962887109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e400bb070 con 0x7f3e54072e50 2024-09-17T05:44:02.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e4b400640 1 -- 172.21.15.44:0/3962887109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e400043b0 con 0x7f3e54072e50 2024-09-17T05:44:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e540b1170 con 0x7f3e54072e50 2024-09-17T05:44:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e4b400640 1 -- 172.21.15.44:0/3962887109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e400b2040 con 0x7f3e54072e50 2024-09-17T05:44:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5415cf30 con 0x7f3e54072e50 2024-09-17T05:44:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e540b0ee0 con 0x7f3e54072e50 2024-09-17T05:44:02.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e4b400640 1 -- 172.21.15.44:0/3962887109 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e400052d0 con 0x7f3e54072e50 2024-09-17T05:44:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e4b400640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e34073200 0x7f3e34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e4b400640 1 -- 172.21.15.44:0/3962887109 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f3e4012def0 con 0x7f3e54072e50 2024-09-17T05:44:02.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.641+0000 7f3e53400640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e34073200 0x7f3e34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:02.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.645+0000 7f3e53400640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e34073200 0x7f3e34075710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400bad0 tx=0x7f3e4400b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:02.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.645+0000 7f3e4b400640 1 -- 172.21.15.44:0/3962887109 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3e400f2db0 con 0x7f3e54072e50 2024-09-17T05:44:02.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.837+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3e540c6f00 con 0x7f3e54072e50 2024-09-17T05:44:02.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.837+0000 7f3e4b400640 1 -- 172.21.15.44:0/3962887109 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v94) ==== 80+0+244 (secure 0 0 0) 0x7f3e400164b0 con 0x7f3e54072e50 2024-09-17T05:44:02.837 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/3231247769 2024-09-18T05:43:23.478847+0000 2024-09-17T05:44:02.837 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3305866275 2024-09-18T05:42:11.653403+0000 2024-09-17T05:44:02.838 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3231247769 2024-09-18T05:43:23.478847+0000 2024-09-17T05:44:02.838 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6833/3305866275 2024-09-18T05:42:11.653403+0000 2024-09-17T05:44:02.838 INFO:teuthology.orchestra.run.smithi044.stderr:listed 4 entries 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e34073200 msgr2=0x7f3e34075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e34073200 0x7f3e34075710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400bad0 tx=0x7f3e4400b260 comp rx=0 tx=0).stop 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e54072e50 msgr2=0x7f3e540b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e54072e50 0x7f3e540b2e70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3e4001aee0 tx=0x7f3e400a5640 comp rx=0 tx=0).stop 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 shutdown_connections 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e540ced00 0x7f3e5415d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e54072e50 0x7f3e540b2e70 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e34073200 0x7f3e34075710 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 --2- 172.21.15.44:0/3962887109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e5406de50 0x7f3e540b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 >> 172.21.15.44:0/3962887109 conn(0x7f3e540ccaa0 msgr2=0x7f3e541566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 shutdown_connections 2024-09-17T05:44:02.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:02.841+0000 7f3e5a600640 1 -- 172.21.15.44:0/3962887109 wait complete. 2024-09-17T05:44:02.859 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:44:02.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:02.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:02.885 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:44:02.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:02.886 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:44:02.935 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:44:02.935 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:44:02.935 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:02.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:44:02.945 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:44:02.945 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:02.945 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:02.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:44:02.987 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:44:02.987 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:44:02.987 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:02.996 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:44:02.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 -- 172.21.15.44:0/1520435982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40b5880 msgr2=0x7ff0c406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 --2- 172.21.15.44:0/1520435982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40b5880 0x7ff0c406de50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff0c409e100 tx=0x7ff0b401c6e0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 -- 172.21.15.44:0/1520435982 shutdown_connections 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 --2- 172.21.15.44:0/1520435982 >> v2:172.21.15.86:3300/0 conn(0x7ff0c40ce300 0x7ff0c4167120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 --2- 172.21.15.44:0/1520435982 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40b5880 0x7ff0c406de50 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 -- 172.21.15.44:0/1520435982 >> 172.21.15.44:0/1520435982 conn(0x7ff0c40ccaa0 msgr2=0x7ff0c40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 -- 172.21.15.44:0/1520435982 shutdown_connections 2024-09-17T05:44:03.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.189+0000 7ff0ca000640 1 -- 172.21.15.44:0/1520435982 wait complete. 2024-09-17T05:44:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 Processor -- start 2024-09-17T05:44:03.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 -- start start 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c406e390 0x7ff0c40c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40b5880 0x7ff0c4154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce300 0x7ff0c41fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c416a000 con 0x7ff0c40ce300 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c4169e80 con 0x7ff0c406e390 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c416a180 con 0x7ff0c40b5880 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce300 0x7ff0c41fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce300 0x7ff0c41fa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50184/0 (socket says 172.21.15.44:50184) 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 -- 172.21.15.44:0/3866952521 learned_addr learned my addr 172.21.15.44:0/3866952521 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3400640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c406e390 0x7ff0c40c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c2a00640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40b5880 0x7ff0c4154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 -- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40b5880 msgr2=0x7ff0c4154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40b5880 0x7ff0c4154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 -- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c406e390 msgr2=0x7ff0c40c2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c406e390 0x7ff0c40c2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 -- 172.21.15.44:0/3866952521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c40b30c0 con 0x7ff0c40ce300 2024-09-17T05:44:03.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0c3e00640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce300 0x7ff0c41fa830 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00ba10 tx=0x7ff0bc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0bb400640 1 -- 172.21.15.44:0/3866952521 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc019070 con 0x7ff0c40ce300 2024-09-17T05:44:03.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0bb400640 1 -- 172.21.15.44:0/3866952521 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0bc00cc50 con 0x7ff0c40ce300 2024-09-17T05:44:03.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c40b33a0 con 0x7ff0c40ce300 2024-09-17T05:44:03.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0bb400640 1 -- 172.21.15.44:0/3866952521 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0146a0 con 0x7ff0c40ce300 2024-09-17T05:44:03.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.193+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c40b3960 con 0x7ff0c40ce300 2024-09-17T05:44:03.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.197+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c406de50 con 0x7ff0c40ce300 2024-09-17T05:44:03.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.197+0000 7ff0bb400640 1 -- 172.21.15.44:0/3866952521 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff0bc01c070 con 0x7ff0c40ce300 2024-09-17T05:44:03.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.197+0000 7ff0bb400640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a4073200 0x7ff0a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.197+0000 7ff0bb400640 1 -- 172.21.15.44:0/3866952521 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7ff0bc0941f0 con 0x7ff0c40ce300 2024-09-17T05:44:03.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.197+0000 7ff0c3400640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a4073200 0x7ff0a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.201+0000 7ff0c3400640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a4073200 0x7ff0a4075710 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af000 tx=0x7ff0b401af20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.201+0000 7ff0bb400640 1 -- 172.21.15.44:0/3866952521 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff0bc05e840 con 0x7ff0c40ce300 2024-09-17T05:44:03.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0c40cdd00 con 0x7ff0c40ce300 2024-09-17T05:44:03.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0bb400640 1 -- 172.21.15.44:0/3866952521 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5223 (secure 0 0 0) 0x7ff0bc063270 con 0x7ff0c40ce300 2024-09-17T05:44:03.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:03.413 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"btime":"2024-09-17T05:43:27:494628+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:27.494619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7344,"qdb_cluster":[7344]},"id":6}]} 2024-09-17T05:44:03.413 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a4073200 msgr2=0x7ff0a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a4073200 0x7ff0a4075710 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40af000 tx=0x7ff0b401af20 comp rx=0 tx=0).stop 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce300 msgr2=0x7ff0c41fa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce300 0x7ff0c41fa830 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00ba10 tx=0x7ff0bc00bed0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 shutdown_connections 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0c40ce300 0x7ff0c41fa830 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0c40b5880 0x7ff0c4154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff0a4073200 0x7ff0a4075710 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 --2- 172.21.15.44:0/3866952521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0c406e390 0x7ff0c40c2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 >> 172.21.15.44:0/3866952521 conn(0x7ff0c40ccaa0 msgr2=0x7ff0c4070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.413+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 shutdown_connections 2024-09-17T05:44:03.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.417+0000 7ff0ca000640 1 -- 172.21.15.44:0/3866952521 wait complete. 2024-09-17T05:44:03.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 -- 172.21.15.44:0/3173268501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406de50 msgr2=0x7f42f406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 --2- 172.21.15.44:0/3173268501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406de50 0x7f42f406e260 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f42f40cff10 tx=0x7f42e001c830 comp rx=0 tx=0).stop 2024-09-17T05:44:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 -- 172.21.15.44:0/3173268501 shutdown_connections 2024-09-17T05:44:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 --2- 172.21.15.44:0/3173268501 >> v2:172.21.15.86:3300/0 conn(0x7f42f40ced00 0x7f42f40cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 --2- 172.21.15.44:0/3173268501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f406de50 0x7f42f406e260 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 --2- 172.21.15.44:0/3173268501 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42f4072e50 0x7f42f415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 -- 172.21.15.44:0/3173268501 >> 172.21.15.44:0/3173268501 conn(0x7f42f40ccaa0 msgr2=0x7f42f40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 -- 172.21.15.44:0/3173268501 shutdown_connections 2024-09-17T05:44:03.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.593+0000 7f42f8a00640 1 -- 172.21.15.44:0/3173268501 wait complete. 2024-09-17T05:44:03.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 Processor -- start 2024-09-17T05:44:03.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 -- start start 2024-09-17T05:44:03.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42f406de50 0x7f42f41f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f4072e50 0x7f42f40a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42f40ced00 0x7f42f40a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40cea00 con 0x7f42f4072e50 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40ce880 con 0x7f42f40ced00 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f42f40cb470 con 0x7f42f406de50 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f4072e50 0x7f42f40a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f4072e50 0x7f42f40a0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50198/0 (socket says 172.21.15.44:50198) 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 -- 172.21.15.44:0/2113952261 learned_addr learned my addr 172.21.15.44:0/2113952261 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1e00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42f406de50 0x7f42f41f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f2800640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42f40ced00 0x7f42f40a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 -- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42f406de50 msgr2=0x7f42f41f8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42f406de50 0x7f42f41f8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 -- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42f40ced00 msgr2=0x7f42f40a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42f40ced00 0x7f42f40a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 -- 172.21.15.44:0/2113952261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f40c9de0 con 0x7f42f4072e50 2024-09-17T05:44:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f1400640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f4072e50 0x7f42f40a0350 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f42e001aee0 tx=0x7f42e00a66b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42ea000640 1 -- 172.21.15.44:0/2113952261 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e00bd070 con 0x7f42f4072e50 2024-09-17T05:44:03.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42ea000640 1 -- 172.21.15.44:0/2113952261 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e0004490 con 0x7f42f4072e50 2024-09-17T05:44:03.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f415b100 con 0x7f42f4072e50 2024-09-17T05:44:03.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42ea000640 1 -- 172.21.15.44:0/2113952261 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0005290 con 0x7f42f4072e50 2024-09-17T05:44:03.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.597+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f415b6c0 con 0x7f42f4072e50 2024-09-17T05:44:03.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.601+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f415aef0 con 0x7f42f4072e50 2024-09-17T05:44:03.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.601+0000 7f42ea000640 1 -- 172.21.15.44:0/2113952261 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f42e0005430 con 0x7f42f4072e50 2024-09-17T05:44:03.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.601+0000 7f42ea000640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d4073200 0x7f42d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:03.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.601+0000 7f42ea000640 1 -- 172.21.15.44:0/2113952261 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f42e012e6a0 con 0x7f42f4072e50 2024-09-17T05:44:03.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.601+0000 7f42f1e00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d4073200 0x7f42d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:03.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.601+0000 7f42f1e00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d4073200 0x7f42d4075710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f42e4005fd0 tx=0x7f42e4005d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:03.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.605+0000 7f42ea000640 1 -- 172.21.15.44:0/2113952261 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f42e00164b0 con 0x7f42f4072e50 2024-09-17T05:44:03.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.817+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f415e990 con 0x7f42f4072e50 2024-09-17T05:44:03.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.817+0000 7f42ea000640 1 -- 172.21.15.44:0/2113952261 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5223 (secure 0 0 0) 0x7f42e00f93e0 con 0x7f42f4072e50 2024-09-17T05:44:03.817 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"btime":"2024-09-17T05:43:27:494628+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:27.494619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7344,"qdb_cluster":[7344]},"id":6}]} 2024-09-17T05:44:03.818 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2024-09-17T05:44:03.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d4073200 msgr2=0x7f42d4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d4073200 0x7f42d4075710 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f42e4005fd0 tx=0x7f42e4005d60 comp rx=0 tx=0).stop 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f4072e50 msgr2=0x7f42f40a0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f4072e50 0x7f42f40a0350 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f42e001aee0 tx=0x7f42e00a66b0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 shutdown_connections 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d4073200 0x7f42d4075710 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42f40ced00 0x7f42f40a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42f4072e50 0x7f42f40a0350 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 --2- 172.21.15.44:0/2113952261 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42f406de50 0x7f42f41f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 >> 172.21.15.44:0/2113952261 conn(0x7f42f40ccaa0 msgr2=0x7f42f406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 shutdown_connections 2024-09-17T05:44:03.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:03.821+0000 7f42f8a00640 1 -- 172.21.15.44:0/2113952261 wait complete. 2024-09-17T05:44:03.841 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 -- 172.21.15.44:0/4100622044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680b5880 msgr2=0x7fc86806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 --2- 172.21.15.44:0/4100622044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680b5880 0x7fc86806de50 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc868072de0 tx=0x7fc85c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 -- 172.21.15.44:0/4100622044 shutdown_connections 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 --2- 172.21.15.44:0/4100622044 >> v2:172.21.15.86:3300/0 conn(0x7fc8680ce130 0x7fc8680ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 --2- 172.21.15.44:0/4100622044 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc86806e390 0x7fc8680cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 --2- 172.21.15.44:0/4100622044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680b5880 0x7fc86806de50 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 -- 172.21.15.44:0/4100622044 >> 172.21.15.44:0/4100622044 conn(0x7fc8680ccaa0 msgr2=0x7fc8680cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 -- 172.21.15.44:0/4100622044 shutdown_connections 2024-09-17T05:44:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 -- 172.21.15.44:0/4100622044 wait complete. 2024-09-17T05:44:04.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 Processor -- start 2024-09-17T05:44:04.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.001+0000 7fc870200640 1 -- start start 2024-09-17T05:44:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc86806e390 0x7fc868158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8680b5880 0x7fc86815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680ce130 0x7fc86815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc868070c70 con 0x7fc8680ce130 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc868070af0 con 0x7fc8680b5880 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc868070df0 con 0x7fc86806e390 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680ce130 0x7fc86815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680ce130 0x7fc86815c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50218/0 (socket says 172.21.15.44:50218) 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 -- 172.21.15.44:0/3676133688 learned_addr learned my addr 172.21.15.44:0/3676133688 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86ce00640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8680b5880 0x7fc86815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86d800640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc86806e390 0x7fc868158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 -- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc86806e390 msgr2=0x7fc868158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc86806e390 0x7fc868158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 -- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8680b5880 msgr2=0x7fc86815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8680b5880 0x7fc86815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 -- 172.21.15.44:0/3676133688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8681594c0 con 0x7fc8680ce130 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc86e200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680ce130 0x7fc86815c1a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc86000eab0 tx=0x7fc86000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc865600640 1 -- 172.21.15.44:0/3676133688 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86000ce40 con 0x7fc8680ce130 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc865600640 1 -- 172.21.15.44:0/3676133688 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc860004b30 con 0x7fc8680ce130 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8681f9ef0 con 0x7fc8680ce130 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc865600640 1 -- 172.21.15.44:0/3676133688 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860005020 con 0x7fc8680ce130 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.005+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681fa4b0 con 0x7fc8680ce130 2024-09-17T05:44:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.009+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc86806de50 con 0x7fc8680ce130 2024-09-17T05:44:04.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.009+0000 7fc865600640 1 -- 172.21.15.44:0/3676133688 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc8600051c0 con 0x7fc8680ce130 2024-09-17T05:44:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.009+0000 7fc865600640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc848073230 0x7fc848075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.009+0000 7fc865600640 1 -- 172.21.15.44:0/3676133688 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fc8600950a0 con 0x7fc8680ce130 2024-09-17T05:44:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.009+0000 7fc86d800640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc848073230 0x7fc848075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.009+0000 7fc86d800640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc848073230 0x7fc848075740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0af000 tx=0x7fc85c01b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.013+0000 7fc865600640 1 -- 172.21.15.44:0/3676133688 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc8681594c0 con 0x7fc8680ce130 2024-09-17T05:44:04.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.189+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8680b0640 con 0x7fc8680ce130 2024-09-17T05:44:04.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.189+0000 7fc865600640 1 -- 172.21.15.44:0/3676133688 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+17434 (secure 0 0 0) 0x7fc86005f6f0 con 0x7fc8680ce130 2024-09-17T05:44:04.190 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:04.190 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":94,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:43:23.478878+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:59.546897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:00.752532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.15","mappings":[{"from":6,"to":4}]},{"pgid":"14.25","mappings":[{"from":7,"to":3}]},{"pgid":"14.31","mappings":[{"from":7,"to":0}]},{"pgid":"14.34","mappings":[{"from":7,"to":0}]},{"pgid":"14.37","mappings":[{"from":1,"to":0}]},{"pgid":"14.3e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6833/3231247769":"2024-09-18T05:43:23.478847+0000","172.21.15.44:6835/3305866275":"2024-09-18T05:42:11.653403+0000","172.21.15.44:6835/3231247769":"2024-09-18T05:43:23.478847+0000","172.21.15.44:6833/3305866275":"2024-09-18T05:42:11.653403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc848073230 msgr2=0x7fc848075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc848073230 0x7fc848075740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0af000 tx=0x7fc85c01b100 comp rx=0 tx=0).stop 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680ce130 msgr2=0x7fc86815c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680ce130 0x7fc86815c1a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc86000eab0 tx=0x7fc86000ef70 comp rx=0 tx=0).stop 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 shutdown_connections 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8680ce130 0x7fc86815c1a0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc848073230 0x7fc848075740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc8680b5880 0x7fc86815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 --2- 172.21.15.44:0/3676133688 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc86806e390 0x7fc868158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 >> 172.21.15.44:0/3676133688 conn(0x7fc8680ccaa0 msgr2=0x7fc868068ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:04.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 shutdown_connections 2024-09-17T05:44:04.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.193+0000 7fc870200640 1 -- 172.21.15.44:0/3676133688 wait complete. 2024-09-17T05:44:04.212 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:44:04.213 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:04.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 -- 172.21.15.44:0/1143276640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 msgr2=0x7f1648073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 --2- 172.21.15.44:0/1143276640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f1648073f60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1648163370 tx=0x7f163c01c890 comp rx=0 tx=0).stop 2024-09-17T05:44:04.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 -- 172.21.15.44:0/1143276640 shutdown_connections 2024-09-17T05:44:04.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 --2- 172.21.15.44:0/1143276640 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16480744a0 0x7f16480cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 --2- 172.21.15.44:0/1143276640 >> v2:172.21.15.86:3300/0 conn(0x7f16480aec80 0x7f16480cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 --2- 172.21.15.44:0/1143276640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f1648073f60 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 -- 172.21.15.44:0/1143276640 >> 172.21.15.44:0/1143276640 conn(0x7f16480d1120 msgr2=0x7f16480d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:04.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 -- 172.21.15.44:0/1143276640 shutdown_connections 2024-09-17T05:44:04.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.369+0000 7f1650800640 1 -- 172.21.15.44:0/1143276640 wait complete. 2024-09-17T05:44:04.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 Processor -- start 2024-09-17T05:44:04.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 -- start start 2024-09-17T05:44:04.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16480744a0 0x7f16480b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f16480b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16480aec80 0x7f16480b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f164815e320 con 0x7f16480ae870 2024-09-17T05:44:04.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f164815e1a0 con 0x7f16480aec80 2024-09-17T05:44:04.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f1650800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f164815e4a0 con 0x7f16480744a0 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.373+0000 7f164d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f16480b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f16480b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50238/0 (socket says 172.21.15.44:50238) 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 -- 172.21.15.44:0/889153512 learned_addr learned my addr 172.21.15.44:0/889153512 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164de00640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16480744a0 0x7f16480b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164e800640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16480aec80 0x7f16480b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 -- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16480744a0 msgr2=0x7f16480b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16480744a0 0x7f16480b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 -- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16480aec80 msgr2=0x7f16480b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16480aec80 0x7f16480b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 -- 172.21.15.44:0/889153512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1648161be0 con 0x7f16480ae870 2024-09-17T05:44:04.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f164d400640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f16480b2610 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f163800c9f0 tx=0x7f163800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:04.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f1642000640 1 -- 172.21.15.44:0/889153512 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1638007bb0 con 0x7f16480ae870 2024-09-17T05:44:04.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f1642000640 1 -- 172.21.15.44:0/889153512 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1638007e40 con 0x7f16480ae870 2024-09-17T05:44:04.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f1642000640 1 -- 172.21.15.44:0/889153512 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163800f690 con 0x7f16480ae870 2024-09-17T05:44:04.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16480b3f50 con 0x7f16480ae870 2024-09-17T05:44:04.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16480b4510 con 0x7f16480ae870 2024-09-17T05:44:04.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16480cb150 con 0x7f16480ae870 2024-09-17T05:44:04.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.377+0000 7f1642000640 1 -- 172.21.15.44:0/889153512 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f163800f830 con 0x7f16480ae870 2024-09-17T05:44:04.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.381+0000 7f1642000640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f162c073200 0x7f162c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.381+0000 7f1642000640 1 -- 172.21.15.44:0/889153512 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7f1638094c60 con 0x7f16480ae870 2024-09-17T05:44:04.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.381+0000 7f164de00640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f162c073200 0x7f162c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.381+0000 7f164de00640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f162c073200 0x7f162c075710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f163c0af000 tx=0x7f163c01b0d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:04.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.385+0000 7f1642000640 1 -- 172.21.15.44:0/889153512 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1648161be0 con 0x7f16480ae870 2024-09-17T05:44:04.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.593+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1648073f60 con 0x7f16480ae870 2024-09-17T05:44:04.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.593+0000 7f1642000640 1 -- 172.21.15.44:0/889153512 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5223 (secure 0 0 0) 0x7f1638014030 con 0x7f16480ae870 2024-09-17T05:44:04.594 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:04.594 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"btime":"2024-09-17T05:43:27:494628+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:27.494619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7344,"qdb_cluster":[7344]},"id":6}]} 2024-09-17T05:44:04.594 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2024-09-17T05:44:04.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f162c073200 msgr2=0x7f162c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f162c073200 0x7f162c075710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f163c0af000 tx=0x7f163c01b0d0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 msgr2=0x7f16480b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f16480b2610 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f163800c9f0 tx=0x7f163800ceb0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 shutdown_connections 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f162c073200 0x7f162c075710 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16480aec80 0x7f16480b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16480ae870 0x7f16480b2610 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 --2- 172.21.15.44:0/889153512 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16480744a0 0x7f16480b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 >> 172.21.15.44:0/889153512 conn(0x7f16480d1120 msgr2=0x7f1648157140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 shutdown_connections 2024-09-17T05:44:04.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.597+0000 7f1650800640 1 -- 172.21.15.44:0/889153512 wait complete. 2024-09-17T05:44:04.617 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:04.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 -- 172.21.15.44:0/825980916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 msgr2=0x7fb46c0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 --2- 172.21.15.44:0/825980916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 0x7fb46c0cb880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb464009bc0 tx=0x7fb46401cb10 comp rx=0 tx=0).stop 2024-09-17T05:44:04.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 -- 172.21.15.44:0/825980916 shutdown_connections 2024-09-17T05:44:04.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 --2- 172.21.15.44:0/825980916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 0x7fb46c0cb880 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 --2- 172.21.15.44:0/825980916 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c072e50 0x7fb46c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 -- 172.21.15.44:0/825980916 >> 172.21.15.44:0/825980916 conn(0x7fb46c0ccaa0 msgr2=0x7fb46c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:04.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 -- 172.21.15.44:0/825980916 shutdown_connections 2024-09-17T05:44:04.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 -- 172.21.15.44:0/825980916 wait complete. 2024-09-17T05:44:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 Processor -- start 2024-09-17T05:44:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.777+0000 7fb470c00640 1 -- start start 2024-09-17T05:44:04.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c06de50 0x7fb46c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46c072e50 0x7fb46c0aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 0x7fb46c164820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c168fc0 con 0x7fb46c072e50 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c168e40 con 0x7fb46c0cb470 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb46c169140 con 0x7fb46c06de50 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46c072e50 0x7fb46c0aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46c072e50 0x7fb46c0aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50244/0 (socket says 172.21.15.44:50244) 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 -- 172.21.15.44:0/1395688346 learned_addr learned my addr 172.21.15.44:0/1395688346 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb469e00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c06de50 0x7fb46c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb46a800640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 0x7fb46c164820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 -- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c06de50 msgr2=0x7fb46c0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c06de50 0x7fb46c0ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 -- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 msgr2=0x7fb46c164820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 0x7fb46c164820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 -- 172.21.15.44:0/1395688346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c153bc0 con 0x7fb46c072e50 2024-09-17T05:44:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb461400640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46c072e50 0x7fb46c0aea00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb45400c390 tx=0x7fb45400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb462a00640 1 -- 172.21.15.44:0/1395688346 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454011790 con 0x7fb46c072e50 2024-09-17T05:44:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb462a00640 1 -- 172.21.15.44:0/1395688346 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb454017070 con 0x7fb46c072e50 2024-09-17T05:44:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb462a00640 1 -- 172.21.15.44:0/1395688346 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454011cc0 con 0x7fb46c072e50 2024-09-17T05:44:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c165d60 con 0x7fb46c072e50 2024-09-17T05:44:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c158440 con 0x7fb46c072e50 2024-09-17T05:44:04.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.781+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46c0cb880 con 0x7fb46c072e50 2024-09-17T05:44:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.785+0000 7fb462a00640 1 -- 172.21.15.44:0/1395688346 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb45401c460 con 0x7fb46c072e50 2024-09-17T05:44:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.785+0000 7fb462a00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb448073230 0x7fb448075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:04.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.785+0000 7fb462a00640 1 -- 172.21.15.44:0/1395688346 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fb454094100 con 0x7fb46c072e50 2024-09-17T05:44:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.785+0000 7fb469e00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb448073230 0x7fb448075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:04.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.785+0000 7fb469e00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb448073230 0x7fb448075740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009600 tx=0x7fb45c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:04.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:04.789+0000 7fb462a00640 1 -- 172.21.15.44:0/1395688346 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb45405e7e0 con 0x7fb46c072e50 2024-09-17T05:44:05.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb46c0ade00 con 0x7fb46c072e50 2024-09-17T05:44:05.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb462a00640 1 -- 172.21.15.44:0/1395688346 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5223 (secure 0 0 0) 0x7fb454063210 con 0x7fb46c072e50 2024-09-17T05:44:05.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:05.004 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":75,"btime":"2024-09-17T05:43:27:494628+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:42:01.792332+0000","modified":"2024-09-17T05:43:27.494619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7344},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7344":{"gid":7344,"name":"a","rank":0,"incarnation":72,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/1038379221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1038379221},{"type":"v1","addr":"172.21.15.44:6835","nonce":1038379221}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7344,"qdb_cluster":[7344]},"id":6}]} 2024-09-17T05:44:05.005 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 75 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb448073230 msgr2=0x7fb448075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb448073230 0x7fb448075740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009600 tx=0x7fb45c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46c072e50 msgr2=0x7fb46c0aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46c072e50 0x7fb46c0aea00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb45400c390 tx=0x7fb45400c850 comp rx=0 tx=0).stop 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 shutdown_connections 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb448073230 0x7fb448075740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb46c0cb470 0x7fb46c164820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46c072e50 0x7fb46c0aea00 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 --2- 172.21.15.44:0/1395688346 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb46c06de50 0x7fb46c0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 >> 172.21.15.44:0/1395688346 conn(0x7fb46c0ccaa0 msgr2=0x7fb46c0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 shutdown_connections 2024-09-17T05:44:05.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.005+0000 7fb470c00640 1 -- 172.21.15.44:0/1395688346 wait complete. 2024-09-17T05:44:05.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:05.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 -- 172.21.15.44:0/552073917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680cf5b0 msgr2=0x7fce6815d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 --2- 172.21.15.44:0/552073917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680cf5b0 0x7fce6815d060 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fce680744e0 tx=0x7fce6001cac0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 -- 172.21.15.44:0/552073917 shutdown_connections 2024-09-17T05:44:05.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 --2- 172.21.15.44:0/552073917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680cf5b0 0x7fce6815d060 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 --2- 172.21.15.44:0/552073917 >> v2:172.21.15.86:3300/0 conn(0x7fce680d1d00 0x7fce680cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 -- 172.21.15.44:0/552073917 >> 172.21.15.44:0/552073917 conn(0x7fce680b4240 msgr2=0x7fce680b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 -- 172.21.15.44:0/552073917 shutdown_connections 2024-09-17T05:44:05.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.185+0000 7fce6d000640 1 -- 172.21.15.44:0/552073917 wait complete. 2024-09-17T05:44:05.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 Processor -- start 2024-09-17T05:44:05.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 -- start start 2024-09-17T05:44:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce680cf5b0 0x7fce6806df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce680d18f0 0x7fce6815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680d1d00 0x7fce6806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fce68169e80 con 0x7fce680d1d00 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce68169d00 con 0x7fce680cf5b0 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce6d000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fce6816a000 con 0x7fce680d18f0 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.189+0000 7fce66800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680d1d00 0x7fce6806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680d1d00 0x7fce6806f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50256/0 (socket says 172.21.15.44:50256) 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 -- 172.21.15.44:0/1328434433 learned_addr learned my addr 172.21.15.44:0/1328434433 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:05.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce5d400640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce680d18f0 0x7fce6815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 -- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce680d18f0 msgr2=0x7fce6815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce680d18f0 0x7fce6815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce65e00640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce680cf5b0 0x7fce6806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 -- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce680cf5b0 msgr2=0x7fce6806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce680cf5b0 0x7fce6806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 -- 172.21.15.44:0/1328434433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce681fcb40 con 0x7fce680d1d00 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce5d400640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce680d18f0 0x7fce6815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce65e00640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce680cf5b0 0x7fce6806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce66800640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680d1d00 0x7fce6806f8c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fce6001a6f0 tx=0x7fce60009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce5ea00640 1 -- 172.21.15.44:0/1328434433 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce600bc070 con 0x7fce680d1d00 2024-09-17T05:44:05.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce5ea00640 1 -- 172.21.15.44:0/1328434433 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce600042f0 con 0x7fce680d1d00 2024-09-17T05:44:05.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce5ea00640 1 -- 172.21.15.44:0/1328434433 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce600b2040 con 0x7fce680d1d00 2024-09-17T05:44:05.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce681fce20 con 0x7fce680d1d00 2024-09-17T05:44:05.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce681fd3e0 con 0x7fce680d1d00 2024-09-17T05:44:05.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce6815d060 con 0x7fce680d1d00 2024-09-17T05:44:05.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.193+0000 7fce5ea00640 1 -- 172.21.15.44:0/1328434433 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce600bf070 con 0x7fce680d1d00 2024-09-17T05:44:05.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.197+0000 7fce5ea00640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce44073200 0x7fce44075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.197+0000 7fce5ea00640 1 -- 172.21.15.44:0/1328434433 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fce6012e7c0 con 0x7fce680d1d00 2024-09-17T05:44:05.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.197+0000 7fce65e00640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce44073200 0x7fce44075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.197+0000 7fce65e00640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce44073200 0x7fce44075710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fce58000f70 tx=0x7fce58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.197+0000 7fce5ea00640 1 -- 172.21.15.44:0/1328434433 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fce600c6080 con 0x7fce680d1d00 2024-09-17T05:44:05.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.373+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce681ef1a0 con 0x7fce680d1d00 2024-09-17T05:44:05.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce5ea00640 1 -- 172.21.15.44:0/1328434433 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+17434 (secure 0 0 0) 0x7fce60016770 con 0x7fce680d1d00 2024-09-17T05:44:05.376 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:05.376 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":94,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:43:23.478878+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:41:59.546897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-17T05:42:00.752532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.15","mappings":[{"from":6,"to":4}]},{"pgid":"14.25","mappings":[{"from":7,"to":3}]},{"pgid":"14.31","mappings":[{"from":7,"to":0}]},{"pgid":"14.34","mappings":[{"from":7,"to":0}]},{"pgid":"14.37","mappings":[{"from":1,"to":0}]},{"pgid":"14.3e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6833/3231247769":"2024-09-18T05:43:23.478847+0000","172.21.15.44:6835/3305866275":"2024-09-18T05:42:11.653403+0000","172.21.15.44:6835/3231247769":"2024-09-18T05:43:23.478847+0000","172.21.15.44:6833/3305866275":"2024-09-18T05:42:11.653403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce44073200 msgr2=0x7fce44075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce44073200 0x7fce44075710 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fce58000f70 tx=0x7fce58009040 comp rx=0 tx=0).stop 2024-09-17T05:44:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680d1d00 msgr2=0x7fce6806f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680d1d00 0x7fce6806f8c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fce6001a6f0 tx=0x7fce60009310 comp rx=0 tx=0).stop 2024-09-17T05:44:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 shutdown_connections 2024-09-17T05:44:05.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce680d1d00 0x7fce6806f8c0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fce680d18f0 0x7fce6815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fce44073200 0x7fce44075710 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 --2- 172.21.15.44:0/1328434433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce680cf5b0 0x7fce6806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 >> 172.21.15.44:0/1328434433 conn(0x7fce680b4240 msgr2=0x7fce681532b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 shutdown_connections 2024-09-17T05:44:05.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.377+0000 7fce6d000640 1 -- 172.21.15.44:0/1328434433 wait complete. 2024-09-17T05:44:05.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:44:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 -- 172.21.15.44:0/2934513950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf815bd30 msgr2=0x7fedf815c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 --2- 172.21.15.44:0/2934513950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf815bd30 0x7fedf815c140 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fedf8072f70 tx=0x7fedf001cd80 comp rx=0 tx=0).stop 2024-09-17T05:44:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 -- 172.21.15.44:0/2934513950 shutdown_connections 2024-09-17T05:44:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 --2- 172.21.15.44:0/2934513950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf815bd30 0x7fedf815c140 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 --2- 172.21.15.44:0/2934513950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedf80ce340 0x7fedf80ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 --2- 172.21.15.44:0/2934513950 >> v2:172.21.15.86:3300/0 conn(0x7fedf80cff50 0x7fedf80cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 -- 172.21.15.44:0/2934513950 >> 172.21.15.44:0/2934513950 conn(0x7fedf8073690 msgr2=0x7fedf8073aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 -- 172.21.15.44:0/2934513950 shutdown_connections 2024-09-17T05:44:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.557+0000 7fedf7e00640 1 -- 172.21.15.44:0/2934513950 wait complete. 2024-09-17T05:44:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 Processor -- start 2024-09-17T05:44:05.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 -- start start 2024-09-17T05:44:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedf80ce340 0x7fedf814aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf80cff50 0x7fedf8145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedf815bd30 0x7fedf8149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fedf8070c30 con 0x7fedf80cff50 2024-09-17T05:44:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fedf8070ab0 con 0x7fedf80ce340 2024-09-17T05:44:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf7e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fedf8070db0 con 0x7fedf815bd30 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf80cff50 0x7fedf8145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf80cff50 0x7fedf8145870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50266/0 (socket says 172.21.15.44:50266) 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.561+0000 7fedf6000640 1 -- 172.21.15.44:0/1258177326 learned_addr learned my addr 172.21.15.44:0/1258177326 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6a00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedf80ce340 0x7fedf814aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf7400640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedf815bd30 0x7fedf8149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6000640 1 -- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedf815bd30 msgr2=0x7fedf8149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6000640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedf815bd30 0x7fedf8149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6000640 1 -- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedf80ce340 msgr2=0x7fedf814aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6000640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedf80ce340 0x7fedf814aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6000640 1 -- 172.21.15.44:0/1258177326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf81f88b0 con 0x7fedf80cff50 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6a00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedf80ce340 0x7fedf814aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf6000640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf80cff50 0x7fedf8145870 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fede400d720 tx=0x7fede400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedeea00640 1 -- 172.21.15.44:0/1258177326 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4017070 con 0x7fedf80cff50 2024-09-17T05:44:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedeea00640 1 -- 172.21.15.44:0/1258177326 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fede4009b10 con 0x7fedf80cff50 2024-09-17T05:44:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf814ec10 con 0x7fedf80cff50 2024-09-17T05:44:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedeea00640 1 -- 172.21.15.44:0/1258177326 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4010460 con 0x7fedf80cff50 2024-09-17T05:44:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf8149790 con 0x7fedf80cff50 2024-09-17T05:44:05.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf814f130 con 0x7fedf80cff50 2024-09-17T05:44:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedeea00640 1 -- 172.21.15.44:0/1258177326 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fede401a070 con 0x7fedf80cff50 2024-09-17T05:44:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.565+0000 7fedeea00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fedd8073230 0x7fedd8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.569+0000 7fedeea00640 1 -- 172.21.15.44:0/1258177326 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 6447+0+0 (secure 0 0 0) 0x7fede4094740 con 0x7fedf80cff50 2024-09-17T05:44:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.569+0000 7fedf6a00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fedd8073230 0x7fedd8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.569+0000 7fedf6a00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fedd8073230 0x7fedd8075740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fede8005d90 tx=0x7fede8005d20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.573+0000 7fedeea00640 1 -- 172.21.15.44:0/1258177326 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fedf814f130 con 0x7fedf80cff50 2024-09-17T05:44:05.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.777+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fedf80cca30 con 0x7fedf80cff50 2024-09-17T05:44:05.778 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:44:05.777+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:44:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.781+0000 7fedeea00640 1 -- 172.21.15.44:0/1258177326 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) ==== 161+0+0 (secure 0 0 0) 0x7fede405f3e0 con 0x7fedf80cff50 2024-09-17T05:44:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:44:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fedd8073230 msgr2=0x7fedd8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fedd8073230 0x7fedd8075740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fede8005d90 tx=0x7fede8005d20 comp rx=0 tx=0).stop 2024-09-17T05:44:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf80cff50 msgr2=0x7fedf8145870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf80cff50 0x7fedf8145870 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fede400d720 tx=0x7fede400dbe0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 shutdown_connections 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fedf815bd30 0x7fedf8149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fedf80cff50 0x7fedf8145870 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fedd8073230 0x7fedd8075740 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 --2- 172.21.15.44:0/1258177326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fedf80ce340 0x7fedf814aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 >> 172.21.15.44:0/1258177326 conn(0x7fedf8073690 msgr2=0x7fedf8150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 shutdown_connections 2024-09-17T05:44:05.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.785+0000 7fedf7e00640 1 -- 172.21.15.44:0/1258177326 wait complete. 2024-09-17T05:44:05.791 INFO:tasks.ceph.mds.a.smithi044.stderr: -2266> 2024-09-17T05:43:30.490+0000 7faa59600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:44:05.792 INFO:tasks.ceph.mds.a.smithi044.stderr: -1923> 2024-09-17T05:43:30.638+0000 7faa54600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | request=0 lock=0 dirtyparent=1 authpin=1 scrubqueue=0 0x561c7e674100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-17T05:44:05.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:44:05.918 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:44:05.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 -- 172.21.15.44:0/650711431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 msgr2=0x7f944415ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 --2- 172.21.15.44:0/650711431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f944415ce30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9444072370 tx=0x7f943c01ccf0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 -- 172.21.15.44:0/650711431 shutdown_connections 2024-09-17T05:44:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 --2- 172.21.15.44:0/650711431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f944415ce30 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 --2- 172.21.15.44:0/650711431 >> v2:172.21.15.86:3300/0 conn(0x7f9444160060 0x7f9444160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 --2- 172.21.15.44:0/650711431 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94440c7370 0x7f94440c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 -- 172.21.15.44:0/650711431 >> 172.21.15.44:0/650711431 conn(0x7f94440ceaa0 msgr2=0x7f94440ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:05.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 -- 172.21.15.44:0/650711431 shutdown_connections 2024-09-17T05:44:05.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 -- 172.21.15.44:0/650711431 wait complete. 2024-09-17T05:44:05.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 Processor -- start 2024-09-17T05:44:05.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.973+0000 7f944a600640 1 -- start start 2024-09-17T05:44:05.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94440c7370 0x7f944413d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f94440713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9444160060 0x7f9444142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b2cf0 con 0x7f944415ca20 2024-09-17T05:44:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94440b2b70 con 0x7f9444160060 2024-09-17T05:44:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f94440b2e70 con 0x7f94440c7370 2024-09-17T05:44:05.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f94440713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f94440713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50302/0 (socket says 172.21.15.44:50302) 2024-09-17T05:44:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 -- 172.21.15.44:0/4076507277 learned_addr learned my addr 172.21.15.44:0/4076507277 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9449200640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94440c7370 0x7f944413d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9449c00640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9444160060 0x7f9444142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 -- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94440c7370 msgr2=0x7f944413d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94440c7370 0x7f944413d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 -- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9444160060 msgr2=0x7f9444142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9444160060 0x7f9444142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 -- 172.21.15.44:0/4076507277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94440b6830 con 0x7f944415ca20 2024-09-17T05:44:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9443e00640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f94440713c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f943000e9c0 tx=0x7f943000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9440c00640 1 -- 172.21.15.44:0/4076507277 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943000cd80 con 0x7f944415ca20 2024-09-17T05:44:05.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9440c00640 1 -- 172.21.15.44:0/4076507277 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9430010520 con 0x7f944415ca20 2024-09-17T05:44:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94441fbfe0 con 0x7f944415ca20 2024-09-17T05:44:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f9440c00640 1 -- 172.21.15.44:0/4076507277 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430010970 con 0x7f944415ca20 2024-09-17T05:44:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94441fc5a0 con 0x7f944415ca20 2024-09-17T05:44:05.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.977+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444071db0 con 0x7f944415ca20 2024-09-17T05:44:05.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.981+0000 7f9440c00640 1 -- 172.21.15.44:0/4076507277 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f943001f020 con 0x7f944415ca20 2024-09-17T05:44:05.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.981+0000 7f9440c00640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073200 0x7f9424075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:05.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.981+0000 7f9440c00640 1 -- 172.21.15.44:0/4076507277 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6533+0+0 (secure 0 0 0) 0x7f9430094d00 con 0x7f944415ca20 2024-09-17T05:44:05.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.981+0000 7f9449200640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073200 0x7f9424075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:05.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.981+0000 7f9449200640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073200 0x7f9424075710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9438009ac0 tx=0x7f94380091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:05.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:05.985+0000 7f9440c00640 1 -- 172.21.15.44:0/4076507277 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f943005f2f0 con 0x7f944415ca20 2024-09-17T05:44:06.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.209+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f944415ce30 con 0x7f944415ca20 2024-09-17T05:44:06.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f9440c00640 1 -- 172.21.15.44:0/4076507277 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) ==== 104+0+0 (secure 0 0 0) 0x7f9430063d20 con 0x7f944415ca20 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073200 msgr2=0x7f9424075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073200 0x7f9424075710 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9438009ac0 tx=0x7f94380091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 msgr2=0x7f94440713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f94440713c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f943000e9c0 tx=0x7f943000ee80 comp rx=0 tx=0).stop 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 shutdown_connections 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9424073200 0x7f9424075710 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9444160060 0x7f9444142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f944415ca20 0x7f94440713c0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 --2- 172.21.15.44:0/4076507277 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f94440c7370 0x7f944413d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:06.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 >> 172.21.15.44:0/4076507277 conn(0x7f94440ceaa0 msgr2=0x7f944415c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:06.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 shutdown_connections 2024-09-17T05:44:06.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:06.837+0000 7f944a600640 1 -- 172.21.15.44:0/4076507277 wait complete. 2024-09-17T05:44:06.863 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:44:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 -- 172.21.15.44:0/4115737295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00746f0 msgr2=0x7fb6c00afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 --2- 172.21.15.44:0/4115737295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00746f0 0x7fb6c00afeb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb6c015d590 tx=0x7fb6b001c850 comp rx=0 tx=0).stop 2024-09-17T05:44:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 -- 172.21.15.44:0/4115737295 shutdown_connections 2024-09-17T05:44:07.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 --2- 172.21.15.44:0/4115737295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6c00741e0 0x7fb6c006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 --2- 172.21.15.44:0/4115737295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00746f0 0x7fb6c00afeb0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 -- 172.21.15.44:0/4115737295 >> 172.21.15.44:0/4115737295 conn(0x7fb6c00736c0 msgr2=0x7fb6c0073ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 -- 172.21.15.44:0/4115737295 shutdown_connections 2024-09-17T05:44:07.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.029+0000 7fb6c6000640 1 -- 172.21.15.44:0/4115737295 wait complete. 2024-09-17T05:44:07.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 Processor -- start 2024-09-17T05:44:07.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 -- start start 2024-09-17T05:44:07.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6c006e390 0x7fb6c014e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00741e0 0x7fb6c015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6c00746f0 0x7fb6c015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0169c20 con 0x7fb6c00741e0 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0169aa0 con 0x7fb6c00746f0 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c0169da0 con 0x7fb6c006e390 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00741e0 0x7fb6c015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00741e0 0x7fb6c015f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50318/0 (socket says 172.21.15.44:50318) 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 -- 172.21.15.44:0/1222674685 learned_addr learned my addr 172.21.15.44:0/1222674685 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6bf400640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6c006e390 0x7fb6c014e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6bfe00640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6c00746f0 0x7fb6c015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 -- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6c006e390 msgr2=0x7fb6c014e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6c006e390 0x7fb6c014e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 -- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6c00746f0 msgr2=0x7fb6c015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6c00746f0 0x7fb6c015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 -- 172.21.15.44:0/1222674685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c01fc030 con 0x7fb6c00741e0 2024-09-17T05:44:07.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6bf400640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6c006e390 0x7fb6c014e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b6a00640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00741e0 0x7fb6c015f340 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800e7f0 tx=0x7fb6a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b7e00640 1 -- 172.21.15.44:0/1222674685 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a800ccc0 con 0x7fb6c00741e0 2024-09-17T05:44:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b7e00640 1 -- 172.21.15.44:0/1222674685 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6a800ce80 con 0x7fb6c00741e0 2024-09-17T05:44:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c01fc310 con 0x7fb6c00741e0 2024-09-17T05:44:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6b7e00640 1 -- 172.21.15.44:0/1222674685 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8005280 con 0x7fb6c00741e0 2024-09-17T05:44:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.033+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c01fc8d0 con 0x7fb6c00741e0 2024-09-17T05:44:07.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.037+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c006de50 con 0x7fb6c00741e0 2024-09-17T05:44:07.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.037+0000 7fb6b7e00640 1 -- 172.21.15.44:0/1222674685 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6a8005420 con 0x7fb6c00741e0 2024-09-17T05:44:07.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.037+0000 7fb6b7e00640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb69c073200 0x7fb69c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:07.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.037+0000 7fb6b7e00640 1 -- 172.21.15.44:0/1222674685 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 6533+0+0 (secure 0 0 0) 0x7fb6a8094fe0 con 0x7fb6c00741e0 2024-09-17T05:44:07.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.037+0000 7fb6bf400640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb69c073200 0x7fb69c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:07.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.037+0000 7fb6bf400640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb69c073200 0x7fb69c075710 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00af000 tx=0x7fb6b001b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:07.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.041+0000 7fb6b7e00640 1 -- 172.21.15.44:0/1222674685 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb6a805fc20 con 0x7fb6c00741e0 2024-09-17T05:44:07.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.217+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6c015fb90 con 0x7fb6c00741e0 2024-09-17T05:44:07.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.837+0000 7fb6b7e00640 1 -- 172.21.15.44:0/1222674685 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7fb6a805f520 con 0x7fb6c00741e0 2024-09-17T05:44:07.838 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:44:07.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb69c073200 msgr2=0x7fb69c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb69c073200 0x7fb69c075710 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00af000 tx=0x7fb6b001b090 comp rx=0 tx=0).stop 2024-09-17T05:44:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00741e0 msgr2=0x7fb6c015f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00741e0 0x7fb6c015f340 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800e7f0 tx=0x7fb6a800ecb0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 shutdown_connections 2024-09-17T05:44:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb69c073200 0x7fb69c075710 secure :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb6b00af000 tx=0x7fb6b001b090 comp rx=0 tx=0).stop 2024-09-17T05:44:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb6c00746f0 0x7fb6c015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6c00741e0 0x7fb6c015f340 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 --2- 172.21.15.44:0/1222674685 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb6c006e390 0x7fb6c014e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 >> 172.21.15.44:0/1222674685 conn(0x7fb6c00736c0 msgr2=0x7fb6c00b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 shutdown_connections 2024-09-17T05:44:07.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:07.841+0000 7fb6c6000640 1 -- 172.21.15.44:0/1222674685 wait complete. 2024-09-17T05:44:07.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:44:08.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 -- 172.21.15.44:0/1218517861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 msgr2=0x7ff88406f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 --2- 172.21.15.44:0/1218517861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 0x7ff88406f800 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009c80 tx=0x7ff87c01f5a0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 -- 172.21.15.44:0/1218517861 shutdown_connections 2024-09-17T05:44:08.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 --2- 172.21.15.44:0/1218517861 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 0x7ff88406f800 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 --2- 172.21.15.44:0/1218517861 >> v2:172.21.15.86:3300/0 conn(0x7ff88406df80 0x7ff88406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 -- 172.21.15.44:0/1218517861 >> 172.21.15.44:0/1218517861 conn(0x7ff8840b35f0 msgr2=0x7ff8840b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:08.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 -- 172.21.15.44:0/1218517861 shutdown_connections 2024-09-17T05:44:08.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 -- 172.21.15.44:0/1218517861 wait complete. 2024-09-17T05:44:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 Processor -- start 2024-09-17T05:44:08.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.033+0000 7ff88c000640 1 -- start start 2024-09-17T05:44:08.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88406df80 0x7ff88415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 0x7ff88414be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff884155b10 0x7ff8841f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840ce4c0 con 0x7ff884155b10 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840ce340 con 0x7ff88406df80 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff8840ce640 con 0x7ff88406f3f0 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff884155b10 0x7ff8841f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff884155b10 0x7ff8841f58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50332/0 (socket says 172.21.15.44:50332) 2024-09-17T05:44:08.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 -- 172.21.15.44:0/393593172 learned_addr learned my addr 172.21.15.44:0/393593172 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:08.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff888c00640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 0x7ff88414be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff889600640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88406df80 0x7ff88415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 -- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 msgr2=0x7ff88414be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 0x7ff88414be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 -- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88406df80 msgr2=0x7ff88415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88406df80 0x7ff88415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 -- 172.21.15.44:0/393593172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8841f6630 con 0x7ff884155b10 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88a000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff884155b10 0x7ff8841f58c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0262f0 tx=0x7ff87c005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff881600640 1 -- 172.21.15.44:0/393593172 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0af8a0 con 0x7ff884155b10 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff881600640 1 -- 172.21.15.44:0/393593172 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff87c0afb30 con 0x7ff884155b10 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff881600640 1 -- 172.21.15.44:0/393593172 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c004040 con 0x7ff884155b10 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88415a690 con 0x7ff884155b10 2024-09-17T05:44:08.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88415ac50 con 0x7ff884155b10 2024-09-17T05:44:08.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.037+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88406e390 con 0x7ff884155b10 2024-09-17T05:44:08.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.041+0000 7ff881600640 1 -- 172.21.15.44:0/393593172 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff87c0041e0 con 0x7ff884155b10 2024-09-17T05:44:08.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.041+0000 7ff881600640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff864073200 0x7ff864075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:08.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.041+0000 7ff881600640 1 -- 172.21.15.44:0/393593172 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6066+0+0 (secure 0 0 0) 0x7ff87c133200 con 0x7ff884155b10 2024-09-17T05:44:08.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.041+0000 7ff889600640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff864073200 0x7ff864075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:08.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.041+0000 7ff889600640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff864073200 0x7ff864075710 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff878007fd0 tx=0x7ff878009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:08.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.045+0000 7ff881600640 1 -- 172.21.15.44:0/393593172 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff87c0ac050 con 0x7ff884155b10 2024-09-17T05:44:08.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.229+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff8841f63c0 con 0x7ff884155b10 2024-09-17T05:44:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.853+0000 7ff881600640 1 -- 172.21.15.44:0/393593172 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7ff87c019100 con 0x7ff884155b10 2024-09-17T05:44:08.853 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:44:08.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff864073200 msgr2=0x7ff864075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff864073200 0x7ff864075710 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff878007fd0 tx=0x7ff878009040 comp rx=0 tx=0).stop 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff884155b10 msgr2=0x7ff8841f58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff884155b10 0x7ff8841f58c0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0262f0 tx=0x7ff87c005a60 comp rx=0 tx=0).stop 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 shutdown_connections 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff884155b10 0x7ff8841f58c0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff88406f3f0 0x7ff88414be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff864073200 0x7ff864075710 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 --2- 172.21.15.44:0/393593172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff88406df80 0x7ff88415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:08.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.857+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 >> 172.21.15.44:0/393593172 conn(0x7ff8840b35f0 msgr2=0x7ff884152050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:08.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.861+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 shutdown_connections 2024-09-17T05:44:08.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:08.861+0000 7ff88c000640 1 -- 172.21.15.44:0/393593172 wait complete. 2024-09-17T05:44:08.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:44:09.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 -- 172.21.15.44:0/525338576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c06e560 msgr2=0x7fd62c0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 --2- 172.21.15.44:0/525338576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c06e560 0x7fd62c0700d0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd62c09e100 tx=0x7fd61801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 -- 172.21.15.44:0/525338576 shutdown_connections 2024-09-17T05:44:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 --2- 172.21.15.44:0/525338576 >> v2:172.21.15.86:3300/0 conn(0x7fd62c070610 0x7fd62c070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 --2- 172.21.15.44:0/525338576 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c06e560 0x7fd62c0700d0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 -- 172.21.15.44:0/525338576 >> 172.21.15.44:0/525338576 conn(0x7fd62c0ccaa0 msgr2=0x7fd62c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 -- 172.21.15.44:0/525338576 shutdown_connections 2024-09-17T05:44:09.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 -- 172.21.15.44:0/525338576 wait complete. 2024-09-17T05:44:09.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 Processor -- start 2024-09-17T05:44:09.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.049+0000 7fd633a00640 1 -- start start 2024-09-17T05:44:09.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd62c070610 0x7fd62c0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c0b5880 0x7fd62c09cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd62c09d660 0x7fd62c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c169e30 con 0x7fd62c0b5880 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c169cb0 con 0x7fd62c070610 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c169fb0 con 0x7fd62c09d660 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c0b5880 0x7fd62c09cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c0b5880 0x7fd62c09cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57948/0 (socket says 172.21.15.44:57948) 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 -- 172.21.15.44:0/2484833491 learned_addr learned my addr 172.21.15.44:0/2484833491 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd631a00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd62c09d660 0x7fd62c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd631000640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd62c070610 0x7fd62c0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 -- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd62c09d660 msgr2=0x7fd62c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd62c09d660 0x7fd62c0aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 -- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd62c070610 msgr2=0x7fd62c0c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd62c070610 0x7fd62c0c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 -- 172.21.15.44:0/2484833491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c09d000 con 0x7fd62c0b5880 2024-09-17T05:44:09.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd62be00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c0b5880 0x7fd62c09cac0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b0040 tx=0x7fd618005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:09.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd628c00640 1 -- 172.21.15.44:0/2484833491 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6180b2040 con 0x7fd62c0b5880 2024-09-17T05:44:09.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd628c00640 1 -- 172.21.15.44:0/2484833491 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd618004330 con 0x7fd62c0b5880 2024-09-17T05:44:09.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd628c00640 1 -- 172.21.15.44:0/2484833491 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618005280 con 0x7fd62c0b5880 2024-09-17T05:44:09.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c0c80e0 con 0x7fd62c0b5880 2024-09-17T05:44:09.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c09c2c0 con 0x7fd62c0b5880 2024-09-17T05:44:09.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.053+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c0700d0 con 0x7fd62c0b5880 2024-09-17T05:44:09.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.057+0000 7fd628c00640 1 -- 172.21.15.44:0/2484833491 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd618005420 con 0x7fd62c0b5880 2024-09-17T05:44:09.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.057+0000 7fd628c00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd60c073200 0x7fd60c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.057+0000 7fd628c00640 1 -- 172.21.15.44:0/2484833491 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7fd61812e140 con 0x7fd62c0b5880 2024-09-17T05:44:09.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.057+0000 7fd631000640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd60c073200 0x7fd60c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.057+0000 7fd631000640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd60c073200 0x7fd60c075710 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6200098e0 tx=0x7fd620009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:09.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.061+0000 7fd628c00640 1 -- 172.21.15.44:0/2484833491 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd6180bd060 con 0x7fd62c0b5880 2024-09-17T05:44:09.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.245+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fd62c073d40 con 0x7fd62c0b5880 2024-09-17T05:44:09.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd628c00640 1 -- 172.21.15.44:0/2484833491 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7fd6180164b0 con 0x7fd62c0b5880 2024-09-17T05:44:09.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd60c073200 msgr2=0x7fd60c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd60c073200 0x7fd60c075710 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6200098e0 tx=0x7fd620009060 comp rx=0 tx=0).stop 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c0b5880 msgr2=0x7fd62c09cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c0b5880 0x7fd62c09cac0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd6180b0040 tx=0x7fd618005e70 comp rx=0 tx=0).stop 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 shutdown_connections 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd62c09d660 0x7fd62c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd62c0b5880 0x7fd62c09cac0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd60c073200 0x7fd60c075710 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 --2- 172.21.15.44:0/2484833491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd62c070610 0x7fd62c0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 >> 172.21.15.44:0/2484833491 conn(0x7fd62c0ccaa0 msgr2=0x7fd62c0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 shutdown_connections 2024-09-17T05:44:09.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.249+0000 7fd633a00640 1 -- 172.21.15.44:0/2484833491 wait complete. 2024-09-17T05:44:09.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-09-17T05:44:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 -- 172.21.15.44:0/427728768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc09406de50 msgr2=0x7fc09406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 --2- 172.21.15.44:0/427728768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc09406de50 0x7fc09406e260 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc084009840 tx=0x7fc08401c790 comp rx=0 tx=0).stop 2024-09-17T05:44:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 -- 172.21.15.44:0/427728768 shutdown_connections 2024-09-17T05:44:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 --2- 172.21.15.44:0/427728768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc09406de50 0x7fc09406e260 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 -- 172.21.15.44:0/427728768 >> 172.21.15.44:0/427728768 conn(0x7fc0940ccaa0 msgr2=0x7fc0940cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 -- 172.21.15.44:0/427728768 shutdown_connections 2024-09-17T05:44:09.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 -- 172.21.15.44:0/427728768 wait complete. 2024-09-17T05:44:09.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 Processor -- start 2024-09-17T05:44:09.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.433+0000 7fc09c800640 1 -- start start 2024-09-17T05:44:09.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09406de50 0x7fc09415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc094072e50 0x7fc094159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0940cb470 0x7fc09415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc094169ee0 con 0x7fc0940cb470 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc094169d60 con 0x7fc094072e50 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc09416a060 con 0x7fc09406de50 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0940cb470 0x7fc09415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0940cb470 0x7fc09415cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57962/0 (socket says 172.21.15.44:57962) 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 -- 172.21.15.44:0/526275399 learned_addr learned my addr 172.21.15.44:0/526275399 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc099400640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc094072e50 0x7fc094159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc099e00640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09406de50 0x7fc09415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 -- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09406de50 msgr2=0x7fc09415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09406de50 0x7fc09415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 -- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc094072e50 msgr2=0x7fc094159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc094072e50 0x7fc094159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 -- 172.21.15.44:0/526275399 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09415d7c0 con 0x7fc0940cb470 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09a800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0940cb470 0x7fc09415cdc0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c730 tx=0x7fc09000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc08e000640 1 -- 172.21.15.44:0/526275399 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc090003b80 con 0x7fc0940cb470 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc08e000640 1 -- 172.21.15.44:0/526275399 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc090003d40 con 0x7fc0940cb470 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc08e000640 1 -- 172.21.15.44:0/526275399 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0900052d0 con 0x7fc0940cb470 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09415daa0 con 0x7fc0940cb470 2024-09-17T05:44:09.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09415f5c0 con 0x7fc0940cb470 2024-09-17T05:44:09.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.437+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09415dce0 con 0x7fc0940cb470 2024-09-17T05:44:09.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.441+0000 7fc08e000640 1 -- 172.21.15.44:0/526275399 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc090005680 con 0x7fc0940cb470 2024-09-17T05:44:09.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.441+0000 7fc08e000640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc078073200 0x7fc078075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:09.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.441+0000 7fc08e000640 1 -- 172.21.15.44:0/526275399 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7fc0900941f0 con 0x7fc0940cb470 2024-09-17T05:44:09.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.441+0000 7fc099e00640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc078073200 0x7fc078075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:09.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.441+0000 7fc099e00640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc078073200 0x7fc078075710 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc088000f70 tx=0x7fc088009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:09.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.445+0000 7fc08e000640 1 -- 172.21.15.44:0/526275399 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc09415dce0 con 0x7fc0940cb470 2024-09-17T05:44:09.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.681+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7fc09406e260 con 0x7fc0940cb470 2024-09-17T05:44:09.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc08e000640 1 -- 172.21.15.44:0/526275399 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v374) ==== 167+0+0 (secure 0 0 0) 0x7fc09406e7a0 con 0x7fc0940cb470 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc078073200 msgr2=0x7fc078075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc078073200 0x7fc078075710 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc088000f70 tx=0x7fc088009040 comp rx=0 tx=0).stop 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0940cb470 msgr2=0x7fc09415cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0940cb470 0x7fc09415cdc0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fc09000c730 tx=0x7fc09000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 shutdown_connections 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0940cb470 0x7fc09415cdc0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc078073200 0x7fc078075710 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc094072e50 0x7fc094159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 --2- 172.21.15.44:0/526275399 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc09406de50 0x7fc09415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:09.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 >> 172.21.15.44:0/526275399 conn(0x7fc0940ccaa0 msgr2=0x7fc0940b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:09.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 shutdown_connections 2024-09-17T05:44:09.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:09.857+0000 7fc09c800640 1 -- 172.21.15.44:0/526275399 wait complete. 2024-09-17T05:44:09.879 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-09-17T05:44:09.879 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-17T05:44:09.880 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:10.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.037+0000 7f9346a00640 1 -- 172.21.15.44:0/4050940735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 msgr2=0x7f9328004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.037+0000 7f9346a00640 1 --2- 172.21.15.44:0/4050940735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 0x7f9328004810 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f93400b5b30 tx=0x7f932c01cc50 comp rx=0 tx=0).stop 2024-09-17T05:44:10.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.037+0000 7f9346000640 1 -- 172.21.15.44:0/4050940735 reap_dead start 2024-09-17T05:44:10.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 -- 172.21.15.44:0/4050940735 shutdown_connections 2024-09-17T05:44:10.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 -- 172.21.15.44:0/4050940735 >> 172.21.15.44:0/4050940735 conn(0x7f9340073ce0 msgr2=0x7f93400740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:10.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 -- 172.21.15.44:0/4050940735 shutdown_connections 2024-09-17T05:44:10.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 -- 172.21.15.44:0/4050940735 wait complete. 2024-09-17T05:44:10.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 Processor -- start 2024-09-17T05:44:10.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 -- start start 2024-09-17T05:44:10.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 0x7f9340151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9340141950 0x7f934014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9340150fc0 0x7f93401513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.041+0000 7f9346a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f934006d1d0 con 0x7f9328003fe0 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9346a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f934006d050 con 0x7f9340141950 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9346a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f934006d350 con 0x7f9340150fc0 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 0x7f9340151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 0x7f9340151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57978/0 (socket says 172.21.15.44:57978) 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 -- 172.21.15.44:0/676164701 learned_addr learned my addr 172.21.15.44:0/676164701 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9346000640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9340150fc0 0x7f93401513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9344c00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9340141950 0x7f934014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 -- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9340150fc0 msgr2=0x7f93401513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9340150fc0 0x7f93401513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 -- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9340141950 msgr2=0x7f934014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9340141950 0x7f934014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 -- 172.21.15.44:0/676164701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9340151910 con 0x7f9328003fe0 2024-09-17T05:44:10.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9344c00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9340141950 0x7f934014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9345600640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 0x7f9340151b60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9334011ae0 tx=0x7f9334009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f933d600640 1 -- 172.21.15.44:0/676164701 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933401e070 con 0x7f9328003fe0 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f933d600640 1 -- 172.21.15.44:0/676164701 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f933400fd00 con 0x7f9328003fe0 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f933d600640 1 -- 172.21.15.44:0/676164701 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334019670 con 0x7f9328003fe0 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934014fd90 con 0x7f9328003fe0 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9340150350 con 0x7f9328003fe0 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93400cea80 con 0x7f9328003fe0 2024-09-17T05:44:10.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.045+0000 7f933d600640 1 -- 172.21.15.44:0/676164701 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9334021070 con 0x7f9328003fe0 2024-09-17T05:44:10.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.049+0000 7f933d600640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9320073200 0x7f9320075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.049+0000 7f933d600640 1 -- 172.21.15.44:0/676164701 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f9334094ac0 con 0x7f9328003fe0 2024-09-17T05:44:10.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.049+0000 7f9344c00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9320073200 0x7f9320075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.049+0000 7f9344c00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9320073200 0x7f9320075710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f932c0ab000 tx=0x7f932c019a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:10.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.053+0000 7f933d600640 1 -- 172.21.15.44:0/676164701 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9340151910 con 0x7f9328003fe0 2024-09-17T05:44:10.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.225+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9340071f00 con 0x7f9328003fe0 2024-09-17T05:44:10.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f933d600640 1 -- 172.21.15.44:0/676164701 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+13518 (secure 0 0 0) 0x7f933405f540 con 0x7f9328003fe0 2024-09-17T05:44:10.228 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:10.228 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":97,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:44:08.851086+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/1038379221":"2024-09-18T05:44:05.781912+0000","172.21.15.44:6833/1038379221":"2024-09-18T05:44:05.781912+0000","172.21.15.44:6833/3231247769":"2024-09-18T05:43:23.478847+0000","172.21.15.44:6835/3305866275":"2024-09-18T05:42:11.653403+0000","172.21.15.44:6835/3231247769":"2024-09-18T05:43:23.478847+0000","172.21.15.44:6833/3305866275":"2024-09-18T05:42:11.653403+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9320073200 msgr2=0x7f9320075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9320073200 0x7f9320075710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f932c0ab000 tx=0x7f932c019a90 comp rx=0 tx=0).stop 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 msgr2=0x7f9340151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 0x7f9340151b60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9334011ae0 tx=0x7f9334009f60 comp rx=0 tx=0).stop 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 shutdown_connections 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9340150fc0 0x7f93401513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9320073200 0x7f9320075710 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9340141950 0x7f934014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 --2- 172.21.15.44:0/676164701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9328003fe0 0x7f9340151b60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 >> 172.21.15.44:0/676164701 conn(0x7f9340073ce0 msgr2=0x7f9340159690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 shutdown_connections 2024-09-17T05:44:10.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.229+0000 7f9346a00640 1 -- 172.21.15.44:0/676164701 wait complete. 2024-09-17T05:44:10.250 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:36:06.284181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:44:10.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:44:10.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 -- 172.21.15.44:0/865640588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c15b5f0 msgr2=0x7f372c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 --2- 172.21.15.44:0/865640588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c15b5f0 0x7f372c15ba00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f372c0ce8d0 tx=0x7f372401c880 comp rx=0 tx=0).stop 2024-09-17T05:44:10.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 -- 172.21.15.44:0/865640588 shutdown_connections 2024-09-17T05:44:10.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 --2- 172.21.15.44:0/865640588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c15b5f0 0x7f372c15ba00 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 --2- 172.21.15.44:0/865640588 >> v2:172.21.15.86:3300/0 conn(0x7f372c06f090 0x7f372c06f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 -- 172.21.15.44:0/865640588 >> 172.21.15.44:0/865640588 conn(0x7f372c0cda70 msgr2=0x7f372c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:10.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 -- 172.21.15.44:0/865640588 shutdown_connections 2024-09-17T05:44:10.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.413+0000 7f3731600640 1 -- 172.21.15.44:0/865640588 wait complete. 2024-09-17T05:44:10.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 Processor -- start 2024-09-17T05:44:10.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 -- start start 2024-09-17T05:44:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c06f090 0x7f372c14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f372c0711c0 0x7f372c1f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f372c15b5f0 0x7f372c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f372c168a70 con 0x7f372c06f090 2024-09-17T05:44:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f372c1688f0 con 0x7f372c15b5f0 2024-09-17T05:44:10.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f372c168bf0 con 0x7f372c0711c0 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c06f090 0x7f372c14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c06f090 0x7f372c14fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57992/0 (socket says 172.21.15.44:57992) 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 -- 172.21.15.44:0/3533110310 learned_addr learned my addr 172.21.15.44:0/3533110310 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3730c00640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f372c15b5f0 0x7f372c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3723400640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f372c0711c0 0x7f372c1f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 -- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f372c0711c0 msgr2=0x7f372c1f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f372c0711c0 0x7f372c1f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 -- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f372c15b5f0 msgr2=0x7f372c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f372c15b5f0 0x7f372c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 -- 172.21.15.44:0/3533110310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c153110 con 0x7f372c06f090 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f372be00640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c06f090 0x7f372c14fd80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f371c00ba50 tx=0x7f371c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3728c00640 1 -- 172.21.15.44:0/3533110310 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c019070 con 0x7f372c06f090 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3728c00640 1 -- 172.21.15.44:0/3533110310 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f371c00cd10 con 0x7f372c06f090 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c0b63a0 con 0x7f372c06f090 2024-09-17T05:44:10.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3728c00640 1 -- 172.21.15.44:0/3533110310 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0146a0 con 0x7f372c06f090 2024-09-17T05:44:10.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.417+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c0b6960 con 0x7f372c06f090 2024-09-17T05:44:10.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.421+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c06f4a0 con 0x7f372c06f090 2024-09-17T05:44:10.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.421+0000 7f3728c00640 1 -- 172.21.15.44:0/3533110310 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f371c01c070 con 0x7f372c06f090 2024-09-17T05:44:10.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.421+0000 7f3728c00640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3708073200 0x7f3708075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.421+0000 7f3728c00640 1 -- 172.21.15.44:0/3533110310 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f371c093ed0 con 0x7f372c06f090 2024-09-17T05:44:10.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.421+0000 7f3723400640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3708073200 0x7f3708075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.421+0000 7f3723400640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3708073200 0x7f3708075710 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f37140058d0 tx=0x7f3714005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:10.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.425+0000 7f3728c00640 1 -- 172.21.15.44:0/3533110310 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f371c05e8c0 con 0x7f372c06f090 2024-09-17T05:44:10.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f372c1502c0 con 0x7f372c06f090 2024-09-17T05:44:10.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3728c00640 1 -- 172.21.15.44:0/3533110310 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) ==== 93+0+10 (secure 0 0 0) 0x7f371c0632f0 con 0x7f372c06f090 2024-09-17T05:44:10.600 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3708073200 msgr2=0x7f3708075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3708073200 0x7f3708075710 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f37140058d0 tx=0x7f3714005860 comp rx=0 tx=0).stop 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c06f090 msgr2=0x7f372c14fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c06f090 0x7f372c14fd80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f371c00ba50 tx=0x7f371c00bf10 comp rx=0 tx=0).stop 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 shutdown_connections 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3708073200 0x7f3708075710 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f372c15b5f0 0x7f372c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f372c0711c0 0x7f372c1f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 --2- 172.21.15.44:0/3533110310 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f372c06f090 0x7f372c14fd80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 >> 172.21.15.44:0/3533110310 conn(0x7f372c0cda70 msgr2=0x7f372c152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 shutdown_connections 2024-09-17T05:44:10.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.601+0000 7f3731600640 1 -- 172.21.15.44:0/3533110310 wait complete. 2024-09-17T05:44:10.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 -- 172.21.15.44:0/707816079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 msgr2=0x7f056c0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 --2- 172.21.15.44:0/707816079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 0x7f056c0cb880 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0564009c80 tx=0x7f056401cd30 comp rx=0 tx=0).stop 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 -- 172.21.15.44:0/707816079 shutdown_connections 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 --2- 172.21.15.44:0/707816079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 0x7f056c0cb880 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 --2- 172.21.15.44:0/707816079 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f056c072e50 0x7f056c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 -- 172.21.15.44:0/707816079 >> 172.21.15.44:0/707816079 conn(0x7f056c0ccaa0 msgr2=0x7f056c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 -- 172.21.15.44:0/707816079 shutdown_connections 2024-09-17T05:44:10.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 -- 172.21.15.44:0/707816079 wait complete. 2024-09-17T05:44:10.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 Processor -- start 2024-09-17T05:44:10.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.781+0000 7f0573200640 1 -- start start 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f056c06de50 0x7f056c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f056c072e50 0x7f056c0a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 0x7f056c0a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f056c168f20 con 0x7f056c06de50 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f056c168da0 con 0x7f056c0cb470 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f056c1690a0 con 0x7f056c072e50 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f056c06de50 0x7f056c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f056c06de50 0x7f056c153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57998/0 (socket says 172.21.15.44:57998) 2024-09-17T05:44:10.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 -- 172.21.15.44:0/1394991389 learned_addr learned my addr 172.21.15.44:0/1394991389 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:10.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0571200640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 0x7f056c0a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0563e00640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f056c072e50 0x7f056c0a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 -- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f056c072e50 msgr2=0x7f056c0a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f056c072e50 0x7f056c0a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 -- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 msgr2=0x7f056c0a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 0x7f056c0a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 -- 172.21.15.44:0/1394991389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c06f420 con 0x7f056c06de50 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f056be00640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f056c06de50 0x7f056c153590 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e7f0 tx=0x7f055c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0568c00640 1 -- 172.21.15.44:0/1394991389 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c00ccc0 con 0x7f056c06de50 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0568c00640 1 -- 172.21.15.44:0/1394991389 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f055c00ce80 con 0x7f056c06de50 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0568c00640 1 -- 172.21.15.44:0/1394991389 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c005280 con 0x7f056c06de50 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056c0c98c0 con 0x7f056c06de50 2024-09-17T05:44:10.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056c0c9e80 con 0x7f056c06de50 2024-09-17T05:44:10.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.785+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056c0cb880 con 0x7f056c06de50 2024-09-17T05:44:10.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.789+0000 7f0568c00640 1 -- 172.21.15.44:0/1394991389 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f055c005420 con 0x7f056c06de50 2024-09-17T05:44:10.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.789+0000 7f0568c00640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0548073230 0x7f0548075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:10.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.789+0000 7f0568c00640 1 -- 172.21.15.44:0/1394991389 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f055c094d80 con 0x7f056c06de50 2024-09-17T05:44:10.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.789+0000 7f0563e00640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0548073230 0x7f0548075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:10.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.789+0000 7f0563e00640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0548073230 0x7f0548075740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f056c0b5ee0 tx=0x7f0554009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:10.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:10.793+0000 7f0568c00640 1 -- 172.21.15.44:0/1394991389 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f055c05f880 con 0x7f056c06de50 2024-09-17T05:44:11.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.033+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f056c0b5fa0 con 0x7f056c06de50 2024-09-17T05:44:11.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.865+0000 7f0568c00640 1 -- 172.21.15.44:0/1394991389 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v376) ==== 149+0+0 (secure 0 0 0) 0x7f055c0642b0 con 0x7f056c06de50 2024-09-17T05:44:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0548073230 msgr2=0x7f0548075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0548073230 0x7f0548075740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f056c0b5ee0 tx=0x7f0554009040 comp rx=0 tx=0).stop 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f056c06de50 msgr2=0x7f056c153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f056c06de50 0x7f056c153590 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f055c00e7f0 tx=0x7f055c00ecb0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 shutdown_connections 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0548073230 0x7f0548075740 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f056c0cb470 0x7f056c0a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f056c072e50 0x7f056c0a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 --2- 172.21.15.44:0/1394991389 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f056c06de50 0x7f056c153590 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 >> 172.21.15.44:0/1394991389 conn(0x7f056c0ccaa0 msgr2=0x7f056c164650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 shutdown_connections 2024-09-17T05:44:11.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:11.869+0000 7f0573200640 1 -- 172.21.15.44:0/1394991389 wait complete. 2024-09-17T05:44:11.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:44:12.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 -- 172.21.15.44:0/979599819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 msgr2=0x7fbf20070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 --2- 172.21.15.44:0/979599819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf20070a20 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009c80 tx=0x7fbf1801cda0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 -- 172.21.15.44:0/979599819 shutdown_connections 2024-09-17T05:44:12.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 --2- 172.21.15.44:0/979599819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf20070a20 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 --2- 172.21.15.44:0/979599819 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf2006e560 0x7fbf200700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 -- 172.21.15.44:0/979599819 >> 172.21.15.44:0/979599819 conn(0x7fbf200ccaa0 msgr2=0x7fbf200cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:12.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 -- 172.21.15.44:0/979599819 shutdown_connections 2024-09-17T05:44:12.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 -- 172.21.15.44:0/979599819 wait complete. 2024-09-17T05:44:12.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 Processor -- start 2024-09-17T05:44:12.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.061+0000 7fbf27a00640 1 -- start start 2024-09-17T05:44:12.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf200c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf200b5880 0x7fbf201589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf201fab60 0x7fbf2015ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20169ea0 con 0x7fbf20070610 2024-09-17T05:44:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20169d20 con 0x7fbf200b5880 2024-09-17T05:44:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbf2016a020 con 0x7fbf201fab60 2024-09-17T05:44:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf200c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf200c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58010/0 (socket says 172.21.15.44:58010) 2024-09-17T05:44:12.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 -- 172.21.15.44:0/2732794331 learned_addr learned my addr 172.21.15.44:0/2732794331 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf1fe00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf200b5880 0x7fbf201589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25a00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf201fab60 0x7fbf2015ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 -- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf201fab60 msgr2=0x7fbf2015ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf201fab60 0x7fbf2015ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 -- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf200b5880 msgr2=0x7fbf201589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf200b5880 0x7fbf201589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 -- 172.21.15.44:0/2732794331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf200c99e0 con 0x7fbf20070610 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf25000640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf200c9090 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400b410 tx=0x7fbf1400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf1cc00640 1 -- 172.21.15.44:0/2732794331 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14015030 con 0x7fbf20070610 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf1cc00640 1 -- 172.21.15.44:0/2732794331 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf14004020 con 0x7fbf20070610 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf201fa080 con 0x7fbf20070610 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf1cc00640 1 -- 172.21.15.44:0/2732794331 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140044b0 con 0x7fbf20070610 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf201fa640 con 0x7fbf20070610 2024-09-17T05:44:12.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.065+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf200700d0 con 0x7fbf20070610 2024-09-17T05:44:12.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.069+0000 7fbf1cc00640 1 -- 172.21.15.44:0/2732794331 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbf14018070 con 0x7fbf20070610 2024-09-17T05:44:12.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.069+0000 7fbf1cc00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf00073230 0x7fbf00075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.069+0000 7fbf1cc00640 1 -- 172.21.15.44:0/2732794331 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7fbf140940b0 con 0x7fbf20070610 2024-09-17T05:44:12.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.069+0000 7fbf1fe00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf00073230 0x7fbf00075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.069+0000 7fbf1fe00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf00073230 0x7fbf00075740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0058d0 tx=0x7fbf0c005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:12.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.073+0000 7fbf1cc00640 1 -- 172.21.15.44:0/2732794331 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbf1405f200 con 0x7fbf20070610 2024-09-17T05:44:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.249+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbf2015fb80 con 0x7fbf20070610 2024-09-17T05:44:12.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.249+0000 7fbf1cc00640 1 -- 172.21.15.44:0/2732794331 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+2294 (secure 0 0 0) 0x7fbf1405eb00 con 0x7fbf20070610 2024-09-17T05:44:12.249 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:44:12.249 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:44:12.249 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:44:12.249 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:44:12.249 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3062.155679 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3184.697297 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3313.522676 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3406.954625 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4320.207875 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.313189 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7119.006184 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4437.685284 2024-09-17T05:44:12.250 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:44:12.251 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:44:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf00073230 msgr2=0x7fbf00075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf00073230 0x7fbf00075740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0058d0 tx=0x7fbf0c005860 comp rx=0 tx=0).stop 2024-09-17T05:44:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 msgr2=0x7fbf200c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf200c9090 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400b410 tx=0x7fbf1400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 shutdown_connections 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbf201fab60 0x7fbf2015ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbf00073230 0x7fbf00075740 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf200b5880 0x7fbf201589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 --2- 172.21.15.44:0/2732794331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbf20070610 0x7fbf200c9090 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 >> 172.21.15.44:0/2732794331 conn(0x7fbf200ccaa0 msgr2=0x7fbf2015baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 shutdown_connections 2024-09-17T05:44:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.253+0000 7fbf27a00640 1 -- 172.21.15.44:0/2732794331 wait complete. 2024-09-17T05:44:12.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:44:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.433+0000 7f5326a00640 1 -- 172.21.15.44:0/1753080779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f532006de50 msgr2=0x7f532006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.433+0000 7f5326a00640 1 --2- 172.21.15.44:0/1753080779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f532006de50 0x7f532006e260 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f530c009840 tx=0x7f530c01c790 comp rx=0 tx=0).stop 2024-09-17T05:44:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.433+0000 7f5326a00640 1 -- 172.21.15.44:0/1753080779 shutdown_connections 2024-09-17T05:44:12.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.433+0000 7f5326a00640 1 --2- 172.21.15.44:0/1753080779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f532006de50 0x7f532006e260 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.433+0000 7f5326a00640 1 -- 172.21.15.44:0/1753080779 >> 172.21.15.44:0/1753080779 conn(0x7f53200ccaa0 msgr2=0x7f53200cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:12.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.433+0000 7f5326a00640 1 -- 172.21.15.44:0/1753080779 shutdown_connections 2024-09-17T05:44:12.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.433+0000 7f5326a00640 1 -- 172.21.15.44:0/1753080779 wait complete. 2024-09-17T05:44:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 Processor -- start 2024-09-17T05:44:12.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 -- start start 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532006de50 0x7f53200709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5320072e50 0x7f532015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53200cb470 0x7f532015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5320169f20 con 0x7f53200cb470 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5320169da0 con 0x7f532006de50 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5326a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f532016a0a0 con 0x7f5320072e50 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53200cb470 0x7f532015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53200cb470 0x7f532015a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58020/0 (socket says 172.21.15.44:58020) 2024-09-17T05:44:12.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 -- 172.21.15.44:0/2779190923 learned_addr learned my addr 172.21.15.44:0/2779190923 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:12.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f531f400640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5320072e50 0x7f532015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f531fe00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532006de50 0x7f53200709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 -- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5320072e50 msgr2=0x7f532015a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5320072e50 0x7f532015a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 -- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532006de50 msgr2=0x7f53200709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532006de50 0x7f53200709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.437+0000 7f5324a00640 1 -- 172.21.15.44:0/2779190923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53201f92b0 con 0x7f53200cb470 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5324a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53200cb470 0x7f532015a580 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f531800b970 tx=0x7f531800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5317e00640 1 -- 172.21.15.44:0/2779190923 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5318019070 con 0x7f53200cb470 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5317e00640 1 -- 172.21.15.44:0/2779190923 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f531800cc30 con 0x7f53200cb470 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53201f9550 con 0x7f53200cb470 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5317e00640 1 -- 172.21.15.44:0/2779190923 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53180146a0 con 0x7f53200cb470 2024-09-17T05:44:12.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53201f9b10 con 0x7f53200cb470 2024-09-17T05:44:12.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532006e260 con 0x7f53200cb470 2024-09-17T05:44:12.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5317e00640 1 -- 172.21.15.44:0/2779190923 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f531801c070 con 0x7f53200cb470 2024-09-17T05:44:12.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5317e00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5300073200 0x7f5300075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:12.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f5317e00640 1 -- 172.21.15.44:0/2779190923 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f5318093df0 con 0x7f53200cb470 2024-09-17T05:44:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.441+0000 7f531fe00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5300073200 0x7f5300075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:12.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.445+0000 7f531fe00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5300073200 0x7f5300075710 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5310007fd0 tx=0x7f5310009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:12.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.449+0000 7f5317e00640 1 -- 172.21.15.44:0/2779190923 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f531805e7e0 con 0x7f53200cb470 2024-09-17T05:44:12.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.625+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f53200b5fa0 con 0x7f53200cb470 2024-09-17T05:44:12.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5317e00640 1 -- 172.21.15.44:0/2779190923 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f5318063210 con 0x7f53200cb470 2024-09-17T05:44:12.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5300073200 msgr2=0x7f5300075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5300073200 0x7f5300075710 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5310007fd0 tx=0x7f5310009040 comp rx=0 tx=0).stop 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53200cb470 msgr2=0x7f532015a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53200cb470 0x7f532015a580 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f531800b970 tx=0x7f531800be30 comp rx=0 tx=0).stop 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 shutdown_connections 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53200cb470 0x7f532015a580 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5320072e50 0x7f532015a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5300073200 0x7f5300075710 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 --2- 172.21.15.44:0/2779190923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532006de50 0x7f53200709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 >> 172.21.15.44:0/2779190923 conn(0x7f53200ccaa0 msgr2=0x7f532015e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 shutdown_connections 2024-09-17T05:44:12.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:12.629+0000 7f5326a00640 1 -- 172.21.15.44:0/2779190923 wait complete. 2024-09-17T05:44:12.649 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:44:12.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:44:12.761 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:44:12.861 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:44:12.861 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:12.862 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:12.871 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:44:12.871 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:44:12.872 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:12.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:44:12.881 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:12.881 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:12.922 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:44:12.923 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:44:12.923 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:12.931 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:44:12.932 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:44:12.932 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.125+0000 7f43e4800640 1 -- 172.21.15.44:0/2685588427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c4003fe0 msgr2=0x7f43c4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.125+0000 7f43e4800640 1 --2- 172.21.15.44:0/2685588427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c4003fe0 0x7f43c4004810 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0af8d0 tx=0x7f43cc01d1d0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.125+0000 7f43e2800640 1 -- 172.21.15.44:0/2685588427 reap_dead start 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.125+0000 7f43e4800640 1 -- 172.21.15.44:0/2685588427 shutdown_connections 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.125+0000 7f43e4800640 1 -- 172.21.15.44:0/2685588427 >> 172.21.15.44:0/2685588427 conn(0x7f43dc0ccaa0 msgr2=0x7f43dc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.125+0000 7f43e4800640 1 -- 172.21.15.44:0/2685588427 shutdown_connections 2024-09-17T05:44:13.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.125+0000 7f43e4800640 1 -- 172.21.15.44:0/2685588427 wait complete. 2024-09-17T05:44:13.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 Processor -- start 2024-09-17T05:44:13.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 -- start start 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43c4003fe0 0x7f43dc0c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43dc0c9720 0x7f43dc1fb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43dc1fbd60 0x7f43dc1fc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc166dd0 con 0x7f43dc1fbd60 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc166c50 con 0x7f43dc0c9720 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f43dc166f50 con 0x7f43c4003fe0 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43dc1fbd60 0x7f43dc1fc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43dc1fbd60 0x7f43dc1fc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58032/0 (socket says 172.21.15.44:58032) 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 -- 172.21.15.44:0/3530820006 learned_addr learned my addr 172.21.15.44:0/3530820006 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e1400640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43dc0c9720 0x7f43dc1fb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e1e00640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43c4003fe0 0x7f43dc0c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 -- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43c4003fe0 msgr2=0x7f43dc0c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43c4003fe0 0x7f43dc0c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 -- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43dc0c9720 msgr2=0x7f43dc1fb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43dc0c9720 0x7f43dc1fb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 -- 172.21.15.44:0/3530820006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1fc6b0 con 0x7f43dc1fbd60 2024-09-17T05:44:13.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e2800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43dc1fbd60 0x7f43dc1fc170 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0af7f0 tx=0x7f43d800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43d6000640 1 -- 172.21.15.44:0/3530820006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8004d30 con 0x7f43dc1fbd60 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43d6000640 1 -- 172.21.15.44:0/3530820006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d8003980 con 0x7f43dc1fbd60 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc0c9b30 con 0x7f43dc1fbd60 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43d6000640 1 -- 172.21.15.44:0/3530820006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8003dd0 con 0x7f43dc1fbd60 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.129+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1fa780 con 0x7f43dc1fbd60 2024-09-17T05:44:13.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.133+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc0cb880 con 0x7f43dc1fbd60 2024-09-17T05:44:13.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.133+0000 7f43d6000640 1 -- 172.21.15.44:0/3530820006 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f43d8004030 con 0x7f43dc1fbd60 2024-09-17T05:44:13.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.133+0000 7f43d6000640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f43c0073200 0x7f43c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.133+0000 7f43d6000640 1 -- 172.21.15.44:0/3530820006 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7f43d8095140 con 0x7f43dc1fbd60 2024-09-17T05:44:13.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.133+0000 7f43e1e00640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f43c0073200 0x7f43c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.137+0000 7f43e1e00640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f43c0073200 0x7f43c0075710 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f43d0000fc0 tx=0x7f43d0006920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.137+0000 7f43d6000640 1 -- 172.21.15.44:0/3530820006 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f43dc0c9b30 con 0x7f43dc1fbd60 2024-09-17T05:44:13.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:13.297 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.345+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43dc15e250 con 0x7f43dc1fbd60 2024-09-17T05:44:13.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43d6000640 1 -- 172.21.15.44:0/3530820006 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+3908 (secure 0 0 0) 0x7f43d801f060 con 0x7f43dc1fbd60 2024-09-17T05:44:13.347 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:13.348 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":77,"btime":"2024-09-17T05:44:06:833237+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6116,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/836324793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":836324793},{"type":"v1","addr":"172.21.15.86:6837","nonce":836324793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4065800344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4065800344},{"type":"v1","addr":"172.21.15.86:6836","nonce":4065800344}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":6697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/2435618901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":2435618901},{"type":"v1","addr":"172.21.15.44:6834","nonce":2435618901}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/1184312732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1184312732},{"type":"v1","addr":"172.21.15.44:6835","nonce":1184312732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[]} 2024-09-17T05:44:13.348 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 77 2024-09-17T05:44:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f43c0073200 msgr2=0x7f43c0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f43c0073200 0x7f43c0075710 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f43d0000fc0 tx=0x7f43d0006920 comp rx=0 tx=0).stop 2024-09-17T05:44:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43dc1fbd60 msgr2=0x7f43dc1fc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43dc1fbd60 0x7f43dc1fc170 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0af7f0 tx=0x7f43d800f790 comp rx=0 tx=0).stop 2024-09-17T05:44:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 shutdown_connections 2024-09-17T05:44:13.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43dc1fbd60 0x7f43dc1fc170 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f43c0073200 0x7f43c0075710 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43dc0c9720 0x7f43dc1fb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 --2- 172.21.15.44:0/3530820006 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f43c4003fe0 0x7f43dc0c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 >> 172.21.15.44:0/3530820006 conn(0x7f43dc0ccaa0 msgr2=0x7f43dc165950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 shutdown_connections 2024-09-17T05:44:13.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.349+0000 7f43e4800640 1 -- 172.21.15.44:0/3530820006 wait complete. 2024-09-17T05:44:13.369 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:44:13.369 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:44:13.369 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:44:13.370 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:44:13.370 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:44:13.370 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:44:13.370 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:44:13.370 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:44:13.370 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:44:13.370 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:44:13.371 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:44:13.371 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:44:13.371 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:44:13.371 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:44:13.371 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:44:13.371 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:44:13.385 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:44:13.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:44:13.387 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:44:13.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:44:13.424 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:44:13.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:44:13.432 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:44:13.433 DEBUG:teuthology.parallel:result is None 2024-09-17T05:44:13.434 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:44:13.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:44:13.435 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:44:13.435 DEBUG:teuthology.parallel:result is None 2024-09-17T05:44:13.477 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:44:13.477 DEBUG:teuthology.parallel:result is None 2024-09-17T05:44:13.479 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:44:13.479 DEBUG:teuthology.parallel:result is None 2024-09-17T05:44:13.479 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:44:13.536 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:44:13.536 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:44:13.581 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:44:13.582 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:44:13.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 -- 172.21.15.44:0/1432789180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 msgr2=0x7fd6280c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 --2- 172.21.15.44:0/1432789180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 0x7fd6280c7780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009840 tx=0x7fd61c01c790 comp rx=0 tx=0).stop 2024-09-17T05:44:13.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 -- 172.21.15.44:0/1432789180 shutdown_connections 2024-09-17T05:44:13.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 --2- 172.21.15.44:0/1432789180 >> v2:172.21.15.86:3300/0 conn(0x7fd6280b1fc0 0x7fd6280b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 --2- 172.21.15.44:0/1432789180 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 0x7fd6280c7780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 -- 172.21.15.44:0/1432789180 >> 172.21.15.44:0/1432789180 conn(0x7fd6280ceaa0 msgr2=0x7fd6280ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 -- 172.21.15.44:0/1432789180 shutdown_connections 2024-09-17T05:44:13.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 -- 172.21.15.44:0/1432789180 wait complete. 2024-09-17T05:44:13.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 Processor -- start 2024-09-17T05:44:13.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.649+0000 7fd62e000640 1 -- start start 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6280b1fc0 0x7fd62814a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 0x7fd628153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd628160060 0x7fd62815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd628169df0 con 0x7fd6280b1fc0 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd628169c70 con 0x7fd628160060 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd628169f70 con 0x7fd6280c7370 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6280b1fc0 0x7fd62814a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6280b1fc0 0x7fd62814a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58090/0 (socket says 172.21.15.44:58090) 2024-09-17T05:44:13.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 -- 172.21.15.44:0/3655490064 learned_addr learned my addr 172.21.15.44:0/3655490064 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62d600640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd628160060 0x7fd62815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd627e00640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 0x7fd628153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 -- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 msgr2=0x7fd628153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 0x7fd628153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 -- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd628160060 msgr2=0x7fd62815b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd628160060 0x7fd62815b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 -- 172.21.15.44:0/3655490064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62814fab0 con 0x7fd6280b1fc0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62cc00640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6280b1fc0 0x7fd62814a9c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd61c01ae40 tx=0x7fd61c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd624c00640 1 -- 172.21.15.44:0/3655490064 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c0b2040 con 0x7fd6280b1fc0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd624c00640 1 -- 172.21.15.44:0/3655490064 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd61c004320 con 0x7fd6280b1fc0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62814af00 con 0x7fd6280b1fc0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd624c00640 1 -- 172.21.15.44:0/3655490064 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c005280 con 0x7fd6280b1fc0 2024-09-17T05:44:13.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62806e2d0 con 0x7fd6280b1fc0 2024-09-17T05:44:13.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.653+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6280b23d0 con 0x7fd6280b1fc0 2024-09-17T05:44:13.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.657+0000 7fd624c00640 1 -- 172.21.15.44:0/3655490064 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd61c0bd060 con 0x7fd6280b1fc0 2024-09-17T05:44:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.657+0000 7fd624c00640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd608073200 0x7fd608075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.657+0000 7fd624c00640 1 -- 172.21.15.44:0/3655490064 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5507+0+0 (secure 0 0 0) 0x7fd61c12d7c0 con 0x7fd6280b1fc0 2024-09-17T05:44:13.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.657+0000 7fd627e00640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd608073200 0x7fd608075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:13.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.657+0000 7fd627e00640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd608073200 0x7fd608075710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd6281fb9f0 tx=0x7fd6140013a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:13.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.661+0000 7fd624c00640 1 -- 172.21.15.44:0/3655490064 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fd61c016410 con 0x7fd6280b1fc0 2024-09-17T05:44:13.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.845+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd6280cf860 con 0x7fd6280b1fc0 2024-09-17T05:44:13.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.885+0000 7fd624c00640 1 -- 172.21.15.44:0/3655490064 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) ==== 97+0+0 (secure 0 0 0) 0x7fd61c0f88d0 con 0x7fd6280b1fc0 2024-09-17T05:44:13.884 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-17T05:44:13.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.885+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd608073200 msgr2=0x7fd608075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.885+0000 7fd62e000640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd608073200 0x7fd608075710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd6281fb9f0 tx=0x7fd6140013a0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.885+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6280b1fc0 msgr2=0x7fd62814a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:13.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.885+0000 7fd62e000640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6280b1fc0 0x7fd62814a9c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd61c01ae40 tx=0x7fd61c005dc0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.885+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 shutdown_connections 2024-09-17T05:44:13.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.889+0000 7fd62e000640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd608073200 0x7fd608075710 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.889+0000 7fd62e000640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd628160060 0x7fd62815b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.889+0000 7fd62e000640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6280c7370 0x7fd628153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.889+0000 7fd62e000640 1 --2- 172.21.15.44:0/3655490064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6280b1fc0 0x7fd62814a9c0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:13.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.889+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 >> 172.21.15.44:0/3655490064 conn(0x7fd6280ceaa0 msgr2=0x7fd628070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:13.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.889+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 shutdown_connections 2024-09-17T05:44:13.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:13.889+0000 7fd62e000640 1 -- 172.21.15.44:0/3655490064 wait complete. 2024-09-17T05:44:13.909 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:44:14.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.069+0000 7f3e65e00640 1 -- 172.21.15.44:0/1178131277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 msgr2=0x7f3e4400b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.069+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1178131277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e4400b9f0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3e58009ec0 tx=0x7f3e5801d610 comp rx=0 tx=0).stop 2024-09-17T05:44:14.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.069+0000 7f3e65e00640 1 -- 172.21.15.44:0/1178131277 shutdown_connections 2024-09-17T05:44:14.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.069+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1178131277 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e4400b9f0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.069+0000 7f3e65e00640 1 -- 172.21.15.44:0/1178131277 >> 172.21.15.44:0/1178131277 conn(0x7f3e600ccaa0 msgr2=0x7f3e600cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:14.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.069+0000 7f3e65e00640 1 -- 172.21.15.44:0/1178131277 shutdown_connections 2024-09-17T05:44:14.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.069+0000 7f3e65e00640 1 -- 172.21.15.44:0/1178131277 wait complete. 2024-09-17T05:44:14.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 Processor -- start 2024-09-17T05:44:14.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 -- start start 2024-09-17T05:44:14.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e6015db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e601f51f0 0x7f3e600c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e600c5860 0x7f3e6015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6015ed80 con 0x7f3e44005330 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6015ec00 con 0x7f3e600c5860 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3e6015ef00 con 0x7f3e601f51f0 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e6015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e6015db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58118/0 (socket says 172.21.15.44:58118) 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 -- 172.21.15.44:0/1742792731 learned_addr learned my addr 172.21.15.44:0/1742792731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e57e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e601f51f0 0x7f3e600c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5f400640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e600c5860 0x7f3e6015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 -- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e601f51f0 msgr2=0x7f3e600c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e601f51f0 0x7f3e600c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 -- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e600c5860 msgr2=0x7f3e6015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e600c5860 0x7f3e6015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 -- 172.21.15.44:0/1742792731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e600c5c70 con 0x7f3e44005330 2024-09-17T05:44:14.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5f400640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e600c5860 0x7f3e6015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:44:14.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e5ea00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e6015db80 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3e50005e70 tx=0x7f3e50011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e57400640 1 -- 172.21.15.44:0/1742792731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50005320 con 0x7f3e44005330 2024-09-17T05:44:14.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e57400640 1 -- 172.21.15.44:0/1742792731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e50018020 con 0x7f3e44005330 2024-09-17T05:44:14.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e60154120 con 0x7f3e44005330 2024-09-17T05:44:14.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e57400640 1 -- 172.21.15.44:0/1742792731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50003860 con 0x7f3e44005330 2024-09-17T05:44:14.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.073+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e600b5070 con 0x7f3e44005330 2024-09-17T05:44:14.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.077+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6006e640 con 0x7f3e44005330 2024-09-17T05:44:14.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.077+0000 7f3e57400640 1 -- 172.21.15.44:0/1742792731 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e50003a00 con 0x7f3e44005330 2024-09-17T05:44:14.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.077+0000 7f3e57400640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e3c073200 0x7f3e3c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.077+0000 7f3e57400640 1 -- 172.21.15.44:0/1742792731 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5249+0+0 (secure 0 0 0) 0x7f3e500978d0 con 0x7f3e44005330 2024-09-17T05:44:14.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.077+0000 7f3e57e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e3c073200 0x7f3e3c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.077+0000 7f3e57e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e3c073200 0x7f3e3c075710 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3e600cd500 tx=0x7f3e48006730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.081+0000 7f3e57400640 1 -- 172.21.15.44:0/1742792731 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3e50022020 con 0x7f3e44005330 2024-09-17T05:44:14.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3e600b15c0 con 0x7f3e44005330 2024-09-17T05:44:14.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e57400640 1 -- 172.21.15.44:0/1742792731 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f3e600c5c70 con 0x7f3e44005330 2024-09-17T05:44:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:14.316 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:44:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-17T05:44:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.316 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw==", 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow==", 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.317 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ==", 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:44:14.318 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA==", 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.319 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw==", 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA==", 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.320 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg==", 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.321 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q==", 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.322 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg==", 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew==", 2024-09-17T05:44:14.323 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA==", 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.324 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw==", 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow==", 2024-09-17T05:44:14.325 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ==", 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:44:14.326 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw==", 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A==", 2024-09-17T05:44:14.327 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQARFelmev8SKhAAoaY75HymG92N8LNMMAUl6g==", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:44:14.328 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA==", 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-17T05:44:14.329 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw==", 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:44:14.330 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e3c073200 msgr2=0x7f3e3c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e3c073200 0x7f3e3c075710 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3e600cd500 tx=0x7f3e48006730 comp rx=0 tx=0).stop 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 msgr2=0x7f3e6015db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e6015db80 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f3e50005e70 tx=0x7f3e50011740 comp rx=0 tx=0).stop 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 shutdown_connections 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e3c073200 0x7f3e3c075710 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e600c5860 0x7f3e6015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e601f51f0 0x7f3e600c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 --2- 172.21.15.44:0/1742792731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e44005330 0x7f3e6015db80 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 >> 172.21.15.44:0/1742792731 conn(0x7f3e600ccaa0 msgr2=0x7f3e600cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 shutdown_connections 2024-09-17T05:44:14.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.317+0000 7f3e65e00640 1 -- 172.21.15.44:0/1742792731 wait complete. 2024-09-17T05:44:14.339 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 -- 172.21.15.44:0/2135110631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 msgr2=0x7fc6e00cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2135110631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e00cf070 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0073b70 tx=0x7fc6c801c740 comp rx=0 tx=0).stop 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 -- 172.21.15.44:0/2135110631 shutdown_connections 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2135110631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e00cf070 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2135110631 >> v2:172.21.15.86:3300/0 conn(0x7fc6e00d18f0 0x7fc6e00b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 -- 172.21.15.44:0/2135110631 >> 172.21.15.44:0/2135110631 conn(0x7fc6e00b4240 msgr2=0x7fc6e00b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 -- 172.21.15.44:0/2135110631 shutdown_connections 2024-09-17T05:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.497+0000 7fc6e7200640 1 -- 172.21.15.44:0/2135110631 wait complete. 2024-09-17T05:44:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 Processor -- start 2024-09-17T05:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 -- start start 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6e00cf5b0 0x7fc6e0165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6e00d18f0 0x7fc6e00cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e0169e80 con 0x7fc6e00d1d00 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e0169d00 con 0x7fc6e00cf5b0 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e7200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e016a000 con 0x7fc6e00d18f0 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e015a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58142/0 (socket says 172.21.15.44:58142) 2024-09-17T05:44:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6e5200640 1 -- 172.21.15.44:0/2130260259 learned_addr learned my addr 172.21.15.44:0/2130260259 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6dfe00640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6e00cf5b0 0x7fc6e0165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.501+0000 7fc6d7400640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6e00d18f0 0x7fc6e00cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e5200640 1 -- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6e00d18f0 msgr2=0x7fc6e00cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e5200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6e00d18f0 0x7fc6e00cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e5200640 1 -- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6e00cf5b0 msgr2=0x7fc6e0165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e5200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6e00cf5b0 0x7fc6e0165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e5200640 1 -- 172.21.15.44:0/2130260259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e01fc8a0 con 0x7fc6e00d1d00 2024-09-17T05:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e5200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e015a780 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c3f0 tx=0x7fc6d8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6dcc00640 1 -- 172.21.15.44:0/2130260259 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8017070 con 0x7fc6e00d1d00 2024-09-17T05:44:14.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6dcc00640 1 -- 172.21.15.44:0/2130260259 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6d8006da0 con 0x7fc6e00d1d00 2024-09-17T05:44:14.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e01fcb80 con 0x7fc6e00d1d00 2024-09-17T05:44:14.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6dcc00640 1 -- 172.21.15.44:0/2130260259 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8007290 con 0x7fc6e00d1d00 2024-09-17T05:44:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e00b6880 con 0x7fc6e00d1d00 2024-09-17T05:44:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e01fc610 con 0x7fc6e00d1d00 2024-09-17T05:44:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.505+0000 7fc6dcc00640 1 -- 172.21.15.44:0/2130260259 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc6d801a070 con 0x7fc6e00d1d00 2024-09-17T05:44:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.509+0000 7fc6dcc00640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc6bc073200 0x7fc6bc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.509+0000 7fc6dcc00640 1 -- 172.21.15.44:0/2130260259 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5249+0+0 (secure 0 0 0) 0x7fc6d8093270 con 0x7fc6e00d1d00 2024-09-17T05:44:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.509+0000 7fc6dfe00640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc6bc073200 0x7fc6bc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.509+0000 7fc6dfe00640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc6bc073200 0x7fc6bc075710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009ec0 tx=0x7fc6d0009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.513+0000 7fc6dcc00640 1 -- 172.21.15.44:0/2130260259 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc6e00cf9c0 con 0x7fc6e00d1d00 2024-09-17T05:44:14.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc6e01fd0a0 con 0x7fc6e00d1d00 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6dcc00640 1 -- 172.21.15.44:0/2130260259 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v101) ==== 84+0+65 (secure 0 0 0) 0x7fc6e01fd0a0 con 0x7fc6e00d1d00 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:14.693 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:44:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc6bc073200 msgr2=0x7fc6bc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc6bc073200 0x7fc6bc075710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009ec0 tx=0x7fc6d0009500 comp rx=0 tx=0).stop 2024-09-17T05:44:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 msgr2=0x7fc6e015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e015a780 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c3f0 tx=0x7fc6d8001e80 comp rx=0 tx=0).stop 2024-09-17T05:44:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 shutdown_connections 2024-09-17T05:44:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6e00d1d00 0x7fc6e015a780 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc6e00d18f0 0x7fc6e00cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc6bc073200 0x7fc6bc075710 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 --2- 172.21.15.44:0/2130260259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6e00cf5b0 0x7fc6e0165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.693+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 >> 172.21.15.44:0/2130260259 conn(0x7fc6e00b4240 msgr2=0x7fc6e0155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.697+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 shutdown_connections 2024-09-17T05:44:14.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.697+0000 7fc6e7200640 1 -- 172.21.15.44:0/2130260259 wait complete. 2024-09-17T05:44:14.717 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:44:14.717 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 -- 172.21.15.44:0/2434490221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 msgr2=0x7ff0700d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 --2- 172.21.15.44:0/2434490221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 0x7ff0700d08f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff068009900 tx=0x7ff06801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 -- 172.21.15.44:0/2434490221 shutdown_connections 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 --2- 172.21.15.44:0/2434490221 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 0x7ff0700d08f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 --2- 172.21.15.44:0/2434490221 >> v2:172.21.15.86:3300/0 conn(0x7ff07006f3f0 0x7ff07006f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 -- 172.21.15.44:0/2434490221 >> 172.21.15.44:0/2434490221 conn(0x7ff0700b35f0 msgr2=0x7ff0700b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 -- 172.21.15.44:0/2434490221 shutdown_connections 2024-09-17T05:44:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.881+0000 7ff077e00640 1 -- 172.21.15.44:0/2434490221 wait complete. 2024-09-17T05:44:14.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 Processor -- start 2024-09-17T05:44:14.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 -- start start 2024-09-17T05:44:14.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07006f3f0 0x7ff07015b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 0x7ff07009c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff07015f210 0x7ff07014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff070169040 con 0x7ff07006f3f0 2024-09-17T05:44:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff070168ec0 con 0x7ff07015f210 2024-09-17T05:44:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.885+0000 7ff077e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff0701691c0 con 0x7ff0700d04e0 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07006f3f0 0x7ff07015b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff074a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 0x7ff07009c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07006f3f0 0x7ff07015b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58156/0 (socket says 172.21.15.44:58156) 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 -- 172.21.15.44:0/1138435617 learned_addr learned my addr 172.21.15.44:0/1138435617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075e00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff07015f210 0x7ff07014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 -- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 msgr2=0x7ff07009c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 0x7ff07009c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 -- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff07015f210 msgr2=0x7ff07014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff07015f210 0x7ff07014e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:14.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 -- 172.21.15.44:0/1138435617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07014e640 con 0x7ff07006f3f0 2024-09-17T05:44:14.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff075400640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07006f3f0 0x7ff07015b170 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c760 tx=0x7ff06400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff06d600640 1 -- 172.21.15.44:0/1138435617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064003b80 con 0x7ff07006f3f0 2024-09-17T05:44:14.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff06d600640 1 -- 172.21.15.44:0/1138435617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff064003d20 con 0x7ff07006f3f0 2024-09-17T05:44:14.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff070154ea0 con 0x7ff07006f3f0 2024-09-17T05:44:14.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff06d600640 1 -- 172.21.15.44:0/1138435617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06400aab0 con 0x7ff07006f3f0 2024-09-17T05:44:14.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07009c910 con 0x7ff07006f3f0 2024-09-17T05:44:14.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.889+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07006f800 con 0x7ff07006f3f0 2024-09-17T05:44:14.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.893+0000 7ff06d600640 1 -- 172.21.15.44:0/1138435617 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff06400ac50 con 0x7ff07006f3f0 2024-09-17T05:44:14.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.893+0000 7ff06d600640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff050073200 0x7ff050075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:14.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.893+0000 7ff06d600640 1 -- 172.21.15.44:0/1138435617 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5249+0+0 (secure 0 0 0) 0x7ff064094800 con 0x7ff07006f3f0 2024-09-17T05:44:14.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.893+0000 7ff074a00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff050073200 0x7ff050075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:14.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.893+0000 7ff074a00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff050073200 0x7ff050075710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff0700cd730 tx=0x7ff05c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:14.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:14.897+0000 7ff06d600640 1 -- 172.21.15.44:0/1138435617 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff0700d0e30 con 0x7ff07006f3f0 2024-09-17T05:44:15.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.073+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff0701f8eb0 con 0x7ff07006f3f0 2024-09-17T05:44:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.901+0000 7ff06d600640 1 -- 172.21.15.44:0/1138435617 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v102) ==== 138+0+0 (secure 0 0 0) 0x7ff06405f400 con 0x7ff07006f3f0 2024-09-17T05:44:15.902 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:44:15.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff050073200 msgr2=0x7ff050075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff050073200 0x7ff050075710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff0700cd730 tx=0x7ff05c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07006f3f0 msgr2=0x7ff07015b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:15.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07006f3f0 0x7ff07015b170 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff06400c760 tx=0x7ff06400cc20 comp rx=0 tx=0).stop 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 shutdown_connections 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff050073200 0x7ff050075710 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff07015f210 0x7ff07014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff0700d04e0 0x7ff07009c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 --2- 172.21.15.44:0/1138435617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff07006f3f0 0x7ff07015b170 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 >> 172.21.15.44:0/1138435617 conn(0x7ff0700b35f0 msgr2=0x7ff070151430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 shutdown_connections 2024-09-17T05:44:15.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:15.905+0000 7ff077e00640 1 -- 172.21.15.44:0/1138435617 wait complete. 2024-09-17T05:44:15.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:44:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 -- 172.21.15.44:0/4047721629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 msgr2=0x7f19c8166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 --2- 172.21.15.44:0/4047721629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 0x7f19c8166480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009bf0 tx=0x7f19c001cb50 comp rx=0 tx=0).stop 2024-09-17T05:44:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 -- 172.21.15.44:0/4047721629 shutdown_connections 2024-09-17T05:44:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 --2- 172.21.15.44:0/4047721629 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 0x7f19c8166480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 -- 172.21.15.44:0/4047721629 >> 172.21.15.44:0/4047721629 conn(0x7f19c80ccaa0 msgr2=0x7f19c80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:16.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 -- 172.21.15.44:0/4047721629 shutdown_connections 2024-09-17T05:44:16.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 -- 172.21.15.44:0/4047721629 wait complete. 2024-09-17T05:44:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.105+0000 7f19cf400640 1 Processor -- start 2024-09-17T05:44:16.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 -- start start 2024-09-17T05:44:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c806de50 0x7f19c809ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c8072e50 0x7f19c8156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 0x7f19c8156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8169ff0 con 0x7f19c8072e50 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8169e70 con 0x7f19c806de50 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f19c816a170 con 0x7f19c80cc480 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c8072e50 0x7f19c8156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c8072e50 0x7f19c8156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58166/0 (socket says 172.21.15.44:58166) 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19bfe00640 1 -- 172.21.15.44:0/1318401333 learned_addr learned my addr 172.21.15.44:0/1318401333 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cd400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 0x7f19c8156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cca00640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c806de50 0x7f19c809ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cd400640 1 -- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c806de50 msgr2=0x7f19c809ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cd400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c806de50 0x7f19c809ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cd400640 1 -- 172.21.15.44:0/1318401333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c8072e50 msgr2=0x7f19c8156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cd400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c8072e50 0x7f19c8156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cd400640 1 -- 172.21.15.44:0/1318401333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c80af010 con 0x7f19c80cc480 2024-09-17T05:44:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19bfe00640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c8072e50 0x7f19c8156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:16.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cd400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 0x7f19c8156950 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19c00ac000 tx=0x7f19c0005ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19c5600640 1 -- 172.21.15.44:0/1318401333 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c00bc070 con 0x7f19c80cc480 2024-09-17T05:44:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19c5600640 1 -- 172.21.15.44:0/1318401333 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19c0004130 con 0x7f19c80cc480 2024-09-17T05:44:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19c5600640 1 -- 172.21.15.44:0/1318401333 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c00b2040 con 0x7f19c80cc480 2024-09-17T05:44:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c80cf620 con 0x7f19c80cc480 2024-09-17T05:44:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.109+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c8158c60 con 0x7f19c80cc480 2024-09-17T05:44:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.113+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c815e990 con 0x7f19c80cc480 2024-09-17T05:44:16.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.113+0000 7f19c5600640 1 -- 172.21.15.44:0/1318401333 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f19c0004580 con 0x7f19c80cc480 2024-09-17T05:44:16.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.113+0000 7f19c5600640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19a4073200 0x7f19a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.113+0000 7f19c5600640 1 -- 172.21.15.44:0/1318401333 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(102..102 src has 1..102) ==== 5619+0+0 (secure 0 0 0) 0x7f19c012dfd0 con 0x7f19c80cc480 2024-09-17T05:44:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.113+0000 7f19cca00640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19a4073200 0x7f19a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:16.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.113+0000 7f19cca00640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19a4073200 0x7f19a4075710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f19b8007fd0 tx=0x7f19b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.117+0000 7f19c5600640 1 -- 172.21.15.44:0/1318401333 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f19c00c5080 con 0x7f19c80cc480 2024-09-17T05:44:16.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.293+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f19c80b5fa0 con 0x7f19c80cc480 2024-09-17T05:44:16.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.921+0000 7f19c5600640 1 -- 172.21.15.44:0/1318401333 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v103) ==== 170+0+0 (secure 0 0 0) 0x7f19c80af010 con 0x7f19c80cc480 2024-09-17T05:44:16.928 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:44:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19a4073200 msgr2=0x7f19a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19a4073200 0x7f19a4075710 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f19b8007fd0 tx=0x7f19b8009040 comp rx=0 tx=0).stop 2024-09-17T05:44:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 msgr2=0x7f19c8156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 0x7f19c8156950 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19c00ac000 tx=0x7f19c0005ae0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 shutdown_connections 2024-09-17T05:44:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19c80cc480 0x7f19c8156950 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19c8072e50 0x7f19c8156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19a4073200 0x7f19a4075710 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 --2- 172.21.15.44:0/1318401333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19c806de50 0x7f19c809ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:16.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 >> 172.21.15.44:0/1318401333 conn(0x7f19c80ccaa0 msgr2=0x7f19c815eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:16.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.929+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 shutdown_connections 2024-09-17T05:44:16.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:16.933+0000 7f19cf400640 1 -- 172.21.15.44:0/1318401333 wait complete. 2024-09-17T05:44:16.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:44:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 -- 172.21.15.44:0/2868580728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb300cb040 msgr2=0x7feb300cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 --2- 172.21.15.44:0/2868580728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb300cb040 0x7feb300cf190 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009840 tx=0x7feb1c01c820 comp rx=0 tx=0).stop 2024-09-17T05:44:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 -- 172.21.15.44:0/2868580728 shutdown_connections 2024-09-17T05:44:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 --2- 172.21.15.44:0/2868580728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb300cb040 0x7feb300cf190 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 --2- 172.21.15.44:0/2868580728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb300cac30 0x7feb300cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 -- 172.21.15.44:0/2868580728 >> 172.21.15.44:0/2868580728 conn(0x7feb300ccaa0 msgr2=0x7feb300cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 -- 172.21.15.44:0/2868580728 shutdown_connections 2024-09-17T05:44:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.125+0000 7feb35800640 1 -- 172.21.15.44:0/2868580728 wait complete. 2024-09-17T05:44:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 Processor -- start 2024-09-17T05:44:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 -- start start 2024-09-17T05:44:17.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb300cac30 0x7feb30154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb300cb040 0x7feb30166c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb3015e8c0 0x7feb301671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb30166490 con 0x7feb3015e8c0 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb30166310 con 0x7feb300cac30 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb35800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7feb30166610 con 0x7feb300cb040 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb3015e8c0 0x7feb301671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb3015e8c0 0x7feb301671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58180/0 (socket says 172.21.15.44:58180) 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 -- 172.21.15.44:0/2562219256 learned_addr learned my addr 172.21.15.44:0/2562219256 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2ea00640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb300cac30 0x7feb30154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2e000640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb300cb040 0x7feb30166c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 -- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb300cb040 msgr2=0x7feb30166c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb300cb040 0x7feb30166c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 -- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb300cac30 msgr2=0x7feb30154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb300cac30 0x7feb30154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.129+0000 7feb2f400640 1 -- 172.21.15.44:0/2562219256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb300c7f60 con 0x7feb3015e8c0 2024-09-17T05:44:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb2f400640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb3015e8c0 0x7feb301671a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7feb2800cae0 tx=0x7feb2800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb26a00640 1 -- 172.21.15.44:0/2562219256 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28016020 con 0x7feb3015e8c0 2024-09-17T05:44:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb26a00640 1 -- 172.21.15.44:0/2562219256 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb2800ab40 con 0x7feb3015e8c0 2024-09-17T05:44:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb300c8460 con 0x7feb3015e8c0 2024-09-17T05:44:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb26a00640 1 -- 172.21.15.44:0/2562219256 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2800ce20 con 0x7feb3015e8c0 2024-09-17T05:44:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb300c8a20 con 0x7feb3015e8c0 2024-09-17T05:44:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb300c81d0 con 0x7feb3015e8c0 2024-09-17T05:44:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb26a00640 1 -- 172.21.15.44:0/2562219256 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feb28019020 con 0x7feb3015e8c0 2024-09-17T05:44:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.133+0000 7feb26a00640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb10073230 0x7feb10075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.137+0000 7feb26a00640 1 -- 172.21.15.44:0/2562219256 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 6001+0+0 (secure 0 0 0) 0x7feb28094490 con 0x7feb3015e8c0 2024-09-17T05:44:17.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.137+0000 7feb2ea00640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb10073230 0x7feb10075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:17.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.137+0000 7feb2ea00640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb10073230 0x7feb10075740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feb20009b40 tx=0x7feb200091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.141+0000 7feb26a00640 1 -- 172.21.15.44:0/2562219256 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7feb28020020 con 0x7feb3015e8c0 2024-09-17T05:44:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.349+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7feb3015ecd0 con 0x7feb3015e8c0 2024-09-17T05:44:17.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.913+0000 7feb26a00640 1 -- 172.21.15.44:0/2562219256 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v80) ==== 174+0+0 (secure 0 0 0) 0x7feb2805ec90 con 0x7feb3015e8c0 2024-09-17T05:44:17.915 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 15 and data pool 16 2024-09-17T05:44:17.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb10073230 msgr2=0x7feb10075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb10073230 0x7feb10075740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feb20009b40 tx=0x7feb200091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb3015e8c0 msgr2=0x7feb301671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:17.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb3015e8c0 0x7feb301671a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7feb2800cae0 tx=0x7feb2800cbd0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 shutdown_connections 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb3015e8c0 0x7feb301671a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feb300cb040 0x7feb30166c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feb10073230 0x7feb10075740 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 --2- 172.21.15.44:0/2562219256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb300cac30 0x7feb30154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.917+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 >> 172.21.15.44:0/2562219256 conn(0x7feb300ccaa0 msgr2=0x7feb3006f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.921+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 shutdown_connections 2024-09-17T05:44:17.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:17.921+0000 7feb35800640 1 -- 172.21.15.44:0/2562219256 wait complete. 2024-09-17T05:44:17.975 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:18.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 -- 172.21.15.44:0/3647285165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 msgr2=0x7f30a815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 --2- 172.21.15.44:0/3647285165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a815e990 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f30a80af7b0 tx=0x7f309801c830 comp rx=0 tx=0).stop 2024-09-17T05:44:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 -- 172.21.15.44:0/3647285165 shutdown_connections 2024-09-17T05:44:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 --2- 172.21.15.44:0/3647285165 >> v2:172.21.15.86:3300/0 conn(0x7f30a80cb470 0x7f30a80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 --2- 172.21.15.44:0/3647285165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a815e990 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 -- 172.21.15.44:0/3647285165 >> 172.21.15.44:0/3647285165 conn(0x7f30a80ccaa0 msgr2=0x7f30a80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 -- 172.21.15.44:0/3647285165 shutdown_connections 2024-09-17T05:44:18.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 -- 172.21.15.44:0/3647285165 wait complete. 2024-09-17T05:44:18.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 Processor -- start 2024-09-17T05:44:18.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.137+0000 7f30ad200640 1 -- start start 2024-09-17T05:44:18.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30a806de50 0x7f30a8151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a8165c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30a80cb470 0x7f30a81fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8168f20 con 0x7f30a8072e50 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8168da0 con 0x7f30a806de50 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f30a81690a0 con 0x7f30a80cb470 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a8165c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a8165c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58200/0 (socket says 172.21.15.44:58200) 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 -- 172.21.15.44:0/2608266293 learned_addr learned my addr 172.21.15.44:0/2608266293 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30a6800640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30a80cb470 0x7f30a81fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30a5e00640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30a806de50 0x7f30a8151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 -- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30a80cb470 msgr2=0x7f30a81fd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30a80cb470 0x7f30a81fd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 -- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30a806de50 msgr2=0x7f30a8151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30a806de50 0x7f30a8151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 -- 172.21.15.44:0/2608266293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a80a0ce0 con 0x7f30a8072e50 2024-09-17T05:44:18.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30a6800640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30a80cb470 0x7f30a81fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:18.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309d400640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a8165c50 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f309000c3c0 tx=0x7f309000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:18.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309ea00640 1 -- 172.21.15.44:0/2608266293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090017070 con 0x7f30a8072e50 2024-09-17T05:44:18.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309ea00640 1 -- 172.21.15.44:0/2608266293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30900053c0 con 0x7f30a8072e50 2024-09-17T05:44:18.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a8164d50 con 0x7f30a8072e50 2024-09-17T05:44:18.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f309ea00640 1 -- 172.21.15.44:0/2608266293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090003860 con 0x7f30a8072e50 2024-09-17T05:44:18.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a8165310 con 0x7f30a8072e50 2024-09-17T05:44:18.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.141+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8165550 con 0x7f30a8072e50 2024-09-17T05:44:18.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.145+0000 7f309ea00640 1 -- 172.21.15.44:0/2608266293 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f309001a070 con 0x7f30a8072e50 2024-09-17T05:44:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.145+0000 7f309ea00640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3084073230 0x7f3084075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.145+0000 7f309ea00640 1 -- 172.21.15.44:0/2608266293 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f3090093630 con 0x7f30a8072e50 2024-09-17T05:44:18.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.145+0000 7f30a5e00640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3084073230 0x7f3084075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.145+0000 7f30a5e00640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3084073230 0x7f3084075740 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f30980af000 tx=0x7f30980a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:18.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.149+0000 7f309ea00640 1 -- 172.21.15.44:0/2608266293 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f30a8165550 con 0x7f30a8072e50 2024-09-17T05:44:18.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.329+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30a815e990 con 0x7f30a8072e50 2024-09-17T05:44:18.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.329+0000 7f309ea00640 1 -- 172.21.15.44:0/2608266293 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16925 (secure 0 0 0) 0x7f30a80a0ce0 con 0x7f30a8072e50 2024-09-17T05:44:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:18.330 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":104,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:44:17.352588+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:44:15.087361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:16.307403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:18.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3084073230 msgr2=0x7f3084075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3084073230 0x7f3084075740 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f30980af000 tx=0x7f30980a7040 comp rx=0 tx=0).stop 2024-09-17T05:44:18.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 msgr2=0x7f30a8165c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a8165c50 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f309000c3c0 tx=0x7f309000c880 comp rx=0 tx=0).stop 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 shutdown_connections 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f30a80cb470 0x7f30a81fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30a8072e50 0x7f30a8165c50 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3084073230 0x7f3084075740 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 --2- 172.21.15.44:0/2608266293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30a806de50 0x7f30a8151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 >> 172.21.15.44:0/2608266293 conn(0x7f30a80ccaa0 msgr2=0x7f30a8157700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 shutdown_connections 2024-09-17T05:44:18.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.333+0000 7f30ad200640 1 -- 172.21.15.44:0/2608266293 wait complete. 2024-09-17T05:44:18.353 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:18.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.509+0000 7f6f08000640 1 -- 172.21.15.44:0/2951231821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f00160720 msgr2=0x7f6f000ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.509+0000 7f6f08000640 1 --2- 172.21.15.44:0/2951231821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f00160720 0x7f6f000ae0e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009c80 tx=0x7f6ef801cda0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.509+0000 7f6f08000640 1 -- 172.21.15.44:0/2951231821 shutdown_connections 2024-09-17T05:44:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.509+0000 7f6f08000640 1 --2- 172.21.15.44:0/2951231821 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f00160720 0x7f6f000ae0e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.509+0000 7f6f08000640 1 --2- 172.21.15.44:0/2951231821 >> v2:172.21.15.86:3300/0 conn(0x7f6f0006dd30 0x7f6f0015c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.509+0000 7f6f08000640 1 -- 172.21.15.44:0/2951231821 >> 172.21.15.44:0/2951231821 conn(0x7f6f000d1120 msgr2=0x7f6f000d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 -- 172.21.15.44:0/2951231821 shutdown_connections 2024-09-17T05:44:18.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 -- 172.21.15.44:0/2951231821 wait complete. 2024-09-17T05:44:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 Processor -- start 2024-09-17T05:44:18.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 -- start start 2024-09-17T05:44:18.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f0006dd30 0x7f6f00159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f000cf700 0x7f6f000cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f00165510 0x7f6f00165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00169bf0 con 0x7f6f000cf700 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.513+0000 7f6f08000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6f00169a70 con 0x7f6f00165510 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f08000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6f00169d70 con 0x7f6f0006dd30 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f04c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f000cf700 0x7f6f000cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f0006dd30 0x7f6f00159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f0006dd30 0x7f6f00159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:59260/0 (socket says 172.21.15.44:59260) 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 -- 172.21.15.44:0/1957808793 learned_addr learned my addr 172.21.15.44:0/1957808793 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f06000640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f00165510 0x7f6f00165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 -- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f00165510 msgr2=0x7f6f00165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f00165510 0x7f6f00165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 -- 172.21.15.44:0/1957808793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f000cf700 msgr2=0x7f6f000cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f000cf700 0x7f6f000cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 -- 172.21.15.44:0/1957808793 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f00165e60 con 0x7f6f0006dd30 2024-09-17T05:44:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f05600640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f0006dd30 0x7f6f00159300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400e800 tx=0x7f6ef400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6efd600640 1 -- 172.21.15.44:0/1957808793 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400ccc0 con 0x7f6f0006dd30 2024-09-17T05:44:18.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6efd600640 1 -- 172.21.15.44:0/1957808793 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ef4010430 con 0x7f6f0006dd30 2024-09-17T05:44:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6efd600640 1 -- 172.21.15.44:0/1957808793 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4010860 con 0x7f6f0006dd30 2024-09-17T05:44:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f000b3f50 con 0x7f6f0006dd30 2024-09-17T05:44:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f000cd340 con 0x7f6f0006dd30 2024-09-17T05:44:18.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.517+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0015c430 con 0x7f6f0006dd30 2024-09-17T05:44:18.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.521+0000 7f6efd600640 1 -- 172.21.15.44:0/1957808793 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6ef4010a00 con 0x7f6f0006dd30 2024-09-17T05:44:18.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.521+0000 7f6efd600640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6ee0073230 0x7f6ee0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.521+0000 7f6efd600640 1 -- 172.21.15.44:0/1957808793 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7f6ef4095070 con 0x7f6f0006dd30 2024-09-17T05:44:18.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.521+0000 7f6f04c00640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6ee0073230 0x7f6ee0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.521+0000 7f6f04c00640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6ee0073230 0x7f6ee0075740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6f001fbaf0 tx=0x7f6eec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:18.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.525+0000 7f6efd600640 1 -- 172.21.15.44:0/1957808793 <== mon.2 v2:172.21.15.86:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6f00165e60 con 0x7f6f0006dd30 2024-09-17T05:44:18.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.697+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f000b1530 con 0x7f6f0006dd30 2024-09-17T05:44:18.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.697+0000 7f6efd600640 1 -- 172.21.15.44:0/1957808793 <== mon.2 v2:172.21.15.86:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16925 (secure 0 0 0) 0x7f6ef405f9b0 con 0x7f6f0006dd30 2024-09-17T05:44:18.699 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:18.699 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":104,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:44:17.352588+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:44:15.087361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:16.307403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6ee0073230 msgr2=0x7f6ee0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6ee0073230 0x7f6ee0075740 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6f001fbaf0 tx=0x7f6eec009040 comp rx=0 tx=0).stop 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f0006dd30 msgr2=0x7f6f00159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f0006dd30 0x7f6f00159300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400e800 tx=0x7f6ef400ecc0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 shutdown_connections 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6ee0073230 0x7f6ee0075740 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f00165510 0x7f6f00165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6f000cf700 0x7f6f000cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 --2- 172.21.15.44:0/1957808793 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6f0006dd30 0x7f6f00159300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 >> 172.21.15.44:0/1957808793 conn(0x7f6f000d1120 msgr2=0x7f6f0015eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:18.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 shutdown_connections 2024-09-17T05:44:18.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.701+0000 7f6f08000640 1 -- 172.21.15.44:0/1957808793 wait complete. 2024-09-17T05:44:18.721 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:44:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 -- 172.21.15.44:0/563257233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015a080 msgr2=0x7ff7b00cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/563257233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015a080 0x7ff7b00cbca0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7ff798009840 tx=0x7ff79801c820 comp rx=0 tx=0).stop 2024-09-17T05:44:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 -- 172.21.15.44:0/563257233 shutdown_connections 2024-09-17T05:44:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/563257233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015a080 0x7ff7b00cbca0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 -- 172.21.15.44:0/563257233 >> 172.21.15.44:0/563257233 conn(0x7ff7b00cd930 msgr2=0x7ff7b00cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 -- 172.21.15.44:0/563257233 shutdown_connections 2024-09-17T05:44:18.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 -- 172.21.15.44:0/563257233 wait complete. 2024-09-17T05:44:18.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 Processor -- start 2024-09-17T05:44:18.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.885+0000 7ff7b6c00640 1 -- start start 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7b00cc1e0 0x7ff7b01530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b015a080 0x7ff7b01f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015d560 0x7ff7b00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b016b020 con 0x7ff7b015d560 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b016aea0 con 0x7ff7b015a080 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b016b1a0 con 0x7ff7b00cc1e0 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015d560 0x7ff7b00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015d560 0x7ff7b00ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35098/0 (socket says 172.21.15.44:35098) 2024-09-17T05:44:18.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 -- 172.21.15.44:0/3191195003 learned_addr learned my addr 172.21.15.44:0/3191195003 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7afe00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7b00cc1e0 0x7ff7b01530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7a7400640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b015a080 0x7ff7b01f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 -- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7b00cc1e0 msgr2=0x7ff7b01530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7b00cc1e0 0x7ff7b01530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 -- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b015a080 msgr2=0x7ff7b01f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b015a080 0x7ff7b01f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:18.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 -- 172.21.15.44:0/3191195003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b01f9660 con 0x7ff7b015d560 2024-09-17T05:44:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b4c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015d560 0x7ff7b00ce480 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800cb10 tx=0x7ff7a800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7acc00640 1 -- 172.21.15.44:0/3191195003 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8016020 con 0x7ff7b015d560 2024-09-17T05:44:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7acc00640 1 -- 172.21.15.44:0/3191195003 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7a800ce50 con 0x7ff7b015d560 2024-09-17T05:44:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b01f9940 con 0x7ff7b015d560 2024-09-17T05:44:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7acc00640 1 -- 172.21.15.44:0/3191195003 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800ada0 con 0x7ff7b015d560 2024-09-17T05:44:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b00b3900 con 0x7ff7b015d560 2024-09-17T05:44:18.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.889+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b01f93d0 con 0x7ff7b015d560 2024-09-17T05:44:18.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.893+0000 7ff7acc00640 1 -- 172.21.15.44:0/3191195003 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff7a8019020 con 0x7ff7b015d560 2024-09-17T05:44:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.893+0000 7ff7acc00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff78c073200 0x7ff78c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:18.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.893+0000 7ff7acc00640 1 -- 172.21.15.44:0/3191195003 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 6101+0+0 (secure 0 0 0) 0x7ff7a80941c0 con 0x7ff7b015d560 2024-09-17T05:44:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.893+0000 7ff7afe00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff78c073200 0x7ff78c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:18.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.893+0000 7ff7afe00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff78c073200 0x7ff78c075710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0007fd0 tx=0x7ff7a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:18.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:18.897+0000 7ff7acc00640 1 -- 172.21.15.44:0/3191195003 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff7a8020030 con 0x7ff7b015d560 2024-09-17T05:44:19.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.113+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff7b015cdc0 con 0x7ff7b015d560 2024-09-17T05:44:19.889 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:44:19.889+0000 7fe2dfc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:44:19.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7acc00640 1 -- 172.21.15.44:0/3191195003 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) ==== 118+0+0 (secure 0 0 0) 0x7ff7b00cc5f0 con 0x7ff7b015d560 2024-09-17T05:44:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff78c073200 msgr2=0x7ff78c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff78c073200 0x7ff78c075710 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0007fd0 tx=0x7ff7a0009040 comp rx=0 tx=0).stop 2024-09-17T05:44:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015d560 msgr2=0x7ff7b00ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015d560 0x7ff7b00ce480 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800cb10 tx=0x7ff7a800cc00 comp rx=0 tx=0).stop 2024-09-17T05:44:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 shutdown_connections 2024-09-17T05:44:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7b015d560 0x7ff7b00ce480 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:19.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff78c073200 0x7ff78c075710 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b015a080 0x7ff7b01f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 --2- 172.21.15.44:0/3191195003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff7b00cc1e0 0x7ff7b01530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 >> 172.21.15.44:0/3191195003 conn(0x7ff7b00cd930 msgr2=0x7ff7b0167960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 shutdown_connections 2024-09-17T05:44:19.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:19.949+0000 7ff7b6c00640 1 -- 172.21.15.44:0/3191195003 wait complete. 2024-09-17T05:44:19.974 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:44:19.974 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:44:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 -- 172.21.15.44:0/2195853588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f871c072e50 msgr2=0x7f871c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 --2- 172.21.15.44:0/2195853588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f871c072e50 0x7f871c15e990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f870c009840 tx=0x7f870c01c790 comp rx=0 tx=0).stop 2024-09-17T05:44:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 -- 172.21.15.44:0/2195853588 shutdown_connections 2024-09-17T05:44:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 --2- 172.21.15.44:0/2195853588 >> v2:172.21.15.86:3300/0 conn(0x7f871c06de50 0x7f871c06e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 --2- 172.21.15.44:0/2195853588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f871c072e50 0x7f871c15e990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 -- 172.21.15.44:0/2195853588 >> 172.21.15.44:0/2195853588 conn(0x7f871c0ccaa0 msgr2=0x7f871c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:20.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 -- 172.21.15.44:0/2195853588 shutdown_connections 2024-09-17T05:44:20.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.141+0000 7f8721a00640 1 -- 172.21.15.44:0/2195853588 wait complete. 2024-09-17T05:44:20.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 Processor -- start 2024-09-17T05:44:20.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 -- start start 2024-09-17T05:44:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f871c06de50 0x7f871c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f871c072e50 0x7f871c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f871c0ced00 0x7f871c15a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f871c169410 con 0x7f871c06de50 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f871c169290 con 0x7f871c0ced00 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f871c169590 con 0x7f871c072e50 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f871c06de50 0x7f871c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f871c06de50 0x7f871c0aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35112/0 (socket says 172.21.15.44:35112) 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 -- 172.21.15.44:0/2883316999 learned_addr learned my addr 172.21.15.44:0/2883316999 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 -- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f871c072e50 msgr2=0x7f871c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f871c072e50 0x7f871c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 -- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f871c0ced00 msgr2=0x7f871c15a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f871c0ced00 0x7f871c15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 -- 172.21.15.44:0/2883316999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f871c1fadc0 con 0x7f871c06de50 2024-09-17T05:44:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f871aa00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f871c06de50 0x7f871c0aeee0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f870c01cc70 tx=0x7f870c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8713400640 1 -- 172.21.15.44:0/2883316999 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0b2040 con 0x7f871c06de50 2024-09-17T05:44:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8713400640 1 -- 172.21.15.44:0/2883316999 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870c004040 con 0x7f871c06de50 2024-09-17T05:44:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f871c1fb0a0 con 0x7f871c06de50 2024-09-17T05:44:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8713400640 1 -- 172.21.15.44:0/2883316999 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0043f0 con 0x7f871c06de50 2024-09-17T05:44:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.145+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f871c1fb660 con 0x7f871c06de50 2024-09-17T05:44:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.149+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871c06e260 con 0x7f871c06de50 2024-09-17T05:44:20.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.149+0000 7f8713400640 1 -- 172.21.15.44:0/2883316999 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f870c0bd030 con 0x7f871c06de50 2024-09-17T05:44:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.149+0000 7f8713400640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f86f8073230 0x7f86f8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.149+0000 7f8713400640 1 -- 172.21.15.44:0/2883316999 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f870c12df10 con 0x7f871c06de50 2024-09-17T05:44:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.149+0000 7f8712000640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f86f8073230 0x7f86f8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:20.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.149+0000 7f8712000640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f86f8073230 0x7f86f8075740 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f87040058d0 tx=0x7f8704005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:20.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.153+0000 7f8713400640 1 -- 172.21.15.44:0/2883316999 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f870c0c4020 con 0x7f871c06de50 2024-09-17T05:44:20.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.369+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f871c0a0cf0 con 0x7f871c06de50 2024-09-17T05:44:20.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.953+0000 7f8713400640 1 -- 172.21.15.44:0/2883316999 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) ==== 122+0+0 (secure 0 0 0) 0x7f870c016410 con 0x7f871c06de50 2024-09-17T05:44:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f86f8073230 msgr2=0x7f86f8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f86f8073230 0x7f86f8075740 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f87040058d0 tx=0x7f8704005860 comp rx=0 tx=0).stop 2024-09-17T05:44:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f871c06de50 msgr2=0x7f871c0aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f871c06de50 0x7f871c0aeee0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f870c01cc70 tx=0x7f870c005760 comp rx=0 tx=0).stop 2024-09-17T05:44:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 shutdown_connections 2024-09-17T05:44:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f86f8073230 0x7f86f8075740 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f871c0ced00 0x7f871c15a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f871c072e50 0x7f871c159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 --2- 172.21.15.44:0/2883316999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f871c06de50 0x7f871c0aeee0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:20.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 >> 172.21.15.44:0/2883316999 conn(0x7f871c0ccaa0 msgr2=0x7f871c158840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:20.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 shutdown_connections 2024-09-17T05:44:20.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:20.957+0000 7f8721a00640 1 -- 172.21.15.44:0/2883316999 wait complete. 2024-09-17T05:44:20.981 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:44:20.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:21.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.145+0000 7f0fcae00640 1 -- 172.21.15.44:0/1133754661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 msgr2=0x7f0fa8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.145+0000 7f0fcae00640 1 --2- 172.21.15.44:0/1133754661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fa8004c80 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f0fac006f70 tx=0x7f0fac01ce50 comp rx=0 tx=0).stop 2024-09-17T05:44:21.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.145+0000 7f0fcae00640 1 -- 172.21.15.44:0/1133754661 shutdown_connections 2024-09-17T05:44:21.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.145+0000 7f0fcae00640 1 --2- 172.21.15.44:0/1133754661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fa8004c80 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.145+0000 7f0fcae00640 1 -- 172.21.15.44:0/1133754661 >> 172.21.15.44:0/1133754661 conn(0x7f0fc40b4240 msgr2=0x7f0fc40b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:21.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.145+0000 7f0fcae00640 1 -- 172.21.15.44:0/1133754661 shutdown_connections 2024-09-17T05:44:21.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.145+0000 7f0fcae00640 1 -- 172.21.15.44:0/1133754661 wait complete. 2024-09-17T05:44:21.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 Processor -- start 2024-09-17T05:44:21.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 -- start start 2024-09-17T05:44:21.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fc41571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc4145060 0x7f0fc40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc4150c30 0x7f0fc415ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc415d440 con 0x7f0fa8004810 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc415d2c0 con 0x7f0fc4145060 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc415d5c0 con 0x7f0fc4150c30 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fc41571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fc41571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35132/0 (socket says 172.21.15.44:35132) 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 -- 172.21.15.44:0/2870221766 learned_addr learned my addr 172.21.15.44:0/2870221766 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fbbe00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc4145060 0x7f0fc40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc8e00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc4150c30 0x7f0fc415ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 -- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc4150c30 msgr2=0x7f0fc415ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc4150c30 0x7f0fc415ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 -- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc4145060 msgr2=0x7f0fc40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc4145060 0x7f0fc40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 -- 172.21.15.44:0/2870221766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc40cc600 con 0x7f0fa8004810 2024-09-17T05:44:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc3e00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fc41571e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4001060 tx=0x7f0fb4001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc0c00640 1 -- 172.21.15.44:0/2870221766 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4015070 con 0x7f0fa8004810 2024-09-17T05:44:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc0c00640 1 -- 172.21.15.44:0/2870221766 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb4011920 con 0x7f0fa8004810 2024-09-17T05:44:21.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc41515b0 con 0x7f0fa8004810 2024-09-17T05:44:21.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fc0c00640 1 -- 172.21.15.44:0/2870221766 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4011d70 con 0x7f0fa8004810 2024-09-17T05:44:21.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.149+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc4151b70 con 0x7f0fa8004810 2024-09-17T05:44:21.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.153+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc40d03e0 con 0x7f0fa8004810 2024-09-17T05:44:21.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.153+0000 7f0fc0c00640 1 -- 172.21.15.44:0/2870221766 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0fb4018070 con 0x7f0fa8004810 2024-09-17T05:44:21.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.153+0000 7f0fc0c00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0fa0073230 0x7f0fa0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.153+0000 7f0fc0c00640 1 -- 172.21.15.44:0/2870221766 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f0fb4095180 con 0x7f0fa8004810 2024-09-17T05:44:21.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.153+0000 7f0fbbe00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0fa0073230 0x7f0fa0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.153+0000 7f0fbbe00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0fa0073230 0x7f0fa0075740 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0ac000 tx=0x7f0fac005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:21.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.157+0000 7f0fc0c00640 1 -- 172.21.15.44:0/2870221766 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0fb405f920 con 0x7f0fa8004810 2024-09-17T05:44:21.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fc4071dd0 con 0x7f0fa8004810 2024-09-17T05:44:21.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fc0c00640 1 -- 172.21.15.44:0/2870221766 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7f0fb4064350 con 0x7f0fa8004810 2024-09-17T05:44:21.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:21.368 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"btime":"2024-09-17T05:44:20:951293+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:44:20.372604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3953022133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3953022133},{"type":"v1","addr":"172.21.15.44:6835","nonce":3953022133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7662,"qdb_cluster":[7662]},"id":7}]} 2024-09-17T05:44:21.368 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 84 2024-09-17T05:44:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0fa0073230 msgr2=0x7f0fa0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0fa0073230 0x7f0fa0075740 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0ac000 tx=0x7f0fac005040 comp rx=0 tx=0).stop 2024-09-17T05:44:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 msgr2=0x7f0fc41571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fc41571e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4001060 tx=0x7f0fb4001810 comp rx=0 tx=0).stop 2024-09-17T05:44:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 shutdown_connections 2024-09-17T05:44:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fc4150c30 0x7f0fc415ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0fa0073230 0x7f0fa0075740 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fc4145060 0x7f0fc40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 --2- 172.21.15.44:0/2870221766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fa8004810 0x7f0fc41571e0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 >> 172.21.15.44:0/2870221766 conn(0x7f0fc40b4240 msgr2=0x7f0fc415f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:21.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 shutdown_connections 2024-09-17T05:44:21.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.369+0000 7f0fcae00640 1 -- 172.21.15.44:0/2870221766 wait complete. 2024-09-17T05:44:21.390 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:44:21.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4172703097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e6406d5b0 msgr2=0x7f2e6406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4172703097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e6406d5b0 0x7f2e6406d9c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2e64072640 tx=0x7f2e5c01cb80 comp rx=0 tx=0).stop 2024-09-17T05:44:21.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4172703097 shutdown_connections 2024-09-17T05:44:21.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4172703097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e6406d5b0 0x7f2e6406d9c0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4172703097 >> v2:172.21.15.86:3300/0 conn(0x7f2e640d00b0 0x7f2e6415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4172703097 >> 172.21.15.44:0/4172703097 conn(0x7f2e640cd930 msgr2=0x7f2e640cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:21.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4172703097 shutdown_connections 2024-09-17T05:44:21.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.549+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4172703097 wait complete. 2024-09-17T05:44:21.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 Processor -- start 2024-09-17T05:44:21.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 -- start start 2024-09-17T05:44:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e6406d5b0 0x7f2e640b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e640c9be0 0x7f2e64159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e640d00b0 0x7f2e640b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6416bb90 con 0x7f2e640d00b0 2024-09-17T05:44:21.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6416ba10 con 0x7f2e6406d5b0 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6416bd10 con 0x7f2e640c9be0 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e640d00b0 0x7f2e640b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e640d00b0 0x7f2e640b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35140/0 (socket says 172.21.15.44:35140) 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e63e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e6406d5b0 0x7f2e640b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 -- 172.21.15.44:0/4148060222 learned_addr learned my addr 172.21.15.44:0/4148060222 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e5be00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e640c9be0 0x7f2e64159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 -- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e640c9be0 msgr2=0x7f2e64159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e640c9be0 0x7f2e64159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 -- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e6406d5b0 msgr2=0x7f2e640b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e6406d5b0 0x7f2e640b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 -- 172.21.15.44:0/4148060222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e64075100 con 0x7f2e640d00b0 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e68a00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e640d00b0 0x7f2e640b3860 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c01a7b0 tx=0x7f2e5c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:21.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e60c00640 1 -- 172.21.15.44:0/4148060222 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0bc070 con 0x7f2e640d00b0 2024-09-17T05:44:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e60c00640 1 -- 172.21.15.44:0/4148060222 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e5c0042f0 con 0x7f2e640d00b0 2024-09-17T05:44:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e640b3da0 con 0x7f2e640d00b0 2024-09-17T05:44:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e60c00640 1 -- 172.21.15.44:0/4148060222 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0b2040 con 0x7f2e640d00b0 2024-09-17T05:44:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.553+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6414f4e0 con 0x7f2e640d00b0 2024-09-17T05:44:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.557+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6406d9c0 con 0x7f2e640d00b0 2024-09-17T05:44:21.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.557+0000 7f2e60c00640 1 -- 172.21.15.44:0/4148060222 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2e5c0bf070 con 0x7f2e640d00b0 2024-09-17T05:44:21.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.557+0000 7f2e60c00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e40073200 0x7f2e40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.557+0000 7f2e60c00640 1 -- 172.21.15.44:0/4148060222 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f2e5c12e110 con 0x7f2e640d00b0 2024-09-17T05:44:21.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.557+0000 7f2e63e00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e40073200 0x7f2e40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.557+0000 7f2e63e00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e40073200 0x7f2e40075710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009b40 tx=0x7f2e540091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:21.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.561+0000 7f2e60c00640 1 -- 172.21.15.44:0/4148060222 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2e5c016770 con 0x7f2e640d00b0 2024-09-17T05:44:21.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.737+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e640ca330 con 0x7f2e640d00b0 2024-09-17T05:44:21.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e60c00640 1 -- 172.21.15.44:0/4148060222 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16912 (secure 0 0 0) 0x7f2e5c0f88b0 con 0x7f2e640d00b0 2024-09-17T05:44:21.739 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:21.740 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":105,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:44:18.932723+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:44:15.087361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:16.307403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e40073200 msgr2=0x7f2e40075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e40073200 0x7f2e40075710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009b40 tx=0x7f2e540091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e640d00b0 msgr2=0x7f2e640b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e640d00b0 0x7f2e640b3860 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c01a7b0 tx=0x7f2e5c009260 comp rx=0 tx=0).stop 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 shutdown_connections 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e640d00b0 0x7f2e640b3860 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e640c9be0 0x7f2e64159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e40073200 0x7f2e40075710 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 --2- 172.21.15.44:0/4148060222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e6406d5b0 0x7f2e640b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 >> 172.21.15.44:0/4148060222 conn(0x7f2e640cd930 msgr2=0x7f2e64073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:21.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 shutdown_connections 2024-09-17T05:44:21.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.741+0000 7f2e6aa00640 1 -- 172.21.15.44:0/4148060222 wait complete. 2024-09-17T05:44:21.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:44:21.762 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:44:21.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.921+0000 7fc9da000640 1 -- 172.21.15.44:0/2162389120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 msgr2=0x7fc9d415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.921+0000 7fc9da000640 1 --2- 172.21.15.44:0/2162389120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 0x7fc9d415e990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009870 tx=0x7fc9c401c6f0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.921+0000 7fc9da000640 1 -- 172.21.15.44:0/2162389120 shutdown_connections 2024-09-17T05:44:21.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.921+0000 7fc9da000640 1 --2- 172.21.15.44:0/2162389120 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 0x7fc9d415e990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.921+0000 7fc9da000640 1 -- 172.21.15.44:0/2162389120 >> 172.21.15.44:0/2162389120 conn(0x7fc9d40ccaa0 msgr2=0x7fc9d40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:21.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.921+0000 7fc9da000640 1 -- 172.21.15.44:0/2162389120 shutdown_connections 2024-09-17T05:44:21.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.921+0000 7fc9da000640 1 -- 172.21.15.44:0/2162389120 wait complete. 2024-09-17T05:44:21.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 Processor -- start 2024-09-17T05:44:21.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 -- start start 2024-09-17T05:44:21.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9d406de50 0x7fc9d415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 0x7fc9d40c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40cb470 0x7fc9d40c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4169fd0 con 0x7fc9d406de50 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d4169e50 con 0x7fc9d40cb470 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc9d416a150 con 0x7fc9d4072e50 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9d406de50 0x7fc9d415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9d406de50 0x7fc9d415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35148/0 (socket says 172.21.15.44:35148) 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 -- 172.21.15.44:0/1743954435 learned_addr learned my addr 172.21.15.44:0/1743954435 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3e00640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40cb470 0x7fc9d40c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9cbe00640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 0x7fc9d40c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 -- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 msgr2=0x7fc9d40c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 0x7fc9d40c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 -- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40cb470 msgr2=0x7fc9d40c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:21.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40cb470 0x7fc9d40c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:21.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 -- 172.21.15.44:0/1743954435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d40b5cd0 con 0x7fc9d406de50 2024-09-17T05:44:21.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9d3400640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9d406de50 0x7fc9d415a900 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009790 tx=0x7fc9c4005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:21.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9cb400640 1 -- 172.21.15.44:0/1743954435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40ac070 con 0x7fc9d406de50 2024-09-17T05:44:21.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9cb400640 1 -- 172.21.15.44:0/1743954435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c4004ac0 con 0x7fc9d406de50 2024-09-17T05:44:21.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9cb400640 1 -- 172.21.15.44:0/1743954435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc001700 con 0x7fc9d406de50 2024-09-17T05:44:21.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d409d030 con 0x7fc9d406de50 2024-09-17T05:44:21.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.925+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d409d5f0 con 0x7fc9d406de50 2024-09-17T05:44:21.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.929+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d415e990 con 0x7fc9d406de50 2024-09-17T05:44:21.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.929+0000 7fc9cb400640 1 -- 172.21.15.44:0/1743954435 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9c40af070 con 0x7fc9d406de50 2024-09-17T05:44:21.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.929+0000 7fc9cb400640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc9b0073230 0x7fc9b0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:21.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.929+0000 7fc9cb400640 1 -- 172.21.15.44:0/1743954435 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fc9c412e2c0 con 0x7fc9d406de50 2024-09-17T05:44:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.929+0000 7fc9cbe00640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc9b0073230 0x7fc9b0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:21.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.933+0000 7fc9cbe00640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc9b0073230 0x7fc9b0075740 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40b5f70 tx=0x7fc9bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:21.933+0000 7fc9cb400640 1 -- 172.21.15.44:0/1743954435 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc9c40bf070 con 0x7fc9d406de50 2024-09-17T05:44:22.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.109+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9d40b3420 con 0x7fc9b0073230 2024-09-17T05:44:22.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.113+0000 7fc9cb400640 1 -- 172.21.15.44:0/1743954435 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241932 (secure 0 0 0) 0x7fc9d40b3420 con 0x7fc9b0073230 2024-09-17T05:44:22.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:22.117 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc9b0073230 msgr2=0x7fc9b0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc9b0073230 0x7fc9b0075740 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40b5f70 tx=0x7fc9bc009040 comp rx=0 tx=0).stop 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9d406de50 msgr2=0x7fc9d415a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9d406de50 0x7fc9d415a900 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009790 tx=0x7fc9c4005750 comp rx=0 tx=0).stop 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 shutdown_connections 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc9b0073230 0x7fc9b0075740 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40cb470 0x7fc9d40c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc9d4072e50 0x7fc9d40c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 --2- 172.21.15.44:0/1743954435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9d406de50 0x7fc9d415a900 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 >> 172.21.15.44:0/1743954435 conn(0x7fc9d40ccaa0 msgr2=0x7fc9d40a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:22.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 shutdown_connections 2024-09-17T05:44:22.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.117+0000 7fc9da000640 1 -- 172.21.15.44:0/1743954435 wait complete. 2024-09-17T05:44:22.137 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-17T05:44:20.394990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":104,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260464,"kb_used_data":10912,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714256,"statfs":{"total":773094113280,"available":772827398144,"internally_reserved":0,"allocated":11173888,"data_stored":5775740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.486967"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.941899+0000","last_change":"2024-09-17T05:44:17.938762+0000","last_active":"2024-09-17T05:44:17.941899+0000","last_peered":"2024-09-17T05:44:17.941899+0000","last_clean":"2024-09-17T05:44:17.941899+0000","last_became_active":"2024-09-17T05:44:17.938423+0000","last_became_peered":"2024-09-17T05:44:17.938423+0000","last_unstale":"2024-09-17T05:44:17.941899+0000","last_undegraded":"2024-09-17T05:44:17.941899+0000","last_fullsized":"2024-09-17T05:44:17.941899+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:18.056672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.962999+0000","last_change":"2024-09-17T05:44:17.962148+0000","last_active":"2024-09-17T05:44:17.962999+0000","last_peered":"2024-09-17T05:44:17.962999+0000","last_clean":"2024-09-17T05:44:17.962999+0000","last_became_active":"2024-09-17T05:44:17.961788+0000","last_became_peered":"2024-09-17T05:44:17.961788+0000","last_unstale":"2024-09-17T05:44:17.962999+0000","last_undegraded":"2024-09-17T05:44:17.962999+0000","last_fullsized":"2024-09-17T05:44:17.962999+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:09.444287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.938079+0000","last_change":"2024-09-17T05:44:17.936621+0000","last_active":"2024-09-17T05:44:17.938079+0000","last_peered":"2024-09-17T05:44:17.938079+0000","last_clean":"2024-09-17T05:44:17.938079+0000","last_became_active":"2024-09-17T05:44:17.935808+0000","last_became_peered":"2024-09-17T05:44:17.935808+0000","last_unstale":"2024-09-17T05:44:17.938079+0000","last_undegraded":"2024-09-17T05:44:17.938079+0000","last_fullsized":"2024-09-17T05:44:17.938079+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:10.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.945843+0000","last_change":"2024-09-17T05:44:17.942433+0000","last_active":"2024-09-17T05:44:17.945843+0000","last_peered":"2024-09-17T05:44:17.945843+0000","last_clean":"2024-09-17T05:44:17.945843+0000","last_became_active":"2024-09-17T05:44:17.942128+0000","last_became_peered":"2024-09-17T05:44:17.942128+0000","last_unstale":"2024-09-17T05:44:17.945843+0000","last_undegraded":"2024-09-17T05:44:17.945843+0000","last_fullsized":"2024-09-17T05:44:17.945843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:42.612415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.933492+0000","last_change":"2024-09-17T05:44:17.930020+0000","last_active":"2024-09-17T05:44:17.933492+0000","last_peered":"2024-09-17T05:44:17.933492+0000","last_clean":"2024-09-17T05:44:17.933492+0000","last_became_active":"2024-09-17T05:44:17.929674+0000","last_became_peered":"2024-09-17T05:44:17.929674+0000","last_unstale":"2024-09-17T05:44:17.933492+0000","last_undegraded":"2024-09-17T05:44:17.933492+0000","last_fullsized":"2024-09-17T05:44:17.933492+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.914995+0000","last_change":"2024-09-17T05:44:15.914995+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.914995+0000","last_undegraded":"2024-09-17T05:44:15.914995+0000","last_fullsized":"2024-09-17T05:44:15.914995+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.938048+0000","last_change":"2024-09-17T05:44:17.936112+0000","last_active":"2024-09-17T05:44:17.938048+0000","last_peered":"2024-09-17T05:44:17.938048+0000","last_clean":"2024-09-17T05:44:17.938048+0000","last_became_active":"2024-09-17T05:44:17.935380+0000","last_became_peered":"2024-09-17T05:44:17.935380+0000","last_unstale":"2024-09-17T05:44:17.938048+0000","last_undegraded":"2024-09-17T05:44:17.938048+0000","last_fullsized":"2024-09-17T05:44:17.938048+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:34.063143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.918565+0000","last_change":"2024-09-17T05:44:15.918565+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.918565+0000","last_undegraded":"2024-09-17T05:44:15.918565+0000","last_fullsized":"2024-09-17T05:44:15.918565+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.914846+0000","last_change":"2024-09-17T05:44:15.914846+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.914846+0000","last_undegraded":"2024-09-17T05:44:15.914846+0000","last_fullsized":"2024-09-17T05:44:15.914846+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.963691+0000","last_change":"2024-09-17T05:44:16.933691+0000","last_active":"2024-09-17T05:44:17.963691+0000","last_peered":"2024-09-17T05:44:17.963691+0000","last_clean":"2024-09-17T05:44:17.963691+0000","last_became_active":"2024-09-17T05:44:16.933355+0000","last_became_peered":"2024-09-17T05:44:16.933355+0000","last_unstale":"2024-09-17T05:44:17.963691+0000","last_undegraded":"2024-09-17T05:44:17.963691+0000","last_fullsized":"2024-09-17T05:44:17.963691+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:29.456419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.916425+0000","last_change":"2024-09-17T05:44:15.916425+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.916425+0000","last_undegraded":"2024-09-17T05:44:15.916425+0000","last_fullsized":"2024-09-17T05:44:15.916425+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.911977+0000","last_change":"2024-09-17T05:44:15.911977+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.911977+0000","last_undegraded":"2024-09-17T05:44:15.911977+0000","last_fullsized":"2024-09-17T05:44:15.911977+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.911977+0000","last_change":"2024-09-17T05:44:15.911977+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.911977+0000","last_undegraded":"2024-09-17T05:44:15.911977+0000","last_fullsized":"2024-09-17T05:44:15.911977+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.914996+0000","last_change":"2024-09-17T05:44:15.914996+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.914996+0000","last_undegraded":"2024-09-17T05:44:15.914996+0000","last_fullsized":"2024-09-17T05:44:15.914996+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.916839+0000","last_change":"2024-09-17T05:44:15.916839+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.916839+0000","last_undegraded":"2024-09-17T05:44:15.916839+0000","last_fullsized":"2024-09-17T05:44:15.916839+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.922663+0000","last_change":"2024-09-17T05:44:16.937806+0000","last_active":"2024-09-17T05:44:17.922663+0000","last_peered":"2024-09-17T05:44:17.922663+0000","last_clean":"2024-09-17T05:44:17.922663+0000","last_became_active":"2024-09-17T05:44:16.937342+0000","last_became_peered":"2024-09-17T05:44:16.937342+0000","last_unstale":"2024-09-17T05:44:17.922663+0000","last_undegraded":"2024-09-17T05:44:17.922663+0000","last_fullsized":"2024-09-17T05:44:17.922663+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:37.761643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.945738+0000","last_change":"2024-09-17T05:44:17.942228+0000","last_active":"2024-09-17T05:44:17.945738+0000","last_peered":"2024-09-17T05:44:17.945738+0000","last_clean":"2024-09-17T05:44:17.945738+0000","last_became_active":"2024-09-17T05:44:17.941912+0000","last_became_peered":"2024-09-17T05:44:17.941912+0000","last_unstale":"2024-09-17T05:44:17.945738+0000","last_undegraded":"2024-09-17T05:44:17.945738+0000","last_fullsized":"2024-09-17T05:44:17.945738+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:44.273884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.916032+0000","last_change":"2024-09-17T05:44:15.916032+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.916032+0000","last_undegraded":"2024-09-17T05:44:15.916032+0000","last_fullsized":"2024-09-17T05:44:15.916032+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.916033+0000","last_change":"2024-09-17T05:44:15.916033+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.916033+0000","last_undegraded":"2024-09-17T05:44:15.916033+0000","last_fullsized":"2024-09-17T05:44:15.916033+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.910451+0000","last_change":"2024-09-17T05:44:15.910451+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.910451+0000","last_undegraded":"2024-09-17T05:44:15.910451+0000","last_fullsized":"2024-09-17T05:44:15.910451+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.923050+0000","last_change":"2024-09-17T05:44:16.942297+0000","last_active":"2024-09-17T05:44:17.923050+0000","last_peered":"2024-09-17T05:44:17.923050+0000","last_clean":"2024-09-17T05:44:17.923050+0000","last_became_active":"2024-09-17T05:44:16.941999+0000","last_became_peered":"2024-09-17T05:44:16.941999+0000","last_unstale":"2024-09-17T05:44:17.923050+0000","last_undegraded":"2024-09-17T05:44:17.923050+0000","last_fullsized":"2024-09-17T05:44:17.923050+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:03.896494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.910930+0000","last_change":"2024-09-17T05:44:15.910930+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.910930+0000","last_undegraded":"2024-09-17T05:44:15.910930+0000","last_fullsized":"2024-09-17T05:44:15.910930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.916658+0000","last_change":"2024-09-17T05:44:15.916658+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.916658+0000","last_undegraded":"2024-09-17T05:44:15.916658+0000","last_fullsized":"2024-09-17T05:44:15.916658+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.944053+0000","last_change":"2024-09-17T05:44:17.941510+0000","last_active":"2024-09-17T05:44:17.944053+0000","last_peered":"2024-09-17T05:44:17.944053+0000","last_clean":"2024-09-17T05:44:17.944053+0000","last_became_active":"2024-09-17T05:44:17.941168+0000","last_became_peered":"2024-09-17T05:44:17.941168+0000","last_unstale":"2024-09-17T05:44:17.944053+0000","last_undegraded":"2024-09-17T05:44:17.944053+0000","last_fullsized":"2024-09-17T05:44:17.944053+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:42.832614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.916378+0000","last_change":"2024-09-17T05:44:15.916378+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.916378+0000","last_undegraded":"2024-09-17T05:44:15.916378+0000","last_fullsized":"2024-09-17T05:44:15.916378+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.911323+0000","last_change":"2024-09-17T05:44:15.911323+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.911323+0000","last_undegraded":"2024-09-17T05:44:15.911323+0000","last_fullsized":"2024-09-17T05:44:15.911323+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.915706+0000","last_change":"2024-09-17T05:44:15.915706+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.915706+0000","last_undegraded":"2024-09-17T05:44:15.915706+0000","last_fullsized":"2024-09-17T05:44:15.915706+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.917961+0000","last_change":"2024-09-17T05:44:15.917961+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.917961+0000","last_undegraded":"2024-09-17T05:44:15.917961+0000","last_fullsized":"2024-09-17T05:44:15.917961+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.918647+0000","last_change":"2024-09-17T05:44:15.918647+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.918647+0000","last_undegraded":"2024-09-17T05:44:15.918647+0000","last_fullsized":"2024-09-17T05:44:15.918647+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.915123+0000","last_change":"2024-09-17T05:44:15.915123+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.915123+0000","last_undegraded":"2024-09-17T05:44:15.915123+0000","last_fullsized":"2024-09-17T05:44:15.915123+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.923903+0000","last_change":"2024-09-17T05:44:16.945633+0000","last_active":"2024-09-17T05:44:17.923903+0000","last_peered":"2024-09-17T05:44:17.923903+0000","last_clean":"2024-09-17T05:44:17.923903+0000","last_became_active":"2024-09-17T05:44:16.945274+0000","last_became_peered":"2024-09-17T05:44:16.945274+0000","last_unstale":"2024-09-17T05:44:17.923903+0000","last_undegraded":"2024-09-17T05:44:17.923903+0000","last_fullsized":"2024-09-17T05:44:17.923903+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:12.497050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.918029+0000","last_change":"2024-09-17T05:44:15.918029+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.918029+0000","last_undegraded":"2024-09-17T05:44:15.918029+0000","last_fullsized":"2024-09-17T05:44:15.918029+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.917963+0000","last_change":"2024-09-17T05:44:15.917963+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.917963+0000","last_undegraded":"2024-09-17T05:44:15.917963+0000","last_fullsized":"2024-09-17T05:44:15.917963+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.954656+0000","last_change":"2024-09-17T05:44:17.953280+0000","last_active":"2024-09-17T05:44:17.954656+0000","last_peered":"2024-09-17T05:44:17.954656+0000","last_clean":"2024-09-17T05:44:17.954656+0000","last_became_active":"2024-09-17T05:44:17.952980+0000","last_became_peered":"2024-09-17T05:44:17.952980+0000","last_unstale":"2024-09-17T05:44:17.954656+0000","last_undegraded":"2024-09-17T05:44:17.954656+0000","last_fullsized":"2024-09-17T05:44:17.954656+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:33.846050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.917557+0000","last_change":"2024-09-17T05:44:15.917557+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.917557+0000","last_undegraded":"2024-09-17T05:44:15.917557+0000","last_fullsized":"2024-09-17T05:44:15.917557+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.911195+0000","last_change":"2024-09-17T05:44:15.911195+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.911195+0000","last_undegraded":"2024-09-17T05:44:15.911195+0000","last_fullsized":"2024-09-17T05:44:15.911195+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.915885+0000","last_change":"2024-09-17T05:44:15.915885+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.915885+0000","last_undegraded":"2024-09-17T05:44:15.915885+0000","last_fullsized":"2024-09-17T05:44:15.915885+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.917879+0000","last_change":"2024-09-17T05:44:15.917879+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.917879+0000","last_undegraded":"2024-09-17T05:44:15.917879+0000","last_fullsized":"2024-09-17T05:44:15.917879+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.911327+0000","last_change":"2024-09-17T05:44:15.911327+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.911327+0000","last_undegraded":"2024-09-17T05:44:15.911327+0000","last_fullsized":"2024-09-17T05:44:15.911327+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.917862+0000","last_change":"2024-09-17T05:44:15.917862+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.917862+0000","last_undegraded":"2024-09-17T05:44:15.917862+0000","last_fullsized":"2024-09-17T05:44:15.917862+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:44:16.905641+0000","last_change":"2024-09-17T05:44:16.905641+0000","last_active":"2024-09-17T05:44:16.905641+0000","last_peered":"2024-09-17T05:44:16.905641+0000","last_clean":"2024-09-17T05:44:16.905641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:16.905641+0000","last_undegraded":"2024-09-17T05:44:16.905641+0000","last_fullsized":"2024-09-17T05:44:16.905641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-17T05:44:15.911793+0000","last_change":"2024-09-17T05:44:15.911793+0000","last_active":"2024-09-17T05:44:15.901528+0000","last_peered":"2024-09-17T05:44:15.901528+0000","last_clean":"2024-09-17T05:44:15.901528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:44:15.911793+0000","last_undegraded":"2024-09-17T05:44:15.911793+0000","last_fullsized":"2024-09-17T05:44:15.911793+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":266,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-17T05:44:15.909619+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:44:15.909619+0000","last_peered":"2024-09-17T05:44:15.909619+0000","last_clean":"2024-09-17T05:44:15.909619+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:44:15.909619+0000","last_undegraded":"2024-09-17T05:44:15.909619+0000","last_fullsized":"2024-09-17T05:44:15.909619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1245184,"data_stored":572766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1839104,"data_stored":1163134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1245184,"data_stored":572766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1245184,"data_stored":572766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1245184,"data_stored":572766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509542,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32988,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338852,"statfs":{"total":96636764160,"available":96602984448,"internally_reserved":0,"allocated":1839104,"data_stored":1163134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1245184,"data_stored":572766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1269760,"data_stored":585642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:44:22.141 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 -- 172.21.15.44:0/2294650621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00b5880 msgr2=0x7fe6d006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 --2- 172.21.15.44:0/2294650621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00b5880 0x7fe6d006de50 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0072340 tx=0x7fe6c001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 -- 172.21.15.44:0/2294650621 shutdown_connections 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 --2- 172.21.15.44:0/2294650621 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d00ce130 0x7fe6d00ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 --2- 172.21.15.44:0/2294650621 >> v2:172.21.15.86:3300/0 conn(0x7fe6d006e390 0x7fe6d00cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 --2- 172.21.15.44:0/2294650621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00b5880 0x7fe6d006de50 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 -- 172.21.15.44:0/2294650621 >> 172.21.15.44:0/2294650621 conn(0x7fe6d00ccaa0 msgr2=0x7fe6d00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 -- 172.21.15.44:0/2294650621 shutdown_connections 2024-09-17T05:44:22.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 -- 172.21.15.44:0/2294650621 wait complete. 2024-09-17T05:44:22.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 Processor -- start 2024-09-17T05:44:22.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.337+0000 7fe6d6000640 1 -- start start 2024-09-17T05:44:22.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d006e390 0x7fe6d00a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d00b5880 0x7fe6d00a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00ce130 0x7fe6d009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d0070a60 con 0x7fe6d00ce130 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d00708e0 con 0x7fe6d00b5880 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d0070be0 con 0x7fe6d006e390 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00ce130 0x7fe6d009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00ce130 0x7fe6d009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35176/0 (socket says 172.21.15.44:35176) 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 -- 172.21.15.44:0/488044803 learned_addr learned my addr 172.21.15.44:0/488044803 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6c7e00640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d00b5880 0x7fe6d00a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cf400640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d006e390 0x7fe6d00a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 -- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d006e390 msgr2=0x7fe6d00a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d006e390 0x7fe6d00a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 -- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d00b5880 msgr2=0x7fe6d00a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d00b5880 0x7fe6d00a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 -- 172.21.15.44:0/488044803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d0153e30 con 0x7fe6d00ce130 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00ce130 0x7fe6d009aa40 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800e940 tx=0x7fe6c800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6c7400640 1 -- 172.21.15.44:0/488044803 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8004d30 con 0x7fe6d00ce130 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6c7400640 1 -- 172.21.15.44:0/488044803 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c800cb20 con 0x7fe6d00ce130 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6c7400640 1 -- 172.21.15.44:0/488044803 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8005020 con 0x7fe6d00ce130 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d015ea20 con 0x7fe6d00ce130 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d015e140 con 0x7fe6d00ce130 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.341+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d006de50 con 0x7fe6d00ce130 2024-09-17T05:44:22.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.345+0000 7fe6c7400640 1 -- 172.21.15.44:0/488044803 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe6c80051c0 con 0x7fe6d00ce130 2024-09-17T05:44:22.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.345+0000 7fe6c7400640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe6ac073230 0x7fe6ac075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.345+0000 7fe6c7400640 1 -- 172.21.15.44:0/488044803 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fe6c8094be0 con 0x7fe6d00ce130 2024-09-17T05:44:22.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.345+0000 7fe6cf400640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe6ac073230 0x7fe6ac075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.345+0000 7fe6cf400640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe6ac073230 0x7fe6ac075740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00af000 tx=0x7fe6c001b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:22.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.349+0000 7fe6c7400640 1 -- 172.21.15.44:0/488044803 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe6c8016030 con 0x7fe6d00ce130 2024-09-17T05:44:22.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.521+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6d015def0 con 0x7fe6ac073230 2024-09-17T05:44:22.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.525+0000 7fe6c7400640 1 -- 172.21.15.44:0/488044803 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7fe6c00faa50 con 0x7fe6ac073230 2024-09-17T05:44:22.529 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:22.531 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe6ac073230 msgr2=0x7fe6ac075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe6ac073230 0x7fe6ac075740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00af000 tx=0x7fe6c001b100 comp rx=0 tx=0).stop 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00ce130 msgr2=0x7fe6d009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00ce130 0x7fe6d009aa40 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800e940 tx=0x7fe6c800ee00 comp rx=0 tx=0).stop 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 shutdown_connections 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6d00ce130 0x7fe6d009aa40 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe6ac073230 0x7fe6ac075740 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6d00b5880 0x7fe6d00a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 --2- 172.21.15.44:0/488044803 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6d006e390 0x7fe6d00a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 >> 172.21.15.44:0/488044803 conn(0x7fe6d00ccaa0 msgr2=0x7fe6d0156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:22.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 shutdown_connections 2024-09-17T05:44:22.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.529+0000 7fe6d6000640 1 -- 172.21.15.44:0/488044803 wait complete. 2024-09-17T05:44:22.551 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-17T05:44:22.395562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260828,"kb_used_data":11300,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713892,"statfs":{"total":773094113280,"available":772827025408,"internally_reserved":0,"allocated":11571200,"data_stored":5966093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001684"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.945134+0000","last_change":"2024-09-17T05:44:17.941765+0000","last_active":"2024-09-17T05:44:18.945134+0000","last_peered":"2024-09-17T05:44:18.945134+0000","last_clean":"2024-09-17T05:44:18.945134+0000","last_became_active":"2024-09-17T05:44:17.940223+0000","last_became_peered":"2024-09-17T05:44:17.940223+0000","last_unstale":"2024-09-17T05:44:18.945134+0000","last_undegraded":"2024-09-17T05:44:18.945134+0000","last_fullsized":"2024-09-17T05:44:18.945134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:51.463132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.945119+0000","last_change":"2024-09-17T05:44:17.962778+0000","last_active":"2024-09-17T05:44:18.945119+0000","last_peered":"2024-09-17T05:44:18.945119+0000","last_clean":"2024-09-17T05:44:18.945119+0000","last_became_active":"2024-09-17T05:44:17.962428+0000","last_became_peered":"2024-09-17T05:44:17.962428+0000","last_unstale":"2024-09-17T05:44:18.945119+0000","last_undegraded":"2024-09-17T05:44:18.945119+0000","last_fullsized":"2024-09-17T05:44:18.945119+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:37.121447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480951+0000","last_change":"2024-09-17T05:44:17.944276+0000","last_active":"2024-09-17T05:44:19.480951+0000","last_peered":"2024-09-17T05:44:19.480951+0000","last_clean":"2024-09-17T05:44:19.480951+0000","last_became_active":"2024-09-17T05:44:17.943960+0000","last_became_peered":"2024-09-17T05:44:17.943960+0000","last_unstale":"2024-09-17T05:44:19.480951+0000","last_undegraded":"2024-09-17T05:44:19.480951+0000","last_fullsized":"2024-09-17T05:44:19.480951+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:54.849773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944358+0000","last_change":"2024-09-17T05:44:17.961591+0000","last_active":"2024-09-17T05:44:18.944358+0000","last_peered":"2024-09-17T05:44:18.944358+0000","last_clean":"2024-09-17T05:44:18.944358+0000","last_became_active":"2024-09-17T05:44:17.961206+0000","last_became_peered":"2024-09-17T05:44:17.961206+0000","last_unstale":"2024-09-17T05:44:18.944358+0000","last_undegraded":"2024-09-17T05:44:18.944358+0000","last_fullsized":"2024-09-17T05:44:18.944358+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:21.617473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944073+0000","last_change":"2024-09-17T05:44:17.939642+0000","last_active":"2024-09-17T05:44:18.944073+0000","last_peered":"2024-09-17T05:44:18.944073+0000","last_clean":"2024-09-17T05:44:18.944073+0000","last_became_active":"2024-09-17T05:44:17.939268+0000","last_became_peered":"2024-09-17T05:44:17.939268+0000","last_unstale":"2024-09-17T05:44:18.944073+0000","last_undegraded":"2024-09-17T05:44:18.944073+0000","last_fullsized":"2024-09-17T05:44:18.944073+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:25.391427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479720+0000","last_change":"2024-09-17T05:44:17.944163+0000","last_active":"2024-09-17T05:44:19.479720+0000","last_peered":"2024-09-17T05:44:19.479720+0000","last_clean":"2024-09-17T05:44:19.479720+0000","last_became_active":"2024-09-17T05:44:17.937983+0000","last_became_peered":"2024-09-17T05:44:17.937983+0000","last_unstale":"2024-09-17T05:44:19.479720+0000","last_undegraded":"2024-09-17T05:44:19.479720+0000","last_fullsized":"2024-09-17T05:44:19.479720+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:27.924588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479508+0000","last_change":"2024-09-17T05:44:17.954004+0000","last_active":"2024-09-17T05:44:19.479508+0000","last_peered":"2024-09-17T05:44:19.479508+0000","last_clean":"2024-09-17T05:44:19.479508+0000","last_became_active":"2024-09-17T05:44:17.943106+0000","last_became_peered":"2024-09-17T05:44:17.943106+0000","last_unstale":"2024-09-17T05:44:19.479508+0000","last_undegraded":"2024-09-17T05:44:19.479508+0000","last_fullsized":"2024-09-17T05:44:19.479508+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:18.641755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.941899+0000","last_change":"2024-09-17T05:44:17.938762+0000","last_active":"2024-09-17T05:44:17.941899+0000","last_peered":"2024-09-17T05:44:17.941899+0000","last_clean":"2024-09-17T05:44:17.941899+0000","last_became_active":"2024-09-17T05:44:17.938423+0000","last_became_peered":"2024-09-17T05:44:17.938423+0000","last_unstale":"2024-09-17T05:44:17.941899+0000","last_undegraded":"2024-09-17T05:44:17.941899+0000","last_fullsized":"2024-09-17T05:44:17.941899+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:18.056672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.945474+0000","last_change":"2024-09-17T05:44:17.957593+0000","last_active":"2024-09-17T05:44:18.945474+0000","last_peered":"2024-09-17T05:44:18.945474+0000","last_clean":"2024-09-17T05:44:18.945474+0000","last_became_active":"2024-09-17T05:44:17.951864+0000","last_became_peered":"2024-09-17T05:44:17.951864+0000","last_unstale":"2024-09-17T05:44:18.945474+0000","last_undegraded":"2024-09-17T05:44:18.945474+0000","last_fullsized":"2024-09-17T05:44:18.945474+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:31.621847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.962999+0000","last_change":"2024-09-17T05:44:17.962148+0000","last_active":"2024-09-17T05:44:17.962999+0000","last_peered":"2024-09-17T05:44:17.962999+0000","last_clean":"2024-09-17T05:44:17.962999+0000","last_became_active":"2024-09-17T05:44:17.961788+0000","last_became_peered":"2024-09-17T05:44:17.961788+0000","last_unstale":"2024-09-17T05:44:17.962999+0000","last_undegraded":"2024-09-17T05:44:17.962999+0000","last_fullsized":"2024-09-17T05:44:17.962999+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:09.444287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.454040+0000","last_change":"2024-09-17T05:44:17.965573+0000","last_active":"2024-09-17T05:44:19.454040+0000","last_peered":"2024-09-17T05:44:19.454040+0000","last_clean":"2024-09-17T05:44:19.454040+0000","last_became_active":"2024-09-17T05:44:17.965267+0000","last_became_peered":"2024-09-17T05:44:17.965267+0000","last_unstale":"2024-09-17T05:44:19.454040+0000","last_undegraded":"2024-09-17T05:44:19.454040+0000","last_fullsized":"2024-09-17T05:44:19.454040+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:30.209421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479745+0000","last_change":"2024-09-17T05:44:17.945506+0000","last_active":"2024-09-17T05:44:19.479745+0000","last_peered":"2024-09-17T05:44:19.479745+0000","last_clean":"2024-09-17T05:44:19.479745+0000","last_became_active":"2024-09-17T05:44:17.942554+0000","last_became_peered":"2024-09-17T05:44:17.942554+0000","last_unstale":"2024-09-17T05:44:19.479745+0000","last_undegraded":"2024-09-17T05:44:19.479745+0000","last_fullsized":"2024-09-17T05:44:19.479745+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:01.485263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943818+0000","last_change":"2024-09-17T05:44:17.957517+0000","last_active":"2024-09-17T05:44:18.943818+0000","last_peered":"2024-09-17T05:44:18.943818+0000","last_clean":"2024-09-17T05:44:18.943818+0000","last_became_active":"2024-09-17T05:44:17.957125+0000","last_became_peered":"2024-09-17T05:44:17.957125+0000","last_unstale":"2024-09-17T05:44:18.943818+0000","last_undegraded":"2024-09-17T05:44:18.943818+0000","last_fullsized":"2024-09-17T05:44:18.943818+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:10.554978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480039+0000","last_change":"2024-09-17T05:44:17.943903+0000","last_active":"2024-09-17T05:44:19.480039+0000","last_peered":"2024-09-17T05:44:19.480039+0000","last_clean":"2024-09-17T05:44:19.480039+0000","last_became_active":"2024-09-17T05:44:17.938572+0000","last_became_peered":"2024-09-17T05:44:17.938572+0000","last_unstale":"2024-09-17T05:44:19.480039+0000","last_undegraded":"2024-09-17T05:44:19.480039+0000","last_fullsized":"2024-09-17T05:44:19.480039+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:16.454660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944149+0000","last_change":"2024-09-17T05:44:17.950110+0000","last_active":"2024-09-17T05:44:18.944149+0000","last_peered":"2024-09-17T05:44:18.944149+0000","last_clean":"2024-09-17T05:44:18.944149+0000","last_became_active":"2024-09-17T05:44:17.949717+0000","last_became_peered":"2024-09-17T05:44:17.949717+0000","last_unstale":"2024-09-17T05:44:18.944149+0000","last_undegraded":"2024-09-17T05:44:18.944149+0000","last_fullsized":"2024-09-17T05:44:18.944149+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:39.082818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943437+0000","last_change":"2024-09-17T05:44:17.951293+0000","last_active":"2024-09-17T05:44:18.943437+0000","last_peered":"2024-09-17T05:44:18.943437+0000","last_clean":"2024-09-17T05:44:18.943437+0000","last_became_active":"2024-09-17T05:44:17.950995+0000","last_became_peered":"2024-09-17T05:44:17.950995+0000","last_unstale":"2024-09-17T05:44:18.943437+0000","last_undegraded":"2024-09-17T05:44:18.943437+0000","last_fullsized":"2024-09-17T05:44:18.943437+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:53.124284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481108+0000","last_change":"2024-09-17T05:44:17.956519+0000","last_active":"2024-09-17T05:44:19.481108+0000","last_peered":"2024-09-17T05:44:19.481108+0000","last_clean":"2024-09-17T05:44:19.481108+0000","last_became_active":"2024-09-17T05:44:17.955929+0000","last_became_peered":"2024-09-17T05:44:17.955929+0000","last_unstale":"2024-09-17T05:44:19.481108+0000","last_undegraded":"2024-09-17T05:44:19.481108+0000","last_fullsized":"2024-09-17T05:44:19.481108+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:17.780304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.945379+0000","last_change":"2024-09-17T05:44:17.958483+0000","last_active":"2024-09-17T05:44:18.945379+0000","last_peered":"2024-09-17T05:44:18.945379+0000","last_clean":"2024-09-17T05:44:18.945379+0000","last_became_active":"2024-09-17T05:44:17.958141+0000","last_became_peered":"2024-09-17T05:44:17.958141+0000","last_unstale":"2024-09-17T05:44:18.945379+0000","last_undegraded":"2024-09-17T05:44:18.945379+0000","last_fullsized":"2024-09-17T05:44:18.945379+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:34.875498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944484+0000","last_change":"2024-09-17T05:44:17.946903+0000","last_active":"2024-09-17T05:44:18.944484+0000","last_peered":"2024-09-17T05:44:18.944484+0000","last_clean":"2024-09-17T05:44:18.944484+0000","last_became_active":"2024-09-17T05:44:17.946508+0000","last_became_peered":"2024-09-17T05:44:17.946508+0000","last_unstale":"2024-09-17T05:44:18.944484+0000","last_undegraded":"2024-09-17T05:44:18.944484+0000","last_fullsized":"2024-09-17T05:44:18.944484+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:38:46.189692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944063+0000","last_change":"2024-09-17T05:44:17.940248+0000","last_active":"2024-09-17T05:44:18.944063+0000","last_peered":"2024-09-17T05:44:18.944063+0000","last_clean":"2024-09-17T05:44:18.944063+0000","last_became_active":"2024-09-17T05:44:17.939616+0000","last_became_peered":"2024-09-17T05:44:17.939616+0000","last_unstale":"2024-09-17T05:44:18.944063+0000","last_undegraded":"2024-09-17T05:44:18.944063+0000","last_fullsized":"2024-09-17T05:44:18.944063+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:06.294392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481200+0000","last_change":"2024-09-17T05:44:17.937763+0000","last_active":"2024-09-17T05:44:19.481200+0000","last_peered":"2024-09-17T05:44:19.481200+0000","last_clean":"2024-09-17T05:44:19.481200+0000","last_became_active":"2024-09-17T05:44:17.937360+0000","last_became_peered":"2024-09-17T05:44:17.937360+0000","last_unstale":"2024-09-17T05:44:19.481200+0000","last_undegraded":"2024-09-17T05:44:19.481200+0000","last_fullsized":"2024-09-17T05:44:19.481200+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:20.835263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480431+0000","last_change":"2024-09-17T05:44:17.955993+0000","last_active":"2024-09-17T05:44:19.480431+0000","last_peered":"2024-09-17T05:44:19.480431+0000","last_clean":"2024-09-17T05:44:19.480431+0000","last_became_active":"2024-09-17T05:44:17.955675+0000","last_became_peered":"2024-09-17T05:44:17.955675+0000","last_unstale":"2024-09-17T05:44:19.480431+0000","last_undegraded":"2024-09-17T05:44:19.480431+0000","last_fullsized":"2024-09-17T05:44:19.480431+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:05.096889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.938079+0000","last_change":"2024-09-17T05:44:17.936621+0000","last_active":"2024-09-17T05:44:17.938079+0000","last_peered":"2024-09-17T05:44:17.938079+0000","last_clean":"2024-09-17T05:44:17.938079+0000","last_became_active":"2024-09-17T05:44:17.935808+0000","last_became_peered":"2024-09-17T05:44:17.935808+0000","last_unstale":"2024-09-17T05:44:17.938079+0000","last_undegraded":"2024-09-17T05:44:17.938079+0000","last_fullsized":"2024-09-17T05:44:17.938079+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:10.655222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.945843+0000","last_change":"2024-09-17T05:44:17.942433+0000","last_active":"2024-09-17T05:44:17.945843+0000","last_peered":"2024-09-17T05:44:17.945843+0000","last_clean":"2024-09-17T05:44:17.945843+0000","last_became_active":"2024-09-17T05:44:17.942128+0000","last_became_peered":"2024-09-17T05:44:17.942128+0000","last_unstale":"2024-09-17T05:44:17.945843+0000","last_undegraded":"2024-09-17T05:44:17.945843+0000","last_fullsized":"2024-09-17T05:44:17.945843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:42.612415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944342+0000","last_change":"2024-09-17T05:44:17.958492+0000","last_active":"2024-09-17T05:44:18.944342+0000","last_peered":"2024-09-17T05:44:18.944342+0000","last_clean":"2024-09-17T05:44:18.944342+0000","last_became_active":"2024-09-17T05:44:17.958188+0000","last_became_peered":"2024-09-17T05:44:17.958188+0000","last_unstale":"2024-09-17T05:44:18.944342+0000","last_undegraded":"2024-09-17T05:44:18.944342+0000","last_fullsized":"2024-09-17T05:44:18.944342+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:45.810526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944357+0000","last_change":"2024-09-17T05:44:17.968445+0000","last_active":"2024-09-17T05:44:18.944357+0000","last_peered":"2024-09-17T05:44:18.944357+0000","last_clean":"2024-09-17T05:44:18.944357+0000","last_became_active":"2024-09-17T05:44:17.968113+0000","last_became_peered":"2024-09-17T05:44:17.968113+0000","last_unstale":"2024-09-17T05:44:18.944357+0000","last_undegraded":"2024-09-17T05:44:18.944357+0000","last_fullsized":"2024-09-17T05:44:18.944357+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:10.097269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944298+0000","last_change":"2024-09-17T05:44:17.937458+0000","last_active":"2024-09-17T05:44:18.944298+0000","last_peered":"2024-09-17T05:44:18.944298+0000","last_clean":"2024-09-17T05:44:18.944298+0000","last_became_active":"2024-09-17T05:44:17.937108+0000","last_became_peered":"2024-09-17T05:44:17.937108+0000","last_unstale":"2024-09-17T05:44:18.944298+0000","last_undegraded":"2024-09-17T05:44:18.944298+0000","last_fullsized":"2024-09-17T05:44:18.944298+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:56.282833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479829+0000","last_change":"2024-09-17T05:44:17.952450+0000","last_active":"2024-09-17T05:44:19.479829+0000","last_peered":"2024-09-17T05:44:19.479829+0000","last_clean":"2024-09-17T05:44:19.479829+0000","last_became_active":"2024-09-17T05:44:17.952109+0000","last_became_peered":"2024-09-17T05:44:17.952109+0000","last_unstale":"2024-09-17T05:44:19.479829+0000","last_undegraded":"2024-09-17T05:44:19.479829+0000","last_fullsized":"2024-09-17T05:44:19.479829+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:31.872992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.933492+0000","last_change":"2024-09-17T05:44:17.930020+0000","last_active":"2024-09-17T05:44:17.933492+0000","last_peered":"2024-09-17T05:44:17.933492+0000","last_clean":"2024-09-17T05:44:17.933492+0000","last_became_active":"2024-09-17T05:44:17.929674+0000","last_became_peered":"2024-09-17T05:44:17.929674+0000","last_unstale":"2024-09-17T05:44:17.933492+0000","last_undegraded":"2024-09-17T05:44:17.933492+0000","last_fullsized":"2024-09-17T05:44:17.933492+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:39.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453743+0000","last_change":"2024-09-17T05:44:17.965696+0000","last_active":"2024-09-17T05:44:19.453743+0000","last_peered":"2024-09-17T05:44:19.453743+0000","last_clean":"2024-09-17T05:44:19.453743+0000","last_became_active":"2024-09-17T05:44:17.965214+0000","last_became_peered":"2024-09-17T05:44:17.965214+0000","last_unstale":"2024-09-17T05:44:19.453743+0000","last_undegraded":"2024-09-17T05:44:19.453743+0000","last_fullsized":"2024-09-17T05:44:19.453743+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:33.177242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479612+0000","last_change":"2024-09-17T05:44:17.937535+0000","last_active":"2024-09-17T05:44:19.479612+0000","last_peered":"2024-09-17T05:44:19.479612+0000","last_clean":"2024-09-17T05:44:19.479612+0000","last_became_active":"2024-09-17T05:44:17.937212+0000","last_became_peered":"2024-09-17T05:44:17.937212+0000","last_unstale":"2024-09-17T05:44:19.479612+0000","last_undegraded":"2024-09-17T05:44:19.479612+0000","last_fullsized":"2024-09-17T05:44:19.479612+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:11.303894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479612+0000","last_change":"2024-09-17T05:44:17.958074+0000","last_active":"2024-09-17T05:44:19.479612+0000","last_peered":"2024-09-17T05:44:19.479612+0000","last_clean":"2024-09-17T05:44:19.479612+0000","last_became_active":"2024-09-17T05:44:17.957715+0000","last_became_peered":"2024-09-17T05:44:17.957715+0000","last_unstale":"2024-09-17T05:44:19.479612+0000","last_undegraded":"2024-09-17T05:44:19.479612+0000","last_fullsized":"2024-09-17T05:44:19.479612+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:58.064744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479793+0000","last_change":"2024-09-17T05:44:17.943413+0000","last_active":"2024-09-17T05:44:19.479793+0000","last_peered":"2024-09-17T05:44:19.479793+0000","last_clean":"2024-09-17T05:44:19.479793+0000","last_became_active":"2024-09-17T05:44:17.943068+0000","last_became_peered":"2024-09-17T05:44:17.943068+0000","last_unstale":"2024-09-17T05:44:19.479793+0000","last_undegraded":"2024-09-17T05:44:19.479793+0000","last_fullsized":"2024-09-17T05:44:19.479793+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:43.273307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"104'4","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481018+0000","last_change":"2024-09-17T05:44:16.947769+0000","last_active":"2024-09-17T05:44:19.481018+0000","last_peered":"2024-09-17T05:44:19.481018+0000","last_clean":"2024-09-17T05:44:19.481018+0000","last_became_active":"2024-09-17T05:44:16.947436+0000","last_became_peered":"2024-09-17T05:44:16.947436+0000","last_unstale":"2024-09-17T05:44:19.481018+0000","last_undegraded":"2024-09-17T05:44:19.481018+0000","last_fullsized":"2024-09-17T05:44:19.481018+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:56.816650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.938048+0000","last_change":"2024-09-17T05:44:17.936112+0000","last_active":"2024-09-17T05:44:17.938048+0000","last_peered":"2024-09-17T05:44:17.938048+0000","last_clean":"2024-09-17T05:44:17.938048+0000","last_became_active":"2024-09-17T05:44:17.935380+0000","last_became_peered":"2024-09-17T05:44:17.935380+0000","last_unstale":"2024-09-17T05:44:17.938048+0000","last_undegraded":"2024-09-17T05:44:17.938048+0000","last_fullsized":"2024-09-17T05:44:17.938048+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:34.063143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"104'1","reported_seq":16,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481258+0000","last_change":"2024-09-17T05:44:16.941198+0000","last_active":"2024-09-17T05:44:19.481258+0000","last_peered":"2024-09-17T05:44:19.481258+0000","last_clean":"2024-09-17T05:44:19.481258+0000","last_became_active":"2024-09-17T05:44:16.940835+0000","last_became_peered":"2024-09-17T05:44:16.940835+0000","last_unstale":"2024-09-17T05:44:19.481258+0000","last_undegraded":"2024-09-17T05:44:19.481258+0000","last_fullsized":"2024-09-17T05:44:19.481258+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:39.347489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944709+0000","last_change":"2024-09-17T05:44:17.940513+0000","last_active":"2024-09-17T05:44:18.944709+0000","last_peered":"2024-09-17T05:44:18.944709+0000","last_clean":"2024-09-17T05:44:18.944709+0000","last_became_active":"2024-09-17T05:44:17.940137+0000","last_became_peered":"2024-09-17T05:44:17.940137+0000","last_unstale":"2024-09-17T05:44:18.944709+0000","last_undegraded":"2024-09-17T05:44:18.944709+0000","last_fullsized":"2024-09-17T05:44:18.944709+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:40.137253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944910+0000","last_change":"2024-09-17T05:44:16.939231+0000","last_active":"2024-09-17T05:44:18.944910+0000","last_peered":"2024-09-17T05:44:18.944910+0000","last_clean":"2024-09-17T05:44:18.944910+0000","last_became_active":"2024-09-17T05:44:16.938920+0000","last_became_peered":"2024-09-17T05:44:16.938920+0000","last_unstale":"2024-09-17T05:44:18.944910+0000","last_undegraded":"2024-09-17T05:44:18.944910+0000","last_fullsized":"2024-09-17T05:44:18.944910+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:47.203330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453788+0000","last_change":"2024-09-17T05:44:17.956529+0000","last_active":"2024-09-17T05:44:19.453788+0000","last_peered":"2024-09-17T05:44:19.453788+0000","last_clean":"2024-09-17T05:44:19.453788+0000","last_became_active":"2024-09-17T05:44:17.956231+0000","last_became_peered":"2024-09-17T05:44:17.956231+0000","last_unstale":"2024-09-17T05:44:19.453788+0000","last_undegraded":"2024-09-17T05:44:19.453788+0000","last_fullsized":"2024-09-17T05:44:19.453788+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:46.106405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"104'2","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.963691+0000","last_change":"2024-09-17T05:44:16.933691+0000","last_active":"2024-09-17T05:44:17.963691+0000","last_peered":"2024-09-17T05:44:17.963691+0000","last_clean":"2024-09-17T05:44:17.963691+0000","last_became_active":"2024-09-17T05:44:16.933355+0000","last_became_peered":"2024-09-17T05:44:16.933355+0000","last_unstale":"2024-09-17T05:44:17.963691+0000","last_undegraded":"2024-09-17T05:44:17.963691+0000","last_fullsized":"2024-09-17T05:44:17.963691+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:29.456419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944637+0000","last_change":"2024-09-17T05:44:17.940060+0000","last_active":"2024-09-17T05:44:18.944637+0000","last_peered":"2024-09-17T05:44:18.944637+0000","last_clean":"2024-09-17T05:44:18.944637+0000","last_became_active":"2024-09-17T05:44:17.939538+0000","last_became_peered":"2024-09-17T05:44:17.939538+0000","last_unstale":"2024-09-17T05:44:18.944637+0000","last_undegraded":"2024-09-17T05:44:18.944637+0000","last_fullsized":"2024-09-17T05:44:18.944637+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:00.065238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"104'1","reported_seq":16,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453874+0000","last_change":"2024-09-17T05:44:16.944435+0000","last_active":"2024-09-17T05:44:19.453874+0000","last_peered":"2024-09-17T05:44:19.453874+0000","last_clean":"2024-09-17T05:44:19.453874+0000","last_became_active":"2024-09-17T05:44:16.944089+0000","last_became_peered":"2024-09-17T05:44:16.944089+0000","last_unstale":"2024-09-17T05:44:19.453874+0000","last_undegraded":"2024-09-17T05:44:19.453874+0000","last_fullsized":"2024-09-17T05:44:19.453874+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:09.550866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944869+0000","last_change":"2024-09-17T05:44:17.944741+0000","last_active":"2024-09-17T05:44:18.944869+0000","last_peered":"2024-09-17T05:44:18.944869+0000","last_clean":"2024-09-17T05:44:18.944869+0000","last_became_active":"2024-09-17T05:44:17.944443+0000","last_became_peered":"2024-09-17T05:44:17.944443+0000","last_unstale":"2024-09-17T05:44:18.944869+0000","last_undegraded":"2024-09-17T05:44:18.944869+0000","last_fullsized":"2024-09-17T05:44:18.944869+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:52.043499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"104'1","reported_seq":16,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943437+0000","last_change":"2024-09-17T05:44:16.939390+0000","last_active":"2024-09-17T05:44:18.943437+0000","last_peered":"2024-09-17T05:44:18.943437+0000","last_clean":"2024-09-17T05:44:18.943437+0000","last_became_active":"2024-09-17T05:44:16.939088+0000","last_became_peered":"2024-09-17T05:44:16.939088+0000","last_unstale":"2024-09-17T05:44:18.943437+0000","last_undegraded":"2024-09-17T05:44:18.943437+0000","last_fullsized":"2024-09-17T05:44:18.943437+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:16.776191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.454158+0000","last_change":"2024-09-17T05:44:17.955572+0000","last_active":"2024-09-17T05:44:19.454158+0000","last_peered":"2024-09-17T05:44:19.454158+0000","last_clean":"2024-09-17T05:44:19.454158+0000","last_became_active":"2024-09-17T05:44:17.955193+0000","last_became_peered":"2024-09-17T05:44:17.955193+0000","last_unstale":"2024-09-17T05:44:19.454158+0000","last_undegraded":"2024-09-17T05:44:19.454158+0000","last_fullsized":"2024-09-17T05:44:19.454158+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:27.253017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943361+0000","last_change":"2024-09-17T05:44:16.943615+0000","last_active":"2024-09-17T05:44:18.943361+0000","last_peered":"2024-09-17T05:44:18.943361+0000","last_clean":"2024-09-17T05:44:18.943361+0000","last_became_active":"2024-09-17T05:44:16.943259+0000","last_became_peered":"2024-09-17T05:44:16.943259+0000","last_unstale":"2024-09-17T05:44:18.943361+0000","last_undegraded":"2024-09-17T05:44:18.943361+0000","last_fullsized":"2024-09-17T05:44:18.943361+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:42.269194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.945299+0000","last_change":"2024-09-17T05:44:17.936170+0000","last_active":"2024-09-17T05:44:18.945299+0000","last_peered":"2024-09-17T05:44:18.945299+0000","last_clean":"2024-09-17T05:44:18.945299+0000","last_became_active":"2024-09-17T05:44:17.935864+0000","last_became_peered":"2024-09-17T05:44:17.935864+0000","last_unstale":"2024-09-17T05:44:18.945299+0000","last_undegraded":"2024-09-17T05:44:18.945299+0000","last_fullsized":"2024-09-17T05:44:18.945299+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:18.334614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480036+0000","last_change":"2024-09-17T05:44:16.948326+0000","last_active":"2024-09-17T05:44:19.480036+0000","last_peered":"2024-09-17T05:44:19.480036+0000","last_clean":"2024-09-17T05:44:19.480036+0000","last_became_active":"2024-09-17T05:44:16.948018+0000","last_became_peered":"2024-09-17T05:44:16.948018+0000","last_unstale":"2024-09-17T05:44:19.480036+0000","last_undegraded":"2024-09-17T05:44:19.480036+0000","last_fullsized":"2024-09-17T05:44:19.480036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:25.366543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943718+0000","last_change":"2024-09-17T05:44:17.940433+0000","last_active":"2024-09-17T05:44:18.943718+0000","last_peered":"2024-09-17T05:44:18.943718+0000","last_clean":"2024-09-17T05:44:18.943718+0000","last_became_active":"2024-09-17T05:44:17.940049+0000","last_became_peered":"2024-09-17T05:44:17.940049+0000","last_unstale":"2024-09-17T05:44:18.943718+0000","last_undegraded":"2024-09-17T05:44:18.943718+0000","last_fullsized":"2024-09-17T05:44:18.943718+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:11.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479957+0000","last_change":"2024-09-17T05:44:16.932752+0000","last_active":"2024-09-17T05:44:19.479957+0000","last_peered":"2024-09-17T05:44:19.479957+0000","last_clean":"2024-09-17T05:44:19.479957+0000","last_became_active":"2024-09-17T05:44:16.932409+0000","last_became_peered":"2024-09-17T05:44:16.932409+0000","last_unstale":"2024-09-17T05:44:19.479957+0000","last_undegraded":"2024-09-17T05:44:19.479957+0000","last_fullsized":"2024-09-17T05:44:19.479957+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:05.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943776+0000","last_change":"2024-09-17T05:44:17.936560+0000","last_active":"2024-09-17T05:44:18.943776+0000","last_peered":"2024-09-17T05:44:18.943776+0000","last_clean":"2024-09-17T05:44:18.943776+0000","last_became_active":"2024-09-17T05:44:17.935191+0000","last_became_peered":"2024-09-17T05:44:17.935191+0000","last_unstale":"2024-09-17T05:44:18.943776+0000","last_undegraded":"2024-09-17T05:44:18.943776+0000","last_fullsized":"2024-09-17T05:44:18.943776+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:07.550554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.922663+0000","last_change":"2024-09-17T05:44:16.937806+0000","last_active":"2024-09-17T05:44:17.922663+0000","last_peered":"2024-09-17T05:44:17.922663+0000","last_clean":"2024-09-17T05:44:17.922663+0000","last_became_active":"2024-09-17T05:44:16.937342+0000","last_became_peered":"2024-09-17T05:44:16.937342+0000","last_unstale":"2024-09-17T05:44:17.922663+0000","last_undegraded":"2024-09-17T05:44:17.922663+0000","last_fullsized":"2024-09-17T05:44:17.922663+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:37.761643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.945738+0000","last_change":"2024-09-17T05:44:17.942228+0000","last_active":"2024-09-17T05:44:17.945738+0000","last_peered":"2024-09-17T05:44:17.945738+0000","last_clean":"2024-09-17T05:44:17.945738+0000","last_became_active":"2024-09-17T05:44:17.941912+0000","last_became_peered":"2024-09-17T05:44:17.941912+0000","last_unstale":"2024-09-17T05:44:17.945738+0000","last_undegraded":"2024-09-17T05:44:17.945738+0000","last_fullsized":"2024-09-17T05:44:17.945738+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:44.273884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"104'3","reported_seq":18,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479780+0000","last_change":"2024-09-17T05:44:16.935859+0000","last_active":"2024-09-17T05:44:19.479780+0000","last_peered":"2024-09-17T05:44:19.479780+0000","last_clean":"2024-09-17T05:44:19.479780+0000","last_became_active":"2024-09-17T05:44:16.935364+0000","last_became_peered":"2024-09-17T05:44:16.935364+0000","last_unstale":"2024-09-17T05:44:19.479780+0000","last_undegraded":"2024-09-17T05:44:19.479780+0000","last_fullsized":"2024-09-17T05:44:19.479780+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:20.710677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480062+0000","last_change":"2024-09-17T05:44:17.957896+0000","last_active":"2024-09-17T05:44:19.480062+0000","last_peered":"2024-09-17T05:44:19.480062+0000","last_clean":"2024-09-17T05:44:19.480062+0000","last_became_active":"2024-09-17T05:44:17.957563+0000","last_became_peered":"2024-09-17T05:44:17.957563+0000","last_unstale":"2024-09-17T05:44:19.480062+0000","last_undegraded":"2024-09-17T05:44:19.480062+0000","last_fullsized":"2024-09-17T05:44:19.480062+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:23.366913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"104'6","reported_seq":21,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453816+0000","last_change":"2024-09-17T05:44:16.941597+0000","last_active":"2024-09-17T05:44:19.453816+0000","last_peered":"2024-09-17T05:44:19.453816+0000","last_clean":"2024-09-17T05:44:19.453816+0000","last_became_active":"2024-09-17T05:44:16.941279+0000","last_became_peered":"2024-09-17T05:44:16.941279+0000","last_unstale":"2024-09-17T05:44:19.453816+0000","last_undegraded":"2024-09-17T05:44:19.453816+0000","last_fullsized":"2024-09-17T05:44:19.453816+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:01.644855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944857+0000","last_change":"2024-09-17T05:44:17.951751+0000","last_active":"2024-09-17T05:44:18.944857+0000","last_peered":"2024-09-17T05:44:18.944857+0000","last_clean":"2024-09-17T05:44:18.944857+0000","last_became_active":"2024-09-17T05:44:17.950924+0000","last_became_peered":"2024-09-17T05:44:17.950924+0000","last_unstale":"2024-09-17T05:44:18.944857+0000","last_undegraded":"2024-09-17T05:44:18.944857+0000","last_fullsized":"2024-09-17T05:44:18.944857+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:57.037977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943948+0000","last_change":"2024-09-17T05:44:16.933499+0000","last_active":"2024-09-17T05:44:18.943948+0000","last_peered":"2024-09-17T05:44:18.943948+0000","last_clean":"2024-09-17T05:44:18.943948+0000","last_became_active":"2024-09-17T05:44:16.933112+0000","last_became_peered":"2024-09-17T05:44:16.933112+0000","last_unstale":"2024-09-17T05:44:18.943948+0000","last_undegraded":"2024-09-17T05:44:18.943948+0000","last_fullsized":"2024-09-17T05:44:18.943948+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:10.396146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944936+0000","last_change":"2024-09-17T05:44:17.943214+0000","last_active":"2024-09-17T05:44:18.944936+0000","last_peered":"2024-09-17T05:44:18.944936+0000","last_clean":"2024-09-17T05:44:18.944936+0000","last_became_active":"2024-09-17T05:44:17.942909+0000","last_became_peered":"2024-09-17T05:44:17.942909+0000","last_unstale":"2024-09-17T05:44:18.944936+0000","last_undegraded":"2024-09-17T05:44:18.944936+0000","last_fullsized":"2024-09-17T05:44:18.944936+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:52.947508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.923050+0000","last_change":"2024-09-17T05:44:16.942297+0000","last_active":"2024-09-17T05:44:17.923050+0000","last_peered":"2024-09-17T05:44:17.923050+0000","last_clean":"2024-09-17T05:44:17.923050+0000","last_became_active":"2024-09-17T05:44:16.941999+0000","last_became_peered":"2024-09-17T05:44:16.941999+0000","last_unstale":"2024-09-17T05:44:17.923050+0000","last_undegraded":"2024-09-17T05:44:17.923050+0000","last_fullsized":"2024-09-17T05:44:17.923050+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:03.896494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481274+0000","last_change":"2024-09-17T05:44:17.956231+0000","last_active":"2024-09-17T05:44:19.481274+0000","last_peered":"2024-09-17T05:44:19.481274+0000","last_clean":"2024-09-17T05:44:19.481274+0000","last_became_active":"2024-09-17T05:44:17.955933+0000","last_became_peered":"2024-09-17T05:44:17.955933+0000","last_unstale":"2024-09-17T05:44:19.481274+0000","last_undegraded":"2024-09-17T05:44:19.481274+0000","last_fullsized":"2024-09-17T05:44:19.481274+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:57.037977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943650+0000","last_change":"2024-09-17T05:44:16.928909+0000","last_active":"2024-09-17T05:44:18.943650+0000","last_peered":"2024-09-17T05:44:18.943650+0000","last_clean":"2024-09-17T05:44:18.943650+0000","last_became_active":"2024-09-17T05:44:16.928595+0000","last_became_peered":"2024-09-17T05:44:16.928595+0000","last_unstale":"2024-09-17T05:44:18.943650+0000","last_undegraded":"2024-09-17T05:44:18.943650+0000","last_fullsized":"2024-09-17T05:44:18.943650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:16.776191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481370+0000","last_change":"2024-09-17T05:44:17.956238+0000","last_active":"2024-09-17T05:44:19.481370+0000","last_peered":"2024-09-17T05:44:19.481370+0000","last_clean":"2024-09-17T05:44:19.481370+0000","last_became_active":"2024-09-17T05:44:17.955530+0000","last_became_peered":"2024-09-17T05:44:17.955530+0000","last_unstale":"2024-09-17T05:44:19.481370+0000","last_undegraded":"2024-09-17T05:44:19.481370+0000","last_fullsized":"2024-09-17T05:44:19.481370+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:11.400259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"104'8","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453597+0000","last_change":"2024-09-17T05:44:16.944086+0000","last_active":"2024-09-17T05:44:19.453597+0000","last_peered":"2024-09-17T05:44:19.453597+0000","last_clean":"2024-09-17T05:44:19.453597+0000","last_became_active":"2024-09-17T05:44:16.942547+0000","last_became_peered":"2024-09-17T05:44:16.942547+0000","last_unstale":"2024-09-17T05:44:19.453597+0000","last_undegraded":"2024-09-17T05:44:19.453597+0000","last_fullsized":"2024-09-17T05:44:19.453597+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:20.613361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.944053+0000","last_change":"2024-09-17T05:44:17.941510+0000","last_active":"2024-09-17T05:44:17.944053+0000","last_peered":"2024-09-17T05:44:17.944053+0000","last_clean":"2024-09-17T05:44:17.944053+0000","last_became_active":"2024-09-17T05:44:17.941168+0000","last_became_peered":"2024-09-17T05:44:17.941168+0000","last_unstale":"2024-09-17T05:44:17.944053+0000","last_undegraded":"2024-09-17T05:44:17.944053+0000","last_fullsized":"2024-09-17T05:44:17.944053+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:42.832614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"104'1","reported_seq":16,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480004+0000","last_change":"2024-09-17T05:44:16.935836+0000","last_active":"2024-09-17T05:44:19.480004+0000","last_peered":"2024-09-17T05:44:19.480004+0000","last_clean":"2024-09-17T05:44:19.480004+0000","last_became_active":"2024-09-17T05:44:16.935540+0000","last_became_peered":"2024-09-17T05:44:16.935540+0000","last_unstale":"2024-09-17T05:44:19.480004+0000","last_undegraded":"2024-09-17T05:44:19.480004+0000","last_fullsized":"2024-09-17T05:44:19.480004+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:45.257395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943570+0000","last_change":"2024-09-17T05:44:17.953818+0000","last_active":"2024-09-17T05:44:18.943570+0000","last_peered":"2024-09-17T05:44:18.943570+0000","last_clean":"2024-09-17T05:44:18.943570+0000","last_became_active":"2024-09-17T05:44:17.953485+0000","last_became_peered":"2024-09-17T05:44:17.953485+0000","last_unstale":"2024-09-17T05:44:18.943570+0000","last_undegraded":"2024-09-17T05:44:18.943570+0000","last_fullsized":"2024-09-17T05:44:18.943570+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:01.008902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"104'1","reported_seq":16,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944008+0000","last_change":"2024-09-17T05:44:16.946384+0000","last_active":"2024-09-17T05:44:18.944008+0000","last_peered":"2024-09-17T05:44:18.944008+0000","last_clean":"2024-09-17T05:44:18.944008+0000","last_became_active":"2024-09-17T05:44:16.946119+0000","last_became_peered":"2024-09-17T05:44:16.946119+0000","last_unstale":"2024-09-17T05:44:18.944008+0000","last_undegraded":"2024-09-17T05:44:18.944008+0000","last_fullsized":"2024-09-17T05:44:18.944008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:08.433984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479781+0000","last_change":"2024-09-17T05:44:17.947333+0000","last_active":"2024-09-17T05:44:19.479781+0000","last_peered":"2024-09-17T05:44:19.479781+0000","last_clean":"2024-09-17T05:44:19.479781+0000","last_became_active":"2024-09-17T05:44:17.946989+0000","last_became_peered":"2024-09-17T05:44:17.946989+0000","last_unstale":"2024-09-17T05:44:19.479781+0000","last_undegraded":"2024-09-17T05:44:19.479781+0000","last_fullsized":"2024-09-17T05:44:19.479781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:54.293064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479824+0000","last_change":"2024-09-17T05:44:16.937167+0000","last_active":"2024-09-17T05:44:19.479824+0000","last_peered":"2024-09-17T05:44:19.479824+0000","last_clean":"2024-09-17T05:44:19.479824+0000","last_became_active":"2024-09-17T05:44:16.936839+0000","last_became_peered":"2024-09-17T05:44:16.936839+0000","last_unstale":"2024-09-17T05:44:19.479824+0000","last_undegraded":"2024-09-17T05:44:19.479824+0000","last_fullsized":"2024-09-17T05:44:19.479824+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:21.472863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944640+0000","last_change":"2024-09-17T05:44:17.939538+0000","last_active":"2024-09-17T05:44:18.944640+0000","last_peered":"2024-09-17T05:44:18.944640+0000","last_clean":"2024-09-17T05:44:18.944640+0000","last_became_active":"2024-09-17T05:44:17.939111+0000","last_became_peered":"2024-09-17T05:44:17.939111+0000","last_unstale":"2024-09-17T05:44:18.944640+0000","last_undegraded":"2024-09-17T05:44:18.944640+0000","last_fullsized":"2024-09-17T05:44:18.944640+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:18.788268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480618+0000","last_change":"2024-09-17T05:44:16.939151+0000","last_active":"2024-09-17T05:44:19.480618+0000","last_peered":"2024-09-17T05:44:19.480618+0000","last_clean":"2024-09-17T05:44:19.480618+0000","last_became_active":"2024-09-17T05:44:16.938361+0000","last_became_peered":"2024-09-17T05:44:16.938361+0000","last_unstale":"2024-09-17T05:44:19.480618+0000","last_undegraded":"2024-09-17T05:44:19.480618+0000","last_fullsized":"2024-09-17T05:44:19.480618+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:30.617734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480927+0000","last_change":"2024-09-17T05:44:17.951014+0000","last_active":"2024-09-17T05:44:19.480927+0000","last_peered":"2024-09-17T05:44:19.480927+0000","last_clean":"2024-09-17T05:44:19.480927+0000","last_became_active":"2024-09-17T05:44:17.950666+0000","last_became_peered":"2024-09-17T05:44:17.950666+0000","last_unstale":"2024-09-17T05:44:19.480927+0000","last_undegraded":"2024-09-17T05:44:19.480927+0000","last_fullsized":"2024-09-17T05:44:19.480927+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:40.137253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480170+0000","last_change":"2024-09-17T05:44:16.938717+0000","last_active":"2024-09-17T05:44:19.480170+0000","last_peered":"2024-09-17T05:44:19.480170+0000","last_clean":"2024-09-17T05:44:19.480170+0000","last_became_active":"2024-09-17T05:44:16.938328+0000","last_became_peered":"2024-09-17T05:44:16.938328+0000","last_unstale":"2024-09-17T05:44:19.480170+0000","last_undegraded":"2024-09-17T05:44:19.480170+0000","last_fullsized":"2024-09-17T05:44:19.480170+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:36.117334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480995+0000","last_change":"2024-09-17T05:44:17.958297+0000","last_active":"2024-09-17T05:44:19.480995+0000","last_peered":"2024-09-17T05:44:19.480995+0000","last_clean":"2024-09-17T05:44:19.480995+0000","last_became_active":"2024-09-17T05:44:17.957133+0000","last_became_peered":"2024-09-17T05:44:17.957133+0000","last_unstale":"2024-09-17T05:44:19.480995+0000","last_undegraded":"2024-09-17T05:44:19.480995+0000","last_fullsized":"2024-09-17T05:44:19.480995+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:39.082818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479698+0000","last_change":"2024-09-17T05:44:16.934001+0000","last_active":"2024-09-17T05:44:19.479698+0000","last_peered":"2024-09-17T05:44:19.479698+0000","last_clean":"2024-09-17T05:44:19.479698+0000","last_became_active":"2024-09-17T05:44:16.933669+0000","last_became_peered":"2024-09-17T05:44:16.933669+0000","last_unstale":"2024-09-17T05:44:19.479698+0000","last_undegraded":"2024-09-17T05:44:19.479698+0000","last_fullsized":"2024-09-17T05:44:19.479698+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:40.311349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.945194+0000","last_change":"2024-09-17T05:44:17.936351+0000","last_active":"2024-09-17T05:44:18.945194+0000","last_peered":"2024-09-17T05:44:18.945194+0000","last_clean":"2024-09-17T05:44:18.945194+0000","last_became_active":"2024-09-17T05:44:17.935925+0000","last_became_peered":"2024-09-17T05:44:17.935925+0000","last_unstale":"2024-09-17T05:44:18.945194+0000","last_undegraded":"2024-09-17T05:44:18.945194+0000","last_fullsized":"2024-09-17T05:44:18.945194+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:37.330482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.923903+0000","last_change":"2024-09-17T05:44:16.945633+0000","last_active":"2024-09-17T05:44:17.923903+0000","last_peered":"2024-09-17T05:44:17.923903+0000","last_clean":"2024-09-17T05:44:17.923903+0000","last_became_active":"2024-09-17T05:44:16.945274+0000","last_became_peered":"2024-09-17T05:44:16.945274+0000","last_unstale":"2024-09-17T05:44:17.923903+0000","last_undegraded":"2024-09-17T05:44:17.923903+0000","last_fullsized":"2024-09-17T05:44:17.923903+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:12.497050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480552+0000","last_change":"2024-09-17T05:44:17.940227+0000","last_active":"2024-09-17T05:44:19.480552+0000","last_peered":"2024-09-17T05:44:19.480552+0000","last_clean":"2024-09-17T05:44:19.480552+0000","last_became_active":"2024-09-17T05:44:17.939884+0000","last_became_peered":"2024-09-17T05:44:17.939884+0000","last_unstale":"2024-09-17T05:44:19.480552+0000","last_undegraded":"2024-09-17T05:44:19.480552+0000","last_fullsized":"2024-09-17T05:44:19.480552+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:22.414888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481435+0000","last_change":"2024-09-17T05:44:16.936551+0000","last_active":"2024-09-17T05:44:19.481435+0000","last_peered":"2024-09-17T05:44:19.481435+0000","last_clean":"2024-09-17T05:44:19.481435+0000","last_became_active":"2024-09-17T05:44:16.935854+0000","last_became_peered":"2024-09-17T05:44:16.935854+0000","last_unstale":"2024-09-17T05:44:19.481435+0000","last_undegraded":"2024-09-17T05:44:19.481435+0000","last_fullsized":"2024-09-17T05:44:19.481435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:05.606535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453691+0000","last_change":"2024-09-17T05:44:17.965580+0000","last_active":"2024-09-17T05:44:19.453691+0000","last_peered":"2024-09-17T05:44:19.453691+0000","last_clean":"2024-09-17T05:44:19.453691+0000","last_became_active":"2024-09-17T05:44:17.962782+0000","last_became_peered":"2024-09-17T05:44:17.962782+0000","last_unstale":"2024-09-17T05:44:19.453691+0000","last_undegraded":"2024-09-17T05:44:19.453691+0000","last_fullsized":"2024-09-17T05:44:19.453691+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:10.389427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"105'1","reported_seq":16,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.481445+0000","last_change":"2024-09-17T05:44:16.941801+0000","last_active":"2024-09-17T05:44:19.481445+0000","last_peered":"2024-09-17T05:44:19.481445+0000","last_clean":"2024-09-17T05:44:19.481445+0000","last_became_active":"2024-09-17T05:44:16.940164+0000","last_became_peered":"2024-09-17T05:44:16.940164+0000","last_unstale":"2024-09-17T05:44:19.481445+0000","last_undegraded":"2024-09-17T05:44:19.481445+0000","last_fullsized":"2024-09-17T05:44:19.481445+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:50.631115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":10,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-17T05:44:17.954656+0000","last_change":"2024-09-17T05:44:17.953280+0000","last_active":"2024-09-17T05:44:17.954656+0000","last_peered":"2024-09-17T05:44:17.954656+0000","last_clean":"2024-09-17T05:44:17.954656+0000","last_became_active":"2024-09-17T05:44:17.952980+0000","last_became_peered":"2024-09-17T05:44:17.952980+0000","last_unstale":"2024-09-17T05:44:17.954656+0000","last_undegraded":"2024-09-17T05:44:17.954656+0000","last_fullsized":"2024-09-17T05:44:17.954656+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:33.846050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453964+0000","last_change":"2024-09-17T05:44:16.938879+0000","last_active":"2024-09-17T05:44:19.453964+0000","last_peered":"2024-09-17T05:44:19.453964+0000","last_clean":"2024-09-17T05:44:19.453964+0000","last_became_active":"2024-09-17T05:44:16.938423+0000","last_became_peered":"2024-09-17T05:44:16.938423+0000","last_unstale":"2024-09-17T05:44:19.453964+0000","last_undegraded":"2024-09-17T05:44:19.453964+0000","last_fullsized":"2024-09-17T05:44:19.453964+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:06.546441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943919+0000","last_change":"2024-09-17T05:44:17.943949+0000","last_active":"2024-09-17T05:44:18.943919+0000","last_peered":"2024-09-17T05:44:18.943919+0000","last_clean":"2024-09-17T05:44:18.943919+0000","last_became_active":"2024-09-17T05:44:17.943613+0000","last_became_peered":"2024-09-17T05:44:17.943613+0000","last_unstale":"2024-09-17T05:44:18.943919+0000","last_undegraded":"2024-09-17T05:44:18.943919+0000","last_fullsized":"2024-09-17T05:44:18.943919+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:33.495902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944730+0000","last_change":"2024-09-17T05:44:16.935178+0000","last_active":"2024-09-17T05:44:18.944730+0000","last_peered":"2024-09-17T05:44:18.944730+0000","last_clean":"2024-09-17T05:44:18.944730+0000","last_became_active":"2024-09-17T05:44:16.934866+0000","last_became_peered":"2024-09-17T05:44:16.934866+0000","last_unstale":"2024-09-17T05:44:18.944730+0000","last_undegraded":"2024-09-17T05:44:18.944730+0000","last_fullsized":"2024-09-17T05:44:18.944730+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:19.831150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944400+0000","last_change":"2024-09-17T05:44:17.943827+0000","last_active":"2024-09-17T05:44:18.944400+0000","last_peered":"2024-09-17T05:44:18.944400+0000","last_clean":"2024-09-17T05:44:18.944400+0000","last_became_active":"2024-09-17T05:44:17.943369+0000","last_became_peered":"2024-09-17T05:44:17.943369+0000","last_unstale":"2024-09-17T05:44:18.944400+0000","last_undegraded":"2024-09-17T05:44:18.944400+0000","last_fullsized":"2024-09-17T05:44:18.944400+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:02.648968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.453868+0000","last_change":"2024-09-17T05:44:16.944205+0000","last_active":"2024-09-17T05:44:19.453868+0000","last_peered":"2024-09-17T05:44:19.453868+0000","last_clean":"2024-09-17T05:44:19.453868+0000","last_became_active":"2024-09-17T05:44:16.943885+0000","last_became_peered":"2024-09-17T05:44:16.943885+0000","last_unstale":"2024-09-17T05:44:19.453868+0000","last_undegraded":"2024-09-17T05:44:19.453868+0000","last_fullsized":"2024-09-17T05:44:19.453868+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:24.387314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944587+0000","last_change":"2024-09-17T05:44:17.940772+0000","last_active":"2024-09-17T05:44:18.944587+0000","last_peered":"2024-09-17T05:44:18.944587+0000","last_clean":"2024-09-17T05:44:18.944587+0000","last_became_active":"2024-09-17T05:44:17.940444+0000","last_became_peered":"2024-09-17T05:44:17.940444+0000","last_unstale":"2024-09-17T05:44:18.944587+0000","last_undegraded":"2024-09-17T05:44:18.944587+0000","last_fullsized":"2024-09-17T05:44:18.944587+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:20.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480311+0000","last_change":"2024-09-17T05:44:16.936047+0000","last_active":"2024-09-17T05:44:19.480311+0000","last_peered":"2024-09-17T05:44:19.480311+0000","last_clean":"2024-09-17T05:44:19.480311+0000","last_became_active":"2024-09-17T05:44:16.934451+0000","last_became_peered":"2024-09-17T05:44:16.934451+0000","last_unstale":"2024-09-17T05:44:19.480311+0000","last_undegraded":"2024-09-17T05:44:19.480311+0000","last_fullsized":"2024-09-17T05:44:19.480311+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:33.871385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480079+0000","last_change":"2024-09-17T05:44:17.951735+0000","last_active":"2024-09-17T05:44:19.480079+0000","last_peered":"2024-09-17T05:44:19.480079+0000","last_clean":"2024-09-17T05:44:19.480079+0000","last_became_active":"2024-09-17T05:44:17.951389+0000","last_became_peered":"2024-09-17T05:44:17.951389+0000","last_unstale":"2024-09-17T05:44:19.480079+0000","last_undegraded":"2024-09-17T05:44:19.480079+0000","last_fullsized":"2024-09-17T05:44:19.480079+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:17.564813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943430+0000","last_change":"2024-09-17T05:44:16.937060+0000","last_active":"2024-09-17T05:44:18.943430+0000","last_peered":"2024-09-17T05:44:18.943430+0000","last_clean":"2024-09-17T05:44:18.943430+0000","last_became_active":"2024-09-17T05:44:16.936766+0000","last_became_peered":"2024-09-17T05:44:16.936766+0000","last_unstale":"2024-09-17T05:44:18.943430+0000","last_undegraded":"2024-09-17T05:44:18.943430+0000","last_fullsized":"2024-09-17T05:44:18.943430+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:53.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.945584+0000","last_change":"2024-09-17T05:44:17.966282+0000","last_active":"2024-09-17T05:44:18.945584+0000","last_peered":"2024-09-17T05:44:18.945584+0000","last_clean":"2024-09-17T05:44:18.945584+0000","last_became_active":"2024-09-17T05:44:17.965571+0000","last_became_peered":"2024-09-17T05:44:17.965571+0000","last_unstale":"2024-09-17T05:44:18.945584+0000","last_undegraded":"2024-09-17T05:44:18.945584+0000","last_fullsized":"2024-09-17T05:44:18.945584+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:40.351602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.479124+0000","last_change":"2024-09-17T05:44:16.941693+0000","last_active":"2024-09-17T05:44:19.479124+0000","last_peered":"2024-09-17T05:44:19.479124+0000","last_clean":"2024-09-17T05:44:19.479124+0000","last_became_active":"2024-09-17T05:44:16.941228+0000","last_became_peered":"2024-09-17T05:44:16.941228+0000","last_unstale":"2024-09-17T05:44:19.479124+0000","last_undegraded":"2024-09-17T05:44:19.479124+0000","last_fullsized":"2024-09-17T05:44:19.479124+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:51.943395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:19.480098+0000","last_change":"2024-09-17T05:44:17.953528+0000","last_active":"2024-09-17T05:44:19.480098+0000","last_peered":"2024-09-17T05:44:19.480098+0000","last_clean":"2024-09-17T05:44:19.480098+0000","last_became_active":"2024-09-17T05:44:17.943130+0000","last_became_peered":"2024-09-17T05:44:17.943130+0000","last_unstale":"2024-09-17T05:44:19.480098+0000","last_undegraded":"2024-09-17T05:44:19.480098+0000","last_fullsized":"2024-09-17T05:44:19.480098+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:16.905641+0000","last_clean_scrub_stamp":"2024-09-17T05:44:16.905641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:08.883903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"104'2","reported_seq":17,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.944796+0000","last_change":"2024-09-17T05:44:16.939169+0000","last_active":"2024-09-17T05:44:18.944796+0000","last_peered":"2024-09-17T05:44:18.944796+0000","last_clean":"2024-09-17T05:44:18.944796+0000","last_became_active":"2024-09-17T05:44:16.938228+0000","last_became_peered":"2024-09-17T05:44:16.938228+0000","last_unstale":"2024-09-17T05:44:18.944796+0000","last_undegraded":"2024-09-17T05:44:18.944796+0000","last_fullsized":"2024-09-17T05:44:18.944796+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:44:15.901528+0000","last_clean_scrub_stamp":"2024-09-17T05:44:15.901528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:53.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-09-17T05:44:18.943250+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:44:18.943250+0000","last_peered":"2024-09-17T05:44:18.943250+0000","last_clean":"2024-09-17T05:44:18.943250+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:44:18.943250+0000","last_undegraded":"2024-09-17T05:44:18.943250+0000","last_fullsized":"2024-09-17T05:44:18.943250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1302528,"data_stored":600153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":1189993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509541,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1298432,"data_stored":599535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509542,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1306624,"data_stored":601113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1302528,"data_stored":599613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":1189961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509543,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1298432,"data_stored":600083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1269760,"data_stored":585642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:44:22.556 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:44:22.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:44:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.761+0000 7f9deb800640 1 -- 172.21.15.44:0/1771896414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dcc004da0 msgr2=0x7f9dcc005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.761+0000 7f9deb800640 1 --2- 172.21.15.44:0/1771896414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9dcc004da0 0x7f9dcc005230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9de40af7f0 tx=0x7f9ddc01f390 comp rx=0 tx=0).stop 2024-09-17T05:44:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.761+0000 7f9de9800640 1 -- 172.21.15.44:0/1771896414 reap_dead start 2024-09-17T05:44:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.761+0000 7f9deb800640 1 -- 172.21.15.44:0/1771896414 shutdown_connections 2024-09-17T05:44:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.761+0000 7f9deb800640 1 -- 172.21.15.44:0/1771896414 >> 172.21.15.44:0/1771896414 conn(0x7f9de40ccaa0 msgr2=0x7f9de40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.761+0000 7f9deb800640 1 -- 172.21.15.44:0/1771896414 shutdown_connections 2024-09-17T05:44:22.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.761+0000 7f9deb800640 1 -- 172.21.15.44:0/1771896414 wait complete. 2024-09-17T05:44:22.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 Processor -- start 2024-09-17T05:44:22.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 -- start start 2024-09-17T05:44:22.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dcc004da0 0x7f9de41e9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de409aa40 0x7f9de41e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9de41f6a10 0x7f9de41f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9de40cbf90 con 0x7f9de409aa40 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9de415ec80 con 0x7f9dcc004da0 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9deb800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9de40cc110 con 0x7f9de41f6a10 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de409aa40 0x7f9de41e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de409aa40 0x7f9de41e98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35182/0 (socket says 172.21.15.44:35182) 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 -- 172.21.15.44:0/2187571535 learned_addr learned my addr 172.21.15.44:0/2187571535 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de8e00640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dcc004da0 0x7f9de41e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de9800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9de41f6a10 0x7f9de41f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 -- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9de41f6a10 msgr2=0x7f9de41f97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9de41f6a10 0x7f9de41f97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 -- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dcc004da0 msgr2=0x7f9de41e9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:22.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dcc004da0 0x7f9de41e9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 -- 172.21.15.44:0/2187571535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de409b1e0 con 0x7f9de409aa40 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de9800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9de41f6a10 0x7f9de41f97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de3e00640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de409aa40 0x7f9de41e98d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0006450 tx=0x7f9dd00039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.765+0000 7f9de0c00640 1 -- 172.21.15.44:0/2187571535 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0015070 con 0x7f9de409aa40 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9de0c00640 1 -- 172.21.15.44:0/2187571535 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dd0011840 con 0x7f9de409aa40 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de41f5f30 con 0x7f9de409aa40 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9de0c00640 1 -- 172.21.15.44:0/2187571535 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011c90 con 0x7f9de409aa40 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de409b4c0 con 0x7f9de409aa40 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de409af50 con 0x7f9de409aa40 2024-09-17T05:44:22.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9de0c00640 1 -- 172.21.15.44:0/2187571535 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9dd0018070 con 0x7f9de409aa40 2024-09-17T05:44:22.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9de0c00640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9dc4073200 0x7f9dc4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:22.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9de0c00640 1 -- 172.21.15.44:0/2187571535 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f9dd0094fc0 con 0x7f9de409aa40 2024-09-17T05:44:22.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.769+0000 7f9de8e00640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9dc4073200 0x7f9dc4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:22.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.773+0000 7f9de8e00640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9dc4073200 0x7f9dc4075710 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009c60 tx=0x7f9dd80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:22.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:22.773+0000 7f9de0c00640 1 -- 172.21.15.44:0/2187571535 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9dd005fed0 con 0x7f9de409aa40 2024-09-17T05:44:23.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.017+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9de40cc6a0 con 0x7f9de409aa40 2024-09-17T05:44:23.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9de0c00640 1 -- 172.21.15.44:0/2187571535 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f9dd005f7d0 con 0x7f9de409aa40 2024-09-17T05:44:23.021 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:44:23.021 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:44:23.021 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-09-17T05:44:23.021 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-09-17T05:44:23.021 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:44:23.021 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9dc4073200 msgr2=0x7f9dc4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9dc4073200 0x7f9dc4075710 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009c60 tx=0x7f9dd80091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de409aa40 msgr2=0x7f9de41e98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de409aa40 0x7f9de41e98d0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0006450 tx=0x7f9dd00039d0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 shutdown_connections 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9de41f6a10 0x7f9de41f97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9de409aa40 0x7f9de41e98d0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9dc4073200 0x7f9dc4075710 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 --2- 172.21.15.44:0/2187571535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9dcc004da0 0x7f9de41e9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.021+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 >> 172.21.15.44:0/2187571535 conn(0x7f9de40ccaa0 msgr2=0x7f9de409fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.025+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 shutdown_connections 2024-09-17T05:44:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.025+0000 7f9deb800640 1 -- 172.21.15.44:0/2187571535 wait complete. 2024-09-17T05:44:23.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:23.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 -- 172.21.15.44:0/529756463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c0ccd30 msgr2=0x7f838c072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:23.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 --2- 172.21.15.44:0/529756463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c0ccd30 0x7f838c072b10 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f838c0cd2f0 tx=0x7f837401c5b0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 -- 172.21.15.44:0/529756463 shutdown_connections 2024-09-17T05:44:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 --2- 172.21.15.44:0/529756463 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f838c073050 0x7f838c143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 --2- 172.21.15.44:0/529756463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c0ccd30 0x7f838c072b10 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 --2- 172.21.15.44:0/529756463 >> v2:172.21.15.86:3300/0 conn(0x7f838c156b90 0x7f838c0cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 -- 172.21.15.44:0/529756463 >> 172.21.15.44:0/529756463 conn(0x7f838c0d2450 msgr2=0x7f838c0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 -- 172.21.15.44:0/529756463 shutdown_connections 2024-09-17T05:44:23.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.201+0000 7f838be00640 1 -- 172.21.15.44:0/529756463 wait complete. 2024-09-17T05:44:23.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 Processor -- start 2024-09-17T05:44:23.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 -- start start 2024-09-17T05:44:23.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c073050 0x7f838c0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:23.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f838c0ccd30 0x7f838c152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:23.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f838c156b90 0x7f838c15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:23.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f838c160930 con 0x7f838c073050 2024-09-17T05:44:23.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f838c1607b0 con 0x7f838c0ccd30 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838be00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f838c160ab0 con 0x7f838c156b90 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c073050 0x7f838c0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c073050 0x7f838c0c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35200/0 (socket says 172.21.15.44:35200) 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838aa00640 1 -- 172.21.15.44:0/3003912064 learned_addr learned my addr 172.21.15.44:0/3003912064 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f838b400640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f838c156b90 0x7f838c15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.205+0000 7f8382000640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f838c0ccd30 0x7f838c152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838aa00640 1 -- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f838c156b90 msgr2=0x7f838c15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838aa00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f838c156b90 0x7f838c15b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838aa00640 1 -- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f838c0ccd30 msgr2=0x7f838c152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838aa00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f838c0ccd30 0x7f838c152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838aa00640 1 -- 172.21.15.44:0/3003912064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c0c6cb0 con 0x7f838c073050 2024-09-17T05:44:23.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838aa00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c073050 0x7f838c0c86e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f837c00e970 tx=0x7f837c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:23.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f8383e00640 1 -- 172.21.15.44:0/3003912064 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c00cd80 con 0x7f838c073050 2024-09-17T05:44:23.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f8383e00640 1 -- 172.21.15.44:0/3003912064 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f837c004020 con 0x7f838c073050 2024-09-17T05:44:23.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c0c6f90 con 0x7f838c073050 2024-09-17T05:44:23.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f8383e00640 1 -- 172.21.15.44:0/3003912064 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c004470 con 0x7f838c073050 2024-09-17T05:44:23.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c06e6b0 con 0x7f838c073050 2024-09-17T05:44:23.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c072b10 con 0x7f838c073050 2024-09-17T05:44:23.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f8383e00640 1 -- 172.21.15.44:0/3003912064 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f837c003600 con 0x7f838c073050 2024-09-17T05:44:23.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.209+0000 7f8383e00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8368073200 0x7f8368075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:23.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.213+0000 7f8383e00640 1 -- 172.21.15.44:0/3003912064 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f837c094cb0 con 0x7f838c073050 2024-09-17T05:44:23.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.213+0000 7f8382000640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8368073200 0x7f8368075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:23.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.213+0000 7f8382000640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8368073200 0x7f8368075710 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f83740ae000 tx=0x7f837401adf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.217+0000 7f8383e00640 1 -- 172.21.15.44:0/3003912064 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f837c05fb30 con 0x7f838c073050 2024-09-17T05:44:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.425+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f838c145ef0 con 0x7f838c073050 2024-09-17T05:44:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.425+0000 7f8383e00640 1 -- 172.21.15.44:0/3003912064 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7f837c05f430 con 0x7f838c073050 2024-09-17T05:44:23.425 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:23.425 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"btime":"2024-09-17T05:44:20:951293+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:44:20.372604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3953022133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3953022133},{"type":"v1","addr":"172.21.15.44:6835","nonce":3953022133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7662,"qdb_cluster":[7662]},"id":7}]} 2024-09-17T05:44:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 84 2024-09-17T05:44:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8368073200 msgr2=0x7f8368075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8368073200 0x7f8368075710 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f83740ae000 tx=0x7f837401adf0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c073050 msgr2=0x7f838c0c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c073050 0x7f838c0c86e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f837c00e970 tx=0x7f837c00ee30 comp rx=0 tx=0).stop 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 shutdown_connections 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f838c156b90 0x7f838c15b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8368073200 0x7f8368075710 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f838c0ccd30 0x7f838c152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 --2- 172.21.15.44:0/3003912064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f838c073050 0x7f838c0c86e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 >> 172.21.15.44:0/3003912064 conn(0x7f838c0d2450 msgr2=0x7f838c15dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 shutdown_connections 2024-09-17T05:44:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:23.429+0000 7f838be00640 1 -- 172.21.15.44:0/3003912064 wait complete. 2024-09-17T05:44:23.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:44:17.352549+0000', 'modified': '2024-09-17T05:44:20.372604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7662}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7662': {'gid': 7662, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/3953022133', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 3953022133}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3953022133}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7662, 'qdb_cluster': [7662]} 2024-09-17T05:44:23.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:44:23.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 -- 172.21.15.44:0/1215815442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc006ce40 msgr2=0x7fbcc00cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 --2- 172.21.15.44:0/1215815442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc006ce40 0x7fbcc00cbca0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009840 tx=0x7fbca801c820 comp rx=0 tx=0).stop 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 -- 172.21.15.44:0/1215815442 shutdown_connections 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 --2- 172.21.15.44:0/1215815442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc006ce40 0x7fbcc00cbca0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 --2- 172.21.15.44:0/1215815442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc015d560 0x7fbcc015a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 -- 172.21.15.44:0/1215815442 >> 172.21.15.44:0/1215815442 conn(0x7fbcc00cd930 msgr2=0x7fbcc00cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 -- 172.21.15.44:0/1215815442 shutdown_connections 2024-09-17T05:44:24.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.013+0000 7fbcc6800640 1 -- 172.21.15.44:0/1215815442 wait complete. 2024-09-17T05:44:24.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 Processor -- start 2024-09-17T05:44:24.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 -- start start 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc006ce40 0x7fbcc0153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc00cc1e0 0x7fbcc0154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc015d560 0x7fbcc0145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0169e00 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0169c80 con 0x7fbcc006ce40 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcc6800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc0169f80 con 0x7fbcc015d560 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc00cc1e0 0x7fbcc0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.017+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc00cc1e0 0x7fbcc0154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35224/0 (socket says 172.21.15.44:35224) 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7e00640 1 -- 172.21.15.44:0/2584780530 learned_addr learned my addr 172.21.15.44:0/2584780530 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcbf400640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc006ce40 0x7fbcc0153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcbfe00640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc015d560 0x7fbcc0145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7e00640 1 -- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc015d560 msgr2=0x7fbcc0145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc015d560 0x7fbcc0145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7e00640 1 -- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc006ce40 msgr2=0x7fbcc0153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc006ce40 0x7fbcc0153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7e00640 1 -- 172.21.15.44:0/2584780530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc0153c80 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc00cc1e0 0x7fbcc0154610 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fbca801aed0 tx=0x7fbca80a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7400640 1 -- 172.21.15.44:0/2584780530 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8004380 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7400640 1 -- 172.21.15.44:0/2584780530 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbca80bc070 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7400640 1 -- 172.21.15.44:0/2584780530 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca80052d0 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc0153f20 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc01fc430 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.021+0000 7fbcb7400640 1 -- 172.21.15.44:0/2584780530 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbca8005470 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcb7400640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc9c073230 0x7fbc9c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcb7400640 1 -- 172.21.15.44:0/2584780530 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fbca812f0d0 con 0x7fbcc00cc1e0 2024-09-17T05:44:24.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc9c073230 0x7fbc9c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 Processor -- start 2024-09-17T05:44:24.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 -- start start 2024-09-17T05:44:24.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc9c073230 0x7fbc9c075740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009b40 tx=0x7fbcb00091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b5096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3b8950 0x55d94b509be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 0x55d94b50a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d94b3de410 con 0x55d94b3b8950 2024-09-17T05:44:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d94b31bb40 con 0x55d94b3a1ca0 2024-09-17T05:44:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55d94b30af70 con 0x55d94afc8460 2024-09-17T05:44:24.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b5096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3b8950 0x55d94b509be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b5096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:47288/0 (socket says 172.21.15.44:47288) 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 -- 172.21.15.44:0/2214782518 learned_addr learned my addr 172.21.15.44:0/2214782518 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3b8950 0x55d94b509be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35238/0 (socket says 172.21.15.44:35238) 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbfe00640 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 0x55d94b50a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 -- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 msgr2=0x55d94b50a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 0x55d94b50a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 -- 172.21.15.44:0/2214782518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3b8950 msgr2=0x55d94b509be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3b8950 0x55d94b509be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 -- 172.21.15.44:0/2214782518 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d94b2d25b0 con 0x55d94afc8460 2024-09-17T05:44:24.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3b8950 0x55d94b509be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:24.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.025+0000 7fbcbf400640 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b5096a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0011e60 tx=0x7fbcb0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=addcc2f939988681 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbcafe00640 1 -- 172.21.15.44:0/2214782518 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb000ebf0 con 0x55d94afc8460 2024-09-17T05:44:24.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbcafe00640 1 -- 172.21.15.44:0/2214782518 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcb0004020 con 0x55d94afc8460 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbcafe00640 1 -- 172.21.15.44:0/2214782518 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0004410 con 0x55d94afc8460 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 -- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 msgr2=0x55d94b5096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b5096a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0011e60 tx=0x7fbcb0014000 comp rx=0 tx=0).stop 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 -- 172.21.15.44:0/2214782518 shutdown_connections 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 0x55d94b50a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3b8950 0x55d94b509be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/2214782518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b5096a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 -- 172.21.15.44:0/2214782518 >> 172.21.15.44:0/2214782518 conn(0x55d94b48ed90 msgr2=0x55d94b4be690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 -- 172.21.15.44:0/2214782518 shutdown_connections 2024-09-17T05:44:24.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 -- 172.21.15.44:0/2214782518 wait complete. 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 -- start start 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.029+0000 7fbccdf0d000 1 Processor -- start 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94afc8460 0x55d94b510920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b510e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 0x55d94b5113a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d94b2a55f0 con 0x55d94b3a1ca0 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d94b30ed80 con 0x55d94afc8460 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55d94b2b1520 con 0x55d94b3b8950 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 10 client.0 _ll_register_callbacks cb 0x55d94b2b5830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b510e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b510e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35242/0 (socket says 172.21.15.44:35242) 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 -- 172.21.15.44:0/1752517865 learned_addr learned my addr 172.21.15.44:0/1752517865 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcbf400640 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94afc8460 0x55d94b510920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcbfe00640 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 0x55d94b5113a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 -- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 msgr2=0x55d94b5113a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 0x55d94b5113a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 -- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94afc8460 msgr2=0x55d94b510920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94afc8460 0x55d94b510920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 -- 172.21.15.44:0/1752517865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d94b2a9190 con 0x55d94b3a1ca0 2024-09-17T05:44:24.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b510e60 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009840 tx=0x7fbca80f9dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ed0c5631d5e5df server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:24.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 1 -- 172.21.15.44:0/1752517865 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca80f9380 con 0x55d94b3a1ca0 2024-09-17T05:44:24.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 1 -- 172.21.15.44:0/1752517865 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fbca811ec70 con 0x55d94b3a1ca0 2024-09-17T05:44:24.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d94b2a3110 con 0x55d94b3a1ca0 2024-09-17T05:44:24.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 1 -- 172.21.15.44:0/1752517865 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fbca80f9870 con 0x55d94b3a1ca0 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 10 client.7776 fetch_fsmap learned FSMap version 84 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d94b38ff10 con 0x55d94b3a1ca0 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 1 -- 172.21.15.44:0/1752517865 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55d94b2a3110 con 0x55d94b3a1ca0 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 1 -- 172.21.15.44:0/1752517865 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fbca80f51c0 con 0x55d94b3a1ca0 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 10 client.7776 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 10 client.7776 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 20 client.7776 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94afad7d0 0x55d94b51ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 4 client.7776 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d94b31da90 con 0x55d94afad7d0 2024-09-17T05:44:24.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcbf400640 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94afad7d0 0x55d94b51ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 10 client.7776 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcbf400640 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94afad7d0 0x55d94b51ad00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e43cc98914b718da server_cookie=12c0186ab80624d1 in_seq=0 out_seq=0 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 1 -- 172.21.15.44:0/1752517865 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d94b31da90 con 0x55d94afad7d0 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbcacc00640 10 client.7776 handle_command_reply: tid=0 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.033+0000 7fbccdf0d000 1 client.7776 shutdown 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 msgr2=0x55d94b510e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b510e60 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009840 tx=0x7fbca80f9dc0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 shutdown_connections 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94afad7d0 0x55d94b51ad00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 0x55d94b5113a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b510e60 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/1752517865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94afc8460 0x55d94b510920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbcacc00640 0 client.7776 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:24.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 >> 172.21.15.44:0/1752517865 conn(0x55d94b48ed90 msgr2=0x55d94b4c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 shutdown_connections 2024-09-17T05:44:24.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 1 -- 172.21.15.44:0/1752517865 wait complete. 2024-09-17T05:44:24.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.037+0000 7fbccdf0d000 20 client.7776 trim_cache size 0 max 16384 2024-09-17T05:44:24.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.053+0000 7fbccdf0d000 1 Processor -- start 2024-09-17T05:44:24.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.053+0000 7fbccdf0d000 1 -- start start 2024-09-17T05:44:24.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94afc8460 0x55d94b57b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 0x55d94b57bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 0x55d94b57c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0205ad0 con 0x55d94afc8460 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc0204b30 con 0x55d94b3a1ca0 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc00b1d30 con 0x55d94b3b8950 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94afc8460 0x55d94b57b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94afc8460 0x55d94b57b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35246/0 (socket says 172.21.15.44:35246) 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 -- 172.21.15.44:0/3226046169 learned_addr learned my addr 172.21.15.44:0/3226046169 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 -- 172.21.15.44:0/3226046169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 msgr2=0x55d94b57c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 --2- 172.21.15.44:0/3226046169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 0x55d94b57c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 -- 172.21.15.44:0/3226046169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 msgr2=0x55d94b57bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 --2- 172.21.15.44:0/3226046169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 0x55d94b57bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 -- 172.21.15.44:0/3226046169 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d94b366db0 con 0x55d94afc8460 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcbf400640 1 --2- 172.21.15.44:0/3226046169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94afc8460 0x55d94b57b620 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0011e00 tx=0x7fbcb0029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1471556067736604 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcaf400640 1 -- 172.21.15.44:0/3226046169 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0004240 con 0x55d94afc8460 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcaf400640 1 -- 172.21.15.44:0/3226046169 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcb0004400 con 0x55d94afc8460 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbcaf400640 1 -- 172.21.15.44:0/3226046169 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0003860 con 0x55d94afc8460 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3226046169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94afc8460 msgr2=0x55d94b57b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3226046169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94afc8460 0x55d94b57b620 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0011e00 tx=0x7fbcb0029040 comp rx=0 tx=0).stop 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3226046169 shutdown_connections 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3226046169 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94b3b8950 0x55d94b57c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3226046169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3a1ca0 0x55d94b57bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3226046169 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94afc8460 0x55d94b57b620 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3226046169 >> 172.21.15.44:0/3226046169 conn(0x55d94b48ed90 msgr2=0x55d94b507620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3226046169 shutdown_connections 2024-09-17T05:44:24.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.057+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3226046169 wait complete. 2024-09-17T05:44:24.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 -- start start 2024-09-17T05:44:24.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 Processor -- start 2024-09-17T05:44:24.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b57f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b57f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3b8950 0x55d94b57fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d94b31a910 con 0x55d94b3a1ca0 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d94b3133b0 con 0x55d94b3b8950 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55d94b3ca750 con 0x55d94afc8460 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 10 client.0 _ll_register_callbacks cb 0x7fbca80f5710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b57f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b57f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35256/0 (socket says 172.21.15.44:35256) 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 -- 172.21.15.44:0/3901395869 learned_addr learned my addr 172.21.15.44:0/3901395869 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 -- 172.21.15.44:0/3901395869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 msgr2=0x55d94b57f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b57f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 -- 172.21.15.44:0/3901395869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3b8950 msgr2=0x55d94b57fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:24.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3b8950 0x55d94b57fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 -- 172.21.15.44:0/3901395869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d94b2d1ab0 con 0x55d94b3a1ca0 2024-09-17T05:44:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcb7e00640 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b57f8d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbca80f5df0 tx=0x7fbca80f8770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96f0f4aaef13c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcacc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcacc00640 1 -- 172.21.15.44:0/3901395869 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca80f9380 con 0x55d94b3a1ca0 2024-09-17T05:44:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcacc00640 1 -- 172.21.15.44:0/3901395869 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fbca80ff630 con 0x55d94b3a1ca0 2024-09-17T05:44:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcb0004400 con 0x55d94b3a1ca0 2024-09-17T05:44:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcacc00640 1 -- 172.21.15.44:0/3901395869 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fbca80f91c0 con 0x55d94b3a1ca0 2024-09-17T05:44:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 10 client.7782 fetch_fsmap learned FSMap version 84 2024-09-17T05:44:24.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d94b2b0070 con 0x55d94b3a1ca0 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcacc00640 1 -- 172.21.15.44:0/3901395869 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcb0004400 con 0x55d94b3a1ca0 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbcacc00640 1 -- 172.21.15.44:0/3901395869 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fbca8102720 con 0x55d94b3a1ca0 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 10 client.7782 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 10 client.7782 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 20 client.7782 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94af9b830 0x55d94b53b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 4 client.7782 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.061+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "status"}) -- 0x55d94b319540 con 0x55d94af9b830 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcbf400640 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94af9b830 0x55d94b53b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcbf400640 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94af9b830 0x55d94b53b580 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b137e0df523c2214 server_cookie=48406762d7869aae in_seq=0 out_seq=0 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcacc00640 10 client.7782 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:24.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcacc00640 1 -- 172.21.15.44:0/3901395869 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55d94b319540 con 0x55d94af9b830 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcacc00640 10 client.7782 handle_command_reply: tid=0 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 client.7782 shutdown 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 msgr2=0x55d94b57f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b57f8d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbca80f5df0 tx=0x7fbca80f8770 comp rx=0 tx=0).stop 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 shutdown_connections 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x55d94af9b830 0x55d94b53b580 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d94b3b8950 0x55d94b57fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d94b3a1ca0 0x55d94b57f8d0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 --2- 172.21.15.44:0/3901395869 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55d94afc8460 0x55d94b57f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcacc00640 0 client.7782 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:24.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 >> 172.21.15.44:0/3901395869 conn(0x55d94b48ed90 msgr2=0x55d94b507fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 shutdown_connections 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 1 -- 172.21.15.44:0/3901395869 wait complete. 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbccdf0d000 20 client.7782 trim_cache size 0 max 16384 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7662, 2024-09-17T05:44:24.068 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.1482001960000003, 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 84, 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 105, 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 105, 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 10.477337712000001 2024-09-17T05:44:24.069 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc9c073230 msgr2=0x7fbc9c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc9c073230 0x7fbc9c075740 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009b40 tx=0x7fbcb00091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc00cc1e0 msgr2=0x7fbcc0154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc00cc1e0 0x7fbcc0154610 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fbca801aed0 tx=0x7fbca80a66d0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 shutdown_connections 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbcc015d560 0x7fbcc0145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbcc00cc1e0 0x7fbcc0154610 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbc9c073230 0x7fbc9c075740 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 --2- 172.21.15.44:0/2584780530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcc006ce40 0x7fbcc0153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 >> 172.21.15.44:0/2584780530 conn(0x7fbcc00cd930 msgr2=0x7fbcc006e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 shutdown_connections 2024-09-17T05:44:24.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.065+0000 7fbcc6800640 1 -- 172.21.15.44:0/2584780530 wait complete. 2024-09-17T05:44:24.085 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:44:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 -- 172.21.15.44:0/816697473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa120005360 msgr2=0x7fa12000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 --2- 172.21.15.44:0/816697473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa120005360 0x7fa12000ba10 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa134009e90 tx=0x7fa13401d5f0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 -- 172.21.15.44:0/816697473 shutdown_connections 2024-09-17T05:44:24.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 --2- 172.21.15.44:0/816697473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa120005360 0x7fa12000ba10 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 -- 172.21.15.44:0/816697473 >> 172.21.15.44:0/816697473 conn(0x7fa1380b4240 msgr2=0x7fa1380b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 -- 172.21.15.44:0/816697473 shutdown_connections 2024-09-17T05:44:24.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 -- 172.21.15.44:0/816697473 wait complete. 2024-09-17T05:44:24.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 Processor -- start 2024-09-17T05:44:24.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.249+0000 7fa140800640 1 -- start start 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa120005360 0x7fa1381e9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13814fde0 0x7fa1381501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1380aede0 0x7fa1380af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa1380b1d60 con 0x7fa1380aede0 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa1380b1be0 con 0x7fa13814fde0 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa1380b1ee0 con 0x7fa120005360 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1380aede0 0x7fa1380af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1380aede0 0x7fa1380af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35284/0 (socket says 172.21.15.44:35284) 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 -- 172.21.15.44:0/3577667446 learned_addr learned my addr 172.21.15.44:0/3577667446 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13d400640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13814fde0 0x7fa1381501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13de00640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa120005360 0x7fa1381e9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 -- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa120005360 msgr2=0x7fa1381e9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa120005360 0x7fa1381e9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 -- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13814fde0 msgr2=0x7fa1381501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13814fde0 0x7fa1381501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 -- 172.21.15.44:0/3577667446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1380af730 con 0x7fa1380aede0 2024-09-17T05:44:24.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa13e800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1380aede0 0x7fa1380af1f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa134009de0 tx=0x7fa1340092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa132000640 1 -- 172.21.15.44:0/3577667446 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340ba070 con 0x7fa1380aede0 2024-09-17T05:44:24.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa132000640 1 -- 172.21.15.44:0/3577667446 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1340a79d0 con 0x7fa1380aede0 2024-09-17T05:44:24.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa132000640 1 -- 172.21.15.44:0/3577667446 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340a7dc0 con 0x7fa1380aede0 2024-09-17T05:44:24.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1381e74c0 con 0x7fa1380aede0 2024-09-17T05:44:24.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1381e7a80 con 0x7fa1380aede0 2024-09-17T05:44:24.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.253+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1381e83b0 con 0x7fa1380aede0 2024-09-17T05:44:24.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.257+0000 7fa132000640 1 -- 172.21.15.44:0/3577667446 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa1340bd070 con 0x7fa1380aede0 2024-09-17T05:44:24.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.257+0000 7fa132000640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa11c073200 0x7fa11c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:24.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.257+0000 7fa132000640 1 -- 172.21.15.44:0/3577667446 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fa13412e2d0 con 0x7fa1380aede0 2024-09-17T05:44:24.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.257+0000 7fa13de00640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa11c073200 0x7fa11c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:24.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.257+0000 7fa13de00640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa11c073200 0x7fa11c075710 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001250 tx=0x7fa12c001cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:24.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.261+0000 7fa132000640 1 -- 172.21.15.44:0/3577667446 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa1380af730 con 0x7fa1380aede0 2024-09-17T05:44:24.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.473+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa1380cf1e0 con 0x7fa1380aede0 2024-09-17T05:44:24.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.473+0000 7fa132000640 1 -- 172.21.15.44:0/3577667446 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7fa134017300 con 0x7fa1380aede0 2024-09-17T05:44:24.474 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:44:24.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa11c073200 msgr2=0x7fa11c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa11c073200 0x7fa11c075710 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa12c001250 tx=0x7fa12c001cf0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1380aede0 msgr2=0x7fa1380af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1380aede0 0x7fa1380af1f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa134009de0 tx=0x7fa1340092f0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 shutdown_connections 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa1380aede0 0x7fa1380af1f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa11c073200 0x7fa11c075710 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa13814fde0 0x7fa1381501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 --2- 172.21.15.44:0/3577667446 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa120005360 0x7fa1381e9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 >> 172.21.15.44:0/3577667446 conn(0x7fa1380b4240 msgr2=0x7fa1380b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 shutdown_connections 2024-09-17T05:44:24.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24.477+0000 7fa140800640 1 -- 172.21.15.44:0/3577667446 wait complete. 2024-09-17T05:44:24.496 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:44:24.497 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:24.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:24.497 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:44:24.506 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:44:24.506 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:44:24.506 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:44:24.506 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.506 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41941sec preferred_lft 41941sec 2024-09-17T05:44:24.507 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:44:24.508 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:44:24.509 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:24.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:24.510 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:44:24.573 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:44:24.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:24.575 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:44:24.628 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:44:24.628 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:44:24.628 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:44:24.628 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:44:24.628 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:44:24.628 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:44:24.628 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:44:24.629 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:44:24.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:44:24.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:44:24.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:44:24.629 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:44:24.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:44:24.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:24.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:24.767 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:44:24.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:44:24.776 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:44:24.777 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:24.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:24.778 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:44:24.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:44:24.839 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:24.886 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:24.886 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:44:24.887 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:24.939 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:44:24.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:24.939 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:25.044 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:25.044 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:25.044 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:44:25.062 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:25.062 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:25.062 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:44:25.062 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:44:25.062 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:44:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:44:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:44:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:44:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:44:25.072 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:44:25.073 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:44:25.076 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:44:25.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:25.076 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:25.097 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:44:25.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:44:25.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:25.206 INFO:teuthology.orchestra.run.smithi044.stdout:client7791 2024-09-17T05:44:25.206 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:25.206 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:25.215 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:25.215 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:25.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:25.266 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T05:44:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:6+0 records in 2024-09-17T05:44:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:6+0 records out 2024-09-17T05:44:25.436 INFO:teuthology.orchestra.run.smithi044.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.106279 s, 59.2 MB/s 2024-09-17T05:44:25.437 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:25.437 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:25.446 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:25.446 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:25.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:44:25.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 -- 172.21.15.44:0/2507083015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 msgr2=0x7fb964072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:25.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 --2- 172.21.15.44:0/2507083015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb964072e50 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb964072de0 tx=0x7fb95801f0b0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 -- 172.21.15.44:0/2507083015 shutdown_connections 2024-09-17T05:44:25.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 --2- 172.21.15.44:0/2507083015 >> v2:172.21.15.86:3300/0 conn(0x7fb9640ce080 0x7fb9640ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 --2- 172.21.15.44:0/2507083015 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb964072e50 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 -- 172.21.15.44:0/2507083015 >> 172.21.15.44:0/2507083015 conn(0x7fb9640ccaa0 msgr2=0x7fb9640cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:25.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 -- 172.21.15.44:0/2507083015 shutdown_connections 2024-09-17T05:44:25.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.697+0000 7fb96c000640 1 -- 172.21.15.44:0/2507083015 wait complete. 2024-09-17T05:44:25.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 Processor -- start 2024-09-17T05:44:25.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 -- start start 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb96406de50 0x7fb9640b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9640ce080 0x7fb9640c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb9640c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640cf7f0 con 0x7fb9640cef20 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb964071150 con 0x7fb96406de50 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96c000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb9640ce9d0 con 0x7fb9640ce080 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb9640c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb9640c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35308/0 (socket says 172.21.15.44:35308) 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 -- 172.21.15.44:0/2735739008 learned_addr learned my addr 172.21.15.44:0/2735739008 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:25.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb969600640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb96406de50 0x7fb9640b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb968c00640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9640ce080 0x7fb9640c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 -- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9640ce080 msgr2=0x7fb9640c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9640ce080 0x7fb9640c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 -- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb96406de50 msgr2=0x7fb9640b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb96406de50 0x7fb9640b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.701+0000 7fb96a000640 1 -- 172.21.15.44:0/2735739008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96409b7c0 con 0x7fb9640cef20 2024-09-17T05:44:25.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb96a000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb9640c97e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00ddc0 tx=0x7fb95c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:25.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb961600640 1 -- 172.21.15.44:0/2735739008 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c004d30 con 0x7fb9640cef20 2024-09-17T05:44:25.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb961600640 1 -- 172.21.15.44:0/2735739008 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb95c00be40 con 0x7fb9640cef20 2024-09-17T05:44:25.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96409baa0 con 0x7fb9640cef20 2024-09-17T05:44:25.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb961600640 1 -- 172.21.15.44:0/2735739008 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00e8c0 con 0x7fb9640cef20 2024-09-17T05:44:25.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96409fbd0 con 0x7fb9640cef20 2024-09-17T05:44:25.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96409fe30 con 0x7fb9640cef20 2024-09-17T05:44:25.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb961600640 1 -- 172.21.15.44:0/2735739008 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb95c00ea60 con 0x7fb9640cef20 2024-09-17T05:44:25.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb961600640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb944073200 0x7fb944075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:25.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.705+0000 7fb961600640 1 -- 172.21.15.44:0/2735739008 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fb95c094d20 con 0x7fb9640cef20 2024-09-17T05:44:25.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.709+0000 7fb969600640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb944073200 0x7fb944075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:25.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.709+0000 7fb969600640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb944073200 0x7fb944075710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb9580b2000 tx=0x7fb95801d8f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:25.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.713+0000 7fb961600640 1 -- 172.21.15.44:0/2735739008 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb95c05fbb0 con 0x7fb9640cef20 2024-09-17T05:44:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb9640ce490 con 0x7fb9640cef20 2024-09-17T05:44:25.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb961600640 1 -- 172.21.15.44:0/2735739008 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v105) ==== 80+0+0 (secure 0 0 0) 0x7fb95c05f4b0 con 0x7fb9640cef20 2024-09-17T05:44:25.900 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb944073200 msgr2=0x7fb944075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb944073200 0x7fb944075710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb9580b2000 tx=0x7fb95801d8f0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 msgr2=0x7fb9640c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb9640c97e0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00ddc0 tx=0x7fb95c00b730 comp rx=0 tx=0).stop 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 shutdown_connections 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb9640cef20 0x7fb9640c97e0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb9640ce080 0x7fb9640c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb944073200 0x7fb944075710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 --2- 172.21.15.44:0/2735739008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb96406de50 0x7fb9640b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:25.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 >> 172.21.15.44:0/2735739008 conn(0x7fb9640ccaa0 msgr2=0x7fb96406f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:25.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 shutdown_connections 2024-09-17T05:44:25.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:25.901+0000 7fb96c000640 1 -- 172.21.15.44:0/2735739008 wait complete. 2024-09-17T05:44:25.922 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:44:25.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:25.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:25.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:44:25.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:25.954 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:44:26.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:26.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.209+0000 7f4f7b400640 1 -- 172.21.15.44:0/2870850894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c004810 msgr2=0x7f4f5c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.209+0000 7f4f7b400640 1 --2- 172.21.15.44:0/2870850894 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f5c004810 0x7f4f5c004c20 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f4f60006f90 tx=0x7f4f6001cec0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.209+0000 7f4f79400640 1 -- 172.21.15.44:0/2870850894 reap_dead start 2024-09-17T05:44:26.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.209+0000 7f4f7b400640 1 -- 172.21.15.44:0/2870850894 shutdown_connections 2024-09-17T05:44:26.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.209+0000 7f4f7b400640 1 -- 172.21.15.44:0/2870850894 >> 172.21.15.44:0/2870850894 conn(0x7f4f740cd930 msgr2=0x7f4f740cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:26.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.209+0000 7f4f7b400640 1 -- 172.21.15.44:0/2870850894 shutdown_connections 2024-09-17T05:44:26.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.209+0000 7f4f7b400640 1 -- 172.21.15.44:0/2870850894 wait complete. 2024-09-17T05:44:26.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 Processor -- start 2024-09-17T05:44:26.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 -- start start 2024-09-17T05:44:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c004810 0x7f4f74147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7415cbd0 0x7f4f741433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7406d800 0x7f4f7406dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4f741670d0 con 0x7f4f7415cbd0 2024-09-17T05:44:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4f74152830 con 0x7f4f5c004810 2024-09-17T05:44:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4f74167250 con 0x7f4f7406d800 2024-09-17T05:44:26.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7415cbd0 0x7f4f741433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7415cbd0 0x7f4f741433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35332/0 (socket says 172.21.15.44:35332) 2024-09-17T05:44:26.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 -- 172.21.15.44:0/956772533 learned_addr learned my addr 172.21.15.44:0/956772533 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:26.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f79400640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7406d800 0x7f4f7406dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f78a00640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c004810 0x7f4f74147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 -- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7406d800 msgr2=0x7f4f7406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7406d800 0x7f4f7406dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 -- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c004810 msgr2=0x7f4f74147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c004810 0x7f4f74147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 -- 172.21.15.44:0/956772533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f74147ae0 con 0x7f4f7415cbd0 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f73e00640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7415cbd0 0x7f4f741433f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4f6001b5c0 tx=0x7f4f60001030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f70c00640 1 -- 172.21.15.44:0/956772533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60006090 con 0x7f4f7415cbd0 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f70c00640 1 -- 172.21.15.44:0/956772533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f60006230 con 0x7f4f7415cbd0 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f70c00640 1 -- 172.21.15.44:0/956772533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60003600 con 0x7f4f7415cbd0 2024-09-17T05:44:26.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7406e150 con 0x7f4f7415cbd0 2024-09-17T05:44:26.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.213+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f741f9160 con 0x7f4f7415cbd0 2024-09-17T05:44:26.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.217+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7415b430 con 0x7f4f7415cbd0 2024-09-17T05:44:26.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.217+0000 7f4f70c00640 1 -- 172.21.15.44:0/956772533 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4f600037a0 con 0x7f4f7415cbd0 2024-09-17T05:44:26.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.217+0000 7f4f70c00640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f54073230 0x7f4f54075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.217+0000 7f4f70c00640 1 -- 172.21.15.44:0/956772533 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f4f6012dfa0 con 0x7f4f7415cbd0 2024-09-17T05:44:26.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.217+0000 7f4f78a00640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f54073230 0x7f4f54075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.221+0000 7f4f78a00640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f54073230 0x7f4f54075740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000f70 tx=0x7f4f68006c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:26.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.221+0000 7f4f70c00640 1 -- 172.21.15.44:0/956772533 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4f600bf030 con 0x7f4f7415cbd0 2024-09-17T05:44:26.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.429+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f740ccae0 con 0x7f4f7415cbd0 2024-09-17T05:44:26.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.429+0000 7f4f70c00640 1 -- 172.21.15.44:0/956772533 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7f4f7406e150 con 0x7f4f7415cbd0 2024-09-17T05:44:26.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:26.431 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"btime":"2024-09-17T05:44:20:951293+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:44:20.372604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3953022133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3953022133},{"type":"v1","addr":"172.21.15.44:6835","nonce":3953022133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7662,"qdb_cluster":[7662]},"id":7}]} 2024-09-17T05:44:26.431 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 84 2024-09-17T05:44:26.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f54073230 msgr2=0x7f4f54075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f54073230 0x7f4f54075740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4f68000f70 tx=0x7f4f68006c20 comp rx=0 tx=0).stop 2024-09-17T05:44:26.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7415cbd0 msgr2=0x7f4f741433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7415cbd0 0x7f4f741433f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f4f6001b5c0 tx=0x7f4f60001030 comp rx=0 tx=0).stop 2024-09-17T05:44:26.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 shutdown_connections 2024-09-17T05:44:26.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4f7406d800 0x7f4f7406dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4f7415cbd0 0x7f4f741433f0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4f54073230 0x7f4f54075740 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 --2- 172.21.15.44:0/956772533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f5c004810 0x7f4f74147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 >> 172.21.15.44:0/956772533 conn(0x7f4f740cd930 msgr2=0x7f4f74143d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:26.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 shutdown_connections 2024-09-17T05:44:26.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.433+0000 7f4f7b400640 1 -- 172.21.15.44:0/956772533 wait complete. 2024-09-17T05:44:26.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-17T05:44:26.636 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:44:26.637 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:44:26.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 -- 172.21.15.44:0/4262084273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a806e490 msgr2=0x7fb1a8151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 --2- 172.21.15.44:0/4262084273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a806e490 0x7fb1a8151b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009bc0 tx=0x7fb1a001cb10 comp rx=0 tx=0).stop 2024-09-17T05:44:26.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 -- 172.21.15.44:0/4262084273 shutdown_connections 2024-09-17T05:44:26.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 --2- 172.21.15.44:0/4262084273 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a806e490 0x7fb1a8151b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 --2- 172.21.15.44:0/4262084273 >> v2:172.21.15.86:3300/0 conn(0x7fb1a8071c60 0x7fb1a806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 -- 172.21.15.44:0/4262084273 >> 172.21.15.44:0/4262084273 conn(0x7fb1a80cd930 msgr2=0x7fb1a80cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:26.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 -- 172.21.15.44:0/4262084273 shutdown_connections 2024-09-17T05:44:26.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 -- 172.21.15.44:0/4262084273 wait complete. 2024-09-17T05:44:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 Processor -- start 2024-09-17T05:44:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.797+0000 7fb1b0000640 1 -- start start 2024-09-17T05:44:26.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a806e490 0x7fb1a814b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a8070e00 0x7fb1a80c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a8071c60 0x7fb1a80ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a815c450 con 0x7fb1a806e490 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a815c2d0 con 0x7fb1a8071c60 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a815c5d0 con 0x7fb1a8070e00 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a806e490 0x7fb1a814b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a806e490 0x7fb1a814b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35340/0 (socket says 172.21.15.44:35340) 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 -- 172.21.15.44:0/71536334 learned_addr learned my addr 172.21.15.44:0/71536334 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ae000640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a8071c60 0x7fb1a80ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1acc00640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a8070e00 0x7fb1a80c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 -- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a8070e00 msgr2=0x7fb1a80c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a8070e00 0x7fb1a80c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 -- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a8071c60 msgr2=0x7fb1a80ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a8071c60 0x7fb1a80ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 -- 172.21.15.44:0/71536334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a81f9560 con 0x7fb1a806e490 2024-09-17T05:44:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1ad600640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a806e490 0x7fb1a814b5c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c790 tx=0x7fb19c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1a5600640 1 -- 172.21.15.44:0/71536334 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c016020 con 0x7fb1a806e490 2024-09-17T05:44:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a814bb00 con 0x7fb1a806e490 2024-09-17T05:44:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1a5600640 1 -- 172.21.15.44:0/71536334 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb19c00a950 con 0x7fb1a806e490 2024-09-17T05:44:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1a5600640 1 -- 172.21.15.44:0/71536334 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00ada0 con 0x7fb1a806e490 2024-09-17T05:44:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a81f8a80 con 0x7fb1a806e490 2024-09-17T05:44:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.801+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a8151b00 con 0x7fb1a806e490 2024-09-17T05:44:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.805+0000 7fb1a5600640 1 -- 172.21.15.44:0/71536334 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb19c019020 con 0x7fb1a806e490 2024-09-17T05:44:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.805+0000 7fb1a5600640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb188073230 0x7fb188075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.805+0000 7fb1a5600640 1 -- 172.21.15.44:0/71536334 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fb19c0946e0 con 0x7fb1a806e490 2024-09-17T05:44:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.805+0000 7fb1acc00640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb188073230 0x7fb188075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.805+0000 7fb1acc00640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb188073230 0x7fb188075740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80b5ec0 tx=0x7fb1940091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:26.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:26.809+0000 7fb1a5600640 1 -- 172.21.15.44:0/71536334 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb19c020020 con 0x7fb1a806e490 2024-09-17T05:44:27.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.017+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1a814ceb0 con 0x7fb1a806e490 2024-09-17T05:44:27.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.017+0000 7fb1a5600640 1 -- 172.21.15.44:0/71536334 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7fb1a806e8a0 con 0x7fb1a806e490 2024-09-17T05:44:27.017 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:27.017 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"btime":"2024-09-17T05:44:20:951293+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:44:20.372604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3953022133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3953022133},{"type":"v1","addr":"172.21.15.44:6835","nonce":3953022133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7662,"qdb_cluster":[7662]},"id":7}]} 2024-09-17T05:44:27.017 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 84 2024-09-17T05:44:27.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb188073230 msgr2=0x7fb188075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb188073230 0x7fb188075740 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80b5ec0 tx=0x7fb1940091e0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a806e490 msgr2=0x7fb1a814b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a806e490 0x7fb1a814b5c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c790 tx=0x7fb19c00cc50 comp rx=0 tx=0).stop 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 shutdown_connections 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb188073230 0x7fb188075740 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a8071c60 0x7fb1a80ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb1a8070e00 0x7fb1a80c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 --2- 172.21.15.44:0/71536334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a806e490 0x7fb1a814b5c0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 >> 172.21.15.44:0/71536334 conn(0x7fb1a80cd930 msgr2=0x7fb1a815b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 shutdown_connections 2024-09-17T05:44:27.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.021+0000 7fb1b0000640 1 -- 172.21.15.44:0/71536334 wait complete. 2024-09-17T05:44:27.040 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-09-17T05:44:27.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 Processor -- start 2024-09-17T05:44:27.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- start start 2024-09-17T05:44:27.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45cb83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 0x55fd45d5fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 0x55fd45d603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fd45bdba00 con 0x55fd45cbc9d0 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fd45c39f40 con 0x55fd45d610d0 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55fd45d614e0 con 0x55fd45cb6830 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45cb83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45cb83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35348/0 (socket says 172.21.15.44:35348) 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 -- 172.21.15.44:0/202143622 learned_addr learned my addr 172.21.15.44:0/202143622 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34ef000640 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 0x55fd45d5fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f0400640 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 0x55fd45d603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 -- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 msgr2=0x55fd45d603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 0x55fd45d603d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 -- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 msgr2=0x55fd45d5fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:27.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 0x55fd45d5fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 -- 172.21.15.44:0/202143622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd45bb4c10 con 0x55fd45cbc9d0 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34efa00640 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45cb83e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f34e000b7d0 tx=0x7f34e0004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e5b1f060748a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34edc00640 1 -- 172.21.15.44:0/202143622 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e000abd0 con 0x55fd45cbc9d0 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34edc00640 1 -- 172.21.15.44:0/202143622 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34e000ad70 con 0x55fd45cbc9d0 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34edc00640 1 -- 172.21.15.44:0/202143622 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e0008690 con 0x55fd45cbc9d0 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- 172.21.15.44:0/202143622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 msgr2=0x55fd45cb83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45cb83e0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f34e000b7d0 tx=0x7f34e0004f90 comp rx=0 tx=0).stop 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- 172.21.15.44:0/202143622 shutdown_connections 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 0x55fd45d603d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 0x55fd45d5fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 --2- 172.21.15.44:0/202143622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45cb83e0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- 172.21.15.44:0/202143622 >> 172.21.15.44:0/202143622 conn(0x55fd45c79d20 msgr2=0x55fd45cb93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- 172.21.15.44:0/202143622 shutdown_connections 2024-09-17T05:44:27.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.101+0000 7f34f6959080 1 -- 172.21.15.44:0/202143622 wait complete. 2024-09-17T05:44:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 Processor -- start 2024-09-17T05:44:27.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 -- start start 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 0x55fd45dfd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45c8ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 0x55fd45c8f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55fd45cb3f50 con 0x55fd45cbc9d0 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fd45cb3cb0 con 0x55fd45d610d0 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55fd45cb41f0 con 0x55fd45cb6830 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45c8ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45c8ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35356/0 (socket says 172.21.15.44:35356) 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 -- 172.21.15.44:0/3882890566 learned_addr learned my addr 172.21.15.44:0/3882890566 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:27.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34efa00640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 0x55fd45dfd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f0400640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 0x55fd45c8f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 -- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 msgr2=0x55fd45dfd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55fd45cb6830 0x55fd45dfd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 -- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 msgr2=0x55fd45c8f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fd45d610d0 0x55fd45c8f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 -- 172.21.15.44:0/3882890566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd45d5fd20 con 0x55fd45cbc9d0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34ef000640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45c8ef30 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c560 tx=0x7f34dc00c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34e7e00640 1 -- 172.21.15.44:0/3882890566 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc017620 con 0x55fd45cbc9d0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34e7e00640 1 -- 172.21.15.44:0/3882890566 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34dc013070 con 0x55fd45cbc9d0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34e7e00640 1 -- 172.21.15.44:0/3882890566 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc017b50 con 0x55fd45cbc9d0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd45d5ffc0 con 0x55fd45cbc9d0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.105+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd45d60500 con 0x55fd45cbc9d0 2024-09-17T05:44:27.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.109+0000 7f34e7e00640 1 -- 172.21.15.44:0/3882890566 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f34dc00f410 con 0x55fd45cbc9d0 2024-09-17T05:44:27.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.109+0000 7f34e7e00640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f34d0071c10 0x7f34d0074120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.109+0000 7f34e7e00640 1 -- 172.21.15.44:0/3882890566 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f34dc0936c0 con 0x55fd45cbc9d0 2024-09-17T05:44:27.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.109+0000 7f34efa00640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f34d0071c10 0x7f34d0074120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.109+0000 7f34f6959080 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55fd45d5c5c0 0x55fd45d5c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.109+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e105) -- 0x55fd45d5f880 con 0x55fd45d5c5c0 2024-09-17T05:44:27.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.109+0000 7f34f0400640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55fd45d5c5c0 0x55fd45d5c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34efa00640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f34d0071c10 0x7f34d0074120 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c10 tx=0x7f34e0017040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:27.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f0400640 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55fd45d5c5c0 0x55fd45d5c9d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f0400640 1 -- 172.21.15.44:0/3882890566 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7f34e80b8040 con 0x55fd45d5c5c0 2024-09-17T05:44:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55fd45d5c5c0 msgr2=0x55fd45d5c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55fd45d5c5c0 0x55fd45d5c9d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f34d0071c10 msgr2=0x7f34d0074120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f34d0071c10 0x7f34d0074120 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c10 tx=0x7f34e0017040 comp rx=0 tx=0).stop 2024-09-17T05:44:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 msgr2=0x55fd45c8ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 --2- 172.21.15.44:0/3882890566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55fd45cbc9d0 0x55fd45c8ef30 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c560 tx=0x7f34dc00c650 comp rx=0 tx=0).stop 2024-09-17T05:44:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f0400640 1 -- 172.21.15.44:0/3882890566 reap_dead start 2024-09-17T05:44:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 shutdown_connections 2024-09-17T05:44:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 >> 172.21.15.44:0/3882890566 conn(0x55fd45c79d20 msgr2=0x55fd45cb0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 shutdown_connections 2024-09-17T05:44:27.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.113+0000 7f34f6959080 1 -- 172.21.15.44:0/3882890566 wait complete. 2024-09-17T05:44:27.117 INFO:teuthology.orchestra.run.smithi044.stdout:����� 2024-09-17T05:44:27.117 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:44:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 -- 172.21.15.44:0/440213551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 msgr2=0x7f07d806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 --2- 172.21.15.44:0/440213551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d806df50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f07d806eb10 tx=0x7f07c001c770 comp rx=0 tx=0).stop 2024-09-17T05:44:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 -- 172.21.15.44:0/440213551 shutdown_connections 2024-09-17T05:44:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 --2- 172.21.15.44:0/440213551 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d806df50 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 --2- 172.21.15.44:0/440213551 >> v2:172.21.15.86:3300/0 conn(0x7f07d8070e00 0x7f07d8071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 -- 172.21.15.44:0/440213551 >> 172.21.15.44:0/440213551 conn(0x7f07d80cd930 msgr2=0x7f07d80cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:27.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 -- 172.21.15.44:0/440213551 shutdown_connections 2024-09-17T05:44:27.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 -- 172.21.15.44:0/440213551 wait complete. 2024-09-17T05:44:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 Processor -- start 2024-09-17T05:44:27.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.277+0000 7f07dde00640 1 -- start start 2024-09-17T05:44:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07d806e490 0x7f07d814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07d8070e00 0x7f07d81f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f07d815c350 con 0x7f07d80ccb60 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f07d815c1d0 con 0x7f07d8070e00 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f07d815c4d0 con 0x7f07d806e490 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d814ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35370/0 (socket says 172.21.15.44:35370) 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 -- 172.21.15.44:0/1607901409 learned_addr learned my addr 172.21.15.44:0/1607901409 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07cfe00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07d8070e00 0x7f07d81f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d6a00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07d806e490 0x7f07d814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 -- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07d806e490 msgr2=0x7f07d814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07d806e490 0x7f07d814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 -- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07d8070e00 msgr2=0x7f07d81f9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07d8070e00 0x7f07d81f9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 -- 172.21.15.44:0/1607901409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d81fa2a0 con 0x7f07d80ccb60 2024-09-17T05:44:27.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07d7400640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d814ac60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c760 tx=0x7f07d000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:27.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07cf400640 1 -- 172.21.15.44:0/1607901409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0003db0 con 0x7f07d80ccb60 2024-09-17T05:44:27.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07cf400640 1 -- 172.21.15.44:0/1607901409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07d000ce10 con 0x7f07d80ccb60 2024-09-17T05:44:27.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d81fa580 con 0x7f07d80ccb60 2024-09-17T05:44:27.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07cf400640 1 -- 172.21.15.44:0/1607901409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d00052d0 con 0x7f07d80ccb60 2024-09-17T05:44:27.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d81fab40 con 0x7f07d80ccb60 2024-09-17T05:44:27.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.281+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d8071c60 con 0x7f07d80ccb60 2024-09-17T05:44:27.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.285+0000 7f07cf400640 1 -- 172.21.15.44:0/1607901409 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f07d0005470 con 0x7f07d80ccb60 2024-09-17T05:44:27.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.285+0000 7f07cf400640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07b4073200 0x7f07b4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:27.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.285+0000 7f07cf400640 1 -- 172.21.15.44:0/1607901409 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f07d0094120 con 0x7f07d80ccb60 2024-09-17T05:44:27.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.285+0000 7f07d6a00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07b4073200 0x7f07b4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:27.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.285+0000 7f07d6a00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07b4073200 0x7f07b4075710 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07c8005fd0 tx=0x7f07c800b390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:27.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.289+0000 7f07cf400640 1 -- 172.21.15.44:0/1607901409 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f07d806e8a0 con 0x7f07d80ccb60 2024-09-17T05:44:27.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.497+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f07d8074070 con 0x7f07d80ccb60 2024-09-17T05:44:27.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.497+0000 7f07cf400640 1 -- 172.21.15.44:0/1607901409 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7f07d005e8c0 con 0x7f07d80ccb60 2024-09-17T05:44:27.560 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07b4073200 msgr2=0x7f07b4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07b4073200 0x7f07b4075710 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07c8005fd0 tx=0x7f07c800b390 comp rx=0 tx=0).stop 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 msgr2=0x7f07d814ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d814ac60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c760 tx=0x7f07d000cc20 comp rx=0 tx=0).stop 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 shutdown_connections 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f07d80ccb60 0x7f07d814ac60 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f07b4073200 0x7f07b4075710 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07d8070e00 0x7f07d81f9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 --2- 172.21.15.44:0/1607901409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f07d806e490 0x7f07d814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 >> 172.21.15.44:0/1607901409 conn(0x7f07d80cd930 msgr2=0x7f07d806dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 shutdown_connections 2024-09-17T05:44:27.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27.501+0000 7f07dde00640 1 -- 172.21.15.44:0/1607901409 wait complete. 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:44:27.563 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:27.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:27.563 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:44:27.572 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:44:27.573 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41938sec preferred_lft 41938sec 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:44:27.574 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:44:27.575 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:44:27.576 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:44:27.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:27.577 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:44:27.637 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:44:27.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:27.639 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:44:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:44:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:44:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:44:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:44:27.692 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:44:27.693 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:44:27.693 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:44:27.693 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:44:27.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:44:27.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:44:27.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:44:27.693 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:44:27.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:44:27.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:27.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:27.835 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:44:27.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:44:27.843 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:44:27.844 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:27.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:27.844 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:44:27.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:44:27.907 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:27.963 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:44:27.963 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:44:27.963 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:28.018 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:44:28.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:28.019 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:28.124 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:28.124 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:28.124 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:44:28.142 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:28.142 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:28.142 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:44:28.143 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:44:28.143 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:44:28.153 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:44:28.153 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:44:28.153 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:44:28.153 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:44:28.153 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:44:28.154 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:44:28.154 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:44:28.154 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:44:28.157 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:44:28.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:28.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:28.177 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:44:28.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:44:28.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:28.279 INFO:teuthology.orchestra.run.smithi044.stdout:client7549 2024-09-17T05:44:28.280 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:28.280 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:28.289 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:28.289 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:28.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:28.342 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T05:44:28.512 INFO:teuthology.orchestra.run.smithi044.stderr:6+0 records in 2024-09-17T05:44:28.512 INFO:teuthology.orchestra.run.smithi044.stderr:6+0 records out 2024-09-17T05:44:28.512 INFO:teuthology.orchestra.run.smithi044.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.115072 s, 54.7 MB/s 2024-09-17T05:44:28.513 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:28.513 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:28.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:28.523 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-17T05:44:28.652 INFO:teuthology.orchestra.run.smithi044.stderr:6+0 records in 2024-09-17T05:44:28.652 INFO:teuthology.orchestra.run.smithi044.stderr:6+0 records out 2024-09-17T05:44:28.652 INFO:teuthology.orchestra.run.smithi044.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0753333 s, 83.5 MB/s 2024-09-17T05:44:28.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:28.653 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-09-17T05:44:28.664 INFO:teuthology.orchestra.run.smithi044.stdout:./ 2024-09-17T05:44:28.664 INFO:teuthology.orchestra.run.smithi044.stdout:./file2_sixmegs 2024-09-17T05:44:28.664 INFO:teuthology.orchestra.run.smithi044.stdout:./file3_sixmegs 2024-09-17T05:44:28.664 INFO:teuthology.orchestra.run.smithi044.stdout:./file1_sixmegs 2024-09-17T05:44:28.665 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:44:28.665 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:44:28.665 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:44:28.665 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:44:28.665 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-09-17T05:44:28.666 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:44:28.776 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:44:28.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:28.785 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:44:28.785 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:44:28.785 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:44:28.785 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:44:28.785 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-09-17T05:44:28.785 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:44:28.896 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-17T05:44:28.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:28.905 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:44:28.905 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:44:28.906 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:44:28.906 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:44:28.906 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-09-17T05:44:28.906 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:44:29.013 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-17T05:44:29.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:29.022 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:44:29.022 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:44:29.022 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:44:29.023 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:44:29.023 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-09-17T05:44:29.023 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:44:29.128 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-17T05:44:29.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:44:29.137 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:29.137 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:29.187 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:29.187 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:29.239 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:44:29.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 -- 172.21.15.44:0/531971325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 msgr2=0x7f3d5015e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 --2- 172.21.15.44:0/531971325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d5015e990 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f3d500cb0b0 tx=0x7f3d4001c830 comp rx=0 tx=0).stop 2024-09-17T05:44:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 -- 172.21.15.44:0/531971325 shutdown_connections 2024-09-17T05:44:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 --2- 172.21.15.44:0/531971325 >> v2:172.21.15.86:3300/0 conn(0x7f3d5006de50 0x7f3d5006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 --2- 172.21.15.44:0/531971325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d5015e990 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 -- 172.21.15.44:0/531971325 >> 172.21.15.44:0/531971325 conn(0x7f3d500ccaa0 msgr2=0x7f3d500cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 -- 172.21.15.44:0/531971325 shutdown_connections 2024-09-17T05:44:29.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.441+0000 7f3d56000640 1 -- 172.21.15.44:0/531971325 wait complete. 2024-09-17T05:44:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 Processor -- start 2024-09-17T05:44:29.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 -- start start 2024-09-17T05:44:29.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d5006de50 0x7f3d500c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d500c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d500ced00 0x7f3d500c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50169410 con 0x7f3d50072e50 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50169290 con 0x7f3d5006de50 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3d50169590 con 0x7f3d500ced00 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d500c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d500c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57708/0 (socket says 172.21.15.44:57708) 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 -- 172.21.15.44:0/4110140020 learned_addr learned my addr 172.21.15.44:0/4110140020 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d4f400640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d5006de50 0x7f3d500c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d4fe00640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d500ced00 0x7f3d500c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 -- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d500ced00 msgr2=0x7f3d500c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d500ced00 0x7f3d500c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 -- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d5006de50 msgr2=0x7f3d500c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d5006de50 0x7f3d500c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 -- 172.21.15.44:0/4110140020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d50070d50 con 0x7f3d50072e50 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47e00640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d500c70d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d780 tx=0x7f3d3800dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47400640 1 -- 172.21.15.44:0/4110140020 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38017070 con 0x7f3d50072e50 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47400640 1 -- 172.21.15.44:0/4110140020 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d3800de90 con 0x7f3d50072e50 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d47400640 1 -- 172.21.15.44:0/4110140020 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38004020 con 0x7f3d50072e50 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d501655d0 con 0x7f3d50072e50 2024-09-17T05:44:29.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.445+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d500c7e40 con 0x7f3d50072e50 2024-09-17T05:44:29.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.449+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d500cbc80 con 0x7f3d50072e50 2024-09-17T05:44:29.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.449+0000 7f3d47400640 1 -- 172.21.15.44:0/4110140020 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3d380041c0 con 0x7f3d50072e50 2024-09-17T05:44:29.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.449+0000 7f3d47400640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d2c073200 0x7f3d2c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.449+0000 7f3d47400640 1 -- 172.21.15.44:0/4110140020 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f3d38094710 con 0x7f3d50072e50 2024-09-17T05:44:29.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.449+0000 7f3d4f400640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d2c073200 0x7f3d2c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.453+0000 7f3d4f400640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d2c073200 0x7f3d2c075710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3d400af000 tx=0x7f3d400a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:29.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.453+0000 7f3d47400640 1 -- 172.21.15.44:0/4110140020 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3d38020020 con 0x7f3d50072e50 2024-09-17T05:44:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.637+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3d501657a0 con 0x7f3d50072e50 2024-09-17T05:44:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d47400640 1 -- 172.21.15.44:0/4110140020 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v105) ==== 80+0+0 (secure 0 0 0) 0x7f3d3805eeb0 con 0x7f3d50072e50 2024-09-17T05:44:29.639 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:44:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d2c073200 msgr2=0x7f3d2c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d2c073200 0x7f3d2c075710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3d400af000 tx=0x7f3d400a7040 comp rx=0 tx=0).stop 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 msgr2=0x7f3d500c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d500c70d0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800d780 tx=0x7f3d3800dc40 comp rx=0 tx=0).stop 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 shutdown_connections 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3d500ced00 0x7f3d500c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d50072e50 0x7f3d500c70d0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3d2c073200 0x7f3d2c075710 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 --2- 172.21.15.44:0/4110140020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3d5006de50 0x7f3d500c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 >> 172.21.15.44:0/4110140020 conn(0x7f3d500ccaa0 msgr2=0x7f3d50154a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 shutdown_connections 2024-09-17T05:44:29.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.641+0000 7f3d56000640 1 -- 172.21.15.44:0/4110140020 wait complete. 2024-09-17T05:44:29.662 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:44:29.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:29.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:44:29.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:44:29.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:29.731 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:44:29.749 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:44:29.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 -- 172.21.15.44:0/2695962110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 msgr2=0x7faacc165c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 --2- 172.21.15.44:0/2695962110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc165c50 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7faac4009bc0 tx=0x7faac401cba0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 -- 172.21.15.44:0/2695962110 shutdown_connections 2024-09-17T05:44:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 --2- 172.21.15.44:0/2695962110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc165c50 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 --2- 172.21.15.44:0/2695962110 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faacc15be30 0x7faacc06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 -- 172.21.15.44:0/2695962110 >> 172.21.15.44:0/2695962110 conn(0x7faacc0ccaa0 msgr2=0x7faacc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 -- 172.21.15.44:0/2695962110 shutdown_connections 2024-09-17T05:44:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.949+0000 7faad2c00640 1 -- 172.21.15.44:0/2695962110 wait complete. 2024-09-17T05:44:29.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 Processor -- start 2024-09-17T05:44:29.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 -- start start 2024-09-17T05:44:29.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0cac30 0x7faacc1f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faacc15be30 0x7faacc163e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faacc168fb0 con 0x7faacc0cf360 2024-09-17T05:44:29.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faacc168e30 con 0x7faacc0cac30 2024-09-17T05:44:29.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faacc169130 con 0x7faacc15be30 2024-09-17T05:44:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc0b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57726/0 (socket says 172.21.15.44:57726) 2024-09-17T05:44:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 -- 172.21.15.44:0/2740737725 learned_addr learned my addr 172.21.15.44:0/2740737725 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faacbe00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0cac30 0x7faacc1f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad0c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faacc15be30 0x7faacc163e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 -- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faacc15be30 msgr2=0x7faacc163e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faacc15be30 0x7faacc163e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 -- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0cac30 msgr2=0x7faacc1f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0cac30 0x7faacc1f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 -- 172.21.15.44:0/2740737725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc0b0d80 con 0x7faacc0cf360 2024-09-17T05:44:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac3e00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc0b0840 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7faab400c430 tx=0x7faab400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac8c00640 1 -- 172.21.15.44:0/2740737725 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4011790 con 0x7faacc0cf360 2024-09-17T05:44:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac8c00640 1 -- 172.21.15.44:0/2740737725 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab4017070 con 0x7faacc0cf360 2024-09-17T05:44:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faac8c00640 1 -- 172.21.15.44:0/2740737725 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4011ce0 con 0x7faacc0cf360 2024-09-17T05:44:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc0b1050 con 0x7faacc0cf360 2024-09-17T05:44:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.953+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc0b1610 con 0x7faacc0cf360 2024-09-17T05:44:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.957+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc0b1810 con 0x7faacc0cf360 2024-09-17T05:44:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.957+0000 7faac8c00640 1 -- 172.21.15.44:0/2740737725 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faab401c460 con 0x7faacc0cf360 2024-09-17T05:44:29.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.957+0000 7faac8c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faaa8073230 0x7faaa8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:29.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.957+0000 7faac8c00640 1 -- 172.21.15.44:0/2740737725 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7faab40942b0 con 0x7faacc0cf360 2024-09-17T05:44:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.957+0000 7faacbe00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faaa8073230 0x7faaa8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.957+0000 7faacbe00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faaa8073230 0x7faaa8075740 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faabc0058d0 tx=0x7faabc005860 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:29.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:29.961+0000 7faac8c00640 1 -- 172.21.15.44:0/2740737725 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faab405f0e0 con 0x7faacc0cf360 2024-09-17T05:44:30.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.169+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faacc0c2720 con 0x7faacc0cf360 2024-09-17T05:44:30.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faac8c00640 1 -- 172.21.15.44:0/2740737725 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5219 (secure 0 0 0) 0x7faab405e9e0 con 0x7faacc0cf360 2024-09-17T05:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:30.172 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":84,"btime":"2024-09-17T05:44:20:951293+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:44:20.372604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/3953022133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":3953022133},{"type":"v1","addr":"172.21.15.44:6835","nonce":3953022133}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7662,"qdb_cluster":[7662]},"id":7}]} 2024-09-17T05:44:30.172 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 84 2024-09-17T05:44:30.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faaa8073230 msgr2=0x7faaa8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faaa8073230 0x7faaa8075740 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faabc0058d0 tx=0x7faabc005860 comp rx=0 tx=0).stop 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 msgr2=0x7faacc0b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc0b0840 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7faab400c430 tx=0x7faab400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 shutdown_connections 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faacc15be30 0x7faacc163e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faacc0cf360 0x7faacc0b0840 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faaa8073230 0x7faaa8075740 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 --2- 172.21.15.44:0/2740737725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0cac30 0x7faacc1f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 >> 172.21.15.44:0/2740737725 conn(0x7faacc0ccaa0 msgr2=0x7faacc0a05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 shutdown_connections 2024-09-17T05:44:30.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.173+0000 7faad2c00640 1 -- 172.21.15.44:0/2740737725 wait complete. 2024-09-17T05:44:30.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-17T05:44:30.373 INFO:teuthology.orchestra.run.smithi044.stdout:{"message":"","return_code":0} 2024-09-17T05:44:30.374 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-17T05:44:30.374 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:44:30.374 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:44:30.383 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:44:30.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:44:30.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:30.383 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:44:30.434 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-17T05:44:30.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:44:30.435 DEBUG:teuthology.orchestra.run.smithi044:> sudo daemon-helper kill ceph --cluster ceph -w 2024-09-17T05:44:30.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:30.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-09-17T05:44:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 -- 172.21.15.44:0/45850518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a815d2f0 msgr2=0x7fd0a80cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 --2- 172.21.15.44:0/45850518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a815d2f0 0x7fd0a80cef60 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8073eb0 tx=0x7fd09001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 -- 172.21.15.44:0/45850518 shutdown_connections 2024-09-17T05:44:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 --2- 172.21.15.44:0/45850518 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0a815d700 0x7fd0a80cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 --2- 172.21.15.44:0/45850518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a815d2f0 0x7fd0a80cef60 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 --2- 172.21.15.44:0/45850518 >> v2:172.21.15.86:3300/0 conn(0x7fd0a80d1be0 0x7fd0a8160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 -- 172.21.15.44:0/45850518 >> 172.21.15.44:0/45850518 conn(0x7fd0a80b41a0 msgr2=0x7fd0a80b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 -- 172.21.15.44:0/45850518 shutdown_connections 2024-09-17T05:44:30.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.645+0000 7fd0ad600640 1 -- 172.21.15.44:0/45850518 wait complete. 2024-09-17T05:44:30.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 Processor -- start 2024-09-17T05:44:30.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 -- start start 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a80d1be0 0x7fd0a8142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0a815d2f0 0x7fd0a80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0a815d700 0x7fd0a80b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a80d0790 con 0x7fd0a80d1be0 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a80d0610 con 0x7fd0a815d2f0 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a80d0910 con 0x7fd0a815d700 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a80d1be0 0x7fd0a8142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a80d1be0 0x7fd0a8142500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57732/0 (socket says 172.21.15.44:57732) 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 -- 172.21.15.44:0/1964922900 learned_addr learned my addr 172.21.15.44:0/1964922900 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd09fe00640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0a815d2f0 0x7fd0a80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a7400640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0a815d700 0x7fd0a80b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 -- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0a815d700 msgr2=0x7fd0a80b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0a815d700 0x7fd0a80b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 -- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0a815d2f0 msgr2=0x7fd0a80b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0a815d2f0 0x7fd0a80b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 -- 172.21.15.44:0/1964922900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a806e770 con 0x7fd0a80d1be0 2024-09-17T05:44:30.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a80d1be0 0x7fd0a8142500 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fd09800d660 tx=0x7fd09800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd09ea00640 1 -- 172.21.15.44:0/1964922900 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098017070 con 0x7fd0a80d1be0 2024-09-17T05:44:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd09ea00640 1 -- 172.21.15.44:0/1964922900 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd098005310 con 0x7fd0a80d1be0 2024-09-17T05:44:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a8142d50 con 0x7fd0a80d1be0 2024-09-17T05:44:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd09ea00640 1 -- 172.21.15.44:0/1964922900 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098009820 con 0x7fd0a80d1be0 2024-09-17T05:44:30.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.649+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a8143310 con 0x7fd0a80d1be0 2024-09-17T05:44:30.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.653+0000 7fd09ea00640 1 -- 172.21.15.44:0/1964922900 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd0980099c0 con 0x7fd0a80d1be0 2024-09-17T05:44:30.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.653+0000 7fd09ea00640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd084073200 0x7fd084075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.653+0000 7fd09ea00640 1 -- 172.21.15.44:0/1964922900 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fd0980943c0 con 0x7fd0a80d1be0 2024-09-17T05:44:30.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.653+0000 7fd09fe00640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd084073200 0x7fd084075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 Processor -- start 2024-09-17T05:44:30.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd09fe00640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd084073200 0x7fd084075710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd0900af000 tx=0x7fd09001b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 -- start start 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce68640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547ce68b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd01970 0x56547ce690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56547cc2dbd0 con 0x56547cd01970 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56547cc1e430 con 0x56547cd17ae0 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56547cc7bce0 con 0x56547cd1f1a0 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd01970 0x56547ce690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd01970 0x56547ce690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57736/0 (socket says 172.21.15.44:57736) 2024-09-17T05:44:30.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 -- 172.21.15.44:0/3396879470 learned_addr learned my addr 172.21.15.44:0/3396879470 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd09fe00640 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547ce68b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce68640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 -- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 msgr2=0x56547ce68640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce68640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 -- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 msgr2=0x56547ce68b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547ce68b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 -- 172.21.15.44:0/3396879470 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547cc1fd80 con 0x56547cd01970 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd0a7400640 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd01970 0x56547ce690c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009e10 tx=0x7fd0a0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df77b5b6da9aa19c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd097000640 1 -- 172.21.15.44:0/3396879470 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0016070 con 0x56547cd01970 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd097000640 1 -- 172.21.15.44:0/3396879470 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0a001b750 con 0x56547cd01970 2024-09-17T05:44:30.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.657+0000 7fd097000640 1 -- 172.21.15.44:0/3396879470 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a001bb20 con 0x56547cd01970 2024-09-17T05:44:30.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/3396879470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd01970 msgr2=0x56547ce690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd01970 0x56547ce690c0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009e10 tx=0x7fd0a0010740 comp rx=0 tx=0).stop 2024-09-17T05:44:30.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/3396879470 shutdown_connections 2024-09-17T05:44:30.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd01970 0x56547ce690c0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547ce68b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/3396879470 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce68640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/3396879470 >> 172.21.15.44:0/3396879470 conn(0x56547cd258c0 msgr2=0x56547ce1d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/3396879470 shutdown_connections 2024-09-17T05:44:30.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/3396879470 wait complete. 2024-09-17T05:44:30.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- start start 2024-09-17T05:44:30.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 Processor -- start 2024-09-17T05:44:30.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce24640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd17ae0 0x56547ce24b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce53f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56547cc6ef20 con 0x56547cd17ae0 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56547cc6b110 con 0x56547cd01970 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56547cc106d0 con 0x56547cd1f1a0 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0b4b5c000 10 client.0 _ll_register_callbacks cb 0x56547cc0f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd09fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd17ae0 0x56547ce24b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd09fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd17ae0 0x56547ce24b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57750/0 (socket says 172.21.15.44:57750) 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd09fe00640 1 -- 172.21.15.44:0/2405670761 learned_addr learned my addr 172.21.15.44:0/2405670761 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0a7400640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce53f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.661+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce24640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd09fe00640 1 -- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 msgr2=0x56547ce53f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd09fe00640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce53f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd09fe00640 1 -- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 msgr2=0x56547ce24640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd09fe00640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce24640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd09fe00640 1 -- 172.21.15.44:0/2405670761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56547cc09310 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce24640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd09fe00640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd17ae0 0x56547ce24b80 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd0900b0040 tx=0x7fd09001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d78279a610368c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 1 -- 172.21.15.44:0/2405670761 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0900ca060 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 1 -- 172.21.15.44:0/2405670761 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fd090005240 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56547cc03450 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 1 -- 172.21.15.44:0/2405670761 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fd090005440 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 10 client.7851 fetch_fsmap learned FSMap version 84 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x56547cc26f60 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 1 -- 172.21.15.44:0/2405670761 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56547cc03450 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 1 -- 172.21.15.44:0/2405670761 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fd0900046d0 con 0x56547cd17ae0 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 10 client.7851 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:44:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 10 client.7851 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:44:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 20 client.7851 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c90db80 0x56547ce6f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 4 client.7851 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:44:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56547cc7dc30 con 0x56547c90db80 2024-09-17T05:44:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c90db80 0x56547ce6f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 10 client.7851 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c90db80 0x56547ce6f8c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b328da69b25804 server_cookie=937ea55c713c8513 in_seq=0 out_seq=0 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 1 -- 172.21.15.44:0/2405670761 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56547cc7dc30 con 0x56547c90db80 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 10 client.7851 handle_command_reply: tid=0 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 client.7851 shutdown 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd17ae0 msgr2=0x56547ce24b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd17ae0 0x56547ce24b80 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd0900b0040 tx=0x7fd09001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 shutdown_connections 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c90db80 0x56547ce6f8c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd1f1a0 0x56547ce53f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd17ae0 0x56547ce24b80 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/2405670761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce24640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 >> 172.21.15.44:0/2405670761 conn(0x56547cd258c0 msgr2=0x56547ce1dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.665+0000 7fd08b400640 0 client.7851 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.669+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 shutdown_connections 2024-09-17T05:44:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.669+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/2405670761 wait complete. 2024-09-17T05:44:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.669+0000 7fd0b4b5c000 20 client.7851 trim_cache size 0 max 16384 2024-09-17T05:44:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 -- 172.21.15.44:0/601904219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaf40cd2a0 msgr2=0x7faaf40b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 --2- 172.21.15.44:0/601904219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaf40cd2a0 0x7faaf40b2420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faae0009840 tx=0x7faae001c790 comp rx=0 tx=0).stop 2024-09-17T05:44:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 -- 172.21.15.44:0/601904219 shutdown_connections 2024-09-17T05:44:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 --2- 172.21.15.44:0/601904219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaf40cd2a0 0x7faaf40b2420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 -- 172.21.15.44:0/601904219 >> 172.21.15.44:0/601904219 conn(0x7faaf40d2330 msgr2=0x7faaf40d2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 -- 172.21.15.44:0/601904219 shutdown_connections 2024-09-17T05:44:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 -- 172.21.15.44:0/601904219 wait complete. 2024-09-17T05:44:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 Processor -- start 2024-09-17T05:44:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.673+0000 7faaf9200640 1 -- start start 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaf40d11f0 0x7faaf406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaf40d1600 0x7faaf40b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaf40718e0 0x7faaf40c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faaf416af70 con 0x7faaf40d11f0 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faaf416adf0 con 0x7faaf40d1600 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faaf416b0f0 con 0x7faaf40718e0 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaf40d11f0 0x7faaf406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaf40d11f0 0x7faaf406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57766/0 (socket says 172.21.15.44:57766) 2024-09-17T05:44:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 -- 172.21.15.44:0/3901621729 learned_addr learned my addr 172.21.15.44:0/3901621729 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1400640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaf40d1600 0x7faaf40b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf2800640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaf40718e0 0x7faaf40c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 -- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaf40718e0 msgr2=0x7faaf40c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faaf40718e0 0x7faaf40c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 -- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaf40d1600 msgr2=0x7faaf40b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaf40d1600 0x7faaf40b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 -- 172.21.15.44:0/3901621729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf406e490 con 0x7faaf40d11f0 2024-09-17T05:44:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf1e00640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faaf40d11f0 0x7faaf406df50 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7faae400c420 tx=0x7faae400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4017070 con 0x7faaf40d11f0 2024-09-17T05:44:30.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 -- 172.21.15.44:0/3901621729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf40aff20 con 0x7faaf40d11f0 2024-09-17T05:44:30.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faae40053c0 con 0x7faaf40d11f0 2024-09-17T05:44:30.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4003860 con 0x7faaf40d11f0 2024-09-17T05:44:30.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 -- 172.21.15.44:0/3901621729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf40b04e0 con 0x7faaf40d11f0 2024-09-17T05:44:30.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.677+0000 7faaf9200640 1 -- 172.21.15.44:0/3901621729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7faaf40ccb90 con 0x7faaf40d11f0 2024-09-17T05:44:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.681+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faae401a070 con 0x7faaf40d11f0 2024-09-17T05:44:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.681+0000 7faaea000640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faad4073230 0x7faad4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.681+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7faae40936f0 con 0x7faaf40d11f0 2024-09-17T05:44:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.681+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+501 (secure 0 0 0) 0x7faae4096210 con 0x7faaf40d11f0 2024-09-17T05:44:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.681+0000 7faaf1400640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faad4073230 0x7faad4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.681+0000 7faaf9200640 1 -- 172.21.15.44:0/3901621729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7faaf40b16c0 con 0x7faaf40d11f0 2024-09-17T05:44:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.681+0000 7faaf1400640 1 --2- 172.21.15.44:0/3901621729 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faad4073230 0x7faad4075740 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7faae00af000 tx=0x7faae0019530 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.685+0000 7fd0b4b5c000 1 Processor -- start 2024-09-17T05:44:30.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.685+0000 7fd0b4b5c000 1 -- start start 2024-09-17T05:44:30.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce21370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd17ae0 0x56547ce80280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547ce807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a8205770 con 0x56547cd1f1a0 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a8204790 con 0x56547cd01970 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a806fbe0 con 0x56547cd17ae0 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547ce807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547ce807c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57782/0 (socket says 172.21.15.44:57782) 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 -- 172.21.15.44:0/1290124838 learned_addr learned my addr 172.21.15.44:0/1290124838 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce21370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd09fe00640 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd17ae0 0x56547ce80280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 -- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd17ae0 msgr2=0x56547ce80280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd17ae0 0x56547ce80280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 -- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 msgr2=0x56547ce21370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce21370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 -- 172.21.15.44:0/1290124838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56547cceff30 con 0x56547cd1f1a0 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0a7400640 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547ce807c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x56547cc15800 tx=0x7fd0a0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780a2d5f682abf7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd096600640 1 -- 172.21.15.44:0/1290124838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0016040 con 0x56547cd1f1a0 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd096600640 1 -- 172.21.15.44:0/1290124838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0a0009810 con 0x56547cd1f1a0 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd096600640 1 -- 172.21.15.44:0/1290124838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a001b930 con 0x56547cd1f1a0 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/1290124838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 msgr2=0x56547ce807c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547ce807c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x56547cc15800 tx=0x7fd0a0004a50 comp rx=0 tx=0).stop 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/1290124838 shutdown_connections 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547ce807c0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd17ae0 0x56547ce80280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/1290124838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd01970 0x56547ce21370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/1290124838 >> 172.21.15.44:0/1290124838 conn(0x56547cd258c0 msgr2=0x56547ce676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/1290124838 shutdown_connections 2024-09-17T05:44:30.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.689+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/1290124838 wait complete. 2024-09-17T05:44:30.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 -- start start 2024-09-17T05:44:30.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 Processor -- start 2024-09-17T05:44:30.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd01970 0x56547cedde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547cede3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547cede8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56547cc73550 con 0x56547cd1f1a0 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56547cc6b110 con 0x56547cd17ae0 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56547cc33310 con 0x56547cd01970 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 10 client.0 _ll_register_callbacks cb 0x7fd090009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547cede8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547cede8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57784/0 (socket says 172.21.15.44:57784) 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 -- 172.21.15.44:0/4289905132 learned_addr learned my addr 172.21.15.44:0/4289905132 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd09fe00640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547cede3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd01970 0x56547cedde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 -- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd01970 msgr2=0x56547cedde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd01970 0x56547cedde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 -- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 msgr2=0x56547cede3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547cede3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 -- 172.21.15.44:0/4289905132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56547ccc6dd0 con 0x56547cd1f1a0 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd09fe00640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547cede3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0a7400640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547cede8f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x56547cdff440 tx=0x7fd0a0012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd91b4a05bb1c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd08b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd08b400640 1 -- 172.21.15.44:0/4289905132 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0016040 con 0x56547cd1f1a0 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0a0009810 con 0x56547cd1f1a0 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd08b400640 1 -- 172.21.15.44:0/4289905132 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7fd0a0004b30 con 0x56547cd1f1a0 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd08b400640 1 -- 172.21.15.44:0/4289905132 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fd0a0004d30 con 0x56547cd1f1a0 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 10 client.7863 fetch_fsmap learned FSMap version 84 2024-09-17T05:44:30.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x56547cc01840 con 0x56547cd1f1a0 2024-09-17T05:44:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.693+0000 7fd08b400640 1 -- 172.21.15.44:0/4289905132 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0a0009810 con 0x56547cd1f1a0 2024-09-17T05:44:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd08b400640 1 -- 172.21.15.44:0/4289905132 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fd0a003c080 con 0x56547cd1f1a0 2024-09-17T05:44:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 10 client.7863 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:44:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 10 client.7863 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:44:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 20 client.7863 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:30.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c8fbbe0 0x56547ce1dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 4 client.7863 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x56547cc796e0 con 0x56547c8fbbe0 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c8fbbe0 0x56547ce1dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0a6a00640 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c8fbbe0 0x56547ce1dff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f71d9e199696c4d server_cookie=848950a113f60508 in_seq=0 out_seq=0 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd08b400640 10 client.7863 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd08b400640 1 -- 172.21.15.44:0/4289905132 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56547cc796e0 con 0x56547c8fbbe0 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd08b400640 10 client.7863 handle_command_reply: tid=0 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 client.7863 shutdown 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 msgr2=0x56547cede8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547cede8f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x56547cdff440 tx=0x7fd0a0012660 comp rx=0 tx=0).stop 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 shutdown_connections 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56547c8fbbe0 0x56547ce1dff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56547cd1f1a0 0x56547cede8f0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56547cd17ae0 0x56547cede3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 --2- 172.21.15.44:0/4289905132 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56547cd01970 0x56547cedde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd08b400640 0 client.7863 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 >> 172.21.15.44:0/4289905132 conn(0x56547cd258c0 msgr2=0x56547ce67e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 shutdown_connections 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 1 -- 172.21.15.44:0/4289905132 wait complete. 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0b4b5c000 20 client.7863 trim_cache size 0 max 16384 2024-09-17T05:44:30.700 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "33071b56-81bf-4be4-b9f6-238cae7c959a", 2024-09-17T05:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:44:30.701 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:44:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd084073200 msgr2=0x7fd084075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd084073200 0x7fd084075710 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd0900af000 tx=0x7fd09001b100 comp rx=0 tx=0).stop 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a80d1be0 msgr2=0x7fd0a8142500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a80d1be0 0x7fd0a8142500 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fd09800d660 tx=0x7fd09800db20 comp rx=0 tx=0).stop 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 shutdown_connections 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd0a815d700 0x7fd0a80b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd084073200 0x7fd084075710 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0a815d2f0 0x7fd0a80b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 --2- 172.21.15.44:0/1964922900 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0a80d1be0 0x7fd0a8142500 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.697+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 >> 172.21.15.44:0/1964922900 conn(0x7fd0a80b41a0 msgr2=0x7fd0a80b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.701+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 shutdown_connections 2024-09-17T05:44:30.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.701+0000 7fd0ad600640 1 -- 172.21.15.44:0/1964922900 wait complete. 2024-09-17T05:44:30.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:44:30.718 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 -- 172.21.15.44:0/2928365413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 msgr2=0x7f80640cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 --2- 172.21.15.44:0/2928365413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f80640cb880 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f80640cb0b0 tx=0x7f805c01caf0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 -- 172.21.15.44:0/2928365413 shutdown_connections 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 --2- 172.21.15.44:0/2928365413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f80640cb880 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 --2- 172.21.15.44:0/2928365413 >> v2:172.21.15.86:3300/0 conn(0x7f806406de50 0x7f806406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 -- 172.21.15.44:0/2928365413 >> 172.21.15.44:0/2928365413 conn(0x7f80640ccaa0 msgr2=0x7f80640cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 -- 172.21.15.44:0/2928365413 shutdown_connections 2024-09-17T05:44:30.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 -- 172.21.15.44:0/2928365413 wait complete. 2024-09-17T05:44:30.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 Processor -- start 2024-09-17T05:44:30.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.881+0000 7f8068a00640 1 -- start start 2024-09-17T05:44:30.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f806406de50 0x7f8064155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8064072e50 0x7f8064159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f806415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8064168e30 con 0x7f80640cb470 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8064168cb0 con 0x7f8064072e50 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8064168fb0 con 0x7f806406de50 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f806415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f806415a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57796/0 (socket says 172.21.15.44:57796) 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 -- 172.21.15.44:0/130087508 learned_addr learned my addr 172.21.15.44:0/130087508 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8059400640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8064072e50 0x7f8064159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8061e00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f806406de50 0x7f8064155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 -- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f806406de50 msgr2=0x7f8064155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f806406de50 0x7f8064155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 -- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8064072e50 msgr2=0x7f8064159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8064072e50 0x7f8064159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 -- 172.21.15.44:0/130087508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80640a12d0 con 0x7f80640cb470 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8061e00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f806406de50 0x7f8064155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:30.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8062800640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f806415a3c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f805c01c560 tx=0x7f805c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f805aa00640 1 -- 172.21.15.44:0/130087508 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0ba020 con 0x7f80640cb470 2024-09-17T05:44:30.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f805aa00640 1 -- 172.21.15.44:0/130087508 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f805c004130 con 0x7f80640cb470 2024-09-17T05:44:30.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806409d600 con 0x7f80640cb470 2024-09-17T05:44:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f805aa00640 1 -- 172.21.15.44:0/130087508 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0b2040 con 0x7f80640cb470 2024-09-17T05:44:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.885+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80641f9d40 con 0x7f80640cb470 2024-09-17T05:44:30.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.889+0000 7f805aa00640 1 -- 172.21.15.44:0/130087508 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f805c0bd020 con 0x7f80640cb470 2024-09-17T05:44:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.889+0000 7f805aa00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8040073230 0x7f8040075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.889+0000 7f805aa00640 1 -- 172.21.15.44:0/130087508 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f805c12ea50 con 0x7f80640cb470 2024-09-17T05:44:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.889+0000 7f806ff59000 1 Processor -- start 2024-09-17T05:44:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.889+0000 7f8061e00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8040073230 0x7f8040075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.889+0000 7f806ff59000 1 -- start start 2024-09-17T05:44:30.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.889+0000 7f8061e00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8040073230 0x7f8040075740 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8054001400 tx=0x7f8054009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132aed69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132a9c1890 0x56132aed6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132aa85aa0 0x56132aed7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56132ad75cd0 con 0x56132a9c1890 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56132ac8b330 con 0x56132ad6a6d0 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56132ace8bb0 con 0x56132aa85aa0 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132a9c1890 0x56132aed6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132a9c1890 0x56132aed6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57812/0 (socket says 172.21.15.44:57812) 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 -- 172.21.15.44:0/3890688300 learned_addr learned my addr 172.21.15.44:0/3890688300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8061e00640 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132aed69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8062800640 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132aa85aa0 0x56132aed7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 -- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132aa85aa0 msgr2=0x56132aed7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132aa85aa0 0x56132aed7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 -- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 msgr2=0x56132aed69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132aed69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 -- 172.21.15.44:0/3890688300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132ac8cc80 con 0x56132a9c1890 2024-09-17T05:44:30.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8059400640 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132a9c1890 0x56132aed6f30 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f804c009c10 tx=0x7f804c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da902cabf48c5e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8052600640 1 -- 172.21.15.44:0/3890688300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c01e070 con 0x56132a9c1890 2024-09-17T05:44:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8052600640 1 -- 172.21.15.44:0/3890688300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f804c019720 con 0x56132a9c1890 2024-09-17T05:44:30.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f8052600640 1 -- 172.21.15.44:0/3890688300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c019b70 con 0x56132a9c1890 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- 172.21.15.44:0/3890688300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132a9c1890 msgr2=0x56132aed6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132a9c1890 0x56132aed6f30 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f804c009c10 tx=0x7f804c011810 comp rx=0 tx=0).stop 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- 172.21.15.44:0/3890688300 shutdown_connections 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132aa85aa0 0x56132aed7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132a9c1890 0x56132aed6f30 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 --2- 172.21.15.44:0/3890688300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132aed69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- 172.21.15.44:0/3890688300 >> 172.21.15.44:0/3890688300 conn(0x56132a9955c0 msgr2=0x56132ae93ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- 172.21.15.44:0/3890688300 shutdown_connections 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- 172.21.15.44:0/3890688300 wait complete. 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 -- start start 2024-09-17T05:44:30.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.893+0000 7f806ff59000 1 Processor -- start 2024-09-17T05:44:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132ae929b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132ae92ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132ae995f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56132acdbdf0 con 0x56132aa85aa0 2024-09-17T05:44:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56132acd7fe0 con 0x56132ad6a6d0 2024-09-17T05:44:30.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56132ac7d4d0 con 0x56132a9c1890 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 10 client.0 _ll_register_callbacks cb 0x56132ac5b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132ae92ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132ae92ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57826/0 (socket says 172.21.15.44:57826) 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 -- 172.21.15.44:0/461988443 learned_addr learned my addr 172.21.15.44:0/461988443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8061e00640 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132ae929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8062800640 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132ae995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 -- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 msgr2=0x56132ae929b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132ae929b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 -- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 msgr2=0x56132ae995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132ae995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 -- 172.21.15.44:0/461988443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56132ac76210 con 0x56132aa85aa0 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8059400640 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132ae92ef0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x56132ad8b760 tx=0x7f804c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2be4ed70d5d93af server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8046a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8046a00640 1 -- 172.21.15.44:0/461988443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c028070 con 0x56132aa85aa0 2024-09-17T05:44:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8046a00640 1 -- 172.21.15.44:0/461988443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f804c019d90 con 0x56132aa85aa0 2024-09-17T05:44:30.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56132ac70350 con 0x56132aa85aa0 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8046a00640 1 -- 172.21.15.44:0/461988443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f804c032050 con 0x56132aa85aa0 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 10 client.7878 fetch_fsmap learned FSMap version 84 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x56132ac5cfc0 con 0x56132aa85aa0 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8046a00640 1 -- 172.21.15.44:0/461988443 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56132ac70350 con 0x56132aa85aa0 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8046a00640 1 -- 172.21.15.44:0/461988443 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f804c035020 con 0x56132aa85aa0 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 10 client.7878 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 10 client.7878 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 20 client.7878 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a97a930 0x56132aedde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 4 client.7878 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56132aceab00 con 0x56132a97a930 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.897+0000 7f8061e00640 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a97a930 0x56132aedde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f8061e00640 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a97a930 0x56132aedde80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d945812b5f34086e server_cookie=94508d32978c0bc6 in_seq=0 out_seq=0 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f8046a00640 10 client.7878 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f8046a00640 1 -- 172.21.15.44:0/461988443 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56132aceab00 con 0x56132a97a930 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f8046a00640 10 client.7878 handle_command_reply: tid=0 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 client.7878 shutdown 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 msgr2=0x56132ae92ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132ae92ef0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x56132ad8b760 tx=0x7f804c019810 comp rx=0 tx=0).stop 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 shutdown_connections 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a97a930 0x56132aedde80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132ae995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132ae92ef0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 --2- 172.21.15.44:0/461988443 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132ae929b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f8046a00640 0 client.7878 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 >> 172.21.15.44:0/461988443 conn(0x56132a9955c0 msgr2=0x56132ae8bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 shutdown_connections 2024-09-17T05:44:30.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 1 -- 172.21.15.44:0/461988443 wait complete. 2024-09-17T05:44:30.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.901+0000 7f806ff59000 20 client.7878 trim_cache size 0 max 16384 2024-09-17T05:44:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 Processor -- start 2024-09-17T05:44:30.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 -- start start 2024-09-17T05:44:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af48400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132aa85aa0 0x56132af48940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132ad6a6d0 0x56132af48e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56132ae91b20 con 0x56132ad6a6d0 2024-09-17T05:44:30.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8064205ae0 con 0x56132aa85aa0 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8064204ac0 con 0x56132a9c1890 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132ad6a6d0 0x56132af48e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132ad6a6d0 0x56132af48e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57838/0 (socket says 172.21.15.44:57838) 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 -- 172.21.15.44:0/3795341316 learned_addr learned my addr 172.21.15.44:0/3795341316 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8059400640 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132aa85aa0 0x56132af48940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8061e00640 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af48400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 -- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 msgr2=0x56132af48400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af48400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 -- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132aa85aa0 msgr2=0x56132af48940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132aa85aa0 0x56132af48940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 -- 172.21.15.44:0/3795341316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132ad35680 con 0x56132ad6a6d0 2024-09-17T05:44:30.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8061e00640 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af48400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8062800640 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132ad6a6d0 0x56132af48e80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f805c0f8ed0 tx=0x7f805c100040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83b7cc0d20bef05 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8051c00640 1 -- 172.21.15.44:0/3795341316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0f8ce0 con 0x56132ad6a6d0 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8051c00640 1 -- 172.21.15.44:0/3795341316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f805c0f91d0 con 0x56132ad6a6d0 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f8051c00640 1 -- 172.21.15.44:0/3795341316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c0fdcb0 con 0x56132ad6a6d0 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 -- 172.21.15.44:0/3795341316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132ad6a6d0 msgr2=0x56132af48e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.921+0000 7f806ff59000 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132ad6a6d0 0x56132af48e80 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f805c0f8ed0 tx=0x7f805c100040 comp rx=0 tx=0).stop 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- 172.21.15.44:0/3795341316 shutdown_connections 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132ad6a6d0 0x56132af48e80 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132aa85aa0 0x56132af48940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 --2- 172.21.15.44:0/3795341316 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af48400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- 172.21.15.44:0/3795341316 >> 172.21.15.44:0/3795341316 conn(0x56132a9955c0 msgr2=0x56132aee8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- 172.21.15.44:0/3795341316 shutdown_connections 2024-09-17T05:44:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- 172.21.15.44:0/3795341316 wait complete. 2024-09-17T05:44:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- start start 2024-09-17T05:44:30.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 Processor -- start 2024-09-17T05:44:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af4c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132af4c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132af4cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f80641fd0f0 con 0x56132aa85aa0 2024-09-17T05:44:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f80640a1060 con 0x56132ad6a6d0 2024-09-17T05:44:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56132a99d680 con 0x56132a9c1890 2024-09-17T05:44:30.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f806ff59000 10 client.0 _ll_register_callbacks cb 0x7f804c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132af4c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132af4c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57846/0 (socket says 172.21.15.44:57846) 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 -- 172.21.15.44:0/821776473 learned_addr learned my addr 172.21.15.44:0/821776473 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8061e00640 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af4c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8062800640 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132af4cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 -- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 msgr2=0x56132af4c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af4c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 -- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 msgr2=0x56132af4cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132af4cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 -- 172.21.15.44:0/821776473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56132aca20b0 con 0x56132aa85aa0 2024-09-17T05:44:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8059400640 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132af4c980 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f804c009810 tx=0x7f804c005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8194cc0099a2fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:44:30.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8046a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.925+0000 7f8046a00640 1 -- 172.21.15.44:0/821776473 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c028070 con 0x56132aa85aa0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 1 -- 172.21.15.44:0/821776473 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 6101+0+0 (secure 0 0 0) 0x7f804c037c30 con 0x56132aa85aa0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f805c0f91d0 con 0x56132aa85aa0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 1 -- 172.21.15.44:0/821776473 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f804c03d050 con 0x56132aa85aa0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 10 client.7884 fetch_fsmap learned FSMap version 84 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x56132ac6e610 con 0x56132aa85aa0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 1 -- 172.21.15.44:0/821776473 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f805c0f91d0 con 0x56132aa85aa0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 1 -- 172.21.15.44:0/821776473 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f804c040020 con 0x56132aa85aa0 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 10 client.7884 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 10 client.7884 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 20 client.7884 populate_metadata read hostname 'smithi044' 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a968990 0x56132ae8d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 4 client.7884 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:44:30.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56132ace65b0 con 0x56132a968990 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8061e00640 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a968990 0x56132ae8d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8061e00640 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a968990 0x56132ae8d8c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=730611c35ad9eb3e server_cookie=b8d3381b82c71539 in_seq=0 out_seq=0 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 10 client.7884 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 1 -- 172.21.15.44:0/821776473 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x56132ace65b0 con 0x56132a968990 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 10 client.7884 handle_command_reply: tid=0 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 client.7884 shutdown 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 msgr2=0x56132af4c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132af4c980 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f804c009810 tx=0x7f804c005320 comp rx=0 tx=0).stop 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 shutdown_connections 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56132a968990 0x56132ae8d8c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56132ad6a6d0 0x56132af4cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56132aa85aa0 0x56132af4c980 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 --2- 172.21.15.44:0/821776473 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56132a9c1890 0x56132af4c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 >> 172.21.15.44:0/821776473 conn(0x56132a9955c0 msgr2=0x56132ae985a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8046a00640 0 client.7884 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 shutdown_connections 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 1 -- 172.21.15.44:0/821776473 wait complete. 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f806ff59000 20 client.7884 trim_cache size 0 max 16384 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:44:30.932 INFO:teuthology.orchestra.run.smithi044.stdout: "33071b56-81bf-4be4-b9f6-238cae7c959a": { 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "33071b56-81bf-4be4-b9f6-238cae7c959a", 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive,repair" 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "33071b56-81bf-4be4-b9f6-238cae7c959a": { 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:44:30.697455+0000", 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:44:30.933 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:44:30.934 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:44:30.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8040073230 msgr2=0x7f8040075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8040073230 0x7f8040075740 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8054001400 tx=0x7f8054009040 comp rx=0 tx=0).stop 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 msgr2=0x7f806415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f806415a3c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f805c01c560 tx=0x7f805c003f40 comp rx=0 tx=0).stop 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 shutdown_connections 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80640cb470 0x7f806415a3c0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8040073230 0x7f8040075740 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8064072e50 0x7f8064159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 --2- 172.21.15.44:0/130087508 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f806406de50 0x7f8064155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 >> 172.21.15.44:0/130087508 conn(0x7f80640ccaa0 msgr2=0x7f8064156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 shutdown_connections 2024-09-17T05:44:30.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:30.929+0000 7f8068a00640 1 -- 172.21.15.44:0/130087508 wait complete. 2024-09-17T05:44:30.949 INFO:tasks.cephfs.filesystem:scrub status for tag:33071b56-81bf-4be4-b9f6-238cae7c959a - {'path': '/', 'tag': '33071b56-81bf-4be4-b9f6-238cae7c959a', 'options': 'recursive,repair'} 2024-09-17T05:44:31.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:31.989+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 7 ==== log(4 entries from seq 1 at 2024-09-17T05:44:30.699930+0000) ==== 695+0+0 (secure 0 0 0) 0x7faae4096000 con 0x7faaf40d11f0 2024-09-17T05:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout: cluster: 2024-09-17T05:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout: id: 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout: health: HEALTH_OK 2024-09-17T05:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout: services: 2024-09-17T05:44:31.991 INFO:teuthology.orchestra.run.smithi044.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: mgr: x(active, since 8m), standbys: y 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: mds: 1/1 daemons up, 3 standby 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: data: 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: volumes: 1/1 healthy 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: pools: 3 pools, 97 pgs 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: objects: 26 objects, 6.6 MiB 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: usage: 263 MiB used, 720 GiB / 720 GiB avail 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: pgs: 97 active+clean 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: io: 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: client: 617 KiB/s wr, 0 op/s rd, 5 op/s wr 2024-09-17T05:44:31.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:44:30.699930+0000 mds.c [INF] scrub queued for path: / 2024-09-17T05:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:44:30.699934+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-09-17T05:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:44:30.699941+0000 mds.c [INF] scrub summary: active paths [/] 2024-09-17T05:44:31.993 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:44:30.701805+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-09-17T05:44:34.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:34.997+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 8 ==== log(1 entries from seq 5 at 2024-09-17T05:44:33.593828+0000) ==== 189+0+0 (secure 0 0 0) 0x7faae4091b00 con 0x7faaf40d11f0 2024-09-17T05:44:34.997 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:44:33.593828+0000 mds.c [INF] scrub summary: idle 2024-09-17T05:44:43.629 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:43.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:44:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:58.065+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 9 ==== log(8 entries from seq 167 at 2024-09-17T05:44:57.881810+0000) ==== 2202+0+0 (secure 0 0 0) 0x7faae405e100 con 0x7faaf40d11f0 2024-09-17T05:44:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:44:59.073+0000 7faaea000640 1 -- 172.21.15.44:0/3901621729 <== mon.0 v2:172.21.15.44:3300/0 10 ==== log(4 entries from seq 916 at 2024-09-17T05:44:58.053649+0000) ==== 1082+0+0 (secure 0 0 0) 0x7faae40672f0 con 0x7faaf40d11f0 2024-09-17T05:45:00.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:00.951 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 -- 172.21.15.44:0/2346577785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec006de50 msgr2=0x7faec006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 --2- 172.21.15.44:0/2346577785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec006de50 0x7faec006e260 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7faec00cff10 tx=0x7faeac01c830 comp rx=0 tx=0).stop 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 -- 172.21.15.44:0/2346577785 shutdown_connections 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 --2- 172.21.15.44:0/2346577785 >> v2:172.21.15.86:3300/0 conn(0x7faec00ced00 0x7faec00cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 --2- 172.21.15.44:0/2346577785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec006de50 0x7faec006e260 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 --2- 172.21.15.44:0/2346577785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faec0072e50 0x7faec015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 -- 172.21.15.44:0/2346577785 >> 172.21.15.44:0/2346577785 conn(0x7faec00ccaa0 msgr2=0x7faec00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 -- 172.21.15.44:0/2346577785 shutdown_connections 2024-09-17T05:45:01.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 -- 172.21.15.44:0/2346577785 wait complete. 2024-09-17T05:45:01.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 Processor -- start 2024-09-17T05:45:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.129+0000 7faec8600640 1 -- start start 2024-09-17T05:45:01.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faec006de50 0x7faec01f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec0072e50 0x7faec00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faec00ced00 0x7faec00c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faec00cc310 con 0x7faec0072e50 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faec00cc190 con 0x7faec006de50 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faec00cc490 con 0x7faec00ced00 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec0072e50 0x7faec00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faec006de50 0x7faec01f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec0072e50 0x7faec00ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51170/0 (socket says 172.21.15.44:51170) 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 -- 172.21.15.44:0/338972830 learned_addr learned my addr 172.21.15.44:0/338972830 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec6600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faec00ced00 0x7faec00c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 -- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faec00ced00 msgr2=0x7faec00c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faec00ced00 0x7faec00c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 -- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faec006de50 msgr2=0x7faec01f8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faec006de50 0x7faec01f8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 -- 172.21.15.44:0/338972830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec00c81d0 con 0x7faec0072e50 2024-09-17T05:45:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec5200640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec0072e50 0x7faec00ce220 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7faeac01aee0 tx=0x7faeac0a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faebd600640 1 -- 172.21.15.44:0/338972830 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0bb070 con 0x7faec0072e50 2024-09-17T05:45:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faebd600640 1 -- 172.21.15.44:0/338972830 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeac0043b0 con 0x7faec0072e50 2024-09-17T05:45:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec00c7c10 con 0x7faec0072e50 2024-09-17T05:45:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faebd600640 1 -- 172.21.15.44:0/338972830 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0b2040 con 0x7faec0072e50 2024-09-17T05:45:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.133+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec009f690 con 0x7faec0072e50 2024-09-17T05:45:01.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faebd600640 1 -- 172.21.15.44:0/338972830 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faeac0be070 con 0x7faec0072e50 2024-09-17T05:45:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faebd600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faea0073200 0x7faea0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 Processor -- start 2024-09-17T05:45:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faebd600640 1 -- 172.21.15.44:0/338972830 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6217+0+0 (secure 0 0 0) 0x7faeac12dbc0 con 0x7faec0072e50 2024-09-17T05:45:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 -- start start 2024-09-17T05:45:01.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faec5c00640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faea0073200 0x7faea0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faec5c00640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faea0073200 0x7faea0075710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faeb4005950 tx=0x7faeb4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db4a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db4af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d6f9aa0 0x56321db4b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56321d9e9cd0 con 0x56321d635890 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56321d8ff330 con 0x56321d6f9aa0 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.137+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56321d95cbb0 con 0x56321d9de6d0 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db4af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db4af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51180/0 (socket says 172.21.15.44:51180) 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 -- 172.21.15.44:0/1610813762 learned_addr learned my addr 172.21.15.44:0/1610813762 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5c00640 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db4a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec6600640 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d6f9aa0 0x56321db4b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 -- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 msgr2=0x56321db4a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db4a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 -- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d6f9aa0 msgr2=0x56321db4b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d6f9aa0 0x56321db4b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 -- 172.21.15.44:0/1610813762 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321d900c80 con 0x56321d635890 2024-09-17T05:45:01.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faec5200640 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db4af30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b0040 tx=0x7faeac0f7d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4005d60d7ee28c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faeb2000640 1 -- 172.21.15.44:0/1610813762 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0f8410 con 0x56321d635890 2024-09-17T05:45:01.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faeb2000640 1 -- 172.21.15.44:0/1610813762 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeac0fce40 con 0x56321d635890 2024-09-17T05:45:01.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faeb2000640 1 -- 172.21.15.44:0/1610813762 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac101cf0 con 0x56321d635890 2024-09-17T05:45:01.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 -- 172.21.15.44:0/1610813762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 msgr2=0x56321db4af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db4af30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7faeac0b0040 tx=0x7faeac0f7d60 comp rx=0 tx=0).stop 2024-09-17T05:45:01.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 -- 172.21.15.44:0/1610813762 shutdown_connections 2024-09-17T05:45:01.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d6f9aa0 0x56321db4b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db4af30 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 --2- 172.21.15.44:0/1610813762 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db4a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 -- 172.21.15.44:0/1610813762 >> 172.21.15.44:0/1610813762 conn(0x56321d6095c0 msgr2=0x56321db07ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 -- 172.21.15.44:0/1610813762 shutdown_connections 2024-09-17T05:45:01.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 -- 172.21.15.44:0/1610813762 wait complete. 2024-09-17T05:45:01.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 -- start start 2024-09-17T05:45:01.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.141+0000 7faecfe64000 1 Processor -- start 2024-09-17T05:45:01.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d635890 0x56321db51e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d6f9aa0 0x56321db523c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db52900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56321d94fdf0 con 0x56321d6f9aa0 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56321d94bfe0 con 0x56321d635890 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56321d8f14d0 con 0x56321d9de6d0 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 10 client.0 _ll_register_callbacks cb 0x56321d8cf7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d6f9aa0 0x56321db523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d6f9aa0 0x56321db523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51186/0 (socket says 172.21.15.44:51186) 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 -- 172.21.15.44:0/3522215071 learned_addr learned my addr 172.21.15.44:0/3522215071 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5c00640 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d635890 0x56321db51e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec6600640 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db52900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 -- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 msgr2=0x56321db52900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db52900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 -- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d635890 msgr2=0x56321db51e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d635890 0x56321db51e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 -- 172.21.15.44:0/3522215071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321d8ea210 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5200640 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d6f9aa0 0x56321db523c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7faeac01cd10 tx=0x7faeac0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b805dee6341fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faea6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faea6a00640 1 -- 172.21.15.44:0/3522215071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0fce40 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faea6a00640 1 -- 172.21.15.44:0/3522215071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6217+0+0 (secure 0 0 0) 0x7faeac0ff0c0 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56321d8e4350 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faea6a00640 1 -- 172.21.15.44:0/3522215071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7faeac101cf0 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 10 client.7896 fetch_fsmap learned FSMap version 84 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x56321d8d0fc0 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faea6a00640 1 -- 172.21.15.44:0/3522215071 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56321d8e4350 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faea6a00640 1 -- 172.21.15.44:0/3522215071 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7faeac12d040 con 0x56321d6f9aa0 2024-09-17T05:45:01.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 10 client.7896 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:45:01.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 10 client.7896 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:01.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 20 client.7896 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:01.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5ee930 0x56321db5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 4 client.7896 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:45:01.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56321d95eb00 con 0x56321d5ee930 2024-09-17T05:45:01.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5c00640 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5ee930 0x56321db5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faec5c00640 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5ee930 0x56321db5c260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c4ad6831967bb99 server_cookie=4eebde5902f72847 in_seq=0 out_seq=0 2024-09-17T05:45:01.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.145+0000 7faea6a00640 10 client.7896 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faea6a00640 1 -- 172.21.15.44:0/3522215071 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56321d95eb00 con 0x56321d5ee930 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faea6a00640 10 client.7896 handle_command_reply: tid=0 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 client.7896 shutdown 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d6f9aa0 msgr2=0x56321db523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d6f9aa0 0x56321db523c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7faeac01cd10 tx=0x7faeac0095f0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 shutdown_connections 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5ee930 0x56321db5c260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d9de6d0 0x56321db52900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d6f9aa0 0x56321db523c0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 --2- 172.21.15.44:0/3522215071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d635890 0x56321db51e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faea6a00640 0 client.7896 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:45:01.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 >> 172.21.15.44:0/3522215071 conn(0x56321d6095c0 msgr2=0x56321db48b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 shutdown_connections 2024-09-17T05:45:01.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 1 -- 172.21.15.44:0/3522215071 wait complete. 2024-09-17T05:45:01.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.149+0000 7faecfe64000 20 client.7896 trim_cache size 0 max 16384 2024-09-17T05:45:01.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.165+0000 7faecfe64000 1 Processor -- start 2024-09-17T05:45:01.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.165+0000 7faecfe64000 1 -- start start 2024-09-17T05:45:01.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db5c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db5cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56321db03af0 con 0x56321d635890 2024-09-17T05:45:01.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faec0205c30 con 0x56321d9de6d0 2024-09-17T05:45:01.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faec0204c80 con 0x56321d6f9aa0 2024-09-17T05:45:01.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51196/0 (socket says 172.21.15.44:51196) 2024-09-17T05:45:01.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 -- 172.21.15.44:0/636387174 learned_addr learned my addr 172.21.15.44:0/636387174 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5200640 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db5c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec6600640 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db5cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 -- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 msgr2=0x56321db5c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db5c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 -- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 msgr2=0x56321db5cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db5cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 -- 172.21.15.44:0/636387174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321d9a9680 con 0x56321d635890 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faec5c00640 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5c260 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faeb400fc10 tx=0x7faeb4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf1046a9cf18c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faeb1600640 1 -- 172.21.15.44:0/636387174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4034070 con 0x56321d635890 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faeb1600640 1 -- 172.21.15.44:0/636387174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeb4010dc0 con 0x56321d635890 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faeb1600640 1 -- 172.21.15.44:0/636387174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4016070 con 0x56321d635890 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- 172.21.15.44:0/636387174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 msgr2=0x56321db5c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5c260 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faeb400fc10 tx=0x7faeb4012000 comp rx=0 tx=0).stop 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- 172.21.15.44:0/636387174 shutdown_connections 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db5cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db5c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 --2- 172.21.15.44:0/636387174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5c260 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- 172.21.15.44:0/636387174 >> 172.21.15.44:0/636387174 conn(0x56321d6095c0 msgr2=0x56321db48b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- 172.21.15.44:0/636387174 shutdown_connections 2024-09-17T05:45:01.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.169+0000 7faecfe64000 1 -- 172.21.15.44:0/636387174 wait complete. 2024-09-17T05:45:01.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 -- start start 2024-09-17T05:45:01.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 Processor -- start 2024-09-17T05:45:01.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db7c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faec00a0ba0 con 0x56321d635890 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faec01fd420 con 0x56321d9de6d0 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56321d611680 con 0x56321d6f9aa0 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 10 client.0 _ll_register_callbacks cb 0x7faeb8009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51206/0 (socket says 172.21.15.44:51206) 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 -- 172.21.15.44:0/2924484931 learned_addr learned my addr 172.21.15.44:0/2924484931 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec6600640 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db7c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5200640 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 -- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 msgr2=0x56321db602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 -- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 msgr2=0x56321db7c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db7c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 -- 172.21.15.44:0/2924484931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321d9160b0 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5c00640 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5fd60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7faeb400a8d0 tx=0x7faeb402f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe7f11a296e0c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faea6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faea6a00640 1 -- 172.21.15.44:0/2924484931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4034040 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faea6a00640 1 -- 172.21.15.44:0/2924484931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 6217+0+0 (secure 0 0 0) 0x7faeb402fa50 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faeb4010dc0 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faea6a00640 1 -- 172.21.15.44:0/2924484931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7faeb4046050 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 10 client.7902 fetch_fsmap learned FSMap version 84 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x56321d8e2610 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faea6a00640 1 -- 172.21.15.44:0/2924484931 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faeb4010dc0 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faea6a00640 1 -- 172.21.15.44:0/2924484931 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7faeb4049020 con 0x56321d635890 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 10 client.7902 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 10 client.7902 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:01.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 20 client.7902 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5dc990 0x56321db7d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 4 client.7902 mds_command: new command op to 7662 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 --> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56321d95a5b0 con 0x56321d5dc990 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.173+0000 7faec5200640 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5dc990 0x56321db7d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec5200640 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5dc990 0x56321db7d170 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f16293fc383c8494 server_cookie=6e03c5af3b416aad in_seq=0 out_seq=0 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faea6a00640 10 client.7902 ms_handle_connect on v2:172.21.15.44:6833/3953022133 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faea6a00640 1 -- 172.21.15.44:0/2924484931 <== mds.0 v2:172.21.15.44:6833/3953022133 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x56321d95a5b0 con 0x56321d5dc990 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faea6a00640 10 client.7902 handle_command_reply: tid=0 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 client.7902 shutdown 2024-09-17T05:45:01.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 msgr2=0x56321db5fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5fd60 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7faeb400a8d0 tx=0x7faeb402f6e0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 shutdown_connections 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:6833/3953022133,v1:172.21.15.44:6835/3953022133] conn(0x56321d5dc990 0x56321db7d170 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56321d9de6d0 0x56321db7c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faea6a00640 0 client.7902 ms_handle_reset on v2:172.21.15.44:6833/3953022133 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56321d6f9aa0 0x56321db602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 --2- 172.21.15.44:0/2924484931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56321d635890 0x56321db5fd60 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 >> 172.21.15.44:0/2924484931 conn(0x56321d6095c0 msgr2=0x56321db49530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 shutdown_connections 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 1 -- 172.21.15.44:0/2924484931 wait complete. 2024-09-17T05:45:01.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faecfe64000 20 client.7902 trim_cache size 0 max 16384 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "33071b56-81bf-4be4-b9f6-238cae7c959a": { 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:44:30.697455+0000", 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:45:01.181 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:45:01.182 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:45:01.182 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:01.182 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:01.182 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:45:01.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faea0073200 msgr2=0x7faea0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faea0073200 0x7faea0075710 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faeb4005950 tx=0x7faeb4005f90 comp rx=0 tx=0).stop 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec0072e50 msgr2=0x7faec00ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec0072e50 0x7faec00ce220 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7faeac01aee0 tx=0x7faeac0a5640 comp rx=0 tx=0).stop 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 shutdown_connections 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faec00ced00 0x7faec00c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faec0072e50 0x7faec00ce220 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faea0073200 0x7faea0075710 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 --2- 172.21.15.44:0/338972830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faec006de50 0x7faec01f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 >> 172.21.15.44:0/338972830 conn(0x7faec00ccaa0 msgr2=0x7faec015f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 shutdown_connections 2024-09-17T05:45:01.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.177+0000 7faec8600640 1 -- 172.21.15.44:0/338972830 wait complete. 2024-09-17T05:45:01.197 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:45:01.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:45:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.457+0000 7f8eed600640 1 -- 172.21.15.44:0/2176038827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee806de50 msgr2=0x7f8ee806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.457+0000 7f8eed600640 1 --2- 172.21.15.44:0/2176038827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee806de50 0x7f8ee806e260 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0009870 tx=0x7f8ed001c7d0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.457+0000 7f8eed600640 1 -- 172.21.15.44:0/2176038827 shutdown_connections 2024-09-17T05:45:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.457+0000 7f8eed600640 1 --2- 172.21.15.44:0/2176038827 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee806de50 0x7f8ee806e260 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.457+0000 7f8eed600640 1 -- 172.21.15.44:0/2176038827 >> 172.21.15.44:0/2176038827 conn(0x7f8ee80ccaa0 msgr2=0x7f8ee80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.457+0000 7f8eed600640 1 -- 172.21.15.44:0/2176038827 shutdown_connections 2024-09-17T05:45:01.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.457+0000 7f8eed600640 1 -- 172.21.15.44:0/2176038827 wait complete. 2024-09-17T05:45:01.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 Processor -- start 2024-09-17T05:45:01.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 -- start start 2024-09-17T05:45:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee806de50 0x7f8ee80b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee8072e50 0x7f8ee8149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee80cb470 0x7f8ee80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8169fd0 con 0x7f8ee8072e50 2024-09-17T05:45:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8169e50 con 0x7f8ee806de50 2024-09-17T05:45:01.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8eed600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee816a150 con 0x7f8ee80cb470 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8edfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee8072e50 0x7f8ee8149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8ee6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee806de50 0x7f8ee80b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8edfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee8072e50 0x7f8ee8149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51212/0 (socket says 172.21.15.44:51212) 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8ee6a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee806de50 0x7f8ee80b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:38754/0 (socket says 172.21.15.44:38754) 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.461+0000 7f8edfe00640 1 -- 172.21.15.44:0/3920040164 learned_addr learned my addr 172.21.15.44:0/3920040164 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8ee7400640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee80cb470 0x7f8ee80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edfe00640 1 -- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee80cb470 msgr2=0x7f8ee80c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edfe00640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee80cb470 0x7f8ee80c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edfe00640 1 -- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee806de50 msgr2=0x7f8ee80b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edfe00640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee806de50 0x7f8ee80b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edfe00640 1 -- 172.21.15.44:0/3920040164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee80b4750 con 0x7f8ee8072e50 2024-09-17T05:45:01.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edfe00640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee8072e50 0x7f8ee8149190 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00982c0 tx=0x7f8ed0005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edea00640 1 -- 172.21.15.44:0/3920040164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00bb070 con 0x7f8ee8072e50 2024-09-17T05:45:01.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edea00640 1 -- 172.21.15.44:0/3920040164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ed0004330 con 0x7f8ee8072e50 2024-09-17T05:45:01.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edea00640 1 -- 172.21.15.44:0/3920040164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed00b2040 con 0x7f8ee8072e50 2024-09-17T05:45:01.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee80b4a30 con 0x7f8ee8072e50 2024-09-17T05:45:01.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee80b4ff0 con 0x7f8ee8072e50 2024-09-17T05:45:01.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee806e260 con 0x7f8ee8072e50 2024-09-17T05:45:01.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.465+0000 7f8edea00640 1 -- 172.21.15.44:0/3920040164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8ed0005250 con 0x7f8ee8072e50 2024-09-17T05:45:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.469+0000 7f8edea00640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ec4073200 0x7f8ec4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.469+0000 7f8edea00640 1 -- 172.21.15.44:0/3920040164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 6217+0+0 (secure 0 0 0) 0x7f8ed012dba0 con 0x7f8ee8072e50 2024-09-17T05:45:01.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.469+0000 7f8ee6a00640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ec4073200 0x7f8ec4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.469+0000 7f8ee6a00640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ec4073200 0x7f8ec4075710 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8001400 tx=0x7f8ed8007b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.473+0000 7f8edea00640 1 -- 172.21.15.44:0/3920040164 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8ed00f1db0 con 0x7f8ee8072e50 2024-09-17T05:45:01.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.681+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8ee80b5fa0 con 0x7f8ee8072e50 2024-09-17T05:45:01.681 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:45:01.681+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:45:01.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8edea00640 1 -- 172.21.15.44:0/3920040164 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) ==== 161+0+0 (secure 0 0 0) 0x7f8ed0016450 con 0x7f8ee8072e50 2024-09-17T05:45:01.683 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ec4073200 msgr2=0x7f8ec4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ec4073200 0x7f8ec4075710 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8001400 tx=0x7f8ed8007b10 comp rx=0 tx=0).stop 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee8072e50 msgr2=0x7f8ee8149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee8072e50 0x7f8ee8149190 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00982c0 tx=0x7f8ed0005d30 comp rx=0 tx=0).stop 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 shutdown_connections 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8ee80cb470 0x7f8ee80c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8ee8072e50 0x7f8ee8149190 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8ec4073200 0x7f8ec4075710 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 --2- 172.21.15.44:0/3920040164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee806de50 0x7f8ee80b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.685+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 >> 172.21.15.44:0/3920040164 conn(0x7f8ee80ccaa0 msgr2=0x7f8ee80b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.689+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 shutdown_connections 2024-09-17T05:45:01.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.689+0000 7f8eed600640 1 -- 172.21.15.44:0/3920040164 wait complete. 2024-09-17T05:45:01.698 INFO:tasks.ceph.mds.c.smithi044.stderr: -8094> 2024-09-17T05:44:19.889+0000 7fe2dfc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:45:01.708 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-09-17T05:45:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 -- start start 2024-09-17T05:45:01.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 Processor -- start 2024-09-17T05:45:01.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174199680 0x563174e9a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174199b00 0x563174e9a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56317419a400 0x563174e9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563174eb4780 con 0x563174199b00 2024-09-17T05:45:01.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563174eb4600 con 0x563174199680 2024-09-17T05:45:01.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0064ea8400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x563174eb4480 con 0x56317419a400 2024-09-17T05:45:01.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174199b00 0x563174e9a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174199b00 0x563174e9a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51218/0 (socket says 172.21.15.44:51218) 2024-09-17T05:45:01.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 -- 172.21.15.44:0/2085294668 learned_addr learned my addr 172.21.15.44:0/2085294668 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0063a00640 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56317419a400 0x563174e9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0063000640 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174199680 0x563174e9a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 -- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56317419a400 msgr2=0x563174e9ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56317419a400 0x563174e9ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 -- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174199680 msgr2=0x563174e9a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174199680 0x563174e9a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 -- 172.21.15.44:0/2085294668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631741f4960 con 0x563174199b00 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0063a00640 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56317419a400 0x563174e9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f0062600640 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174199b00 0x563174e9a000 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x563174f21bf0 tx=0x563174fdc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea427b47bc58ad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.773+0000 7f005fe00640 1 -- 172.21.15.44:0/2085294668 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5631740ed520 con 0x563174199b00 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 -- 172.21.15.44:0/2085294668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631741f4d20 con 0x563174199b00 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f005fe00640 1 -- 172.21.15.44:0/2085294668 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56317410afc0 con 0x563174199b00 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f005fe00640 1 -- 172.21.15.44:0/2085294668 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5631740ed1e0 con 0x563174199b00 2024-09-17T05:45:01.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 -- 172.21.15.44:0/2085294668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5631741f4f00 con 0x563174199b00 2024-09-17T05:45:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 4 waiting for MDS map... 2024-09-17T05:45:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f005fe00640 1 -- 172.21.15.44:0/2085294668 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x563174e99400 con 0x563174199b00 2024-09-17T05:45:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f005fe00640 1 -- 172.21.15.44:0/2085294668 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 85) ==== 2893+0+0 (secure 0 0 0) 0x56317410d180 con 0x563174199b00 2024-09-17T05:45:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 4 Got MDS map 85 2024-09-17T05:45:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 10 main: JournalTool::main 2024-09-17T05:45:01.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 4 main: JournalTool: connecting to RADOS... 2024-09-17T05:45:01.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 Processor -- start 2024-09-17T05:45:01.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 -- start start 2024-09-17T05:45:01.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198900 0x563174e9b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563174eb4300 con 0x563174198d80 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563174eb4000 con 0x563174198480 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0064ea8400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x563174117800 con 0x563174198900 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0063a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0063a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51232/0 (socket says 172.21.15.44:51232) 2024-09-17T05:45:01.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0063a00640 1 -- 172.21.15.44:0/1996454618 learned_addr learned my addr 172.21.15.44:0/1996454618 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0063000640 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198900 0x563174e9b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.777+0000 7f0062600640 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0063a00640 1 -- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198900 msgr2=0x563174e9b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0063a00640 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198900 0x563174e9b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0063a00640 1 -- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198480 msgr2=0x563174e9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0063a00640 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0063a00640 1 -- 172.21.15.44:0/1996454618 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631741f4d20 con 0x563174198d80 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0063a00640 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x563174f21230 tx=0x5631741d39e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabb0ea31292606f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f005d600640 1 -- 172.21.15.44:0/1996454618 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5631740ed380 con 0x563174198d80 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f005d600640 1 -- 172.21.15.44:0/1996454618 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56317410ae00 con 0x563174198d80 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f005d600640 1 -- 172.21.15.44:0/1996454618 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5631740ed520 con 0x563174198d80 2024-09-17T05:45:01.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- 172.21.15.44:0/1996454618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 msgr2=0x563174e9b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x563174f21230 tx=0x5631741d39e0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- 172.21.15.44:0/1996454618 shutdown_connections 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198900 0x563174e9b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 --2- 172.21.15.44:0/1996454618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- 172.21.15.44:0/1996454618 >> 172.21.15.44:0/1996454618 conn(0x563174199200 msgr2=0x5631743ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- 172.21.15.44:0/1996454618 shutdown_connections 2024-09-17T05:45:01.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- 172.21.15.44:0/1996454618 wait complete. 2024-09-17T05:45:01.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 Processor -- start 2024-09-17T05:45:01.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- start start 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198900 0x563174e9b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563174eb5380 con 0x563174198d80 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563174eb4000 con 0x563174198900 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.781+0000 7f0064ea8400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x563174eb5500 con 0x563174198480 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0063a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51248/0 (socket says 172.21.15.44:51248) 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 -- 172.21.15.44:0/3813840186 learned_addr learned my addr 172.21.15.44:0/3813840186 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0063000640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198900 0x563174e9b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 -- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198480 msgr2=0x563174e9bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 -- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198900 msgr2=0x563174e9b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174198900 0x563174e9b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 -- 172.21.15.44:0/3813840186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631741f5c20 con 0x563174198d80 2024-09-17T05:45:01.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0063a00640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x563174198480 0x563174e9bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:01.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0062600640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x563174febb60 tx=0x563174fdc420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f005b800640 1 -- 172.21.15.44:0/3813840186 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5631740ed040 con 0x563174198d80 2024-09-17T05:45:01.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f005b800640 1 -- 172.21.15.44:0/3813840186 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56317410a000 con 0x563174198d80 2024-09-17T05:45:01.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5631741f5e00 con 0x563174198d80 2024-09-17T05:45:01.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f005b800640 1 -- 172.21.15.44:0/3813840186 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5631740ed380 con 0x563174198d80 2024-09-17T05:45:01.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631741f41e0 con 0x563174198d80 2024-09-17T05:45:01.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f0064ea8400 4 main: JournalTool: resolving pool 15 2024-09-17T05:45:01.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.785+0000 7f005b800640 1 -- 172.21.15.44:0/3813840186 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x563174400c00 con 0x563174198d80 2024-09-17T05:45:01.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f005b800640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x56317419b180 0x563174e9c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f005b800640 1 -- 172.21.15.44:0/3813840186 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x5631743fc200 con 0x563174198d80 2024-09-17T05:45:01.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0064ea8400 4 main: JournalTool: creating IoCtx.. 2024-09-17T05:45:01.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0064ea8400 4 main: Executing for rank 0 2024-09-17T05:45:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0064ea8400 4 Filtering by inode '1099511627777' 2024-09-17T05:45:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0064ea8400 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x563174198000 0x563174e9c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x563174500000 con 0x563174198000 2024-09-17T05:45:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0063a00640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x56317419b180 0x563174e9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0063000640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x563174198000 0x563174e9c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0063000640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x563174198000 0x563174e9c680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.789+0000 7f0063a00640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x56317419b180 0x563174e9c100 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x563174f21230 tx=0x56317500ccc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.793+0000 7f0063000640 1 -- 172.21.15.44:0/3813840186 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5631741c0000 con 0x563174198000 2024-09-17T05:45:01.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.793+0000 7f0064ea8400 4 Pointer 400.00000000 is readable 2024-09-17T05:45:01.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.793+0000 7f0064ea8400 4 JournalScanner::scan: reading header object '200.00000000' 2024-09-17T05:45:01.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.793+0000 7f0064ea8400 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x56317419a880 0x563174e9cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.793+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x563174500400 con 0x56317419a880 2024-09-17T05:45:01.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.793+0000 7f0063a00640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x56317419a880 0x563174e9cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.793+0000 7f0063a00640 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x56317419a880 0x563174e9cc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0063a00640 1 -- 172.21.15.44:0/3813840186 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5631741c0500 con 0x56317419a880 2024-09-17T05:45:01.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 10 Header 0x400000 0x407955 0x407cd1 2024-09-17T05:45:01.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 10 Starting journal scan from offset 0x407955 2024-09-17T05:45:01.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 31061~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x563174501800 con 0x56317419a880 2024-09-17T05:45:01.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0063a00640 1 -- 172.21.15.44:0/3813840186 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(3 200.00000001 [read 31061~892 out=892b] v0'0 uv27 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x5631741c0500 con 0x56317419a880 2024-09-17T05:45:01.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 10 Parsing data, 0x37c bytes available 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 10 Attempting decode at 0x407955 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 10 Consumed 0x37c bytes 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 10 Valid entry at 0x407955 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x563174501c00 con 0x56317419a880 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0063a00640 1 -- 172.21.15.44:0/3813840186 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5631741c0500 con 0x56317419a880 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 4 Reached end of journal objects 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 4 Scanned objects, 0 missing, 1 valid 2024-09-17T05:45:01.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 4 Events scanned, 0 gaps 2024-09-17T05:45:01.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 4 Found 1 valid events 2024-09-17T05:45:01.798 INFO:teuthology.orchestra.run.smithi044.stdout:Events by type: 2024-09-17T05:45:01.798 INFO:teuthology.orchestra.run.smithi044.stdout:Errors: 0 2024-09-17T05:45:01.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 4 Selected 0 events events for processing 2024-09-17T05:45:01.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 4 0 events 2024-09-17T05:45:01.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x563174198000 msgr2=0x563174e9c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x563174198000 0x563174e9c680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x56317419a880 msgr2=0x563174e9cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x56317419a880 0x563174e9cc00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x56317419b180 msgr2=0x563174e9c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x56317419b180 0x563174e9c100 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x563174f21230 tx=0x56317500ccc0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 msgr2=0x563174e9b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x563174febb60 tx=0x563174fdc420 comp rx=0 tx=0).stop 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0063000640 1 -- 172.21.15.44:0/3813840186 reap_dead start 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 shutdown_connections 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/3813840186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174198d80 0x563174e9b080 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 >> 172.21.15.44:0/3813840186 conn(0x563174199200 msgr2=0x5631743ee000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 shutdown_connections 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/3813840186 wait complete. 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/2085294668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174199b00 msgr2=0x563174e9a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174199b00 0x563174e9a000 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x563174f21bf0 tx=0x563174fdc120 comp rx=0 tx=0).stop 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/2085294668 shutdown_connections 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56317419a400 0x563174e9ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563174199b00 0x563174e9a000 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 --2- 172.21.15.44:0/2085294668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563174199680 0x563174e9a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/2085294668 >> 172.21.15.44:0/2085294668 conn(0x563174199f80 msgr2=0x5631700b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/2085294668 shutdown_connections 2024-09-17T05:45:01.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.797+0000 7f0064ea8400 1 -- 172.21.15.44:0/2085294668 wait complete. 2024-09-17T05:45:01.804 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.096115, result: Events by type: Errors: 0 2024-09-17T05:45:01.804 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-09-17T05:45:01.826 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:45:01.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.869+0000 7fd40f5ba400 1 -- start start 2024-09-17T05:45:01.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.869+0000 7fd40f5ba400 1 Processor -- start 2024-09-17T05:45:01.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.869+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ef680 0x5649ff2ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.869+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5efb00 0x5649ff2ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.869+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5f0400 0x5649ff2eab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.869+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649ff30c780 con 0x5649fe5efb00 2024-09-17T05:45:01.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.869+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649ff30c600 con 0x5649fe5ef680 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5649ff30c480 con 0x5649fe5f0400 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5efb00 0x5649ff2ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5efb00 0x5649ff2ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51276/0 (socket says 172.21.15.44:51276) 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 -- 172.21.15.44:0/2581439965 learned_addr learned my addr 172.21.15.44:0/2581439965 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40e000640 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5f0400 0x5649ff2eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40d600640 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ef680 0x5649ff2ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 -- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5f0400 msgr2=0x5649ff2eab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5f0400 0x5649ff2eab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 -- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ef680 msgr2=0x5649ff2ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ef680 0x5649ff2ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 -- 172.21.15.44:0/2581439965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fe64a960 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40cc00640 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5efb00 0x5649ff2ea000 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x5649ff37bc20 tx=0x5649ff2f4120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab62875ff5c3febd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40a400640 1 -- 172.21.15.44:0/2581439965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5649fe543520 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40a400640 1 -- 172.21.15.44:0/2581439965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5649fe560540 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40a400640 1 -- 172.21.15.44:0/2581439965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5649fe5431e0 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2581439965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fe64ad20 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2581439965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5649fe64af00 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 4 waiting for MDS map... 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40a400640 1 -- 172.21.15.44:0/2581439965 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x5649ff2f3000 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40a400640 1 -- 172.21.15.44:0/2581439965 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 85) ==== 2893+0+0 (secure 0 0 0) 0x5649fe563180 con 0x5649fe5efb00 2024-09-17T05:45:01.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 4 Got MDS map 85 2024-09-17T05:45:01.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 10 main: JournalTool::main 2024-09-17T05:45:01.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 4 main: JournalTool: connecting to RADOS... 2024-09-17T05:45:01.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 1 Processor -- start 2024-09-17T05:45:01.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.873+0000 7fd40f5ba400 1 -- start start 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5ee900 0x5649ff2eb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649ff30c300 con 0x5649fe5ee480 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649ff30c000 con 0x5649fe5eed80 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5649fe56d800 con 0x5649fe5ee900 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40d600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5ee900 0x5649ff2eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51286/0 (socket says 172.21.15.44:51286) 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 -- 172.21.15.44:0/2082521523 learned_addr learned my addr 172.21.15.44:0/2082521523 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40e000640 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 -- 172.21.15.44:0/2082521523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5ee900 msgr2=0x5649ff2eb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5ee900 0x5649ff2eb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 -- 172.21.15.44:0/2082521523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5eed80 msgr2=0x5649ff2eb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 -- 172.21.15.44:0/2082521523 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fe64ad20 con 0x5649fe5ee480 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40cc00640 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x5649ff435020 tx=0x5649ff2f4540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23a94b55f0e27b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd407c00640 1 -- 172.21.15.44:0/2082521523 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5649fe543040 con 0x5649fe5ee480 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd407c00640 1 -- 172.21.15.44:0/2082521523 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5649fe560fc0 con 0x5649fe5ee480 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd407c00640 1 -- 172.21.15.44:0/2082521523 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5649fe543520 con 0x5649fe5ee480 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2082521523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 msgr2=0x5649ff2ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x5649ff435020 tx=0x5649ff2f4540 comp rx=0 tx=0).stop 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2082521523 shutdown_connections 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5ee900 0x5649ff2eb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2082521523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2082521523 >> 172.21.15.44:0/2082521523 conn(0x5649fe5ef200 msgr2=0x5649fe83c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2082521523 shutdown_connections 2024-09-17T05:45:01.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2082521523 wait complete. 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 Processor -- start 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.877+0000 7fd40f5ba400 1 -- start start 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ee900 0x5649ff2eb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649ff30d500 con 0x5649fe5ee480 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649ff30d680 con 0x5649fe5ee900 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5649ff30c000 con 0x5649fe5eed80 2024-09-17T05:45:01.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51302/0 (socket says 172.21.15.44:51302) 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 -- 172.21.15.44:0/3979922128 learned_addr learned my addr 172.21.15.44:0/3979922128 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40cc00640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40d600640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ee900 0x5649ff2eb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 -- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5eed80 msgr2=0x5649ff2eb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 -- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ee900 msgr2=0x5649ff2eb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ee900 0x5649ff2eb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 -- 172.21.15.44:0/3979922128 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fe64ba40 con 0x5649fe5ee480 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40cc00640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5eed80 0x5649ff2eb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40e000640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x5649ff435dd0 tx=0x5649ff456ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd405e00640 1 -- 172.21.15.44:0/3979922128 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5649fe543040 con 0x5649fe5ee480 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd405e00640 1 -- 172.21.15.44:0/3979922128 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5649fe560e00 con 0x5649fe5ee480 2024-09-17T05:45:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649fe64bc20 con 0x5649fe5ee480 2024-09-17T05:45:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd405e00640 1 -- 172.21.15.44:0/3979922128 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5649fe543520 con 0x5649fe5ee480 2024-09-17T05:45:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fe64bc20 con 0x5649fe5ee480 2024-09-17T05:45:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd40f5ba400 4 main: JournalTool: resolving pool 15 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.881+0000 7fd405e00640 1 -- 172.21.15.44:0/3979922128 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x5649fe848c00 con 0x5649fe5ee480 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd405e00640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5649fe5f1180 0x5649ff2ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd405e00640 1 -- 172.21.15.44:0/3979922128 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x5649fe85ea00 con 0x5649fe5ee480 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 main: JournalTool: creating IoCtx.. 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 main: Executing for rank 0 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Filtering by inode '1099511627778' 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5649fe5ee000 0x5649ff2ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x5649fe860800 con 0x5649fe5ee000 2024-09-17T05:45:01.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40cc00640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5649fe5ee000 0x5649ff2ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40d600640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5649fe5f1180 0x5649ff2ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40cc00640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5649fe5ee000 0x5649ff2ec680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40d600640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5649fe5f1180 0x5649ff2ec100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x5649fe62a6c0 tx=0x5649fe6299e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40cc00640 1 -- 172.21.15.44:0/3979922128 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5649fe616000 con 0x5649fe5ee000 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Pointer 400.00000000 is readable 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 JournalScanner::scan: reading header object '200.00000000' 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5649fe5f0880 0x5649ff2ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x5649fe860c00 con 0x5649fe5f0880 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40e000640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5649fe5f0880 0x5649ff2ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40e000640 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5649fe5f0880 0x5649ff2ecc00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:01.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40e000640 1 -- 172.21.15.44:0/3979922128 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv29 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5649fe616500 con 0x5649fe5f0880 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 10 Header 0x400000 0x407955 0x407cd1 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 10 Starting journal scan from offset 0x407955 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 31061~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x5649fe861000 con 0x5649fe5f0880 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40e000640 1 -- 172.21.15.44:0/3979922128 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(3 200.00000001 [read 31061~892 out=892b] v0'0 uv27 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x5649fe616500 con 0x5649fe5f0880 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 10 Parsing data, 0x37c bytes available 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 10 Attempting decode at 0x407955 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 10 Consumed 0x37c bytes 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 10 Valid entry at 0x407955 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) -- 0x5649fe861400 con 0x5649fe5f0880 2024-09-17T05:45:01.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40e000640 1 -- 172.21.15.44:0/3979922128 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5649fe616500 con 0x5649fe5f0880 2024-09-17T05:45:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Reached end of journal objects 2024-09-17T05:45:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Scanned objects, 0 missing, 1 valid 2024-09-17T05:45:01.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Events scanned, 0 gaps 2024-09-17T05:45:01.891 INFO:teuthology.orchestra.run.smithi044.stdout:Events by type: 2024-09-17T05:45:01.891 INFO:teuthology.orchestra.run.smithi044.stdout:Errors: 0 2024-09-17T05:45:01.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Found 1 valid events 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 Selected 0 events events for processing 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 4 0 events 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5649fe5ee000 msgr2=0x5649ff2ec680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5649fe5ee000 0x5649ff2ec680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5649fe5f0880 msgr2=0x5649ff2ecc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5649fe5f0880 0x5649ff2ecc00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5649fe5f1180 msgr2=0x5649ff2ec100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5649fe5f1180 0x5649ff2ec100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x5649fe62a6c0 tx=0x5649fe6299e0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 msgr2=0x5649ff2ebb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/3979922128 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5ee480 0x5649ff2ebb80 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x5649ff435dd0 tx=0x5649ff456ea0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.885+0000 7fd40d600640 1 -- 172.21.15.44:0/3979922128 reap_dead start 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40d600640 1 -- 172.21.15.44:0/3979922128 reap_dead start 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 shutdown_connections 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 >> 172.21.15.44:0/3979922128 conn(0x5649fe5ef200 msgr2=0x5649fe83c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 shutdown_connections 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/3979922128 wait complete. 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2581439965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5efb00 msgr2=0x5649ff2ea000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5efb00 0x5649ff2ea000 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x5649ff37bc20 tx=0x5649ff2f4120 comp rx=0 tx=0).stop 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2581439965 shutdown_connections 2024-09-17T05:45:01.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5649fe5f0400 0x5649ff2eab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649fe5efb00 0x5649ff2ea000 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 --2- 172.21.15.44:0/2581439965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649fe5ef680 0x5649ff2ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2581439965 >> 172.21.15.44:0/2581439965 conn(0x5649fe5eff80 msgr2=0x5649fa509800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2581439965 shutdown_connections 2024-09-17T05:45:01.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.889+0000 7fd40f5ba400 1 -- 172.21.15.44:0/2581439965 wait complete. 2024-09-17T05:45:01.896 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.092407, result: Events by type: Errors: 0 2024-09-17T05:45:01.897 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-09-17T05:45:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.997+0000 7fa189c21080 1 Processor -- start 2024-09-17T05:45:01.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:01.997+0000 7fa189c21080 1 -- start start 2024-09-17T05:45:01.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b91a570 0x55797b957d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f4a0 0x55797b9e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b95f8b0 0x55797b9e6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:01.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55797b8c4f40 con 0x55797b95f8b0 2024-09-17T05:45:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55797b8d1d00 con 0x55797b91a570 2024-09-17T05:45:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55797b866a00 con 0x55797b95f4a0 2024-09-17T05:45:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b95f8b0 0x55797b9e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b95f8b0 0x55797b9e6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51322/0 (socket says 172.21.15.44:51322) 2024-09-17T05:45:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa17be00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f4a0 0x55797b9e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 -- 172.21.15.44:0/1451938020 learned_addr learned my addr 172.21.15.44:0/1451938020 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:02.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa182e00640 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b91a570 0x55797b957d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 -- 172.21.15.44:0/1451938020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f4a0 msgr2=0x55797b9e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:02.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f4a0 0x55797b9e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 -- 172.21.15.44:0/1451938020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b91a570 msgr2=0x55797b957d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b91a570 0x55797b957d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 -- 172.21.15.44:0/1451938020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55797b958380 con 0x55797b95f8b0 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa183800640 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b95f8b0 0x55797b9e6440 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa17c001690 tx=0x7fa17c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33528661909f74a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa181a00640 1 -- 172.21.15.44:0/1451938020 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c016070 con 0x55797b95f8b0 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa181a00640 1 -- 172.21.15.44:0/1451938020 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa17c00f800 con 0x55797b95f8b0 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa181a00640 1 -- 172.21.15.44:0/1451938020 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00fc10 con 0x55797b95f8b0 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- 172.21.15.44:0/1451938020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b95f8b0 msgr2=0x55797b9e6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b95f8b0 0x55797b9e6440 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa17c001690 tx=0x7fa17c006f90 comp rx=0 tx=0).stop 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- 172.21.15.44:0/1451938020 shutdown_connections 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b95f8b0 0x55797b9e6440 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f4a0 0x55797b9e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 --2- 172.21.15.44:0/1451938020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b91a570 0x55797b957d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- 172.21.15.44:0/1451938020 >> 172.21.15.44:0/1451938020 conn(0x55797b904d20 msgr2=0x55797b946ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:02.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- 172.21.15.44:0/1451938020 shutdown_connections 2024-09-17T05:45:02.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- 172.21.15.44:0/1451938020 wait complete. 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 Processor -- start 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.001+0000 7fa189c21080 1 -- start start 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b91a570 0x55797b9e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b95f4a0 0x55797b9d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f8b0 0x55797b9468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55797b958620 con 0x55797b91a570 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55797b959000 con 0x55797b95f4a0 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55797b9588c0 con 0x55797b95f8b0 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b91a570 0x55797b9e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b91a570 0x55797b9e58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51336/0 (socket says 172.21.15.44:51336) 2024-09-17T05:45:02.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 -- 172.21.15.44:0/4028006442 learned_addr learned my addr 172.21.15.44:0/4028006442 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa183800640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f8b0 0x55797b9468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa17be00640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b95f4a0 0x55797b9d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 -- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f8b0 msgr2=0x55797b9468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55797b95f8b0 0x55797b9468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 -- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b95f4a0 msgr2=0x55797b9d9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b95f4a0 0x55797b9d9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 -- 172.21.15.44:0/4028006442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55797b9e9310 con 0x55797b91a570 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa17be00640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55797b95f4a0 0x55797b9d9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa182e00640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b91a570 0x55797b9e58c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa17400ef80 tx=0x7fa17400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa17b400640 1 -- 172.21.15.44:0/4028006442 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174015020 con 0x55797b91a570 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55797b9e95b0 con 0x55797b91a570 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa17b400640 1 -- 172.21.15.44:0/4028006442 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa174011750 con 0x55797b91a570 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa17b400640 1 -- 172.21.15.44:0/4028006442 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17400a040 con 0x55797b91a570 2024-09-17T05:45:02.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.005+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55797b9db8a0 con 0x55797b91a570 2024-09-17T05:45:02.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.009+0000 7fa17b400640 1 -- 172.21.15.44:0/4028006442 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa174018020 con 0x55797b91a570 2024-09-17T05:45:02.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.009+0000 7fa17b400640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa160071be0 0x7fa1600740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.009+0000 7fa17b400640 1 -- 172.21.15.44:0/4028006442 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7fa174093390 con 0x55797b91a570 2024-09-17T05:45:02.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.009+0000 7fa189c21080 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55797b9e8bc0 0x55797b9dbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.009+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e108) -- 0x55797b9dc520 con 0x55797b9e8bc0 2024-09-17T05:45:02.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.009+0000 7fa183800640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55797b9e8bc0 0x55797b9dbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.009+0000 7fa17be00640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa160071be0 0x7fa1600740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa183800640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55797b9e8bc0 0x55797b9dbfe0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa17be00640 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa160071be0 0x7fa1600740f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0ab000 tx=0x7fa16c019a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa183800640 1 -- 172.21.15.44:0/4028006442 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v108'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7fa17c019040 con 0x55797b9e8bc0 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55797b9e8bc0 msgr2=0x55797b9dbfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55797b9e8bc0 0x55797b9dbfe0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa160071be0 msgr2=0x7fa1600740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa160071be0 0x7fa1600740f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa16c0ab000 tx=0x7fa16c019a40 comp rx=0 tx=0).stop 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b91a570 msgr2=0x55797b9e58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 --2- 172.21.15.44:0/4028006442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55797b91a570 0x55797b9e58c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa17400ef80 tx=0x7fa17400c6f0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa183800640 1 -- 172.21.15.44:0/4028006442 reap_dead start 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 shutdown_connections 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 >> 172.21.15.44:0/4028006442 conn(0x55797b904d20 msgr2=0x55797b9e0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 shutdown_connections 2024-09-17T05:45:02.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.013+0000 7fa189c21080 1 -- 172.21.15.44:0/4028006442 wait complete. 2024-09-17T05:45:02.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T05:45:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.225+0000 7f817aa00640 1 -- 172.21.15.44:0/3116118580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 msgr2=0x7f8158004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.225+0000 7f817aa00640 1 --2- 172.21.15.44:0/3116118580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 0x7f8158004810 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f81740af8d0 tx=0x7f815c01d1d0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.225+0000 7f8178a00640 1 -- 172.21.15.44:0/3116118580 reap_dead start 2024-09-17T05:45:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.225+0000 7f817aa00640 1 -- 172.21.15.44:0/3116118580 shutdown_connections 2024-09-17T05:45:02.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.225+0000 7f817aa00640 1 -- 172.21.15.44:0/3116118580 >> 172.21.15.44:0/3116118580 conn(0x7f81740ccaa0 msgr2=0x7f81740cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:02.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.225+0000 7f817aa00640 1 -- 172.21.15.44:0/3116118580 shutdown_connections 2024-09-17T05:45:02.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.225+0000 7f817aa00640 1 -- 172.21.15.44:0/3116118580 wait complete. 2024-09-17T05:45:02.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 Processor -- start 2024-09-17T05:45:02.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 -- start start 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 0x7f817409f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81740c2b80 0x7f8174155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f817409d260 0x7f817409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f81740ce790 con 0x7f8158003fe0 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81740ce610 con 0x7f817409d260 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f81740ce910 con 0x7f81740c2b80 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 0x7f817409f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 0x7f817409f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51358/0 (socket says 172.21.15.44:51358) 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 -- 172.21.15.44:0/2946376476 learned_addr learned my addr 172.21.15.44:0/2946376476 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8178a00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f817409d260 0x7f817409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f816be00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81740c2b80 0x7f8174155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 -- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81740c2b80 msgr2=0x7f8174155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81740c2b80 0x7f8174155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 -- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f817409d260 msgr2=0x7f817409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f817409d260 0x7f817409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 -- 172.21.15.44:0/2946376476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817409cac0 con 0x7f8158003fe0 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8178a00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f817409d260 0x7f817409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:02.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8173e00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 0x7f817409f6d0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8164011b30 tx=0x7f816400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8170c00640 1 -- 172.21.15.44:0/2946376476 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816401e070 con 0x7f8158003fe0 2024-09-17T05:45:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8170c00640 1 -- 172.21.15.44:0/2946376476 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f816400fe00 con 0x7f8158003fe0 2024-09-17T05:45:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817409ef00 con 0x7f8158003fe0 2024-09-17T05:45:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f8170c00640 1 -- 172.21.15.44:0/2946376476 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164019650 con 0x7f8158003fe0 2024-09-17T05:45:02.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.229+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817409fc10 con 0x7f8158003fe0 2024-09-17T05:45:02.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.233+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817415e990 con 0x7f8158003fe0 2024-09-17T05:45:02.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.233+0000 7f8170c00640 1 -- 172.21.15.44:0/2946376476 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8164021070 con 0x7f8158003fe0 2024-09-17T05:45:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.237+0000 7f8170c00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8150073200 0x7f8150075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.237+0000 7f8170c00640 1 -- 172.21.15.44:0/2946376476 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f8164095620 con 0x7f8158003fe0 2024-09-17T05:45:02.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.237+0000 7f816be00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8150073200 0x7f8150075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.237+0000 7f816be00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8150073200 0x7f8150075710 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f815c0ae000 tx=0x7f815c019f70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.237+0000 7f8170c00640 1 -- 172.21.15.44:0/2946376476 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f817409cac0 con 0x7f8158003fe0 2024-09-17T05:45:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.453+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f8174160fd0 con 0x7f8158003fe0 2024-09-17T05:45:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.685+0000 7f8170c00640 1 -- 172.21.15.44:0/2946376476 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v86) ==== 162+0+0 (secure 0 0 0) 0x7f816405fe80 con 0x7f8158003fe0 2024-09-17T05:45:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8150073200 msgr2=0x7f8150075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8150073200 0x7f8150075710 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f815c0ae000 tx=0x7f815c019f70 comp rx=0 tx=0).stop 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 msgr2=0x7f817409f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 0x7f817409f6d0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8164011b30 tx=0x7f816400f3c0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 shutdown_connections 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8150073200 0x7f8150075710 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f817409d260 0x7f817409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f81740c2b80 0x7f8174155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 --2- 172.21.15.44:0/2946376476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8158003fe0 0x7f817409f6d0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 >> 172.21.15.44:0/2946376476 conn(0x7f81740ccaa0 msgr2=0x7f817415a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 shutdown_connections 2024-09-17T05:45:02.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.689+0000 7f817aa00640 1 -- 172.21.15.44:0/2946376476 wait complete. 2024-09-17T05:45:02.712 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 -- 172.21.15.44:0/3455407313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 msgr2=0x7f9a8806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 --2- 172.21.15.44:0/3455407313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8806e160 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f9a880cffa0 tx=0x7f9a7c01c7c0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 -- 172.21.15.44:0/3455407313 shutdown_connections 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 --2- 172.21.15.44:0/3455407313 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a8815f0e0 0x7f9a8815f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 --2- 172.21.15.44:0/3455407313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8806e160 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 -- 172.21.15.44:0/3455407313 >> 172.21.15.44:0/3455407313 conn(0x7f9a880d1120 msgr2=0x7f9a880d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 -- 172.21.15.44:0/3455407313 shutdown_connections 2024-09-17T05:45:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.869+0000 7f9a8f800640 1 -- 172.21.15.44:0/3455407313 wait complete. 2024-09-17T05:45:02.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 Processor -- start 2024-09-17T05:45:02.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 -- start start 2024-09-17T05:45:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a880cecf0 0x7f9a8815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a8815f0e0 0x7f9a880b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a88168df0 con 0x7f9a88072190 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a88168c70 con 0x7f9a8815f0e0 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8f800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9a88168f70 con 0x7f9a880cecf0 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.873+0000 7f9a8ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51380/0 (socket says 172.21.15.44:51380) 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 -- 172.21.15.44:0/1595108940 learned_addr learned my addr 172.21.15.44:0/1595108940 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a87e00640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a880cecf0 0x7f9a8815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8d800640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a8815f0e0 0x7f9a880b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 -- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a880cecf0 msgr2=0x7f9a8815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a880cecf0 0x7f9a8815dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 -- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a8815f0e0 msgr2=0x7f9a880b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a8815f0e0 0x7f9a880b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 -- 172.21.15.44:0/1595108940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a881fc6c0 con 0x7f9a88072190 2024-09-17T05:45:02.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8ce00640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8815ce70 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0b0040 tx=0x7f9a7c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a84c00640 1 -- 172.21.15.44:0/1595108940 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c0b2040 con 0x7f9a88072190 2024-09-17T05:45:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a881fc9a0 con 0x7f9a88072190 2024-09-17T05:45:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a84c00640 1 -- 172.21.15.44:0/1595108940 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a7c004040 con 0x7f9a88072190 2024-09-17T05:45:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a84c00640 1 -- 172.21.15.44:0/1595108940 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c004410 con 0x7f9a88072190 2024-09-17T05:45:02.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a881fcf60 con 0x7f9a88072190 2024-09-17T05:45:02.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8806e160 con 0x7f9a88072190 2024-09-17T05:45:02.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.877+0000 7f9a84c00640 1 -- 172.21.15.44:0/1595108940 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9a7c0bf020 con 0x7f9a88072190 2024-09-17T05:45:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.881+0000 7f9a84c00640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a68073200 0x7f9a68075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.881+0000 7f9a84c00640 1 -- 172.21.15.44:0/1595108940 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f9a7c12e5d0 con 0x7f9a88072190 2024-09-17T05:45:02.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.881+0000 7f9a87e00640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a68073200 0x7f9a68075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:02.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.881+0000 7f9a87e00640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a68073200 0x7f9a68075710 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9a8815da00 tx=0x7f9a74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:02.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:02.885+0000 7f9a84c00640 1 -- 172.21.15.44:0/1595108940 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9a7c0c6020 con 0x7f9a88072190 2024-09-17T05:45:03.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.093+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a8806dd30 con 0x7f9a88072190 2024-09-17T05:45:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a84c00640 1 -- 172.21.15.44:0/1595108940 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5214 (secure 0 0 0) 0x7f9a7c0164d0 con 0x7f9a88072190 2024-09-17T05:45:03.095 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:03.095 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":87,"btime":"2024-09-17T05:45:02:691675+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:45:02.691657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7651},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7651":{"gid":7651,"name":"c","rank":0,"incarnation":87,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/1998109127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1998109127},{"type":"v1","addr":"172.21.15.44:6835","nonce":1998109127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-17T05:45:03.095 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 87 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a68073200 msgr2=0x7f9a68075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a68073200 0x7f9a68075710 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9a8815da00 tx=0x7f9a74009040 comp rx=0 tx=0).stop 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 msgr2=0x7f9a8815ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8815ce70 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0b0040 tx=0x7f9a7c005780 comp rx=0 tx=0).stop 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 shutdown_connections 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9a68073200 0x7f9a68075710 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a8815f0e0 0x7f9a880b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9a880cecf0 0x7f9a8815dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 --2- 172.21.15.44:0/1595108940 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a88072190 0x7f9a8815ce70 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:03.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 >> 172.21.15.44:0/1595108940 conn(0x7f9a880d1120 msgr2=0x7f9a88165a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:03.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 shutdown_connections 2024-09-17T05:45:03.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:03.097+0000 7f9a8f800640 1 -- 172.21.15.44:0/1595108940 wait complete. 2024-09-17T05:45:03.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:44:17.352549+0000', 'modified': '2024-09-17T05:45:02.691657+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7651}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7651': {'gid': 7651, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/1998109127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1998109127}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1998109127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:45:03.520 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7651:up:replay 2024-09-17T05:45:04.521 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.692+0000 7f1de5000640 1 -- 172.21.15.44:0/2240847827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 msgr2=0x7f1dc4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.692+0000 7f1de5000640 1 --2- 172.21.15.44:0/2240847827 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 0x7f1dc4003e80 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009d30 tx=0x7f1dd001d430 comp rx=0 tx=0).stop 2024-09-17T05:45:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.692+0000 7f1dde800640 1 -- 172.21.15.44:0/2240847827 reap_dead start 2024-09-17T05:45:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.692+0000 7f1de5000640 1 -- 172.21.15.44:0/2240847827 shutdown_connections 2024-09-17T05:45:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.692+0000 7f1de5000640 1 -- 172.21.15.44:0/2240847827 >> 172.21.15.44:0/2240847827 conn(0x7f1de00ccaa0 msgr2=0x7f1de00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.692+0000 7f1de5000640 1 -- 172.21.15.44:0/2240847827 shutdown_connections 2024-09-17T05:45:04.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.692+0000 7f1de5000640 1 -- 172.21.15.44:0/2240847827 wait complete. 2024-09-17T05:45:04.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 Processor -- start 2024-09-17T05:45:04.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 -- start start 2024-09-17T05:45:04.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 0x7f1de00b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1de00b4d50 0x7f1de01fa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1de01face0 0x7f1de01f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1de0166e20 con 0x7f1dc4003a10 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1de0166ca0 con 0x7f1de01face0 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1de5000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1de0166fa0 con 0x7f1de00b4d50 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1ddde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 0x7f1de00b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1ddde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 0x7f1de00b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51390/0 (socket says 172.21.15.44:51390) 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1ddde00640 1 -- 172.21.15.44:0/2144727426 learned_addr learned my addr 172.21.15.44:0/2144727426 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1dd7e00640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1de00b4d50 0x7f1de01fa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.696+0000 7f1dde800640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1de01face0 0x7f1de01f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1ddde00640 1 -- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1de00b4d50 msgr2=0x7f1de01fa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1ddde00640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1de00b4d50 0x7f1de01fa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1ddde00640 1 -- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1de01face0 msgr2=0x7f1de01f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1ddde00640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1de01face0 0x7f1de01f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1ddde00640 1 -- 172.21.15.44:0/2144727426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de00b5160 con 0x7f1dc4003a10 2024-09-17T05:45:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1ddde00640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 0x7f1de00b4810 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00b0040 tx=0x7f1dd00099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:04.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1dd6000640 1 -- 172.21.15.44:0/2144727426 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00bd020 con 0x7f1dc4003a10 2024-09-17T05:45:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1dd6000640 1 -- 172.21.15.44:0/2144727426 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd0005030 con 0x7f1dc4003a10 2024-09-17T05:45:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de00b1260 con 0x7f1dc4003a10 2024-09-17T05:45:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1dd6000640 1 -- 172.21.15.44:0/2144727426 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0005460 con 0x7f1dc4003a10 2024-09-17T05:45:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de00c2c40 con 0x7f1dc4003a10 2024-09-17T05:45:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de00cb880 con 0x7f1dc4003a10 2024-09-17T05:45:04.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1dd6000640 1 -- 172.21.15.44:0/2144727426 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1dd00c0070 con 0x7f1dc4003a10 2024-09-17T05:45:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1dd6000640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dbc073200 0x7f1dbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:04.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.700+0000 7f1dd6000640 1 -- 172.21.15.44:0/2144727426 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f1dd012eb80 con 0x7f1dc4003a10 2024-09-17T05:45:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.704+0000 7f1dd7e00640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dbc073200 0x7f1dbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:04.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.704+0000 7f1dd7e00640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dbc073200 0x7f1dbc075710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1de015a520 tx=0x7f1dc8006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:04.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.708+0000 7f1dd6000640 1 -- 172.21.15.44:0/2144727426 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1dd0017140 con 0x7f1dc4003a10 2024-09-17T05:45:04.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1de01660d0 con 0x7f1dc4003a10 2024-09-17T05:45:04.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1dd6000640 1 -- 172.21.15.44:0/2144727426 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) ==== 94+0+5214 (secure 0 0 0) 0x7f1dd00f9260 con 0x7f1dc4003a10 2024-09-17T05:45:04.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:04.916 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"btime":"2024-09-17T05:45:04:695295+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:45:03.700743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7651},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7651":{"gid":7651,"name":"c","rank":0,"incarnation":87,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.44:6835/1998109127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1998109127},{"type":"v1","addr":"172.21.15.44:6835","nonce":1998109127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-17T05:45:04.916 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 89 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dbc073200 msgr2=0x7f1dbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dbc073200 0x7f1dbc075710 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1de015a520 tx=0x7f1dc8006040 comp rx=0 tx=0).stop 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 msgr2=0x7f1de00b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 0x7f1de00b4810 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00b0040 tx=0x7f1dd00099a0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 shutdown_connections 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1dbc073200 0x7f1dbc075710 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1de01face0 0x7f1de01f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1de00b4d50 0x7f1de01fa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 --2- 172.21.15.44:0/2144727426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1dc4003a10 0x7f1de00b4810 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:04.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 >> 172.21.15.44:0/2144727426 conn(0x7f1de00ccaa0 msgr2=0x7f1de015a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:04.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 shutdown_connections 2024-09-17T05:45:04.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:04.916+0000 7f1de5000640 1 -- 172.21.15.44:0/2144727426 wait complete. 2024-09-17T05:45:05.342 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:44:17.352549+0000', 'modified': '2024-09-17T05:45:03.700743+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7651}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7651': {'gid': 7651, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.44:6835/1998109127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1998109127}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1998109127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:45:05.342 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7651:up:rejoin 2024-09-17T05:45:06.343 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:06.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 -- 172.21.15.44:0/2159510005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc8072e50 msgr2=0x7f7fc815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 --2- 172.21.15.44:0/2159510005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc8072e50 0x7f7fc815e990 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009900 tx=0x7f7fb801c850 comp rx=0 tx=0).stop 2024-09-17T05:45:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 -- 172.21.15.44:0/2159510005 shutdown_connections 2024-09-17T05:45:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 --2- 172.21.15.44:0/2159510005 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc80cb470 0x7f7fc80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 --2- 172.21.15.44:0/2159510005 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc8072e50 0x7f7fc815e990 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 -- 172.21.15.44:0/2159510005 >> 172.21.15.44:0/2159510005 conn(0x7f7fc80ccaa0 msgr2=0x7f7fc80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 -- 172.21.15.44:0/2159510005 shutdown_connections 2024-09-17T05:45:06.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.512+0000 7f7fce800640 1 -- 172.21.15.44:0/2159510005 wait complete. 2024-09-17T05:45:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 Processor -- start 2024-09-17T05:45:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 -- start start 2024-09-17T05:45:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc806de50 0x7f7fc80a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc8072e50 0x7f7fc80c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc80cb470 0x7f7fc81597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8168f70 con 0x7f7fc806de50 2024-09-17T05:45:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc8168df0 con 0x7f7fc80cb470 2024-09-17T05:45:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fce800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc81690f0 con 0x7f7fc8072e50 2024-09-17T05:45:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fc7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc806de50 0x7f7fc80a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fc7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc806de50 0x7f7fc80a0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51414/0 (socket says 172.21.15.44:51414) 2024-09-17T05:45:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.516+0000 7f7fc7400640 1 -- 172.21.15.44:0/3862075578 learned_addr learned my addr 172.21.15.44:0/3862075578 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbea00640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc8072e50 0x7f7fc80c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7e00640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc80cb470 0x7f7fc81597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7400640 1 -- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc8072e50 msgr2=0x7f7fc80c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7400640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc8072e50 0x7f7fc80c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7400640 1 -- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc80cb470 msgr2=0x7f7fc81597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7400640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc80cb470 0x7f7fc81597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7400640 1 -- 172.21.15.44:0/3862075578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc81fc420 con 0x7f7fc806de50 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7e00640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc80cb470 0x7f7fc81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbea00640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc8072e50 0x7f7fc80c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fc7400640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc806de50 0x7f7fc80a0f40 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80b0040 tx=0x7f7fb80a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbfe00640 1 -- 172.21.15.44:0/3862075578 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80bb070 con 0x7f7fc806de50 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbfe00640 1 -- 172.21.15.44:0/3862075578 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fb80043b0 con 0x7f7fc806de50 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbfe00640 1 -- 172.21.15.44:0/3862075578 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80b2040 con 0x7f7fc806de50 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc81fc700 con 0x7f7fc806de50 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc81fccc0 con 0x7f7fc806de50 2024-09-17T05:45:06.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc815e990 con 0x7f7fc806de50 2024-09-17T05:45:06.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbfe00640 1 -- 172.21.15.44:0/3862075578 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7fb80be070 con 0x7f7fc806de50 2024-09-17T05:45:06.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbfe00640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7fa4073200 0x7f7fa4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:06.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.520+0000 7f7fbfe00640 1 -- 172.21.15.44:0/3862075578 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f7fb812dc80 con 0x7f7fc806de50 2024-09-17T05:45:06.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.524+0000 7f7fbea00640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7fa4073200 0x7f7fa4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:06.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.524+0000 7f7fbea00640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7fa4073200 0x7f7fa4075710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80b5ee0 tx=0x7f7fb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:06.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.528+0000 7f7fbfe00640 1 -- 172.21.15.44:0/3862075578 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7fb80164d0 con 0x7f7fc806de50 2024-09-17T05:45:06.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.736+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fc80b5fa0 con 0x7f7fc806de50 2024-09-17T05:45:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.736+0000 7f7fbfe00640 1 -- 172.21.15.44:0/3862075578 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5221 (secure 0 0 0) 0x7f7fb80f8a50 con 0x7f7fc806de50 2024-09-17T05:45:06.738 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:06.738 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":90,"btime":"2024-09-17T05:45:05:696886+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:45:05.696875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7651},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7651":{"gid":7651,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/1998109127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":1998109127},{"type":"v1","addr":"172.21.15.44:6835","nonce":1998109127}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7651,"qdb_cluster":[7651]},"id":7}]} 2024-09-17T05:45:06.738 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 90 2024-09-17T05:45:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7fa4073200 msgr2=0x7f7fa4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7fa4073200 0x7f7fa4075710 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80b5ee0 tx=0x7f7fb0008040 comp rx=0 tx=0).stop 2024-09-17T05:45:06.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc806de50 msgr2=0x7f7fc80a0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc806de50 0x7f7fc80a0f40 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80b0040 tx=0x7f7fb80a5620 comp rx=0 tx=0).stop 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 shutdown_connections 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7fa4073200 0x7f7fa4075710 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc80cb470 0x7f7fc81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7fc8072e50 0x7f7fc80c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 --2- 172.21.15.44:0/3862075578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7fc806de50 0x7f7fc80a0f40 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 >> 172.21.15.44:0/3862075578 conn(0x7f7fc80ccaa0 msgr2=0x7f7fc806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 shutdown_connections 2024-09-17T05:45:06.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:06.740+0000 7f7fce800640 1 -- 172.21.15.44:0/3862075578 wait complete. 2024-09-17T05:45:07.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:44:17.352549+0000', 'modified': '2024-09-17T05:45:05.696875+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 108, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7651}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7651': {'gid': 7651, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6835/1998109127', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6833', 'nonce': 1998109127}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1998109127}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7651, 'qdb_cluster': [7651]} 2024-09-17T05:45:07.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:45:07.164 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:45:07.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.324+0000 7f088ae00640 1 -- 172.21.15.44:0/732827534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0884072e50 msgr2=0x7f088415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.324+0000 7f088ae00640 1 --2- 172.21.15.44:0/732827534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0884072e50 0x7f088415e990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0874009840 tx=0x7f087401c790 comp rx=0 tx=0).stop 2024-09-17T05:45:07.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.324+0000 7f088ae00640 1 -- 172.21.15.44:0/732827534 shutdown_connections 2024-09-17T05:45:07.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.324+0000 7f088ae00640 1 --2- 172.21.15.44:0/732827534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0884072e50 0x7f088415e990 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.324+0000 7f088ae00640 1 -- 172.21.15.44:0/732827534 >> 172.21.15.44:0/732827534 conn(0x7f08840ccaa0 msgr2=0x7f08840cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.324+0000 7f088ae00640 1 -- 172.21.15.44:0/732827534 shutdown_connections 2024-09-17T05:45:07.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.324+0000 7f088ae00640 1 -- 172.21.15.44:0/732827534 wait complete. 2024-09-17T05:45:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 Processor -- start 2024-09-17T05:45:07.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 -- start start 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f088406de50 0x7f08840b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0884072e50 0x7f08840af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08840cb470 0x7f08840cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0884169ee0 con 0x7f088406de50 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0884169d60 con 0x7f08840cb470 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f088416a060 con 0x7f0884072e50 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f088406de50 0x7f08840b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f088406de50 0x7f08840b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51420/0 (socket says 172.21.15.44:51420) 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 -- 172.21.15.44:0/923957040 learned_addr learned my addr 172.21.15.44:0/923957040 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f087b400640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0884072e50 0x7f08840af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0888e00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08840cb470 0x7f08840cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 -- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0884072e50 msgr2=0x7f08840af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0884072e50 0x7f08840af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 -- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08840cb470 msgr2=0x7f08840cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08840cb470 0x7f08840cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 -- 172.21.15.44:0/923957040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08840b09d0 con 0x7f088406de50 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0888e00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08840cb470 0x7f08840cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:07.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0883e00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f088406de50 0x7f08840b59b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0874009790 tx=0x7f0874005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0880c00640 1 -- 172.21.15.44:0/923957040 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08740b2040 con 0x7f088406de50 2024-09-17T05:45:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08840b0cb0 con 0x7f088406de50 2024-09-17T05:45:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0880c00640 1 -- 172.21.15.44:0/923957040 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08740043e0 con 0x7f088406de50 2024-09-17T05:45:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f0880c00640 1 -- 172.21.15.44:0/923957040 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08740052d0 con 0x7f088406de50 2024-09-17T05:45:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.328+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08840afc10 con 0x7f088406de50 2024-09-17T05:45:07.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.332+0000 7f0880c00640 1 -- 172.21.15.44:0/923957040 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0874005470 con 0x7f088406de50 2024-09-17T05:45:07.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.332+0000 7f0880c00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0860073230 0x7f0860075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.332+0000 7f0880c00640 1 -- 172.21.15.44:0/923957040 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f087412d700 con 0x7f088406de50 2024-09-17T05:45:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.332+0000 7f087b400640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0860073230 0x7f0860075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.332+0000 7f089237e000 1 Processor -- start 2024-09-17T05:45:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.332+0000 7f089237e000 1 -- start start 2024-09-17T05:45:07.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f087b400640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0860073230 0x7f0860075740 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f08840a0ca0 tx=0x7f086c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55693236a460 0x5569328ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556932743ca0 0x5569328ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556932780410 con 0x55693236a460 2024-09-17T05:45:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5569326bdb40 con 0x556932743ca0 2024-09-17T05:45:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5569326acf70 con 0x55693275a950 2024-09-17T05:45:07.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55693236a460 0x5569328ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55693236a460 0x5569328ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51424/0 (socket says 172.21.15.44:51424) 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 -- 172.21.15.44:0/3659839105 learned_addr learned my addr 172.21.15.44:0/3659839105 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0888e00640 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556932743ca0 0x5569328ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f087b400640 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 -- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 msgr2=0x5569328abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 -- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556932743ca0 msgr2=0x5569328ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556932743ca0 0x5569328ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 -- 172.21.15.44:0/3659839105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569326745b0 con 0x55693236a460 2024-09-17T05:45:07.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0888e00640 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556932743ca0 0x5569328ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:07.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0883e00640 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55693236a460 0x5569328ab6a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f08740f4fa0 tx=0x7f08740f7b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f37909a752237e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0878c00640 1 -- 172.21.15.44:0/3659839105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08740bc040 con 0x55693236a460 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0878c00640 1 -- 172.21.15.44:0/3659839105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08740a5850 con 0x55693236a460 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f0878c00640 1 -- 172.21.15.44:0/3659839105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08740f7840 con 0x55693236a460 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- 172.21.15.44:0/3659839105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55693236a460 msgr2=0x5569328ab6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55693236a460 0x5569328ab6a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f08740f4fa0 tx=0x7f08740f7b00 comp rx=0 tx=0).stop 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- 172.21.15.44:0/3659839105 shutdown_connections 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556932743ca0 0x5569328ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 --2- 172.21.15.44:0/3659839105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55693236a460 0x5569328ab6a0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- 172.21.15.44:0/3659839105 >> 172.21.15.44:0/3659839105 conn(0x556932830d90 msgr2=0x556932860690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- 172.21.15.44:0/3659839105 shutdown_connections 2024-09-17T05:45:07.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.336+0000 7f089237e000 1 -- 172.21.15.44:0/3659839105 wait complete. 2024-09-17T05:45:07.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 -- start start 2024-09-17T05:45:07.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 Processor -- start 2024-09-17T05:45:07.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x5569328b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x5569328b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5569326475f0 con 0x556932743ca0 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5569326b0d80 con 0x55693275a950 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x556932653520 con 0x55693236a460 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 10 client.0 _ll_register_callbacks cb 0x556932657830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328b2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51428/0 (socket says 172.21.15.44:51428) 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 -- 172.21.15.44:0/151750783 learned_addr learned my addr 172.21.15.44:0/151750783 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0888e00640 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x5569328b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0883e00640 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x5569328b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 -- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 msgr2=0x5569328b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x5569328b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 -- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 msgr2=0x5569328b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x5569328b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 -- 172.21.15.44:0/151750783 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55693264b190 con 0x556932743ca0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f087b400640 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328b2e60 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f086c015c30 tx=0x7f086c004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e29b56d3023b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0871600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0871600640 1 -- 172.21.15.44:0/151750783 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c005020 con 0x556932743ca0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556932645110 con 0x556932743ca0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0871600640 1 -- 172.21.15.44:0/151750783 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f086c01e040 con 0x556932743ca0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0871600640 1 -- 172.21.15.44:0/151750783 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f086c02d050 con 0x556932743ca0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 10 client.7983 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x556932731f10 con 0x556932743ca0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0871600640 1 -- 172.21.15.44:0/151750783 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x556932645110 con 0x556932743ca0 2024-09-17T05:45:07.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f0871600640 1 -- 172.21.15.44:0/151750783 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f086c030020 con 0x556932743ca0 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.340+0000 7f089237e000 10 client.7983 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 10 client.7983 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 20 client.7983 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693234f7d0 0x5569328bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 4 client.7983 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569326bfa90 con 0x55693234f7d0 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f0883e00640 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693234f7d0 0x5569328bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f0883e00640 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693234f7d0 0x5569328bcd00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82002695a7cbf89b server_cookie=edbfb0d9d0ec7306 in_seq=0 out_seq=0 2024-09-17T05:45:07.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f0871600640 10 client.7983 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f0871600640 1 -- 172.21.15.44:0/151750783 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569326bfa90 con 0x55693234f7d0 2024-09-17T05:45:07.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f0871600640 10 client.7983 handle_command_reply: tid=0 2024-09-17T05:45:07.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 client.7983 shutdown 2024-09-17T05:45:07.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 msgr2=0x5569328b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328b2e60 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f086c015c30 tx=0x7f086c004630 comp rx=0 tx=0).stop 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 shutdown_connections 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693234f7d0 0x5569328bcd00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x5569328b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328b2e60 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f0871600640 0 client.7983 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 --2- 172.21.15.44:0/151750783 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x5569328b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 >> 172.21.15.44:0/151750783 conn(0x556932830d90 msgr2=0x556932867440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 shutdown_connections 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 1 -- 172.21.15.44:0/151750783 wait complete. 2024-09-17T05:45:07.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.344+0000 7f089237e000 20 client.7983 trim_cache size 0 max 16384 2024-09-17T05:45:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 Processor -- start 2024-09-17T05:45:07.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 -- start start 2024-09-17T05:45:07.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x55693285fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x556932860210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x556932860750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0884203750 con 0x556932743ca0 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0884202790 con 0x55693275a950 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f08840b44d0 con 0x55693236a460 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x556932860210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x556932860210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51430/0 (socket says 172.21.15.44:51430) 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 -- 172.21.15.44:0/1655394064 learned_addr learned my addr 172.21.15.44:0/1655394064 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f0883e00640 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x55693285fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f0888e00640 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x556932860750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 -- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 msgr2=0x55693285fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x55693285fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 -- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 msgr2=0x556932860750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x556932860750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 -- 172.21.15.44:0/1655394064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556932708db0 con 0x556932743ca0 2024-09-17T05:45:07.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f087b400640 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x556932860210 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f086c013fd0 tx=0x7f086c005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18fefd4bb58ba05 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f0873e00640 1 -- 172.21.15.44:0/1655394064 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c035020 con 0x556932743ca0 2024-09-17T05:45:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f0873e00640 1 -- 172.21.15.44:0/1655394064 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f086c021420 con 0x556932743ca0 2024-09-17T05:45:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.364+0000 7f0873e00640 1 -- 172.21.15.44:0/1655394064 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c021670 con 0x556932743ca0 2024-09-17T05:45:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- 172.21.15.44:0/1655394064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 msgr2=0x556932860210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x556932860210 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f086c013fd0 tx=0x7f086c005630 comp rx=0 tx=0).stop 2024-09-17T05:45:07.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- 172.21.15.44:0/1655394064 shutdown_connections 2024-09-17T05:45:07.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693275a950 0x556932860750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x556932860210 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 --2- 172.21.15.44:0/1655394064 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693236a460 0x55693285fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- 172.21.15.44:0/1655394064 >> 172.21.15.44:0/1655394064 conn(0x556932830d90 msgr2=0x5569328a9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- 172.21.15.44:0/1655394064 shutdown_connections 2024-09-17T05:45:07.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- 172.21.15.44:0/1655394064 wait complete. 2024-09-17T05:45:07.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- start start 2024-09-17T05:45:07.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 Processor -- start 2024-09-17T05:45:07.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693236a460 0x556932862db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328e1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556932731a80 con 0x556932743ca0 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5569326b53b0 con 0x55693236a460 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5569326bc910 con 0x55693275a950 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f089237e000 10 client.0 _ll_register_callbacks cb 0x7f086c015430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f087b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f087b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51440/0 (socket says 172.21.15.44:51440) 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f087b400640 1 -- 172.21.15.44:0/2100477978 learned_addr learned my addr 172.21.15.44:0/2100477978 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f0883e00640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693236a460 0x556932862db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.368+0000 7f0888e00640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f087b400640 1 -- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 msgr2=0x5569328e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f087b400640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328e1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f087b400640 1 -- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693236a460 msgr2=0x556932862db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f087b400640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693236a460 0x556932862db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f087b400640 1 -- 172.21.15.44:0/2100477978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556932673ab0 con 0x556932743ca0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0888e00640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f087b400640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328632f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f086c001ec0 tx=0x7f086c007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb1bbb4bc6f5a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 1 -- 172.21.15.44:0/2100477978 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086c035070 con 0x556932743ca0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 1 -- 172.21.15.44:0/2100477978 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f086c026040 con 0x556932743ca0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f086c021420 con 0x556932743ca0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 1 -- 172.21.15.44:0/2100477978 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f086c042050 con 0x556932743ca0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 10 client.7989 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x556932652070 con 0x556932743ca0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 1 -- 172.21.15.44:0/2100477978 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f086c021420 con 0x556932743ca0 2024-09-17T05:45:07.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 1 -- 172.21.15.44:0/2100477978 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f086c045020 con 0x556932743ca0 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 10 client.7989 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 10 client.7989 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 20 client.7989 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693233d830 0x5569328e1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 4 client.7989 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "status"}) -- 0x5569326bb540 con 0x55693233d830 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0883e00640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693233d830 0x5569328e1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0883e00640 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693233d830 0x5569328e1fc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f109702781226b4c server_cookie=c5bc8531a0aa3020 in_seq=0 out_seq=0 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 10 client.7989 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 1 -- 172.21.15.44:0/2100477978 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5569326bb540 con 0x55693233d830 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 10 client.7989 handle_command_reply: tid=0 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 client.7989 shutdown 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 msgr2=0x5569328632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328632f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f086c001ec0 tx=0x7f086c007920 comp rx=0 tx=0).stop 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 shutdown_connections 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55693275a950 0x5569328e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556932743ca0 0x5569328632f0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55693233d830 0x5569328e1fc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 --2- 172.21.15.44:0/2100477978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693236a460 0x556932862db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 >> 172.21.15.44:0/2100477978 conn(0x556932830d90 msgr2=0x5569328bc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f0871600640 0 client.7989 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 shutdown_connections 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 1 -- 172.21.15.44:0/2100477978 wait complete. 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f089237e000 20 client.7989 trim_cache size 0 max 16384 2024-09-17T05:45:07.378 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 7651, 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.6792193390000003, 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 90, 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 108, 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 108, 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 5.5436246239999996 2024-09-17T05:45:07.379 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:45:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0860073230 msgr2=0x7f0860075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0860073230 0x7f0860075740 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f08840a0ca0 tx=0x7f086c009040 comp rx=0 tx=0).stop 2024-09-17T05:45:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f088406de50 msgr2=0x7f08840b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f088406de50 0x7f08840b59b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0874009790 tx=0x7f0874005db0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 shutdown_connections 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0860073230 0x7f0860075740 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08840cb470 0x7f08840cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0884072e50 0x7f08840af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 --2- 172.21.15.44:0/923957040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f088406de50 0x7f08840b59b0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.372+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 >> 172.21.15.44:0/923957040 conn(0x7f08840ccaa0 msgr2=0x7f0884153d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.376+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 shutdown_connections 2024-09-17T05:45:07.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.376+0000 7f088ae00640 1 -- 172.21.15.44:0/923957040 wait complete. 2024-09-17T05:45:07.394 DEBUG:teuthology.orchestra.run.smithi044:> sudo daemon-helper kill ceph --cluster ceph -w 2024-09-17T05:45:07.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:07.398 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-09-17T05:45:07.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.564+0000 7fc5cde00640 1 -- 172.21.15.44:0/3404520378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5ac003a10 msgr2=0x7fc5ac003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.564+0000 7fc5cde00640 1 --2- 172.21.15.44:0/3404520378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5ac003a10 0x7fc5ac003e80 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c290 tx=0x7fc5b801cf70 comp rx=0 tx=0).stop 2024-09-17T05:45:07.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.564+0000 7fc5c7400640 1 -- 172.21.15.44:0/3404520378 reap_dead start 2024-09-17T05:45:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.564+0000 7fc5cde00640 1 -- 172.21.15.44:0/3404520378 shutdown_connections 2024-09-17T05:45:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.564+0000 7fc5cde00640 1 -- 172.21.15.44:0/3404520378 >> 172.21.15.44:0/3404520378 conn(0x7fc5c80b9260 msgr2=0x7fc5c80b9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.564+0000 7fc5cde00640 1 -- 172.21.15.44:0/3404520378 shutdown_connections 2024-09-17T05:45:07.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.564+0000 7fc5cde00640 1 -- 172.21.15.44:0/3404520378 wait complete. 2024-09-17T05:45:07.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.568+0000 7fc5cde00640 1 Processor -- start 2024-09-17T05:45:07.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.568+0000 7fc5cde00640 1 -- start start 2024-09-17T05:45:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac003a10 0x7fc5c80ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5c8156740 0x7fc5c8158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8156c90 0x7fc5c81588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80d0590 con 0x7fc5c8156c90 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80b67d0 con 0x7fc5ac003a10 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c80d0710 con 0x7fc5c8156740 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8156c90 0x7fc5c81588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8156c90 0x7fc5c81588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51460/0 (socket says 172.21.15.44:51460) 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 -- 172.21.15.44:0/2348066647 learned_addr learned my addr 172.21.15.44:0/2348066647 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c6000640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5c8156740 0x7fc5c8158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac003a10 0x7fc5c80ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 -- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5c8156740 msgr2=0x7fc5c8158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5c8156740 0x7fc5c8158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 -- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac003a10 msgr2=0x7fc5c80ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac003a10 0x7fc5c80ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 -- 172.21.15.44:0/2348066647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c8168880 con 0x7fc5c8156c90 2024-09-17T05:45:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac003a10 0x7fc5c80ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c6000640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5c8156740 0x7fc5c8158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5c7400640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8156c90 0x7fc5c81588c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80b7350 tx=0x7fc5c000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5bf400640 1 -- 172.21.15.44:0/2348066647 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004d30 con 0x7fc5c8156c90 2024-09-17T05:45:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5bf400640 1 -- 172.21.15.44:0/2348066647 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5c0003980 con 0x7fc5c8156c90 2024-09-17T05:45:07.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c81f90d0 con 0x7fc5c8156c90 2024-09-17T05:45:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5bf400640 1 -- 172.21.15.44:0/2348066647 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0003dd0 con 0x7fc5c8156c90 2024-09-17T05:45:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.572+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c81f9690 con 0x7fc5c8156c90 2024-09-17T05:45:07.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5bf400640 1 -- 172.21.15.44:0/2348066647 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc5c0004030 con 0x7fc5c8156c90 2024-09-17T05:45:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 Processor -- start 2024-09-17T05:45:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5bf400640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc5a8073230 0x7fc5a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 -- start start 2024-09-17T05:45:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5bf400640 1 -- 172.21.15.44:0/2348066647 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7fc5c00957d0 con 0x7fc5c8156c90 2024-09-17T05:45:07.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5c6000640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc5a8073230 0x7fc5a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5c6000640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc5a8073230 0x7fc5a8075740 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc5c81f8fe0 tx=0x7fc5b4005f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f01693a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167e9ae0 0x55f01693ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f01693b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f0166ffbd0 con 0x55f0167d3970 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f0166f0430 con 0x55f0167f11a0 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f01674dce0 con 0x55f0167e9ae0 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f01693b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f01693b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51462/0 (socket says 172.21.15.44:51462) 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5c7400640 1 -- 172.21.15.44:0/2979518360 learned_addr learned my addr 172.21.15.44:0/2979518360 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f01693a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.576+0000 7fc5c6000640 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167e9ae0 0x55f01693ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5c7400640 1 -- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167e9ae0 msgr2=0x55f01693ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5c7400640 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167e9ae0 0x55f01693ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5c7400640 1 -- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 msgr2=0x55f01693a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5c7400640 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f01693a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5c7400640 1 -- 172.21.15.44:0/2979518360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0166f1d80 con 0x55f0167d3970 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5c7400640 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f01693b0c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc5c005fe20 tx=0x7fc5c005f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a21a80b66cb597 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5b3400640 1 -- 172.21.15.44:0/2979518360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0064970 con 0x55f0167d3970 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5b3400640 1 -- 172.21.15.44:0/2979518360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5c0069820 con 0x55f0167d3970 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5b3400640 1 -- 172.21.15.44:0/2979518360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c005f0f0 con 0x55f0167d3970 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 -- 172.21.15.44:0/2979518360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 msgr2=0x55f01693b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f01693b0c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc5c005fe20 tx=0x7fc5c005f9a0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 -- 172.21.15.44:0/2979518360 shutdown_connections 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f01693b0c0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167e9ae0 0x55f01693ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/2979518360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f01693a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 -- 172.21.15.44:0/2979518360 >> 172.21.15.44:0/2979518360 conn(0x55f0167f78c0 msgr2=0x55f0168ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 -- 172.21.15.44:0/2979518360 shutdown_connections 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 -- 172.21.15.44:0/2979518360 wait complete. 2024-09-17T05:45:07.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 -- start start 2024-09-17T05:45:07.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.580+0000 7fc5d54b2000 1 Processor -- start 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f016928100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f016928a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167f11a0 0x55f016928f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f016740f20 con 0x55f0167d3970 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f01673d110 con 0x55f0167e9ae0 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f0166e26d0 con 0x55f0167f11a0 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 10 client.0 _ll_register_callbacks cb 0x55f0166e1330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f016928100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f016928100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51466/0 (socket says 172.21.15.44:51466) 2024-09-17T05:45:07.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 -- 172.21.15.44:0/3469469156 learned_addr learned my addr 172.21.15.44:0/3469469156 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6000640 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f016928a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c7400640 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167f11a0 0x55f016928f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 -- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167f11a0 msgr2=0x55f016928f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167f11a0 0x55f016928f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 -- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 msgr2=0x55f016928a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f016928a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 -- 172.21.15.44:0/3469469156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0166db310 con 0x55f0167d3970 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f016928100 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c290 tx=0x7fc5b8001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a25040f1fc787dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:07.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3469469156 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8001540 con 0x55f0167d3970 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3469469156 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7fc5b80bc970 con 0x55f0167d3970 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0166d5450 con 0x55f0167d3970 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3469469156 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fc5b80016e0 con 0x55f0167d3970 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 10 client.8001 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.584+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x55f0166f8f60 con 0x55f0167d3970 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3469469156 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f0166d5450 con 0x55f0167d3970 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3469469156 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7fc5b80bcb70 con 0x55f0167d3970 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 10 client.8001 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 10 client.8001 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 20 client.8001 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163dfb80 0x55f016929ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 4 client.8001 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:45:07.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f01674fc30 con 0x55f0163dfb80 2024-09-17T05:45:07.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5c6000640 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163dfb80 0x55f016929ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5a7e00640 10 client.8001 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5c6000640 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163dfb80 0x55f016929ca0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8290ed25e7410ecf server_cookie=cfbd0f934ba260b7 in_seq=0 out_seq=0 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3469469156 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f01674fc30 con 0x55f0163dfb80 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5a7e00640 10 client.8001 handle_command_reply: tid=0 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 client.8001 shutdown 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 msgr2=0x55f016928100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f016928100 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c290 tx=0x7fc5b8001cc0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 shutdown_connections 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167f11a0 0x55f016928f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163dfb80 0x55f016929ca0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f016928a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3469469156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167d3970 0x55f016928100 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5a7e00640 0 client.8001 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 >> 172.21.15.44:0/3469469156 conn(0x55f0167f78c0 msgr2=0x55f0168ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 shutdown_connections 2024-09-17T05:45:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3469469156 wait complete. 2024-09-17T05:45:07.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.588+0000 7fc5d54b2000 20 client.8001 trim_cache size 0 max 16384 2024-09-17T05:45:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 -- 172.21.15.44:0/3874799400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42700adf60 msgr2=0x7f427015c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 --2- 172.21.15.44:0/3874799400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42700adf60 0x7f427015c870 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f4260009840 tx=0x7f426001c820 comp rx=0 tx=0).stop 2024-09-17T05:45:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 -- 172.21.15.44:0/3874799400 shutdown_connections 2024-09-17T05:45:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 --2- 172.21.15.44:0/3874799400 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42700ad6b0 0x7f4270072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 --2- 172.21.15.44:0/3874799400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42700adf60 0x7f427015c870 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 -- 172.21.15.44:0/3874799400 >> 172.21.15.44:0/3874799400 conn(0x7f42700d0190 msgr2=0x7f42700d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 -- 172.21.15.44:0/3874799400 shutdown_connections 2024-09-17T05:45:07.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.592+0000 7f4276e00640 1 -- 172.21.15.44:0/3874799400 wait complete. 2024-09-17T05:45:07.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.596+0000 7f4276e00640 1 Processor -- start 2024-09-17T05:45:07.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.596+0000 7f4276e00640 1 -- start start 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42700adf60 0x7f42701fa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42700cf960 0x7f42700b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700c6640 0x7f42701f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4270169ec0 con 0x7f42700adf60 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4270169d40 con 0x7f42700c6640 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f427016a040 con 0x7f42700cf960 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42700adf60 0x7f42701fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42700adf60 0x7f42701fa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51478/0 (socket says 172.21.15.44:51478) 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 -- 172.21.15.44:0/3745300829 learned_addr learned my addr 172.21.15.44:0/3745300829 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4274e00640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700c6640 0x7f42701f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426f400640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42700cf960 0x7f42700b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 -- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42700cf960 msgr2=0x7f42700b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42700cf960 0x7f42700b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 -- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700c6640 msgr2=0x7f42701f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42700c6640 0x7f42701f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 -- 172.21.15.44:0/3745300829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427015a6c0 con 0x7f42700adf60 2024-09-17T05:45:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426f400640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42700cf960 0x7f42700b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f426fe00640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42700adf60 0x7f42701fa3a0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f4260009790 tx=0x7f4260005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600bb070 con 0x7f42700adf60 2024-09-17T05:45:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4260004330 con 0x7f42700adf60 2024-09-17T05:45:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600b2040 con 0x7f42700adf60 2024-09-17T05:45:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 -- 172.21.15.44:0/3745300829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427015a9a0 con 0x7f42700adf60 2024-09-17T05:45:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.600+0000 7f4276e00640 1 -- 172.21.15.44:0/3745300829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701f6e30 con 0x7f42700adf60 2024-09-17T05:45:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f4276e00640 1 -- 172.21.15.44:0/3745300829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f4270072ea0 con 0x7f42700adf60 2024-09-17T05:45:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4260003820 con 0x7f42700adf60 2024-09-17T05:45:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f4267e00640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4250073200 0x7f4250075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f426012e4c0 con 0x7f42700adf60 2024-09-17T05:45:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+511 (secure 0 0 0) 0x7f42600c4070 con 0x7f42700adf60 2024-09-17T05:45:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f426f400640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4250073200 0x7f4250075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f4276e00640 1 -- 172.21.15.44:0/3745300829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f42700affb0 con 0x7f42700adf60 2024-09-17T05:45:07.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 7 ==== log(2 entries from seq 942 at 2024-09-17T05:45:05.696979+0000) ==== 389+0+0 (secure 0 0 0) 0x7f426012c810 con 0x7f42700adf60 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: cluster: 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: id: 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: health: HEALTH_OK 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: services: 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: mgr: x(active, since 9m), standbys: y 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: mds: 1/1 daemons up, 3 standby 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: data: 2024-09-17T05:45:07.607 INFO:teuthology.orchestra.run.smithi044.stdout: volumes: 1/1 healthy 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: pools: 3 pools, 97 pgs 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: objects: 30 objects, 19 MiB 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: pgs: 97 active+clean 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: io: 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: client: 10 KiB/s rd, 127 B/s wr, 9 op/s rd, 0 op/s wr 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:05.696979+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-17T05:45:07.608 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:05.697013+0000 mon.a [INF] Cluster is now healthy 2024-09-17T05:45:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.604+0000 7f426f400640 1 --2- 172.21.15.44:0/3745300829 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4250073200 0x7f4250075710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4270158660 tx=0x7f425c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.612+0000 7fc5d54b2000 1 Processor -- start 2024-09-17T05:45:07.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.612+0000 7fc5d54b2000 1 -- start start 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0169517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167e9ae0 0x55f016951d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f0168ecae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8205a60 con 0x55f0167e9ae0 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8204af0 con 0x55f0167f11a0 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c81fb0e0 con 0x55f0167d3970 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167e9ae0 0x55f016951d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167e9ae0 0x55f016951d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51486/0 (socket says 172.21.15.44:51486) 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 -- 172.21.15.44:0/854368076 learned_addr learned my addr 172.21.15.44:0/854368076 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0169517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c7400640 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f0168ecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 -- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 msgr2=0x55f0169517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0169517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 -- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 msgr2=0x55f0168ecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f0168ecae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 -- 172.21.15.44:0/854368076 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0167c1f30 con 0x55f0167e9ae0 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c7400640 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f0168ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5c6000640 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167e9ae0 0x55f016951d30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4013010 tx=0x7fc5b401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e871c07866630ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5b2a00640 1 -- 172.21.15.44:0/854368076 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4038070 con 0x55f0167e9ae0 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5b2a00640 1 -- 172.21.15.44:0/854368076 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5b4005320 con 0x55f0167e9ae0 2024-09-17T05:45:07.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5b2a00640 1 -- 172.21.15.44:0/854368076 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b40056f0 con 0x55f0167e9ae0 2024-09-17T05:45:07.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- 172.21.15.44:0/854368076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167e9ae0 msgr2=0x55f016951d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167e9ae0 0x55f016951d30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4013010 tx=0x7fc5b401b000 comp rx=0 tx=0).stop 2024-09-17T05:45:07.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- 172.21.15.44:0/854368076 shutdown_connections 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167f11a0 0x55f0168ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167e9ae0 0x55f016951d30 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/854368076 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0169517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- 172.21.15.44:0/854368076 >> 172.21.15.44:0/854368076 conn(0x55f0167f78c0 msgr2=0x55f016928de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- 172.21.15.44:0/854368076 shutdown_connections 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.616+0000 7fc5d54b2000 1 -- 172.21.15.44:0/854368076 wait complete. 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 -- start start 2024-09-17T05:45:07.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 Processor -- start 2024-09-17T05:45:07.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0168f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f0168f0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167f11a0 0x55f0168f1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f016745550 con 0x55f0167f11a0 2024-09-17T05:45:07.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f01673d110 con 0x55f0167e9ae0 2024-09-17T05:45:07.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55f0167c1aa0 con 0x55f0167d3970 2024-09-17T05:45:07.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 10 client.0 _ll_register_callbacks cb 0x7fc5ac005650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167f11a0 0x55f0168f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167f11a0 0x55f0168f1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51500/0 (socket says 172.21.15.44:51500) 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 -- 172.21.15.44:0/3780980245 learned_addr learned my addr 172.21.15.44:0/3780980245 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0168f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c6000640 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f0168f0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 -- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 msgr2=0x55f0168f06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0168f06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 -- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 msgr2=0x55f0168f0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f0168f0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 -- 172.21.15.44:0/3780980245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f016798dd0 con 0x55f0167f11a0 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5c7400640 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167f11a0 0x55f0168f1130 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fc5c005fe20 tx=0x7fc5c00939d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216de7cf6764946c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:07.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3780980245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0064970 con 0x55f0167f11a0 2024-09-17T05:45:07.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3780980245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7fc5c005f300 con 0x55f0167f11a0 2024-09-17T05:45:07.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b4005320 con 0x55f0167f11a0 2024-09-17T05:45:07.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3780980245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fc5c0069820 con 0x55f0167f11a0 2024-09-17T05:45:07.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 10 client.8016 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:07.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x55f0166d3840 con 0x55f0167f11a0 2024-09-17T05:45:07.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3780980245 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5b4005320 con 0x55f0167f11a0 2024-09-17T05:45:07.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3780980245 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7fc5c0065bf0 con 0x55f0167f11a0 2024-09-17T05:45:07.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 10 client.8016 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:07.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 10 client.8016 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:07.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 20 client.8016 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:07.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163cdbe0 0x55f0168f1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 4 client.8016 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-09-17T05:45:07.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.620+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55f01674b6e0 con 0x55f0163cdbe0 2024-09-17T05:45:07.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163cdbe0 0x55f0168f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5c6a00640 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163cdbe0 0x55f0168f1670 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2d6e367a87f7da5 server_cookie=50b812c806d31f35 in_seq=0 out_seq=0 2024-09-17T05:45:07.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5a7e00640 10 client.8016 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.626 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-09-17T05:45:07.626 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-09-17T05:45:07.626 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-09-17T05:45:07.626 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-09-17T05:45:07.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5a7e00640 1 -- 172.21.15.44:0/3780980245 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f01674b6e0 con 0x55f0163cdbe0 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5a7e00640 10 client.8016 handle_command_reply: tid=0 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 client.8016 shutdown 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167f11a0 msgr2=0x55f0168f1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167f11a0 0x55f0168f1130 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fc5c005fe20 tx=0x7fc5c00939d0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 shutdown_connections 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f0167f11a0 0x55f0168f1130 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x55f0163cdbe0 0x55f0168f1670 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f0167e9ae0 0x55f0168f0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 --2- 172.21.15.44:0/3780980245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55f0167d3970 0x55f0168f06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5a7e00640 0 client.8016 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 >> 172.21.15.44:0/3780980245 conn(0x55f0167f78c0 msgr2=0x55f0169507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 shutdown_connections 2024-09-17T05:45:07.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 1 -- 172.21.15.44:0/3780980245 wait complete. 2024-09-17T05:45:07.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5d54b2000 20 client.8016 trim_cache size 0 max 16384 2024-09-17T05:45:07.629 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:45:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-09-17T05:45:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "0a4fbae4-0934-46f3-a62a-788729420d0c", 2024-09-17T05:45:07.629 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-09-17T05:45:07.629 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:45:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc5a8073230 msgr2=0x7fc5a8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc5a8073230 0x7fc5a8075740 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc5c81f8fe0 tx=0x7fc5b4005f40 comp rx=0 tx=0).stop 2024-09-17T05:45:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8156c90 msgr2=0x7fc5c81588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8156c90 0x7fc5c81588c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc5c80b7350 tx=0x7fc5c000f790 comp rx=0 tx=0).stop 2024-09-17T05:45:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 shutdown_connections 2024-09-17T05:45:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5c8156c90 0x7fc5c81588c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc5c8156740 0x7fc5c8158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc5a8073230 0x7fc5a8075740 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 --2- 172.21.15.44:0/2348066647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5ac003a10 0x7fc5c80ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 >> 172.21.15.44:0/2348066647 conn(0x7fc5c80b9260 msgr2=0x7fc5c8159780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 shutdown_connections 2024-09-17T05:45:07.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.624+0000 7fc5cde00640 1 -- 172.21.15.44:0/2348066647 wait complete. 2024-09-17T05:45:07.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:07.648 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 -- 172.21.15.44:0/3036513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 msgr2=0x7fee0c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 --2- 172.21.15.44:0/3036513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c15e990 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009840 tx=0x7fedfc01c790 comp rx=0 tx=0).stop 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 -- 172.21.15.44:0/3036513 shutdown_connections 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 --2- 172.21.15.44:0/3036513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee0c0cb470 0x7fee0c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 --2- 172.21.15.44:0/3036513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c15e990 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 -- 172.21.15.44:0/3036513 >> 172.21.15.44:0/3036513 conn(0x7fee0c0ccaa0 msgr2=0x7fee0c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 -- 172.21.15.44:0/3036513 shutdown_connections 2024-09-17T05:45:07.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.808+0000 7fee13800640 1 -- 172.21.15.44:0/3036513 wait complete. 2024-09-17T05:45:07.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 Processor -- start 2024-09-17T05:45:07.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 -- start start 2024-09-17T05:45:07.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee0c06de50 0x7fee0c1f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee0c0cb470 0x7fee0c070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c168ed0 con 0x7fee0c072e50 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c168d50 con 0x7fee0c0cb470 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee13800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c169050 con 0x7fee0c06de50 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51514/0 (socket says 172.21.15.44:51514) 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee03e00640 1 -- 172.21.15.44:0/3351889593 learned_addr learned my addr 172.21.15.44:0/3351889593 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee11800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee0c0cb470 0x7fee0c070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.812+0000 7fee10e00640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee0c06de50 0x7fee0c1f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee03e00640 1 -- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee0c06de50 msgr2=0x7fee0c1f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee03e00640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee0c06de50 0x7fee0c1f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee03e00640 1 -- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee0c0cb470 msgr2=0x7fee0c070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee03e00640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee0c0cb470 0x7fee0c070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee03e00640 1 -- 172.21.15.44:0/3351889593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0cf340 con 0x7fee0c072e50 2024-09-17T05:45:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee03e00640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c158170 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c400 tx=0x7fedf400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee09600640 1 -- 172.21.15.44:0/3351889593 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4017070 con 0x7fee0c072e50 2024-09-17T05:45:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee09600640 1 -- 172.21.15.44:0/3351889593 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedf4003600 con 0x7fee0c072e50 2024-09-17T05:45:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c0cf620 con 0x7fee0c072e50 2024-09-17T05:45:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee09600640 1 -- 172.21.15.44:0/3351889593 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4003a50 con 0x7fee0c072e50 2024-09-17T05:45:07.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.816+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c1649d0 con 0x7fee0c072e50 2024-09-17T05:45:07.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee09600640 1 -- 172.21.15.44:0/3351889593 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fedf401a070 con 0x7fee0c072e50 2024-09-17T05:45:07.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 Processor -- start 2024-09-17T05:45:07.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 -- start start 2024-09-17T05:45:07.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee09600640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fede8073200 0x7fede8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee09600640 1 -- 172.21.15.44:0/3351889593 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7fedf40936f0 con 0x7fee0c072e50 2024-09-17T05:45:07.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee11800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fede8073200 0x7fede8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee11800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fede8073200 0x7fede8075710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee04005fd0 tx=0x7fee0400a4f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77df200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb77df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb77dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561eb7675cd0 con 0x561eb766a6d0 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561eb758b330 con 0x561eb7385aa0 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x561eb75e8bb0 con 0x561eb72c1890 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77df200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51528/0 (socket says 172.21.15.44:51528) 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 -- 172.21.15.44:0/1189129231 learned_addr learned my addr 172.21.15.44:0/1189129231 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee11800640 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb77dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee03e00640 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb77df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 -- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 msgr2=0x561eb77df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb77df740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 -- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 msgr2=0x561eb77dfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb77dfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 -- 172.21.15.44:0/1189129231 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb758cc80 con 0x561eb766a6d0 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.820+0000 7fee10e00640 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77df200 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0b0040 tx=0x7fedfc019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f5165691497b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee01600640 1 -- 172.21.15.44:0/1189129231 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0b2040 con 0x561eb766a6d0 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee01600640 1 -- 172.21.15.44:0/1189129231 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedfc0bd070 con 0x561eb766a6d0 2024-09-17T05:45:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee01600640 1 -- 172.21.15.44:0/1189129231 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0a5850 con 0x561eb766a6d0 2024-09-17T05:45:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- 172.21.15.44:0/1189129231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 msgr2=0x561eb77df200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77df200 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0b0040 tx=0x7fedfc019530 comp rx=0 tx=0).stop 2024-09-17T05:45:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- 172.21.15.44:0/1189129231 shutdown_connections 2024-09-17T05:45:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb77dfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb77df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 --2- 172.21.15.44:0/1189129231 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77df200 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- 172.21.15.44:0/1189129231 >> 172.21.15.44:0/1189129231 conn(0x561eb72955c0 msgr2=0x561eb7793ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- 172.21.15.44:0/1189129231 shutdown_connections 2024-09-17T05:45:07.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- 172.21.15.44:0/1189129231 wait complete. 2024-09-17T05:45:07.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- start start 2024-09-17T05:45:07.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 Processor -- start 2024-09-17T05:45:07.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb72c1890 0x561eb77929d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb7385aa0 0x561eb7792f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561eb75dbdf0 con 0x561eb766a6d0 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561eb75d7fe0 con 0x561eb72c1890 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x561eb757d4d0 con 0x561eb7385aa0 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.824+0000 7fee1af07000 10 client.0 _ll_register_callbacks cb 0x561eb755b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee11800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee11800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51530/0 (socket says 172.21.15.44:51530) 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee11800640 1 -- 172.21.15.44:0/306687692 learned_addr learned my addr 172.21.15.44:0/306687692 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee10e00640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb72c1890 0x561eb77929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee03e00640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb7385aa0 0x561eb7792f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee10e00640 1 -- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb7385aa0 msgr2=0x561eb7792f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee10e00640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb7385aa0 0x561eb7792f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee10e00640 1 -- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 msgr2=0x561eb77a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee10e00640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee10e00640 1 -- 172.21.15.44:0/306687692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb7576210 con 0x561eb72c1890 2024-09-17T05:45:07.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee11800640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:07.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee10e00640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb72c1890 0x561eb77929d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fedfc01a3c0 tx=0x7fedfc0044a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f0b2b98908afb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-17T05:45:07.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 1 -- 172.21.15.44:0/306687692 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0b2070 con 0x561eb72c1890 2024-09-17T05:45:07.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 1 -- 172.21.15.44:0/306687692 <== mon.1 v2:172.21.15.86:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7fedfc0a5850 con 0x561eb72c1890 2024-09-17T05:45:07.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561eb7570350 con 0x561eb72c1890 2024-09-17T05:45:07.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 1 -- 172.21.15.44:0/306687692 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fedfc0cc050 con 0x561eb72c1890 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 10 client.7735 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x561eb755cfc0 con 0x561eb72c1890 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 1 -- 172.21.15.44:0/306687692 <== mon.1 v2:172.21.15.86:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561eb7570350 con 0x561eb72c1890 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 1 -- 172.21.15.44:0/306687692 <== mon.1 v2:172.21.15.86:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7fedfc0cf020 con 0x561eb72c1890 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 10 client.7735 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 10 client.7735 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 20 client.7735 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb727a930 0x561eb77e6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 4 client.7735 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eb75eab00 con 0x561eb727a930 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee03e00640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb727a930 0x561eb77e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 10 client.7735 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee03e00640 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb727a930 0x561eb77e6690 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f485984f8b92826f server_cookie=440b877a91aa254e in_seq=0 out_seq=0 2024-09-17T05:45:07.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 1 -- 172.21.15.44:0/306687692 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561eb75eab00 con 0x561eb727a930 2024-09-17T05:45:07.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fedfa000640 10 client.7735 handle_command_reply: tid=0 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.828+0000 7fee1af07000 1 client.7735 shutdown 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb72c1890 msgr2=0x561eb77929d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb72c1890 0x561eb77929d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fedfc01a3c0 tx=0x7fedfc0044a0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 shutdown_connections 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb766a6d0 0x561eb77a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb7385aa0 0x561eb7792f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb727a930 0x561eb77e6690 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 --2- 172.21.15.44:0/306687692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb72c1890 0x561eb77929d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fedfa000640 0 client.7735 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 >> 172.21.15.44:0/306687692 conn(0x561eb72955c0 msgr2=0x561eb778bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 shutdown_connections 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 1 -- 172.21.15.44:0/306687692 wait complete. 2024-09-17T05:45:07.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.832+0000 7fee1af07000 20 client.7735 trim_cache size 0 max 16384 2024-09-17T05:45:07.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.848+0000 7fee1af07000 1 Processor -- start 2024-09-17T05:45:07.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.848+0000 7fee1af07000 1 -- start start 2024-09-17T05:45:07.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb72c1890 0x561eb7850a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb7850f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb766a6d0 0x561eb7851480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561eb7791af0 con 0x561eb72c1890 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c162a70 con 0x561eb7385aa0 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c161af0 con 0x561eb766a6d0 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb72c1890 0x561eb7850a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb72c1890 0x561eb7850a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51546/0 (socket says 172.21.15.44:51546) 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 -- 172.21.15.44:0/3851037728 learned_addr learned my addr 172.21.15.44:0/3851037728 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee03e00640 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb7850f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee11800640 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb766a6d0 0x561eb7851480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 -- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb766a6d0 msgr2=0x561eb7851480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb766a6d0 0x561eb7851480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 -- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 msgr2=0x561eb7850f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb7850f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 -- 172.21.15.44:0/3851037728 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb7635680 con 0x561eb72c1890 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee11800640 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb766a6d0 0x561eb7851480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee10e00640 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb72c1890 0x561eb7850a00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fedfc000c10 tx=0x7fedfc0a5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c94ed83d8ca8ad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee00c00640 1 -- 172.21.15.44:0/3851037728 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0b2040 con 0x561eb72c1890 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee00c00640 1 -- 172.21.15.44:0/3851037728 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedfc000e50 con 0x561eb72c1890 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee00c00640 1 -- 172.21.15.44:0/3851037728 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc005280 con 0x561eb72c1890 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- 172.21.15.44:0/3851037728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb72c1890 msgr2=0x561eb7850a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb72c1890 0x561eb7850a00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fedfc000c10 tx=0x7fedfc0a5f50 comp rx=0 tx=0).stop 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- 172.21.15.44:0/3851037728 shutdown_connections 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb766a6d0 0x561eb7851480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb7385aa0 0x561eb7850f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 --2- 172.21.15.44:0/3851037728 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb72c1890 0x561eb7850a00 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- 172.21.15.44:0/3851037728 >> 172.21.15.44:0/3851037728 conn(0x561eb72955c0 msgr2=0x561eb77f17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- 172.21.15.44:0/3851037728 shutdown_connections 2024-09-17T05:45:07.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- 172.21.15.44:0/3851037728 wait complete. 2024-09-17T05:45:07.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 -- start start 2024-09-17T05:45:07.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.852+0000 7fee1af07000 1 Processor -- start 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb7854c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb7385aa0 0x561eb7855190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb766a6d0 0x561eb78556d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c1614a0 con 0x561eb7385aa0 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c165c30 con 0x561eb766a6d0 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x561eb729d680 con 0x561eb72c1890 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 10 client.0 _ll_register_callbacks cb 0x7fee0400aa50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb7385aa0 0x561eb7855190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb7385aa0 0x561eb7855190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51554/0 (socket says 172.21.15.44:51554) 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 -- 172.21.15.44:0/2541342600 learned_addr learned my addr 172.21.15.44:0/2541342600 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee10e00640 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb7854c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee11800640 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb766a6d0 0x561eb78556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 -- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 msgr2=0x561eb7854c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb7854c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 -- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb766a6d0 msgr2=0x561eb78556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb766a6d0 0x561eb78556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 -- 172.21.15.44:0/2541342600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb75a20b0 con 0x561eb7385aa0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee03e00640 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb7385aa0 0x561eb7855190 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fedf400cfd0 tx=0x7fedf4005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f06dc309addfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fedfa000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fedfa000640 1 -- 172.21.15.44:0/2541342600 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf40674b0 con 0x561eb7385aa0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fedfa000640 1 -- 172.21.15.44:0/2541342600 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7fedf4065b80 con 0x561eb7385aa0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedfc000e50 con 0x561eb7385aa0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fedfa000640 1 -- 172.21.15.44:0/2541342600 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fedf406f050 con 0x561eb7385aa0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 10 client.8037 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x561eb756e610 con 0x561eb7385aa0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fedfa000640 1 -- 172.21.15.44:0/2541342600 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedfc000e50 con 0x561eb7385aa0 2024-09-17T05:45:07.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fedfa000640 1 -- 172.21.15.44:0/2541342600 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7fedf4072020 con 0x561eb7385aa0 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 10 client.8037 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 10 client.8037 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 20 client.8037 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb7268990 0x561eb778db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 4 client.8037 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561eb75e65b0 con 0x561eb7268990 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee10e00640 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb7268990 0x561eb778db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fedfa000640 10 client.8037 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.856+0000 7fee10e00640 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb7268990 0x561eb778db10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d22adac2af32ea server_cookie=70c9daa7653ea6db in_seq=0 out_seq=0 2024-09-17T05:45:07.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fedfa000640 1 -- 172.21.15.44:0/2541342600 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+571 (crc 0 0 0) 0x561eb75e65b0 con 0x561eb7268990 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fedfa000640 10 client.8037 handle_command_reply: tid=0 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 client.8037 shutdown 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb7385aa0 msgr2=0x561eb7855190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb7385aa0 0x561eb7855190 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fedf400cfd0 tx=0x7fedf4005560 comp rx=0 tx=0).stop 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 shutdown_connections 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x561eb7268990 0x561eb778db10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561eb766a6d0 0x561eb78556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561eb7385aa0 0x561eb7855190 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 --2- 172.21.15.44:0/2541342600 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561eb72c1890 0x561eb7854c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fedfa000640 0 client.8037 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 >> 172.21.15.44:0/2541342600 conn(0x561eb72955c0 msgr2=0x561eb77a0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 shutdown_connections 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 1 -- 172.21.15.44:0/2541342600 wait complete. 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee1af07000 20 client.8037 trim_cache size 0 max 16384 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stdout: "0a4fbae4-0934-46f3-a62a-788729420d0c": { 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "0a4fbae4-0934-46f3-a62a-788729420d0c", 2024-09-17T05:45:07.865 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive,repair" 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "0a4fbae4-0934-46f3-a62a-788729420d0c": { 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:45:07.624952+0000", 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:07.866 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:45:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fede8073200 msgr2=0x7fede8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fede8073200 0x7fede8075710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee04005fd0 tx=0x7fee0400a4f0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 msgr2=0x7fee0c158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c158170 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c400 tx=0x7fedf400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 shutdown_connections 2024-09-17T05:45:07.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fede8073200 0x7fede8075710 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee0c0cb470 0x7fee0c070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee0c072e50 0x7fee0c158170 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 --2- 172.21.15.44:0/3351889593 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee0c06de50 0x7fee0c1f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:07.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 >> 172.21.15.44:0/3351889593 conn(0x7fee0c0ccaa0 msgr2=0x7fee0c0b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:07.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 shutdown_connections 2024-09-17T05:45:07.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:07.860+0000 7fee13800640 1 -- 172.21.15.44:0/3351889593 wait complete. 2024-09-17T05:45:07.880 INFO:tasks.cephfs.filesystem:scrub status for tag:0a4fbae4-0934-46f3-a62a-788729420d0c - {'path': '/', 'tag': '0a4fbae4-0934-46f3-a62a-788729420d0c', 'options': 'recursive,repair'} 2024-09-17T05:45:08.695 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:45:08.696+0000 7f382e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:45:08.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:08.712+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 8 ==== log(8 entries from seq 1 at 2024-09-17T05:45:07.627648+0000) ==== 1407+0+0 (secure 0 0 0) 0x7f42600f4ea0 con 0x7f42700adf60 2024-09-17T05:45:08.715 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.627648+0000 mds.c [INF] scrub queued for path: / 2024-09-17T05:45:08.715 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.627652+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-09-17T05:45:08.715 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.627656+0000 mds.c [INF] scrub summary: active paths [/] 2024-09-17T05:45:08.716 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.628671+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-09-17T05:45:08.716 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.628676+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2024-09-17T05:45:08.716 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.628885+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-09-17T05:45:08.716 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.628889+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2024-09-17T05:45:08.716 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:07.629627+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-09-17T05:45:13.690 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:13.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:13.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:13.724+0000 7f4267e00640 1 -- 172.21.15.44:0/3745300829 <== mon.0 v2:172.21.15.44:3300/0 9 ==== log(1 entries from seq 9 at 2024-09-17T05:45:11.836806+0000) ==== 189+0+0 (secure 0 0 0) 0x7f426012e0c0 con 0x7f42700adf60 2024-09-17T05:45:13.725 INFO:teuthology.orchestra.run.smithi044.stdout:2024-09-17T05:45:11.836806+0000 mds.c [INF] scrub summary: idle 2024-09-17T05:45:37.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:45:37.881 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T05:45:38.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.056+0000 7f6955a00640 1 -- 172.21.15.44:0/411882115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 msgr2=0x7f6934004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.056+0000 7f6955a00640 1 --2- 172.21.15.44:0/411882115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 0x7f6934004c20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f6950072900 tx=0x7f693801d250 comp rx=0 tx=0).stop 2024-09-17T05:45:38.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.056+0000 7f694f400640 1 -- 172.21.15.44:0/411882115 reap_dead start 2024-09-17T05:45:38.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.056+0000 7f6955a00640 1 -- 172.21.15.44:0/411882115 shutdown_connections 2024-09-17T05:45:38.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.056+0000 7f6955a00640 1 -- 172.21.15.44:0/411882115 >> 172.21.15.44:0/411882115 conn(0x7f69500ccaa0 msgr2=0x7f69500cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.056+0000 7f6955a00640 1 -- 172.21.15.44:0/411882115 shutdown_connections 2024-09-17T05:45:38.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.056+0000 7f6955a00640 1 -- 172.21.15.44:0/411882115 wait complete. 2024-09-17T05:45:38.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 Processor -- start 2024-09-17T05:45:38.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 -- start start 2024-09-17T05:45:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 0x7f69500c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69500cb6d0 0x7f69501f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69501f9930 0x7f69500c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6950074770 con 0x7f6934004810 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69500745f0 con 0x7f69501f9930 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f6955a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f695006de50 con 0x7f69500cb6d0 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 0x7f69500c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 0x7f69500c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44626/0 (socket says 172.21.15.44:44626) 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 -- 172.21.15.44:0/1454522457 learned_addr learned my addr 172.21.15.44:0/1454522457 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694f400640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69501f9930 0x7f69500c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 -- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69500cb6d0 msgr2=0x7f69501f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69500cb6d0 0x7f69501f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 -- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69501f9930 msgr2=0x7f69500c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69501f9930 0x7f69500c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.060+0000 7f694ea00640 1 -- 172.21.15.44:0/1454522457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69500cbe40 con 0x7f6934004810 2024-09-17T05:45:38.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.064+0000 7f694ea00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 0x7f69500c7f40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f6940011ab0 tx=0x7f6940011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.064+0000 7f6947400640 1 -- 172.21.15.44:0/1454522457 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694001e070 con 0x7f6934004810 2024-09-17T05:45:38.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.064+0000 7f6947400640 1 -- 172.21.15.44:0/1454522457 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f694000fe70 con 0x7f6934004810 2024-09-17T05:45:38.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.064+0000 7f6947400640 1 -- 172.21.15.44:0/1454522457 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400042b0 con 0x7f6934004810 2024-09-17T05:45:38.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.064+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69500cc120 con 0x7f6934004810 2024-09-17T05:45:38.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.064+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69500c8580 con 0x7f6934004810 2024-09-17T05:45:38.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.064+0000 7f6947400640 1 -- 172.21.15.44:0/1454522457 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6940021070 con 0x7f6934004810 2024-09-17T05:45:38.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f6947400640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f692c073200 0x7f692c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f6947400640 1 -- 172.21.15.44:0/1454522457 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f6940094ea0 con 0x7f6934004810 2024-09-17T05:45:38.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f6946000640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f692c073200 0x7f692c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 Processor -- start 2024-09-17T05:45:38.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 -- start start 2024-09-17T05:45:38.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f6946000640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f692c073200 0x7f692c075710 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6950072900 tx=0x7f6934005840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a7c9a6d0 0x5627a7e069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e06f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e07470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627a7ca5cd0 con 0x5627a7c9a6d0 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5627a7bbb330 con 0x5627a78f1890 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5627a7c18bb0 con 0x5627a79b5aa0 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a7c9a6d0 0x5627a7e069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a7c9a6d0 0x5627a7e069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44642/0 (socket says 172.21.15.44:44642) 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 -- 172.21.15.44:0/1609293847 learned_addr learned my addr 172.21.15.44:0/1609293847 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f6946000640 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e06f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694f400640 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e07470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 -- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 msgr2=0x5627a7e07470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e07470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 -- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 msgr2=0x5627a7e06f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e06f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 -- 172.21.15.44:0/1609293847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a7bbcc80 con 0x5627a7c9a6d0 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.068+0000 7f694ea00640 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a7c9a6d0 0x5627a7e069f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f694005c880 tx=0x7f694005f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d8768dd53da994 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f693f400640 1 -- 172.21.15.44:0/1609293847 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940068ef0 con 0x5627a7c9a6d0 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f693f400640 1 -- 172.21.15.44:0/1609293847 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6940004450 con 0x5627a7c9a6d0 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f693f400640 1 -- 172.21.15.44:0/1609293847 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694005e870 con 0x5627a7c9a6d0 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- 172.21.15.44:0/1609293847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a7c9a6d0 msgr2=0x5627a7e069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a7c9a6d0 0x5627a7e069f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f694005c880 tx=0x7f694005f120 comp rx=0 tx=0).stop 2024-09-17T05:45:38.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- 172.21.15.44:0/1609293847 shutdown_connections 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e07470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e06f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1609293847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a7c9a6d0 0x5627a7e069f0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- 172.21.15.44:0/1609293847 >> 172.21.15.44:0/1609293847 conn(0x5627a78c55c0 msgr2=0x5627a7dc3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- 172.21.15.44:0/1609293847 shutdown_connections 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- 172.21.15.44:0/1609293847 wait complete. 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- start start 2024-09-17T05:45:38.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 Processor -- start 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7dc2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a79b5aa0 0x5627a7dc2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7dc95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627a7c0bdf0 con 0x5627a78f1890 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5627a7c07fe0 con 0x5627a79b5aa0 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.072+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5627a7bad4d0 con 0x5627a7c9a6d0 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 10 client.0 _ll_register_callbacks cb 0x5627a7b8b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7dc2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7dc2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44656/0 (socket says 172.21.15.44:44656) 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 -- 172.21.15.44:0/553425580 learned_addr learned my addr 172.21.15.44:0/553425580 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694f400640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7dc95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6946000640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a79b5aa0 0x5627a7dc2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 -- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 msgr2=0x5627a7dc95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7dc95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 -- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a79b5aa0 msgr2=0x5627a7dc2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a79b5aa0 0x5627a7dc2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 -- 172.21.15.44:0/553425580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a7ba6210 con 0x5627a78f1890 2024-09-17T05:45:38.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6946000640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a79b5aa0 0x5627a7dc2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:38.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f694ea00640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7dc2a00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f694005f7d0 tx=0x7f694000f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d36a1d0e69b2638 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 1 -- 172.21.15.44:0/553425580 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694007e060 con 0x5627a78f1890 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 1 -- 172.21.15.44:0/553425580 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f694005ea80 con 0x5627a78f1890 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5627a7ba0350 con 0x5627a78f1890 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 1 -- 172.21.15.44:0/553425580 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f6940066250 con 0x5627a78f1890 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 10 client.8049 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x5627a7b8cfc0 con 0x5627a78f1890 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 1 -- 172.21.15.44:0/553425580 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5627a7ba0350 con 0x5627a78f1890 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 1 -- 172.21.15.44:0/553425580 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f694005af60 con 0x5627a78f1890 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 10 client.8049 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 10 client.8049 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 20 client.8049 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a78aa930 0x5627a7e0de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 4 client.8049 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627a7c1ab00 con 0x5627a78aa930 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6946000640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a78aa930 0x5627a7e0de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6946000640 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a78aa930 0x5627a7e0de80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3675f8109c0ae16e server_cookie=9ec3cefa1786724f in_seq=0 out_seq=0 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 10 client.8049 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 1 -- 172.21.15.44:0/553425580 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627a7c1ab00 con 0x5627a78aa930 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 10 client.8049 handle_command_reply: tid=0 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 client.8049 shutdown 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 msgr2=0x5627a7dc2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7dc2a00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f694005f7d0 tx=0x7f694000f8c0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 shutdown_connections 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7dc95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a78aa930 0x5627a7e0de80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a79b5aa0 0x5627a7dc2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 --2- 172.21.15.44:0/553425580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7dc2a00 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f6933e00640 0 client.8049 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:38.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 >> 172.21.15.44:0/553425580 conn(0x5627a78c55c0 msgr2=0x5627a7dbbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 shutdown_connections 2024-09-17T05:45:38.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.076+0000 7f695d0d7000 1 -- 172.21.15.44:0/553425580 wait complete. 2024-09-17T05:45:38.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.080+0000 7f695d0d7000 20 client.8049 trim_cache size 0 max 16384 2024-09-17T05:45:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 Processor -- start 2024-09-17T05:45:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 -- start start 2024-09-17T05:45:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e78400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a79b5aa0 0x5627a7e78940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7e78e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627a7dc1b20 con 0x5627a79b5aa0 2024-09-17T05:45:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69502034d0 con 0x5627a78f1890 2024-09-17T05:45:38.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.096+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f69502024b0 con 0x5627a7c9a6d0 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a79b5aa0 0x5627a7e78940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a79b5aa0 0x5627a7e78940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44662/0 (socket says 172.21.15.44:44662) 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 -- 172.21.15.44:0/1855434356 learned_addr learned my addr 172.21.15.44:0/1855434356 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f694ea00640 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e78400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f694f400640 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7e78e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 -- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 msgr2=0x5627a7e78e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7e78e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 -- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 msgr2=0x5627a7e78400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e78400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 -- 172.21.15.44:0/1855434356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a7c65680 con 0x5627a79b5aa0 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f694ea00640 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e78400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f6946000640 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a79b5aa0 0x5627a7e78940 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f693801ccc0 tx=0x7f69380b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc64f4d05e78e854 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f693ea00640 1 -- 172.21.15.44:0/1855434356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380be040 con 0x5627a79b5aa0 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f693ea00640 1 -- 172.21.15.44:0/1855434356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69380bf040 con 0x5627a79b5aa0 2024-09-17T05:45:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f693ea00640 1 -- 172.21.15.44:0/1855434356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380b1040 con 0x5627a79b5aa0 2024-09-17T05:45:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 -- 172.21.15.44:0/1855434356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a79b5aa0 msgr2=0x5627a7e78940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a79b5aa0 0x5627a7e78940 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f693801ccc0 tx=0x7f69380b8000 comp rx=0 tx=0).stop 2024-09-17T05:45:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 -- 172.21.15.44:0/1855434356 shutdown_connections 2024-09-17T05:45:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a7c9a6d0 0x5627a7e78e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a79b5aa0 0x5627a7e78940 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1855434356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a78f1890 0x5627a7e78400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 -- 172.21.15.44:0/1855434356 >> 172.21.15.44:0/1855434356 conn(0x5627a78c55c0 msgr2=0x5627a7e18fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 -- 172.21.15.44:0/1855434356 shutdown_connections 2024-09-17T05:45:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 -- 172.21.15.44:0/1855434356 wait complete. 2024-09-17T05:45:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 -- start start 2024-09-17T05:45:38.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.100+0000 7f695d0d7000 1 Processor -- start 2024-09-17T05:45:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7e7c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e7cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a7c9a6d0 0x5627a7e7d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6950201e00 con 0x5627a78f1890 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69501f65c0 con 0x5627a7c9a6d0 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5627a78cd680 con 0x5627a79b5aa0 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 10 client.0 _ll_register_callbacks cb 0x7f69380af070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7e7c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7e7c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44664/0 (socket says 172.21.15.44:44664) 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 -- 172.21.15.44:0/1811363909 learned_addr learned my addr 172.21.15.44:0/1811363909 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6946000640 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e7cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694f400640 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a7c9a6d0 0x5627a7e7d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 -- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 msgr2=0x5627a7e7cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e7cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 -- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a7c9a6d0 msgr2=0x5627a7e7d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a7c9a6d0 0x5627a7e7d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 -- 172.21.15.44:0/1811363909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a7bd20b0 con 0x5627a78f1890 2024-09-17T05:45:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f694ea00640 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7e7c650 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f694005b430 tx=0x7f694005f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e4c1acaf3d9432 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:45:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 1 -- 172.21.15.44:0/1811363909 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694005e2e0 con 0x5627a78f1890 2024-09-17T05:45:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 1 -- 172.21.15.44:0/1811363909 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f694005e480 con 0x5627a78f1890 2024-09-17T05:45:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69380bf040 con 0x5627a78f1890 2024-09-17T05:45:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 1 -- 172.21.15.44:0/1811363909 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f694005e680 con 0x5627a78f1890 2024-09-17T05:45:38.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 10 client.8055 fetch_fsmap learned FSMap version 90 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x5627a7b9e610 con 0x5627a78f1890 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 1 -- 172.21.15.44:0/1811363909 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69380bf040 con 0x5627a78f1890 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 1 -- 172.21.15.44:0/1811363909 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7f69400750d0 con 0x5627a78f1890 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 10 client.8055 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 10 client.8055 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 20 client.8055 populate_metadata read hostname 'smithi044' 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a7898990 0x5627a7dbd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 4 client.8055 mds_command: new command op to 7651 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 --> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5627a7c165b0 con 0x5627a7898990 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6946000640 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a7898990 0x5627a7dbd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6946000640 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a7898990 0x5627a7dbd8f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e91af9a62f9332b server_cookie=5295cae1061f2359 in_seq=0 out_seq=0 2024-09-17T05:45:38.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 10 client.8055 ms_handle_connect on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 1 -- 172.21.15.44:0/1811363909 <== mds.0 v2:172.21.15.44:6833/1998109127 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x5627a7c165b0 con 0x5627a7898990 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f6933e00640 10 client.8055 handle_command_reply: tid=0 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.104+0000 7f695d0d7000 1 client.8055 shutdown 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 msgr2=0x5627a7e7c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7e7c650 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f694005b430 tx=0x7f694005f6a0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 shutdown_connections 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:6833/1998109127,v1:172.21.15.44:6835/1998109127] conn(0x5627a7898990 0x5627a7dbd8f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5627a7c9a6d0 0x5627a7e7d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5627a79b5aa0 0x5627a7e7cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 --2- 172.21.15.44:0/1811363909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627a78f1890 0x5627a7e7c650 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6933e00640 0 client.8055 ms_handle_reset on v2:172.21.15.44:6833/1998109127 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 >> 172.21.15.44:0/1811363909 conn(0x5627a78c55c0 msgr2=0x5627a7dc85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 shutdown_connections 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 1 -- 172.21.15.44:0/1811363909 wait complete. 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f695d0d7000 20 client.8055 trim_cache size 0 max 16384 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "0a4fbae4-0934-46f3-a62a-788729420d0c": { 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-09-17T05:45:07.624952+0000", 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-09-17T05:45:38.111 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-09-17T05:45:38.112 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-09-17T05:45:38.112 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-09-17T05:45:38.112 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:38.112 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:38.112 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f692c073200 msgr2=0x7f692c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f692c073200 0x7f692c075710 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6950072900 tx=0x7f6934005840 comp rx=0 tx=0).stop 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 msgr2=0x7f69500c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 0x7f69500c7f40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f6940011ab0 tx=0x7f6940011f70 comp rx=0 tx=0).stop 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 shutdown_connections 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f692c073200 0x7f692c075710 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69501f9930 0x7f69500c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f69500cb6d0 0x7f69501f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 --2- 172.21.15.44:0/1454522457 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6934004810 0x7f69500c7f40 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 >> 172.21.15.44:0/1454522457 conn(0x7f69500ccaa0 msgr2=0x7f695015f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 shutdown_connections 2024-09-17T05:45:38.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.108+0000 7f6955a00640 1 -- 172.21.15.44:0/1454522457 wait complete. 2024-09-17T05:45:38.127 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T05:45:38.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:45:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 -- 172.21.15.44:0/2466730865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 msgr2=0x7f6edc06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 --2- 172.21.15.44:0/2466730865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc06de50 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6edc09e100 tx=0x7f6ecc01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 -- 172.21.15.44:0/2466730865 shutdown_connections 2024-09-17T05:45:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 --2- 172.21.15.44:0/2466730865 >> v2:172.21.15.86:3300/0 conn(0x7f6edc0ce300 0x7f6edc167120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 --2- 172.21.15.44:0/2466730865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc06de50 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 -- 172.21.15.44:0/2466730865 >> 172.21.15.44:0/2466730865 conn(0x7f6edc0ccaa0 msgr2=0x7f6edc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 -- 172.21.15.44:0/2466730865 shutdown_connections 2024-09-17T05:45:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 -- 172.21.15.44:0/2466730865 wait complete. 2024-09-17T05:45:38.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 Processor -- start 2024-09-17T05:45:38.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.388+0000 7f6ee2600640 1 -- start start 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6edc06e390 0x7f6edc158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6edc0ce300 0x7f6edc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc16a000 con 0x7f6edc0b5880 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc169e80 con 0x7f6edc06e390 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f6edc16a180 con 0x7f6edc0ce300 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44690/0 (socket says 172.21.15.44:44690) 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 -- 172.21.15.44:0/989356011 learned_addr learned my addr 172.21.15.44:0/989356011 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6edb400640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6edc06e390 0x7f6edc158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6edbe00640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6edc0ce300 0x7f6edc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 -- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6edc0ce300 msgr2=0x7f6edc0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6edc0ce300 0x7f6edc0ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 -- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6edc06e390 msgr2=0x7f6edc158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6edc06e390 0x7f6edc158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 -- 172.21.15.44:0/989356011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc0ae630 con 0x7f6edc0b5880 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6edbe00640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6edc0ce300 0x7f6edc0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3e00640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc158b20 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c3c0 tx=0x7f6ec400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3400640 1 -- 172.21.15.44:0/989356011 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4017070 con 0x7f6edc0b5880 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3400640 1 -- 172.21.15.44:0/989356011 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ec40053c0 con 0x7f6edc0b5880 2024-09-17T05:45:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6edc0ae910 con 0x7f6edc0b5880 2024-09-17T05:45:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ed3400640 1 -- 172.21.15.44:0/989356011 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4003860 con 0x7f6edc0b5880 2024-09-17T05:45:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6edc0aeed0 con 0x7f6edc0b5880 2024-09-17T05:45:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.392+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6edc06de50 con 0x7f6edc0b5880 2024-09-17T05:45:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.396+0000 7f6ed3400640 1 -- 172.21.15.44:0/989356011 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6ec401a070 con 0x7f6edc0b5880 2024-09-17T05:45:38.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.396+0000 7f6ed3400640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6eb8073230 0x7f6eb8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.396+0000 7f6ed3400640 1 -- 172.21.15.44:0/989356011 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 6303+0+0 (secure 0 0 0) 0x7f6ec4093760 con 0x7f6edc0b5880 2024-09-17T05:45:38.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.396+0000 7f6edb400640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6eb8073230 0x7f6eb8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.396+0000 7f6edb400640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6eb8073230 0x7f6eb8075740 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0af000 tx=0x7f6ecc0a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.400+0000 7f6ed3400640 1 -- 172.21.15.44:0/989356011 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f6edc06e7a0 con 0x7f6edc0b5880 2024-09-17T05:45:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.608+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6edc15f110 con 0x7f6edc0b5880 2024-09-17T05:45:38.610 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:45:38.608+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:45:38.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.612+0000 7f6ed3400640 1 -- 172.21.15.44:0/989356011 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) ==== 161+0+0 (secure 0 0 0) 0x7f6ec405de40 con 0x7f6edc0b5880 2024-09-17T05:45:38.612 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6eb8073230 msgr2=0x7f6eb8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6eb8073230 0x7f6eb8075740 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0af000 tx=0x7f6ecc0a7040 comp rx=0 tx=0).stop 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 msgr2=0x7f6edc158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc158b20 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c3c0 tx=0x7f6ec400c880 comp rx=0 tx=0).stop 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 shutdown_connections 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f6edc0ce300 0x7f6edc0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6edc0b5880 0x7f6edc158b20 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6eb8073230 0x7f6eb8075740 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 --2- 172.21.15.44:0/989356011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6edc06e390 0x7f6edc158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 >> 172.21.15.44:0/989356011 conn(0x7f6edc0ccaa0 msgr2=0x7f6edc070090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 shutdown_connections 2024-09-17T05:45:38.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.616+0000 7f6ee2600640 1 -- 172.21.15.44:0/989356011 wait complete. 2024-09-17T05:45:38.628 INFO:tasks.ceph.mds.c.smithi044.stderr: -1228> 2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-09-17T05:45:38.629 INFO:tasks.ceph.mds.c.smithi044.stderr: -1224> 2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-09-17T05:45:38.629 INFO:tasks.ceph.mds.c.smithi044.stderr: -1195> 2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-09-17T05:45:38.629 INFO:tasks.ceph.mds.c.smithi044.stderr: -1192> 2024-09-17T05:45:07.624+0000 7f3829400640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-09-17T05:45:38.629 INFO:tasks.ceph.mds.c.smithi044.stderr: -1007> 2024-09-17T05:45:08.696+0000 7f382e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:45:38.642 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-09-17T05:45:38.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 -- start start 2024-09-17T05:45:38.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 Processor -- start 2024-09-17T05:45:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caa3da80 0x5606cb7a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caa3d180 0x5606cb7a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaa000 0x5606cb7a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5606cb7c4600 con 0x5606caa3da80 2024-09-17T05:45:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5606cb7c4480 con 0x5606caaaa000 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5606cb7c4300 con 0x5606caa3d180 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caa3da80 0x5606cb7a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caa3da80 0x5606cb7a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44706/0 (socket says 172.21.15.44:44706) 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 -- 172.21.15.44:0/1666577933 learned_addr learned my addr 172.21.15.44:0/1666577933 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eec400640 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaa000 0x5606cb7a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeb000640 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caa3d180 0x5606cb7a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 -- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caa3d180 msgr2=0x5606cb7a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caa3d180 0x5606cb7a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 -- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaa000 msgr2=0x5606cb7a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaa000 0x5606cb7a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 -- 172.21.15.44:0/1666577933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606cb7a0960 con 0x5606caa3da80 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eeba00640 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caa3da80 0x5606cb7a2000 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x5606cb83af90 tx=0x5606cb7ba360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f41d08316baa6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3ee8800640 1 -- 172.21.15.44:0/1666577933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606ca9ff380 con 0x5606caa3da80 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3ee8800640 1 -- 172.21.15.44:0/1666577933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5606caa1cc40 con 0x5606caa3da80 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3ee8800640 1 -- 172.21.15.44:0/1666577933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606ca9ff520 con 0x5606caa3da80 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 -- 172.21.15.44:0/1666577933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606cb7a0d20 con 0x5606caa3da80 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 1 -- 172.21.15.44:0/1666577933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5606cb7a0f00 con 0x5606caa3da80 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 4 waiting for MDS map... 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3ee8800640 1 -- 172.21.15.44:0/1666577933 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x5606cb7b0a00 con 0x5606caa3da80 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3ee8800640 1 -- 172.21.15.44:0/1666577933 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 91) ==== 2893+0+0 (secure 0 0 0) 0x5606caa1f180 con 0x5606caa3da80 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 4 Got MDS map 91 2024-09-17T05:45:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.700+0000 7f3eed8f0400 10 main: main 2024-09-17T05:45:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.704+0000 7f3eed8f0400 4 main: connecting to RADOS... 2024-09-17T05:45:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.704+0000 7f3eed8f0400 1 Processor -- start 2024-09-17T05:45:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.704+0000 7f3eed8f0400 1 -- start start 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.704+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.704+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 0x5606cb7a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaab200 0x5606cb7a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5606cb7c4180 con 0x5606caaab200 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5606caa29380 con 0x5606caaaad80 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5606caa29800 con 0x5606caaaa900 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaab200 0x5606cb7a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaab200 0x5606cb7a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44722/0 (socket says 172.21.15.44:44722) 2024-09-17T05:45:38.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 -- 172.21.15.44:0/584098752 learned_addr learned my addr 172.21.15.44:0/584098752 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eec400640 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeba00640 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 0x5606cb7a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 -- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaaa900 msgr2=0x5606cb7a3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 -- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 msgr2=0x5606cb7a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 0x5606cb7a3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 -- 172.21.15.44:0/584098752 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606cb7a01e0 con 0x5606caaab200 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eec400640 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eeb000640 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaab200 0x5606cb7a3b80 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x5606cb916870 tx=0x5606cb91ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b8383e5a0c069f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3ee6000640 1 -- 172.21.15.44:0/584098752 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606ca9ff380 con 0x5606caaab200 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3ee6000640 1 -- 172.21.15.44:0/584098752 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5606caa1c8c0 con 0x5606caaab200 2024-09-17T05:45:38.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3ee6000640 1 -- 172.21.15.44:0/584098752 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606ca9ff520 con 0x5606caaab200 2024-09-17T05:45:38.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- 172.21.15.44:0/584098752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaab200 msgr2=0x5606cb7a3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaab200 0x5606cb7a3b80 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x5606cb916870 tx=0x5606cb91ac00 comp rx=0 tx=0).stop 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- 172.21.15.44:0/584098752 shutdown_connections 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaab200 0x5606cb7a3b80 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 0x5606cb7a3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/584098752 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- 172.21.15.44:0/584098752 >> 172.21.15.44:0/584098752 conn(0x5606caaaa480 msgr2=0x5606c69c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- 172.21.15.44:0/584098752 shutdown_connections 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- 172.21.15.44:0/584098752 wait complete. 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 Processor -- start 2024-09-17T05:45:38.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.708+0000 7f3eed8f0400 1 -- start start 2024-09-17T05:45:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 0x5606cb7a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaab200 0x5606cb7a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5606cb7c5380 con 0x5606caaaa900 2024-09-17T05:45:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5606cb7c4180 con 0x5606caaaad80 2024-09-17T05:45:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5606cb7c5500 con 0x5606caaab200 2024-09-17T05:45:38.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaaa900 0x5606cb7a3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:44728/0 (socket says 172.21.15.44:44728) 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 -- 172.21.15.44:0/4172714245 learned_addr learned my addr 172.21.15.44:0/4172714245 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eeba00640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 0x5606cb7a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eeb000640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaab200 0x5606cb7a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 -- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaab200 msgr2=0x5606cb7a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caaab200 0x5606cb7a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 -- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 msgr2=0x5606cb7a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaad80 0x5606cb7a3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 -- 172.21.15.44:0/4172714245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606cb7a1a40 con 0x5606caaaa900 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eec400640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaaa900 0x5606cb7a3080 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x5606cb917560 tx=0x5606cb91af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3ee4200640 1 -- 172.21.15.44:0/4172714245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606ca9ff380 con 0x5606caaaa900 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3ee4200640 1 -- 172.21.15.44:0/4172714245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5606caa1c540 con 0x5606caaaa900 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3ee4200640 1 -- 172.21.15.44:0/4172714245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5606ca9ff520 con 0x5606caaaa900 2024-09-17T05:45:38.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606cb7a1c20 con 0x5606caaaa900 2024-09-17T05:45:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606cacfe000 con 0x5606caaaa900 2024-09-17T05:45:38.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3eed8f0400 4 main: resolving pool 15 2024-09-17T05:45:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.712+0000 7f3ee4200640 1 -- 172.21.15.44:0/4172714245 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x5606cad0ec00 con 0x5606caaaa900 2024-09-17T05:45:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3ee4200640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5606caaad600 0x5606cb7a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3ee4200640 1 -- 172.21.15.44:0/4172714245 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x5606cad07000 con 0x5606caaaa900 2024-09-17T05:45:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 4 main: creating IoCtx.. 2024-09-17T05:45:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5606caaab680 0x5606cb7a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) -- 0x5606cad18c00 con 0x5606caaab680 2024-09-17T05:45:38.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eeba00640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5606caaad600 0x5606cb7a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eeb000640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5606caaab680 0x5606cb7a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eeba00640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5606caaad600 0x5606cb7a4100 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x5606cb83bad0 tx=0x5606caadec00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eeb000640 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5606caaab680 0x5606cb7a4680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eeb000640 1 -- 172.21.15.44:0/4172714245 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x5606caada000 con 0x5606caaab680 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stdout: "0": { 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stdout: "data": { 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 5, 2024-09-17T05:45:38.718 INFO:teuthology.orchestra.run.smithi044.stdout: "inotable": { 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: "projected_free": [ 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627779, 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627773 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: "free": [ 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: "start": 1099511627779, 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: "len": 1099511627773 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:38.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:38.720 INFO:teuthology.orchestra.run.smithi044.stdout: "result": 0 2024-09-17T05:45:38.720 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:38.720 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:45:38.720 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5606caaab680 msgr2=0x5606cb7a4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5606caaab680 0x5606cb7a4680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5606caaad600 msgr2=0x5606cb7a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5606caaad600 0x5606cb7a4100 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x5606cb83bad0 tx=0x5606caadec00 comp rx=0 tx=0).stop 2024-09-17T05:45:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaaa900 msgr2=0x5606cb7a3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/4172714245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caaaa900 0x5606cb7a3080 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x5606cb917560 tx=0x5606cb91af60 comp rx=0 tx=0).stop 2024-09-17T05:45:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eeb000640 1 -- 172.21.15.44:0/4172714245 reap_dead start 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 shutdown_connections 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 >> 172.21.15.44:0/4172714245 conn(0x5606caaaa480 msgr2=0x5606c69c2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 shutdown_connections 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/4172714245 wait complete. 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/1666577933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caa3da80 msgr2=0x5606cb7a2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caa3da80 0x5606cb7a2000 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x5606cb83af90 tx=0x5606cb7ba360 comp rx=0 tx=0).stop 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/1666577933 shutdown_connections 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606caaaa000 0x5606cb7a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5606caa3d180 0x5606cb7a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 --2- 172.21.15.44:0/1666577933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5606caa3da80 0x5606cb7a2000 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/1666577933 >> 172.21.15.44:0/1666577933 conn(0x5606caa3d600 msgr2=0x5606c69c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/1666577933 shutdown_connections 2024-09-17T05:45:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:38.716+0000 7f3eed8f0400 1 -- 172.21.15.44:0/1666577933 wait complete. 2024-09-17T05:45:38.724 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.081692, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-09-17T05:45:38.724 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:45:38.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:38.761 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:45:38.834 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:38.929 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:45:38.929 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:38.929 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:45:38.929 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:38.938 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:45:38.938 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:38.938 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:45:38.938 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:38.946 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:38.946 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:38.946 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:45:38.947 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:38.986 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:45:38.986 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:45:38.987 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:45:38.987 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:38.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:38.998 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:39.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 -- 172.21.15.44:0/2348353902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e8072e50 msgr2=0x7f11e815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 --2- 172.21.15.44:0/2348353902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e8072e50 0x7f11e815e990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f11dc009840 tx=0x7f11dc01c790 comp rx=0 tx=0).stop 2024-09-17T05:45:39.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 -- 172.21.15.44:0/2348353902 shutdown_connections 2024-09-17T05:45:39.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 --2- 172.21.15.44:0/2348353902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11e806de50 0x7f11e806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 --2- 172.21.15.44:0/2348353902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e8072e50 0x7f11e815e990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 -- 172.21.15.44:0/2348353902 >> 172.21.15.44:0/2348353902 conn(0x7f11e80ccaa0 msgr2=0x7f11e80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:39.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 -- 172.21.15.44:0/2348353902 shutdown_connections 2024-09-17T05:45:39.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.188+0000 7f11efc00640 1 -- 172.21.15.44:0/2348353902 wait complete. 2024-09-17T05:45:39.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 Processor -- start 2024-09-17T05:45:39.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 -- start start 2024-09-17T05:45:39.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e806de50 0x7f11e8157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11e8072e50 0x7f11e8158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e80ced00 0x7f11e8164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8169410 con 0x7f11e806de50 2024-09-17T05:45:39.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f11e8169290 con 0x7f11e80ced00 2024-09-17T05:45:39.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f11e8169590 con 0x7f11e8072e50 2024-09-17T05:45:39.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e806de50 0x7f11e8157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e806de50 0x7f11e8157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45846/0 (socket says 172.21.15.44:45846) 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 -- 172.21.15.44:0/3658949016 learned_addr learned my addr 172.21.15.44:0/3658949016 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11edc00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e80ced00 0x7f11e8164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11e7e00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11e8072e50 0x7f11e8158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 -- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11e8072e50 msgr2=0x7f11e8158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11e8072e50 0x7f11e8158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 -- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e80ced00 msgr2=0x7f11e8164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e80ced00 0x7f11e8164650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 -- 172.21.15.44:0/3658949016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e8070990 con 0x7f11e806de50 2024-09-17T05:45:39.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11e7e00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11e8072e50 0x7f11e8158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:39.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11ed200640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e806de50 0x7f11e8157ee0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f11dc01cc70 tx=0x7f11dc005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:39.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11e4c00640 1 -- 172.21.15.44:0/3658949016 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0b2040 con 0x7f11e806de50 2024-09-17T05:45:39.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e8070e90 con 0x7f11e806de50 2024-09-17T05:45:39.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.192+0000 7f11e4c00640 1 -- 172.21.15.44:0/3658949016 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11dc004040 con 0x7f11e806de50 2024-09-17T05:45:39.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.196+0000 7f11e4c00640 1 -- 172.21.15.44:0/3658949016 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0043f0 con 0x7f11e806de50 2024-09-17T05:45:39.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.196+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e81fcce0 con 0x7f11e806de50 2024-09-17T05:45:39.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.196+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e806e260 con 0x7f11e806de50 2024-09-17T05:45:39.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.196+0000 7f11e4c00640 1 -- 172.21.15.44:0/3658949016 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f11dc0bd030 con 0x7f11e806de50 2024-09-17T05:45:39.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.196+0000 7f11e4c00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f11c8073230 0x7f11c8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.196+0000 7f11e4c00640 1 -- 172.21.15.44:0/3658949016 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7f11dc12e910 con 0x7f11e806de50 2024-09-17T05:45:39.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.196+0000 7f11e7e00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f11c8073230 0x7f11c8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.200+0000 7f11e7e00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f11c8073230 0x7f11c8075740 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f11e809f080 tx=0x7f11d40091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:39.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.200+0000 7f11e4c00640 1 -- 172.21.15.44:0/3658949016 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f11dc0c4020 con 0x7f11e806de50 2024-09-17T05:45:39.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.408+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11e80a1280 con 0x7f11e806de50 2024-09-17T05:45:39.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.408+0000 7f11e4c00640 1 -- 172.21.15.44:0/3658949016 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+4381 (secure 0 0 0) 0x7f11dc016410 con 0x7f11e806de50 2024-09-17T05:45:39.410 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:39.410 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":91,"btime":"2024-09-17T05:45:38:614366+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:45:38.614361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-17T05:45:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 91 2024-09-17T05:45:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f11c8073230 msgr2=0x7f11c8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f11c8073230 0x7f11c8075740 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f11e809f080 tx=0x7f11d40091e0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e806de50 msgr2=0x7f11e8157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e806de50 0x7f11e8157ee0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f11dc01cc70 tx=0x7f11dc005760 comp rx=0 tx=0).stop 2024-09-17T05:45:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 shutdown_connections 2024-09-17T05:45:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f11c8073230 0x7f11c8075740 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11e80ced00 0x7f11e8164650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f11e8072e50 0x7f11e8158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 --2- 172.21.15.44:0/3658949016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11e806de50 0x7f11e8157ee0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 >> 172.21.15.44:0/3658949016 conn(0x7f11e80ccaa0 msgr2=0x7f11e80cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:39.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 shutdown_connections 2024-09-17T05:45:39.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.412+0000 7f11efc00640 1 -- 172.21.15.44:0/3658949016 wait complete. 2024-09-17T05:45:39.433 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.588+0000 7fa478800640 1 -- 172.21.15.44:0/2796372086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d1d00 msgr2=0x7fa4700cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.588+0000 7fa478800640 1 --2- 172.21.15.44:0/2796372086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d1d00 0x7fa4700cf070 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa460009840 tx=0x7fa46001c760 comp rx=0 tx=0).stop 2024-09-17T05:45:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.588+0000 7fa478800640 1 -- 172.21.15.44:0/2796372086 shutdown_connections 2024-09-17T05:45:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.588+0000 7fa478800640 1 --2- 172.21.15.44:0/2796372086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d1d00 0x7fa4700cf070 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.588+0000 7fa478800640 1 -- 172.21.15.44:0/2796372086 >> 172.21.15.44:0/2796372086 conn(0x7fa4700b4240 msgr2=0x7fa4700b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.588+0000 7fa478800640 1 -- 172.21.15.44:0/2796372086 shutdown_connections 2024-09-17T05:45:39.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 -- 172.21.15.44:0/2796372086 wait complete. 2024-09-17T05:45:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 Processor -- start 2024-09-17T05:45:39.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 -- start start 2024-09-17T05:45:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4700cf5b0 0x7fa47014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d18f0 0x7fa4700b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4700d1d00 0x7fa4700b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa47016afa0 con 0x7fa4700d18f0 2024-09-17T05:45:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa47016ae20 con 0x7fa4700cf5b0 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa478800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa47016b120 con 0x7fa4700d1d00 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.592+0000 7fa475400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d18f0 0x7fa4700b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d18f0 0x7fa4700b75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45870/0 (socket says 172.21.15.44:45870) 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 -- 172.21.15.44:0/1615790753 learned_addr learned my addr 172.21.15.44:0/1615790753 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475e00640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4700cf5b0 0x7fa47014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa476800640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4700d1d00 0x7fa4700b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 -- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4700d1d00 msgr2=0x7fa4700b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4700d1d00 0x7fa4700b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 -- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4700cf5b0 msgr2=0x7fa47014f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4700cf5b0 0x7fa47014f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 -- 172.21.15.44:0/1615790753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa470167670 con 0x7fa4700d18f0 2024-09-17T05:45:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475e00640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4700cf5b0 0x7fa47014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa475400640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d18f0 0x7fa4700b75e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa460000c10 tx=0x7fa4600a5530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa46a000640 1 -- 172.21.15.44:0/1615790753 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b2040 con 0x7fa4700d18f0 2024-09-17T05:45:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa46a000640 1 -- 172.21.15.44:0/1615790753 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4600043b0 con 0x7fa4700d18f0 2024-09-17T05:45:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4700b5390 con 0x7fa4700d18f0 2024-09-17T05:45:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa46a000640 1 -- 172.21.15.44:0/1615790753 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460003860 con 0x7fa4700d18f0 2024-09-17T05:45:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa470153f10 con 0x7fa4700d18f0 2024-09-17T05:45:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4701f7b30 con 0x7fa4700d18f0 2024-09-17T05:45:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.596+0000 7fa46a000640 1 -- 172.21.15.44:0/1615790753 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa4600bd060 con 0x7fa4700d18f0 2024-09-17T05:45:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.600+0000 7fa46a000640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa454073200 0x7fa454075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.600+0000 7fa46a000640 1 -- 172.21.15.44:0/1615790753 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7fa46012df20 con 0x7fa4700d18f0 2024-09-17T05:45:39.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.600+0000 7fa475e00640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa454073200 0x7fa454075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:39.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.600+0000 7fa475e00640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa454073200 0x7fa454075710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa464000f70 tx=0x7fa464009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.604+0000 7fa46a000640 1 -- 172.21.15.44:0/1615790753 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa460016410 con 0x7fa4700d18f0 2024-09-17T05:45:39.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.812+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4700cf070 con 0x7fa4700d18f0 2024-09-17T05:45:39.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.812+0000 7fa46a000640 1 -- 172.21.15.44:0/1615790753 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5203 (secure 0 0 0) 0x7fa4600f8d10 con 0x7fa4700d18f0 2024-09-17T05:45:39.814 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:39.814 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"btime":"2024-09-17T05:45:39:616357+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":8085,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/581642795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":581642795},{"type":"v1","addr":"172.21.15.44:6835","nonce":581642795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:45:38.614361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-17T05:45:39.815 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 92 2024-09-17T05:45:39.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa454073200 msgr2=0x7fa454075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa454073200 0x7fa454075710 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa464000f70 tx=0x7fa464009040 comp rx=0 tx=0).stop 2024-09-17T05:45:39.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d18f0 msgr2=0x7fa4700b75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d18f0 0x7fa4700b75e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa460000c10 tx=0x7fa4600a5530 comp rx=0 tx=0).stop 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 shutdown_connections 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa4700d1d00 0x7fa4700b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4700d18f0 0x7fa4700b75e0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa454073200 0x7fa454075710 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 --2- 172.21.15.44:0/1615790753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4700cf5b0 0x7fa47014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 >> 172.21.15.44:0/1615790753 conn(0x7fa4700b4240 msgr2=0x7fa470152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:39.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 shutdown_connections 2024-09-17T05:45:39.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.816+0000 7fa478800640 1 -- 172.21.15.44:0/1615790753 wait complete. 2024-09-17T05:45:39.836 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:39.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 -- 172.21.15.44:0/741034674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa40cc480 msgr2=0x7f8aa4166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:39.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/741034674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa40cc480 0x7f8aa4166480 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009bc0 tx=0x7f8a9c01cb10 comp rx=0 tx=0).stop 2024-09-17T05:45:39.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 -- 172.21.15.44:0/741034674 shutdown_connections 2024-09-17T05:45:39.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/741034674 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa40cc480 0x7f8aa4166480 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:39.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 -- 172.21.15.44:0/741034674 >> 172.21.15.44:0/741034674 conn(0x7f8aa40ccaa0 msgr2=0x7f8aa40cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:39.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 -- 172.21.15.44:0/741034674 shutdown_connections 2024-09-17T05:45:39.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 -- 172.21.15.44:0/741034674 wait complete. 2024-09-17T05:45:39.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 Processor -- start 2024-09-17T05:45:39.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:39.996+0000 7f8aa8c00640 1 -- start start 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa406de50 0x7f8aa40aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8aa4072e50 0x7f8aa41fcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8aa40cc480 0x7f8aa41fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4169fe0 con 0x7f8aa406de50 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4169e60 con 0x7f8aa40cc480 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8aa416a160 con 0x7f8aa4072e50 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa406de50 0x7f8aa40aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa406de50 0x7f8aa40aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45894/0 (socket says 172.21.15.44:45894) 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 -- 172.21.15.44:0/2253586941 learned_addr learned my addr 172.21.15.44:0/2253586941 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8a99400640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8aa4072e50 0x7f8aa41fcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa2800640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8aa40cc480 0x7f8aa41fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 -- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8aa4072e50 msgr2=0x7f8aa41fcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8aa4072e50 0x7f8aa41fcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 -- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8aa40cc480 msgr2=0x7f8aa41fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8aa40cc480 0x7f8aa41fd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 -- 172.21.15.44:0/2253586941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa4164650 con 0x7f8aa406de50 2024-09-17T05:45:40.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa1e00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa406de50 0x7f8aa40aef50 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c3f0 tx=0x7f8a9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:40.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8a9aa00640 1 -- 172.21.15.44:0/2253586941 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94017070 con 0x7f8aa406de50 2024-09-17T05:45:40.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8a9aa00640 1 -- 172.21.15.44:0/2253586941 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a94003600 con 0x7f8aa406de50 2024-09-17T05:45:40.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa40af490 con 0x7f8aa406de50 2024-09-17T05:45:40.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8a9aa00640 1 -- 172.21.15.44:0/2253586941 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94003a50 con 0x7f8aa406de50 2024-09-17T05:45:40.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa40c7370 con 0x7f8aa406de50 2024-09-17T05:45:40.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.000+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa4164820 con 0x7f8aa406de50 2024-09-17T05:45:40.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.004+0000 7f8a9aa00640 1 -- 172.21.15.44:0/2253586941 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8a9401a070 con 0x7f8aa406de50 2024-09-17T05:45:40.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.004+0000 7f8a9aa00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a80073200 0x7f8a80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.004+0000 7f8a9aa00640 1 -- 172.21.15.44:0/2253586941 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7f8a940937f0 con 0x7f8aa406de50 2024-09-17T05:45:40.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.004+0000 7f8a99400640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a80073200 0x7f8a80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.004+0000 7f8a99400640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a80073200 0x7f8a80075710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4154a50 tx=0x7f8a8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:40.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.008+0000 7f8a9aa00640 1 -- 172.21.15.44:0/2253586941 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f8a9405de70 con 0x7f8aa406de50 2024-09-17T05:45:40.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.196+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8aa415e990 con 0x7f8aa406de50 2024-09-17T05:45:40.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.196+0000 7f8a9aa00640 1 -- 172.21.15.44:0/2253586941 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+17421 (secure 0 0 0) 0x7f8a940628a0 con 0x7f8aa406de50 2024-09-17T05:45:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:40.197 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":109,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:45:38.614130+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:44:15.087361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:16.307403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"16.33","mappings":[{"from":4,"to":6}]},{"pgid":"16.34","mappings":[{"from":2,"to":3}]},{"pgid":"16.3f","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6833/1998109127":"2024-09-18T05:45:38.614099+0000","172.21.15.44:6835/1998109127":"2024-09-18T05:45:38.614099+0000","172.21.15.44:6835/3953022133":"2024-09-18T05:45:01.684932+0000","172.21.15.44:6833/3953022133":"2024-09-18T05:45:01.684932+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.196+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a80073200 msgr2=0x7f8a80075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.196+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a80073200 0x7f8a80075710 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4154a50 tx=0x7f8a8c009040 comp rx=0 tx=0).stop 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.196+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa406de50 msgr2=0x7f8aa40aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.196+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa406de50 0x7f8aa40aef50 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c3f0 tx=0x7f8a9400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 shutdown_connections 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8a80073200 0x7f8a80075710 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8aa40cc480 0x7f8aa41fd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8aa4072e50 0x7f8aa41fcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 --2- 172.21.15.44:0/2253586941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8aa406de50 0x7f8aa40aef50 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 >> 172.21.15.44:0/2253586941 conn(0x7f8aa40ccaa0 msgr2=0x7f8aa40cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 shutdown_connections 2024-09-17T05:45:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.200+0000 7f8aa8c00640 1 -- 172.21.15.44:0/2253586941 wait complete. 2024-09-17T05:45:40.219 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:45:40.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:40.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.376+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3779590162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 msgr2=0x7f5e3c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.376+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3779590162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 0x7f5e3c003ed0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5e480016f0 tx=0x7f5e4801c750 comp rx=0 tx=0).stop 2024-09-17T05:45:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.376+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3779590162 shutdown_connections 2024-09-17T05:45:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.376+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3779590162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 0x7f5e3c003ed0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.376+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3779590162 >> 172.21.15.44:0/3779590162 conn(0x7f5e580ccaa0 msgr2=0x7f5e580cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.376+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3779590162 shutdown_connections 2024-09-17T05:45:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.376+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3779590162 wait complete. 2024-09-17T05:45:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 Processor -- start 2024-09-17T05:45:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 -- start start 2024-09-17T05:45:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 0x7f5e5809d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e580b3880 0x7f5e5815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e5815d600 0x7f5e581fc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e580cc0f0 con 0x7f5e580b3880 2024-09-17T05:45:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5e580cbf70 con 0x7f5e3c003a60 2024-09-17T05:45:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e5ce00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5e580cc270 con 0x7f5e5815d600 2024-09-17T05:45:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e4fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e580b3880 0x7f5e5815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e4fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e580b3880 0x7f5e5815d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45912/0 (socket says 172.21.15.44:45912) 2024-09-17T05:45:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e4fe00640 1 -- 172.21.15.44:0/3351473395 learned_addr learned my addr 172.21.15.44:0/3351473395 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e56800640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e5815d600 0x7f5e581fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e55e00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 0x7f5e5809d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e4fe00640 1 -- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e5815d600 msgr2=0x7f5e581fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e4fe00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e5815d600 0x7f5e581fc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e4fe00640 1 -- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 msgr2=0x7f5e5809d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.380+0000 7f5e4fe00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 0x7f5e5809d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4fe00640 1 -- 172.21.15.44:0/3351473395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5815da10 con 0x7f5e580b3880 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e56800640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e5815d600 0x7f5e581fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e55e00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 0x7f5e5809d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4fe00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e580b3880 0x7f5e5815d0c0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f5e40006600 tx=0x7f5e400039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4e000640 1 -- 172.21.15.44:0/3351473395 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40015070 con 0x7f5e580b3880 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4e000640 1 -- 172.21.15.44:0/3351473395 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e40011920 con 0x7f5e580b3880 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5809dbb0 con 0x7f5e580b3880 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4e000640 1 -- 172.21.15.44:0/3351473395 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40011d70 con 0x7f5e580b3880 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e580c7970 con 0x7f5e580b3880 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e580c7400 con 0x7f5e580b3880 2024-09-17T05:45:40.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4e000640 1 -- 172.21.15.44:0/3351473395 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5e40018070 con 0x7f5e580b3880 2024-09-17T05:45:40.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4e000640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5e34073200 0x7f5e34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.384+0000 7f5e4e000640 1 -- 172.21.15.44:0/3351473395 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7f5e400951c0 con 0x7f5e580b3880 2024-09-17T05:45:40.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.388+0000 7f5e55e00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5e34073200 0x7f5e34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.388+0000 7f5e55e00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5e34073200 0x7f5e34075710 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5e480016c0 tx=0x7f5e48019540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:40.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.392+0000 7f5e4e000640 1 -- 172.21.15.44:0/3351473395 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f5e5815da10 con 0x7f5e580b3880 2024-09-17T05:45:40.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e580cf010 con 0x7f5e580b3880 2024-09-17T05:45:40.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e4e000640 1 -- 172.21.15.44:0/3351473395 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5203 (secure 0 0 0) 0x7f5e4005ffb0 con 0x7f5e580b3880 2024-09-17T05:45:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:40.602 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"btime":"2024-09-17T05:45:39:616357+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":8085,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/581642795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":581642795},{"type":"v1","addr":"172.21.15.44:6835","nonce":581642795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:45:38.614361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-17T05:45:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 92 2024-09-17T05:45:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5e34073200 msgr2=0x7f5e34075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5e34073200 0x7f5e34075710 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5e480016c0 tx=0x7f5e48019540 comp rx=0 tx=0).stop 2024-09-17T05:45:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e580b3880 msgr2=0x7f5e5815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e580b3880 0x7f5e5815d0c0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f5e40006600 tx=0x7f5e400039d0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 shutdown_connections 2024-09-17T05:45:40.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5e5815d600 0x7f5e581fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e580b3880 0x7f5e5815d0c0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5e34073200 0x7f5e34075710 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 --2- 172.21.15.44:0/3351473395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e3c003a60 0x7f5e5809d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 >> 172.21.15.44:0/3351473395 conn(0x7f5e580ccaa0 msgr2=0x7f5e580c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 shutdown_connections 2024-09-17T05:45:40.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.600+0000 7f5e5ce00640 1 -- 172.21.15.44:0/3351473395 wait complete. 2024-09-17T05:45:40.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 -- 172.21.15.44:0/3549894653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900d1d00 msgr2=0x7fc3900cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 --2- 172.21.15.44:0/3549894653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900d1d00 0x7fc3900cf070 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc3900d2110 tx=0x7fc37801c740 comp rx=0 tx=0).stop 2024-09-17T05:45:40.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 -- 172.21.15.44:0/3549894653 shutdown_connections 2024-09-17T05:45:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 --2- 172.21.15.44:0/3549894653 >> v2:172.21.15.86:3300/0 conn(0x7fc3900cf5b0 0x7fc39015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 --2- 172.21.15.44:0/3549894653 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900d1d00 0x7fc3900cf070 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 -- 172.21.15.44:0/3549894653 >> 172.21.15.44:0/3549894653 conn(0x7fc3900b4240 msgr2=0x7fc3900b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 -- 172.21.15.44:0/3549894653 shutdown_connections 2024-09-17T05:45:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.780+0000 7fc395800640 1 -- 172.21.15.44:0/3549894653 wait complete. 2024-09-17T05:45:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 Processor -- start 2024-09-17T05:45:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 -- start start 2024-09-17T05:45:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900cf5b0 0x7fc390156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900d18f0 0x7fc39014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3900d1d00 0x7fc3901fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc390169d00 con 0x7fc3900cf5b0 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc39015db50 con 0x7fc3900d18f0 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc390169e80 con 0x7fc3900d1d00 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900cf5b0 0x7fc390156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900cf5b0 0x7fc390156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45936/0 (socket says 172.21.15.44:45936) 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 -- 172.21.15.44:0/4185028003 learned_addr learned my addr 172.21.15.44:0/4185028003 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc387e00640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900d18f0 0x7fc39014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38f400640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3900d1d00 0x7fc3901fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 -- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3900d1d00 msgr2=0x7fc3901fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3900d1d00 0x7fc3901fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 -- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900d18f0 msgr2=0x7fc39014e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900d18f0 0x7fc39014e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 -- 172.21.15.44:0/4185028003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc390152090 con 0x7fc3900cf5b0 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc38ea00640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900cf5b0 0x7fc390156e90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c400 tx=0x7fc38000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc386a00640 1 -- 172.21.15.44:0/4185028003 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380017070 con 0x7fc3900cf5b0 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc386a00640 1 -- 172.21.15.44:0/4185028003 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc380003600 con 0x7fc3900cf5b0 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc390152370 con 0x7fc3900cf5b0 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc386a00640 1 -- 172.21.15.44:0/4185028003 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380003a50 con 0x7fc3900cf5b0 2024-09-17T05:45:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.784+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3901fc2b0 con 0x7fc3900cf5b0 2024-09-17T05:45:40.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.788+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc39015d060 con 0x7fc3900cf5b0 2024-09-17T05:45:40.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.788+0000 7fc386a00640 1 -- 172.21.15.44:0/4185028003 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc38001a070 con 0x7fc3900cf5b0 2024-09-17T05:45:40.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.788+0000 7fc386a00640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc36c073200 0x7fc36c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.788+0000 7fc386a00640 1 -- 172.21.15.44:0/4185028003 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7fc3800938c0 con 0x7fc3900cf5b0 2024-09-17T05:45:40.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.788+0000 7fc387e00640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc36c073200 0x7fc36c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:40.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.792+0000 7fc387e00640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc36c073200 0x7fc36c075710 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc3780af000 tx=0x7fc37801af80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:40.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:40.796+0000 7fc386a00640 1 -- 172.21.15.44:0/4185028003 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc3900cf9c0 con 0x7fc3900cf5b0 2024-09-17T05:45:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.004+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc390069040 con 0x7fc3900cf5b0 2024-09-17T05:45:41.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.004+0000 7fc386a00640 1 -- 172.21.15.44:0/4185028003 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5203 (secure 0 0 0) 0x7fc38005dec0 con 0x7fc3900cf5b0 2024-09-17T05:45:41.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:41.005 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":92,"btime":"2024-09-17T05:45:39:616357+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":8085,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/581642795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":581642795},{"type":"v1","addr":"172.21.15.44:6835","nonce":581642795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:44:17.352549+0000","modified":"2024-09-17T05:45:38.614361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-09-17T05:45:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 92 2024-09-17T05:45:41.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc36c073200 msgr2=0x7fc36c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc36c073200 0x7fc36c075710 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc3780af000 tx=0x7fc37801af80 comp rx=0 tx=0).stop 2024-09-17T05:45:41.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900cf5b0 msgr2=0x7fc390156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900cf5b0 0x7fc390156e90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c400 tx=0x7fc38000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 shutdown_connections 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc3900d1d00 0x7fc3901fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc36c073200 0x7fc36c075710 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3900d18f0 0x7fc39014e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 --2- 172.21.15.44:0/4185028003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc3900cf5b0 0x7fc390156e90 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 >> 172.21.15.44:0/4185028003 conn(0x7fc3900b4240 msgr2=0x7fc390150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 shutdown_connections 2024-09-17T05:45:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.008+0000 7fc395800640 1 -- 172.21.15.44:0/4185028003 wait complete. 2024-09-17T05:45:41.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:41.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 -- 172.21.15.44:0/2371346244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc004d50 msgr2=0x7faabc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 --2- 172.21.15.44:0/2371346244 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faabc004d50 0x7faabc005160 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7faad40752c0 tx=0x7faacc01d2c0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faada200640 1 -- 172.21.15.44:0/2371346244 reap_dead start 2024-09-17T05:45:41.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 -- 172.21.15.44:0/2371346244 shutdown_connections 2024-09-17T05:45:41.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 -- 172.21.15.44:0/2371346244 >> 172.21.15.44:0/2371346244 conn(0x7faad40d1120 msgr2=0x7faad40d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 -- 172.21.15.44:0/2371346244 shutdown_connections 2024-09-17T05:45:41.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 -- 172.21.15.44:0/2371346244 wait complete. 2024-09-17T05:45:41.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 Processor -- start 2024-09-17T05:45:41.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.188+0000 7faadc200640 1 -- start start 2024-09-17T05:45:41.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc004d50 0x7faad41f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faad40b1400 0x7faad41f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faad40b1810 0x7faad415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faad4166de0 con 0x7faad40b1400 2024-09-17T05:45:41.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faad4166c60 con 0x7faabc004d50 2024-09-17T05:45:41.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7faad4166f60 con 0x7faad40b1810 2024-09-17T05:45:41.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faad40b1400 0x7faad41f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faad40b1400 0x7faad41f64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45948/0 (socket says 172.21.15.44:45948) 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 -- 172.21.15.44:0/429432189 learned_addr learned my addr 172.21.15.44:0/429432189 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad9800640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc004d50 0x7faad41f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 -- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faad40b1810 msgr2=0x7faad415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faad40b1810 0x7faad415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 -- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc004d50 msgr2=0x7faad41f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc004d50 0x7faad41f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 -- 172.21.15.44:0/429432189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad41f96a0 con 0x7faad40b1400 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad9800640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc004d50 0x7faad41f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad8e00640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faad40b1400 0x7faad41f64c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7faac0011850 tx=0x7faac0011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad1600640 1 -- 172.21.15.44:0/429432189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac000fcd0 con 0x7faad40b1400 2024-09-17T05:45:41.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad1600640 1 -- 172.21.15.44:0/429432189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faac0004030 con 0x7faad40b1400 2024-09-17T05:45:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faad1600640 1 -- 172.21.15.44:0/429432189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0004460 con 0x7faad40b1400 2024-09-17T05:45:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad41f9bb0 con 0x7faad40b1400 2024-09-17T05:45:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad40b0c20 con 0x7faad40b1400 2024-09-17T05:45:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.192+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad41f9920 con 0x7faad40b1400 2024-09-17T05:45:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.196+0000 7faad1600640 1 -- 172.21.15.44:0/429432189 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faac0003600 con 0x7faad40b1400 2024-09-17T05:45:41.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.196+0000 7faad1600640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faab4073200 0x7faab4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.196+0000 7faad1600640 1 -- 172.21.15.44:0/429432189 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7faac0095a40 con 0x7faad40b1400 2024-09-17T05:45:41.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.196+0000 7faad9800640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faab4073200 0x7faab4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.196+0000 7faad9800640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faab4073200 0x7faab4075710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faac8009470 tx=0x7faac80091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.200+0000 7faad1600640 1 -- 172.21.15.44:0/429432189 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7faac0060820 con 0x7faad40b1400 2024-09-17T05:45:41.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.380+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faad41fa0d0 con 0x7faad40b1400 2024-09-17T05:45:41.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.380+0000 7faad1600640 1 -- 172.21.15.44:0/429432189 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+17421 (secure 0 0 0) 0x7faad41fa0d0 con 0x7faad40b1400 2024-09-17T05:45:41.381 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:41.381 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":109,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:45:38.614130+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:44:15.087361+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-17T05:44:16.307403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1c","mappings":[{"from":4,"to":3}]},{"pgid":"16.33","mappings":[{"from":4,"to":6}]},{"pgid":"16.34","mappings":[{"from":2,"to":3}]},{"pgid":"16.3f","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6833/1998109127":"2024-09-18T05:45:38.614099+0000","172.21.15.44:6835/1998109127":"2024-09-18T05:45:38.614099+0000","172.21.15.44:6835/3953022133":"2024-09-18T05:45:01.684932+0000","172.21.15.44:6833/3953022133":"2024-09-18T05:45:01.684932+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:41.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faab4073200 msgr2=0x7faab4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faab4073200 0x7faab4075710 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7faac8009470 tx=0x7faac80091e0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faad40b1400 msgr2=0x7faad41f64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faad40b1400 0x7faad41f64c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7faac0011850 tx=0x7faac0011d10 comp rx=0 tx=0).stop 2024-09-17T05:45:41.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 shutdown_connections 2024-09-17T05:45:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7faad40b1810 0x7faad415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faad40b1400 0x7faad41f64c0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7faab4073200 0x7faab4075710 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 --2- 172.21.15.44:0/429432189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faabc004d50 0x7faad41f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 >> 172.21.15.44:0/429432189 conn(0x7faad40d1120 msgr2=0x7faad4165aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 shutdown_connections 2024-09-17T05:45:41.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.384+0000 7faadc200640 1 -- 172.21.15.44:0/429432189 wait complete. 2024-09-17T05:45:41.403 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:45:41.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 -- 172.21.15.44:0/4214910839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 msgr2=0x7f9ca00cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/4214910839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 0x7f9ca00cb880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009bc0 tx=0x7f9c9801cb10 comp rx=0 tx=0).stop 2024-09-17T05:45:41.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 -- 172.21.15.44:0/4214910839 shutdown_connections 2024-09-17T05:45:41.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/4214910839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 0x7f9ca00cb880 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/4214910839 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ca0072e50 0x7f9ca015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 -- 172.21.15.44:0/4214910839 >> 172.21.15.44:0/4214910839 conn(0x7f9ca00ccaa0 msgr2=0x7f9ca00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:41.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 -- 172.21.15.44:0/4214910839 shutdown_connections 2024-09-17T05:45:41.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 -- 172.21.15.44:0/4214910839 wait complete. 2024-09-17T05:45:41.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 Processor -- start 2024-09-17T05:45:41.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.564+0000 7f9ca5e00640 1 -- start start 2024-09-17T05:45:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ca006de50 0x7f9ca00c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0072e50 0x7f9ca0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 0x7f9ca0159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca0168f20 con 0x7f9ca0072e50 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca0168da0 con 0x7f9ca00cb470 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca01690a0 con 0x7f9ca006de50 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0072e50 0x7f9ca0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0072e50 0x7f9ca0159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45954/0 (socket says 172.21.15.44:45954) 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 -- 172.21.15.44:0/1311799537 learned_addr learned my addr 172.21.15.44:0/1311799537 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c9ea00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ca006de50 0x7f9ca00c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c9f400640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 0x7f9ca0159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 -- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ca006de50 msgr2=0x7f9ca00c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ca006de50 0x7f9ca00c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 -- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 msgr2=0x7f9ca0159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 0x7f9ca0159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 -- 172.21.15.44:0/1311799537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca0155e60 con 0x7f9ca0072e50 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c96000640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0072e50 0x7f9ca0159a80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c3c0 tx=0x7f9c8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c97e00640 1 -- 172.21.15.44:0/1311799537 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88011790 con 0x7f9ca0072e50 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c97e00640 1 -- 172.21.15.44:0/1311799537 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c88017070 con 0x7f9ca0072e50 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9c97e00640 1 -- 172.21.15.44:0/1311799537 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88011cc0 con 0x7f9ca0072e50 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca00c7b80 con 0x7f9ca0072e50 2024-09-17T05:45:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca00c8140 con 0x7f9ca0072e50 2024-09-17T05:45:41.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.568+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca00cb880 con 0x7f9ca0072e50 2024-09-17T05:45:41.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.572+0000 7f9c97e00640 1 -- 172.21.15.44:0/1311799537 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9c8801c460 con 0x7f9ca0072e50 2024-09-17T05:45:41.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.572+0000 7f9c97e00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c7c073230 0x7f9c7c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:41.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.572+0000 7f9c97e00640 1 -- 172.21.15.44:0/1311799537 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7f9c88094210 con 0x7f9ca0072e50 2024-09-17T05:45:41.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.572+0000 7f9c9ea00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c7c073230 0x7f9c7c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:41.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.572+0000 7f9c9ea00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c7c073230 0x7f9c7c075740 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009600 tx=0x7f9c900091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.576+0000 7f9c97e00640 1 -- 172.21.15.44:0/1311799537 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9c8805eee0 con 0x7f9ca0072e50 2024-09-17T05:45:41.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:41.788+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9ca00b5fa0 con 0x7f9ca0072e50 2024-09-17T05:45:42.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.796+0000 7f9c97e00640 1 -- 172.21.15.44:0/1311799537 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) ==== 161+0+0 (secure 0 0 0) 0x7f9c8805e7e0 con 0x7f9ca0072e50 2024-09-17T05:45:42.797 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c7c073230 msgr2=0x7f9c7c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c7c073230 0x7f9c7c075740 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009600 tx=0x7f9c900091e0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0072e50 msgr2=0x7f9ca0159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0072e50 0x7f9ca0159a80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800c3c0 tx=0x7f9c8800c880 comp rx=0 tx=0).stop 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 shutdown_connections 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9c7c073230 0x7f9c7c075740 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca00cb470 0x7f9ca0159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ca0072e50 0x7f9ca0159a80 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 --2- 172.21.15.44:0/1311799537 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f9ca006de50 0x7f9ca00c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 >> 172.21.15.44:0/1311799537 conn(0x7f9ca00ccaa0 msgr2=0x7f9ca0157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 shutdown_connections 2024-09-17T05:45:42.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.800+0000 7f9ca5e00640 1 -- 172.21.15.44:0/1311799537 wait complete. 2024-09-17T05:45:42.825 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 -- 172.21.15.44:0/741860111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c806e660 msgr2=0x7f99c8151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 --2- 172.21.15.44:0/741860111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c806e660 0x7f99c8151b00 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f99c806eb10 tx=0x7f99c001c770 comp rx=0 tx=0).stop 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 -- 172.21.15.44:0/741860111 shutdown_connections 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 --2- 172.21.15.44:0/741860111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c806e660 0x7f99c8151b00 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 --2- 172.21.15.44:0/741860111 >> v2:172.21.15.86:3300/0 conn(0x7f99c8070e00 0x7f99c8071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 -- 172.21.15.44:0/741860111 >> 172.21.15.44:0/741860111 conn(0x7f99c80cd930 msgr2=0x7f99c80cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 -- 172.21.15.44:0/741860111 shutdown_connections 2024-09-17T05:45:42.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.988+0000 7f99cca00640 1 -- 172.21.15.44:0/741860111 wait complete. 2024-09-17T05:45:42.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 Processor -- start 2024-09-17T05:45:42.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 -- start start 2024-09-17T05:45:42.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99c8070e00 0x7f99c814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99c80ccb60 0x7f99c813bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c814d3e0 0x7f99c813c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f99c815c510 con 0x7f99c814d3e0 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99c815c390 con 0x7f99c8070e00 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99cca00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f99c815c690 con 0x7f99c80ccb60 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99c6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c814d3e0 0x7f99c813c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99c6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c814d3e0 0x7f99c813c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45982/0 (socket says 172.21.15.44:45982) 2024-09-17T05:45:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99c6800640 1 -- 172.21.15.44:0/3473175992 learned_addr learned my addr 172.21.15.44:0/3473175992 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99c5e00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99c8070e00 0x7f99c814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.992+0000 7f99bd400640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99c80ccb60 0x7f99c813bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99c6800640 1 -- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99c80ccb60 msgr2=0x7f99c813bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99c6800640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99c80ccb60 0x7f99c813bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99c6800640 1 -- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99c8070e00 msgr2=0x7f99c814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99c6800640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99c8070e00 0x7f99c814cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99c6800640 1 -- 172.21.15.44:0/3473175992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c8152b10 con 0x7f99c814d3e0 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99bd400640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99c80ccb60 0x7f99c813bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99c6800640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c814d3e0 0x7f99c813c4f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f99c0098150 tx=0x7f99c00a6700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99bea00640 1 -- 172.21.15.44:0/3473175992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c00a6c00 con 0x7f99c814d3e0 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99bea00640 1 -- 172.21.15.44:0/3473175992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99c00a6da0 con 0x7f99c814d3e0 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c8152db0 con 0x7f99c814d3e0 2024-09-17T05:45:42.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99bea00640 1 -- 172.21.15.44:0/3473175992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0004270 con 0x7f99c814d3e0 2024-09-17T05:45:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c8153370 con 0x7f99c814d3e0 2024-09-17T05:45:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c8151880 con 0x7f99c814d3e0 2024-09-17T05:45:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:42.996+0000 7f99bea00640 1 -- 172.21.15.44:0/3473175992 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f99c0005040 con 0x7f99c814d3e0 2024-09-17T05:45:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.000+0000 7f99bea00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f99a4073230 0x7f99a4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.000+0000 7f99bea00640 1 -- 172.21.15.44:0/3473175992 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7f99c012e080 con 0x7f99c814d3e0 2024-09-17T05:45:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.000+0000 7f99c5e00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f99a4073230 0x7f99a4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.000+0000 7f99c5e00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f99a4073230 0x7f99a4075740 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f99b800bb50 tx=0x7f99b800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.004+0000 7f99bea00640 1 -- 172.21.15.44:0/3473175992 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f99c00ac030 con 0x7f99c814d3e0 2024-09-17T05:45:43.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.216+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f99c8151b00 con 0x7f99c814d3e0 2024-09-17T05:45:43.751 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:43.754 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:45:43.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.796+0000 7f99bea00640 1 -- 172.21.15.44:0/3473175992 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) ==== 104+0+0 (secure 0 0 0) 0x7f99c00163f0 con 0x7f99c814d3e0 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f99a4073230 msgr2=0x7f99a4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f99a4073230 0x7f99a4075740 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f99b800bb50 tx=0x7f99b800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c814d3e0 msgr2=0x7f99c813c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c814d3e0 0x7f99c813c4f0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f99c0098150 tx=0x7f99c00a6700 comp rx=0 tx=0).stop 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 shutdown_connections 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f99c814d3e0 0x7f99c813c4f0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f99c80ccb60 0x7f99c813bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f99a4073230 0x7f99a4075740 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 --2- 172.21.15.44:0/3473175992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99c8070e00 0x7f99c814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:43.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 >> 172.21.15.44:0/3473175992 conn(0x7f99c80cd930 msgr2=0x7f99c814ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:43.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 shutdown_connections 2024-09-17T05:45:43.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:43.800+0000 7f99cca00640 1 -- 172.21.15.44:0/3473175992 wait complete. 2024-09-17T05:45:43.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:45:44.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 -- 172.21.15.44:0/2505871016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d415e9c0 msgr2=0x7f12d415edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 --2- 172.21.15.44:0/2505871016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d415e9c0 0x7f12d415edd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009bf0 tx=0x7f12cc01cbe0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 -- 172.21.15.44:0/2505871016 shutdown_connections 2024-09-17T05:45:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 --2- 172.21.15.44:0/2505871016 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d415e9c0 0x7f12d415edd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 -- 172.21.15.44:0/2505871016 >> 172.21.15.44:0/2505871016 conn(0x7f12d40b42f0 msgr2=0x7f12d40d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 -- 172.21.15.44:0/2505871016 shutdown_connections 2024-09-17T05:45:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 -- 172.21.15.44:0/2505871016 wait complete. 2024-09-17T05:45:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 Processor -- start 2024-09-17T05:45:44.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.032+0000 7f12db400640 1 -- start start 2024-09-17T05:45:44.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12d415d840 0x7f12d41502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12d415e9c0 0x7f12d41f9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d41fa1e0 0x7f12d41fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f12d416b0f0 con 0x7f12d415d840 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f12d416af70 con 0x7f12d415e9c0 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f12d416b270 con 0x7f12d41fa1e0 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12d415d840 0x7f12d41502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12d415d840 0x7f12d41502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45994/0 (socket says 172.21.15.44:45994) 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 -- 172.21.15.44:0/4059266648 learned_addr learned my addr 172.21.15.44:0/4059266648 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12cbe00640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12d415e9c0 0x7f12d41f9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d9400640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d41fa1e0 0x7f12d41fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 -- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d41fa1e0 msgr2=0x7f12d41fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d41fa1e0 0x7f12d41fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 -- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12d415e9c0 msgr2=0x7f12d41f9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12d415e9c0 0x7f12d41f9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 -- 172.21.15.44:0/4059266648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d41580a0 con 0x7f12d415d840 2024-09-17T05:45:44.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12cbe00640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12d415e9c0 0x7f12d41f9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:44.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d8a00640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12d415d840 0x7f12d41502e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c410 tx=0x7f12c400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:44.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d1600640 1 -- 172.21.15.44:0/4059266648 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011790 con 0x7f12d415d840 2024-09-17T05:45:44.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d1600640 1 -- 172.21.15.44:0/4059266648 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12c4017070 con 0x7f12d415d840 2024-09-17T05:45:44.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12d1600640 1 -- 172.21.15.44:0/4059266648 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011d40 con 0x7f12d415d840 2024-09-17T05:45:44.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d4158380 con 0x7f12d415d840 2024-09-17T05:45:44.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d40c9550 con 0x7f12d415d840 2024-09-17T05:45:44.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.036+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d415edd0 con 0x7f12d415d840 2024-09-17T05:45:44.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.040+0000 7f12d1600640 1 -- 172.21.15.44:0/4059266648 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f12c4026430 con 0x7f12d415d840 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.040+0000 7f12d1600640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f12b0073200 0x7f12b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.040+0000 7f12d1600640 1 -- 172.21.15.44:0/4059266648 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 6389+0+0 (secure 0 0 0) 0x7f12c4094d10 con 0x7f12d415d840 2024-09-17T05:45:44.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.040+0000 7f12cbe00640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f12b0073200 0x7f12b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:44.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.040+0000 7f12cbe00640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f12b0073200 0x7f12b0075710 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f12d40cd700 tx=0x7f12bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:44.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.044+0000 7f12d1600640 1 -- 172.21.15.44:0/4059266648 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f12c405faf0 con 0x7f12d415d840 2024-09-17T05:45:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.220+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f12d4071260 con 0x7f12d415d840 2024-09-17T05:45:44.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.804+0000 7f12d1600640 1 -- 172.21.15.44:0/4059266648 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) ==== 181+0+0 (secure 0 0 0) 0x7f12c405f3f0 con 0x7f12d415d840 2024-09-17T05:45:44.805 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:45:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f12b0073200 msgr2=0x7f12b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f12b0073200 0x7f12b0075710 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f12d40cd700 tx=0x7f12bc009040 comp rx=0 tx=0).stop 2024-09-17T05:45:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12d415d840 msgr2=0x7f12d41502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12d415d840 0x7f12d41502e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f12c400c410 tx=0x7f12c400c8d0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 shutdown_connections 2024-09-17T05:45:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f12d41fa1e0 0x7f12d41fa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f12b0073200 0x7f12b0075710 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12d415e9c0 0x7f12d41f9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 --2- 172.21.15.44:0/4059266648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12d415d840 0x7f12d41502e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 >> 172.21.15.44:0/4059266648 conn(0x7f12d40b42f0 msgr2=0x7f12d4071780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 shutdown_connections 2024-09-17T05:45:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:44.808+0000 7f12db400640 1 -- 172.21.15.44:0/4059266648 wait complete. 2024-09-17T05:45:44.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:45:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.000+0000 7f9737e00640 1 -- 172.21.15.44:0/2701163584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 msgr2=0x7f9718003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.000+0000 7f9737e00640 1 --2- 172.21.15.44:0/2701163584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 0x7f9718003e80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9724009b60 tx=0x7f972401d340 comp rx=0 tx=0).stop 2024-09-17T05:45:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.000+0000 7f9735e00640 1 -- 172.21.15.44:0/2701163584 reap_dead start 2024-09-17T05:45:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.000+0000 7f9737e00640 1 -- 172.21.15.44:0/2701163584 shutdown_connections 2024-09-17T05:45:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.000+0000 7f9737e00640 1 -- 172.21.15.44:0/2701163584 >> 172.21.15.44:0/2701163584 conn(0x7f97300b35f0 msgr2=0x7f97300b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.000+0000 7f9737e00640 1 -- 172.21.15.44:0/2701163584 shutdown_connections 2024-09-17T05:45:45.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.000+0000 7f9737e00640 1 -- 172.21.15.44:0/2701163584 wait complete. 2024-09-17T05:45:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 Processor -- start 2024-09-17T05:45:45.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 -- start start 2024-09-17T05:45:45.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 0x7f97301524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97301f96b0 0x7f97301420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f973013e840 0x7f973013ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f973006e510 con 0x7f973013e840 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f973006e390 con 0x7f9718003a10 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9737e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f973006e690 con 0x7f97301f96b0 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f973013e840 0x7f973013ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f973013e840 0x7f973013ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46014/0 (socket says 172.21.15.44:46014) 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 -- 172.21.15.44:0/1933966746 learned_addr learned my addr 172.21.15.44:0/1933966746 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9734a00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97301f96b0 0x7f97301420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735400640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 0x7f97301524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 -- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97301f96b0 msgr2=0x7f97301420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97301f96b0 0x7f97301420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 -- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 msgr2=0x7f97301524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 0x7f97301524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735e00640 1 -- 172.21.15.44:0/1933966746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973013f190 con 0x7f973013e840 2024-09-17T05:45:45.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.004+0000 7f9735400640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 0x7f97301524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f9735e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f973013e840 0x7f973013ec50 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f97300d11e0 tx=0x7f9728012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f972d600640 1 -- 172.21.15.44:0/1933966746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97280139e0 con 0x7f973013e840 2024-09-17T05:45:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f972d600640 1 -- 172.21.15.44:0/1933966746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9728013ba0 con 0x7f973013e840 2024-09-17T05:45:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97301546a0 con 0x7f973013e840 2024-09-17T05:45:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f972d600640 1 -- 172.21.15.44:0/1933966746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728010480 con 0x7f973013e840 2024-09-17T05:45:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9730154c60 con 0x7f973013e840 2024-09-17T05:45:45.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9730154410 con 0x7f973013e840 2024-09-17T05:45:45.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.008+0000 7f972d600640 1 -- 172.21.15.44:0/1933966746 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9728010640 con 0x7f973013e840 2024-09-17T05:45:45.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.012+0000 7f972d600640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9710073230 0x7f9710075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:45.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.012+0000 7f972d600640 1 -- 172.21.15.44:0/1933966746 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5951+0+0 (secure 0 0 0) 0x7f97280984f0 con 0x7f973013e840 2024-09-17T05:45:45.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.012+0000 7f9735400640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9710073230 0x7f9710075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:45.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.012+0000 7f9735400640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9710073230 0x7f9710075740 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f97240ae000 tx=0x7f972401a0e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:45.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.016+0000 7f972d600640 1 -- 172.21.15.44:0/1933966746 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f9728063510 con 0x7f973013e840 2024-09-17T05:45:45.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.192+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f973006faf0 con 0x7f973013e840 2024-09-17T05:45:45.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.816+0000 7f972d600640 1 -- 172.21.15.44:0/1933966746 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) ==== 169+0+0 (secure 0 0 0) 0x7f9728062e10 con 0x7f973013e840 2024-09-17T05:45:45.815 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:45:45.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9710073230 msgr2=0x7f9710075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9710073230 0x7f9710075740 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f97240ae000 tx=0x7f972401a0e0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f973013e840 msgr2=0x7f973013ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:45.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f973013e840 0x7f973013ec50 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f97300d11e0 tx=0x7f9728012870 comp rx=0 tx=0).stop 2024-09-17T05:45:45.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 shutdown_connections 2024-09-17T05:45:45.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f973013e840 0x7f973013ec50 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f97301f96b0 0x7f97301420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9710073230 0x7f9710075740 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 --2- 172.21.15.44:0/1933966746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9718003a10 0x7f97301524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:45.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 >> 172.21.15.44:0/1933966746 conn(0x7f97300b35f0 msgr2=0x7f9730151480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:45.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 shutdown_connections 2024-09-17T05:45:45.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:45.820+0000 7f9737e00640 1 -- 172.21.15.44:0/1933966746 wait complete. 2024-09-17T05:45:45.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:45:46.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 -- 172.21.15.44:0/1733756280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc97806de50 msgr2=0x7fc97806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 --2- 172.21.15.44:0/1733756280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc97806de50 0x7fc97806e260 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fc9780ca7b0 tx=0x7fc96001c770 comp rx=0 tx=0).stop 2024-09-17T05:45:46.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 -- 172.21.15.44:0/1733756280 shutdown_connections 2024-09-17T05:45:46.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 --2- 172.21.15.44:0/1733756280 >> v2:172.21.15.86:3300/0 conn(0x7fc9780cb470 0x7fc9780cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 --2- 172.21.15.44:0/1733756280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc97806de50 0x7fc97806e260 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 -- 172.21.15.44:0/1733756280 >> 172.21.15.44:0/1733756280 conn(0x7fc9780ccaa0 msgr2=0x7fc9780cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 -- 172.21.15.44:0/1733756280 shutdown_connections 2024-09-17T05:45:46.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.016+0000 7fc97f000640 1 -- 172.21.15.44:0/1733756280 wait complete. 2024-09-17T05:45:46.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 Processor -- start 2024-09-17T05:45:46.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 -- start start 2024-09-17T05:45:46.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806de50 0x7fc9780b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978072e50 0x7fc9780c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9780cb470 0x7fc9780c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc978168ed0 con 0x7fc9780cb470 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc978168d50 con 0x7fc978072e50 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97f000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc978169050 con 0x7fc97806de50 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9780cb470 0x7fc9780c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9780cb470 0x7fc9780c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46024/0 (socket says 172.21.15.44:46024) 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97d000640 1 -- 172.21.15.44:0/2674484078 learned_addr learned my addr 172.21.15.44:0/2674484078 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc96f400640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978072e50 0x7fc9780c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc977e00640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806de50 0x7fc9780b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97d000640 1 -- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806de50 msgr2=0x7fc9780b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97d000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806de50 0x7fc9780b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97d000640 1 -- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978072e50 msgr2=0x7fc9780c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.020+0000 7fc97d000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978072e50 0x7fc9780c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc97d000640 1 -- 172.21.15.44:0/2674484078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9780ae9f0 con 0x7fc9780cb470 2024-09-17T05:45:46.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc977e00640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806de50 0x7fc9780b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:46.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc97d000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9780cb470 0x7fc9780c2f20 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc97000da40 tx=0x7fc97000df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc974c00640 1 -- 172.21.15.44:0/2674484078 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970017070 con 0x7fc9780cb470 2024-09-17T05:45:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc974c00640 1 -- 172.21.15.44:0/2674484078 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc970004b30 con 0x7fc9780cb470 2024-09-17T05:45:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9780a0cb0 con 0x7fc9780cb470 2024-09-17T05:45:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc974c00640 1 -- 172.21.15.44:0/2674484078 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970005020 con 0x7fc9780cb470 2024-09-17T05:45:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9780af0f0 con 0x7fc9780cb470 2024-09-17T05:45:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97806e260 con 0x7fc9780cb470 2024-09-17T05:45:46.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.024+0000 7fc974c00640 1 -- 172.21.15.44:0/2674484078 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9700051c0 con 0x7fc9780cb470 2024-09-17T05:45:46.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.028+0000 7fc974c00640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc954073200 0x7fc954075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.028+0000 7fc974c00640 1 -- 172.21.15.44:0/2674484078 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7fc970094520 con 0x7fc9780cb470 2024-09-17T05:45:46.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.028+0000 7fc977e00640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc954073200 0x7fc954075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.028+0000 7fc977e00640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc954073200 0x7fc954075710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc968000f70 tx=0x7fc968009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.032+0000 7fc974c00640 1 -- 172.21.15.44:0/2674484078 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc970020070 con 0x7fc9780cb470 2024-09-17T05:45:46.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.208+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fc9780707d0 con 0x7fc9780cb470 2024-09-17T05:45:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc974c00640 1 -- 172.21.15.44:0/2674484078 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v43) ==== 71+0+0 (secure 0 0 0) 0x7fc97005f650 con 0x7fc9780cb470 2024-09-17T05:45:46.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc954073200 msgr2=0x7fc954075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc954073200 0x7fc954075710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc968000f70 tx=0x7fc968009040 comp rx=0 tx=0).stop 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9780cb470 msgr2=0x7fc9780c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9780cb470 0x7fc9780c2f20 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc97000da40 tx=0x7fc97000df00 comp rx=0 tx=0).stop 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 shutdown_connections 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9780cb470 0x7fc9780c2f20 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc954073200 0x7fc954075710 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc978072e50 0x7fc9780c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 --2- 172.21.15.44:0/2674484078 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc97806de50 0x7fc9780b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 >> 172.21.15.44:0/2674484078 conn(0x7fc9780ccaa0 msgr2=0x7fc978157850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 shutdown_connections 2024-09-17T05:45:46.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.212+0000 7fc97f000640 1 -- 172.21.15.44:0/2674484078 wait complete. 2024-09-17T05:45:46.235 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 -- 172.21.15.44:0/2002612393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e400cb470 msgr2=0x7f7e400cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2002612393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e400cb470 0x7f7e400cb880 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7e4006ace0 tx=0x7f7e3801ccf0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 -- 172.21.15.44:0/2002612393 shutdown_connections 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2002612393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e400cb470 0x7f7e400cb880 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2002612393 >> v2:172.21.15.86:3300/0 conn(0x7f7e40072e50 0x7f7e4015e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 -- 172.21.15.44:0/2002612393 >> 172.21.15.44:0/2002612393 conn(0x7f7e400ccaa0 msgr2=0x7f7e400cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 -- 172.21.15.44:0/2002612393 shutdown_connections 2024-09-17T05:45:46.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.392+0000 7f7e46c00640 1 -- 172.21.15.44:0/2002612393 wait complete. 2024-09-17T05:45:46.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 Processor -- start 2024-09-17T05:45:46.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 -- start start 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4006de50 0x7f7e401f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40072e50 0x7f7e400c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e400cb470 0x7f7e400c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40168f20 con 0x7f7e40072e50 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40168da0 con 0x7f7e400cb470 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e46c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7e401690a0 con 0x7f7e4006de50 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40072e50 0x7f7e400c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3fe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4006de50 0x7f7e401f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40072e50 0x7f7e400c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46042/0 (socket says 172.21.15.44:46042) 2024-09-17T05:45:46.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 -- 172.21.15.44:0/2384676815 learned_addr learned my addr 172.21.15.44:0/2384676815 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:46.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e44c00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e400cb470 0x7f7e400c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 -- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4006de50 msgr2=0x7f7e401f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4006de50 0x7f7e401f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 -- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e400cb470 msgr2=0x7f7e400c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e400cb470 0x7f7e400c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 -- 172.21.15.44:0/2384676815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e400c9f40 con 0x7f7e40072e50 2024-09-17T05:45:46.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e3f400640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40072e50 0x7f7e400c8e20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c3f0 tx=0x7f7e2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.396+0000 7f7e37e00640 1 -- 172.21.15.44:0/2384676815 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c017070 con 0x7f7e40072e50 2024-09-17T05:45:46.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e37e00640 1 -- 172.21.15.44:0/2384676815 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e2c0053c0 con 0x7f7e40072e50 2024-09-17T05:45:46.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e400c4690 con 0x7f7e40072e50 2024-09-17T05:45:46.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e37e00640 1 -- 172.21.15.44:0/2384676815 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c003860 con 0x7f7e40072e50 2024-09-17T05:45:46.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e400c4c50 con 0x7f7e40072e50 2024-09-17T05:45:46.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4015e990 con 0x7f7e40072e50 2024-09-17T05:45:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e37e00640 1 -- 172.21.15.44:0/2384676815 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7e2c01a070 con 0x7f7e40072e50 2024-09-17T05:45:46.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e37e00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e20073200 0x7f7e20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e37e00640 1 -- 172.21.15.44:0/2384676815 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7f7e2c0933d0 con 0x7f7e40072e50 2024-09-17T05:45:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.400+0000 7f7e3fe00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e20073200 0x7f7e20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:46.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.404+0000 7f7e3fe00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e20073200 0x7f7e20075710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7e30004630 tx=0x7f7e3000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.404+0000 7f7e37e00640 1 -- 172.21.15.44:0/2384676815 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7e2c05deb0 con 0x7f7e40072e50 2024-09-17T05:45:46.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.640+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f7e400c6830 con 0x7f7e40072e50 2024-09-17T05:45:46.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.824+0000 7f7e37e00640 1 -- 172.21.15.44:0/2384676815 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v441) ==== 146+0+0 (secure 0 0 0) 0x7f7e2c0628e0 con 0x7f7e40072e50 2024-09-17T05:45:46.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e20073200 msgr2=0x7f7e20075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e20073200 0x7f7e20075710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7e30004630 tx=0x7f7e3000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40072e50 msgr2=0x7f7e400c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40072e50 0x7f7e400c8e20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00c3f0 tx=0x7f7e2c00c8b0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 shutdown_connections 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7e20073200 0x7f7e20075710 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e400cb470 0x7f7e400c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7e40072e50 0x7f7e400c8e20 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 --2- 172.21.15.44:0/2384676815 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7e4006de50 0x7f7e401f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 >> 172.21.15.44:0/2384676815 conn(0x7f7e400ccaa0 msgr2=0x7f7e4009f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 shutdown_connections 2024-09-17T05:45:46.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:46.828+0000 7f7e46c00640 1 -- 172.21.15.44:0/2384676815 wait complete. 2024-09-17T05:45:46.848 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-09-17T05:45:46.848 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-09-17T05:45:46.849 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 -- 172.21.15.44:0/879603845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c072e50 msgr2=0x7f2e3c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 --2- 172.21.15.44:0/879603845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c072e50 0x7f2e3c15e990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009870 tx=0x7f2e2c01c7d0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 -- 172.21.15.44:0/879603845 shutdown_connections 2024-09-17T05:45:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 --2- 172.21.15.44:0/879603845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c072e50 0x7f2e3c15e990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 -- 172.21.15.44:0/879603845 >> 172.21.15.44:0/879603845 conn(0x7f2e3c0ccaa0 msgr2=0x7f2e3c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 -- 172.21.15.44:0/879603845 shutdown_connections 2024-09-17T05:45:47.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 -- 172.21.15.44:0/879603845 wait complete. 2024-09-17T05:45:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 Processor -- start 2024-09-17T05:45:47.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.008+0000 7f2e41a00640 1 -- start start 2024-09-17T05:45:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c06de50 0x7f2e3c0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c072e50 0x7f2e3c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e3c0cb470 0x7f2e3c166140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c169f80 con 0x7f2e3c0cb470 2024-09-17T05:45:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c169e00 con 0x7f2e3c072e50 2024-09-17T05:45:47.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3c16a100 con 0x7f2e3c06de50 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e3c0cb470 0x7f2e3c166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e3c0cb470 0x7f2e3c166140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46056/0 (socket says 172.21.15.44:46056) 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3aa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c06de50 0x7f2e3c0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 -- 172.21.15.44:0/272173281 learned_addr learned my addr 172.21.15.44:0/272173281 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e33e00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c072e50 0x7f2e3c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 -- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c06de50 msgr2=0x7f2e3c0b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c06de50 0x7f2e3c0b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 -- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c072e50 msgr2=0x7f2e3c0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c072e50 0x7f2e3c0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 -- 172.21.15.44:0/272173281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c0b33b0 con 0x7f2e3c0cb470 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3aa00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c06de50 0x7f2e3c0b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e3b400640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e3c0cb470 0x7f2e3c166140 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c730 tx=0x7f2e3400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:47.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e32a00640 1 -- 172.21.15.44:0/272173281 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34003b80 con 0x7f2e3c0cb470 2024-09-17T05:45:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e32a00640 1 -- 172.21.15.44:0/272173281 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e34003d20 con 0x7f2e3c0cb470 2024-09-17T05:45:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e32a00640 1 -- 172.21.15.44:0/272173281 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3400aa50 con 0x7f2e3c0cb470 2024-09-17T05:45:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3c0c7690 con 0x7f2e3c0cb470 2024-09-17T05:45:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3c165940 con 0x7f2e3c0cb470 2024-09-17T05:45:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.012+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e3c15e990 con 0x7f2e3c0cb470 2024-09-17T05:45:47.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.016+0000 7f2e32a00640 1 -- 172.21.15.44:0/272173281 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2e3400abf0 con 0x7f2e3c0cb470 2024-09-17T05:45:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.016+0000 7f2e32a00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e18073200 0x7f2e18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.016+0000 7f2e32a00640 1 -- 172.21.15.44:0/272173281 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7f2e34093ef0 con 0x7f2e3c0cb470 2024-09-17T05:45:47.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.016+0000 7f2e3aa00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e18073200 0x7f2e18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.016+0000 7f2e3aa00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e18073200 0x7f2e18075710 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0af000 tx=0x7f2e2c01b010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:47.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.020+0000 7f2e32a00640 1 -- 172.21.15.44:0/272173281 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2e3405e8c0 con 0x7f2e3c0cb470 2024-09-17T05:45:47.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e3c0b5fa0 con 0x7f2e3c0cb470 2024-09-17T05:45:47.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e32a00640 1 -- 172.21.15.44:0/272173281 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+13397 (secure 0 0 0) 0x7f2e340632f0 con 0x7f2e3c0cb470 2024-09-17T05:45:47.196 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:47.196 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":111,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:45:45.816836+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6833/1998109127":"2024-09-18T05:45:38.614099+0000","172.21.15.44:6835/1998109127":"2024-09-18T05:45:38.614099+0000","172.21.15.44:6835/3953022133":"2024-09-18T05:45:01.684932+0000","172.21.15.44:6833/3953022133":"2024-09-18T05:45:01.684932+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e18073200 msgr2=0x7f2e18075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e18073200 0x7f2e18075710 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0af000 tx=0x7f2e2c01b010 comp rx=0 tx=0).stop 2024-09-17T05:45:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e3c0cb470 msgr2=0x7f2e3c166140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e3c0cb470 0x7f2e3c166140 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400c730 tx=0x7f2e3400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 shutdown_connections 2024-09-17T05:45:47.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2e3c0cb470 0x7f2e3c166140 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2e18073200 0x7f2e18075710 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e3c072e50 0x7f2e3c0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 --2- 172.21.15.44:0/272173281 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2e3c06de50 0x7f2e3c0b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 >> 172.21.15.44:0/272173281 conn(0x7f2e3c0ccaa0 msgr2=0x7f2e3c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 shutdown_connections 2024-09-17T05:45:47.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.196+0000 7f2e41a00640 1 -- 172.21.15.44:0/272173281 wait complete. 2024-09-17T05:45:47.218 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:36:06.284181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:45:47.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:45:47.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.380+0000 7f0fc1000640 1 -- 172.21.15.44:0/366259657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc06de50 msgr2=0x7f0fbc06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.380+0000 7f0fc1000640 1 --2- 172.21.15.44:0/366259657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc06de50 0x7f0fbc06e260 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009840 tx=0x7f0fa801c790 comp rx=0 tx=0).stop 2024-09-17T05:45:47.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.380+0000 7f0fc1000640 1 -- 172.21.15.44:0/366259657 shutdown_connections 2024-09-17T05:45:47.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.380+0000 7f0fc1000640 1 --2- 172.21.15.44:0/366259657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc06de50 0x7f0fbc06e260 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.380+0000 7f0fc1000640 1 -- 172.21.15.44:0/366259657 >> 172.21.15.44:0/366259657 conn(0x7f0fbc0ccaa0 msgr2=0x7f0fbc0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:47.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.380+0000 7f0fc1000640 1 -- 172.21.15.44:0/366259657 shutdown_connections 2024-09-17T05:45:47.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.380+0000 7f0fc1000640 1 -- 172.21.15.44:0/366259657 wait complete. 2024-09-17T05:45:47.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 Processor -- start 2024-09-17T05:45:47.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 -- start start 2024-09-17T05:45:47.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc06de50 0x7f0fbc0c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fbc072e50 0x7f0fbc06f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc0cb470 0x7f0fbc06f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc169f80 con 0x7f0fbc0cb470 2024-09-17T05:45:47.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc169e00 con 0x7f0fbc06de50 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fc1000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc16a100 con 0x7f0fbc072e50 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc0cb470 0x7f0fbc06f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc0cb470 0x7f0fbc06f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46074/0 (socket says 172.21.15.44:46074) 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 -- 172.21.15.44:0/1290413106 learned_addr learned my addr 172.21.15.44:0/1290413106 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fb9400640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fbc072e50 0x7f0fbc06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fb9e00640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc06de50 0x7f0fbc0c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 -- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fbc072e50 msgr2=0x7f0fbc06f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fbc072e50 0x7f0fbc06f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 -- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc06de50 msgr2=0x7f0fbc0c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc06de50 0x7f0fbc0c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 -- 172.21.15.44:0/1290413106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc09e9e0 con 0x7f0fbc0cb470 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fb9e00640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc06de50 0x7f0fbc0c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:47.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.384+0000 7f0fba800640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc0cb470 0x7f0fbc06f680 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c710 tx=0x7f0fb400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fb2000640 1 -- 172.21.15.44:0/1290413106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4003b80 con 0x7f0fbc0cb470 2024-09-17T05:45:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fb2000640 1 -- 172.21.15.44:0/1290413106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fb4003d20 con 0x7f0fbc0cb470 2024-09-17T05:45:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fb2000640 1 -- 172.21.15.44:0/1290413106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400aab0 con 0x7f0fbc0cb470 2024-09-17T05:45:47.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc0c2970 con 0x7f0fbc0cb470 2024-09-17T05:45:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc155780 con 0x7f0fbc0cb470 2024-09-17T05:45:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc06e260 con 0x7f0fbc0cb470 2024-09-17T05:45:47.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fb2000640 1 -- 172.21.15.44:0/1290413106 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0fb400ac50 con 0x7f0fbc0cb470 2024-09-17T05:45:47.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fb2000640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f9c073200 0x7f0f9c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fb2000640 1 -- 172.21.15.44:0/1290413106 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7f0fb4093f50 con 0x7f0fbc0cb470 2024-09-17T05:45:47.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.388+0000 7f0fb9e00640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f9c073200 0x7f0f9c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.392+0000 7f0fb9e00640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f9c073200 0x7f0f9c075710 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0046c0 tx=0x7f0fac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:47.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.392+0000 7f0fb2000640 1 -- 172.21.15.44:0/1290413106 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0fb400ce20 con 0x7f0fbc0cb470 2024-09-17T05:45:47.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.568+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0fbc15f540 con 0x7f0fbc0cb470 2024-09-17T05:45:47.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.568+0000 7f0fb2000640 1 -- 172.21.15.44:0/1290413106 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) ==== 93+0+10 (secure 0 0 0) 0x7f0fb405eff0 con 0x7f0fbc0cb470 2024-09-17T05:45:47.570 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f9c073200 msgr2=0x7f0f9c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f9c073200 0x7f0f9c075710 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0046c0 tx=0x7f0fac009040 comp rx=0 tx=0).stop 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc0cb470 msgr2=0x7f0fbc06f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc0cb470 0x7f0fbc06f680 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400c710 tx=0x7f0fb400cbd0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 shutdown_connections 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0fbc0cb470 0x7f0fbc06f680 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0fbc072e50 0x7f0fbc06f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0f9c073200 0x7f0f9c075710 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 --2- 172.21.15.44:0/1290413106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0fbc06de50 0x7f0fbc0c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 >> 172.21.15.44:0/1290413106 conn(0x7f0fbc0ccaa0 msgr2=0x7f0fbc0aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 shutdown_connections 2024-09-17T05:45:47.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.572+0000 7f0fc1000640 1 -- 172.21.15.44:0/1290413106 wait complete. 2024-09-17T05:45:47.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-09-17T05:45:47.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 -- 172.21.15.44:0/1797716824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd04072e50 msgr2=0x7fbd0415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 --2- 172.21.15.44:0/1797716824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd04072e50 0x7fbd0415e990 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbd040af7b0 tx=0x7fbcf801c770 comp rx=0 tx=0).stop 2024-09-17T05:45:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 -- 172.21.15.44:0/1797716824 shutdown_connections 2024-09-17T05:45:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 --2- 172.21.15.44:0/1797716824 >> v2:172.21.15.86:3300/0 conn(0x7fbd040cb470 0x7fbd040cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 --2- 172.21.15.44:0/1797716824 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd04072e50 0x7fbd0415e990 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 -- 172.21.15.44:0/1797716824 >> 172.21.15.44:0/1797716824 conn(0x7fbd040ccaa0 msgr2=0x7fbd040cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 -- 172.21.15.44:0/1797716824 shutdown_connections 2024-09-17T05:45:47.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 -- 172.21.15.44:0/1797716824 wait complete. 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 Processor -- start 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.752+0000 7fbd0b400640 1 -- start start 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0406de50 0x7fbd041fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd04072e50 0x7fbd040c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd040cb470 0x7fbd04157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbd04168e80 con 0x7fbd0406de50 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd04168d00 con 0x7fbd040cb470 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbd04169000 con 0x7fbd04072e50 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0406de50 0x7fbd041fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0406de50 0x7fbd041fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46104/0 (socket says 172.21.15.44:46104) 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 -- 172.21.15.44:0/935180448 learned_addr learned my addr 172.21.15.44:0/935180448 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd09400640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd040cb470 0x7fbd04157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd03e00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd04072e50 0x7fbd040c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 -- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd04072e50 msgr2=0x7fbd040c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd04072e50 0x7fbd040c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 -- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd040cb470 msgr2=0x7fbd04157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd040cb470 0x7fbd04157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 -- 172.21.15.44:0/935180448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd040c6710 con 0x7fbd0406de50 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd03e00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd04072e50 0x7fbd040c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd08a00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0406de50 0x7fbd041fcd10 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbcf801cc50 tx=0x7fbcf8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd00c00640 1 -- 172.21.15.44:0/935180448 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf80b2040 con 0x7fbd0406de50 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd00c00640 1 -- 172.21.15.44:0/935180448 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcf80bb070 con 0x7fbd0406de50 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd00c00640 1 -- 172.21.15.44:0/935180448 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8004370 con 0x7fbd0406de50 2024-09-17T05:45:47.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd040c69f0 con 0x7fbd0406de50 2024-09-17T05:45:47.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd041fc510 con 0x7fbd0406de50 2024-09-17T05:45:47.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.756+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd040cb880 con 0x7fbd0406de50 2024-09-17T05:45:47.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.760+0000 7fbd00c00640 1 -- 172.21.15.44:0/935180448 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbcf8003600 con 0x7fbd0406de50 2024-09-17T05:45:47.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.760+0000 7fbd00c00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbce4073200 0x7fbce4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:47.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.760+0000 7fbd00c00640 1 -- 172.21.15.44:0/935180448 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7fbcf812ee20 con 0x7fbd0406de50 2024-09-17T05:45:47.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.760+0000 7fbd03e00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbce4073200 0x7fbce4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:47.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.760+0000 7fbd03e00640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbce4073200 0x7fbce4075710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbd040c9fd0 tx=0x7fbcf0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:47.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.764+0000 7fbd00c00640 1 -- 172.21.15.44:0/935180448 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fbcf80163f0 con 0x7fbd0406de50 2024-09-17T05:45:47.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:47.996+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7fbd040b5fa0 con 0x7fbd0406de50 2024-09-17T05:45:48.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.832+0000 7fbd00c00640 1 -- 172.21.15.44:0/935180448 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v443) ==== 147+0+0 (secure 0 0 0) 0x7fbcf80f9fd0 con 0x7fbd0406de50 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbce4073200 msgr2=0x7fbce4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbce4073200 0x7fbce4075710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbd040c9fd0 tx=0x7fbcf0009040 comp rx=0 tx=0).stop 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0406de50 msgr2=0x7fbd041fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0406de50 0x7fbd041fcd10 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbcf801cc50 tx=0x7fbcf8005760 comp rx=0 tx=0).stop 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 shutdown_connections 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbce4073200 0x7fbce4075710 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd040cb470 0x7fbd04157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbd04072e50 0x7fbd040c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 --2- 172.21.15.44:0/935180448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbd0406de50 0x7fbd041fcd10 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:48.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 >> 172.21.15.44:0/935180448 conn(0x7fbd040ccaa0 msgr2=0x7fbd0415cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 shutdown_connections 2024-09-17T05:45:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:48.836+0000 7fbd0b400640 1 -- 172.21.15.44:0/935180448 wait complete. 2024-09-17T05:45:48.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:45:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 -- 172.21.15.44:0/2466182213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 msgr2=0x7f82f80cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 --2- 172.21.15.44:0/2466182213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 0x7f82f80cb880 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f82f4009bc0 tx=0x7f82f401cb10 comp rx=0 tx=0).stop 2024-09-17T05:45:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 -- 172.21.15.44:0/2466182213 shutdown_connections 2024-09-17T05:45:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 --2- 172.21.15.44:0/2466182213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 0x7f82f80cb880 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 --2- 172.21.15.44:0/2466182213 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82f8072e50 0x7f82f815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 -- 172.21.15.44:0/2466182213 >> 172.21.15.44:0/2466182213 conn(0x7f82f80ccaa0 msgr2=0x7f82f80cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 -- 172.21.15.44:0/2466182213 shutdown_connections 2024-09-17T05:45:49.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.024+0000 7f8300800640 1 -- 172.21.15.44:0/2466182213 wait complete. 2024-09-17T05:45:49.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 Processor -- start 2024-09-17T05:45:49.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 -- start start 2024-09-17T05:45:49.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f806de50 0x7f82f81f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82f8072e50 0x7f82f80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 0x7f82f80b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f82f8168f20 con 0x7f82f806de50 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82f8168da0 con 0x7f82f80cb470 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f82f81690a0 con 0x7f82f8072e50 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f806de50 0x7f82f81f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f806de50 0x7f82f81f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46390/0 (socket says 172.21.15.44:46390) 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 -- 172.21.15.44:0/42751761 learned_addr learned my addr 172.21.15.44:0/42751761 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fe800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 0x7f82f80b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fd400640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82f8072e50 0x7f82f80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 -- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82f8072e50 msgr2=0x7f82f80c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82f8072e50 0x7f82f80c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 -- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 msgr2=0x7f82f80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 0x7f82f80b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 -- 172.21.15.44:0/42751761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f80b5b30 con 0x7f82f806de50 2024-09-17T05:45:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fe800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 0x7f82f80b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fd400640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82f8072e50 0x7f82f80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82fde00640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f806de50 0x7f82f81f6a10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e7d0 tx=0x7f82ec00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82f2000640 1 -- 172.21.15.44:0/42751761 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00ccc0 con 0x7f82f806de50 2024-09-17T05:45:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82f2000640 1 -- 172.21.15.44:0/42751761 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82ec010430 con 0x7f82f806de50 2024-09-17T05:45:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f80c7270 con 0x7f82f806de50 2024-09-17T05:45:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f82f2000640 1 -- 172.21.15.44:0/42751761 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec010860 con 0x7f82f806de50 2024-09-17T05:45:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.028+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f80c7830 con 0x7f82f806de50 2024-09-17T05:45:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.032+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f80cb880 con 0x7f82f806de50 2024-09-17T05:45:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.032+0000 7f82f2000640 1 -- 172.21.15.44:0/42751761 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f82ec010a00 con 0x7f82f806de50 2024-09-17T05:45:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.032+0000 7f82f2000640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f82dc073200 0x7f82dc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.032+0000 7f82f2000640 1 -- 172.21.15.44:0/42751761 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7f82ec095350 con 0x7f82f806de50 2024-09-17T05:45:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.032+0000 7f82fd400640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f82dc073200 0x7f82dc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.036+0000 7f82fd400640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f82dc073200 0x7f82dc075710 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f82e8001230 tx=0x7f82e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.036+0000 7f82f2000640 1 -- 172.21.15.44:0/42751761 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f82ec060500 con 0x7f82f806de50 2024-09-17T05:45:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f82f80c7050 con 0x7f82f806de50 2024-09-17T05:45:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f82f2000640 1 -- 172.21.15.44:0/42751761 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v43) ==== 59+0+2294 (secure 0 0 0) 0x7f82ec05fe00 con 0x7f82f806de50 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced client_mount_timeout 30 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_client 20/20 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_mgr 20/20 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:mgr advanced debug_ms 1/1 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 3062.155679 2024-09-17T05:45:49.212 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 3184.697297 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 3313.522676 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 3406.954625 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4320.207875 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 3954.313189 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 7119.006184 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4437.685284 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds 20/20 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced debug_ms 2/2 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_frag true 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:45:49.213 INFO:teuthology.orchestra.run.smithi044.stdout:mds dev mds_verify_scatter true 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced client_mount_timeout 600 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_client 20/20 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced debug_ms 1/1 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:45:49.214 INFO:teuthology.orchestra.run.smithi044.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f82dc073200 msgr2=0x7f82dc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f82dc073200 0x7f82dc075710 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f82e8001230 tx=0x7f82e8009040 comp rx=0 tx=0).stop 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f806de50 msgr2=0x7f82f81f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f806de50 0x7f82f81f6a10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00e7d0 tx=0x7f82ec00ec90 comp rx=0 tx=0).stop 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 shutdown_connections 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f82dc073200 0x7f82dc075710 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f80cb470 0x7f82f80b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82f8072e50 0x7f82f80c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 --2- 172.21.15.44:0/42751761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f82f806de50 0x7f82f81f6a10 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 >> 172.21.15.44:0/42751761 conn(0x7f82f80ccaa0 msgr2=0x7f82f815f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 shutdown_connections 2024-09-17T05:45:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.212+0000 7f8300800640 1 -- 172.21.15.44:0/42751761 wait complete. 2024-09-17T05:45:49.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:45:49.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 -- 172.21.15.44:0/3379240835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 msgr2=0x7f0f1806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/3379240835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f1806e260 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009840 tx=0x7f0f0001c790 comp rx=0 tx=0).stop 2024-09-17T05:45:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 -- 172.21.15.44:0/3379240835 shutdown_connections 2024-09-17T05:45:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/3379240835 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f180cb470 0x7f0f180cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/3379240835 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f1806e260 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 -- 172.21.15.44:0/3379240835 >> 172.21.15.44:0/3379240835 conn(0x7f0f180ccaa0 msgr2=0x7f0f180cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 -- 172.21.15.44:0/3379240835 shutdown_connections 2024-09-17T05:45:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 -- 172.21.15.44:0/3379240835 wait complete. 2024-09-17T05:45:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 Processor -- start 2024-09-17T05:45:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.396+0000 7f0f1fa00640 1 -- start start 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f180c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f18072e50 0x7f0f1815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f180cb470 0x7f0f1815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18168ed0 con 0x7f0f1806de50 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18168d50 con 0x7f0f180cb470 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f0f18169050 con 0x7f0f18072e50 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f180c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f180c2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46416/0 (socket says 172.21.15.44:46416) 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 -- 172.21.15.44:0/4049444599 learned_addr learned my addr 172.21.15.44:0/4049444599 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1da00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f180cb470 0x7f0f1815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 -- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f18072e50 msgr2=0x7f0f1815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f18072e50 0x7f0f1815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 -- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f180cb470 msgr2=0x7f0f1815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f180cb470 0x7f0f1815a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 -- 172.21.15.44:0/4049444599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f180a0db0 con 0x7f0f1806de50 2024-09-17T05:45:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1da00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f180cb470 0x7f0f1815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1d000640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f180c2e70 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c760 tx=0x7f0f0800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f15600640 1 -- 172.21.15.44:0/4049444599 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08016020 con 0x7f0f1806de50 2024-09-17T05:45:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f15600640 1 -- 172.21.15.44:0/4049444599 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f0800a8f0 con 0x7f0f1806de50 2024-09-17T05:45:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f15600640 1 -- 172.21.15.44:0/4049444599 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800ad40 con 0x7f0f1806de50 2024-09-17T05:45:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f180a1020 con 0x7f0f1806de50 2024-09-17T05:45:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f180c97a0 con 0x7f0f1806de50 2024-09-17T05:45:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.400+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1806e260 con 0x7f0f1806de50 2024-09-17T05:45:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.404+0000 7f0f15600640 1 -- 172.21.15.44:0/4049444599 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0f08019020 con 0x7f0f1806de50 2024-09-17T05:45:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.404+0000 7f0f15600640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ef4073230 0x7f0ef4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.404+0000 7f0f15600640 1 -- 172.21.15.44:0/4049444599 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7f0f080940d0 con 0x7f0f1806de50 2024-09-17T05:45:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.404+0000 7f0f0fe00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ef4073230 0x7f0ef4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.404+0000 7f0f0fe00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ef4073230 0x7f0ef4075740 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0f000af000 tx=0x7f0f00019530 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:49.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.408+0000 7f0f15600640 1 -- 172.21.15.44:0/4049444599 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f0f08020020 con 0x7f0f1806de50 2024-09-17T05:45:49.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.580+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0f180b5fa0 con 0x7f0f1806de50 2024-09-17T05:45:49.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.584+0000 7f0f15600640 1 -- 172.21.15.44:0/4049444599 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7f0f1806e7a0 con 0x7f0f1806de50 2024-09-17T05:45:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ef4073230 msgr2=0x7f0ef4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ef4073230 0x7f0ef4075740 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0f000af000 tx=0x7f0f00019530 comp rx=0 tx=0).stop 2024-09-17T05:45:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 msgr2=0x7f0f180c2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:49.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f180c2e70 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800c760 tx=0x7f0f0800cc20 comp rx=0 tx=0).stop 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 shutdown_connections 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f0ef4073230 0x7f0ef4075740 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f180cb470 0x7f0f1815a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f0f18072e50 0x7f0f1815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 --2- 172.21.15.44:0/4049444599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f1806de50 0x7f0f180c2e70 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 >> 172.21.15.44:0/4049444599 conn(0x7f0f180ccaa0 msgr2=0x7f0f180cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 shutdown_connections 2024-09-17T05:45:49.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:49.588+0000 7f0f1fa00640 1 -- 172.21.15.44:0/4049444599 wait complete. 2024-09-17T05:45:49.608 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:45:49.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:49.694 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:45:49.789 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:45:49.790 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:45:49.790 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:49.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:45:49.800 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:45:49.800 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:49.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:49.810 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:45:49.810 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:49.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:45:49.853 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:45:49.853 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:45:49.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:45:49.867 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:45:49.867 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:50.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 -- 172.21.15.44:0/1879169797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 msgr2=0x7f53d00cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 --2- 172.21.15.44:0/1879169797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00cf190 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f53d0071d80 tx=0x7f53b801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 -- 172.21.15.44:0/1879169797 shutdown_connections 2024-09-17T05:45:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 --2- 172.21.15.44:0/1879169797 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00cf190 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 --2- 172.21.15.44:0/1879169797 >> v2:172.21.15.86:3300/0 conn(0x7f53d00cac30 0x7f53d00cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 -- 172.21.15.44:0/1879169797 >> 172.21.15.44:0/1879169797 conn(0x7f53d00ccaa0 msgr2=0x7f53d00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 -- 172.21.15.44:0/1879169797 shutdown_connections 2024-09-17T05:45:50.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.056+0000 7f53d6200640 1 -- 172.21.15.44:0/1879169797 wait complete. 2024-09-17T05:45:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 Processor -- start 2024-09-17T05:45:50.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 -- start start 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53d00cac30 0x7f53d01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53d015e8c0 0x7f53d00704c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0166490 con 0x7f53d00cb040 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0166310 con 0x7f53d015e8c0 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53d6200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f53d0166610 con 0x7f53d00cac30 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53c7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53c7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46430/0 (socket says 172.21.15.44:46430) 2024-09-17T05:45:50.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53c7e00640 1 -- 172.21.15.44:0/784490736 learned_addr learned my addr 172.21.15.44:0/784490736 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53cf400640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53d00cac30 0x7f53d01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.060+0000 7f53cfe00640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53d015e8c0 0x7f53d00704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7e00640 1 -- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53d00cac30 msgr2=0x7f53d01573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7e00640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53d00cac30 0x7f53d01573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7e00640 1 -- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53d015e8c0 msgr2=0x7f53d00704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7e00640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53d015e8c0 0x7f53d00704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7e00640 1 -- 172.21.15.44:0/784490736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d009e580 con 0x7f53d00cb040 2024-09-17T05:45:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7e00640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00c8940 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f53b80b0040 tx=0x7f53b80a57f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7400640 1 -- 172.21.15.44:0/784490736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80bb070 con 0x7f53d00cb040 2024-09-17T05:45:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7400640 1 -- 172.21.15.44:0/784490736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53b80044b0 con 0x7f53d00cb040 2024-09-17T05:45:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7400640 1 -- 172.21.15.44:0/784490736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80b2040 con 0x7f53d00cb040 2024-09-17T05:45:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d009d220 con 0x7f53d00cb040 2024-09-17T05:45:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d0167830 con 0x7f53d00cb040 2024-09-17T05:45:50.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d00cd9f0 con 0x7f53d00cb040 2024-09-17T05:45:50.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.064+0000 7f53c7400640 1 -- 172.21.15.44:0/784490736 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f53b80052d0 con 0x7f53d00cb040 2024-09-17T05:45:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.068+0000 7f53c7400640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53ac073200 0x7f53ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.068+0000 7f53c7400640 1 -- 172.21.15.44:0/784490736 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7f53b812d8d0 con 0x7f53d00cb040 2024-09-17T05:45:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.068+0000 7f53cf400640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53ac073200 0x7f53ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.068+0000 7f53cf400640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53ac073200 0x7f53ac075710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f53c0004630 tx=0x7f53c000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.072+0000 7f53c7400640 1 -- 172.21.15.44:0/784490736 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f53b80164b0 con 0x7f53d00cb040 2024-09-17T05:45:50.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.284+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53d015ecd0 con 0x7f53d00cb040 2024-09-17T05:45:50.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.284+0000 7f53c7400640 1 -- 172.21.15.44:0/784490736 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+3902 (secure 0 0 0) 0x7f53b80f8320 con 0x7f53d00cb040 2024-09-17T05:45:50.285 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:50.285 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":94,"btime":"2024-09-17T05:45:43:800469+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6671,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/511524171","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":511524171},{"type":"v1","addr":"172.21.15.44:6834","nonce":511524171}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7372,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6836/4265424794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4265424794},{"type":"v1","addr":"172.21.15.86:6836","nonce":4265424794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":7375,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/378916794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6835","nonce":378916794},{"type":"v1","addr":"172.21.15.86:6837","nonce":378916794}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":8085,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/581642795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":581642795},{"type":"v1","addr":"172.21.15.44:6835","nonce":581642795}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":92}],"filesystems":[]} 2024-09-17T05:45:50.285 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 94 2024-09-17T05:45:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53ac073200 msgr2=0x7f53ac075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53ac073200 0x7f53ac075710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f53c0004630 tx=0x7f53c000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 msgr2=0x7f53d00c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00c8940 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f53b80b0040 tx=0x7f53b80a57f0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 shutdown_connections 2024-09-17T05:45:50.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f53ac073200 0x7f53ac075710 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53d015e8c0 0x7f53d00704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f53d00cb040 0x7f53d00c8940 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 --2- 172.21.15.44:0/784490736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53d00cac30 0x7f53d01573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 >> 172.21.15.44:0/784490736 conn(0x7f53d00ccaa0 msgr2=0x7f53d0157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 shutdown_connections 2024-09-17T05:45:50.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.288+0000 7f53d6200640 1 -- 172.21.15.44:0/784490736 wait complete. 2024-09-17T05:45:50.307 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:45:50.307 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:45:50.308 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:45:50.308 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:50.308 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:45:50.308 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:45:50.308 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:45:50.308 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:50.308 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:45:50.309 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:45:50.309 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:45:50.309 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:50.309 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:45:50.309 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:45:50.309 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:45:50.309 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:45:50.323 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:45:50.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:45:50.324 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:45:50.324 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:45:50.325 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:45:50.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:45:50.331 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:45:50.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:45:50.369 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:45:50.369 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:50.370 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:45:50.371 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:50.380 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:45:50.380 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:50.382 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:45:50.383 DEBUG:teuthology.parallel:result is None 2024-09-17T05:45:50.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:45:50.475 INFO:tasks.ceph.mds.b.smithi086.stdout:starting mds.b at 2024-09-17T05:45:50.477 INFO:tasks.ceph.mds.d.smithi086.stdout:starting mds.d at 2024-09-17T05:45:50.480 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-09-17T05:45:50.482 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:45:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.548+0000 7f19de800640 1 -- 172.21.15.44:0/2579940907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 msgr2=0x7f19bc004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.548+0000 7f19de800640 1 --2- 172.21.15.44:0/2579940907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19bc004c20 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009b10 tx=0x7f19c001d200 comp rx=0 tx=0).stop 2024-09-17T05:45:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.548+0000 7f19de800640 1 -- 172.21.15.44:0/2579940907 shutdown_connections 2024-09-17T05:45:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.548+0000 7f19de800640 1 --2- 172.21.15.44:0/2579940907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19bc004c20 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.548+0000 7f19de800640 1 -- 172.21.15.44:0/2579940907 >> 172.21.15.44:0/2579940907 conn(0x7f19d80b4240 msgr2=0x7f19d80b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.548+0000 7f19de800640 1 -- 172.21.15.44:0/2579940907 shutdown_connections 2024-09-17T05:45:50.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.548+0000 7f19de800640 1 -- 172.21.15.44:0/2579940907 wait complete. 2024-09-17T05:45:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 Processor -- start 2024-09-17T05:45:50.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 -- start start 2024-09-17T05:45:50.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19d81505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d81f9b90 0x7f19d81fc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19d8155e40 0x7f19d8156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f19d815d9f0 con 0x7f19bc004810 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f19d815d870 con 0x7f19d81f9b90 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f19d806ee00 con 0x7f19d8155e40 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19d81505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19d81505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46484/0 (socket says 172.21.15.44:46484) 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 -- 172.21.15.44:0/3969830934 learned_addr learned my addr 172.21.15.44:0/3969830934 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19cfe00640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d81f9b90 0x7f19d81fc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7e00640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19d8155e40 0x7f19d8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 -- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19d8155e40 msgr2=0x7f19d8156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19d8155e40 0x7f19d8156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 -- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d81f9b90 msgr2=0x7f19d81fc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d81f9b90 0x7f19d81fc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 -- 172.21.15.44:0/3969830934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d8154260 con 0x7f19bc004810 2024-09-17T05:45:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7e00640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19d8155e40 0x7f19d8156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19d7400640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19d81505a0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f19c80065d0 tx=0x7f19c80039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:50.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19cf400640 1 -- 172.21.15.44:0/3969830934 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8015070 con 0x7f19bc004810 2024-09-17T05:45:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19cf400640 1 -- 172.21.15.44:0/3969830934 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19c8011940 con 0x7f19bc004810 2024-09-17T05:45:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19cf400640 1 -- 172.21.15.44:0/3969830934 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8011d90 con 0x7f19bc004810 2024-09-17T05:45:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d8156790 con 0x7f19bc004810 2024-09-17T05:45:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.552+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81f90b0 con 0x7f19bc004810 2024-09-17T05:45:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.556+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d81f8ec0 con 0x7f19bc004810 2024-09-17T05:45:50.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.556+0000 7f19cf400640 1 -- 172.21.15.44:0/3969830934 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f19c8018070 con 0x7f19bc004810 2024-09-17T05:45:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.556+0000 7f19cf400640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19b4073230 0x7f19b4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:50.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.556+0000 7f19cf400640 1 -- 172.21.15.44:0/3969830934 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5421+0+0 (secure 0 0 0) 0x7f19c8094f20 con 0x7f19bc004810 2024-09-17T05:45:50.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.556+0000 7f19cfe00640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19b4073230 0x7f19b4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:50.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.560+0000 7f19cfe00640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19b4073230 0x7f19b4075740 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f19c00ae000 tx=0x7f19c0019fa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:50.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.560+0000 7f19cf400640 1 -- 172.21.15.44:0/3969830934 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f19d8156790 con 0x7f19bc004810 2024-09-17T05:45:50.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.748+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f19d80d0680 con 0x7f19bc004810 2024-09-17T05:45:50.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19cf400640 1 -- 172.21.15.44:0/3969830934 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v113) ==== 97+0+0 (secure 0 0 0) 0x7f19d8154260 con 0x7f19bc004810 2024-09-17T05:45:50.848 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19b4073230 msgr2=0x7f19b4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19b4073230 0x7f19b4075740 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f19c00ae000 tx=0x7f19c0019fa0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 msgr2=0x7f19d81505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19d81505a0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f19c80065d0 tx=0x7f19c80039d0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 shutdown_connections 2024-09-17T05:45:50.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f19d8155e40 0x7f19d8156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19b4073230 0x7f19b4075740 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19d81f9b90 0x7f19d81fc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 --2- 172.21.15.44:0/3969830934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f19bc004810 0x7f19d81505a0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 >> 172.21.15.44:0/3969830934 conn(0x7f19d80b4240 msgr2=0x7f19d8159070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 shutdown_connections 2024-09-17T05:45:50.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:50.848+0000 7f19de800640 1 -- 172.21.15.44:0/3969830934 wait complete. 2024-09-17T05:45:50.873 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:45:51.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 -- 172.21.15.44:0/1291786902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec0cfc50 msgr2=0x7f3aec15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 --2- 172.21.15.44:0/1291786902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec0cfc50 0x7f3aec15f470 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0733b0 tx=0x7f3ae401cd80 comp rx=0 tx=0).stop 2024-09-17T05:45:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 -- 172.21.15.44:0/1291786902 shutdown_connections 2024-09-17T05:45:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 --2- 172.21.15.44:0/1291786902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec0cfc50 0x7f3aec15f470 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 --2- 172.21.15.44:0/1291786902 >> v2:172.21.15.86:3300/0 conn(0x7f3aec1523f0 0x7f3aec0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 -- 172.21.15.44:0/1291786902 >> 172.21.15.44:0/1291786902 conn(0x7f3aec0cda70 msgr2=0x7f3aec0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 -- 172.21.15.44:0/1291786902 shutdown_connections 2024-09-17T05:45:51.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.032+0000 7f3aeb200640 1 -- 172.21.15.44:0/1291786902 wait complete. 2024-09-17T05:45:51.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 Processor -- start 2024-09-17T05:45:51.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 -- start start 2024-09-17T05:45:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec06e370 0x7f3aec15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3aec0cfc50 0x7f3aec1f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec1523f0 0x7f3aec1f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec168700 con 0x7f3aec06e370 2024-09-17T05:45:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec15fbc0 con 0x7f3aec1523f0 2024-09-17T05:45:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aeb200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3aec168880 con 0x7f3aec0cfc50 2024-09-17T05:45:51.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec06e370 0x7f3aec15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec06e370 0x7f3aec15ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46502/0 (socket says 172.21.15.44:46502) 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 -- 172.21.15.44:0/4206821639 learned_addr learned my addr 172.21.15.44:0/4206821639 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aea800640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec1523f0 0x7f3aec1f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae3e00640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3aec0cfc50 0x7f3aec1f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 -- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3aec0cfc50 msgr2=0x7f3aec1f96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3aec0cfc50 0x7f3aec1f96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 -- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec1523f0 msgr2=0x7f3aec1f9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec1523f0 0x7f3aec1f9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 -- 172.21.15.44:0/4206821639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec14d170 con 0x7f3aec06e370 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3aea800640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec1523f0 0x7f3aec1f9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae3e00640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3aec0cfc50 0x7f3aec1f96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:51.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae9e00640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec06e370 0x7f3aec15ac80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00d750 tx=0x7f3adc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae2000640 1 -- 172.21.15.44:0/4206821639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc017070 con 0x7f3aec06e370 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae2000640 1 -- 172.21.15.44:0/4206821639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3adc009cc0 con 0x7f3aec06e370 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.036+0000 7f3ae2000640 1 -- 172.21.15.44:0/4206821639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00de60 con 0x7f3aec06e370 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.040+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aec14d450 con 0x7f3aec06e370 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.040+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aec15cdd0 con 0x7f3aec06e370 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.040+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aec0cf710 con 0x7f3aec06e370 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.040+0000 7f3ae2000640 1 -- 172.21.15.44:0/4206821639 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3adc01a070 con 0x7f3aec06e370 2024-09-17T05:45:51.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.040+0000 7f3ae2000640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ac8073230 0x7f3ac8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.040+0000 7f3ae2000640 1 -- 172.21.15.44:0/4206821639 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5249+0+0 (secure 0 0 0) 0x7f3adc0941c0 con 0x7f3aec06e370 2024-09-17T05:45:51.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.040+0000 7f3ae3e00640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ac8073230 0x7f3ac8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.044+0000 7f3ae3e00640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ac8073230 0x7f3ac8075740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3aec15cbb0 tx=0x7f3ad4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:51.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.044+0000 7f3ae2000640 1 -- 172.21.15.44:0/4206821639 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3adc05f390 con 0x7f3aec06e370 2024-09-17T05:45:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3aec14df30 con 0x7f3aec06e370 2024-09-17T05:45:51.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3ae2000640 1 -- 172.21.15.44:0/4206821639 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f3adc05ec90 con 0x7f3aec06e370 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmDs7qDRAAYWmcdHxGya1USmM4h85bGw==", 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.281 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmELLAGxAAcuRDwvdpagkXMnaxLL1Oow==", 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:45:51.282 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm4m/cFRAA8amEypBt+doAK5VZMvkpvQ==", 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:45:51.283 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmV0ujIxAAEgLYbrlV3YwcJlO3AbvAVA==", 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.284 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAVFelmWXxSJRAAG6/82qoxv5KtC+tJl40Ftw==", 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.285 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAYFelmHvggOxAA9+l6FqLnsKOtwOqIYP3yJA==", 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.286 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAcFelmFtlOJBAAkRJmkYsTkBlHWz4G+qmXxg==", 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAfFelm+xc1OBAAaOeKtsbV323sVqnNNz7u4Q==", 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAmFelmwj14ABAARVjXsDCdymbF+u2X2+FrDg==", 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.289 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQApFelmm2/7GBAAJ3pEfLdFhrYX6r/M/aPdew==", 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.290 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAtFelmsH0HAhAAv7wHv+wTdsJ5OrAwlLr5vA==", 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.291 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQAwFelmAF5sGhAAbEI94HoNdGLCubUHvf1dJw==", 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-09-17T05:45:51.292 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow==", 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.293 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow r", 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmpt+LMBAAMRD7tMzIrq43N1J7ayPvUQ==", 2024-09-17T05:45:51.294 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:45:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:45:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:45:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-09-17T05:45:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelm8eZALBAA4qU4f3QyymXKzeTbgVYmLw==", 2024-09-17T05:45:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:45:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:45:51.296 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmJbGbNBAAJo2594A4dKrJLK0i3m+S1A==", 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-09-17T05:45:51.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQARFelmev8SKhAAoaY75HymG92N8LNMMAUl6g==", 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.298 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-09-17T05:45:51.299 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmrO0PCRAApdfvIZxKf7fhXniGkf58lA==", 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.300 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQASFelmFFI+BBAA8HlAH7HNqrju3IbUfaeCPw==", 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-09-17T05:45:51.301 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ac8073230 msgr2=0x7f3ac8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ac8073230 0x7f3ac8075740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3aec15cbb0 tx=0x7f3ad4009040 comp rx=0 tx=0).stop 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec06e370 msgr2=0x7f3aec15ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec06e370 0x7f3aec15ac80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00d750 tx=0x7f3adc00dc10 comp rx=0 tx=0).stop 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 shutdown_connections 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3ac8073230 0x7f3ac8075740 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3aec1523f0 0x7f3aec1f9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3aec0cfc50 0x7f3aec1f96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 --2- 172.21.15.44:0/4206821639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3aec06e370 0x7f3aec15ac80 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 >> 172.21.15.44:0/4206821639 conn(0x7f3aec0cda70 msgr2=0x7f3aec14f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 shutdown_connections 2024-09-17T05:45:51.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.280+0000 7f3aeb200640 1 -- 172.21.15.44:0/4206821639 wait complete. 2024-09-17T05:45:51.304 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:45:51.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.460+0000 7f24de400640 1 -- 172.21.15.44:0/2808134438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d80cf400 msgr2=0x7f24d806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.460+0000 7f24de400640 1 --2- 172.21.15.44:0/2808134438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d80cf400 0x7f24d806e160 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f24d80b0b30 tx=0x7f24c001c7a0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- 172.21.15.44:0/2808134438 shutdown_connections 2024-09-17T05:45:51.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 --2- 172.21.15.44:0/2808134438 >> v2:172.21.15.86:3300/0 conn(0x7f24d815f0e0 0x7f24d815f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 --2- 172.21.15.44:0/2808134438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d80cf400 0x7f24d806e160 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- 172.21.15.44:0/2808134438 >> 172.21.15.44:0/2808134438 conn(0x7f24d80d1120 msgr2=0x7f24d80d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:51.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- 172.21.15.44:0/2808134438 shutdown_connections 2024-09-17T05:45:51.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- 172.21.15.44:0/2808134438 wait complete. 2024-09-17T05:45:51.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 Processor -- start 2024-09-17T05:45:51.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- start start 2024-09-17T05:45:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d8072190 0x7f24d8159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d815f0e0 0x7f24d80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d815b3f0 0x7f24d815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8168df0 con 0x7f24d815b3f0 2024-09-17T05:45:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8168c70 con 0x7f24d815f0e0 2024-09-17T05:45:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.464+0000 7f24de400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f24d8168f70 con 0x7f24d8072190 2024-09-17T05:45:51.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d815b3f0 0x7f24d815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d815b3f0 0x7f24d815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46528/0 (socket says 172.21.15.44:46528) 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 -- 172.21.15.44:0/3178920083 learned_addr learned my addr 172.21.15.44:0/3178920083 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24cfe00640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d815f0e0 0x7f24d80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d8072190 0x7f24d8159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 -- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d8072190 msgr2=0x7f24d8159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d8072190 0x7f24d8159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 -- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d815f0e0 msgr2=0x7f24d80b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d815f0e0 0x7f24d80b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 -- 172.21.15.44:0/3178920083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d815e450 con 0x7f24d815b3f0 2024-09-17T05:45:51.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d8072190 0x7f24d8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24d7e00640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d815b3f0 0x7f24d815b800 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f24d000e940 tx=0x7f24d000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24cf400640 1 -- 172.21.15.44:0/3178920083 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0004d30 con 0x7f24d815b3f0 2024-09-17T05:45:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24cf400640 1 -- 172.21.15.44:0/3178920083 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24d000cb20 con 0x7f24d815b3f0 2024-09-17T05:45:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24cf400640 1 -- 172.21.15.44:0/3178920083 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0005020 con 0x7f24d815b3f0 2024-09-17T05:45:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d815bd40 con 0x7f24d815b3f0 2024-09-17T05:45:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d81fcd20 con 0x7f24d815b3f0 2024-09-17T05:45:51.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d806e160 con 0x7f24d815b3f0 2024-09-17T05:45:51.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.468+0000 7f24cf400640 1 -- 172.21.15.44:0/3178920083 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f24d00051c0 con 0x7f24d815b3f0 2024-09-17T05:45:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.472+0000 7f24cf400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24b4073230 0x7f24b4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.472+0000 7f24cf400640 1 -- 172.21.15.44:0/3178920083 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5249+0+0 (secure 0 0 0) 0x7f24d00947e0 con 0x7f24d815b3f0 2024-09-17T05:45:51.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.472+0000 7f24d7400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24b4073230 0x7f24b4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.472+0000 7f24d7400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24b4073230 0x7f24b4075740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f24c8000f70 tx=0x7f24c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:51.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.476+0000 7f24cf400640 1 -- 172.21.15.44:0/3178920083 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f24d815bd40 con 0x7f24d815b3f0 2024-09-17T05:45:51.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.648+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f24d80b5e20 con 0x7f24d815b3f0 2024-09-17T05:45:51.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.648+0000 7f24cf400640 1 -- 172.21.15.44:0/3178920083 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v115) ==== 84+0+65 (secure 0 0 0) 0x7f24d0016030 con 0x7f24d815b3f0 2024-09-17T05:45:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:51.650 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-09-17T05:45:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-09-17T05:45:51.650 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-09-17T05:45:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-09-17T05:45:51.651 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-09-17T05:45:51.651 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24b4073230 msgr2=0x7f24b4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24b4073230 0x7f24b4075740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f24c8000f70 tx=0x7f24c8009040 comp rx=0 tx=0).stop 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d815b3f0 msgr2=0x7f24d815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d815b3f0 0x7f24d815b800 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f24d000e940 tx=0x7f24d000ee00 comp rx=0 tx=0).stop 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 shutdown_connections 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24d815b3f0 0x7f24d815b800 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24b4073230 0x7f24b4075740 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24d815f0e0 0x7f24d80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 --2- 172.21.15.44:0/3178920083 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24d8072190 0x7f24d8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 >> 172.21.15.44:0/3178920083 conn(0x7f24d80d1120 msgr2=0x7f24d80b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 shutdown_connections 2024-09-17T05:45:51.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.652+0000 7f24de400640 1 -- 172.21.15.44:0/3178920083 wait complete. 2024-09-17T05:45:51.673 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:45:51.673 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:45:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 -- 172.21.15.44:0/766980878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340746f0 msgr2=0x7f3e340afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 --2- 172.21.15.44:0/766980878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340746f0 0x7f3e340afeb0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009bf0 tx=0x7f3e2801cb10 comp rx=0 tx=0).stop 2024-09-17T05:45:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 -- 172.21.15.44:0/766980878 shutdown_connections 2024-09-17T05:45:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 --2- 172.21.15.44:0/766980878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340746f0 0x7f3e340afeb0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 -- 172.21.15.44:0/766980878 >> 172.21.15.44:0/766980878 conn(0x7f3e340736c0 msgr2=0x7f3e34073ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:51.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 -- 172.21.15.44:0/766980878 shutdown_connections 2024-09-17T05:45:51.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 -- 172.21.15.44:0/766980878 wait complete. 2024-09-17T05:45:51.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 Processor -- start 2024-09-17T05:45:51.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.836+0000 7f3e3b600640 1 -- start start 2024-09-17T05:45:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e340741e0 0x7f3e34143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e340746f0 0x7f3e3406d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340ad8b0 0x7f3e3406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3416b480 con 0x7f3e340ad8b0 2024-09-17T05:45:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3416b300 con 0x7f3e340746f0 2024-09-17T05:45:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3416b600 con 0x7f3e340741e0 2024-09-17T05:45:51.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340ad8b0 0x7f3e3406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340ad8b0 0x7f3e3406dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46546/0 (socket says 172.21.15.44:46546) 2024-09-17T05:45:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 -- 172.21.15.44:0/224497166 learned_addr learned my addr 172.21.15.44:0/224497166 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e38c00640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e340741e0 0x7f3e34143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e33e00640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e340746f0 0x7f3e3406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 -- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e340741e0 msgr2=0x7f3e34143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e340741e0 0x7f3e34143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 -- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e340746f0 msgr2=0x7f3e3406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e340746f0 0x7f3e3406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 -- 172.21.15.44:0/224497166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e340ae000 con 0x7f3e340ad8b0 2024-09-17T05:45:51.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e39600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340ad8b0 0x7f3e3406dec0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c3c0 tx=0x7f3e2c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e30c00640 1 -- 172.21.15.44:0/224497166 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c011790 con 0x7f3e340ad8b0 2024-09-17T05:45:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e30c00640 1 -- 172.21.15.44:0/224497166 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e2c017070 con 0x7f3e340ad8b0 2024-09-17T05:45:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e340ae2e0 con 0x7f3e340ad8b0 2024-09-17T05:45:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e30c00640 1 -- 172.21.15.44:0/224497166 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c011cc0 con 0x7f3e340ad8b0 2024-09-17T05:45:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e340ae8a0 con 0x7f3e340ad8b0 2024-09-17T05:45:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.840+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e340afeb0 con 0x7f3e340ad8b0 2024-09-17T05:45:51.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.844+0000 7f3e30c00640 1 -- 172.21.15.44:0/224497166 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e2c01c460 con 0x7f3e340ad8b0 2024-09-17T05:45:51.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.844+0000 7f3e30c00640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e14073200 0x7f3e14075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:51.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.844+0000 7f3e30c00640 1 -- 172.21.15.44:0/224497166 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5249+0+0 (secure 0 0 0) 0x7f3e2c093e20 con 0x7f3e340ad8b0 2024-09-17T05:45:51.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.844+0000 7f3e38c00640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e14073200 0x7f3e14075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:51.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.844+0000 7f3e38c00640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e14073200 0x7f3e14075710 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3e280af000 tx=0x7f3e2801b350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:51.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:51.848+0000 7f3e30c00640 1 -- 172.21.15.44:0/224497166 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f3e2c05eff0 con 0x7f3e340ad8b0 2024-09-17T05:45:52.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.028+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3e3406ae00 con 0x7f3e340ad8b0 2024-09-17T05:45:52.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.864+0000 7f3e30c00640 1 -- 172.21.15.44:0/224497166 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v116) ==== 138+0+0 (secure 0 0 0) 0x7f3e2c05e8f0 con 0x7f3e340ad8b0 2024-09-17T05:45:52.866 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-09-17T05:45:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e14073200 msgr2=0x7f3e14075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e14073200 0x7f3e14075710 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3e280af000 tx=0x7f3e2801b350 comp rx=0 tx=0).stop 2024-09-17T05:45:52.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340ad8b0 msgr2=0x7f3e3406dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340ad8b0 0x7f3e3406dec0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00c3c0 tx=0x7f3e2c00c880 comp rx=0 tx=0).stop 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 shutdown_connections 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e340ad8b0 0x7f3e3406dec0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3e14073200 0x7f3e14075710 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3e340746f0 0x7f3e3406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 --2- 172.21.15.44:0/224497166 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f3e340741e0 0x7f3e34143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 >> 172.21.15.44:0/224497166 conn(0x7f3e340736c0 msgr2=0x7f3e340b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 shutdown_connections 2024-09-17T05:45:52.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:52.868+0000 7f3e3b600640 1 -- 172.21.15.44:0/224497166 wait complete. 2024-09-17T05:45:52.896 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 -- 172.21.15.44:0/1957408141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 msgr2=0x7ff3a00cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 --2- 172.21.15.44:0/1957408141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a00cb880 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff398009c80 tx=0x7ff39801cd10 comp rx=0 tx=0).stop 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 -- 172.21.15.44:0/1957408141 shutdown_connections 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 --2- 172.21.15.44:0/1957408141 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a00cb880 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 --2- 172.21.15.44:0/1957408141 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3a006de50 0x7ff3a006e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 -- 172.21.15.44:0/1957408141 >> 172.21.15.44:0/1957408141 conn(0x7ff3a00ccaa0 msgr2=0x7ff3a00cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 -- 172.21.15.44:0/1957408141 shutdown_connections 2024-09-17T05:45:53.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.060+0000 7ff3a8000640 1 -- 172.21.15.44:0/1957408141 wait complete. 2024-09-17T05:45:53.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 Processor -- start 2024-09-17T05:45:53.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 -- start start 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a006de50 0x7ff3a0156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3a0072e50 0x7ff3a00ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a0153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0168ff0 con 0x7ff3a00cb470 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a0168e70 con 0x7ff3a006de50 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.064+0000 7ff3a8000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a0169170 con 0x7ff3a0072e50 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a0153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a5600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a006de50 0x7ff3a0156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a0153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46558/0 (socket says 172.21.15.44:46558) 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a5600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a006de50 0x7ff3a0156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:53586/0 (socket says 172.21.15.44:53586) 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a4c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3a0072e50 0x7ff3a00ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:53.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 -- 172.21.15.44:0/530510348 learned_addr learned my addr 172.21.15.44:0/530510348 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:53.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 -- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3a0072e50 msgr2=0x7ff3a00ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:53.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3a0072e50 0x7ff3a00ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 -- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a006de50 msgr2=0x7ff3a0156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a006de50 0x7ff3a0156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 -- 172.21.15.44:0/530510348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a0155240 con 0x7ff3a00cb470 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a6000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a0153350 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff398009bd0 tx=0x7ff3980092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff39d600640 1 -- 172.21.15.44:0/530510348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3980bb070 con 0x7ff3a00cb470 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff39d600640 1 -- 172.21.15.44:0/530510348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff398004d40 con 0x7ff3a00cb470 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff39d600640 1 -- 172.21.15.44:0/530510348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3980b2040 con 0x7ff3a00cb470 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a01556b0 con 0x7ff3a00cb470 2024-09-17T05:45:53.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a015a890 con 0x7ff3a00cb470 2024-09-17T05:45:53.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a006e260 con 0x7ff3a00cb470 2024-09-17T05:45:53.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.068+0000 7ff39d600640 1 -- 172.21.15.44:0/530510348 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff398004220 con 0x7ff3a00cb470 2024-09-17T05:45:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.072+0000 7ff39d600640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff380073230 0x7ff380075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:53.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.072+0000 7ff39d600640 1 -- 172.21.15.44:0/530510348 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5619+0+0 (secure 0 0 0) 0x7ff39812de20 con 0x7ff3a00cb470 2024-09-17T05:45:53.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.072+0000 7ff3a5600640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff380073230 0x7ff380075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:53.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.072+0000 7ff3a5600640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff380073230 0x7ff380075740 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff394007fd0 tx=0x7ff394009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:53.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.076+0000 7ff39d600640 1 -- 172.21.15.44:0/530510348 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff3980f1db0 con 0x7ff3a00cb470 2024-09-17T05:45:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.252+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff3a0155440 con 0x7ff3a00cb470 2024-09-17T05:45:53.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.868+0000 7ff39d600640 1 -- 172.21.15.44:0/530510348 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v117) ==== 170+0+0 (secure 0 0 0) 0x7ff398016990 con 0x7ff3a00cb470 2024-09-17T05:45:53.869 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff380073230 msgr2=0x7ff380075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff380073230 0x7ff380075740 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff394007fd0 tx=0x7ff394009040 comp rx=0 tx=0).stop 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 msgr2=0x7ff3a0153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a0153350 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff398009bd0 tx=0x7ff3980092c0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 shutdown_connections 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3a00cb470 0x7ff3a0153350 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff3a0072e50 0x7ff3a00ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff380073230 0x7ff380075740 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 --2- 172.21.15.44:0/530510348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3a006de50 0x7ff3a0156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:53.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 >> 172.21.15.44:0/530510348 conn(0x7ff3a00ccaa0 msgr2=0x7ff3a015ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:53.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 shutdown_connections 2024-09-17T05:45:53.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:53.872+0000 7ff3a8000640 1 -- 172.21.15.44:0/530510348 wait complete. 2024-09-17T05:45:53.910 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:45:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 -- 172.21.15.44:0/3975906668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f854406e560 msgr2=0x7f85440700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 --2- 172.21.15.44:0/3975906668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f854406e560 0x7f85440700d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8530009900 tx=0x7f853001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 -- 172.21.15.44:0/3975906668 shutdown_connections 2024-09-17T05:45:54.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 --2- 172.21.15.44:0/3975906668 >> v2:172.21.15.86:3300/0 conn(0x7f8544070610 0x7f8544070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 --2- 172.21.15.44:0/3975906668 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f854406e560 0x7f85440700d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 -- 172.21.15.44:0/3975906668 >> 172.21.15.44:0/3975906668 conn(0x7f85440ccaa0 msgr2=0x7f85440cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:54.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 -- 172.21.15.44:0/3975906668 shutdown_connections 2024-09-17T05:45:54.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.072+0000 7f854c200640 1 -- 172.21.15.44:0/3975906668 wait complete. 2024-09-17T05:45:54.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 Processor -- start 2024-09-17T05:45:54.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 -- start start 2024-09-17T05:45:54.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8544070610 0x7f85441f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:54.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440b5880 0x7f85441599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:54.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f854415e5a0 0x7f85440a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:54.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8544169ee0 con 0x7f85440b5880 2024-09-17T05:45:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8544169d60 con 0x7f854415e5a0 2024-09-17T05:45:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f854416a060 con 0x7f8544070610 2024-09-17T05:45:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440b5880 0x7f85441599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440b5880 0x7f85441599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46574/0 (socket says 172.21.15.44:46574) 2024-09-17T05:45:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 -- 172.21.15.44:0/1293394513 learned_addr learned my addr 172.21.15.44:0/1293394513 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8549800640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8544070610 0x7f85441f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854a200640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f854415e5a0 0x7f85440a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 -- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8544070610 msgr2=0x7f85441f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8544070610 0x7f85441f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 -- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f854415e5a0 msgr2=0x7f85440a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f854415e5a0 0x7f85440a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 -- 172.21.15.44:0/1293394513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854409f6b0 con 0x7f85440b5880 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8548e00640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440b5880 0x7f85441599f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f8530009850 tx=0x7f8530005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8541600640 1 -- 172.21.15.44:0/1293394513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300b2040 con 0x7f85440b5880 2024-09-17T05:45:54.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8541600640 1 -- 172.21.15.44:0/1293394513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8530004040 con 0x7f85440b5880 2024-09-17T05:45:54.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854409f990 con 0x7f85440b5880 2024-09-17T05:45:54.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.076+0000 7f8541600640 1 -- 172.21.15.44:0/1293394513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530004490 con 0x7f85440b5880 2024-09-17T05:45:54.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.080+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854409ff50 con 0x7f85440b5880 2024-09-17T05:45:54.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.080+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854409f420 con 0x7f85440b5880 2024-09-17T05:45:54.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.080+0000 7f8541600640 1 -- 172.21.15.44:0/1293394513 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f85300bf020 con 0x7f85440b5880 2024-09-17T05:45:54.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.080+0000 7f8541600640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8524073230 0x7f8524075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:54.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.080+0000 7f8541600640 1 -- 172.21.15.44:0/1293394513 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 6001+0+0 (secure 0 0 0) 0x7f853012e6a0 con 0x7f85440b5880 2024-09-17T05:45:54.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.080+0000 7f8549800640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8524073230 0x7f8524075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:54.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.084+0000 7f8549800640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8524073230 0x7f8524075740 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8538001780 tx=0x7f8538009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:54.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.084+0000 7f8541600640 1 -- 172.21.15.44:0/1293394513 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f85300164d0 con 0x7f85440b5880 2024-09-17T05:45:54.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.292+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f85440700d0 con 0x7f85440b5880 2024-09-17T05:45:54.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.900+0000 7f8541600640 1 -- 172.21.15.44:0/1293394513 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v97) ==== 174+0+0 (secure 0 0 0) 0x7f853012ce20 con 0x7f85440b5880 2024-09-17T05:45:54.902 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 17 and data pool 18 2024-09-17T05:45:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.912+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8524073230 msgr2=0x7f8524075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.912+0000 7f854c200640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8524073230 0x7f8524075740 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8538001780 tx=0x7f8538009040 comp rx=0 tx=0).stop 2024-09-17T05:45:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.912+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440b5880 msgr2=0x7f85441599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.912+0000 7f854c200640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440b5880 0x7f85441599f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f8530009850 tx=0x7f8530005760 comp rx=0 tx=0).stop 2024-09-17T05:45:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 shutdown_connections 2024-09-17T05:45:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8524073230 0x7f8524075740 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f854415e5a0 0x7f85440a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85440b5880 0x7f85441599f0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 --2- 172.21.15.44:0/1293394513 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8544070610 0x7f85441f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 >> 172.21.15.44:0/1293394513 conn(0x7f85440ccaa0 msgr2=0x7f854406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 shutdown_connections 2024-09-17T05:45:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:54.916+0000 7f854c200640 1 -- 172.21.15.44:0/1293394513 wait complete. 2024-09-17T05:45:54.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 -- 172.21.15.44:0/2052504540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188006e560 msgr2=0x7f18800700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 --2- 172.21.15.44:0/2052504540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188006e560 0x7f18800700d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f188009e100 tx=0x7f186801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 -- 172.21.15.44:0/2052504540 shutdown_connections 2024-09-17T05:45:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 --2- 172.21.15.44:0/2052504540 >> v2:172.21.15.86:3300/0 conn(0x7f1880070610 0x7f1880070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 --2- 172.21.15.44:0/2052504540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f188006e560 0x7f18800700d0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 -- 172.21.15.44:0/2052504540 >> 172.21.15.44:0/2052504540 conn(0x7f18800ccaa0 msgr2=0x7f18800cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 -- 172.21.15.44:0/2052504540 shutdown_connections 2024-09-17T05:45:55.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 -- 172.21.15.44:0/2052504540 wait complete. 2024-09-17T05:45:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 Processor -- start 2024-09-17T05:45:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.108+0000 7f1887800640 1 -- start start 2024-09-17T05:45:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1880070610 0x7f188015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18800b5880 0x7f18800b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188015bfe0 0x7f18800b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1880169ee0 con 0x7f18800b5880 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1880169d60 con 0x7f188015bfe0 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f188016a060 con 0x7f1880070610 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18800b5880 0x7f18800b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18800b5880 0x7f18800b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46600/0 (socket says 172.21.15.44:46600) 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 -- 172.21.15.44:0/1449538487 learned_addr learned my addr 172.21.15.44:0/1449538487 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:55.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1884e00640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1880070610 0x7f188015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1885800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188015bfe0 0x7f18800b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 -- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1880070610 msgr2=0x7f188015b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1880070610 0x7f188015b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 -- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188015bfe0 msgr2=0x7f18800b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188015bfe0 0x7f18800b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 -- 172.21.15.44:0/1449538487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18801fbe90 con 0x7f18800b5880 2024-09-17T05:45:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1884e00640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1880070610 0x7f188015b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1885800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188015bfe0 0x7f18800b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1877e00640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18800b5880 0x7f18800b3ec0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f18680b0040 tx=0x7f18680a5580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f187d600640 1 -- 172.21.15.44:0/1449538487 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18680b2040 con 0x7f18800b5880 2024-09-17T05:45:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f187d600640 1 -- 172.21.15.44:0/1449538487 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18680043b0 con 0x7f18800b5880 2024-09-17T05:45:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f187d600640 1 -- 172.21.15.44:0/1449538487 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868005280 con 0x7f18800b5880 2024-09-17T05:45:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18801fc170 con 0x7f18800b5880 2024-09-17T05:45:55.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18801fc730 con 0x7f18800b5880 2024-09-17T05:45:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.112+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18801fbc00 con 0x7f18800b5880 2024-09-17T05:45:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.116+0000 7f187d600640 1 -- 172.21.15.44:0/1449538487 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1868005420 con 0x7f18800b5880 2024-09-17T05:45:55.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.116+0000 7f187d600640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f185c073200 0x7f185c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.116+0000 7f187d600640 1 -- 172.21.15.44:0/1449538487 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f186812dfe0 con 0x7f18800b5880 2024-09-17T05:45:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.116+0000 7f1884e00640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f185c073200 0x7f185c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.116+0000 7f1884e00640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f185c073200 0x7f185c075710 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1870000f70 tx=0x7f1870009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:55.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.120+0000 7f187d600640 1 -- 172.21.15.44:0/1449538487 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f18680164b0 con 0x7f18800b5880 2024-09-17T05:45:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18801fc970 con 0x7f18800b5880 2024-09-17T05:45:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f187d600640 1 -- 172.21.15.44:0/1449538487 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16981 (secure 0 0 0) 0x7f18801fc970 con 0x7f18800b5880 2024-09-17T05:45:55.297 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:55.298 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":118,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:45:54.297970+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:52.041779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:53.267006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f185c073200 msgr2=0x7f185c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f185c073200 0x7f185c075710 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1870000f70 tx=0x7f1870009040 comp rx=0 tx=0).stop 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18800b5880 msgr2=0x7f18800b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18800b5880 0x7f18800b3ec0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f18680b0040 tx=0x7f18680a5580 comp rx=0 tx=0).stop 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 shutdown_connections 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f185c073200 0x7f185c075710 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f188015bfe0 0x7f18800b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18800b5880 0x7f18800b3ec0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 --2- 172.21.15.44:0/1449538487 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1880070610 0x7f188015b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.296+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 >> 172.21.15.44:0/1449538487 conn(0x7f18800ccaa0 msgr2=0x7f18800b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.300+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 shutdown_connections 2024-09-17T05:45:55.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.300+0000 7f1887800640 1 -- 172.21.15.44:0/1449538487 wait complete. 2024-09-17T05:45:55.320 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:55.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 -- 172.21.15.44:0/2271365165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 msgr2=0x7f2cec15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 --2- 172.21.15.44:0/2271365165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15b260 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0cfb20 tx=0x7f2ce401c890 comp rx=0 tx=0).stop 2024-09-17T05:45:55.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 -- 172.21.15.44:0/2271365165 shutdown_connections 2024-09-17T05:45:55.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 --2- 172.21.15.44:0/2271365165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15b260 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 --2- 172.21.15.44:0/2271365165 >> v2:172.21.15.86:3300/0 conn(0x7f2cec0cf360 0x7f2cec15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 -- 172.21.15.44:0/2271365165 >> 172.21.15.44:0/2271365165 conn(0x7f2cec0ccaa0 msgr2=0x7f2cec0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:55.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 -- 172.21.15.44:0/2271365165 shutdown_connections 2024-09-17T05:45:55.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.476+0000 7f2cf2600640 1 -- 172.21.15.44:0/2271365165 wait complete. 2024-09-17T05:45:55.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 Processor -- start 2024-09-17T05:45:55.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 -- start start 2024-09-17T05:45:55.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec0cac30 0x7f2cec15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec0cf360 0x7f2cec09f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec167c60 con 0x7f2cec0cb040 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec15c0a0 con 0x7f2cec0cf360 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cf2600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec167de0 con 0x7f2cec0cac30 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46620/0 (socket says 172.21.15.44:46620) 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 -- 172.21.15.44:0/1693866115 learned_addr learned my addr 172.21.15.44:0/1693866115 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ceb400640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec0cac30 0x7f2cec15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2cebe00640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec0cf360 0x7f2cec09f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 -- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec0cac30 msgr2=0x7f2cec15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec0cac30 0x7f2cec15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 -- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec0cf360 msgr2=0x7f2cec09f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec0cf360 0x7f2cec09f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.480+0000 7f2ce2a00640 1 -- 172.21.15.44:0/1693866115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec1f9bb0 con 0x7f2cec0cb040 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2ce2a00640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15d740 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400eac0 tx=0x7f2cd400ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2ce3e00640 1 -- 172.21.15.44:0/1693866115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd400cc80 con 0x7f2cec0cb040 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2ce3e00640 1 -- 172.21.15.44:0/1693866115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cd4005020 con 0x7f2cec0cb040 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2ce3e00640 1 -- 172.21.15.44:0/1693866115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4005470 con 0x7f2cec0cb040 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec0b5ca0 con 0x7f2cec0cb040 2024-09-17T05:45:55.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec1fa150 con 0x7f2cec0cb040 2024-09-17T05:45:55.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec0b5a10 con 0x7f2cec0cb040 2024-09-17T05:45:55.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2ce3e00640 1 -- 172.21.15.44:0/1693866115 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2cd40047b0 con 0x7f2cec0cb040 2024-09-17T05:45:55.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2ce3e00640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2cc8073230 0x7f2cc8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.484+0000 7f2ce3e00640 1 -- 172.21.15.44:0/1693866115 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7f2cd4094760 con 0x7f2cec0cb040 2024-09-17T05:45:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.488+0000 7f2ceb400640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2cc8073230 0x7f2cc8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.488+0000 7f2ceb400640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2cc8073230 0x7f2cc8075740 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0cddc0 tx=0x7f2cdc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:55.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.492+0000 7f2ce3e00640 1 -- 172.21.15.44:0/1693866115 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2cd405f680 con 0x7f2cec0cb040 2024-09-17T05:45:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.664+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cec0cec50 con 0x7f2cec0cb040 2024-09-17T05:45:55.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.664+0000 7f2ce3e00640 1 -- 172.21.15.44:0/1693866115 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16981 (secure 0 0 0) 0x7f2cd405ef80 con 0x7f2cec0cb040 2024-09-17T05:45:55.665 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:55.666 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":118,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:45:54.297970+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:52.041779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:53.267006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:55.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2cc8073230 msgr2=0x7f2cc8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2cc8073230 0x7f2cc8075740 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0cddc0 tx=0x7f2cdc009040 comp rx=0 tx=0).stop 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 msgr2=0x7f2cec15d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15d740 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400eac0 tx=0x7f2cd400ef80 comp rx=0 tx=0).stop 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 shutdown_connections 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2cc8073230 0x7f2cc8075740 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2cec0cf360 0x7f2cec09f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cec0cb040 0x7f2cec15d740 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 --2- 172.21.15.44:0/1693866115 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2cec0cac30 0x7f2cec15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 >> 172.21.15.44:0/1693866115 conn(0x7f2cec0ccaa0 msgr2=0x7f2cec1579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 shutdown_connections 2024-09-17T05:45:55.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.668+0000 7f2cf2600640 1 -- 172.21.15.44:0/1693866115 wait complete. 2024-09-17T05:45:55.688 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.848+0000 7fe40c200640 1 -- 172.21.15.44:0/50824481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 msgr2=0x7fe4040cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.848+0000 7fe40c200640 1 --2- 172.21.15.44:0/50824481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe4040cf070 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009930 tx=0x7fe3f001c820 comp rx=0 tx=0).stop 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.848+0000 7fe40c200640 1 -- 172.21.15.44:0/50824481 shutdown_connections 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.848+0000 7fe40c200640 1 --2- 172.21.15.44:0/50824481 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4040cf5b0 0x7fe40415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.848+0000 7fe40c200640 1 --2- 172.21.15.44:0/50824481 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe4040cf070 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.848+0000 7fe40c200640 1 -- 172.21.15.44:0/50824481 >> 172.21.15.44:0/50824481 conn(0x7fe4040b4240 msgr2=0x7fe4040b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.848+0000 7fe40c200640 1 -- 172.21.15.44:0/50824481 shutdown_connections 2024-09-17T05:45:55.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 -- 172.21.15.44:0/50824481 wait complete. 2024-09-17T05:45:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 Processor -- start 2024-09-17T05:45:55.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 -- start start 2024-09-17T05:45:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4040cf5b0 0x7fe4040cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4040d18f0 0x7fe404157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe404152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe404169e80 con 0x7fe4040d1d00 2024-09-17T05:45:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe404169d00 con 0x7fe4040cf5b0 2024-09-17T05:45:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40c200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe40416a000 con 0x7fe4040d18f0 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe404152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.852+0000 7fe40a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe404152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46642/0 (socket says 172.21.15.44:46642) 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40a200640 1 -- 172.21.15.44:0/3930302466 learned_addr learned my addr 172.21.15.44:0/3930302466 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe409800640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4040cf5b0 0x7fe4040cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe408e00640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4040d18f0 0x7fe404157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40a200640 1 -- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4040d18f0 msgr2=0x7fe404157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40a200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4040d18f0 0x7fe404157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40a200640 1 -- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4040cf5b0 msgr2=0x7fe4040cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40a200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4040cf5b0 0x7fe4040cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40a200640 1 -- 172.21.15.44:0/3930302466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe404152db0 con 0x7fe4040d1d00 2024-09-17T05:45:55.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe409800640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4040cf5b0 0x7fe4040cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40a200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe404152050 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00e970 tx=0x7fe3fc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe401600640 1 -- 172.21.15.44:0/3930302466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc004d30 con 0x7fe4040d1d00 2024-09-17T05:45:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe401600640 1 -- 172.21.15.44:0/3930302466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3fc00cb20 con 0x7fe4040d1d00 2024-09-17T05:45:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe401600640 1 -- 172.21.15.44:0/3930302466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc005020 con 0x7fe4040d1d00 2024-09-17T05:45:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40406eae0 con 0x7fe4040d1d00 2024-09-17T05:45:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40406edc0 con 0x7fe4040d1d00 2024-09-17T05:45:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe404158310 con 0x7fe4040d1d00 2024-09-17T05:45:55.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.856+0000 7fe401600640 1 -- 172.21.15.44:0/3930302466 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe3fc0051c0 con 0x7fe4040d1d00 2024-09-17T05:45:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.860+0000 7fe401600640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe3e4073200 0x7fe3e4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.860+0000 7fe401600640 1 -- 172.21.15.44:0/3930302466 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 6101+0+0 (secure 0 0 0) 0x7fe3fc094c90 con 0x7fe4040d1d00 2024-09-17T05:45:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.860+0000 7fe409800640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe3e4073200 0x7fe3e4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:55.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.860+0000 7fe409800640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe3e4073200 0x7fe3e4075710 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cfc60 tx=0x7fe3f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:55.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:55.864+0000 7fe401600640 1 -- 172.21.15.44:0/3930302466 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fe3fc016030 con 0x7fe4040d1d00 2024-09-17T05:45:56.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.076+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe40415d060 con 0x7fe4040d1d00 2024-09-17T05:45:56.865 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:45:56.864+0000 7f9739e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:45:56.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.908+0000 7fe401600640 1 -- 172.21.15.44:0/3930302466 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v99) ==== 118+0+0 (secure 0 0 0) 0x7fe3fc05fba0 con 0x7fe4040d1d00 2024-09-17T05:45:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe3e4073200 msgr2=0x7fe3e4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe3e4073200 0x7fe3e4075710 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cfc60 tx=0x7fe3f8009040 comp rx=0 tx=0).stop 2024-09-17T05:45:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 msgr2=0x7fe404152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe404152050 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc00e970 tx=0x7fe3fc00ee30 comp rx=0 tx=0).stop 2024-09-17T05:45:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 shutdown_connections 2024-09-17T05:45:56.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4040d1d00 0x7fe404152050 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:56.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe4040d18f0 0x7fe404157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:56.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe3e4073200 0x7fe3e4075710 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:56.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 --2- 172.21.15.44:0/3930302466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4040cf5b0 0x7fe4040cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:56.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 >> 172.21.15.44:0/3930302466 conn(0x7fe4040b4240 msgr2=0x7fe4040b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:56.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 shutdown_connections 2024-09-17T05:45:56.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:56.912+0000 7fe40c200640 1 -- 172.21.15.44:0/3930302466 wait complete. 2024-09-17T05:45:56.936 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:45:56.936 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:45:57.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.100+0000 7f8a14800640 1 -- 172.21.15.44:0/3284713238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d1d00 msgr2=0x7f8a0c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:57.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.100+0000 7f8a14800640 1 --2- 172.21.15.44:0/3284713238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d1d00 0x7f8a0c0cf070 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0d2110 tx=0x7f89fc01c740 comp rx=0 tx=0).stop 2024-09-17T05:45:57.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- 172.21.15.44:0/3284713238 shutdown_connections 2024-09-17T05:45:57.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 --2- 172.21.15.44:0/3284713238 >> v2:172.21.15.86:3300/0 conn(0x7f8a0c0cf5b0 0x7f8a0c15d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 --2- 172.21.15.44:0/3284713238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d1d00 0x7f8a0c0cf070 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- 172.21.15.44:0/3284713238 >> 172.21.15.44:0/3284713238 conn(0x7f8a0c0b4240 msgr2=0x7f8a0c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:57.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- 172.21.15.44:0/3284713238 shutdown_connections 2024-09-17T05:45:57.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- 172.21.15.44:0/3284713238 wait complete. 2024-09-17T05:45:57.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 Processor -- start 2024-09-17T05:45:57.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- start start 2024-09-17T05:45:57.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a0c0cf5b0 0x7f8a0c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:57.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d18f0 0x7f8a0c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:57.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0c0d1d00 0x7f8a0c151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:57.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c169d00 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c15db50 con 0x7f8a0c0d1d00 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a14800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0c169e80 con 0x7f8a0c0cf5b0 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a11400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d18f0 0x7f8a0c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.104+0000 7f8a11400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d18f0 0x7f8a0c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46662/0 (socket says 172.21.15.44:46662) 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11400640 1 -- 172.21.15.44:0/2685352919 learned_addr learned my addr 172.21.15.44:0/2685352919 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a12800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0c0d1d00 0x7f8a0c151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11e00640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a0c0cf5b0 0x7f8a0c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11400640 1 -- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a0c0cf5b0 msgr2=0x7f8a0c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11400640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a0c0cf5b0 0x7f8a0c158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11400640 1 -- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0c0d1d00 msgr2=0x7f8a0c151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11400640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0c0d1d00 0x7f8a0c151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11400640 1 -- 172.21.15.44:0/2685352919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c157bb0 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a12800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0c0d1d00 0x7f8a0c151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:57.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11e00640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a0c0cf5b0 0x7f8a0c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:57.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a11400640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d18f0 0x7f8a0c0cc0c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f89fc098320 tx=0x7f89fc005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:57.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a06000640 1 -- 172.21.15.44:0/2685352919 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0b2040 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a06000640 1 -- 172.21.15.44:0/2685352919 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89fc0bb070 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a06000640 1 -- 172.21.15.44:0/2685352919 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc003600 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c157e90 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c158450 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c15d060 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.108+0000 7f8a06000640 1 -- 172.21.15.44:0/2685352919 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89fc0037a0 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.112+0000 7f8a06000640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89f0073230 0x7f89f0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.112+0000 7f8a06000640 1 -- 172.21.15.44:0/2685352919 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f89fc12e970 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.112+0000 7f8a11e00640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89f0073230 0x7f89f0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:57.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.112+0000 7f8a11e00640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89f0073230 0x7f89f0075740 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8a00000f70 tx=0x7f8a00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.116+0000 7f8a06000640 1 -- 172.21.15.44:0/2685352919 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f89fc0163f0 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.324+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8a0c1fad50 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a06000640 1 -- 172.21.15.44:0/2685352919 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v100) ==== 122+0+0 (secure 0 0 0) 0x7f89fc0f97f0 con 0x7f8a0c0d18f0 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89f0073230 msgr2=0x7f89f0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89f0073230 0x7f89f0075740 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8a00000f70 tx=0x7f8a00009040 comp rx=0 tx=0).stop 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d18f0 msgr2=0x7f8a0c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d18f0 0x7f8a0c0cc0c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f89fc098320 tx=0x7f89fc005db0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 shutdown_connections 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f89f0073230 0x7f89f0075740 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a0c0d1d00 0x7f8a0c151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a0c0d18f0 0x7f8a0c0cc0c0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 --2- 172.21.15.44:0/2685352919 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8a0c0cf5b0 0x7f8a0c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 >> 172.21.15.44:0/2685352919 conn(0x7f8a0c0b4240 msgr2=0x7f8a0c0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:57.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 shutdown_connections 2024-09-17T05:45:57.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:57.912+0000 7f8a14800640 1 -- 172.21.15.44:0/2685352919 wait complete. 2024-09-17T05:45:57.938 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:45:57.938 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:45:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.096+0000 7feecb400640 1 -- 172.21.15.44:0/2205226164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 msgr2=0x7feec4160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 --2- 172.21.15.44:0/2205226164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4160010 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009900 tx=0x7feeb001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- 172.21.15.44:0/2205226164 shutdown_connections 2024-09-17T05:45:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 --2- 172.21.15.44:0/2205226164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4160010 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 --2- 172.21.15.44:0/2205226164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feec406dd30 0x7feec415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- 172.21.15.44:0/2205226164 >> 172.21.15.44:0/2205226164 conn(0x7feec40d1120 msgr2=0x7feec40d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:58.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- 172.21.15.44:0/2205226164 shutdown_connections 2024-09-17T05:45:58.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- 172.21.15.44:0/2205226164 wait complete. 2024-09-17T05:45:58.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 Processor -- start 2024-09-17T05:45:58.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- start start 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feec406dd30 0x7feec41f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4165580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feec4160550 0x7feec41f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feec4169a60 con 0x7feec40cf700 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feec41698e0 con 0x7feec406dd30 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.100+0000 7feecb400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7feec4169be0 con 0x7feec4160550 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4165580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4165580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46672/0 (socket says 172.21.15.44:46672) 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 -- 172.21.15.44:0/1397854108 learned_addr learned my addr 172.21.15.44:0/1397854108 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:58.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec8a00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feec406dd30 0x7feec41f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec9400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feec4160550 0x7feec41f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 -- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feec4160550 msgr2=0x7feec41f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feec4160550 0x7feec41f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 -- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feec406dd30 msgr2=0x7feec41f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feec406dd30 0x7feec41f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 -- 172.21.15.44:0/1397854108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec41f9ae0 con 0x7feec40cf700 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec8a00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feec406dd30 0x7feec41f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec9400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feec4160550 0x7feec41f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec3e00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4165580 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009850 tx=0x7feeb00a5560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec0c00640 1 -- 172.21.15.44:0/1397854108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb00b2040 con 0x7feec40cf700 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec41f8500 con 0x7feec40cf700 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec0c00640 1 -- 172.21.15.44:0/1397854108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb00043b0 con 0x7feec40cf700 2024-09-17T05:45:58.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec0c00640 1 -- 172.21.15.44:0/1397854108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0005270 con 0x7feec40cf700 2024-09-17T05:45:58.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec41f8ac0 con 0x7feec40cf700 2024-09-17T05:45:58.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec41f8270 con 0x7feec40cf700 2024-09-17T05:45:58.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.104+0000 7feec0c00640 1 -- 172.21.15.44:0/1397854108 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7feeb00bd060 con 0x7feec40cf700 2024-09-17T05:45:58.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.108+0000 7feec0c00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feea4073230 0x7feea4075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.108+0000 7feec0c00640 1 -- 172.21.15.44:0/1397854108 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7feeb012d860 con 0x7feec40cf700 2024-09-17T05:45:58.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.108+0000 7feec8a00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feea4073230 0x7feea4075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.108+0000 7feec8a00640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feea4073230 0x7feea4075740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feeb8005d10 tx=0x7feeb8005dc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.112+0000 7feec0c00640 1 -- 172.21.15.44:0/1397854108 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7feeb00164d0 con 0x7feec40cf700 2024-09-17T05:45:58.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feec40cb180 con 0x7feec40cf700 2024-09-17T05:45:58.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feec0c00640 1 -- 172.21.15.44:0/1397854108 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5227 (secure 0 0 0) 0x7feeb00f86f0 con 0x7feec40cf700 2024-09-17T05:45:58.320 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:58.320 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":100,"btime":"2024-09-17T05:45:57:912411+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:45:57.329223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8235":{"gid":8235,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1819525564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1819525564},{"type":"v1","addr":"172.21.15.44:6835","nonce":1819525564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8235,"qdb_cluster":[8235]},"id":8}]} 2024-09-17T05:45:58.321 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 100 2024-09-17T05:45:58.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feea4073230 msgr2=0x7feea4075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feea4073230 0x7feea4075740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feeb8005d10 tx=0x7feeb8005dc0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 msgr2=0x7feec4165580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4165580 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009850 tx=0x7feeb00a5560 comp rx=0 tx=0).stop 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 shutdown_connections 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7feec4160550 0x7feec41f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feec40cf700 0x7feec4165580 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7feea4073230 0x7feea4075740 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 --2- 172.21.15.44:0/1397854108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feec406dd30 0x7feec41f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 >> 172.21.15.44:0/1397854108 conn(0x7feec40d1120 msgr2=0x7feec40b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 shutdown_connections 2024-09-17T05:45:58.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.320+0000 7feecb400640 1 -- 172.21.15.44:0/1397854108 wait complete. 2024-09-17T05:45:58.344 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:45:58.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 -- 172.21.15.44:0/1750811096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 msgr2=0x7f78880b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 --2- 172.21.15.44:0/1750811096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 0x7f78880b20e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7880009bc0 tx=0x7f788001cae0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 -- 172.21.15.44:0/1750811096 shutdown_connections 2024-09-17T05:45:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 --2- 172.21.15.44:0/1750811096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 0x7f78880b20e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 --2- 172.21.15.44:0/1750811096 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f788815c900 0x7f78880b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 -- 172.21.15.44:0/1750811096 >> 172.21.15.44:0/1750811096 conn(0x7f78880d2000 msgr2=0x7f78880d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 -- 172.21.15.44:0/1750811096 shutdown_connections 2024-09-17T05:45:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.500+0000 7f7887e00640 1 -- 172.21.15.44:0/1750811096 wait complete. 2024-09-17T05:45:58.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 Processor -- start 2024-09-17T05:45:58.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 -- start start 2024-09-17T05:45:58.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 0x7f78880cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7888145c50 0x7f78881f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f788815c900 0x7f78880cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7888169c20 con 0x7f7888145c50 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7888169aa0 con 0x7f78880b4210 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7888169da0 con 0x7f788815c900 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f787fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7888145c50 0x7f78881f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f787fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7888145c50 0x7f78881f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46682/0 (socket says 172.21.15.44:46682) 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f787fe00640 1 -- 172.21.15.44:0/1159885830 learned_addr learned my addr 172.21.15.44:0/1159885830 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7886a00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 0x7f78880cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.504+0000 7f7887400640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f788815c900 0x7f78880cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787fe00640 1 -- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f788815c900 msgr2=0x7f78880cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787fe00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f788815c900 0x7f78880cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787fe00640 1 -- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 msgr2=0x7f78880cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787fe00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 0x7f78880cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787fe00640 1 -- 172.21.15.44:0/1159885830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78880ccb00 con 0x7f7888145c50 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787fe00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7888145c50 0x7f78881f87d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f787000e9c0 tx=0x7f787000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787ea00640 1 -- 172.21.15.44:0/1159885830 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787000cd80 con 0x7f7888145c50 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787ea00640 1 -- 172.21.15.44:0/1159885830 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7870004020 con 0x7f7888145c50 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78881f8d10 con 0x7f7888145c50 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787ea00640 1 -- 172.21.15.44:0/1159885830 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7870004450 con 0x7f7888145c50 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78881f9500 con 0x7f7888145c50 2024-09-17T05:45:58.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78880b20e0 con 0x7f7888145c50 2024-09-17T05:45:58.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.508+0000 7f787ea00640 1 -- 172.21.15.44:0/1159885830 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7870003600 con 0x7f7888145c50 2024-09-17T05:45:58.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.512+0000 7f787ea00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7864073200 0x7f7864075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.512+0000 7f787ea00640 1 -- 172.21.15.44:0/1159885830 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f7870094b90 con 0x7f7888145c50 2024-09-17T05:45:58.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.512+0000 7f7886a00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7864073200 0x7f7864075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.512+0000 7f7886a00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7864073200 0x7f7864075710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7878007fd0 tx=0x7f7878009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:58.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.516+0000 7f787ea00640 1 -- 172.21.15.44:0/1159885830 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f787005f450 con 0x7f7888145c50 2024-09-17T05:45:58.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.688+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78881f8fb0 con 0x7f7888145c50 2024-09-17T05:45:58.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f787ea00640 1 -- 172.21.15.44:0/1159885830 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16968 (secure 0 0 0) 0x7f7870063e80 con 0x7f7888145c50 2024-09-17T05:45:58.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:58.691 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":119,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:45:55.888742+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:52.041779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:53.267006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7864073200 msgr2=0x7f7864075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7864073200 0x7f7864075710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7878007fd0 tx=0x7f7878009040 comp rx=0 tx=0).stop 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7888145c50 msgr2=0x7f78881f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7888145c50 0x7f78881f87d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f787000e9c0 tx=0x7f787000ee80 comp rx=0 tx=0).stop 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 shutdown_connections 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f788815c900 0x7f78880cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7888145c50 0x7f78881f87d0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7864073200 0x7f7864075710 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 --2- 172.21.15.44:0/1159885830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f78880b4210 0x7f78880cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 >> 172.21.15.44:0/1159885830 conn(0x7f78880d2000 msgr2=0x7f78880c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:58.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 shutdown_connections 2024-09-17T05:45:58.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.692+0000 7f7887e00640 1 -- 172.21.15.44:0/1159885830 wait complete. 2024-09-17T05:45:58.715 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:45:58.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:45:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 -- 172.21.15.44:0/2930943122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc06f670 msgr2=0x7f29bc0cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 --2- 172.21.15.44:0/2930943122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc06f670 0x7f29bc0cff70 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f29bc06deb0 tx=0x7f29b401cd80 comp rx=0 tx=0).stop 2024-09-17T05:45:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 -- 172.21.15.44:0/2930943122 shutdown_connections 2024-09-17T05:45:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 --2- 172.21.15.44:0/2930943122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc06f670 0x7f29bc0cff70 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 --2- 172.21.15.44:0/2930943122 >> v2:172.21.15.86:3300/0 conn(0x7f29bc070c30 0x7f29bc144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 -- 172.21.15.44:0/2930943122 >> 172.21.15.44:0/2930943122 conn(0x7f29bc073ce0 msgr2=0x7f29bc0740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:58.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 -- 172.21.15.44:0/2930943122 shutdown_connections 2024-09-17T05:45:58.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.872+0000 7f29c2c00640 1 -- 172.21.15.44:0/2930943122 wait complete. 2024-09-17T05:45:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 Processor -- start 2024-09-17T05:45:58.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 -- start start 2024-09-17T05:45:58.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc070c30 0x7f29bc13e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29bc0ce190 0x7f29bc160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc15eb60 0x7f29bc15ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc1698f0 con 0x7f29bc15eb60 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc169770 con 0x7f29bc070c30 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f29bc169a70 con 0x7f29bc0ce190 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc15eb60 0x7f29bc15ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc15eb60 0x7f29bc15ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46770/0 (socket says 172.21.15.44:46770) 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 -- 172.21.15.44:0/1420339536 learned_addr learned my addr 172.21.15.44:0/1420339536 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c1800640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc070c30 0x7f29bc13e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c0e00640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29bc0ce190 0x7f29bc160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 -- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29bc0ce190 msgr2=0x7f29bc160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29bc0ce190 0x7f29bc160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 -- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc070c30 msgr2=0x7f29bc13e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:58.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc070c30 0x7f29bc13e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:58.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.876+0000 7f29c2200640 1 -- 172.21.15.44:0/1420339536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29bc15f4b0 con 0x7f29bc15eb60 2024-09-17T05:45:58.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29c2200640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc15eb60 0x7f29bc15ef70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f29b401b430 tx=0x7f29b4005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:58.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29b9600640 1 -- 172.21.15.44:0/1420339536 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b40bb070 con 0x7f29bc15eb60 2024-09-17T05:45:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29b9600640 1 -- 172.21.15.44:0/1420339536 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29b4004d40 con 0x7f29bc15eb60 2024-09-17T05:45:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29bc15b830 con 0x7f29bc15eb60 2024-09-17T05:45:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29b9600640 1 -- 172.21.15.44:0/1420339536 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b40b2040 con 0x7f29bc15eb60 2024-09-17T05:45:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29bc13c010 con 0x7f29bc15eb60 2024-09-17T05:45:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29bc13a220 con 0x7f29bc15eb60 2024-09-17T05:45:58.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29b9600640 1 -- 172.21.15.44:0/1420339536 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f29b40043a0 con 0x7f29bc15eb60 2024-09-17T05:45:58.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29b9600640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f299c073200 0x7f299c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:58.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.880+0000 7f29b9600640 1 -- 172.21.15.44:0/1420339536 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f29b412e4b0 con 0x7f29bc15eb60 2024-09-17T05:45:58.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.884+0000 7f29c1800640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f299c073200 0x7f299c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:58.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.884+0000 7f29c1800640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f299c073200 0x7f299c075710 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f29b0004630 tx=0x7f29b000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:58.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:58.888+0000 7f29b9600640 1 -- 172.21.15.44:0/1420339536 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f29bc13a220 con 0x7f29bc15eb60 2024-09-17T05:45:59.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.060+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29bc0cff70 con 0x7f299c073200 2024-09-17T05:45:59.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.064+0000 7f29b9600640 1 -- 172.21.15.44:0/1420339536 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f29bc0cff70 con 0x7f299c073200 2024-09-17T05:45:59.068 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:59.069 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:45:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f299c073200 msgr2=0x7f299c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f299c073200 0x7f299c075710 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f29b0004630 tx=0x7f29b000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc15eb60 msgr2=0x7f29bc15ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc15eb60 0x7f29bc15ef70 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f29b401b430 tx=0x7f29b4005b00 comp rx=0 tx=0).stop 2024-09-17T05:45:59.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 shutdown_connections 2024-09-17T05:45:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29bc15eb60 0x7f29bc15ef70 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f29bc0ce190 0x7f29bc160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f299c073200 0x7f299c075710 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 --2- 172.21.15.44:0/1420339536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29bc070c30 0x7f29bc13e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 >> 172.21.15.44:0/1420339536 conn(0x7f29bc073ce0 msgr2=0x7f29bc0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 shutdown_connections 2024-09-17T05:45:59.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.068+0000 7f29c2c00640 1 -- 172.21.15.44:0/1420339536 wait complete. 2024-09-17T05:45:59.089 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2024-09-17T05:45:58.425420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262180,"kb_used_data":12660,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712540,"statfs":{"total":773094113280,"available":772825640960,"internally_reserved":0,"allocated":12963840,"data_stored":6636968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.555341"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094199+0000","last_change":"2024-09-17T05:45:54.921071+0000","last_active":"2024-09-17T05:45:56.094199+0000","last_peered":"2024-09-17T05:45:56.094199+0000","last_clean":"2024-09-17T05:45:56.094199+0000","last_became_active":"2024-09-17T05:45:54.920490+0000","last_became_peered":"2024-09-17T05:45:54.920490+0000","last_unstale":"2024-09-17T05:45:56.094199+0000","last_undegraded":"2024-09-17T05:45:56.094199+0000","last_fullsized":"2024-09-17T05:45:56.094199+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:51.171701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094472+0000","last_change":"2024-09-17T05:45:54.919975+0000","last_active":"2024-09-17T05:45:56.094472+0000","last_peered":"2024-09-17T05:45:56.094472+0000","last_clean":"2024-09-17T05:45:56.094472+0000","last_became_active":"2024-09-17T05:45:54.919339+0000","last_became_peered":"2024-09-17T05:45:54.919339+0000","last_unstale":"2024-09-17T05:45:56.094472+0000","last_undegraded":"2024-09-17T05:45:56.094472+0000","last_fullsized":"2024-09-17T05:45:56.094472+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:20.240757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895108+0000","last_change":"2024-09-17T05:45:54.917881+0000","last_active":"2024-09-17T05:45:55.895108+0000","last_peered":"2024-09-17T05:45:55.895108+0000","last_clean":"2024-09-17T05:45:55.895108+0000","last_became_active":"2024-09-17T05:45:54.917314+0000","last_became_peered":"2024-09-17T05:45:54.917314+0000","last_unstale":"2024-09-17T05:45:55.895108+0000","last_undegraded":"2024-09-17T05:45:55.895108+0000","last_fullsized":"2024-09-17T05:45:55.895108+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:44.514477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893181+0000","last_change":"2024-09-17T05:45:54.910153+0000","last_active":"2024-09-17T05:45:55.893181+0000","last_peered":"2024-09-17T05:45:55.893181+0000","last_clean":"2024-09-17T05:45:55.893181+0000","last_became_active":"2024-09-17T05:45:54.909863+0000","last_became_peered":"2024-09-17T05:45:54.909863+0000","last_unstale":"2024-09-17T05:45:55.893181+0000","last_undegraded":"2024-09-17T05:45:55.893181+0000","last_fullsized":"2024-09-17T05:45:55.893181+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:04.156807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915268+0000","last_change":"2024-09-17T05:45:54.900571+0000","last_active":"2024-09-17T05:45:55.915268+0000","last_peered":"2024-09-17T05:45:55.915268+0000","last_clean":"2024-09-17T05:45:55.915268+0000","last_became_active":"2024-09-17T05:45:54.900043+0000","last_became_peered":"2024-09-17T05:45:54.900043+0000","last_unstale":"2024-09-17T05:45:55.915268+0000","last_undegraded":"2024-09-17T05:45:55.915268+0000","last_fullsized":"2024-09-17T05:45:55.915268+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:04.216940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093772+0000","last_change":"2024-09-17T05:45:54.919101+0000","last_active":"2024-09-17T05:45:56.093772+0000","last_peered":"2024-09-17T05:45:56.093772+0000","last_clean":"2024-09-17T05:45:56.093772+0000","last_became_active":"2024-09-17T05:45:54.918611+0000","last_became_peered":"2024-09-17T05:45:54.918611+0000","last_unstale":"2024-09-17T05:45:56.093772+0000","last_undegraded":"2024-09-17T05:45:56.093772+0000","last_fullsized":"2024-09-17T05:45:56.093772+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:07.030563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092833+0000","last_change":"2024-09-17T05:45:54.926029+0000","last_active":"2024-09-17T05:45:56.092833+0000","last_peered":"2024-09-17T05:45:56.092833+0000","last_clean":"2024-09-17T05:45:56.092833+0000","last_became_active":"2024-09-17T05:45:54.925586+0000","last_became_peered":"2024-09-17T05:45:54.925586+0000","last_unstale":"2024-09-17T05:45:56.092833+0000","last_undegraded":"2024-09-17T05:45:56.092833+0000","last_fullsized":"2024-09-17T05:45:56.092833+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:19.452378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093237+0000","last_change":"2024-09-17T05:45:54.898078+0000","last_active":"2024-09-17T05:45:56.093237+0000","last_peered":"2024-09-17T05:45:56.093237+0000","last_clean":"2024-09-17T05:45:56.093237+0000","last_became_active":"2024-09-17T05:45:54.897702+0000","last_became_peered":"2024-09-17T05:45:54.897702+0000","last_unstale":"2024-09-17T05:45:56.093237+0000","last_undegraded":"2024-09-17T05:45:56.093237+0000","last_fullsized":"2024-09-17T05:45:56.093237+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:31.748339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893398+0000","last_change":"2024-09-17T05:45:54.914489+0000","last_active":"2024-09-17T05:45:55.893398+0000","last_peered":"2024-09-17T05:45:55.893398+0000","last_clean":"2024-09-17T05:45:55.893398+0000","last_became_active":"2024-09-17T05:45:54.914217+0000","last_became_peered":"2024-09-17T05:45:54.914217+0000","last_unstale":"2024-09-17T05:45:55.893398+0000","last_undegraded":"2024-09-17T05:45:55.893398+0000","last_fullsized":"2024-09-17T05:45:55.893398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:52.113619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094289+0000","last_change":"2024-09-17T05:45:54.920339+0000","last_active":"2024-09-17T05:45:56.094289+0000","last_peered":"2024-09-17T05:45:56.094289+0000","last_clean":"2024-09-17T05:45:56.094289+0000","last_became_active":"2024-09-17T05:45:54.919749+0000","last_became_peered":"2024-09-17T05:45:54.919749+0000","last_unstale":"2024-09-17T05:45:56.094289+0000","last_undegraded":"2024-09-17T05:45:56.094289+0000","last_fullsized":"2024-09-17T05:45:56.094289+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:06.871843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094060+0000","last_change":"2024-09-17T05:45:54.917529+0000","last_active":"2024-09-17T05:45:56.094060+0000","last_peered":"2024-09-17T05:45:56.094060+0000","last_clean":"2024-09-17T05:45:56.094060+0000","last_became_active":"2024-09-17T05:45:54.917206+0000","last_became_peered":"2024-09-17T05:45:54.917206+0000","last_unstale":"2024-09-17T05:45:56.094060+0000","last_undegraded":"2024-09-17T05:45:56.094060+0000","last_fullsized":"2024-09-17T05:45:56.094060+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:04.832084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894523+0000","last_change":"2024-09-17T05:45:54.933172+0000","last_active":"2024-09-17T05:45:55.894523+0000","last_peered":"2024-09-17T05:45:55.894523+0000","last_clean":"2024-09-17T05:45:55.894523+0000","last_became_active":"2024-09-17T05:45:54.932765+0000","last_became_peered":"2024-09-17T05:45:54.932765+0000","last_unstale":"2024-09-17T05:45:55.894523+0000","last_undegraded":"2024-09-17T05:45:55.894523+0000","last_fullsized":"2024-09-17T05:45:55.894523+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:24.469804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094052+0000","last_change":"2024-09-17T05:45:54.918873+0000","last_active":"2024-09-17T05:45:56.094052+0000","last_peered":"2024-09-17T05:45:56.094052+0000","last_clean":"2024-09-17T05:45:56.094052+0000","last_became_active":"2024-09-17T05:45:54.918528+0000","last_became_peered":"2024-09-17T05:45:54.918528+0000","last_unstale":"2024-09-17T05:45:56.094052+0000","last_undegraded":"2024-09-17T05:45:56.094052+0000","last_fullsized":"2024-09-17T05:45:56.094052+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:01.526880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894915+0000","last_change":"2024-09-17T05:45:54.915579+0000","last_active":"2024-09-17T05:45:55.894915+0000","last_peered":"2024-09-17T05:45:55.894915+0000","last_clean":"2024-09-17T05:45:55.894915+0000","last_became_active":"2024-09-17T05:45:54.915234+0000","last_became_peered":"2024-09-17T05:45:54.915234+0000","last_unstale":"2024-09-17T05:45:55.894915+0000","last_undegraded":"2024-09-17T05:45:55.894915+0000","last_fullsized":"2024-09-17T05:45:55.894915+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:36.355746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093146+0000","last_change":"2024-09-17T05:45:54.902311+0000","last_active":"2024-09-17T05:45:56.093146+0000","last_peered":"2024-09-17T05:45:56.093146+0000","last_clean":"2024-09-17T05:45:56.093146+0000","last_became_active":"2024-09-17T05:45:54.901979+0000","last_became_peered":"2024-09-17T05:45:54.901979+0000","last_unstale":"2024-09-17T05:45:56.093146+0000","last_undegraded":"2024-09-17T05:45:56.093146+0000","last_fullsized":"2024-09-17T05:45:56.093146+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.310645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894060+0000","last_change":"2024-09-17T05:45:54.915972+0000","last_active":"2024-09-17T05:45:55.894060+0000","last_peered":"2024-09-17T05:45:55.894060+0000","last_clean":"2024-09-17T05:45:55.894060+0000","last_became_active":"2024-09-17T05:45:54.915630+0000","last_became_peered":"2024-09-17T05:45:54.915630+0000","last_unstale":"2024-09-17T05:45:55.894060+0000","last_undegraded":"2024-09-17T05:45:55.894060+0000","last_fullsized":"2024-09-17T05:45:55.894060+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:29.720730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895332+0000","last_change":"2024-09-17T05:45:54.920294+0000","last_active":"2024-09-17T05:45:55.895332+0000","last_peered":"2024-09-17T05:45:55.895332+0000","last_clean":"2024-09-17T05:45:55.895332+0000","last_became_active":"2024-09-17T05:45:54.919859+0000","last_became_peered":"2024-09-17T05:45:54.919859+0000","last_unstale":"2024-09-17T05:45:55.895332+0000","last_undegraded":"2024-09-17T05:45:55.895332+0000","last_fullsized":"2024-09-17T05:45:55.895332+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:38.710380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895197+0000","last_change":"2024-09-17T05:45:54.922925+0000","last_active":"2024-09-17T05:45:55.895197+0000","last_peered":"2024-09-17T05:45:55.895197+0000","last_clean":"2024-09-17T05:45:55.895197+0000","last_became_active":"2024-09-17T05:45:54.922508+0000","last_became_peered":"2024-09-17T05:45:54.922508+0000","last_unstale":"2024-09-17T05:45:55.895197+0000","last_undegraded":"2024-09-17T05:45:55.895197+0000","last_fullsized":"2024-09-17T05:45:55.895197+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:27.301159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915179+0000","last_change":"2024-09-17T05:45:54.922447+0000","last_active":"2024-09-17T05:45:55.915179+0000","last_peered":"2024-09-17T05:45:55.915179+0000","last_clean":"2024-09-17T05:45:55.915179+0000","last_became_active":"2024-09-17T05:45:54.920193+0000","last_became_peered":"2024-09-17T05:45:54.920193+0000","last_unstale":"2024-09-17T05:45:55.915179+0000","last_undegraded":"2024-09-17T05:45:55.915179+0000","last_fullsized":"2024-09-17T05:45:55.915179+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:23.070329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094107+0000","last_change":"2024-09-17T05:45:54.927602+0000","last_active":"2024-09-17T05:45:56.094107+0000","last_peered":"2024-09-17T05:45:56.094107+0000","last_clean":"2024-09-17T05:45:56.094107+0000","last_became_active":"2024-09-17T05:45:54.925747+0000","last_became_peered":"2024-09-17T05:45:54.925747+0000","last_unstale":"2024-09-17T05:45:56.094107+0000","last_undegraded":"2024-09-17T05:45:56.094107+0000","last_fullsized":"2024-09-17T05:45:56.094107+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:11.445572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915535+0000","last_change":"2024-09-17T05:45:54.912155+0000","last_active":"2024-09-17T05:45:55.915535+0000","last_peered":"2024-09-17T05:45:55.915535+0000","last_clean":"2024-09-17T05:45:55.915535+0000","last_became_active":"2024-09-17T05:45:54.910064+0000","last_became_peered":"2024-09-17T05:45:54.910064+0000","last_unstale":"2024-09-17T05:45:55.915535+0000","last_undegraded":"2024-09-17T05:45:55.915535+0000","last_fullsized":"2024-09-17T05:45:55.915535+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:36.842917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092951+0000","last_change":"2024-09-17T05:45:54.916536+0000","last_active":"2024-09-17T05:45:56.092951+0000","last_peered":"2024-09-17T05:45:56.092951+0000","last_clean":"2024-09-17T05:45:56.092951+0000","last_became_active":"2024-09-17T05:45:54.916176+0000","last_became_peered":"2024-09-17T05:45:54.916176+0000","last_unstale":"2024-09-17T05:45:56.092951+0000","last_undegraded":"2024-09-17T05:45:56.092951+0000","last_fullsized":"2024-09-17T05:45:56.092951+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:03.248138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092941+0000","last_change":"2024-09-17T05:45:54.902998+0000","last_active":"2024-09-17T05:45:56.092941+0000","last_peered":"2024-09-17T05:45:56.092941+0000","last_clean":"2024-09-17T05:45:56.092941+0000","last_became_active":"2024-09-17T05:45:54.902681+0000","last_became_peered":"2024-09-17T05:45:54.902681+0000","last_unstale":"2024-09-17T05:45:56.092941+0000","last_undegraded":"2024-09-17T05:45:56.092941+0000","last_fullsized":"2024-09-17T05:45:56.092941+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:33.440837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093085+0000","last_change":"2024-09-17T05:45:54.912973+0000","last_active":"2024-09-17T05:45:56.093085+0000","last_peered":"2024-09-17T05:45:56.093085+0000","last_clean":"2024-09-17T05:45:56.093085+0000","last_became_active":"2024-09-17T05:45:54.912682+0000","last_became_peered":"2024-09-17T05:45:54.912682+0000","last_unstale":"2024-09-17T05:45:56.093085+0000","last_undegraded":"2024-09-17T05:45:56.093085+0000","last_fullsized":"2024-09-17T05:45:56.093085+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:04.156807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094228+0000","last_change":"2024-09-17T05:45:54.920620+0000","last_active":"2024-09-17T05:45:56.094228+0000","last_peered":"2024-09-17T05:45:56.094228+0000","last_clean":"2024-09-17T05:45:56.094228+0000","last_became_active":"2024-09-17T05:45:54.920325+0000","last_became_peered":"2024-09-17T05:45:54.920325+0000","last_unstale":"2024-09-17T05:45:56.094228+0000","last_undegraded":"2024-09-17T05:45:56.094228+0000","last_fullsized":"2024-09-17T05:45:56.094228+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:43.875223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093063+0000","last_change":"2024-09-17T05:45:54.913578+0000","last_active":"2024-09-17T05:45:56.093063+0000","last_peered":"2024-09-17T05:45:56.093063+0000","last_clean":"2024-09-17T05:45:56.093063+0000","last_became_active":"2024-09-17T05:45:54.913191+0000","last_became_peered":"2024-09-17T05:45:54.913191+0000","last_unstale":"2024-09-17T05:45:56.093063+0000","last_undegraded":"2024-09-17T05:45:56.093063+0000","last_fullsized":"2024-09-17T05:45:56.093063+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:52.073367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915321+0000","last_change":"2024-09-17T05:45:54.923397+0000","last_active":"2024-09-17T05:45:55.915321+0000","last_peered":"2024-09-17T05:45:55.915321+0000","last_clean":"2024-09-17T05:45:55.915321+0000","last_became_active":"2024-09-17T05:45:54.923058+0000","last_became_peered":"2024-09-17T05:45:54.923058+0000","last_unstale":"2024-09-17T05:45:55.915321+0000","last_undegraded":"2024-09-17T05:45:55.915321+0000","last_fullsized":"2024-09-17T05:45:55.915321+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:59.407694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894568+0000","last_change":"2024-09-17T05:45:54.922867+0000","last_active":"2024-09-17T05:45:55.894568+0000","last_peered":"2024-09-17T05:45:55.894568+0000","last_clean":"2024-09-17T05:45:55.894568+0000","last_became_active":"2024-09-17T05:45:54.922484+0000","last_became_peered":"2024-09-17T05:45:54.922484+0000","last_unstale":"2024-09-17T05:45:55.894568+0000","last_undegraded":"2024-09-17T05:45:55.894568+0000","last_fullsized":"2024-09-17T05:45:55.894568+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:58.754005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894633+0000","last_change":"2024-09-17T05:45:54.921864+0000","last_active":"2024-09-17T05:45:55.894633+0000","last_peered":"2024-09-17T05:45:55.894633+0000","last_clean":"2024-09-17T05:45:55.894633+0000","last_became_active":"2024-09-17T05:45:54.921521+0000","last_became_peered":"2024-09-17T05:45:54.921521+0000","last_unstale":"2024-09-17T05:45:55.894633+0000","last_undegraded":"2024-09-17T05:45:55.894633+0000","last_fullsized":"2024-09-17T05:45:55.894633+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:48.154761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893270+0000","last_change":"2024-09-17T05:45:54.907484+0000","last_active":"2024-09-17T05:45:55.893270+0000","last_peered":"2024-09-17T05:45:55.893270+0000","last_clean":"2024-09-17T05:45:55.893270+0000","last_became_active":"2024-09-17T05:45:54.907102+0000","last_became_peered":"2024-09-17T05:45:54.907102+0000","last_unstale":"2024-09-17T05:45:55.893270+0000","last_undegraded":"2024-09-17T05:45:55.893270+0000","last_fullsized":"2024-09-17T05:45:55.893270+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:35.583675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093442+0000","last_change":"2024-09-17T05:45:54.917514+0000","last_active":"2024-09-17T05:45:56.093442+0000","last_peered":"2024-09-17T05:45:56.093442+0000","last_clean":"2024-09-17T05:45:56.093442+0000","last_became_active":"2024-09-17T05:45:54.917171+0000","last_became_peered":"2024-09-17T05:45:54.917171+0000","last_unstale":"2024-09-17T05:45:56.093442+0000","last_undegraded":"2024-09-17T05:45:56.093442+0000","last_fullsized":"2024-09-17T05:45:56.093442+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:11.565884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093478+0000","last_change":"2024-09-17T05:45:54.915957+0000","last_active":"2024-09-17T05:45:56.093478+0000","last_peered":"2024-09-17T05:45:56.093478+0000","last_clean":"2024-09-17T05:45:56.093478+0000","last_became_active":"2024-09-17T05:45:54.915630+0000","last_became_peered":"2024-09-17T05:45:54.915630+0000","last_unstale":"2024-09-17T05:45:56.093478+0000","last_undegraded":"2024-09-17T05:45:56.093478+0000","last_fullsized":"2024-09-17T05:45:56.093478+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:54.386533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093057+0000","last_change":"2024-09-17T05:45:54.908393+0000","last_active":"2024-09-17T05:45:56.093057+0000","last_peered":"2024-09-17T05:45:56.093057+0000","last_clean":"2024-09-17T05:45:56.093057+0000","last_became_active":"2024-09-17T05:45:54.908072+0000","last_became_peered":"2024-09-17T05:45:54.908072+0000","last_unstale":"2024-09-17T05:45:56.093057+0000","last_undegraded":"2024-09-17T05:45:56.093057+0000","last_fullsized":"2024-09-17T05:45:56.093057+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:01.133628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"118'4","reported_seq":19,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915906+0000","last_change":"2024-09-17T05:45:53.898290+0000","last_active":"2024-09-17T05:45:55.915906+0000","last_peered":"2024-09-17T05:45:55.915906+0000","last_clean":"2024-09-17T05:45:55.915906+0000","last_became_active":"2024-09-17T05:45:53.897939+0000","last_became_peered":"2024-09-17T05:45:53.897939+0000","last_unstale":"2024-09-17T05:45:55.915906+0000","last_undegraded":"2024-09-17T05:45:55.915906+0000","last_fullsized":"2024-09-17T05:45:55.915906+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:43.506700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094175+0000","last_change":"2024-09-17T05:45:54.914626+0000","last_active":"2024-09-17T05:45:56.094175+0000","last_peered":"2024-09-17T05:45:56.094175+0000","last_clean":"2024-09-17T05:45:56.094175+0000","last_became_active":"2024-09-17T05:45:54.914186+0000","last_became_peered":"2024-09-17T05:45:54.914186+0000","last_unstale":"2024-09-17T05:45:56.094175+0000","last_undegraded":"2024-09-17T05:45:56.094175+0000","last_fullsized":"2024-09-17T05:45:56.094175+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:25.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895062+0000","last_change":"2024-09-17T05:45:53.902832+0000","last_active":"2024-09-17T05:45:55.895062+0000","last_peered":"2024-09-17T05:45:55.895062+0000","last_clean":"2024-09-17T05:45:55.895062+0000","last_became_active":"2024-09-17T05:45:53.902179+0000","last_became_peered":"2024-09-17T05:45:53.902179+0000","last_unstale":"2024-09-17T05:45:55.895062+0000","last_undegraded":"2024-09-17T05:45:55.895062+0000","last_fullsized":"2024-09-17T05:45:55.895062+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:36.989185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093955+0000","last_change":"2024-09-17T05:45:54.918895+0000","last_active":"2024-09-17T05:45:56.093955+0000","last_peered":"2024-09-17T05:45:56.093955+0000","last_clean":"2024-09-17T05:45:56.093955+0000","last_became_active":"2024-09-17T05:45:54.917740+0000","last_became_peered":"2024-09-17T05:45:54.917740+0000","last_unstale":"2024-09-17T05:45:56.093955+0000","last_undegraded":"2024-09-17T05:45:56.093955+0000","last_fullsized":"2024-09-17T05:45:56.093955+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:05.917474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093578+0000","last_change":"2024-09-17T05:45:53.891396+0000","last_active":"2024-09-17T05:45:56.093578+0000","last_peered":"2024-09-17T05:45:56.093578+0000","last_clean":"2024-09-17T05:45:56.093578+0000","last_became_active":"2024-09-17T05:45:53.891088+0000","last_became_peered":"2024-09-17T05:45:53.891088+0000","last_unstale":"2024-09-17T05:45:56.093578+0000","last_undegraded":"2024-09-17T05:45:56.093578+0000","last_fullsized":"2024-09-17T05:45:56.093578+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.286628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893412+0000","last_change":"2024-09-17T05:45:54.913557+0000","last_active":"2024-09-17T05:45:55.893412+0000","last_peered":"2024-09-17T05:45:55.893412+0000","last_clean":"2024-09-17T05:45:55.893412+0000","last_became_active":"2024-09-17T05:45:54.913208+0000","last_became_peered":"2024-09-17T05:45:54.913208+0000","last_unstale":"2024-09-17T05:45:55.893412+0000","last_undegraded":"2024-09-17T05:45:55.893412+0000","last_fullsized":"2024-09-17T05:45:55.893412+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:01.526880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093957+0000","last_change":"2024-09-17T05:45:53.903534+0000","last_active":"2024-09-17T05:45:56.093957+0000","last_peered":"2024-09-17T05:45:56.093957+0000","last_clean":"2024-09-17T05:45:56.093957+0000","last_became_active":"2024-09-17T05:45:53.903118+0000","last_became_peered":"2024-09-17T05:45:53.903118+0000","last_unstale":"2024-09-17T05:45:56.093957+0000","last_undegraded":"2024-09-17T05:45:56.093957+0000","last_fullsized":"2024-09-17T05:45:56.093957+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:37.566216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093300+0000","last_change":"2024-09-17T05:45:54.919977+0000","last_active":"2024-09-17T05:45:56.093300+0000","last_peered":"2024-09-17T05:45:56.093300+0000","last_clean":"2024-09-17T05:45:56.093300+0000","last_became_active":"2024-09-17T05:45:54.919655+0000","last_became_peered":"2024-09-17T05:45:54.919655+0000","last_unstale":"2024-09-17T05:45:56.093300+0000","last_undegraded":"2024-09-17T05:45:56.093300+0000","last_fullsized":"2024-09-17T05:45:56.093300+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:42.153121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093720+0000","last_change":"2024-09-17T05:45:53.899455+0000","last_active":"2024-09-17T05:45:56.093720+0000","last_peered":"2024-09-17T05:45:56.093720+0000","last_clean":"2024-09-17T05:45:56.093720+0000","last_became_active":"2024-09-17T05:45:53.899139+0000","last_became_peered":"2024-09-17T05:45:53.899139+0000","last_unstale":"2024-09-17T05:45:56.093720+0000","last_undegraded":"2024-09-17T05:45:56.093720+0000","last_fullsized":"2024-09-17T05:45:56.093720+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:36.903640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093480+0000","last_change":"2024-09-17T05:45:54.918574+0000","last_active":"2024-09-17T05:45:56.093480+0000","last_peered":"2024-09-17T05:45:56.093480+0000","last_clean":"2024-09-17T05:45:56.093480+0000","last_became_active":"2024-09-17T05:45:54.916701+0000","last_became_peered":"2024-09-17T05:45:54.916701+0000","last_unstale":"2024-09-17T05:45:56.093480+0000","last_undegraded":"2024-09-17T05:45:56.093480+0000","last_fullsized":"2024-09-17T05:45:56.093480+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:50.677186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092842+0000","last_change":"2024-09-17T05:45:53.892900+0000","last_active":"2024-09-17T05:45:56.092842+0000","last_peered":"2024-09-17T05:45:56.092842+0000","last_clean":"2024-09-17T05:45:56.092842+0000","last_became_active":"2024-09-17T05:45:53.892530+0000","last_became_peered":"2024-09-17T05:45:53.892530+0000","last_unstale":"2024-09-17T05:45:56.092842+0000","last_undegraded":"2024-09-17T05:45:56.092842+0000","last_fullsized":"2024-09-17T05:45:56.092842+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:22.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893335+0000","last_change":"2024-09-17T05:45:54.915773+0000","last_active":"2024-09-17T05:45:55.893335+0000","last_peered":"2024-09-17T05:45:55.893335+0000","last_clean":"2024-09-17T05:45:55.893335+0000","last_became_active":"2024-09-17T05:45:54.915430+0000","last_became_peered":"2024-09-17T05:45:54.915430+0000","last_unstale":"2024-09-17T05:45:55.893335+0000","last_undegraded":"2024-09-17T05:45:55.893335+0000","last_fullsized":"2024-09-17T05:45:55.893335+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:02.645488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093573+0000","last_change":"2024-09-17T05:45:53.896105+0000","last_active":"2024-09-17T05:45:56.093573+0000","last_peered":"2024-09-17T05:45:56.093573+0000","last_clean":"2024-09-17T05:45:56.093573+0000","last_became_active":"2024-09-17T05:45:53.895255+0000","last_became_peered":"2024-09-17T05:45:53.895255+0000","last_unstale":"2024-09-17T05:45:56.093573+0000","last_undegraded":"2024-09-17T05:45:56.093573+0000","last_fullsized":"2024-09-17T05:45:56.093573+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:59.752178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093398+0000","last_change":"2024-09-17T05:45:54.902870+0000","last_active":"2024-09-17T05:45:56.093398+0000","last_peered":"2024-09-17T05:45:56.093398+0000","last_clean":"2024-09-17T05:45:56.093398+0000","last_became_active":"2024-09-17T05:45:54.902539+0000","last_became_peered":"2024-09-17T05:45:54.902539+0000","last_unstale":"2024-09-17T05:45:56.093398+0000","last_undegraded":"2024-09-17T05:45:56.093398+0000","last_fullsized":"2024-09-17T05:45:56.093398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:33.035561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893111+0000","last_change":"2024-09-17T05:45:53.901997+0000","last_active":"2024-09-17T05:45:55.893111+0000","last_peered":"2024-09-17T05:45:55.893111+0000","last_clean":"2024-09-17T05:45:55.893111+0000","last_became_active":"2024-09-17T05:45:53.901650+0000","last_became_peered":"2024-09-17T05:45:53.901650+0000","last_unstale":"2024-09-17T05:45:55.893111+0000","last_undegraded":"2024-09-17T05:45:55.893111+0000","last_fullsized":"2024-09-17T05:45:55.893111+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:10.490910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093233+0000","last_change":"2024-09-17T05:45:54.902312+0000","last_active":"2024-09-17T05:45:56.093233+0000","last_peered":"2024-09-17T05:45:56.093233+0000","last_clean":"2024-09-17T05:45:56.093233+0000","last_became_active":"2024-09-17T05:45:54.901957+0000","last_became_peered":"2024-09-17T05:45:54.901957+0000","last_unstale":"2024-09-17T05:45:56.093233+0000","last_undegraded":"2024-09-17T05:45:56.093233+0000","last_fullsized":"2024-09-17T05:45:56.093233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:50.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893467+0000","last_change":"2024-09-17T05:45:53.897775+0000","last_active":"2024-09-17T05:45:55.893467+0000","last_peered":"2024-09-17T05:45:55.893467+0000","last_clean":"2024-09-17T05:45:55.893467+0000","last_became_active":"2024-09-17T05:45:53.897314+0000","last_became_peered":"2024-09-17T05:45:53.897314+0000","last_unstale":"2024-09-17T05:45:55.893467+0000","last_undegraded":"2024-09-17T05:45:55.893467+0000","last_fullsized":"2024-09-17T05:45:55.893467+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.286628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893119+0000","last_change":"2024-09-17T05:45:54.910805+0000","last_active":"2024-09-17T05:45:55.893119+0000","last_peered":"2024-09-17T05:45:55.893119+0000","last_clean":"2024-09-17T05:45:55.893119+0000","last_became_active":"2024-09-17T05:45:54.910484+0000","last_became_peered":"2024-09-17T05:45:54.910484+0000","last_unstale":"2024-09-17T05:45:55.893119+0000","last_undegraded":"2024-09-17T05:45:55.893119+0000","last_fullsized":"2024-09-17T05:45:55.893119+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:11.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893104+0000","last_change":"2024-09-17T05:45:53.902288+0000","last_active":"2024-09-17T05:45:55.893104+0000","last_peered":"2024-09-17T05:45:55.893104+0000","last_clean":"2024-09-17T05:45:55.893104+0000","last_became_active":"2024-09-17T05:45:53.901991+0000","last_became_peered":"2024-09-17T05:45:53.901991+0000","last_unstale":"2024-09-17T05:45:55.893104+0000","last_undegraded":"2024-09-17T05:45:55.893104+0000","last_fullsized":"2024-09-17T05:45:55.893104+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:27.419278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895594+0000","last_change":"2024-09-17T05:45:54.908359+0000","last_active":"2024-09-17T05:45:55.895594+0000","last_peered":"2024-09-17T05:45:55.895594+0000","last_clean":"2024-09-17T05:45:55.895594+0000","last_became_active":"2024-09-17T05:45:54.908021+0000","last_became_peered":"2024-09-17T05:45:54.908021+0000","last_unstale":"2024-09-17T05:45:55.895594+0000","last_undegraded":"2024-09-17T05:45:55.895594+0000","last_fullsized":"2024-09-17T05:45:55.895594+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:02.355351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"118'3","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094060+0000","last_change":"2024-09-17T05:45:53.900355+0000","last_active":"2024-09-17T05:45:56.094060+0000","last_peered":"2024-09-17T05:45:56.094060+0000","last_clean":"2024-09-17T05:45:56.094060+0000","last_became_active":"2024-09-17T05:45:53.900002+0000","last_became_peered":"2024-09-17T05:45:53.900002+0000","last_unstale":"2024-09-17T05:45:56.094060+0000","last_undegraded":"2024-09-17T05:45:56.094060+0000","last_fullsized":"2024-09-17T05:45:56.094060+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:30.851950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915754+0000","last_change":"2024-09-17T05:45:54.911937+0000","last_active":"2024-09-17T05:45:55.915754+0000","last_peered":"2024-09-17T05:45:55.915754+0000","last_clean":"2024-09-17T05:45:55.915754+0000","last_became_active":"2024-09-17T05:45:54.911059+0000","last_became_peered":"2024-09-17T05:45:54.911059+0000","last_unstale":"2024-09-17T05:45:55.915754+0000","last_undegraded":"2024-09-17T05:45:55.915754+0000","last_fullsized":"2024-09-17T05:45:55.915754+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:19.452378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"118'6","reported_seq":21,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094131+0000","last_change":"2024-09-17T05:45:53.898869+0000","last_active":"2024-09-17T05:45:56.094131+0000","last_peered":"2024-09-17T05:45:56.094131+0000","last_clean":"2024-09-17T05:45:56.094131+0000","last_became_active":"2024-09-17T05:45:53.898403+0000","last_became_peered":"2024-09-17T05:45:53.898403+0000","last_unstale":"2024-09-17T05:45:56.094131+0000","last_undegraded":"2024-09-17T05:45:56.094131+0000","last_fullsized":"2024-09-17T05:45:56.094131+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:41.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.914942+0000","last_change":"2024-09-17T05:45:54.898536+0000","last_active":"2024-09-17T05:45:55.914942+0000","last_peered":"2024-09-17T05:45:55.914942+0000","last_clean":"2024-09-17T05:45:55.914942+0000","last_became_active":"2024-09-17T05:45:54.898005+0000","last_became_peered":"2024-09-17T05:45:54.898005+0000","last_unstale":"2024-09-17T05:45:55.914942+0000","last_undegraded":"2024-09-17T05:45:55.914942+0000","last_fullsized":"2024-09-17T05:45:55.914942+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:47.353351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093531+0000","last_change":"2024-09-17T05:45:53.897247+0000","last_active":"2024-09-17T05:45:56.093531+0000","last_peered":"2024-09-17T05:45:56.093531+0000","last_clean":"2024-09-17T05:45:56.093531+0000","last_became_active":"2024-09-17T05:45:53.896953+0000","last_became_peered":"2024-09-17T05:45:53.896953+0000","last_unstale":"2024-09-17T05:45:56.093531+0000","last_undegraded":"2024-09-17T05:45:56.093531+0000","last_fullsized":"2024-09-17T05:45:56.093531+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:41.512305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093383+0000","last_change":"2024-09-17T05:45:54.918393+0000","last_active":"2024-09-17T05:45:56.093383+0000","last_peered":"2024-09-17T05:45:56.093383+0000","last_clean":"2024-09-17T05:45:56.093383+0000","last_became_active":"2024-09-17T05:45:54.917614+0000","last_became_peered":"2024-09-17T05:45:54.917614+0000","last_unstale":"2024-09-17T05:45:56.093383+0000","last_undegraded":"2024-09-17T05:45:56.093383+0000","last_fullsized":"2024-09-17T05:45:56.093383+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:33.440837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893617+0000","last_change":"2024-09-17T05:45:53.895486+0000","last_active":"2024-09-17T05:45:55.893617+0000","last_peered":"2024-09-17T05:45:55.893617+0000","last_clean":"2024-09-17T05:45:55.893617+0000","last_became_active":"2024-09-17T05:45:53.894518+0000","last_became_peered":"2024-09-17T05:45:53.894518+0000","last_unstale":"2024-09-17T05:45:55.893617+0000","last_undegraded":"2024-09-17T05:45:55.893617+0000","last_fullsized":"2024-09-17T05:45:55.893617+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:54.597901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894640+0000","last_change":"2024-09-17T05:45:54.923032+0000","last_active":"2024-09-17T05:45:55.894640+0000","last_peered":"2024-09-17T05:45:55.894640+0000","last_clean":"2024-09-17T05:45:55.894640+0000","last_became_active":"2024-09-17T05:45:54.922121+0000","last_became_peered":"2024-09-17T05:45:54.922121+0000","last_unstale":"2024-09-17T05:45:55.894640+0000","last_undegraded":"2024-09-17T05:45:55.894640+0000","last_fullsized":"2024-09-17T05:45:55.894640+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:56.170468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092703+0000","last_change":"2024-09-17T05:45:53.897158+0000","last_active":"2024-09-17T05:45:56.092703+0000","last_peered":"2024-09-17T05:45:56.092703+0000","last_clean":"2024-09-17T05:45:56.092703+0000","last_became_active":"2024-09-17T05:45:53.896835+0000","last_became_peered":"2024-09-17T05:45:53.896835+0000","last_unstale":"2024-09-17T05:45:56.092703+0000","last_undegraded":"2024-09-17T05:45:56.092703+0000","last_fullsized":"2024-09-17T05:45:56.092703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:48.870036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893322+0000","last_change":"2024-09-17T05:45:54.897732+0000","last_active":"2024-09-17T05:45:55.893322+0000","last_peered":"2024-09-17T05:45:55.893322+0000","last_clean":"2024-09-17T05:45:55.893322+0000","last_became_active":"2024-09-17T05:45:54.897106+0000","last_became_peered":"2024-09-17T05:45:54.897106+0000","last_unstale":"2024-09-17T05:45:55.893322+0000","last_undegraded":"2024-09-17T05:45:55.893322+0000","last_fullsized":"2024-09-17T05:45:55.893322+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:59.644253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895296+0000","last_change":"2024-09-17T05:45:53.903612+0000","last_active":"2024-09-17T05:45:55.895296+0000","last_peered":"2024-09-17T05:45:55.895296+0000","last_clean":"2024-09-17T05:45:55.895296+0000","last_became_active":"2024-09-17T05:45:53.901872+0000","last_became_peered":"2024-09-17T05:45:53.901872+0000","last_unstale":"2024-09-17T05:45:55.895296+0000","last_undegraded":"2024-09-17T05:45:55.895296+0000","last_fullsized":"2024-09-17T05:45:55.895296+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:26.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093985+0000","last_change":"2024-09-17T05:45:54.917493+0000","last_active":"2024-09-17T05:45:56.093985+0000","last_peered":"2024-09-17T05:45:56.093985+0000","last_clean":"2024-09-17T05:45:56.093985+0000","last_became_active":"2024-09-17T05:45:54.916870+0000","last_became_peered":"2024-09-17T05:45:54.916870+0000","last_unstale":"2024-09-17T05:45:56.093985+0000","last_undegraded":"2024-09-17T05:45:56.093985+0000","last_fullsized":"2024-09-17T05:45:56.093985+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:14.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895200+0000","last_change":"2024-09-17T05:45:53.900192+0000","last_active":"2024-09-17T05:45:55.895200+0000","last_peered":"2024-09-17T05:45:55.895200+0000","last_clean":"2024-09-17T05:45:55.895200+0000","last_became_active":"2024-09-17T05:45:53.899872+0000","last_became_peered":"2024-09-17T05:45:53.899872+0000","last_unstale":"2024-09-17T05:45:55.895200+0000","last_undegraded":"2024-09-17T05:45:55.895200+0000","last_fullsized":"2024-09-17T05:45:55.895200+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:47.904819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094330+0000","last_change":"2024-09-17T05:45:54.920105+0000","last_active":"2024-09-17T05:45:56.094330+0000","last_peered":"2024-09-17T05:45:56.094330+0000","last_clean":"2024-09-17T05:45:56.094330+0000","last_became_active":"2024-09-17T05:45:54.919523+0000","last_became_peered":"2024-09-17T05:45:54.919523+0000","last_unstale":"2024-09-17T05:45:56.094330+0000","last_undegraded":"2024-09-17T05:45:56.094330+0000","last_fullsized":"2024-09-17T05:45:56.094330+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:44.393994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915255+0000","last_change":"2024-09-17T05:45:53.901686+0000","last_active":"2024-09-17T05:45:55.915255+0000","last_peered":"2024-09-17T05:45:55.915255+0000","last_clean":"2024-09-17T05:45:55.915255+0000","last_became_active":"2024-09-17T05:45:53.899892+0000","last_became_peered":"2024-09-17T05:45:53.899892+0000","last_unstale":"2024-09-17T05:45:55.915255+0000","last_undegraded":"2024-09-17T05:45:55.915255+0000","last_fullsized":"2024-09-17T05:45:55.915255+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:04.736595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915765+0000","last_change":"2024-09-17T05:45:54.903362+0000","last_active":"2024-09-17T05:45:55.915765+0000","last_peered":"2024-09-17T05:45:55.915765+0000","last_clean":"2024-09-17T05:45:55.915765+0000","last_became_active":"2024-09-17T05:45:54.903055+0000","last_became_peered":"2024-09-17T05:45:54.903055+0000","last_unstale":"2024-09-17T05:45:55.915765+0000","last_undegraded":"2024-09-17T05:45:55.915765+0000","last_fullsized":"2024-09-17T05:45:55.915765+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:14.433086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093972+0000","last_change":"2024-09-17T05:45:53.901781+0000","last_active":"2024-09-17T05:45:56.093972+0000","last_peered":"2024-09-17T05:45:56.093972+0000","last_clean":"2024-09-17T05:45:56.093972+0000","last_became_active":"2024-09-17T05:45:53.899234+0000","last_became_peered":"2024-09-17T05:45:53.899234+0000","last_unstale":"2024-09-17T05:45:56.093972+0000","last_undegraded":"2024-09-17T05:45:56.093972+0000","last_fullsized":"2024-09-17T05:45:56.093972+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:39.404864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092978+0000","last_change":"2024-09-17T05:45:54.921313+0000","last_active":"2024-09-17T05:45:56.092978+0000","last_peered":"2024-09-17T05:45:56.092978+0000","last_clean":"2024-09-17T05:45:56.092978+0000","last_became_active":"2024-09-17T05:45:54.921000+0000","last_became_peered":"2024-09-17T05:45:54.921000+0000","last_unstale":"2024-09-17T05:45:56.092978+0000","last_undegraded":"2024-09-17T05:45:56.092978+0000","last_fullsized":"2024-09-17T05:45:56.092978+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:14.433086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894073+0000","last_change":"2024-09-17T05:45:53.901202+0000","last_active":"2024-09-17T05:45:55.894073+0000","last_peered":"2024-09-17T05:45:55.894073+0000","last_clean":"2024-09-17T05:45:55.894073+0000","last_became_active":"2024-09-17T05:45:53.897996+0000","last_became_peered":"2024-09-17T05:45:53.897996+0000","last_unstale":"2024-09-17T05:45:55.894073+0000","last_undegraded":"2024-09-17T05:45:55.894073+0000","last_fullsized":"2024-09-17T05:45:55.894073+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:01.579907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894171+0000","last_change":"2024-09-17T05:45:54.925005+0000","last_active":"2024-09-17T05:45:55.894171+0000","last_peered":"2024-09-17T05:45:55.894171+0000","last_clean":"2024-09-17T05:45:55.894171+0000","last_became_active":"2024-09-17T05:45:54.924663+0000","last_became_peered":"2024-09-17T05:45:54.924663+0000","last_unstale":"2024-09-17T05:45:55.894171+0000","last_undegraded":"2024-09-17T05:45:55.894171+0000","last_fullsized":"2024-09-17T05:45:55.894171+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:51.871043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092913+0000","last_change":"2024-09-17T05:45:53.895705+0000","last_active":"2024-09-17T05:45:56.092913+0000","last_peered":"2024-09-17T05:45:56.092913+0000","last_clean":"2024-09-17T05:45:56.092913+0000","last_became_active":"2024-09-17T05:45:53.895394+0000","last_became_peered":"2024-09-17T05:45:53.895394+0000","last_unstale":"2024-09-17T05:45:56.092913+0000","last_undegraded":"2024-09-17T05:45:56.092913+0000","last_fullsized":"2024-09-17T05:45:56.092913+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:54.290760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893487+0000","last_change":"2024-09-17T05:45:54.919035+0000","last_active":"2024-09-17T05:45:55.893487+0000","last_peered":"2024-09-17T05:45:55.893487+0000","last_clean":"2024-09-17T05:45:55.893487+0000","last_became_active":"2024-09-17T05:45:54.918621+0000","last_became_peered":"2024-09-17T05:45:54.918621+0000","last_unstale":"2024-09-17T05:45:55.893487+0000","last_undegraded":"2024-09-17T05:45:55.893487+0000","last_fullsized":"2024-09-17T05:45:55.893487+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:05.744372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893111+0000","last_change":"2024-09-17T05:45:53.902130+0000","last_active":"2024-09-17T05:45:55.893111+0000","last_peered":"2024-09-17T05:45:55.893111+0000","last_clean":"2024-09-17T05:45:55.893111+0000","last_became_active":"2024-09-17T05:45:53.901796+0000","last_became_peered":"2024-09-17T05:45:53.901796+0000","last_unstale":"2024-09-17T05:45:55.893111+0000","last_undegraded":"2024-09-17T05:45:55.893111+0000","last_fullsized":"2024-09-17T05:45:55.893111+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:57.814247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093765+0000","last_change":"2024-09-17T05:45:54.919085+0000","last_active":"2024-09-17T05:45:56.093765+0000","last_peered":"2024-09-17T05:45:56.093765+0000","last_clean":"2024-09-17T05:45:56.093765+0000","last_became_active":"2024-09-17T05:45:54.918745+0000","last_became_peered":"2024-09-17T05:45:54.918745+0000","last_unstale":"2024-09-17T05:45:56.093765+0000","last_undegraded":"2024-09-17T05:45:56.093765+0000","last_fullsized":"2024-09-17T05:45:56.093765+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:26.109104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.914822+0000","last_change":"2024-09-17T05:45:53.904284+0000","last_active":"2024-09-17T05:45:55.914822+0000","last_peered":"2024-09-17T05:45:55.914822+0000","last_clean":"2024-09-17T05:45:55.914822+0000","last_became_active":"2024-09-17T05:45:53.903747+0000","last_became_peered":"2024-09-17T05:45:53.903747+0000","last_unstale":"2024-09-17T05:45:55.914822+0000","last_undegraded":"2024-09-17T05:45:55.914822+0000","last_fullsized":"2024-09-17T05:45:55.914822+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:46.053415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894758+0000","last_change":"2024-09-17T05:45:54.923680+0000","last_active":"2024-09-17T05:45:55.894758+0000","last_peered":"2024-09-17T05:45:55.894758+0000","last_clean":"2024-09-17T05:45:55.894758+0000","last_became_active":"2024-09-17T05:45:54.923340+0000","last_became_peered":"2024-09-17T05:45:54.923340+0000","last_unstale":"2024-09-17T05:45:55.894758+0000","last_undegraded":"2024-09-17T05:45:55.894758+0000","last_fullsized":"2024-09-17T05:45:55.894758+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:50.662399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094269+0000","last_change":"2024-09-17T05:45:53.899862+0000","last_active":"2024-09-17T05:45:56.094269+0000","last_peered":"2024-09-17T05:45:56.094269+0000","last_clean":"2024-09-17T05:45:56.094269+0000","last_became_active":"2024-09-17T05:45:53.899475+0000","last_became_peered":"2024-09-17T05:45:53.899475+0000","last_unstale":"2024-09-17T05:45:56.094269+0000","last_undegraded":"2024-09-17T05:45:56.094269+0000","last_fullsized":"2024-09-17T05:45:56.094269+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:27.586187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895178+0000","last_change":"2024-09-17T05:45:54.914564+0000","last_active":"2024-09-17T05:45:55.895178+0000","last_peered":"2024-09-17T05:45:55.895178+0000","last_clean":"2024-09-17T05:45:55.895178+0000","last_became_active":"2024-09-17T05:45:54.914207+0000","last_became_peered":"2024-09-17T05:45:54.914207+0000","last_unstale":"2024-09-17T05:45:55.895178+0000","last_undegraded":"2024-09-17T05:45:55.895178+0000","last_fullsized":"2024-09-17T05:45:55.895178+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:47.518902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"119'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.917190+0000","last_change":"2024-09-17T05:45:53.901463+0000","last_active":"2024-09-17T05:45:55.917190+0000","last_peered":"2024-09-17T05:45:55.917190+0000","last_clean":"2024-09-17T05:45:55.917190+0000","last_became_active":"2024-09-17T05:45:53.901136+0000","last_became_peered":"2024-09-17T05:45:53.901136+0000","last_unstale":"2024-09-17T05:45:55.917190+0000","last_undegraded":"2024-09-17T05:45:55.917190+0000","last_fullsized":"2024-09-17T05:45:55.917190+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:01.637710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893247+0000","last_change":"2024-09-17T05:45:54.898643+0000","last_active":"2024-09-17T05:45:55.893247+0000","last_peered":"2024-09-17T05:45:55.893247+0000","last_clean":"2024-09-17T05:45:55.893247+0000","last_became_active":"2024-09-17T05:45:54.898226+0000","last_became_peered":"2024-09-17T05:45:54.898226+0000","last_unstale":"2024-09-17T05:45:55.893247+0000","last_undegraded":"2024-09-17T05:45:55.893247+0000","last_fullsized":"2024-09-17T05:45:55.893247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:03.248138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915321+0000","last_change":"2024-09-17T05:45:53.900946+0000","last_active":"2024-09-17T05:45:55.915321+0000","last_peered":"2024-09-17T05:45:55.915321+0000","last_clean":"2024-09-17T05:45:55.915321+0000","last_became_active":"2024-09-17T05:45:53.900570+0000","last_became_peered":"2024-09-17T05:45:53.900570+0000","last_unstale":"2024-09-17T05:45:55.915321+0000","last_undegraded":"2024-09-17T05:45:55.915321+0000","last_fullsized":"2024-09-17T05:45:55.915321+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:47.146983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895639+0000","last_change":"2024-09-17T05:45:54.922174+0000","last_active":"2024-09-17T05:45:55.895639+0000","last_peered":"2024-09-17T05:45:55.895639+0000","last_clean":"2024-09-17T05:45:55.895639+0000","last_became_active":"2024-09-17T05:45:54.921760+0000","last_became_peered":"2024-09-17T05:45:54.921760+0000","last_unstale":"2024-09-17T05:45:55.895639+0000","last_undegraded":"2024-09-17T05:45:55.895639+0000","last_fullsized":"2024-09-17T05:45:55.895639+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:58.581397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894640+0000","last_change":"2024-09-17T05:45:53.891987+0000","last_active":"2024-09-17T05:45:55.894640+0000","last_peered":"2024-09-17T05:45:55.894640+0000","last_clean":"2024-09-17T05:45:55.894640+0000","last_became_active":"2024-09-17T05:45:53.891658+0000","last_became_peered":"2024-09-17T05:45:53.891658+0000","last_unstale":"2024-09-17T05:45:55.894640+0000","last_undegraded":"2024-09-17T05:45:55.894640+0000","last_fullsized":"2024-09-17T05:45:55.894640+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:46.726284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894005+0000","last_change":"2024-09-17T05:45:54.923564+0000","last_active":"2024-09-17T05:45:55.894005+0000","last_peered":"2024-09-17T05:45:55.894005+0000","last_clean":"2024-09-17T05:45:55.894005+0000","last_became_active":"2024-09-17T05:45:54.923105+0000","last_became_peered":"2024-09-17T05:45:54.923105+0000","last_unstale":"2024-09-17T05:45:55.894005+0000","last_undegraded":"2024-09-17T05:45:55.894005+0000","last_fullsized":"2024-09-17T05:45:55.894005+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:00.901538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915413+0000","last_change":"2024-09-17T05:45:53.896926+0000","last_active":"2024-09-17T05:45:55.915413+0000","last_peered":"2024-09-17T05:45:55.915413+0000","last_clean":"2024-09-17T05:45:55.915413+0000","last_became_active":"2024-09-17T05:45:53.896563+0000","last_became_peered":"2024-09-17T05:45:53.896563+0000","last_unstale":"2024-09-17T05:45:55.915413+0000","last_undegraded":"2024-09-17T05:45:55.915413+0000","last_fullsized":"2024-09-17T05:45:55.915413+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:34.575897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093121+0000","last_change":"2024-09-17T05:45:54.918621+0000","last_active":"2024-09-17T05:45:56.093121+0000","last_peered":"2024-09-17T05:45:56.093121+0000","last_clean":"2024-09-17T05:45:56.093121+0000","last_became_active":"2024-09-17T05:45:54.918069+0000","last_became_peered":"2024-09-17T05:45:54.918069+0000","last_unstale":"2024-09-17T05:45:56.093121+0000","last_undegraded":"2024-09-17T05:45:56.093121+0000","last_fullsized":"2024-09-17T05:45:56.093121+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.310645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093077+0000","last_change":"2024-09-17T05:45:53.887526+0000","last_active":"2024-09-17T05:45:56.093077+0000","last_peered":"2024-09-17T05:45:56.093077+0000","last_clean":"2024-09-17T05:45:56.093077+0000","last_became_active":"2024-09-17T05:45:53.887204+0000","last_became_peered":"2024-09-17T05:45:53.887204+0000","last_unstale":"2024-09-17T05:45:56.093077+0000","last_undegraded":"2024-09-17T05:45:56.093077+0000","last_fullsized":"2024-09-17T05:45:56.093077+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:08.923966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915038+0000","last_change":"2024-09-17T05:45:54.909359+0000","last_active":"2024-09-17T05:45:55.915038+0000","last_peered":"2024-09-17T05:45:55.915038+0000","last_clean":"2024-09-17T05:45:55.915038+0000","last_became_active":"2024-09-17T05:45:54.909049+0000","last_became_peered":"2024-09-17T05:45:54.909049+0000","last_unstale":"2024-09-17T05:45:55.915038+0000","last_undegraded":"2024-09-17T05:45:55.915038+0000","last_fullsized":"2024-09-17T05:45:55.915038+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:10.141165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093597+0000","last_change":"2024-09-17T05:45:53.900934+0000","last_active":"2024-09-17T05:45:56.093597+0000","last_peered":"2024-09-17T05:45:56.093597+0000","last_clean":"2024-09-17T05:45:56.093597+0000","last_became_active":"2024-09-17T05:45:53.900633+0000","last_became_peered":"2024-09-17T05:45:53.900633+0000","last_unstale":"2024-09-17T05:45:56.093597+0000","last_undegraded":"2024-09-17T05:45:56.093597+0000","last_fullsized":"2024-09-17T05:45:56.093597+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:55.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093634+0000","last_change":"2024-09-17T05:45:54.898300+0000","last_active":"2024-09-17T05:45:56.093634+0000","last_peered":"2024-09-17T05:45:56.093634+0000","last_clean":"2024-09-17T05:45:56.093634+0000","last_became_active":"2024-09-17T05:45:54.897946+0000","last_became_peered":"2024-09-17T05:45:54.897946+0000","last_unstale":"2024-09-17T05:45:56.093634+0000","last_undegraded":"2024-09-17T05:45:56.093634+0000","last_fullsized":"2024-09-17T05:45:56.093634+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:12.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.914962+0000","last_change":"2024-09-17T05:45:53.899245+0000","last_active":"2024-09-17T05:45:55.914962+0000","last_peered":"2024-09-17T05:45:55.914962+0000","last_clean":"2024-09-17T05:45:55.914962+0000","last_became_active":"2024-09-17T05:45:53.898312+0000","last_became_peered":"2024-09-17T05:45:53.898312+0000","last_unstale":"2024-09-17T05:45:55.914962+0000","last_undegraded":"2024-09-17T05:45:55.914962+0000","last_fullsized":"2024-09-17T05:45:55.914962+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:11.207715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915202+0000","last_change":"2024-09-17T05:45:54.908221+0000","last_active":"2024-09-17T05:45:55.915202+0000","last_peered":"2024-09-17T05:45:55.915202+0000","last_clean":"2024-09-17T05:45:55.915202+0000","last_became_active":"2024-09-17T05:45:54.907854+0000","last_became_peered":"2024-09-17T05:45:54.907854+0000","last_unstale":"2024-09-17T05:45:55.915202+0000","last_undegraded":"2024-09-17T05:45:55.915202+0000","last_fullsized":"2024-09-17T05:45:55.915202+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:09.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"118'8","reported_seq":23,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093332+0000","last_change":"2024-09-17T05:45:53.888441+0000","last_active":"2024-09-17T05:45:56.093332+0000","last_peered":"2024-09-17T05:45:56.093332+0000","last_clean":"2024-09-17T05:45:56.093332+0000","last_became_active":"2024-09-17T05:45:53.887726+0000","last_became_peered":"2024-09-17T05:45:53.887726+0000","last_unstale":"2024-09-17T05:45:56.093332+0000","last_undegraded":"2024-09-17T05:45:56.093332+0000","last_fullsized":"2024-09-17T05:45:56.093332+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:18.812111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":299,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092699+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:45:56.092699+0000","last_peered":"2024-09-17T05:45:56.092699+0000","last_clean":"2024-09-17T05:45:56.092699+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:45:56.092699+0000","last_undegraded":"2024-09-17T05:45:56.092699+0000","last_fullsized":"2024-09-17T05:45:56.092699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509562,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":680590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2068480,"data_stored":1272570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1470464,"data_stored":680646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1466368,"data_stored":680680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1478656,"data_stored":682784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2064384,"data_stored":1271118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1474560,"data_stored":681276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1478656,"data_stored":687304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:45:59.094 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:45:59.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.292+0000 7f1a24c00640 1 -- 172.21.15.44:0/28727957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a04003a40 msgr2=0x7f1a04003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.292+0000 7f1a24c00640 1 --2- 172.21.15.44:0/28727957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a04003a40 0x7f1a04003eb0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000c4a0 tx=0x7f1a1001cf30 comp rx=0 tx=0).stop 2024-09-17T05:45:59.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.292+0000 7f1a1e800640 1 -- 172.21.15.44:0/28727957 reap_dead start 2024-09-17T05:45:59.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.292+0000 7f1a24c00640 1 -- 172.21.15.44:0/28727957 shutdown_connections 2024-09-17T05:45:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.292+0000 7f1a24c00640 1 -- 172.21.15.44:0/28727957 >> 172.21.15.44:0/28727957 conn(0x7f1a200ccaa0 msgr2=0x7f1a200cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.292+0000 7f1a24c00640 1 -- 172.21.15.44:0/28727957 shutdown_connections 2024-09-17T05:45:59.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.292+0000 7f1a24c00640 1 -- 172.21.15.44:0/28727957 wait complete. 2024-09-17T05:45:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 Processor -- start 2024-09-17T05:45:59.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 -- start start 2024-09-17T05:45:59.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a04003a40 0x7f1a200c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a201f8a70 0x7f1a20165750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a201f8e80 0x7f1a20165c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20167ed0 con 0x7f1a201f8e80 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1a20167d50 con 0x7f1a04003a40 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a24c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1a20168050 con 0x7f1a201f8a70 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a201f8e80 0x7f1a20165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a201f8e80 0x7f1a20165c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46778/0 (socket says 172.21.15.44:46778) 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 -- 172.21.15.44:0/3112530025 learned_addr learned my addr 172.21.15.44:0/3112530025 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a17e00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a201f8a70 0x7f1a20165750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1de00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a04003a40 0x7f1a200c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 -- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a201f8a70 msgr2=0x7f1a20165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a201f8a70 0x7f1a20165750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 -- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a04003a40 msgr2=0x7f1a200c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a04003a40 0x7f1a200c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a1e800640 1 -- 172.21.15.44:0/3112530025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a200c4530 con 0x7f1a201f8e80 2024-09-17T05:45:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.296+0000 7f1a17e00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a201f8a70 0x7f1a20165750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:45:59.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a1e800640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a201f8e80 0x7f1a20165c90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006fd0 tx=0x7f1a18006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a16000640 1 -- 172.21.15.44:0/3112530025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18011900 con 0x7f1a201f8e80 2024-09-17T05:45:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a16000640 1 -- 172.21.15.44:0/3112530025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a18018070 con 0x7f1a201f8e80 2024-09-17T05:45:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a16000640 1 -- 172.21.15.44:0/3112530025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18011d60 con 0x7f1a201f8e80 2024-09-17T05:45:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a200c6710 con 0x7f1a201f8e80 2024-09-17T05:45:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a200c5a00 con 0x7f1a201f8e80 2024-09-17T05:45:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2015e990 con 0x7f1a201f8e80 2024-09-17T05:45:59.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.300+0000 7f1a16000640 1 -- 172.21.15.44:0/3112530025 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1a1801d460 con 0x7f1a201f8e80 2024-09-17T05:45:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.304+0000 7f1a16000640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19fc073200 0x7f19fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.304+0000 7f1a16000640 1 -- 172.21.15.44:0/3112530025 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f1a18094de0 con 0x7f1a201f8e80 2024-09-17T05:45:59.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.304+0000 7f1a1de00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19fc073200 0x7f19fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.304+0000 7f1a1de00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19fc073200 0x7f19fc075710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1a100aa000 tx=0x7f1a100b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:59.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.308+0000 7f1a16000640 1 -- 172.21.15.44:0/3112530025 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1a200c4530 con 0x7f1a201f8e80 2024-09-17T05:45:59.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.484+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a200b5fa0 con 0x7f19fc073200 2024-09-17T05:45:59.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.488+0000 7f1a16000640 1 -- 172.21.15.44:0/3112530025 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252473 (secure 0 0 0) 0x7f1a200b5fa0 con 0x7f19fc073200 2024-09-17T05:45:59.492 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:45:59.493 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19fc073200 msgr2=0x7f19fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19fc073200 0x7f19fc075710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1a100aa000 tx=0x7f1a100b1040 comp rx=0 tx=0).stop 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a201f8e80 msgr2=0x7f1a20165c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a201f8e80 0x7f1a20165c90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006fd0 tx=0x7f1a18006430 comp rx=0 tx=0).stop 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 shutdown_connections 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a201f8e80 0x7f1a20165c90 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a201f8a70 0x7f1a20165750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19fc073200 0x7f19fc075710 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 --2- 172.21.15.44:0/3112530025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a04003a40 0x7f1a200c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 >> 172.21.15.44:0/3112530025 conn(0x7f1a200ccaa0 msgr2=0x7f1a20166c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:59.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 shutdown_connections 2024-09-17T05:45:59.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.492+0000 7f1a24c00640 1 -- 172.21.15.44:0/3112530025 wait complete. 2024-09-17T05:45:59.514 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2024-09-17T05:45:58.425420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262180,"kb_used_data":12660,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712540,"statfs":{"total":773094113280,"available":772825640960,"internally_reserved":0,"allocated":12963840,"data_stored":6636968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.555341"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094199+0000","last_change":"2024-09-17T05:45:54.921071+0000","last_active":"2024-09-17T05:45:56.094199+0000","last_peered":"2024-09-17T05:45:56.094199+0000","last_clean":"2024-09-17T05:45:56.094199+0000","last_became_active":"2024-09-17T05:45:54.920490+0000","last_became_peered":"2024-09-17T05:45:54.920490+0000","last_unstale":"2024-09-17T05:45:56.094199+0000","last_undegraded":"2024-09-17T05:45:56.094199+0000","last_fullsized":"2024-09-17T05:45:56.094199+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:51.171701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094472+0000","last_change":"2024-09-17T05:45:54.919975+0000","last_active":"2024-09-17T05:45:56.094472+0000","last_peered":"2024-09-17T05:45:56.094472+0000","last_clean":"2024-09-17T05:45:56.094472+0000","last_became_active":"2024-09-17T05:45:54.919339+0000","last_became_peered":"2024-09-17T05:45:54.919339+0000","last_unstale":"2024-09-17T05:45:56.094472+0000","last_undegraded":"2024-09-17T05:45:56.094472+0000","last_fullsized":"2024-09-17T05:45:56.094472+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:20.240757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895108+0000","last_change":"2024-09-17T05:45:54.917881+0000","last_active":"2024-09-17T05:45:55.895108+0000","last_peered":"2024-09-17T05:45:55.895108+0000","last_clean":"2024-09-17T05:45:55.895108+0000","last_became_active":"2024-09-17T05:45:54.917314+0000","last_became_peered":"2024-09-17T05:45:54.917314+0000","last_unstale":"2024-09-17T05:45:55.895108+0000","last_undegraded":"2024-09-17T05:45:55.895108+0000","last_fullsized":"2024-09-17T05:45:55.895108+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:44.514477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893181+0000","last_change":"2024-09-17T05:45:54.910153+0000","last_active":"2024-09-17T05:45:55.893181+0000","last_peered":"2024-09-17T05:45:55.893181+0000","last_clean":"2024-09-17T05:45:55.893181+0000","last_became_active":"2024-09-17T05:45:54.909863+0000","last_became_peered":"2024-09-17T05:45:54.909863+0000","last_unstale":"2024-09-17T05:45:55.893181+0000","last_undegraded":"2024-09-17T05:45:55.893181+0000","last_fullsized":"2024-09-17T05:45:55.893181+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:04.156807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915268+0000","last_change":"2024-09-17T05:45:54.900571+0000","last_active":"2024-09-17T05:45:55.915268+0000","last_peered":"2024-09-17T05:45:55.915268+0000","last_clean":"2024-09-17T05:45:55.915268+0000","last_became_active":"2024-09-17T05:45:54.900043+0000","last_became_peered":"2024-09-17T05:45:54.900043+0000","last_unstale":"2024-09-17T05:45:55.915268+0000","last_undegraded":"2024-09-17T05:45:55.915268+0000","last_fullsized":"2024-09-17T05:45:55.915268+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:04.216940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093772+0000","last_change":"2024-09-17T05:45:54.919101+0000","last_active":"2024-09-17T05:45:56.093772+0000","last_peered":"2024-09-17T05:45:56.093772+0000","last_clean":"2024-09-17T05:45:56.093772+0000","last_became_active":"2024-09-17T05:45:54.918611+0000","last_became_peered":"2024-09-17T05:45:54.918611+0000","last_unstale":"2024-09-17T05:45:56.093772+0000","last_undegraded":"2024-09-17T05:45:56.093772+0000","last_fullsized":"2024-09-17T05:45:56.093772+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:07.030563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092833+0000","last_change":"2024-09-17T05:45:54.926029+0000","last_active":"2024-09-17T05:45:56.092833+0000","last_peered":"2024-09-17T05:45:56.092833+0000","last_clean":"2024-09-17T05:45:56.092833+0000","last_became_active":"2024-09-17T05:45:54.925586+0000","last_became_peered":"2024-09-17T05:45:54.925586+0000","last_unstale":"2024-09-17T05:45:56.092833+0000","last_undegraded":"2024-09-17T05:45:56.092833+0000","last_fullsized":"2024-09-17T05:45:56.092833+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:19.452378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093237+0000","last_change":"2024-09-17T05:45:54.898078+0000","last_active":"2024-09-17T05:45:56.093237+0000","last_peered":"2024-09-17T05:45:56.093237+0000","last_clean":"2024-09-17T05:45:56.093237+0000","last_became_active":"2024-09-17T05:45:54.897702+0000","last_became_peered":"2024-09-17T05:45:54.897702+0000","last_unstale":"2024-09-17T05:45:56.093237+0000","last_undegraded":"2024-09-17T05:45:56.093237+0000","last_fullsized":"2024-09-17T05:45:56.093237+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:31.748339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893398+0000","last_change":"2024-09-17T05:45:54.914489+0000","last_active":"2024-09-17T05:45:55.893398+0000","last_peered":"2024-09-17T05:45:55.893398+0000","last_clean":"2024-09-17T05:45:55.893398+0000","last_became_active":"2024-09-17T05:45:54.914217+0000","last_became_peered":"2024-09-17T05:45:54.914217+0000","last_unstale":"2024-09-17T05:45:55.893398+0000","last_undegraded":"2024-09-17T05:45:55.893398+0000","last_fullsized":"2024-09-17T05:45:55.893398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:52.113619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094289+0000","last_change":"2024-09-17T05:45:54.920339+0000","last_active":"2024-09-17T05:45:56.094289+0000","last_peered":"2024-09-17T05:45:56.094289+0000","last_clean":"2024-09-17T05:45:56.094289+0000","last_became_active":"2024-09-17T05:45:54.919749+0000","last_became_peered":"2024-09-17T05:45:54.919749+0000","last_unstale":"2024-09-17T05:45:56.094289+0000","last_undegraded":"2024-09-17T05:45:56.094289+0000","last_fullsized":"2024-09-17T05:45:56.094289+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:06.871843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094060+0000","last_change":"2024-09-17T05:45:54.917529+0000","last_active":"2024-09-17T05:45:56.094060+0000","last_peered":"2024-09-17T05:45:56.094060+0000","last_clean":"2024-09-17T05:45:56.094060+0000","last_became_active":"2024-09-17T05:45:54.917206+0000","last_became_peered":"2024-09-17T05:45:54.917206+0000","last_unstale":"2024-09-17T05:45:56.094060+0000","last_undegraded":"2024-09-17T05:45:56.094060+0000","last_fullsized":"2024-09-17T05:45:56.094060+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:04.832084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894523+0000","last_change":"2024-09-17T05:45:54.933172+0000","last_active":"2024-09-17T05:45:55.894523+0000","last_peered":"2024-09-17T05:45:55.894523+0000","last_clean":"2024-09-17T05:45:55.894523+0000","last_became_active":"2024-09-17T05:45:54.932765+0000","last_became_peered":"2024-09-17T05:45:54.932765+0000","last_unstale":"2024-09-17T05:45:55.894523+0000","last_undegraded":"2024-09-17T05:45:55.894523+0000","last_fullsized":"2024-09-17T05:45:55.894523+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:24.469804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094052+0000","last_change":"2024-09-17T05:45:54.918873+0000","last_active":"2024-09-17T05:45:56.094052+0000","last_peered":"2024-09-17T05:45:56.094052+0000","last_clean":"2024-09-17T05:45:56.094052+0000","last_became_active":"2024-09-17T05:45:54.918528+0000","last_became_peered":"2024-09-17T05:45:54.918528+0000","last_unstale":"2024-09-17T05:45:56.094052+0000","last_undegraded":"2024-09-17T05:45:56.094052+0000","last_fullsized":"2024-09-17T05:45:56.094052+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:01.526880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894915+0000","last_change":"2024-09-17T05:45:54.915579+0000","last_active":"2024-09-17T05:45:55.894915+0000","last_peered":"2024-09-17T05:45:55.894915+0000","last_clean":"2024-09-17T05:45:55.894915+0000","last_became_active":"2024-09-17T05:45:54.915234+0000","last_became_peered":"2024-09-17T05:45:54.915234+0000","last_unstale":"2024-09-17T05:45:55.894915+0000","last_undegraded":"2024-09-17T05:45:55.894915+0000","last_fullsized":"2024-09-17T05:45:55.894915+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:36.355746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093146+0000","last_change":"2024-09-17T05:45:54.902311+0000","last_active":"2024-09-17T05:45:56.093146+0000","last_peered":"2024-09-17T05:45:56.093146+0000","last_clean":"2024-09-17T05:45:56.093146+0000","last_became_active":"2024-09-17T05:45:54.901979+0000","last_became_peered":"2024-09-17T05:45:54.901979+0000","last_unstale":"2024-09-17T05:45:56.093146+0000","last_undegraded":"2024-09-17T05:45:56.093146+0000","last_fullsized":"2024-09-17T05:45:56.093146+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.310645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894060+0000","last_change":"2024-09-17T05:45:54.915972+0000","last_active":"2024-09-17T05:45:55.894060+0000","last_peered":"2024-09-17T05:45:55.894060+0000","last_clean":"2024-09-17T05:45:55.894060+0000","last_became_active":"2024-09-17T05:45:54.915630+0000","last_became_peered":"2024-09-17T05:45:54.915630+0000","last_unstale":"2024-09-17T05:45:55.894060+0000","last_undegraded":"2024-09-17T05:45:55.894060+0000","last_fullsized":"2024-09-17T05:45:55.894060+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:29.720730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895332+0000","last_change":"2024-09-17T05:45:54.920294+0000","last_active":"2024-09-17T05:45:55.895332+0000","last_peered":"2024-09-17T05:45:55.895332+0000","last_clean":"2024-09-17T05:45:55.895332+0000","last_became_active":"2024-09-17T05:45:54.919859+0000","last_became_peered":"2024-09-17T05:45:54.919859+0000","last_unstale":"2024-09-17T05:45:55.895332+0000","last_undegraded":"2024-09-17T05:45:55.895332+0000","last_fullsized":"2024-09-17T05:45:55.895332+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:38.710380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895197+0000","last_change":"2024-09-17T05:45:54.922925+0000","last_active":"2024-09-17T05:45:55.895197+0000","last_peered":"2024-09-17T05:45:55.895197+0000","last_clean":"2024-09-17T05:45:55.895197+0000","last_became_active":"2024-09-17T05:45:54.922508+0000","last_became_peered":"2024-09-17T05:45:54.922508+0000","last_unstale":"2024-09-17T05:45:55.895197+0000","last_undegraded":"2024-09-17T05:45:55.895197+0000","last_fullsized":"2024-09-17T05:45:55.895197+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:27.301159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915179+0000","last_change":"2024-09-17T05:45:54.922447+0000","last_active":"2024-09-17T05:45:55.915179+0000","last_peered":"2024-09-17T05:45:55.915179+0000","last_clean":"2024-09-17T05:45:55.915179+0000","last_became_active":"2024-09-17T05:45:54.920193+0000","last_became_peered":"2024-09-17T05:45:54.920193+0000","last_unstale":"2024-09-17T05:45:55.915179+0000","last_undegraded":"2024-09-17T05:45:55.915179+0000","last_fullsized":"2024-09-17T05:45:55.915179+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:23.070329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094107+0000","last_change":"2024-09-17T05:45:54.927602+0000","last_active":"2024-09-17T05:45:56.094107+0000","last_peered":"2024-09-17T05:45:56.094107+0000","last_clean":"2024-09-17T05:45:56.094107+0000","last_became_active":"2024-09-17T05:45:54.925747+0000","last_became_peered":"2024-09-17T05:45:54.925747+0000","last_unstale":"2024-09-17T05:45:56.094107+0000","last_undegraded":"2024-09-17T05:45:56.094107+0000","last_fullsized":"2024-09-17T05:45:56.094107+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:11.445572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915535+0000","last_change":"2024-09-17T05:45:54.912155+0000","last_active":"2024-09-17T05:45:55.915535+0000","last_peered":"2024-09-17T05:45:55.915535+0000","last_clean":"2024-09-17T05:45:55.915535+0000","last_became_active":"2024-09-17T05:45:54.910064+0000","last_became_peered":"2024-09-17T05:45:54.910064+0000","last_unstale":"2024-09-17T05:45:55.915535+0000","last_undegraded":"2024-09-17T05:45:55.915535+0000","last_fullsized":"2024-09-17T05:45:55.915535+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:36.842917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092951+0000","last_change":"2024-09-17T05:45:54.916536+0000","last_active":"2024-09-17T05:45:56.092951+0000","last_peered":"2024-09-17T05:45:56.092951+0000","last_clean":"2024-09-17T05:45:56.092951+0000","last_became_active":"2024-09-17T05:45:54.916176+0000","last_became_peered":"2024-09-17T05:45:54.916176+0000","last_unstale":"2024-09-17T05:45:56.092951+0000","last_undegraded":"2024-09-17T05:45:56.092951+0000","last_fullsized":"2024-09-17T05:45:56.092951+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:03.248138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092941+0000","last_change":"2024-09-17T05:45:54.902998+0000","last_active":"2024-09-17T05:45:56.092941+0000","last_peered":"2024-09-17T05:45:56.092941+0000","last_clean":"2024-09-17T05:45:56.092941+0000","last_became_active":"2024-09-17T05:45:54.902681+0000","last_became_peered":"2024-09-17T05:45:54.902681+0000","last_unstale":"2024-09-17T05:45:56.092941+0000","last_undegraded":"2024-09-17T05:45:56.092941+0000","last_fullsized":"2024-09-17T05:45:56.092941+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:33.440837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093085+0000","last_change":"2024-09-17T05:45:54.912973+0000","last_active":"2024-09-17T05:45:56.093085+0000","last_peered":"2024-09-17T05:45:56.093085+0000","last_clean":"2024-09-17T05:45:56.093085+0000","last_became_active":"2024-09-17T05:45:54.912682+0000","last_became_peered":"2024-09-17T05:45:54.912682+0000","last_unstale":"2024-09-17T05:45:56.093085+0000","last_undegraded":"2024-09-17T05:45:56.093085+0000","last_fullsized":"2024-09-17T05:45:56.093085+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:04.156807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094228+0000","last_change":"2024-09-17T05:45:54.920620+0000","last_active":"2024-09-17T05:45:56.094228+0000","last_peered":"2024-09-17T05:45:56.094228+0000","last_clean":"2024-09-17T05:45:56.094228+0000","last_became_active":"2024-09-17T05:45:54.920325+0000","last_became_peered":"2024-09-17T05:45:54.920325+0000","last_unstale":"2024-09-17T05:45:56.094228+0000","last_undegraded":"2024-09-17T05:45:56.094228+0000","last_fullsized":"2024-09-17T05:45:56.094228+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:43.875223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093063+0000","last_change":"2024-09-17T05:45:54.913578+0000","last_active":"2024-09-17T05:45:56.093063+0000","last_peered":"2024-09-17T05:45:56.093063+0000","last_clean":"2024-09-17T05:45:56.093063+0000","last_became_active":"2024-09-17T05:45:54.913191+0000","last_became_peered":"2024-09-17T05:45:54.913191+0000","last_unstale":"2024-09-17T05:45:56.093063+0000","last_undegraded":"2024-09-17T05:45:56.093063+0000","last_fullsized":"2024-09-17T05:45:56.093063+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:52.073367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915321+0000","last_change":"2024-09-17T05:45:54.923397+0000","last_active":"2024-09-17T05:45:55.915321+0000","last_peered":"2024-09-17T05:45:55.915321+0000","last_clean":"2024-09-17T05:45:55.915321+0000","last_became_active":"2024-09-17T05:45:54.923058+0000","last_became_peered":"2024-09-17T05:45:54.923058+0000","last_unstale":"2024-09-17T05:45:55.915321+0000","last_undegraded":"2024-09-17T05:45:55.915321+0000","last_fullsized":"2024-09-17T05:45:55.915321+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:59.407694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894568+0000","last_change":"2024-09-17T05:45:54.922867+0000","last_active":"2024-09-17T05:45:55.894568+0000","last_peered":"2024-09-17T05:45:55.894568+0000","last_clean":"2024-09-17T05:45:55.894568+0000","last_became_active":"2024-09-17T05:45:54.922484+0000","last_became_peered":"2024-09-17T05:45:54.922484+0000","last_unstale":"2024-09-17T05:45:55.894568+0000","last_undegraded":"2024-09-17T05:45:55.894568+0000","last_fullsized":"2024-09-17T05:45:55.894568+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:58.754005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894633+0000","last_change":"2024-09-17T05:45:54.921864+0000","last_active":"2024-09-17T05:45:55.894633+0000","last_peered":"2024-09-17T05:45:55.894633+0000","last_clean":"2024-09-17T05:45:55.894633+0000","last_became_active":"2024-09-17T05:45:54.921521+0000","last_became_peered":"2024-09-17T05:45:54.921521+0000","last_unstale":"2024-09-17T05:45:55.894633+0000","last_undegraded":"2024-09-17T05:45:55.894633+0000","last_fullsized":"2024-09-17T05:45:55.894633+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:48.154761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893270+0000","last_change":"2024-09-17T05:45:54.907484+0000","last_active":"2024-09-17T05:45:55.893270+0000","last_peered":"2024-09-17T05:45:55.893270+0000","last_clean":"2024-09-17T05:45:55.893270+0000","last_became_active":"2024-09-17T05:45:54.907102+0000","last_became_peered":"2024-09-17T05:45:54.907102+0000","last_unstale":"2024-09-17T05:45:55.893270+0000","last_undegraded":"2024-09-17T05:45:55.893270+0000","last_fullsized":"2024-09-17T05:45:55.893270+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:35.583675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093442+0000","last_change":"2024-09-17T05:45:54.917514+0000","last_active":"2024-09-17T05:45:56.093442+0000","last_peered":"2024-09-17T05:45:56.093442+0000","last_clean":"2024-09-17T05:45:56.093442+0000","last_became_active":"2024-09-17T05:45:54.917171+0000","last_became_peered":"2024-09-17T05:45:54.917171+0000","last_unstale":"2024-09-17T05:45:56.093442+0000","last_undegraded":"2024-09-17T05:45:56.093442+0000","last_fullsized":"2024-09-17T05:45:56.093442+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:30:11.565884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093478+0000","last_change":"2024-09-17T05:45:54.915957+0000","last_active":"2024-09-17T05:45:56.093478+0000","last_peered":"2024-09-17T05:45:56.093478+0000","last_clean":"2024-09-17T05:45:56.093478+0000","last_became_active":"2024-09-17T05:45:54.915630+0000","last_became_peered":"2024-09-17T05:45:54.915630+0000","last_unstale":"2024-09-17T05:45:56.093478+0000","last_undegraded":"2024-09-17T05:45:56.093478+0000","last_fullsized":"2024-09-17T05:45:56.093478+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:54.386533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093057+0000","last_change":"2024-09-17T05:45:54.908393+0000","last_active":"2024-09-17T05:45:56.093057+0000","last_peered":"2024-09-17T05:45:56.093057+0000","last_clean":"2024-09-17T05:45:56.093057+0000","last_became_active":"2024-09-17T05:45:54.908072+0000","last_became_peered":"2024-09-17T05:45:54.908072+0000","last_unstale":"2024-09-17T05:45:56.093057+0000","last_undegraded":"2024-09-17T05:45:56.093057+0000","last_fullsized":"2024-09-17T05:45:56.093057+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:43:01.133628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"118'4","reported_seq":19,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915906+0000","last_change":"2024-09-17T05:45:53.898290+0000","last_active":"2024-09-17T05:45:55.915906+0000","last_peered":"2024-09-17T05:45:55.915906+0000","last_clean":"2024-09-17T05:45:55.915906+0000","last_became_active":"2024-09-17T05:45:53.897939+0000","last_became_peered":"2024-09-17T05:45:53.897939+0000","last_unstale":"2024-09-17T05:45:55.915906+0000","last_undegraded":"2024-09-17T05:45:55.915906+0000","last_fullsized":"2024-09-17T05:45:55.915906+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:43.506700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094175+0000","last_change":"2024-09-17T05:45:54.914626+0000","last_active":"2024-09-17T05:45:56.094175+0000","last_peered":"2024-09-17T05:45:56.094175+0000","last_clean":"2024-09-17T05:45:56.094175+0000","last_became_active":"2024-09-17T05:45:54.914186+0000","last_became_peered":"2024-09-17T05:45:54.914186+0000","last_unstale":"2024-09-17T05:45:56.094175+0000","last_undegraded":"2024-09-17T05:45:56.094175+0000","last_fullsized":"2024-09-17T05:45:56.094175+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:25.328018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895062+0000","last_change":"2024-09-17T05:45:53.902832+0000","last_active":"2024-09-17T05:45:55.895062+0000","last_peered":"2024-09-17T05:45:55.895062+0000","last_clean":"2024-09-17T05:45:55.895062+0000","last_became_active":"2024-09-17T05:45:53.902179+0000","last_became_peered":"2024-09-17T05:45:53.902179+0000","last_unstale":"2024-09-17T05:45:55.895062+0000","last_undegraded":"2024-09-17T05:45:55.895062+0000","last_fullsized":"2024-09-17T05:45:55.895062+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:36.989185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093955+0000","last_change":"2024-09-17T05:45:54.918895+0000","last_active":"2024-09-17T05:45:56.093955+0000","last_peered":"2024-09-17T05:45:56.093955+0000","last_clean":"2024-09-17T05:45:56.093955+0000","last_became_active":"2024-09-17T05:45:54.917740+0000","last_became_peered":"2024-09-17T05:45:54.917740+0000","last_unstale":"2024-09-17T05:45:56.093955+0000","last_undegraded":"2024-09-17T05:45:56.093955+0000","last_fullsized":"2024-09-17T05:45:56.093955+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:05.917474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093578+0000","last_change":"2024-09-17T05:45:53.891396+0000","last_active":"2024-09-17T05:45:56.093578+0000","last_peered":"2024-09-17T05:45:56.093578+0000","last_clean":"2024-09-17T05:45:56.093578+0000","last_became_active":"2024-09-17T05:45:53.891088+0000","last_became_peered":"2024-09-17T05:45:53.891088+0000","last_unstale":"2024-09-17T05:45:56.093578+0000","last_undegraded":"2024-09-17T05:45:56.093578+0000","last_fullsized":"2024-09-17T05:45:56.093578+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.286628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893412+0000","last_change":"2024-09-17T05:45:54.913557+0000","last_active":"2024-09-17T05:45:55.893412+0000","last_peered":"2024-09-17T05:45:55.893412+0000","last_clean":"2024-09-17T05:45:55.893412+0000","last_became_active":"2024-09-17T05:45:54.913208+0000","last_became_peered":"2024-09-17T05:45:54.913208+0000","last_unstale":"2024-09-17T05:45:55.893412+0000","last_undegraded":"2024-09-17T05:45:55.893412+0000","last_fullsized":"2024-09-17T05:45:55.893412+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:01.526880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093957+0000","last_change":"2024-09-17T05:45:53.903534+0000","last_active":"2024-09-17T05:45:56.093957+0000","last_peered":"2024-09-17T05:45:56.093957+0000","last_clean":"2024-09-17T05:45:56.093957+0000","last_became_active":"2024-09-17T05:45:53.903118+0000","last_became_peered":"2024-09-17T05:45:53.903118+0000","last_unstale":"2024-09-17T05:45:56.093957+0000","last_undegraded":"2024-09-17T05:45:56.093957+0000","last_fullsized":"2024-09-17T05:45:56.093957+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:37.566216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093300+0000","last_change":"2024-09-17T05:45:54.919977+0000","last_active":"2024-09-17T05:45:56.093300+0000","last_peered":"2024-09-17T05:45:56.093300+0000","last_clean":"2024-09-17T05:45:56.093300+0000","last_became_active":"2024-09-17T05:45:54.919655+0000","last_became_peered":"2024-09-17T05:45:54.919655+0000","last_unstale":"2024-09-17T05:45:56.093300+0000","last_undegraded":"2024-09-17T05:45:56.093300+0000","last_fullsized":"2024-09-17T05:45:56.093300+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:42.153121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093720+0000","last_change":"2024-09-17T05:45:53.899455+0000","last_active":"2024-09-17T05:45:56.093720+0000","last_peered":"2024-09-17T05:45:56.093720+0000","last_clean":"2024-09-17T05:45:56.093720+0000","last_became_active":"2024-09-17T05:45:53.899139+0000","last_became_peered":"2024-09-17T05:45:53.899139+0000","last_unstale":"2024-09-17T05:45:56.093720+0000","last_undegraded":"2024-09-17T05:45:56.093720+0000","last_fullsized":"2024-09-17T05:45:56.093720+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:36.903640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093480+0000","last_change":"2024-09-17T05:45:54.918574+0000","last_active":"2024-09-17T05:45:56.093480+0000","last_peered":"2024-09-17T05:45:56.093480+0000","last_clean":"2024-09-17T05:45:56.093480+0000","last_became_active":"2024-09-17T05:45:54.916701+0000","last_became_peered":"2024-09-17T05:45:54.916701+0000","last_unstale":"2024-09-17T05:45:56.093480+0000","last_undegraded":"2024-09-17T05:45:56.093480+0000","last_fullsized":"2024-09-17T05:45:56.093480+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:50.677186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092842+0000","last_change":"2024-09-17T05:45:53.892900+0000","last_active":"2024-09-17T05:45:56.092842+0000","last_peered":"2024-09-17T05:45:56.092842+0000","last_clean":"2024-09-17T05:45:56.092842+0000","last_became_active":"2024-09-17T05:45:53.892530+0000","last_became_peered":"2024-09-17T05:45:53.892530+0000","last_unstale":"2024-09-17T05:45:56.092842+0000","last_undegraded":"2024-09-17T05:45:56.092842+0000","last_fullsized":"2024-09-17T05:45:56.092842+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:22.531819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893335+0000","last_change":"2024-09-17T05:45:54.915773+0000","last_active":"2024-09-17T05:45:55.893335+0000","last_peered":"2024-09-17T05:45:55.893335+0000","last_clean":"2024-09-17T05:45:55.893335+0000","last_became_active":"2024-09-17T05:45:54.915430+0000","last_became_peered":"2024-09-17T05:45:54.915430+0000","last_unstale":"2024-09-17T05:45:55.893335+0000","last_undegraded":"2024-09-17T05:45:55.893335+0000","last_fullsized":"2024-09-17T05:45:55.893335+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:02.645488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093573+0000","last_change":"2024-09-17T05:45:53.896105+0000","last_active":"2024-09-17T05:45:56.093573+0000","last_peered":"2024-09-17T05:45:56.093573+0000","last_clean":"2024-09-17T05:45:56.093573+0000","last_became_active":"2024-09-17T05:45:53.895255+0000","last_became_peered":"2024-09-17T05:45:53.895255+0000","last_unstale":"2024-09-17T05:45:56.093573+0000","last_undegraded":"2024-09-17T05:45:56.093573+0000","last_fullsized":"2024-09-17T05:45:56.093573+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:59.752178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093398+0000","last_change":"2024-09-17T05:45:54.902870+0000","last_active":"2024-09-17T05:45:56.093398+0000","last_peered":"2024-09-17T05:45:56.093398+0000","last_clean":"2024-09-17T05:45:56.093398+0000","last_became_active":"2024-09-17T05:45:54.902539+0000","last_became_peered":"2024-09-17T05:45:54.902539+0000","last_unstale":"2024-09-17T05:45:56.093398+0000","last_undegraded":"2024-09-17T05:45:56.093398+0000","last_fullsized":"2024-09-17T05:45:56.093398+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:33.035561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893111+0000","last_change":"2024-09-17T05:45:53.901997+0000","last_active":"2024-09-17T05:45:55.893111+0000","last_peered":"2024-09-17T05:45:55.893111+0000","last_clean":"2024-09-17T05:45:55.893111+0000","last_became_active":"2024-09-17T05:45:53.901650+0000","last_became_peered":"2024-09-17T05:45:53.901650+0000","last_unstale":"2024-09-17T05:45:55.893111+0000","last_undegraded":"2024-09-17T05:45:55.893111+0000","last_fullsized":"2024-09-17T05:45:55.893111+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:10.490910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093233+0000","last_change":"2024-09-17T05:45:54.902312+0000","last_active":"2024-09-17T05:45:56.093233+0000","last_peered":"2024-09-17T05:45:56.093233+0000","last_clean":"2024-09-17T05:45:56.093233+0000","last_became_active":"2024-09-17T05:45:54.901957+0000","last_became_peered":"2024-09-17T05:45:54.901957+0000","last_unstale":"2024-09-17T05:45:56.093233+0000","last_undegraded":"2024-09-17T05:45:56.093233+0000","last_fullsized":"2024-09-17T05:45:56.093233+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:50.190159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893467+0000","last_change":"2024-09-17T05:45:53.897775+0000","last_active":"2024-09-17T05:45:55.893467+0000","last_peered":"2024-09-17T05:45:55.893467+0000","last_clean":"2024-09-17T05:45:55.893467+0000","last_became_active":"2024-09-17T05:45:53.897314+0000","last_became_peered":"2024-09-17T05:45:53.897314+0000","last_unstale":"2024-09-17T05:45:55.893467+0000","last_undegraded":"2024-09-17T05:45:55.893467+0000","last_fullsized":"2024-09-17T05:45:55.893467+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.286628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893119+0000","last_change":"2024-09-17T05:45:54.910805+0000","last_active":"2024-09-17T05:45:55.893119+0000","last_peered":"2024-09-17T05:45:55.893119+0000","last_clean":"2024-09-17T05:45:55.893119+0000","last_became_active":"2024-09-17T05:45:54.910484+0000","last_became_peered":"2024-09-17T05:45:54.910484+0000","last_unstale":"2024-09-17T05:45:55.893119+0000","last_undegraded":"2024-09-17T05:45:55.893119+0000","last_fullsized":"2024-09-17T05:45:55.893119+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:11.567297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893104+0000","last_change":"2024-09-17T05:45:53.902288+0000","last_active":"2024-09-17T05:45:55.893104+0000","last_peered":"2024-09-17T05:45:55.893104+0000","last_clean":"2024-09-17T05:45:55.893104+0000","last_became_active":"2024-09-17T05:45:53.901991+0000","last_became_peered":"2024-09-17T05:45:53.901991+0000","last_unstale":"2024-09-17T05:45:55.893104+0000","last_undegraded":"2024-09-17T05:45:55.893104+0000","last_fullsized":"2024-09-17T05:45:55.893104+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:27.419278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895594+0000","last_change":"2024-09-17T05:45:54.908359+0000","last_active":"2024-09-17T05:45:55.895594+0000","last_peered":"2024-09-17T05:45:55.895594+0000","last_clean":"2024-09-17T05:45:55.895594+0000","last_became_active":"2024-09-17T05:45:54.908021+0000","last_became_peered":"2024-09-17T05:45:54.908021+0000","last_unstale":"2024-09-17T05:45:55.895594+0000","last_undegraded":"2024-09-17T05:45:55.895594+0000","last_fullsized":"2024-09-17T05:45:55.895594+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:02.355351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"118'3","reported_seq":18,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094060+0000","last_change":"2024-09-17T05:45:53.900355+0000","last_active":"2024-09-17T05:45:56.094060+0000","last_peered":"2024-09-17T05:45:56.094060+0000","last_clean":"2024-09-17T05:45:56.094060+0000","last_became_active":"2024-09-17T05:45:53.900002+0000","last_became_peered":"2024-09-17T05:45:53.900002+0000","last_unstale":"2024-09-17T05:45:56.094060+0000","last_undegraded":"2024-09-17T05:45:56.094060+0000","last_fullsized":"2024-09-17T05:45:56.094060+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:30.851950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915754+0000","last_change":"2024-09-17T05:45:54.911937+0000","last_active":"2024-09-17T05:45:55.915754+0000","last_peered":"2024-09-17T05:45:55.915754+0000","last_clean":"2024-09-17T05:45:55.915754+0000","last_became_active":"2024-09-17T05:45:54.911059+0000","last_became_peered":"2024-09-17T05:45:54.911059+0000","last_unstale":"2024-09-17T05:45:55.915754+0000","last_undegraded":"2024-09-17T05:45:55.915754+0000","last_fullsized":"2024-09-17T05:45:55.915754+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:19.452378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"118'6","reported_seq":21,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094131+0000","last_change":"2024-09-17T05:45:53.898869+0000","last_active":"2024-09-17T05:45:56.094131+0000","last_peered":"2024-09-17T05:45:56.094131+0000","last_clean":"2024-09-17T05:45:56.094131+0000","last_became_active":"2024-09-17T05:45:53.898403+0000","last_became_peered":"2024-09-17T05:45:53.898403+0000","last_unstale":"2024-09-17T05:45:56.094131+0000","last_undegraded":"2024-09-17T05:45:56.094131+0000","last_fullsized":"2024-09-17T05:45:56.094131+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:41.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.914942+0000","last_change":"2024-09-17T05:45:54.898536+0000","last_active":"2024-09-17T05:45:55.914942+0000","last_peered":"2024-09-17T05:45:55.914942+0000","last_clean":"2024-09-17T05:45:55.914942+0000","last_became_active":"2024-09-17T05:45:54.898005+0000","last_became_peered":"2024-09-17T05:45:54.898005+0000","last_unstale":"2024-09-17T05:45:55.914942+0000","last_undegraded":"2024-09-17T05:45:55.914942+0000","last_fullsized":"2024-09-17T05:45:55.914942+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:47.353351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093531+0000","last_change":"2024-09-17T05:45:53.897247+0000","last_active":"2024-09-17T05:45:56.093531+0000","last_peered":"2024-09-17T05:45:56.093531+0000","last_clean":"2024-09-17T05:45:56.093531+0000","last_became_active":"2024-09-17T05:45:53.896953+0000","last_became_peered":"2024-09-17T05:45:53.896953+0000","last_unstale":"2024-09-17T05:45:56.093531+0000","last_undegraded":"2024-09-17T05:45:56.093531+0000","last_fullsized":"2024-09-17T05:45:56.093531+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:41.512305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093383+0000","last_change":"2024-09-17T05:45:54.918393+0000","last_active":"2024-09-17T05:45:56.093383+0000","last_peered":"2024-09-17T05:45:56.093383+0000","last_clean":"2024-09-17T05:45:56.093383+0000","last_became_active":"2024-09-17T05:45:54.917614+0000","last_became_peered":"2024-09-17T05:45:54.917614+0000","last_unstale":"2024-09-17T05:45:56.093383+0000","last_undegraded":"2024-09-17T05:45:56.093383+0000","last_fullsized":"2024-09-17T05:45:56.093383+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:33.440837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893617+0000","last_change":"2024-09-17T05:45:53.895486+0000","last_active":"2024-09-17T05:45:55.893617+0000","last_peered":"2024-09-17T05:45:55.893617+0000","last_clean":"2024-09-17T05:45:55.893617+0000","last_became_active":"2024-09-17T05:45:53.894518+0000","last_became_peered":"2024-09-17T05:45:53.894518+0000","last_unstale":"2024-09-17T05:45:55.893617+0000","last_undegraded":"2024-09-17T05:45:55.893617+0000","last_fullsized":"2024-09-17T05:45:55.893617+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:54.597901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894640+0000","last_change":"2024-09-17T05:45:54.923032+0000","last_active":"2024-09-17T05:45:55.894640+0000","last_peered":"2024-09-17T05:45:55.894640+0000","last_clean":"2024-09-17T05:45:55.894640+0000","last_became_active":"2024-09-17T05:45:54.922121+0000","last_became_peered":"2024-09-17T05:45:54.922121+0000","last_unstale":"2024-09-17T05:45:55.894640+0000","last_undegraded":"2024-09-17T05:45:55.894640+0000","last_fullsized":"2024-09-17T05:45:55.894640+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:56.170468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092703+0000","last_change":"2024-09-17T05:45:53.897158+0000","last_active":"2024-09-17T05:45:56.092703+0000","last_peered":"2024-09-17T05:45:56.092703+0000","last_clean":"2024-09-17T05:45:56.092703+0000","last_became_active":"2024-09-17T05:45:53.896835+0000","last_became_peered":"2024-09-17T05:45:53.896835+0000","last_unstale":"2024-09-17T05:45:56.092703+0000","last_undegraded":"2024-09-17T05:45:56.092703+0000","last_fullsized":"2024-09-17T05:45:56.092703+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:48.870036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893322+0000","last_change":"2024-09-17T05:45:54.897732+0000","last_active":"2024-09-17T05:45:55.893322+0000","last_peered":"2024-09-17T05:45:55.893322+0000","last_clean":"2024-09-17T05:45:55.893322+0000","last_became_active":"2024-09-17T05:45:54.897106+0000","last_became_peered":"2024-09-17T05:45:54.897106+0000","last_unstale":"2024-09-17T05:45:55.893322+0000","last_undegraded":"2024-09-17T05:45:55.893322+0000","last_fullsized":"2024-09-17T05:45:55.893322+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:59.644253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895296+0000","last_change":"2024-09-17T05:45:53.903612+0000","last_active":"2024-09-17T05:45:55.895296+0000","last_peered":"2024-09-17T05:45:55.895296+0000","last_clean":"2024-09-17T05:45:55.895296+0000","last_became_active":"2024-09-17T05:45:53.901872+0000","last_became_peered":"2024-09-17T05:45:53.901872+0000","last_unstale":"2024-09-17T05:45:55.895296+0000","last_undegraded":"2024-09-17T05:45:55.895296+0000","last_fullsized":"2024-09-17T05:45:55.895296+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:26.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093985+0000","last_change":"2024-09-17T05:45:54.917493+0000","last_active":"2024-09-17T05:45:56.093985+0000","last_peered":"2024-09-17T05:45:56.093985+0000","last_clean":"2024-09-17T05:45:56.093985+0000","last_became_active":"2024-09-17T05:45:54.916870+0000","last_became_peered":"2024-09-17T05:45:54.916870+0000","last_unstale":"2024-09-17T05:45:56.093985+0000","last_undegraded":"2024-09-17T05:45:56.093985+0000","last_fullsized":"2024-09-17T05:45:56.093985+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:14.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895200+0000","last_change":"2024-09-17T05:45:53.900192+0000","last_active":"2024-09-17T05:45:55.895200+0000","last_peered":"2024-09-17T05:45:55.895200+0000","last_clean":"2024-09-17T05:45:55.895200+0000","last_became_active":"2024-09-17T05:45:53.899872+0000","last_became_peered":"2024-09-17T05:45:53.899872+0000","last_unstale":"2024-09-17T05:45:55.895200+0000","last_undegraded":"2024-09-17T05:45:55.895200+0000","last_fullsized":"2024-09-17T05:45:55.895200+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:47.904819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094330+0000","last_change":"2024-09-17T05:45:54.920105+0000","last_active":"2024-09-17T05:45:56.094330+0000","last_peered":"2024-09-17T05:45:56.094330+0000","last_clean":"2024-09-17T05:45:56.094330+0000","last_became_active":"2024-09-17T05:45:54.919523+0000","last_became_peered":"2024-09-17T05:45:54.919523+0000","last_unstale":"2024-09-17T05:45:56.094330+0000","last_undegraded":"2024-09-17T05:45:56.094330+0000","last_fullsized":"2024-09-17T05:45:56.094330+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:44.393994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"118'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915255+0000","last_change":"2024-09-17T05:45:53.901686+0000","last_active":"2024-09-17T05:45:55.915255+0000","last_peered":"2024-09-17T05:45:55.915255+0000","last_clean":"2024-09-17T05:45:55.915255+0000","last_became_active":"2024-09-17T05:45:53.899892+0000","last_became_peered":"2024-09-17T05:45:53.899892+0000","last_unstale":"2024-09-17T05:45:55.915255+0000","last_undegraded":"2024-09-17T05:45:55.915255+0000","last_fullsized":"2024-09-17T05:45:55.915255+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:04.736595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915765+0000","last_change":"2024-09-17T05:45:54.903362+0000","last_active":"2024-09-17T05:45:55.915765+0000","last_peered":"2024-09-17T05:45:55.915765+0000","last_clean":"2024-09-17T05:45:55.915765+0000","last_became_active":"2024-09-17T05:45:54.903055+0000","last_became_peered":"2024-09-17T05:45:54.903055+0000","last_unstale":"2024-09-17T05:45:55.915765+0000","last_undegraded":"2024-09-17T05:45:55.915765+0000","last_fullsized":"2024-09-17T05:45:55.915765+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:14.433086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093972+0000","last_change":"2024-09-17T05:45:53.901781+0000","last_active":"2024-09-17T05:45:56.093972+0000","last_peered":"2024-09-17T05:45:56.093972+0000","last_clean":"2024-09-17T05:45:56.093972+0000","last_became_active":"2024-09-17T05:45:53.899234+0000","last_became_peered":"2024-09-17T05:45:53.899234+0000","last_unstale":"2024-09-17T05:45:56.093972+0000","last_undegraded":"2024-09-17T05:45:56.093972+0000","last_fullsized":"2024-09-17T05:45:56.093972+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:39.404864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092978+0000","last_change":"2024-09-17T05:45:54.921313+0000","last_active":"2024-09-17T05:45:56.092978+0000","last_peered":"2024-09-17T05:45:56.092978+0000","last_clean":"2024-09-17T05:45:56.092978+0000","last_became_active":"2024-09-17T05:45:54.921000+0000","last_became_peered":"2024-09-17T05:45:54.921000+0000","last_unstale":"2024-09-17T05:45:56.092978+0000","last_undegraded":"2024-09-17T05:45:56.092978+0000","last_fullsized":"2024-09-17T05:45:56.092978+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:14.433086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894073+0000","last_change":"2024-09-17T05:45:53.901202+0000","last_active":"2024-09-17T05:45:55.894073+0000","last_peered":"2024-09-17T05:45:55.894073+0000","last_clean":"2024-09-17T05:45:55.894073+0000","last_became_active":"2024-09-17T05:45:53.897996+0000","last_became_peered":"2024-09-17T05:45:53.897996+0000","last_unstale":"2024-09-17T05:45:55.894073+0000","last_undegraded":"2024-09-17T05:45:55.894073+0000","last_fullsized":"2024-09-17T05:45:55.894073+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:01.579907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894171+0000","last_change":"2024-09-17T05:45:54.925005+0000","last_active":"2024-09-17T05:45:55.894171+0000","last_peered":"2024-09-17T05:45:55.894171+0000","last_clean":"2024-09-17T05:45:55.894171+0000","last_became_active":"2024-09-17T05:45:54.924663+0000","last_became_peered":"2024-09-17T05:45:54.924663+0000","last_unstale":"2024-09-17T05:45:55.894171+0000","last_undegraded":"2024-09-17T05:45:55.894171+0000","last_fullsized":"2024-09-17T05:45:55.894171+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:51.871043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092913+0000","last_change":"2024-09-17T05:45:53.895705+0000","last_active":"2024-09-17T05:45:56.092913+0000","last_peered":"2024-09-17T05:45:56.092913+0000","last_clean":"2024-09-17T05:45:56.092913+0000","last_became_active":"2024-09-17T05:45:53.895394+0000","last_became_peered":"2024-09-17T05:45:53.895394+0000","last_unstale":"2024-09-17T05:45:56.092913+0000","last_undegraded":"2024-09-17T05:45:56.092913+0000","last_fullsized":"2024-09-17T05:45:56.092913+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:54.290760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893487+0000","last_change":"2024-09-17T05:45:54.919035+0000","last_active":"2024-09-17T05:45:55.893487+0000","last_peered":"2024-09-17T05:45:55.893487+0000","last_clean":"2024-09-17T05:45:55.893487+0000","last_became_active":"2024-09-17T05:45:54.918621+0000","last_became_peered":"2024-09-17T05:45:54.918621+0000","last_unstale":"2024-09-17T05:45:55.893487+0000","last_undegraded":"2024-09-17T05:45:55.893487+0000","last_fullsized":"2024-09-17T05:45:55.893487+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:05.744372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893111+0000","last_change":"2024-09-17T05:45:53.902130+0000","last_active":"2024-09-17T05:45:55.893111+0000","last_peered":"2024-09-17T05:45:55.893111+0000","last_clean":"2024-09-17T05:45:55.893111+0000","last_became_active":"2024-09-17T05:45:53.901796+0000","last_became_peered":"2024-09-17T05:45:53.901796+0000","last_unstale":"2024-09-17T05:45:55.893111+0000","last_undegraded":"2024-09-17T05:45:55.893111+0000","last_fullsized":"2024-09-17T05:45:55.893111+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:57.814247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093765+0000","last_change":"2024-09-17T05:45:54.919085+0000","last_active":"2024-09-17T05:45:56.093765+0000","last_peered":"2024-09-17T05:45:56.093765+0000","last_clean":"2024-09-17T05:45:56.093765+0000","last_became_active":"2024-09-17T05:45:54.918745+0000","last_became_peered":"2024-09-17T05:45:54.918745+0000","last_unstale":"2024-09-17T05:45:56.093765+0000","last_undegraded":"2024-09-17T05:45:56.093765+0000","last_fullsized":"2024-09-17T05:45:56.093765+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:26.109104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.914822+0000","last_change":"2024-09-17T05:45:53.904284+0000","last_active":"2024-09-17T05:45:55.914822+0000","last_peered":"2024-09-17T05:45:55.914822+0000","last_clean":"2024-09-17T05:45:55.914822+0000","last_became_active":"2024-09-17T05:45:53.903747+0000","last_became_peered":"2024-09-17T05:45:53.903747+0000","last_unstale":"2024-09-17T05:45:55.914822+0000","last_undegraded":"2024-09-17T05:45:55.914822+0000","last_fullsized":"2024-09-17T05:45:55.914822+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:46.053415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894758+0000","last_change":"2024-09-17T05:45:54.923680+0000","last_active":"2024-09-17T05:45:55.894758+0000","last_peered":"2024-09-17T05:45:55.894758+0000","last_clean":"2024-09-17T05:45:55.894758+0000","last_became_active":"2024-09-17T05:45:54.923340+0000","last_became_peered":"2024-09-17T05:45:54.923340+0000","last_unstale":"2024-09-17T05:45:55.894758+0000","last_undegraded":"2024-09-17T05:45:55.894758+0000","last_fullsized":"2024-09-17T05:45:55.894758+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:50.662399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"118'2","reported_seq":17,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.094269+0000","last_change":"2024-09-17T05:45:53.899862+0000","last_active":"2024-09-17T05:45:56.094269+0000","last_peered":"2024-09-17T05:45:56.094269+0000","last_clean":"2024-09-17T05:45:56.094269+0000","last_became_active":"2024-09-17T05:45:53.899475+0000","last_became_peered":"2024-09-17T05:45:53.899475+0000","last_unstale":"2024-09-17T05:45:56.094269+0000","last_undegraded":"2024-09-17T05:45:56.094269+0000","last_fullsized":"2024-09-17T05:45:56.094269+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:27.586187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895178+0000","last_change":"2024-09-17T05:45:54.914564+0000","last_active":"2024-09-17T05:45:55.895178+0000","last_peered":"2024-09-17T05:45:55.895178+0000","last_clean":"2024-09-17T05:45:55.895178+0000","last_became_active":"2024-09-17T05:45:54.914207+0000","last_became_peered":"2024-09-17T05:45:54.914207+0000","last_unstale":"2024-09-17T05:45:55.895178+0000","last_undegraded":"2024-09-17T05:45:55.895178+0000","last_fullsized":"2024-09-17T05:45:55.895178+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:47.518902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"119'1","reported_seq":16,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.917190+0000","last_change":"2024-09-17T05:45:53.901463+0000","last_active":"2024-09-17T05:45:55.917190+0000","last_peered":"2024-09-17T05:45:55.917190+0000","last_clean":"2024-09-17T05:45:55.917190+0000","last_became_active":"2024-09-17T05:45:53.901136+0000","last_became_peered":"2024-09-17T05:45:53.901136+0000","last_unstale":"2024-09-17T05:45:55.917190+0000","last_undegraded":"2024-09-17T05:45:55.917190+0000","last_fullsized":"2024-09-17T05:45:55.917190+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:01.637710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.893247+0000","last_change":"2024-09-17T05:45:54.898643+0000","last_active":"2024-09-17T05:45:55.893247+0000","last_peered":"2024-09-17T05:45:55.893247+0000","last_clean":"2024-09-17T05:45:55.893247+0000","last_became_active":"2024-09-17T05:45:54.898226+0000","last_became_peered":"2024-09-17T05:45:54.898226+0000","last_unstale":"2024-09-17T05:45:55.893247+0000","last_undegraded":"2024-09-17T05:45:55.893247+0000","last_fullsized":"2024-09-17T05:45:55.893247+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:03.248138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915321+0000","last_change":"2024-09-17T05:45:53.900946+0000","last_active":"2024-09-17T05:45:55.915321+0000","last_peered":"2024-09-17T05:45:55.915321+0000","last_clean":"2024-09-17T05:45:55.915321+0000","last_became_active":"2024-09-17T05:45:53.900570+0000","last_became_peered":"2024-09-17T05:45:53.900570+0000","last_unstale":"2024-09-17T05:45:55.915321+0000","last_undegraded":"2024-09-17T05:45:55.915321+0000","last_fullsized":"2024-09-17T05:45:55.915321+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:47.146983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.895639+0000","last_change":"2024-09-17T05:45:54.922174+0000","last_active":"2024-09-17T05:45:55.895639+0000","last_peered":"2024-09-17T05:45:55.895639+0000","last_clean":"2024-09-17T05:45:55.895639+0000","last_became_active":"2024-09-17T05:45:54.921760+0000","last_became_peered":"2024-09-17T05:45:54.921760+0000","last_unstale":"2024-09-17T05:45:55.895639+0000","last_undegraded":"2024-09-17T05:45:55.895639+0000","last_fullsized":"2024-09-17T05:45:55.895639+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:58.581397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894640+0000","last_change":"2024-09-17T05:45:53.891987+0000","last_active":"2024-09-17T05:45:55.894640+0000","last_peered":"2024-09-17T05:45:55.894640+0000","last_clean":"2024-09-17T05:45:55.894640+0000","last_became_active":"2024-09-17T05:45:53.891658+0000","last_became_peered":"2024-09-17T05:45:53.891658+0000","last_unstale":"2024-09-17T05:45:55.894640+0000","last_undegraded":"2024-09-17T05:45:55.894640+0000","last_fullsized":"2024-09-17T05:45:55.894640+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:46.726284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.894005+0000","last_change":"2024-09-17T05:45:54.923564+0000","last_active":"2024-09-17T05:45:55.894005+0000","last_peered":"2024-09-17T05:45:55.894005+0000","last_clean":"2024-09-17T05:45:55.894005+0000","last_became_active":"2024-09-17T05:45:54.923105+0000","last_became_peered":"2024-09-17T05:45:54.923105+0000","last_unstale":"2024-09-17T05:45:55.894005+0000","last_undegraded":"2024-09-17T05:45:55.894005+0000","last_fullsized":"2024-09-17T05:45:55.894005+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:00.901538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915413+0000","last_change":"2024-09-17T05:45:53.896926+0000","last_active":"2024-09-17T05:45:55.915413+0000","last_peered":"2024-09-17T05:45:55.915413+0000","last_clean":"2024-09-17T05:45:55.915413+0000","last_became_active":"2024-09-17T05:45:53.896563+0000","last_became_peered":"2024-09-17T05:45:53.896563+0000","last_unstale":"2024-09-17T05:45:55.915413+0000","last_undegraded":"2024-09-17T05:45:55.915413+0000","last_fullsized":"2024-09-17T05:45:55.915413+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:34.575897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093121+0000","last_change":"2024-09-17T05:45:54.918621+0000","last_active":"2024-09-17T05:45:56.093121+0000","last_peered":"2024-09-17T05:45:56.093121+0000","last_clean":"2024-09-17T05:45:56.093121+0000","last_became_active":"2024-09-17T05:45:54.918069+0000","last_became_peered":"2024-09-17T05:45:54.918069+0000","last_unstale":"2024-09-17T05:45:56.093121+0000","last_undegraded":"2024-09-17T05:45:56.093121+0000","last_fullsized":"2024-09-17T05:45:56.093121+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.310645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093077+0000","last_change":"2024-09-17T05:45:53.887526+0000","last_active":"2024-09-17T05:45:56.093077+0000","last_peered":"2024-09-17T05:45:56.093077+0000","last_clean":"2024-09-17T05:45:56.093077+0000","last_became_active":"2024-09-17T05:45:53.887204+0000","last_became_peered":"2024-09-17T05:45:53.887204+0000","last_unstale":"2024-09-17T05:45:56.093077+0000","last_undegraded":"2024-09-17T05:45:56.093077+0000","last_fullsized":"2024-09-17T05:45:56.093077+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:08.923966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915038+0000","last_change":"2024-09-17T05:45:54.909359+0000","last_active":"2024-09-17T05:45:55.915038+0000","last_peered":"2024-09-17T05:45:55.915038+0000","last_clean":"2024-09-17T05:45:55.915038+0000","last_became_active":"2024-09-17T05:45:54.909049+0000","last_became_peered":"2024-09-17T05:45:54.909049+0000","last_unstale":"2024-09-17T05:45:55.915038+0000","last_undegraded":"2024-09-17T05:45:55.915038+0000","last_fullsized":"2024-09-17T05:45:55.915038+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:10.141165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093597+0000","last_change":"2024-09-17T05:45:53.900934+0000","last_active":"2024-09-17T05:45:56.093597+0000","last_peered":"2024-09-17T05:45:56.093597+0000","last_clean":"2024-09-17T05:45:56.093597+0000","last_became_active":"2024-09-17T05:45:53.900633+0000","last_became_peered":"2024-09-17T05:45:53.900633+0000","last_unstale":"2024-09-17T05:45:56.093597+0000","last_undegraded":"2024-09-17T05:45:56.093597+0000","last_fullsized":"2024-09-17T05:45:56.093597+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:55.195396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093634+0000","last_change":"2024-09-17T05:45:54.898300+0000","last_active":"2024-09-17T05:45:56.093634+0000","last_peered":"2024-09-17T05:45:56.093634+0000","last_clean":"2024-09-17T05:45:56.093634+0000","last_became_active":"2024-09-17T05:45:54.897946+0000","last_became_peered":"2024-09-17T05:45:54.897946+0000","last_unstale":"2024-09-17T05:45:56.093634+0000","last_undegraded":"2024-09-17T05:45:56.093634+0000","last_fullsized":"2024-09-17T05:45:56.093634+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:12.719587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":15,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.914962+0000","last_change":"2024-09-17T05:45:53.899245+0000","last_active":"2024-09-17T05:45:55.914962+0000","last_peered":"2024-09-17T05:45:55.914962+0000","last_clean":"2024-09-17T05:45:55.914962+0000","last_became_active":"2024-09-17T05:45:53.898312+0000","last_became_peered":"2024-09-17T05:45:53.898312+0000","last_unstale":"2024-09-17T05:45:55.914962+0000","last_undegraded":"2024-09-17T05:45:55.914962+0000","last_fullsized":"2024-09-17T05:45:55.914962+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:11.207715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":13,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:55.915202+0000","last_change":"2024-09-17T05:45:54.908221+0000","last_active":"2024-09-17T05:45:55.915202+0000","last_peered":"2024-09-17T05:45:55.915202+0000","last_clean":"2024-09-17T05:45:55.915202+0000","last_became_active":"2024-09-17T05:45:54.907854+0000","last_became_peered":"2024-09-17T05:45:54.907854+0000","last_unstale":"2024-09-17T05:45:55.915202+0000","last_undegraded":"2024-09-17T05:45:55.915202+0000","last_fullsized":"2024-09-17T05:45:55.915202+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":117,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:53.869565+0000","last_clean_scrub_stamp":"2024-09-17T05:45:53.869565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:09.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"118'8","reported_seq":23,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.093332+0000","last_change":"2024-09-17T05:45:53.888441+0000","last_active":"2024-09-17T05:45:56.093332+0000","last_peered":"2024-09-17T05:45:56.093332+0000","last_clean":"2024-09-17T05:45:56.093332+0000","last_became_active":"2024-09-17T05:45:53.887726+0000","last_became_peered":"2024-09-17T05:45:53.887726+0000","last_unstale":"2024-09-17T05:45:56.093332+0000","last_undegraded":"2024-09-17T05:45:56.093332+0000","last_fullsized":"2024-09-17T05:45:56.093332+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":116,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:45:52.861787+0000","last_clean_scrub_stamp":"2024-09-17T05:45:52.861787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:01:18.812111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":299,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-09-17T05:45:56.092699+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:45:56.092699+0000","last_peered":"2024-09-17T05:45:56.092699+0000","last_clean":"2024-09-17T05:45:56.092699+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:45:56.092699+0000","last_undegraded":"2024-09-17T05:45:56.092699+0000","last_fullsized":"2024-09-17T05:45:56.092699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509562,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":680590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509561,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2068480,"data_stored":1272570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509560,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1470464,"data_stored":680646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509561,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1466368,"data_stored":680680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1478656,"data_stored":682784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509562,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2064384,"data_stored":1271118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509562,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1474560,"data_stored":681276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1478656,"data_stored":687304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:45:59.518 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:45:59.518 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:45:59.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 -- 172.21.15.44:0/1541311032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2040cb470 msgr2=0x7fa2040cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 --2- 172.21.15.44:0/1541311032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2040cb470 0x7fa2040cb880 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fa2040cb0b0 tx=0x7fa1fc01cb10 comp rx=0 tx=0).stop 2024-09-17T05:45:59.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 -- 172.21.15.44:0/1541311032 shutdown_connections 2024-09-17T05:45:59.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 --2- 172.21.15.44:0/1541311032 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa2040cb470 0x7fa2040cb880 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 --2- 172.21.15.44:0/1541311032 >> v2:172.21.15.86:3300/0 conn(0x7fa20406de50 0x7fa20406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 -- 172.21.15.44:0/1541311032 >> 172.21.15.44:0/1541311032 conn(0x7fa2040ccaa0 msgr2=0x7fa2040cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:59.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 -- 172.21.15.44:0/1541311032 shutdown_connections 2024-09-17T05:45:59.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 -- 172.21.15.44:0/1541311032 wait complete. 2024-09-17T05:45:59.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 Processor -- start 2024-09-17T05:45:59.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.728+0000 7fa208a00640 1 -- start start 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa20406de50 0x7fa204154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa204072e50 0x7fa2040c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2040cb470 0x7fa2040cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa204168ed0 con 0x7fa204072e50 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa204168d50 con 0x7fa2040cb470 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa204169050 con 0x7fa20406de50 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa204072e50 0x7fa2040c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa204072e50 0x7fa2040c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46804/0 (socket says 172.21.15.44:46804) 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 -- 172.21.15.44:0/1391315820 learned_addr learned my addr 172.21.15.44:0/1391315820 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:45:59.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa201e00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa20406de50 0x7fa204154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa202800640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2040cb470 0x7fa2040cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 -- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa20406de50 msgr2=0x7fa204154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa20406de50 0x7fa204154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 -- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2040cb470 msgr2=0x7fa2040cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2040cb470 0x7fa2040cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 -- 172.21.15.44:0/1391315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20415fae0 con 0x7fa204072e50 2024-09-17T05:45:59.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1f9400640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa204072e50 0x7fa2040c70d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00d720 tx=0x7fa1ec00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:59.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1faa00640 1 -- 172.21.15.44:0/1391315820 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec017070 con 0x7fa204072e50 2024-09-17T05:45:59.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1faa00640 1 -- 172.21.15.44:0/1391315820 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1ec009d20 con 0x7fa204072e50 2024-09-17T05:45:59.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa1faa00640 1 -- 172.21.15.44:0/1391315820 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec005280 con 0x7fa204072e50 2024-09-17T05:45:59.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2040c8c20 con 0x7fa204072e50 2024-09-17T05:45:59.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2040c91e0 con 0x7fa204072e50 2024-09-17T05:45:59.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.732+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20409dbb0 con 0x7fa204072e50 2024-09-17T05:45:59.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.736+0000 7fa1faa00640 1 -- 172.21.15.44:0/1391315820 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa1ec005420 con 0x7fa204072e50 2024-09-17T05:45:59.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.736+0000 7fa1faa00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1e0073200 0x7fa1e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:45:59.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.736+0000 7fa1faa00640 1 -- 172.21.15.44:0/1391315820 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fa1ec0944d0 con 0x7fa204072e50 2024-09-17T05:45:59.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.736+0000 7fa201e00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1e0073200 0x7fa1e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:45:59.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.736+0000 7fa201e00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1e0073200 0x7fa1e0075710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40098e0 tx=0x7fa1f4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:45:59.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.740+0000 7fa1faa00640 1 -- 172.21.15.44:0/1391315820 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa1ec05ec70 con 0x7fa204072e50 2024-09-17T05:45:59.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.976+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa2040b5fa0 con 0x7fa204072e50 2024-09-17T05:45:59.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa1faa00640 1 -- 172.21.15.44:0/1391315820 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7fa1ec0636a0 con 0x7fa204072e50 2024-09-17T05:45:59.981 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-09-17T05:45:59.981 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQASFelmvfIZKBAAyII75QgOplGs34J7voVvow== 2024-09-17T05:45:59.981 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-09-17T05:45:59.981 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-09-17T05:45:59.981 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:45:59.981 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1e0073200 msgr2=0x7fa1e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1e0073200 0x7fa1e0075710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40098e0 tx=0x7fa1f4009060 comp rx=0 tx=0).stop 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa204072e50 msgr2=0x7fa2040c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa204072e50 0x7fa2040c70d0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00d720 tx=0x7fa1ec00dbe0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 shutdown_connections 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa1e0073200 0x7fa1e0075710 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2040cb470 0x7fa2040cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa204072e50 0x7fa2040c70d0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 --2- 172.21.15.44:0/1391315820 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa20406de50 0x7fa204154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 >> 172.21.15.44:0/1391315820 conn(0x7fa2040ccaa0 msgr2=0x7fa204154850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:45:59.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 shutdown_connections 2024-09-17T05:45:59.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:45:59.980+0000 7fa208a00640 1 -- 172.21.15.44:0/1391315820 wait complete. 2024-09-17T05:46:00.003 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 -- 172.21.15.44:0/3932217621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2806e390 msgr2=0x7f2a280cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 --2- 172.21.15.44:0/3932217621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2806e390 0x7f2a280cdbf0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009900 tx=0x7f2a1401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 -- 172.21.15.44:0/3932217621 shutdown_connections 2024-09-17T05:46:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 --2- 172.21.15.44:0/3932217621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a2806e390 0x7f2a280cdbf0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 --2- 172.21.15.44:0/3932217621 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a280b5880 0x7f2a2806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 -- 172.21.15.44:0/3932217621 >> 172.21.15.44:0/3932217621 conn(0x7f2a280ccaa0 msgr2=0x7f2a280cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 -- 172.21.15.44:0/3932217621 shutdown_connections 2024-09-17T05:46:00.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 -- 172.21.15.44:0/3932217621 wait complete. 2024-09-17T05:46:00.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 Processor -- start 2024-09-17T05:46:00.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.172+0000 7f2a2f600640 1 -- start start 2024-09-17T05:46:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a2806e390 0x7f2a281fc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a280b5880 0x7f2a281fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a280ce130 0x7f2a280b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2816a2c0 con 0x7f2a280ce130 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2816a140 con 0x7f2a2806e390 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2a2816a440 con 0x7f2a280b5880 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a280ce130 0x7f2a280b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a280ce130 0x7f2a280b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46824/0 (socket says 172.21.15.44:46824) 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 -- 172.21.15.44:0/407755800 learned_addr learned my addr 172.21.15.44:0/407755800 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a27e00640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a280b5880 0x7f2a281fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2cc00640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a2806e390 0x7f2a281fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 -- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a280b5880 msgr2=0x7f2a281fcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a280b5880 0x7f2a281fcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 -- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a2806e390 msgr2=0x7f2a281fc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a2806e390 0x7f2a281fc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 -- 172.21.15.44:0/407755800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a281fdbb0 con 0x7f2a280ce130 2024-09-17T05:46:00.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a27e00640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a280b5880 0x7f2a281fcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:00.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2d600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a280ce130 0x7f2a280b0150 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c760 tx=0x7f2a2000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:00.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a24c00640 1 -- 172.21.15.44:0/407755800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20003db0 con 0x7f2a280ce130 2024-09-17T05:46:00.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a24c00640 1 -- 172.21.15.44:0/407755800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a2000ce10 con 0x7f2a280ce130 2024-09-17T05:46:00.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2815a370 con 0x7f2a280ce130 2024-09-17T05:46:00.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a24c00640 1 -- 172.21.15.44:0/407755800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a200052d0 con 0x7f2a280ce130 2024-09-17T05:46:00.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a280b11d0 con 0x7f2a280ce130 2024-09-17T05:46:00.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.176+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a280cdbf0 con 0x7f2a280ce130 2024-09-17T05:46:00.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.180+0000 7f2a24c00640 1 -- 172.21.15.44:0/407755800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2a20005470 con 0x7f2a280ce130 2024-09-17T05:46:00.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.180+0000 7f2a24c00640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2a08073230 0x7f2a08075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.180+0000 7f2a24c00640 1 -- 172.21.15.44:0/407755800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f2a20093fe0 con 0x7f2a280ce130 2024-09-17T05:46:00.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.180+0000 7f2a2cc00640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2a08073230 0x7f2a08075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.180+0000 7f2a2cc00640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2a08073230 0x7f2a08075740 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009b40 tx=0x7f2a1c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:00.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.184+0000 7f2a24c00640 1 -- 172.21.15.44:0/407755800 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2a2806e7a0 con 0x7f2a280ce130 2024-09-17T05:46:00.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.396+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a280a14b0 con 0x7f2a280ce130 2024-09-17T05:46:00.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.396+0000 7f2a24c00640 1 -- 172.21.15.44:0/407755800 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5227 (secure 0 0 0) 0x7f2a2005e830 con 0x7f2a280ce130 2024-09-17T05:46:00.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:00.397 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":100,"btime":"2024-09-17T05:45:57:912411+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:45:57.329223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8235":{"gid":8235,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.44:6835/1819525564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":1819525564},{"type":"v1","addr":"172.21.15.44:6835","nonce":1819525564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8235,"qdb_cluster":[8235]},"id":8}]} 2024-09-17T05:46:00.397 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 100 2024-09-17T05:46:00.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2a08073230 msgr2=0x7f2a08075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2a08073230 0x7f2a08075740 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009b40 tx=0x7f2a1c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a280ce130 msgr2=0x7f2a280b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a280ce130 0x7f2a280b0150 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c760 tx=0x7f2a2000cc20 comp rx=0 tx=0).stop 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 shutdown_connections 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a280ce130 0x7f2a280b0150 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2a280b5880 0x7f2a281fcee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2a08073230 0x7f2a08075740 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 --2- 172.21.15.44:0/407755800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a2806e390 0x7f2a281fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 >> 172.21.15.44:0/407755800 conn(0x7f2a280ccaa0 msgr2=0x7f2a2815e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 shutdown_connections 2024-09-17T05:46:00.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.400+0000 7f2a2f600640 1 -- 172.21.15.44:0/407755800 wait complete. 2024-09-17T05:46:00.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:54.297928+0000', 'modified': '2024-09-17T05:45:57.329223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8235}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8235': {'gid': 8235, 'name': 'c', 'rank': 0, 'incarnation': 97, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.44:6835/1819525564', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 1819525564}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 1819525564}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8235, 'qdb_cluster': [8235]} 2024-09-17T05:46:00.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:46:00.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 -- 172.21.15.44:0/181859328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c072e50 msgr2=0x7f230c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 --2- 172.21.15.44:0/181859328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c072e50 0x7f230c15e990 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f230c0af7b0 tx=0x7f22fc01c770 comp rx=0 tx=0).stop 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 -- 172.21.15.44:0/181859328 shutdown_connections 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 --2- 172.21.15.44:0/181859328 >> v2:172.21.15.86:3300/0 conn(0x7f230c0cb470 0x7f230c0cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 --2- 172.21.15.44:0/181859328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c072e50 0x7f230c15e990 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 -- 172.21.15.44:0/181859328 >> 172.21.15.44:0/181859328 conn(0x7f230c0ccaa0 msgr2=0x7f230c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 -- 172.21.15.44:0/181859328 shutdown_connections 2024-09-17T05:46:00.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 -- 172.21.15.44:0/181859328 wait complete. 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.988+0000 7f2311e00640 1 Processor -- start 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 -- start start 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c06de50 0x7f230c09b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c072e50 0x7f230c1fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0cb470 0x7f230c0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f230c168e80 con 0x7f230c06de50 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f230c168d00 con 0x7f230c0cb470 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f230c169000 con 0x7f230c072e50 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c06de50 0x7f230c09b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c06de50 0x7f230c09b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46838/0 (socket says 172.21.15.44:46838) 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 -- 172.21.15.44:0/1275562980 learned_addr learned my addr 172.21.15.44:0/1275562980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:00.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230b400640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0cb470 0x7f230c0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230a000640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c072e50 0x7f230c1fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 -- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c072e50 msgr2=0x7f230c1fbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c072e50 0x7f230c1fbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 -- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0cb470 msgr2=0x7f230c0c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0cb470 0x7f230c0c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 -- 172.21.15.44:0/1275562980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230c1fc8c0 con 0x7f230c06de50 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f230aa00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c06de50 0x7f230c09b490 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f22fc098260 tx=0x7f22fc0a5540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2303400640 1 -- 172.21.15.44:0/1275562980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0b2040 con 0x7f230c06de50 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2303400640 1 -- 172.21.15.44:0/1275562980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22fc0bb070 con 0x7f230c06de50 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2303400640 1 -- 172.21.15.44:0/1275562980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc003600 con 0x7f230c06de50 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230c1fcba0 con 0x7f230c06de50 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.992+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f230c09af70 con 0x7f230c06de50 2024-09-17T05:46:00.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.996+0000 7f2303400640 1 -- 172.21.15.44:0/1275562980 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f22fc0037a0 con 0x7f230c06de50 2024-09-17T05:46:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.996+0000 7f2319523000 1 Processor -- start 2024-09-17T05:46:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.996+0000 7f2303400640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22ec073200 0x7f22ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.996+0000 7f2303400640 1 -- 172.21.15.44:0/1275562980 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f22fc12e900 con 0x7f230c06de50 2024-09-17T05:46:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.996+0000 7f2319523000 1 -- start start 2024-09-17T05:46:00.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:00.996+0000 7f230b400640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22ec073200 0x7f22ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:00.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22ec073200 0x7f22ec075710 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2304005fd0 tx=0x7f230400a330 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x56111525c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x56111525cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x56111525d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561115131410 con 0x5611150f4ca0 2024-09-17T05:46:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56111506eb40 con 0x56111510b950 2024-09-17T05:46:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x56111505df70 con 0x561114d1b460 2024-09-17T05:46:01.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x56111525d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x56111525d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46844/0 (socket says 172.21.15.44:46844) 2024-09-17T05:46:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 -- 172.21.15.44:0/3737282816 learned_addr learned my addr 172.21.15.44:0/3737282816 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230aa00640 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x56111525c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230a000640 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x56111525cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 -- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 msgr2=0x56111525c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x56111525c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 -- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 msgr2=0x56111525cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x56111525cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 -- 172.21.15.44:0/3737282816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611150255b0 con 0x5611150f4ca0 2024-09-17T05:46:01.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f230b400640 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x56111525d120 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f230400afb0 tx=0x7f2304012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6915cd9a8b8914 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f22f7400640 1 -- 172.21.15.44:0/3737282816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2304022070 con 0x5611150f4ca0 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f22f7400640 1 -- 172.21.15.44:0/3737282816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f230401e860 con 0x5611150f4ca0 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f22f7400640 1 -- 172.21.15.44:0/3737282816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230401ec10 con 0x5611150f4ca0 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- 172.21.15.44:0/3737282816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 msgr2=0x56111525d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x56111525d120 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f230400afb0 tx=0x7f2304012000 comp rx=0 tx=0).stop 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- 172.21.15.44:0/3737282816 shutdown_connections 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x56111525d120 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x56111525cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 --2- 172.21.15.44:0/3737282816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x56111525c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- 172.21.15.44:0/3737282816 >> 172.21.15.44:0/3737282816 conn(0x5611151e1d90 msgr2=0x561115211690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- 172.21.15.44:0/3737282816 shutdown_connections 2024-09-17T05:46:01.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.000+0000 7f2319523000 1 -- 172.21.15.44:0/3737282816 wait complete. 2024-09-17T05:46:01.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 -- start start 2024-09-17T05:46:01.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 Processor -- start 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561114d1b460 0x561115263920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611150f4ca0 0x561115263e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 0x5611152643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561114ff85f0 con 0x561114d1b460 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561115061d80 con 0x5611150f4ca0 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x561115004520 con 0x56111510b950 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 10 client.0 _ll_register_callbacks cb 0x561115008830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:01.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561114d1b460 0x561115263920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561114d1b460 0x561115263920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46854/0 (socket says 172.21.15.44:46854) 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 -- 172.21.15.44:0/60996764 learned_addr learned my addr 172.21.15.44:0/60996764 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230a000640 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611150f4ca0 0x561115263e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230b400640 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 0x5611152643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 -- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 msgr2=0x5611152643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 0x5611152643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 -- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611150f4ca0 msgr2=0x561115263e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611150f4ca0 0x561115263e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 -- 172.21.15.44:0/60996764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561114ffc190 con 0x561114d1b460 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f230aa00640 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561114d1b460 0x561115263920 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0f9130 tx=0x7f22fc0f8af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae10b878df45af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f22ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f22ebe00640 1 -- 172.21.15.44:0/60996764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc1028a0 con 0x561114d1b460 2024-09-17T05:46:01.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f22ebe00640 1 -- 172.21.15.44:0/60996764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f22fc0f8400 con 0x561114d1b460 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561114ff6110 con 0x561114d1b460 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f22ebe00640 1 -- 172.21.15.44:0/60996764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f22fc0f98a0 con 0x561114d1b460 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 10 client.8361 fetch_fsmap learned FSMap version 100 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.004+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x5611150e2f10 con 0x561114d1b460 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f22ebe00640 1 -- 172.21.15.44:0/60996764 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x561114ff6110 con 0x561114d1b460 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f22ebe00640 1 -- 172.21.15.44:0/60996764 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f22fc0b5070 con 0x561114d1b460 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 10 client.8361 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 10 client.8361 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 20 client.8361 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:01.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114d007d0 0x56111526dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 4 client.8361 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:46:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 --> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561115070a90 con 0x561114d007d0 2024-09-17T05:46:01.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f230a000640 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114d007d0 0x56111526dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f230a000640 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114d007d0 0x56111526dd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20fb0d1f80498ebc server_cookie=5fc487a8c03c1aaf in_seq=0 out_seq=0 2024-09-17T05:46:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f22ebe00640 10 client.8361 ms_handle_connect on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f22ebe00640 1 -- 172.21.15.44:0/60996764 <== mds.0 v2:172.21.15.44:6834/1819525564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561115070a90 con 0x561114d007d0 2024-09-17T05:46:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f22ebe00640 10 client.8361 handle_command_reply: tid=0 2024-09-17T05:46:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 client.8361 shutdown 2024-09-17T05:46:01.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561114d1b460 msgr2=0x561115263920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561114d1b460 0x561115263920 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0f9130 tx=0x7f22fc0f8af0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 shutdown_connections 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114d007d0 0x56111526dd00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 0x5611152643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5611150f4ca0 0x561115263e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f22ebe00640 0 client.8361 ms_handle_reset on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 --2- 172.21.15.44:0/60996764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561114d1b460 0x561115263920 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 >> 172.21.15.44:0/60996764 conn(0x5611151e1d90 msgr2=0x561115218440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 shutdown_connections 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 1 -- 172.21.15.44:0/60996764 wait complete. 2024-09-17T05:46:01.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.008+0000 7f2319523000 20 client.8361 trim_cache size 0 max 16384 2024-09-17T05:46:01.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 Processor -- start 2024-09-17T05:46:01.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 -- start start 2024-09-17T05:46:01.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561114d1b460 0x5611152ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 0x5611152cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f230c205910 con 0x5611150f4ca0 2024-09-17T05:46:01.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f230c204950 con 0x561114d1b460 2024-09-17T05:46:01.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f230c0b3a10 con 0x56111510b950 2024-09-17T05:46:01.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46864/0 (socket says 172.21.15.44:46864) 2024-09-17T05:46:01.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 -- 172.21.15.44:0/4158816617 learned_addr learned my addr 172.21.15.44:0/4158816617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:01.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 -- 172.21.15.44:0/4158816617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 msgr2=0x5611152cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 --2- 172.21.15.44:0/4158816617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 0x5611152cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 -- 172.21.15.44:0/4158816617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561114d1b460 msgr2=0x5611152ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 --2- 172.21.15.44:0/4158816617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561114d1b460 0x5611152ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.028+0000 7f230a000640 1 -- 172.21.15.44:0/4158816617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611150b9db0 con 0x5611150f4ca0 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f230a000640 1 --2- 172.21.15.44:0/4158816617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152ceb60 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f22f80010d0 tx=0x7f22f8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14b9d5f716725c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f22f6a00640 1 -- 172.21.15.44:0/4158816617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f8005110 con 0x5611150f4ca0 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f22f6a00640 1 -- 172.21.15.44:0/4158816617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22f8023070 con 0x5611150f4ca0 2024-09-17T05:46:01.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f22f6a00640 1 -- 172.21.15.44:0/4158816617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f8016870 con 0x5611150f4ca0 2024-09-17T05:46:01.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 -- 172.21.15.44:0/4158816617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 msgr2=0x5611152ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 --2- 172.21.15.44:0/4158816617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152ceb60 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f22f80010d0 tx=0x7f22f8009040 comp rx=0 tx=0).stop 2024-09-17T05:46:01.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 -- 172.21.15.44:0/4158816617 shutdown_connections 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 --2- 172.21.15.44:0/4158816617 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x56111510b950 0x5611152cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 --2- 172.21.15.44:0/4158816617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152ceb60 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 --2- 172.21.15.44:0/4158816617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561114d1b460 0x5611152ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 -- 172.21.15.44:0/4158816617 >> 172.21.15.44:0/4158816617 conn(0x5611151e1d90 msgr2=0x56111525a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 -- 172.21.15.44:0/4158816617 shutdown_connections 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 -- 172.21.15.44:0/4158816617 wait complete. 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 -- start start 2024-09-17T05:46:01.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.032+0000 7f2319523000 1 Processor -- start 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x5611152d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x5611152d3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f230c204300 con 0x5611150f4ca0 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561115061d80 con 0x56111510b950 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5611150e2a80 con 0x561114d1b460 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 10 client.0 _ll_register_callbacks cb 0x7f22fc0f5040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46868/0 (socket says 172.21.15.44:46868) 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 -- 172.21.15.44:0/1607730703 learned_addr learned my addr 172.21.15.44:0/1607730703 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:01.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230aa00640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x5611152d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230b400640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x5611152d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 -- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 msgr2=0x5611152d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x5611152d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 -- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 msgr2=0x5611152d3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x5611152d3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 -- 172.21.15.44:0/1607730703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561115024ab0 con 0x5611150f4ca0 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230b400640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x5611152d3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230aa00640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x5611152d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230a000640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152d2ae0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f22f80010d0 tx=0x7f22f8005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184e6f4ea9a1f46c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 1 -- 172.21.15.44:0/1607730703 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f802c060 con 0x5611150f4ca0 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 1 -- 172.21.15.44:0/1607730703 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f22f8016a80 con 0x5611150f4ca0 2024-09-17T05:46:01.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22f8023070 con 0x5611150f4ca0 2024-09-17T05:46:01.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 1 -- 172.21.15.44:0/1607730703 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f22f8032050 con 0x5611150f4ca0 2024-09-17T05:46:01.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 10 client.8367 fetch_fsmap learned FSMap version 100 2024-09-17T05:46:01.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x561115003070 con 0x5611150f4ca0 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 1 -- 172.21.15.44:0/1607730703 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22f8023070 con 0x5611150f4ca0 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 1 -- 172.21.15.44:0/1607730703 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f22f8035020 con 0x5611150f4ca0 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 10 client.8367 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 10 client.8367 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 20 client.8367 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114cee830 0x56111528f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 4 client.8367 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 --> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] -- command(tid 0: {"prefix": "status"}) -- 0x56111506c540 con 0x561114cee830 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230aa00640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114cee830 0x56111528f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 10 client.8367 ms_handle_connect on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f230aa00640 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114cee830 0x56111528f460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b7c4d000d559fd8 server_cookie=5c57b5fd137cb919 in_seq=0 out_seq=0 2024-09-17T05:46:01.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 1 -- 172.21.15.44:0/1607730703 <== mds.0 v2:172.21.15.44:6834/1819525564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x56111506c540 con 0x561114cee830 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 10 client.8367 handle_command_reply: tid=0 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 client.8367 shutdown 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 msgr2=0x5611152d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152d2ae0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f22f80010d0 tx=0x7f22f8005490 comp rx=0 tx=0).stop 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 shutdown_connections 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x561114cee830 0x56111528f460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56111510b950 0x5611152d3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5611150f4ca0 0x5611152d2ae0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 --2- 172.21.15.44:0/1607730703 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x561114d1b460 0x5611152d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f22ebe00640 0 client.8367 ms_handle_reset on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 >> 172.21.15.44:0/1607730703 conn(0x5611151e1d90 msgr2=0x56111526d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 shutdown_connections 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 1 -- 172.21.15.44:0/1607730703 wait complete. 2024-09-17T05:46:01.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.036+0000 7f2319523000 20 client.8367 trim_cache size 0 max 16384 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 8235, 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 6.1376087669999997, 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 100, 2024-09-17T05:46:01.042 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 119, 2024-09-17T05:46:01.043 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 119, 2024-09-17T05:46:01.043 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 10.550823903 2024-09-17T05:46:01.043 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22ec073200 msgr2=0x7f22ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22ec073200 0x7f22ec075710 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2304005fd0 tx=0x7f230400a330 comp rx=0 tx=0).stop 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c06de50 msgr2=0x7f230c09b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c06de50 0x7f230c09b490 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f22fc098260 tx=0x7f22fc0a5540 comp rx=0 tx=0).stop 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 shutdown_connections 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22ec073200 0x7f22ec075710 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f230c0cb470 0x7f230c0c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f230c072e50 0x7f230c1fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 --2- 172.21.15.44:0/1275562980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f230c06de50 0x7f230c09b490 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 >> 172.21.15.44:0/1275562980 conn(0x7f230c0ccaa0 msgr2=0x7f230c06e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:01.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 shutdown_connections 2024-09-17T05:46:01.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.040+0000 7f2311e00640 1 -- 172.21.15.44:0/1275562980 wait complete. 2024-09-17T05:46:01.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 -- 172.21.15.44:0/2475595023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6694072e50 msgr2=0x7f669415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 --2- 172.21.15.44:0/2475595023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6694072e50 0x7f669415e990 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f66940cff10 tx=0x7f668401c830 comp rx=0 tx=0).stop 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 -- 172.21.15.44:0/2475595023 shutdown_connections 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 --2- 172.21.15.44:0/2475595023 >> v2:172.21.15.86:3300/0 conn(0x7f66940ced00 0x7f66940cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 --2- 172.21.15.44:0/2475595023 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f669406de50 0x7f669406e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 --2- 172.21.15.44:0/2475595023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6694072e50 0x7f669415e990 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 -- 172.21.15.44:0/2475595023 >> 172.21.15.44:0/2475595023 conn(0x7f66940ccaa0 msgr2=0x7f66940cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 -- 172.21.15.44:0/2475595023 shutdown_connections 2024-09-17T05:46:01.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 -- 172.21.15.44:0/2475595023 wait complete. 2024-09-17T05:46:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 Processor -- start 2024-09-17T05:46:01.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.220+0000 7f6699e00640 1 -- start start 2024-09-17T05:46:01.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f669406de50 0x7f6694159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694072e50 0x7f6694159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66940ced00 0x7f66940b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66940cc310 con 0x7f669406de50 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f66940cc190 con 0x7f6694072e50 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f66940cc490 con 0x7f66940ced00 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f669406de50 0x7f6694159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f669406de50 0x7f6694159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46892/0 (socket says 172.21.15.44:46892) 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 -- 172.21.15.44:0/3627311286 learned_addr learned my addr 172.21.15.44:0/3627311286 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f668a000640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694072e50 0x7f6694159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6693400640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66940ced00 0x7f66940b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 -- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66940ced00 msgr2=0x7f66940b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66940ced00 0x7f66940b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 -- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694072e50 msgr2=0x7f6694159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694072e50 0x7f6694159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 -- 172.21.15.44:0/3627311286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669415d660 con 0x7f669406de50 2024-09-17T05:46:01.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6692a00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f669406de50 0x7f6694159700 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f66840b0040 tx=0x7f6684005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:01.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f668be00640 1 -- 172.21.15.44:0/3627311286 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66840b2040 con 0x7f669406de50 2024-09-17T05:46:01.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f668be00640 1 -- 172.21.15.44:0/3627311286 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6684004240 con 0x7f669406de50 2024-09-17T05:46:01.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f668be00640 1 -- 172.21.15.44:0/3627311286 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684005070 con 0x7f669406de50 2024-09-17T05:46:01.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 -- 172.21.15.44:0/3627311286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669415db90 con 0x7f669406de50 2024-09-17T05:46:01.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6699e00640 1 -- 172.21.15.44:0/3627311286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669415a5b0 con 0x7f669406de50 2024-09-17T05:46:01.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.224+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6694157900 con 0x7f669406de50 2024-09-17T05:46:01.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.228+0000 7f668be00640 1 -- 172.21.15.44:0/3627311286 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6684005230 con 0x7f669406de50 2024-09-17T05:46:01.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.228+0000 7f668be00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6670073200 0x7f6670075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:01.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.228+0000 7f668be00640 1 -- 172.21.15.44:0/3627311286 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f668412dbd0 con 0x7f669406de50 2024-09-17T05:46:01.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.228+0000 7f668a000640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6670073200 0x7f6670075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:01.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.228+0000 7f668a000640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6670073200 0x7f6670075710 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f66941f9f70 tx=0x7f667c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:01.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.232+0000 7f668be00640 1 -- 172.21.15.44:0/3627311286 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f66840164b0 con 0x7f669406de50 2024-09-17T05:46:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66940b5fa0 con 0x7f669406de50 2024-09-17T05:46:01.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f668be00640 1 -- 172.21.15.44:0/3627311286 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7f66840f8400 con 0x7f669406de50 2024-09-17T05:46:01.452 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:46:01.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6670073200 msgr2=0x7f6670075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6670073200 0x7f6670075710 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f66941f9f70 tx=0x7f667c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f669406de50 msgr2=0x7f6694159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f669406de50 0x7f6694159700 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f66840b0040 tx=0x7f6684005de0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 shutdown_connections 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f66940ced00 0x7f66940b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f6670073200 0x7f6670075710 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6694072e50 0x7f6694159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 --2- 172.21.15.44:0/3627311286 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f669406de50 0x7f6694159700 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 >> 172.21.15.44:0/3627311286 conn(0x7f66940ccaa0 msgr2=0x7f66940cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.452+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 shutdown_connections 2024-09-17T05:46:01.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01.456+0000 7f6688c00640 1 -- 172.21.15.44:0/3627311286 wait complete. 2024-09-17T05:46:01.475 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:46:01.475 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:46:01.475 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:46:01.475 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:46:01.475 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:01.475 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:46:01.475 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:46:01.476 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:46:01.476 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:01.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:01.476 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:46:01.485 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:46:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:46:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:46:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.485 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:46:01.486 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41844sec preferred_lft 41844sec 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:01.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:46:01.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:01.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:01.490 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:46:01.553 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:46:01.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:01.555 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:46:01.612 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:46:01.612 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:46:01.612 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:46:01.612 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:46:01.612 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:46:01.613 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:46:01.613 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:46:01.613 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:46:01.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:46:01.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:46:01.613 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:46:01.613 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:46:01.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:46:01.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:01.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:01.750 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:46:01.806 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:46:01.807 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:46:01.807 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:01.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:01.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:46:01.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:01.871 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:01.927 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:01.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:01.927 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:01.982 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:46:01.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:01.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:02.088 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:02.088 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:02.088 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:02.106 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:02.106 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:02.106 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:02.106 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:02.106 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:02.116 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:02.117 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:02.117 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:02.117 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:02.117 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:02.117 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:46:02.117 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:46:02.117 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:46:02.121 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:46:02.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:02.121 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:02.141 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:46:02.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:46:02.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:02.251 INFO:teuthology.orchestra.run.smithi044.stdout:client8376 2024-09-17T05:46:02.252 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:02.252 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:02.261 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:02.261 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:02.261 DEBUG:teuthology.orchestra.run.smithi044:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:46:02.261 DEBUG:teuthology.orchestra.run.smithi044:> parent = os.path.join(mount_point, "parent") 2024-09-17T05:46:02.261 DEBUG:teuthology.orchestra.run.smithi044:> os.mkdir(parent) 2024-09-17T05:46:02.261 DEBUG:teuthology.orchestra.run.smithi044:> flushed = os.path.join(parent, "flushed") 2024-09-17T05:46:02.262 DEBUG:teuthology.orchestra.run.smithi044:> os.mkdir(flushed) 2024-09-17T05:46:02.262 DEBUG:teuthology.orchestra.run.smithi044:> for f in ["alpha", "bravo", "charlie"]: 2024-09-17T05:46:02.262 DEBUG:teuthology.orchestra.run.smithi044:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-09-17T05:46:02.262 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:02.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:02.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:02.394 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-09-17T05:46:02.450 INFO:teuthology.orchestra.run.smithi044.stdout:./ 2024-09-17T05:46:02.450 INFO:teuthology.orchestra.run.smithi044.stdout:./parent 2024-09-17T05:46:02.450 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed 2024-09-17T05:46:02.450 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/charlie 2024-09-17T05:46:02.450 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/alpha 2024-09-17T05:46:02.450 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/bravo 2024-09-17T05:46:02.451 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:02.451 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:02.452 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:02.452 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:02.452 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-09-17T05:46:02.452 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:02.564 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:46:02.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:02.574 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:02.574 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:02.574 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:02.574 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:02.574 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-09-17T05:46:02.575 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:02.680 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-17T05:46:02.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:02.689 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:02.690 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:02.690 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:02.690 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:02.690 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-09-17T05:46:02.690 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:02.800 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-17T05:46:02.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:02.810 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:02.810 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:02.811 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:02.811 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:02.811 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-09-17T05:46:02.811 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:02.923 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628280 2024-09-17T05:46:02.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:02.932 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:02.933 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:02.933 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:02.933 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:02.933 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-09-17T05:46:02.933 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:03.040 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-17T05:46:03.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:03.049 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:03.049 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:03.049 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:03.049 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:03.049 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-09-17T05:46:03.049 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:03.156 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628279 2024-09-17T05:46:03.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:03.166 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:03.166 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:03.219 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:03.219 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:03.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 -- 172.21.15.44:0/4047250930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840ce130 msgr2=0x7fb0840ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 --2- 172.21.15.44:0/4047250930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840ce130 0x7fb0840ce540 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fb08406ace0 tx=0x7fb07c01cd80 comp rx=0 tx=0).stop 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 -- 172.21.15.44:0/4047250930 shutdown_connections 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 --2- 172.21.15.44:0/4047250930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840ce130 0x7fb0840ce540 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 --2- 172.21.15.44:0/4047250930 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb08406e390 0x7fb0840cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 --2- 172.21.15.44:0/4047250930 >> v2:172.21.15.86:3300/0 conn(0x7fb0840b5880 0x7fb08406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 -- 172.21.15.44:0/4047250930 >> 172.21.15.44:0/4047250930 conn(0x7fb0840ccaa0 msgr2=0x7fb0840cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 -- 172.21.15.44:0/4047250930 shutdown_connections 2024-09-17T05:46:03.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 -- 172.21.15.44:0/4047250930 wait complete. 2024-09-17T05:46:03.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 Processor -- start 2024-09-17T05:46:03.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.480+0000 7fb089200640 1 -- start start 2024-09-17T05:46:03.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb08406e390 0x7fb0840a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:03.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840b5880 0x7fb084157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:03.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0840ce130 0x7fb08409c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:03.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb084070c70 con 0x7fb0840b5880 2024-09-17T05:46:03.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb084070af0 con 0x7fb08406e390 2024-09-17T05:46:03.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb084070df0 con 0x7fb0840ce130 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840b5880 0x7fb084157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840b5880 0x7fb084157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46900/0 (socket says 172.21.15.44:46900) 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 -- 172.21.15.44:0/2358847816 learned_addr learned my addr 172.21.15.44:0/2358847816 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb081e00640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb08406e390 0x7fb0840a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb082800640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0840ce130 0x7fb08409c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 -- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0840ce130 msgr2=0x7fb08409c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0840ce130 0x7fb08409c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 -- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb08406e390 msgr2=0x7fb0840a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb08406e390 0x7fb0840a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 -- 172.21.15.44:0/2358847816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0840a1010 con 0x7fb0840b5880 2024-09-17T05:46:03.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07be00640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840b5880 0x7fb084157b60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d610 tx=0x7fb06c00dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07a000640 1 -- 172.21.15.44:0/2358847816 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c017070 con 0x7fb0840b5880 2024-09-17T05:46:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07a000640 1 -- 172.21.15.44:0/2358847816 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb06c005330 con 0x7fb0840b5880 2024-09-17T05:46:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb07a000640 1 -- 172.21.15.44:0/2358847816 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0047b0 con 0x7fb0840b5880 2024-09-17T05:46:03.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08409ab50 con 0x7fb0840b5880 2024-09-17T05:46:03.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08409b110 con 0x7fb0840b5880 2024-09-17T05:46:03.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.484+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08406de50 con 0x7fb0840b5880 2024-09-17T05:46:03.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.488+0000 7fb07a000640 1 -- 172.21.15.44:0/2358847816 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb06c004950 con 0x7fb0840b5880 2024-09-17T05:46:03.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.488+0000 7fb07a000640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb060073230 0x7fb060075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:03.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.488+0000 7fb07a000640 1 -- 172.21.15.44:0/2358847816 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fb06c0943e0 con 0x7fb0840b5880 2024-09-17T05:46:03.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.488+0000 7fb081e00640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb060073230 0x7fb060075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:03.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.488+0000 7fb081e00640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb060073230 0x7fb060075740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb07400bb50 tx=0x7fb07400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:03.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.492+0000 7fb07a000640 1 -- 172.21.15.44:0/2358847816 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb06c05eb80 con 0x7fb0840b5880 2024-09-17T05:46:03.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb0840a1240 con 0x7fb0840b5880 2024-09-17T05:46:03.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb07a000640 1 -- 172.21.15.44:0/2358847816 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7fb06c0635b0 con 0x7fb0840b5880 2024-09-17T05:46:03.680 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb060073230 msgr2=0x7fb060075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb060073230 0x7fb060075740 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb07400bb50 tx=0x7fb07400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840b5880 msgr2=0x7fb084157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840b5880 0x7fb084157b60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00d610 tx=0x7fb06c00dad0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 shutdown_connections 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb0840ce130 0x7fb08409c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0840b5880 0x7fb084157b60 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb060073230 0x7fb060075740 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 --2- 172.21.15.44:0/2358847816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb08406e390 0x7fb0840a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.680+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 >> 172.21.15.44:0/2358847816 conn(0x7fb0840ccaa0 msgr2=0x7fb08415dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:03.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.684+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 shutdown_connections 2024-09-17T05:46:03.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.684+0000 7fb089200640 1 -- 172.21.15.44:0/2358847816 wait complete. 2024-09-17T05:46:03.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:46:03.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:03.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:03.771 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:03.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:03.772 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:46:03.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-09-17T05:46:03.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 -- 172.21.15.44:0/2617198275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 msgr2=0x7fee3c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 --2- 172.21.15.44:0/2617198275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c06e260 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fee3c06ace0 tx=0x7fee2801c830 comp rx=0 tx=0).stop 2024-09-17T05:46:03.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 -- 172.21.15.44:0/2617198275 shutdown_connections 2024-09-17T05:46:03.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 --2- 172.21.15.44:0/2617198275 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c06e260 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 --2- 172.21.15.44:0/2617198275 >> v2:172.21.15.86:3300/0 conn(0x7fee3c072e50 0x7fee3c15e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 -- 172.21.15.44:0/2617198275 >> 172.21.15.44:0/2617198275 conn(0x7fee3c0ccaa0 msgr2=0x7fee3c0cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:03.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 -- 172.21.15.44:0/2617198275 shutdown_connections 2024-09-17T05:46:03.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 -- 172.21.15.44:0/2617198275 wait complete. 2024-09-17T05:46:03.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 Processor -- start 2024-09-17T05:46:03.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.992+0000 7fee44000640 1 -- start start 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c0c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee3c072e50 0x7fee3c0c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee3c0ced00 0x7fee3c1fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c169370 con 0x7fee3c06de50 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c1691f0 con 0x7fee3c072e50 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c1694f0 con 0x7fee3c0ced00 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c0c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c0c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46920/0 (socket says 172.21.15.44:46920) 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 -- 172.21.15.44:0/1064250684 learned_addr learned my addr 172.21.15.44:0/1064250684 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee40c00640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee3c072e50 0x7fee3c0c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:03.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee42000640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee3c0ced00 0x7fee3c1fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 -- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee3c0ced00 msgr2=0x7fee3c1fb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee3c0ced00 0x7fee3c1fb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 -- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee3c072e50 msgr2=0x7fee3c0c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee3c072e50 0x7fee3c0c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 -- 172.21.15.44:0/1064250684 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c0b46a0 con 0x7fee3c06de50 2024-09-17T05:46:03.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee41600640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c0c2f90 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fee3000e7c0 tx=0x7fee3000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee39600640 1 -- 172.21.15.44:0/1064250684 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3000ccc0 con 0x7fee3c06de50 2024-09-17T05:46:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee39600640 1 -- 172.21.15.44:0/1064250684 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee3000ce80 con 0x7fee3c06de50 2024-09-17T05:46:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3c0b3e00 con 0x7fee3c06de50 2024-09-17T05:46:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee39600640 1 -- 172.21.15.44:0/1064250684 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30005280 con 0x7fee3c06de50 2024-09-17T05:46:03.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:03.996+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3c0b43c0 con 0x7fee3c06de50 2024-09-17T05:46:04.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee39600640 1 -- 172.21.15.44:0/1064250684 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fee30005420 con 0x7fee3c06de50 2024-09-17T05:46:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee39600640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee1c073230 0x7fee1c075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 Processor -- start 2024-09-17T05:46:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee39600640 1 -- 172.21.15.44:0/1064250684 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fee30094bb0 con 0x7fee3c06de50 2024-09-17T05:46:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 -- start start 2024-09-17T05:46:04.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee40c00640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee1c073230 0x7fee1c075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee40c00640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee1c073230 0x7fee1c075740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fee280af000 tx=0x7fee2801b070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:04.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a59de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a59def30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a59df470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5589a587dcd0 con 0x5589a558daa0 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5589a5793330 con 0x5589a58726d0 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.000+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5589a57f0bb0 con 0x5589a54c9890 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a59df470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a59df470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46930/0 (socket says 172.21.15.44:46930) 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 -- 172.21.15.44:0/602414795 learned_addr learned my addr 172.21.15.44:0/602414795 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee41600640 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a59de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee40c00640 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a59def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 -- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 msgr2=0x5589a59def30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a59def30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 -- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 msgr2=0x5589a59de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a59de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 -- 172.21.15.44:0/602414795 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a5794c80 con 0x5589a558daa0 2024-09-17T05:46:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee42000640 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a59df470 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fee34001c10 tx=0x7fee340020d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3616aef23e156461 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee2dc00640 1 -- 172.21.15.44:0/602414795 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34019070 con 0x5589a558daa0 2024-09-17T05:46:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee2dc00640 1 -- 172.21.15.44:0/602414795 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee34003b90 con 0x5589a558daa0 2024-09-17T05:46:04.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee2dc00640 1 -- 172.21.15.44:0/602414795 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee3400e800 con 0x5589a558daa0 2024-09-17T05:46:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 -- 172.21.15.44:0/602414795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 msgr2=0x5589a59df470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a59df470 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fee34001c10 tx=0x7fee340020d0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 -- 172.21.15.44:0/602414795 shutdown_connections 2024-09-17T05:46:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a59df470 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a59def30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 --2- 172.21.15.44:0/602414795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a59de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 -- 172.21.15.44:0/602414795 >> 172.21.15.44:0/602414795 conn(0x5589a549d5c0 msgr2=0x5589a599bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 -- 172.21.15.44:0/602414795 shutdown_connections 2024-09-17T05:46:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 -- 172.21.15.44:0/602414795 wait complete. 2024-09-17T05:46:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 -- start start 2024-09-17T05:46:04.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.004+0000 7fee4b813000 1 Processor -- start 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 0x5589a599a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a599aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 0x5589a59a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5589a57e3df0 con 0x5589a558daa0 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5589a57dffe0 con 0x5589a54c9890 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5589a57854d0 con 0x5589a58726d0 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 10 client.0 _ll_register_callbacks cb 0x5589a57637f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a599aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a599aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46936/0 (socket says 172.21.15.44:46936) 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 -- 172.21.15.44:0/3158050790 learned_addr learned my addr 172.21.15.44:0/3158050790 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee41600640 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 0x5589a599a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee42000640 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 0x5589a59a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 -- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 msgr2=0x5589a59a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 0x5589a59a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 -- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 msgr2=0x5589a599a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 0x5589a599a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 -- 172.21.15.44:0/3158050790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a577e210 con 0x5589a558daa0 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee40c00640 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a599aef0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fee28009850 tx=0x7fee28009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10551e76c73205ce server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee22000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee22000640 1 -- 172.21.15.44:0/3158050790 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280bf050 con 0x5589a558daa0 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee22000640 1 -- 172.21.15.44:0/3158050790 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fee28005240 con 0x5589a558daa0 2024-09-17T05:46:04.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5589a5778350 con 0x5589a558daa0 2024-09-17T05:46:04.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee22000640 1 -- 172.21.15.44:0/3158050790 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fee280d1050 con 0x5589a558daa0 2024-09-17T05:46:04.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 10 client.8394 fetch_fsmap learned FSMap version 100 2024-09-17T05:46:04.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x5589a5764fc0 con 0x5589a558daa0 2024-09-17T05:46:04.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee22000640 1 -- 172.21.15.44:0/3158050790 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5589a5778350 con 0x5589a558daa0 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee22000640 1 -- 172.21.15.44:0/3158050790 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fee280d4020 con 0x5589a558daa0 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 10 client.8394 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 10 client.8394 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 20 client.8394 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5482930 0x5589a59e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 4 client.8394 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 --> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589a57f2b00 con 0x5589a5482930 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee41600640 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5482930 0x5589a59e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee41600640 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5482930 0x5589a59e5e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4e248e614ba91cf server_cookie=a04ae7912a28d486 in_seq=0 out_seq=0 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.008+0000 7fee22000640 10 client.8394 ms_handle_connect on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee22000640 1 -- 172.21.15.44:0/3158050790 <== mds.0 v2:172.21.15.44:6834/1819525564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589a57f2b00 con 0x5589a5482930 2024-09-17T05:46:04.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee22000640 10 client.8394 handle_command_reply: tid=0 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 client.8394 shutdown 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 msgr2=0x5589a599aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a599aef0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fee28009850 tx=0x7fee28009260 comp rx=0 tx=0).stop 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 shutdown_connections 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5482930 0x5589a59e5e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 0x5589a59a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a599aef0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee22000640 0 client.8394 ms_handle_reset on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 --2- 172.21.15.44:0/3158050790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 0x5589a599a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 >> 172.21.15.44:0/3158050790 conn(0x5589a549d5c0 msgr2=0x5589a5993d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 shutdown_connections 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 1 -- 172.21.15.44:0/3158050790 wait complete. 2024-09-17T05:46:04.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.012+0000 7fee4b813000 20 client.8394 trim_cache size 0 max 16384 2024-09-17T05:46:04.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 Processor -- start 2024-09-17T05:46:04.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 -- start start 2024-09-17T05:46:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 0x5589a5a54810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a54d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 0x5589a5a55290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5589a5999b20 con 0x5589a558daa0 2024-09-17T05:46:04.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c203fa0 con 0x5589a54c9890 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c0c7be0 con 0x5589a58726d0 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a54d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a54d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46942/0 (socket says 172.21.15.44:46942) 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 -- 172.21.15.44:0/804384409 learned_addr learned my addr 172.21.15.44:0/804384409 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 -- 172.21.15.44:0/804384409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 msgr2=0x5589a5a55290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 --2- 172.21.15.44:0/804384409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 0x5589a5a55290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 -- 172.21.15.44:0/804384409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 msgr2=0x5589a5a54810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 --2- 172.21.15.44:0/804384409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 0x5589a5a54810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 -- 172.21.15.44:0/804384409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a583d680 con 0x5589a558daa0 2024-09-17T05:46:04.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee40c00640 1 --2- 172.21.15.44:0/804384409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a54d50 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fee280b0040 tx=0x7fee280097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3825812f6c1e367 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:04.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee2d200640 1 -- 172.21.15.44:0/804384409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280bf070 con 0x5589a558daa0 2024-09-17T05:46:04.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee2d200640 1 -- 172.21.15.44:0/804384409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee280c9070 con 0x5589a558daa0 2024-09-17T05:46:04.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.028+0000 7fee2d200640 1 -- 172.21.15.44:0/804384409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280b2040 con 0x5589a558daa0 2024-09-17T05:46:04.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- 172.21.15.44:0/804384409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 msgr2=0x5589a5a54d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 --2- 172.21.15.44:0/804384409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a54d50 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fee280b0040 tx=0x7fee280097c0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- 172.21.15.44:0/804384409 shutdown_connections 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 --2- 172.21.15.44:0/804384409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a58726d0 0x5589a5a55290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 --2- 172.21.15.44:0/804384409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a54d50 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 --2- 172.21.15.44:0/804384409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a54c9890 0x5589a5a54810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- 172.21.15.44:0/804384409 >> 172.21.15.44:0/804384409 conn(0x5589a549d5c0 msgr2=0x5589a59f0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- 172.21.15.44:0/804384409 shutdown_connections 2024-09-17T05:46:04.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- 172.21.15.44:0/804384409 wait complete. 2024-09-17T05:46:04.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- start start 2024-09-17T05:46:04.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 Processor -- start 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a5a58a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a58fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a5a594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c0c7590 con 0x5589a558daa0 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c0c6f40 con 0x5589a58726d0 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5589a54a5680 con 0x5589a54c9890 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee4b813000 10 client.0 _ll_register_callbacks cb 0x7fee280bc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a58fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a58fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46954/0 (socket says 172.21.15.44:46954) 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 -- 172.21.15.44:0/2045761379 learned_addr learned my addr 172.21.15.44:0/2045761379 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:04.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee42000640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a5a594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee41600640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a5a58a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 -- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 msgr2=0x5589a5a58a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a5a58a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 -- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 msgr2=0x5589a5a594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a5a594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 -- 172.21.15.44:0/2045761379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a57aa0b0 con 0x5589a558daa0 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee42000640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a5a594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee41600640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a5a58a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee40c00640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a58fa0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fee2801cda0 tx=0x7fee28003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352facd14537e2ea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.032+0000 7fee22000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee22000640 1 -- 172.21.15.44:0/2045761379 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280bf040 con 0x5589a558daa0 2024-09-17T05:46:04.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee22000640 1 -- 172.21.15.44:0/2045761379 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fee28003df0 con 0x5589a558daa0 2024-09-17T05:46:04.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee280c9070 con 0x5589a558daa0 2024-09-17T05:46:04.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee22000640 1 -- 172.21.15.44:0/2045761379 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fee280b2040 con 0x5589a558daa0 2024-09-17T05:46:04.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 10 client.8400 fetch_fsmap learned FSMap version 100 2024-09-17T05:46:04.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x5589a5776610 con 0x5589a558daa0 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee22000640 1 -- 172.21.15.44:0/2045761379 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee280c9070 con 0x5589a558daa0 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee22000640 1 -- 172.21.15.44:0/2045761379 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fee280d4040 con 0x5589a558daa0 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 10 client.8400 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 10 client.8400 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 20 client.8400 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5470990 0x5589a5995770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 4 client.8400 mds_command: new command op to 8235 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 --> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5589a57ee5b0 con 0x5589a5470990 2024-09-17T05:46:04.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee41600640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5470990 0x5589a5995770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee41600640 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5470990 0x5589a5995770 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=862fa680abfc37d4 server_cookie=97b79a844f26def8 in_seq=0 out_seq=0 2024-09-17T05:46:04.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.036+0000 7fee22000640 10 client.8400 ms_handle_connect on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.048+0000 7fee22000640 1 -- 172.21.15.44:0/2045761379 <== mds.0 v2:172.21.15.44:6834/1819525564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5589a57ee5b0 con 0x5589a5470990 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.048+0000 7fee22000640 10 client.8400 handle_command_reply: tid=0 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.048+0000 7fee4b813000 1 client.8400 shutdown 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 msgr2=0x5589a5a58fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a58fa0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fee2801cda0 tx=0x7fee28003a00 comp rx=0 tx=0).stop 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 shutdown_connections 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:6834/1819525564,v1:172.21.15.44:6835/1819525564] conn(0x5589a5470990 0x5589a5995770 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5589a58726d0 0x5589a5a594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5589a558daa0 0x5589a5a58fa0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 --2- 172.21.15.44:0/2045761379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5589a54c9890 0x5589a5a58a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee22000640 0 client.8400 ms_handle_reset on v2:172.21.15.44:6834/1819525564 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 >> 172.21.15.44:0/2045761379 conn(0x5589a549d5c0 msgr2=0x5589a59a05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 shutdown_connections 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 1 -- 172.21.15.44:0/2045761379 wait complete. 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee4b813000 20 client.8400 trim_cache size 0 max 16384 2024-09-17T05:46:04.052 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "message": "", 2024-09-17T05:46:04.053 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0 2024-09-17T05:46:04.053 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:04.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee1c073230 msgr2=0x7fee1c075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee1c073230 0x7fee1c075740 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fee280af000 tx=0x7fee2801b070 comp rx=0 tx=0).stop 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 msgr2=0x7fee3c0c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c0c2f90 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fee3000e7c0 tx=0x7fee3000ec80 comp rx=0 tx=0).stop 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 shutdown_connections 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fee3c0ced00 0x7fee3c1fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fee1c073230 0x7fee1c075740 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee3c072e50 0x7fee3c0c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 --2- 172.21.15.44:0/1064250684 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee3c06de50 0x7fee3c0c2f90 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 >> 172.21.15.44:0/1064250684 conn(0x7fee3c0ccaa0 msgr2=0x7fee3c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 shutdown_connections 2024-09-17T05:46:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.052+0000 7fee44000640 1 -- 172.21.15.44:0/1064250684 wait complete. 2024-09-17T05:46:04.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:46:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.228+0000 7fec28600640 1 -- 172.21.15.44:0/1527713810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200d18f0 msgr2=0x7fec200b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.228+0000 7fec28600640 1 --2- 172.21.15.44:0/1527713810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200d18f0 0x7fec200b1be0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fec200744e0 tx=0x7fec1401c800 comp rx=0 tx=0).stop 2024-09-17T05:46:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.228+0000 7fec28600640 1 -- 172.21.15.44:0/1527713810 shutdown_connections 2024-09-17T05:46:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.228+0000 7fec28600640 1 --2- 172.21.15.44:0/1527713810 >> v2:172.21.15.86:3300/0 conn(0x7fec200d1d00 0x7fec200cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.228+0000 7fec28600640 1 --2- 172.21.15.44:0/1527713810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200d18f0 0x7fec200b1be0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.228+0000 7fec28600640 1 -- 172.21.15.44:0/1527713810 >> 172.21.15.44:0/1527713810 conn(0x7fec200b4240 msgr2=0x7fec200b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:04.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.228+0000 7fec28600640 1 -- 172.21.15.44:0/1527713810 shutdown_connections 2024-09-17T05:46:04.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 -- 172.21.15.44:0/1527713810 wait complete. 2024-09-17T05:46:04.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 Processor -- start 2024-09-17T05:46:04.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 -- start start 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200cf5b0 0x7fec201fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec200d18f0 0x7fec200d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec200d1d00 0x7fec201582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec20169e80 con 0x7fec200cf5b0 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fec20169d00 con 0x7fec200d1d00 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec28600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fec2016a000 con 0x7fec200d18f0 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.232+0000 7fec25c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200cf5b0 0x7fec201fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200cf5b0 0x7fec201fc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46968/0 (socket says 172.21.15.44:46968) 2024-09-17T05:46:04.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 -- 172.21.15.44:0/1822838164 learned_addr learned my addr 172.21.15.44:0/1822838164 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 -- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec200d18f0 msgr2=0x7fec200d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec200d18f0 0x7fec200d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 -- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec200d1d00 msgr2=0x7fec201582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec200d1d00 0x7fec201582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 -- 172.21.15.44:0/1822838164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec200cd380 con 0x7fec200cf5b0 2024-09-17T05:46:04.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec25c00640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200cf5b0 0x7fec201fc480 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fec140b0040 tx=0x7fec140a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec1d600640 1 -- 172.21.15.44:0/1822838164 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec140b2040 con 0x7fec200cf5b0 2024-09-17T05:46:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec1d600640 1 -- 172.21.15.44:0/1822838164 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec140043b0 con 0x7fec200cf5b0 2024-09-17T05:46:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec201fcf40 con 0x7fec200cf5b0 2024-09-17T05:46:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec1d600640 1 -- 172.21.15.44:0/1822838164 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14005280 con 0x7fec200cf5b0 2024-09-17T05:46:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec200b63a0 con 0x7fec200cf5b0 2024-09-17T05:46:04.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec200b6190 con 0x7fec200cf5b0 2024-09-17T05:46:04.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.236+0000 7fec1d600640 1 -- 172.21.15.44:0/1822838164 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fec14005420 con 0x7fec200cf5b0 2024-09-17T05:46:04.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.240+0000 7fec1d600640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fec00073230 0x7fec00075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:04.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.240+0000 7fec1d600640 1 -- 172.21.15.44:0/1822838164 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7fec1412e080 con 0x7fec200cf5b0 2024-09-17T05:46:04.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.240+0000 7fec25200640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fec00073230 0x7fec00075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:04.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.240+0000 7fec25200640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fec00073230 0x7fec00075740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fec20072150 tx=0x7fec0c00b370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:04.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.244+0000 7fec1d600640 1 -- 172.21.15.44:0/1822838164 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fec140164b0 con 0x7fec200cf5b0 2024-09-17T05:46:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fec200b1be0 con 0x7fec200cf5b0 2024-09-17T05:46:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec1d600640 1 -- 172.21.15.44:0/1822838164 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7fec140f8e80 con 0x7fec200cf5b0 2024-09-17T05:46:04.455 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:46:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fec00073230 msgr2=0x7fec00075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fec00073230 0x7fec00075740 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fec20072150 tx=0x7fec0c00b370 comp rx=0 tx=0).stop 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200cf5b0 msgr2=0x7fec201fc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200cf5b0 0x7fec201fc480 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fec140b0040 tx=0x7fec140a5650 comp rx=0 tx=0).stop 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 shutdown_connections 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fec00073230 0x7fec00075740 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec200d1d00 0x7fec201582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fec200d18f0 0x7fec200d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 --2- 172.21.15.44:0/1822838164 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec200cf5b0 0x7fec201fc480 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 >> 172.21.15.44:0/1822838164 conn(0x7fec200b4240 msgr2=0x7fec200b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 shutdown_connections 2024-09-17T05:46:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04.456+0000 7fec28600640 1 -- 172.21.15.44:0/1822838164 wait complete. 2024-09-17T05:46:04.477 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:46:04.477 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:46:04.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:46:04.478 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:46:04.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:04.478 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:46:04.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:46:04.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:46:04.478 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:04.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:04.478 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:46:04.487 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:46:04.487 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:46:04.487 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:46:04.488 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41841sec preferred_lft 41841sec 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:46:04.489 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:46:04.490 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:04.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:04.491 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:46:04.552 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:46:04.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:04.554 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:46:04.608 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:46:04.608 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:46:04.608 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:46:04.608 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:46:04.608 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:46:04.608 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:46:04.609 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:46:04.609 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:46:04.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:46:04.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:46:04.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:46:04.609 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:46:04.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:46:04.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:04.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:04.746 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:46:04.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:46:04.755 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:46:04.756 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:04.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:04.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:46:04.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:04.819 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:04.870 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:04.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:04.871 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:04.926 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:46:04.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:04.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:05.031 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:05.032 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:05.032 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:05.050 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:05.050 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:05.050 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:05.050 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:05.050 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:05.059 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:05.059 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:05.059 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:05.059 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:05.060 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:05.060 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:46:05.060 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:46:05.060 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:46:05.063 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:46:05.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:05.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:05.083 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:46:05.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:46:05.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:05.184 INFO:teuthology.orchestra.run.smithi044.stdout:client8412 2024-09-17T05:46:05.185 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:05.185 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:05.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:05.194 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-09-17T05:46:05.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:05.248 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-09-17T05:46:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:8+0 records in 2024-09-17T05:46:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:8+0 records out 2024-09-17T05:46:05.348 INFO:teuthology.orchestra.run.smithi044.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0467335 s, 179 MB/s 2024-09-17T05:46:05.349 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:05.349 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:05.349 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:05.349 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:05.349 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-09-17T05:46:05.349 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:05.416 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627779 2024-09-17T05:46:05.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:05.425 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:05.425 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:05.425 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:05.425 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:05.425 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-09-17T05:46:05.425 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:05.536 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627780 2024-09-17T05:46:05.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:05.545 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:05.546 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:05.598 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:05.599 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:05.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 -- 172.21.15.44:0/1651057740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 msgr2=0x7f10540cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 --2- 172.21.15.44:0/1651057740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f10540cec50 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1044009900 tx=0x7f104401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 -- 172.21.15.44:0/1651057740 shutdown_connections 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 --2- 172.21.15.44:0/1651057740 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f105415bd30 0x7f10540cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 --2- 172.21.15.44:0/1651057740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f10540cec50 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 -- 172.21.15.44:0/1651057740 >> 172.21.15.44:0/1651057740 conn(0x7f10540ccaa0 msgr2=0x7f10540cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 -- 172.21.15.44:0/1651057740 shutdown_connections 2024-09-17T05:46:05.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.848+0000 7f105b400640 1 -- 172.21.15.44:0/1651057740 wait complete. 2024-09-17T05:46:05.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 Processor -- start 2024-09-17T05:46:05.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 -- start start 2024-09-17T05:46:05.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f1054157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10540cb040 0x7f1054164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f105415bd30 0x7f1054165400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1054165dd0 con 0x7f10540cac30 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1054165c50 con 0x7f10540cb040 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1054165f50 con 0x7f105415bd30 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f1054157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f1054157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46990/0 (socket says 172.21.15.44:46990) 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 -- 172.21.15.44:0/609122690 learned_addr learned my addr 172.21.15.44:0/609122690 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1059400640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f105415bd30 0x7f1054165400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f104be00640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10540cb040 0x7f1054164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:05.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 -- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f105415bd30 msgr2=0x7f1054165400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f105415bd30 0x7f1054165400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 -- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10540cb040 msgr2=0x7f1054164ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10540cb040 0x7f1054164ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 -- 172.21.15.44:0/609122690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541fc500 con 0x7f10540cac30 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1058a00640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f1054157130 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f10440b0040 tx=0x7f10440a5690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1051600640 1 -- 172.21.15.44:0/609122690 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10440b2040 con 0x7f10540cac30 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1051600640 1 -- 172.21.15.44:0/609122690 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10440043b0 con 0x7f10540cac30 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f1051600640 1 -- 172.21.15.44:0/609122690 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044005270 con 0x7f10540cac30 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.852+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541fc7e0 con 0x7f10540cac30 2024-09-17T05:46:05.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.856+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541fcda0 con 0x7f10540cac30 2024-09-17T05:46:05.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.856+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105415e8c0 con 0x7f10540cac30 2024-09-17T05:46:05.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.856+0000 7f1051600640 1 -- 172.21.15.44:0/609122690 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f10440be060 con 0x7f10540cac30 2024-09-17T05:46:05.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.856+0000 7f1051600640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1030073230 0x7f1030075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:05.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.856+0000 7f1051600640 1 -- 172.21.15.44:0/609122690 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f104412d8c0 con 0x7f10540cac30 2024-09-17T05:46:05.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.856+0000 7f104be00640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1030073230 0x7f1030075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.860+0000 7f104be00640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1030073230 0x7f1030075740 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f105415e630 tx=0x7f103c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:05.860+0000 7f1051600640 1 -- 172.21.15.44:0/609122690 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f10440164d0 con 0x7f10540cac30 2024-09-17T05:46:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.048+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f10540b5fa0 con 0x7f10540cac30 2024-09-17T05:46:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.048+0000 7f1051600640 1 -- 172.21.15.44:0/609122690 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f10440ffe20 con 0x7f10540cac30 2024-09-17T05:46:06.050 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1030073230 msgr2=0x7f1030075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1030073230 0x7f1030075740 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f105415e630 tx=0x7f103c009040 comp rx=0 tx=0).stop 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 msgr2=0x7f1054157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f1054157130 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f10440b0040 tx=0x7f10440a5690 comp rx=0 tx=0).stop 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 shutdown_connections 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f105415bd30 0x7f1054165400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1030073230 0x7f1030075740 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10540cb040 0x7f1054164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 --2- 172.21.15.44:0/609122690 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f10540cac30 0x7f1054157130 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 >> 172.21.15.44:0/609122690 conn(0x7f10540ccaa0 msgr2=0x7f10541586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 shutdown_connections 2024-09-17T05:46:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.052+0000 7f105b400640 1 -- 172.21.15.44:0/609122690 wait complete. 2024-09-17T05:46:06.072 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:46:06.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:06.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:06.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:06.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:06.199 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:46:06.220 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:06.220 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:06.275 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:46:06.275 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:06.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:06.275 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:46:06.330 INFO:teuthology.orchestra.run.smithi044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-17T05:46:06.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:46:06.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:46:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.532+0000 7f5394e00640 1 -- 172.21.15.44:0/321973379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5390070e00 msgr2=0x7f5390071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.532+0000 7f5394e00640 1 --2- 172.21.15.44:0/321973379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5390070e00 0x7f5390071c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5380009870 tx=0x7f538001c6f0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.532+0000 7f5394e00640 1 -- 172.21.15.44:0/321973379 shutdown_connections 2024-09-17T05:46:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.532+0000 7f5394e00640 1 --2- 172.21.15.44:0/321973379 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5390070e00 0x7f5390071c60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.532+0000 7f5394e00640 1 -- 172.21.15.44:0/321973379 >> 172.21.15.44:0/321973379 conn(0x7f53900cd930 msgr2=0x7f53900cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.532+0000 7f5394e00640 1 -- 172.21.15.44:0/321973379 shutdown_connections 2024-09-17T05:46:06.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.532+0000 7f5394e00640 1 -- 172.21.15.44:0/321973379 wait complete. 2024-09-17T05:46:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 Processor -- start 2024-09-17T05:46:06.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 -- start start 2024-09-17T05:46:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5390070e00 0x7f53900b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53900ccb60 0x7f53901409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53900c9be0 0x7f53900c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5390169bc0 con 0x7f5390070e00 2024-09-17T05:46:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5390169a40 con 0x7f53900ccb60 2024-09-17T05:46:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f5394e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5390169d40 con 0x7f53900c9be0 2024-09-17T05:46:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f538de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5390070e00 0x7f53900b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:06.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f538de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5390070e00 0x7f53900b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46998/0 (socket says 172.21.15.44:46998) 2024-09-17T05:46:06.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f538de00640 1 -- 172.21.15.44:0/475593170 learned_addr learned my addr 172.21.15.44:0/475593170 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:06.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f538de00640 1 -- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53900c9be0 msgr2=0x7f53900c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.536+0000 7f538de00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53900c9be0 0x7f53900c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f538de00640 1 -- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53900ccb60 msgr2=0x7f53901409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f538de00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53900ccb60 0x7f53901409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f538de00640 1 -- 172.21.15.44:0/475593170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53900ca530 con 0x7f5390070e00 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f538de00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5390070e00 0x7f53900b3860 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f5380098090 tx=0x7f5380005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5386000640 1 -- 172.21.15.44:0/475593170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800bf070 con 0x7f5390070e00 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5386000640 1 -- 172.21.15.44:0/475593170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53800a9ad0 con 0x7f5390070e00 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53900b1440 con 0x7f5390070e00 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5386000640 1 -- 172.21.15.44:0/475593170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800ad050 con 0x7f5390070e00 2024-09-17T05:46:06.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53901fbee0 con 0x7f5390070e00 2024-09-17T05:46:06.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5390071c60 con 0x7f5390070e00 2024-09-17T05:46:06.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5386000640 1 -- 172.21.15.44:0/475593170 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f53800b0070 con 0x7f5390070e00 2024-09-17T05:46:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5386000640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5370073200 0x7f5370075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:06.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.540+0000 7f5386000640 1 -- 172.21.15.44:0/475593170 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 6101+0+0 (secure 0 0 0) 0x7f538012e550 con 0x7f5390070e00 2024-09-17T05:46:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.544+0000 7f538d400640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5370073200 0x7f5370075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:06.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.544+0000 7f538d400640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5370073200 0x7f5370075710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f539014b1c0 tx=0x7f537c0079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:06.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.548+0000 7f5386000640 1 -- 172.21.15.44:0/475593170 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f53900ca530 con 0x7f5390070e00 2024-09-17T05:46:06.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.756+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5390145650 con 0x7f5390070e00 2024-09-17T05:46:06.757 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:46:06.756+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:46:06.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5386000640 1 -- 172.21.15.44:0/475593170 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v101) ==== 161+0+0 (secure 0 0 0) 0x7f53800b7070 con 0x7f5390070e00 2024-09-17T05:46:06.759 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:46:06.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5370073200 msgr2=0x7f5370075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:06.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5370073200 0x7f5370075710 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f539014b1c0 tx=0x7f537c0079d0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5390070e00 msgr2=0x7f53900b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:06.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5390070e00 0x7f53900b3860 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f5380098090 tx=0x7f5380005ca0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 shutdown_connections 2024-09-17T05:46:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f53900c9be0 0x7f53900c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5370073200 0x7f5370075710 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f53900ccb60 0x7f53901409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 --2- 172.21.15.44:0/475593170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5390070e00 0x7f53900b3860 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 >> 172.21.15.44:0/475593170 conn(0x7f53900cd930 msgr2=0x7f5390141a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 shutdown_connections 2024-09-17T05:46:06.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:06.760+0000 7f5394e00640 1 -- 172.21.15.44:0/475593170 wait complete. 2024-09-17T05:46:06.773 INFO:tasks.ceph.mds.c.smithi044.stderr: -9581> 2024-09-17T05:45:56.864+0000 7f9739e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:46:06.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:06.787 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:06.830 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-17T05:46:06.830 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-17T05:46:06.830 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:06.830 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-17T05:46:06.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.830 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-17T05:46:06.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:06.831 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:06.832 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-09-17T05:46:06.833 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-17T05:46:06.834 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.835 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:06.836 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-17T05:46:06.837 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:06.838 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:06.839 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-09-17T05:46:06.840 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = False 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:06.841 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.842 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:06.843 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-17T05:46:06.844 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.845 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-17T05:46:06.846 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.847 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-17T05:46:06.848 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.849 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: mon down mkfs grace = 300 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-17T05:46:06.850 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = "" 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-17T05:46:06.851 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-17T05:46:06.852 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2024-09-17T05:46:06.852 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = False 2024-09-17T05:46:06.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:06.897 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:06.901 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:46:06.938 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-17T05:46:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-17T05:46:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-17T05:46:06.939 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:06.940 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.941 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:06.942 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.943 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2024-09-17T05:46:06.944 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:06.945 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:06.946 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:06.947 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-17T05:46:06.948 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = False 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = False 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-17T05:46:06.949 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:06.951 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:06.952 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.953 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-17T05:46:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-17T05:46:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-17T05:46:06.954 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:06.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-17T05:46:06.956 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:06.958 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:06.959 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.960 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: mon down mkfs grace = 300 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = "" 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-17T05:46:06.961 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-17T05:46:06.962 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-17T05:46:06.962 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-17T05:46:06.962 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-17T05:46:06.962 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2024-09-17T05:46:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = False 2024-09-17T05:46:06.962 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = False 2024-09-17T05:46:06.963 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-09-17T05:46:07.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.064+0000 7f95e1938080 1 Processor -- start 2024-09-17T05:46:07.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.064+0000 7f95e1938080 1 -- start start 2024-09-17T05:46:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 0x5617e55c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5733800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 0x5617e5733d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5617e560fdb0 con 0x5617e55f31c0 2024-09-17T05:46:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5617e5514a00 con 0x5617e5684020 2024-09-17T05:46:07.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5617e5610050 con 0x5617e55f2db0 2024-09-17T05:46:07.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5733800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5733800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47032/0 (socket says 172.21.15.44:47032) 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 -- 172.21.15.44:0/1225765357 learned_addr learned my addr 172.21.15.44:0/1225765357 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 -- 172.21.15.44:0/1225765357 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 msgr2=0x5617e55c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 --2- 172.21.15.44:0/1225765357 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 0x5617e55c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 -- 172.21.15.44:0/1225765357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 msgr2=0x5617e5733d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 --2- 172.21.15.44:0/1225765357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 0x5617e5733d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 -- 172.21.15.44:0/1225765357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e5513a20 con 0x5617e55f31c0 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95da000640 1 --2- 172.21.15.44:0/1225765357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5733800 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c590 tx=0x7f95c800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cebda742d09680 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95d8c00640 1 -- 172.21.15.44:0/1225765357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c800a9f0 con 0x5617e55f31c0 2024-09-17T05:46:07.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95d8c00640 1 -- 172.21.15.44:0/1225765357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95c800ab90 con 0x5617e55f31c0 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95d8c00640 1 -- 172.21.15.44:0/1225765357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8015440 con 0x5617e55f31c0 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- 172.21.15.44:0/1225765357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 msgr2=0x5617e5733800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 --2- 172.21.15.44:0/1225765357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5733800 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c590 tx=0x7f95c800c990 comp rx=0 tx=0).stop 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- 172.21.15.44:0/1225765357 shutdown_connections 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 --2- 172.21.15.44:0/1225765357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 0x5617e5733d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 --2- 172.21.15.44:0/1225765357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5733800 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 --2- 172.21.15.44:0/1225765357 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 0x5617e55c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- 172.21.15.44:0/1225765357 >> 172.21.15.44:0/1225765357 conn(0x5617e55b2d60 msgr2=0x5617e569d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- 172.21.15.44:0/1225765357 shutdown_connections 2024-09-17T05:46:07.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.068+0000 7f95e1938080 1 -- 172.21.15.44:0/1225765357 wait complete. 2024-09-17T05:46:07.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 Processor -- start 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 -- start start 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 0x5617e5737bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5672650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 0x5617e5683120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5617e569a370 con 0x5617e55f31c0 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5617e560d860 con 0x5617e5684020 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5617e569a610 con 0x5617e55f2db0 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5672650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95daa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 0x5617e5737bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95daa00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 0x5617e5737bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3301/0 says I am v2:172.21.15.44:51028/0 (socket says 172.21.15.44:51028) 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5672650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47046/0 (socket says 172.21.15.44:47046) 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95db400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 0x5617e5683120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95daa00640 1 -- 172.21.15.44:0/2089335808 learned_addr learned my addr 172.21.15.44:0/2089335808 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:07.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 -- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 msgr2=0x5617e5737bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5617e55f2db0 0x5617e5737bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 -- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 msgr2=0x5617e5683120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5617e5684020 0x5617e5683120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 -- 172.21.15.44:0/2089335808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e54edc10 con 0x5617e55f31c0 2024-09-17T05:46:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95da000640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5672650 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c560 tx=0x7f95c80157b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95d3400640 1 -- 172.21.15.44:0/2089335808 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8023030 con 0x5617e55f31c0 2024-09-17T05:46:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95d3400640 1 -- 172.21.15.44:0/2089335808 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95c8015ca0 con 0x5617e55f31c0 2024-09-17T05:46:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95d3400640 1 -- 172.21.15.44:0/2089335808 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c801f410 con 0x5617e55f31c0 2024-09-17T05:46:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617e56730b0 con 0x5617e55f31c0 2024-09-17T05:46:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.072+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617e56735f0 con 0x5617e55f31c0 2024-09-17T05:46:07.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95d3400640 1 -- 172.21.15.44:0/2089335808 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f95c8026070 con 0x5617e55f31c0 2024-09-17T05:46:07.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95d3400640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95bc071be0 0x7f95bc0740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95d3400640 1 -- 172.21.15.44:0/2089335808 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f95c8094dd0 con 0x5617e55f31c0 2024-09-17T05:46:07.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95daa00640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95bc071be0 0x7f95bc0740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95e1938080 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5617e5672b90 0x5617e573b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) -- 0x5617e573a390 con 0x5617e5672b90 2024-09-17T05:46:07.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95db400640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5617e5672b90 0x5617e573b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.076+0000 7f95daa00640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95bc071be0 0x7f95bc0740f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0041c0 tx=0x7f95cc00e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95db400640 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5617e5672b90 0x5617e573b640 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95db400640 1 -- 172.21.15.44:0/2089335808 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v120'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f95d40a7d70 con 0x5617e5672b90 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5617e5672b90 msgr2=0x5617e573b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5617e5672b90 0x5617e573b640 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95bc071be0 msgr2=0x7f95bc0740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f95bc071be0 0x7f95bc0740f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0041c0 tx=0x7f95cc00e040 comp rx=0 tx=0).stop 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 msgr2=0x5617e5672650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 --2- 172.21.15.44:0/2089335808 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5617e55f31c0 0x5617e5672650 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c560 tx=0x7f95c80157b0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95db400640 1 -- 172.21.15.44:0/2089335808 reap_dead start 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 shutdown_connections 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 >> 172.21.15.44:0/2089335808 conn(0x5617e55b2d60 msgr2=0x5617e55c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 shutdown_connections 2024-09-17T05:46:07.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.080+0000 7f95e1938080 1 -- 172.21.15.44:0/2089335808 wait complete. 2024-09-17T05:46:07.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 -- 172.21.15.44:0/1428476590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0ce730 msgr2=0x7ff84c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 --2- 172.21.15.44:0/1428476590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0ce730 0x7ff84c0ceb40 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff84c0711c0 tx=0x7ff84401cd80 comp rx=0 tx=0).stop 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 -- 172.21.15.44:0/1428476590 shutdown_connections 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 --2- 172.21.15.44:0/1428476590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0ce730 0x7ff84c0ceb40 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 --2- 172.21.15.44:0/1428476590 >> v2:172.21.15.86:3300/0 conn(0x7ff84c0b3910 0x7ff84c0ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 --2- 172.21.15.44:0/1428476590 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff84c09df30 0x7ff84c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 -- 172.21.15.44:0/1428476590 >> 172.21.15.44:0/1428476590 conn(0x7ff84c06d450 msgr2=0x7ff84c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 -- 172.21.15.44:0/1428476590 shutdown_connections 2024-09-17T05:46:07.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 -- 172.21.15.44:0/1428476590 wait complete. 2024-09-17T05:46:07.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 Processor -- start 2024-09-17T05:46:07.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.248+0000 7ff852c00640 1 -- start start 2024-09-17T05:46:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff84c09df30 0x7ff84c09a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0b3910 0x7ff84c09b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff84c0ce730 0x7ff84c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c0ccef0 con 0x7ff84c0b3910 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c0ccd70 con 0x7ff84c09df30 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c0cd070 con 0x7ff84c0ce730 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0b3910 0x7ff84c09b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0b3910 0x7ff84c09b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47052/0 (socket says 172.21.15.44:47052) 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 -- 172.21.15.44:0/3176040611 learned_addr learned my addr 172.21.15.44:0/3176040611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff84be00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff84c09df30 0x7ff84c09a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff850c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff84c0ce730 0x7ff84c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 -- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff84c0ce730 msgr2=0x7ff84c1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff84c0ce730 0x7ff84c1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 -- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff84c09df30 msgr2=0x7ff84c09a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff84c09df30 0x7ff84c09a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 -- 172.21.15.44:0/3176040611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c1fc0b0 con 0x7ff84c0b3910 2024-09-17T05:46:07.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff843e00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0b3910 0x7ff84c09b7f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e7a0 tx=0x7ff83400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff848c00640 1 -- 172.21.15.44:0/3176040611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83400ccc0 con 0x7ff84c0b3910 2024-09-17T05:46:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff848c00640 1 -- 172.21.15.44:0/3176040611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff83400ce60 con 0x7ff84c0b3910 2024-09-17T05:46:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c1fccc0 con 0x7ff84c0b3910 2024-09-17T05:46:07.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff848c00640 1 -- 172.21.15.44:0/3176040611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834004280 con 0x7ff84c0b3910 2024-09-17T05:46:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c1fc670 con 0x7ff84c0b3910 2024-09-17T05:46:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.252+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84c0ce1f0 con 0x7ff84c0b3910 2024-09-17T05:46:07.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.256+0000 7ff848c00640 1 -- 172.21.15.44:0/3176040611 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff834003600 con 0x7ff84c0b3910 2024-09-17T05:46:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.256+0000 7ff848c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff828073230 0x7ff828075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.256+0000 7ff848c00640 1 -- 172.21.15.44:0/3176040611 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7ff834094cb0 con 0x7ff84c0b3910 2024-09-17T05:46:07.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.256+0000 7ff84be00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff828073230 0x7ff828075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.256+0000 7ff84be00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff828073230 0x7ff828075740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff83c004610 tx=0x7ff83c00b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.260+0000 7ff848c00640 1 -- 172.21.15.44:0/3176040611 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff83405f490 con 0x7ff84c0b3910 2024-09-17T05:46:07.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.472+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7ff84c154030 con 0x7ff84c0b3910 2024-09-17T05:46:07.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.760+0000 7ff848c00640 1 -- 172.21.15.44:0/3176040611 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v102) ==== 162+0+0 (secure 0 0 0) 0x7ff834068030 con 0x7ff84c0b3910 2024-09-17T05:46:07.761 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff828073230 msgr2=0x7ff828075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff828073230 0x7ff828075740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff83c004610 tx=0x7ff83c00b260 comp rx=0 tx=0).stop 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0b3910 msgr2=0x7ff84c09b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0b3910 0x7ff84c09b7f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff83400e7a0 tx=0x7ff83400ec60 comp rx=0 tx=0).stop 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 shutdown_connections 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff84c0ce730 0x7ff84c1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff84c0b3910 0x7ff84c09b7f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff828073230 0x7ff828075740 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 --2- 172.21.15.44:0/3176040611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff84c09df30 0x7ff84c09a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 >> 172.21.15.44:0/3176040611 conn(0x7ff84c06d450 msgr2=0x7ff84c0ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:07.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 shutdown_connections 2024-09-17T05:46:07.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.764+0000 7ff852c00640 1 -- 172.21.15.44:0/3176040611 wait complete. 2024-09-17T05:46:07.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:07.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 -- 172.21.15.44:0/3511706832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f137815b810 msgr2=0x7f13780ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 --2- 172.21.15.44:0/3511706832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f137815b810 0x7f13780ce5b0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f1368009900 tx=0x7f136801c8b0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 -- 172.21.15.44:0/3511706832 shutdown_connections 2024-09-17T05:46:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 --2- 172.21.15.44:0/3511706832 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137806d020 0x7f137806d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 --2- 172.21.15.44:0/3511706832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f137815b810 0x7f13780ce5b0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 -- 172.21.15.44:0/3511706832 >> 172.21.15.44:0/3511706832 conn(0x7f13780d0de0 msgr2=0x7f13780d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 -- 172.21.15.44:0/3511706832 shutdown_connections 2024-09-17T05:46:07.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 -- 172.21.15.44:0/3511706832 wait complete. 2024-09-17T05:46:07.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.948+0000 7f137e200640 1 Processor -- start 2024-09-17T05:46:07.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 -- start start 2024-09-17T05:46:07.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f137806d020 0x7f137814de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13780cc070 0x7f13781650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137815b810 0x7f1378165600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1378169140 con 0x7f13780cc070 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1378168fc0 con 0x7f137806d020 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f13781692c0 con 0x7f137815b810 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13780cc070 0x7f13781650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13780cc070 0x7f13781650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47072/0 (socket says 172.21.15.44:47072) 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 -- 172.21.15.44:0/2631608362 learned_addr learned my addr 172.21.15.44:0/2631608362 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f1377400640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f137806d020 0x7f137814de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f1377e00640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137815b810 0x7f1378165600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 -- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137815b810 msgr2=0x7f1378165600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137815b810 0x7f1378165600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 -- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f137806d020 msgr2=0x7f137814de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f137806d020 0x7f137814de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:07.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 -- 172.21.15.44:0/2631608362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13781f97c0 con 0x7f13780cc070 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f1377400640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f137806d020 0x7f137814de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f1377e00640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137815b810 0x7f1378165600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136fe00640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13780cc070 0x7f13781650c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f1360005d10 tx=0x7f136000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136f400640 1 -- 172.21.15.44:0/2631608362 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360017070 con 0x7f13780cc070 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136f400640 1 -- 172.21.15.44:0/2631608362 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1360009b20 con 0x7f13780cc070 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f136f400640 1 -- 172.21.15.44:0/2631608362 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360010460 con 0x7f13780cc070 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13781f9aa0 con 0x7f13780cc070 2024-09-17T05:46:07.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13781fa060 con 0x7f13780cc070 2024-09-17T05:46:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.952+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13781f9530 con 0x7f13780cc070 2024-09-17T05:46:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.956+0000 7f136f400640 1 -- 172.21.15.44:0/2631608362 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f136001a070 con 0x7f13780cc070 2024-09-17T05:46:07.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.956+0000 7f136f400640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1354073200 0x7f1354075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.956+0000 7f136f400640 1 -- 172.21.15.44:0/2631608362 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f1360094560 con 0x7f13780cc070 2024-09-17T05:46:07.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.956+0000 7f1377400640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1354073200 0x7f1354075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:07.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.956+0000 7f1377400640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1354073200 0x7f1354075710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f13680af000 tx=0x7f136801b0f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:07.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:07.960+0000 7f136f400640 1 -- 172.21.15.44:0/2631608362 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f136005f390 con 0x7f13780cc070 2024-09-17T05:46:08.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.168+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f137806d430 con 0x7f13780cc070 2024-09-17T05:46:08.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.168+0000 7f136f400640 1 -- 172.21.15.44:0/2631608362 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5223 (secure 0 0 0) 0x7f136005ec90 con 0x7f13780cc070 2024-09-17T05:46:08.169 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:08.169 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":103,"btime":"2024-09-17T05:46:07:768141+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:07.768120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":103,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/3525601076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3525601076},{"type":"v1","addr":"172.21.15.44:6835","nonce":3525601076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-17T05:46:08.169 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 103 2024-09-17T05:46:08.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1354073200 msgr2=0x7f1354075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:08.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1354073200 0x7f1354075710 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f13680af000 tx=0x7f136801b0f0 comp rx=0 tx=0).stop 2024-09-17T05:46:08.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13780cc070 msgr2=0x7f13781650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:08.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13780cc070 0x7f13781650c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f1360005d10 tx=0x7f136000dbb0 comp rx=0 tx=0).stop 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 shutdown_connections 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f137815b810 0x7f1378165600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13780cc070 0x7f13781650c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1354073200 0x7f1354075710 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 --2- 172.21.15.44:0/2631608362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f137806d020 0x7f137814de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 >> 172.21.15.44:0/2631608362 conn(0x7f13780d0de0 msgr2=0x7f13780b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 shutdown_connections 2024-09-17T05:46:08.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:08.172+0000 7f137e200640 1 -- 172.21.15.44:0/2631608362 wait complete. 2024-09-17T05:46:08.594 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:54.297928+0000', 'modified': '2024-09-17T05:46:07.768120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8433': {'gid': 8433, 'name': 'c', 'rank': 0, 'incarnation': 103, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/3525601076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 3525601076}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3525601076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:46:08.594 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8433:up:replay 2024-09-17T05:46:09.596 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:09.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 -- 172.21.15.44:0/2424472987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19015edb0 msgr2=0x7ff1900700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:09.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 --2- 172.21.15.44:0/2424472987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19015edb0 0x7ff1900700b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff184009900 tx=0x7ff18401c880 comp rx=0 tx=0).stop 2024-09-17T05:46:09.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 -- 172.21.15.44:0/2424472987 shutdown_connections 2024-09-17T05:46:09.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 --2- 172.21.15.44:0/2424472987 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff1900709b0 0x7ff1900b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 --2- 172.21.15.44:0/2424472987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff19015edb0 0x7ff1900700b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 -- 172.21.15.44:0/2424472987 >> 172.21.15.44:0/2424472987 conn(0x7ff1900ccbe0 msgr2=0x7ff1900ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:09.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 -- 172.21.15.44:0/2424472987 shutdown_connections 2024-09-17T05:46:09.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 -- 172.21.15.44:0/2424472987 wait complete. 2024-09-17T05:46:09.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 Processor -- start 2024-09-17T05:46:09.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.768+0000 7ff197600640 1 -- start start 2024-09-17T05:46:09.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff197600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1900709b0 0x7ff1900c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff197600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1900b4700 0x7ff1900c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff197600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19015edb0 0x7ff1901fa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff197600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff190169010 con 0x7ff1900b4700 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff197600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff190168e90 con 0x7ff1900709b0 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff197600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff190169190 con 0x7ff19015edb0 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff18fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1900b4700 0x7ff1900c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1900709b0 0x7ff1900c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1900709b0 0x7ff1900c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.44:37036/0 (socket says 172.21.15.44:37036) 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff18fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1900b4700 0x7ff1900c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45886/0 (socket says 172.21.15.44:45886) 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 -- 172.21.15.44:0/695980759 learned_addr learned my addr 172.21.15.44:0/695980759 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:09.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff195600640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19015edb0 0x7ff1901fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 -- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19015edb0 msgr2=0x7ff1901fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19015edb0 0x7ff1901fa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 -- 172.21.15.44:0/695980759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1900b4700 msgr2=0x7ff1900c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1900b4700 0x7ff1900c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 -- 172.21.15.44:0/695980759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1900c9750 con 0x7ff1900709b0 2024-09-17T05:46:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff18fe00640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1900b4700 0x7ff1900c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:09.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.772+0000 7ff194c00640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1900709b0 0x7ff1900c6840 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff1840b0040 tx=0x7ff1840056e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:09.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff18cc00640 1 -- 172.21.15.44:0/695980759 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1840b2040 con 0x7ff1900709b0 2024-09-17T05:46:09.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff18cc00640 1 -- 172.21.15.44:0/695980759 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff184004040 con 0x7ff1900709b0 2024-09-17T05:46:09.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff18cc00640 1 -- 172.21.15.44:0/695980759 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184004490 con 0x7ff1900709b0 2024-09-17T05:46:09.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1900ca4f0 con 0x7ff1900709b0 2024-09-17T05:46:09.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1900c9f30 con 0x7ff1900709b0 2024-09-17T05:46:09.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1900b41c0 con 0x7ff1900709b0 2024-09-17T05:46:09.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff18cc00640 1 -- 172.21.15.44:0/695980759 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff1840bf020 con 0x7ff1900709b0 2024-09-17T05:46:09.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff18cc00640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff170073200 0x7ff170075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:09.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.776+0000 7ff18cc00640 1 -- 172.21.15.44:0/695980759 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7ff18412e3c0 con 0x7ff1900709b0 2024-09-17T05:46:09.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.780+0000 7ff18fe00640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff170073200 0x7ff170075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:09.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.780+0000 7ff18fe00640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff170073200 0x7ff170075710 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff190143e50 tx=0x7ff17c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:09.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.784+0000 7ff18cc00640 1 -- 172.21.15.44:0/695980759 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff1840dde20 con 0x7ff1900709b0 2024-09-17T05:46:09.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.992+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff19009da20 con 0x7ff1900709b0 2024-09-17T05:46:09.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff18cc00640 1 -- 172.21.15.44:0/695980759 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) ==== 95+0+5223 (secure 0 0 0) 0x7ff1840164d0 con 0x7ff1900709b0 2024-09-17T05:46:09.996 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:09.996 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":105,"btime":"2024-09-17T05:46:09:773414+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:08.776411+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":103,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.44:6835/3525601076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3525601076},{"type":"v1","addr":"172.21.15.44:6835","nonce":3525601076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-17T05:46:09.996 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 105 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff170073200 msgr2=0x7ff170075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff170073200 0x7ff170075710 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff190143e50 tx=0x7ff17c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1900709b0 msgr2=0x7ff1900c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1900709b0 0x7ff1900c6840 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff1840b0040 tx=0x7ff1840056e0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 shutdown_connections 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff19015edb0 0x7ff1901fa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1900b4700 0x7ff1900c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff170073200 0x7ff170075710 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 --2- 172.21.15.44:0/695980759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff1900709b0 0x7ff1900c6840 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 >> 172.21.15.44:0/695980759 conn(0x7ff1900ccbe0 msgr2=0x7ff1900ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 shutdown_connections 2024-09-17T05:46:09.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:09.996+0000 7ff197600640 1 -- 172.21.15.44:0/695980759 wait complete. 2024-09-17T05:46:10.422 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:54.297928+0000', 'modified': '2024-09-17T05:46:08.776411+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8433': {'gid': 8433, 'name': 'c', 'rank': 0, 'incarnation': 103, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.44:6835/3525601076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 3525601076}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3525601076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:46:10.553 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8433:up:rejoin 2024-09-17T05:46:11.554 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 -- 172.21.15.44:0/2084458105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 msgr2=0x7f1ce00b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 --2- 172.21.15.44:0/2084458105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00b3830 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009c80 tx=0x7f1cd801cda0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 -- 172.21.15.44:0/2084458105 shutdown_connections 2024-09-17T05:46:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 --2- 172.21.15.44:0/2084458105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00b3830 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 -- 172.21.15.44:0/2084458105 >> 172.21.15.44:0/2084458105 conn(0x7f1ce00ccbe0 msgr2=0x7f1ce00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 -- 172.21.15.44:0/2084458105 shutdown_connections 2024-09-17T05:46:11.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 -- 172.21.15.44:0/2084458105 wait complete. 2024-09-17T05:46:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 Processor -- start 2024-09-17T05:46:11.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.728+0000 7f1ce5200640 1 -- start start 2024-09-17T05:46:11.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce00b24e0 0x7f1ce00c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:11.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ce00caec0 0x7f1ce01413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce0169bc0 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce0169a40 con 0x7f1ce00caec0 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce0169d40 con 0x7f1ce00b24e0 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45906/0 (socket says 172.21.15.44:45906) 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 -- 172.21.15.44:0/3643192209 learned_addr learned my addr 172.21.15.44:0/3643192209 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cd5400640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ce00caec0 0x7f1ce01413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cdde00640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce00b24e0 0x7f1ce00c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 -- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce00b24e0 msgr2=0x7f1ce00c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce00b24e0 0x7f1ce00c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 -- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ce00caec0 msgr2=0x7f1ce01413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ce00caec0 0x7f1ce01413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 -- 172.21.15.44:0/3643192209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce01fb210 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cdde00640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce00b24e0 0x7f1ce00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:11.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cde800640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00c9d80 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1cd801b450 tx=0x7f1cd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cd6a00640 1 -- 172.21.15.44:0/3643192209 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80bb070 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cd6a00640 1 -- 172.21.15.44:0/3643192209 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd8004b40 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1cd6a00640 1 -- 172.21.15.44:0/3643192209 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80b2040 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce01fb4f0 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce00c9580 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.732+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce00ca7b0 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.736+0000 7f1cd6a00640 1 -- 172.21.15.44:0/3643192209 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1cd8004460 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.736+0000 7f1cd6a00640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cbc073200 0x7f1cbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.736+0000 7f1cd6a00640 1 -- 172.21.15.44:0/3643192209 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f1cd812e590 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.736+0000 7f1cdde00640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cbc073200 0x7f1cbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:11.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.736+0000 7f1cdde00640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cbc073200 0x7f1cbc075710 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000a850 tx=0x7f1cd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:11.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.740+0000 7f1cd6a00640 1 -- 172.21.15.44:0/3643192209 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f1cd80f1db0 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.948+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ce0074140 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.948+0000 7f1cd6a00640 1 -- 172.21.15.44:0/3643192209 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f1cd8016990 con 0x7f1ce00cb2d0 2024-09-17T05:46:11.951 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:11.951 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":106,"btime":"2024-09-17T05:46:10:775218+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:10.775211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":103,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/3525601076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3525601076},{"type":"v1","addr":"172.21.15.44:6835","nonce":3525601076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8433,"qdb_cluster":[8433]},"id":8}]} 2024-09-17T05:46:11.951 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 106 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cbc073200 msgr2=0x7f1cbc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cbc073200 0x7f1cbc075710 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000a850 tx=0x7f1cd0008040 comp rx=0 tx=0).stop 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 msgr2=0x7f1ce00c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00c9d80 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1cd801b450 tx=0x7f1cd8004270 comp rx=0 tx=0).stop 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 shutdown_connections 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ce00cb2d0 0x7f1ce00c9d80 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1cbc073200 0x7f1cbc075710 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ce00caec0 0x7f1ce01413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 --2- 172.21.15.44:0/3643192209 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1ce00b24e0 0x7f1ce00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 >> 172.21.15.44:0/3643192209 conn(0x7f1ce00ccbe0 msgr2=0x7f1ce00b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 shutdown_connections 2024-09-17T05:46:11.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:11.952+0000 7f1ce5200640 1 -- 172.21.15.44:0/3643192209 wait complete. 2024-09-17T05:46:12.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:54.297928+0000', 'modified': '2024-09-17T05:46:10.775211+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8433': {'gid': 8433, 'name': 'c', 'rank': 0, 'incarnation': 103, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6835/3525601076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 3525601076}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 3525601076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8433, 'qdb_cluster': [8433]} 2024-09-17T05:46:12.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:46:12.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 -- 172.21.15.44:0/2095015677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd02806f890 msgr2=0x7fd02806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 --2- 172.21.15.44:0/2095015677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd02806f890 0x7fd02806fca0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fd0280b2ee0 tx=0x7fd02001cd80 comp rx=0 tx=0).stop 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 -- 172.21.15.44:0/2095015677 shutdown_connections 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 --2- 172.21.15.44:0/2095015677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd02806f890 0x7fd02806fca0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 --2- 172.21.15.44:0/2095015677 >> v2:172.21.15.86:3300/0 conn(0x7fd0280cc960 0x7fd02815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 -- 172.21.15.44:0/2095015677 >> 172.21.15.44:0/2095015677 conn(0x7fd02806d450 msgr2=0x7fd0280d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 -- 172.21.15.44:0/2095015677 shutdown_connections 2024-09-17T05:46:12.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.540+0000 7fd02de00640 1 -- 172.21.15.44:0/2095015677 wait complete. 2024-09-17T05:46:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 Processor -- start 2024-09-17T05:46:12.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 -- start start 2024-09-17T05:46:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd02806f890 0x7fd02814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0280b3140 0x7fd028156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0280cc960 0x7fd0281568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd028168d00 con 0x7fd0280cc960 2024-09-17T05:46:12.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd028168b80 con 0x7fd0280b3140 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd02de00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd028168e80 con 0x7fd02806f890 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0280cc960 0x7fd0281568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0280cc960 0x7fd0281568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45928/0 (socket says 172.21.15.44:45928) 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 -- 172.21.15.44:0/2816579686 learned_addr learned my addr 172.21.15.44:0/2816579686 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd026a00640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd02806f890 0x7fd02814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd026000640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0280b3140 0x7fd028156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 -- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd02806f890 msgr2=0x7fd02814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd02806f890 0x7fd02814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 -- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0280b3140 msgr2=0x7fd028156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0280b3140 0x7fd028156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 -- 172.21.15.44:0/2816579686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0280c8ba0 con 0x7fd0280cc960 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd026000640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0280b3140 0x7fd028156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:12.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.544+0000 7fd027400640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0280cc960 0x7fd0281568c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd02001b430 tx=0x7fd020005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd01f400640 1 -- 172.21.15.44:0/2816579686 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0200bb070 con 0x7fd0280cc960 2024-09-17T05:46:12.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd01f400640 1 -- 172.21.15.44:0/2816579686 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd020004d40 con 0x7fd0280cc960 2024-09-17T05:46:12.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd01f400640 1 -- 172.21.15.44:0/2816579686 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0200b2040 con 0x7fd0280cc960 2024-09-17T05:46:12.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0280c8e80 con 0x7fd0280cc960 2024-09-17T05:46:12.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0280c9440 con 0x7fd0280cc960 2024-09-17T05:46:12.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd01f400640 1 -- 172.21.15.44:0/2816579686 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd0200be070 con 0x7fd0280cc960 2024-09-17T05:46:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd035499000 1 Processor -- start 2024-09-17T05:46:12.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd01f400640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd008073200 0x7fd008075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd035499000 1 -- start start 2024-09-17T05:46:12.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.548+0000 7fd01f400640 1 -- 172.21.15.44:0/2816579686 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fd02012dfe0 con 0x7fd0280cc960 2024-09-17T05:46:12.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd008073200 0x7fd008075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd008073200 0x7fd008075710 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd028152960 tx=0x7fd014008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd9a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd9b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5567dfc6f410 con 0x5567dfc49950 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5567dfbacb40 con 0x5567df859460 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5567dfb9bf70 con 0x5567dfc32ca0 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd9abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd9abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45942/0 (socket says 172.21.15.44:45942) 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 -- 172.21.15.44:0/3999648520 learned_addr learned my addr 172.21.15.44:0/3999648520 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026a00640 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd9a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd027400640 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd9b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 -- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 msgr2=0x5567dfd9b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd9b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 -- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 msgr2=0x5567dfd9a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd9a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 -- 172.21.15.44:0/3999648520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dfb635b0 con 0x5567dfc49950 2024-09-17T05:46:12.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd026000640 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd9abe0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fd01400d7e0 tx=0x7fd014010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34ea07ef0dedb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd013400640 1 -- 172.21.15.44:0/3999648520 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014024070 con 0x5567dfc49950 2024-09-17T05:46:12.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd013400640 1 -- 172.21.15.44:0/3999648520 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd014014970 con 0x5567dfc49950 2024-09-17T05:46:12.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd013400640 1 -- 172.21.15.44:0/3999648520 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014014d80 con 0x5567dfc49950 2024-09-17T05:46:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- 172.21.15.44:0/3999648520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 msgr2=0x5567dfd9abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd9abe0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fd01400d7e0 tx=0x7fd014010000 comp rx=0 tx=0).stop 2024-09-17T05:46:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- 172.21.15.44:0/3999648520 shutdown_connections 2024-09-17T05:46:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd9b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd9abe0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 --2- 172.21.15.44:0/3999648520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd9a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- 172.21.15.44:0/3999648520 >> 172.21.15.44:0/3999648520 conn(0x5567dfd1fd90 msgr2=0x5567dfd4f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- 172.21.15.44:0/3999648520 shutdown_connections 2024-09-17T05:46:12.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.552+0000 7fd035499000 1 -- 172.21.15.44:0/3999648520 wait complete. 2024-09-17T05:46:12.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 -- start start 2024-09-17T05:46:12.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 Processor -- start 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfda1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc32ca0 0x5567dfda1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc49950 0x5567dfda23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5567dfb365f0 con 0x5567dfc32ca0 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5567dfb9fd80 con 0x5567df859460 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5567dfb42520 con 0x5567dfc49950 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 10 client.0 _ll_register_callbacks cb 0x5567dfb46830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:12.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc32ca0 0x5567dfda1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc32ca0 0x5567dfda1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45950/0 (socket says 172.21.15.44:45950) 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 -- 172.21.15.44:0/617203911 learned_addr learned my addr 172.21.15.44:0/617203911 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026a00640 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfda1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd027400640 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc49950 0x5567dfda23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 -- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc49950 msgr2=0x5567dfda23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc49950 0x5567dfda23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 -- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 msgr2=0x5567dfda1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfda1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 -- 172.21.15.44:0/617203911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567dfb3a190 con 0x5567dfc32ca0 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd026000640 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc32ca0 0x5567dfda1e60 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fd014017040 tx=0x7fd0140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefb2e6c9d5fb18a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd007e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd007e00640 1 -- 172.21.15.44:0/617203911 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014024040 con 0x5567dfc32ca0 2024-09-17T05:46:12.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5567dfb34110 con 0x5567dfc32ca0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd007e00640 1 -- 172.21.15.44:0/617203911 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fd014014880 con 0x5567dfc32ca0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd007e00640 1 -- 172.21.15.44:0/617203911 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fd014034050 con 0x5567dfc32ca0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 10 client.8481 fetch_fsmap learned FSMap version 106 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.556+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x5567dfc20f10 con 0x5567dfc32ca0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd007e00640 1 -- 172.21.15.44:0/617203911 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5567dfb34110 con 0x5567dfc32ca0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd007e00640 1 -- 172.21.15.44:0/617203911 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fd014037020 con 0x5567dfc32ca0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 10 client.8481 fetch_fsmap finished waiting for FSMap version 106 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 10 client.8481 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 20 client.8481 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df83e7d0 0x5567dfdabd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 4 client.8481 mds_command: new command op to 8433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 --> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567dfbaea90 con 0x5567df83e7d0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd026a00640 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df83e7d0 0x5567dfdabd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd026a00640 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df83e7d0 0x5567dfdabd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6d1f4b8c8ef37ca server_cookie=110c0e8598ead63a in_seq=0 out_seq=0 2024-09-17T05:46:12.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd007e00640 10 client.8481 ms_handle_connect on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd007e00640 1 -- 172.21.15.44:0/617203911 <== mds.0 v2:172.21.15.44:6834/3525601076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567dfbaea90 con 0x5567df83e7d0 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd007e00640 10 client.8481 handle_command_reply: tid=0 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 client.8481 shutdown 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc32ca0 msgr2=0x5567dfda1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc32ca0 0x5567dfda1e60 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fd014017040 tx=0x7fd0140042f0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 shutdown_connections 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc49950 0x5567dfda23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df83e7d0 0x5567dfdabd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc32ca0 0x5567dfda1e60 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 --2- 172.21.15.44:0/617203911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfda1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd007e00640 0 client.8481 ms_handle_reset on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:12.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 >> 172.21.15.44:0/617203911 conn(0x5567dfd1fd90 msgr2=0x5567dfd56440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 shutdown_connections 2024-09-17T05:46:12.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 1 -- 172.21.15.44:0/617203911 wait complete. 2024-09-17T05:46:12.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.560+0000 7fd035499000 20 client.8481 trim_cache size 0 max 16384 2024-09-17T05:46:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 Processor -- start 2024-09-17T05:46:12.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 -- start start 2024-09-17T05:46:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd4ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd4f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd4f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd028205ad0 con 0x5567dfc49950 2024-09-17T05:46:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd028204b20 con 0x5567df859460 2024-09-17T05:46:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd02809c0b0 con 0x5567dfc32ca0 2024-09-17T05:46:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd027400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd4f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd027400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd4f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45962/0 (socket says 172.21.15.44:45962) 2024-09-17T05:46:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.580+0000 7fd027400640 1 -- 172.21.15.44:0/1974869301 learned_addr learned my addr 172.21.15.44:0/1974869301 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd026000640 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd4f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd026a00640 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd4ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd027400640 1 -- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 msgr2=0x5567dfd4f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd027400640 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd4f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd027400640 1 -- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 msgr2=0x5567dfd4ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd027400640 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd4ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd027400640 1 -- 172.21.15.44:0/1974869301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567dfbf7db0 con 0x5567dfc49950 2024-09-17T05:46:12.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd027400640 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd4f750 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fd02001d260 tx=0x7fd02012c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e339e2f0509af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd012a00640 1 -- 172.21.15.44:0/1974869301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0200f7f70 con 0x5567dfc49950 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd012a00640 1 -- 172.21.15.44:0/1974869301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd020112030 con 0x5567dfc49950 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd012a00640 1 -- 172.21.15.44:0/1974869301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0200a5d20 con 0x5567dfc49950 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 -- 172.21.15.44:0/1974869301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 msgr2=0x5567dfd4f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd4f750 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fd02001d260 tx=0x7fd02012c1a0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 -- 172.21.15.44:0/1974869301 shutdown_connections 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567dfc49950 0x5567dfd4f750 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd4f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 --2- 172.21.15.44:0/1974869301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567df859460 0x5567dfd4ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 -- 172.21.15.44:0/1974869301 >> 172.21.15.44:0/1974869301 conn(0x5567dfd1fd90 msgr2=0x5567dfd98620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 -- 172.21.15.44:0/1974869301 shutdown_connections 2024-09-17T05:46:12.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 -- 172.21.15.44:0/1974869301 wait complete. 2024-09-17T05:46:12.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 -- start start 2024-09-17T05:46:12.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.584+0000 7fd035499000 1 Processor -- start 2024-09-17T05:46:12.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567df859460 0x5567dfd51db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567dfc49950 0x5567dfdcc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5567dfbab910 con 0x5567df859460 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5567dfc20a80 con 0x5567dfc49950 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5567dfb9f090 con 0x5567dfc32ca0 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 10 client.0 _ll_register_callbacks cb 0x7fd014022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567df859460 0x5567dfd51db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567df859460 0x5567dfd51db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45966/0 (socket says 172.21.15.44:45966) 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 -- 172.21.15.44:0/1925671237 learned_addr learned my addr 172.21.15.44:0/1925671237 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:12.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd027400640 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567dfc49950 0x5567dfdcc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026000640 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 -- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 msgr2=0x5567dfd522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 -- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567dfc49950 msgr2=0x5567dfdcc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567dfc49950 0x5567dfdcc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 -- 172.21.15.44:0/1925671237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567dfb62ab0 con 0x5567df859460 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026a00640 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567df859460 0x5567dfd51db0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x5567dfba3310 tx=0x7fd01800bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f3930f66ac296c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 1 -- 172.21.15.44:0/1925671237 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018029060 con 0x5567df859460 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 1 -- 172.21.15.44:0/1925671237 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fd018024470 con 0x5567df859460 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd020112030 con 0x5567df859460 2024-09-17T05:46:12.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 1 -- 172.21.15.44:0/1925671237 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7fd01802f050 con 0x5567df859460 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 10 client.8487 fetch_fsmap learned FSMap version 106 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x5567dfb41070 con 0x5567df859460 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 1 -- 172.21.15.44:0/1925671237 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd020112030 con 0x5567df859460 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 1 -- 172.21.15.44:0/1925671237 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7fd018032020 con 0x5567df859460 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 10 client.8487 fetch_fsmap finished waiting for FSMap version 106 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 10 client.8487 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 20 client.8487 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df82c830 0x5567dfe0fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 4 client.8487 mds_command: new command op to 8433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 --> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] -- command(tid 0: {"prefix": "status"}) -- 0x5567dfbaa540 con 0x5567df82c830 2024-09-17T05:46:12.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026000640 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df82c830 0x5567dfe0fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd026000640 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df82c830 0x5567dfe0fe90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24bb65e7035152c0 server_cookie=7ba5d8b89bd9178e in_seq=0 out_seq=0 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 10 client.8487 ms_handle_connect on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 1 -- 172.21.15.44:0/1925671237 <== mds.0 v2:172.21.15.44:6834/3525601076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5567dfbaa540 con 0x5567df82c830 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 10 client.8487 handle_command_reply: tid=0 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 client.8487 shutdown 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567df859460 msgr2=0x5567dfd51db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567df859460 0x5567dfd51db0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x5567dfba3310 tx=0x7fd01800bef0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 shutdown_connections 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5567dfc49950 0x5567dfdcc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5567dfc32ca0 0x5567dfd522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x5567df82c830 0x5567dfe0fe90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 --2- 172.21.15.44:0/1925671237 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5567df859460 0x5567dfd51db0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 >> 172.21.15.44:0/1925671237 conn(0x5567dfd1fd90 msgr2=0x5567dfdab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd007e00640 0 client.8487 ms_handle_reset on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 shutdown_connections 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 1 -- 172.21.15.44:0/1925671237 wait complete. 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.588+0000 7fd035499000 20 client.8487 trim_cache size 0 max 16384 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:46:12.595 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 8433, 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.8203035549999997, 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 106, 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 120, 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 120, 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 5.6852831979999996 2024-09-17T05:46:12.596 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd008073200 msgr2=0x7fd008075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd008073200 0x7fd008075710 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd028152960 tx=0x7fd014008040 comp rx=0 tx=0).stop 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0280cc960 msgr2=0x7fd0281568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0280cc960 0x7fd0281568c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fd02001b430 tx=0x7fd020005b00 comp rx=0 tx=0).stop 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 shutdown_connections 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0280cc960 0x7fd0281568c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd008073200 0x7fd008075710 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0280b3140 0x7fd028156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 --2- 172.21.15.44:0/2816579686 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd02806f890 0x7fd02814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 >> 172.21.15.44:0/2816579686 conn(0x7fd02806d450 msgr2=0x7fd02815ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 shutdown_connections 2024-09-17T05:46:12.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.592+0000 7fd02de00640 1 -- 172.21.15.44:0/2816579686 wait complete. 2024-09-17T05:46:12.610 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:46:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.768+0000 7fc0d3800640 1 -- 172.21.15.44:0/1016489478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0b0004810 msgr2=0x7fc0b0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.768+0000 7fc0d3800640 1 --2- 172.21.15.44:0/1016489478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0b0004810 0x7fc0b0004c20 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009b60 tx=0x7fc0b401d2b0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.768+0000 7fc0d1800640 1 -- 172.21.15.44:0/1016489478 reap_dead start 2024-09-17T05:46:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.768+0000 7fc0d3800640 1 -- 172.21.15.44:0/1016489478 shutdown_connections 2024-09-17T05:46:12.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.768+0000 7fc0d3800640 1 -- 172.21.15.44:0/1016489478 >> 172.21.15.44:0/1016489478 conn(0x7fc0cc0ccbe0 msgr2=0x7fc0cc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.768+0000 7fc0d3800640 1 -- 172.21.15.44:0/1016489478 shutdown_connections 2024-09-17T05:46:12.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.768+0000 7fc0d3800640 1 -- 172.21.15.44:0/1016489478 wait complete. 2024-09-17T05:46:12.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 Processor -- start 2024-09-17T05:46:12.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 -- start start 2024-09-17T05:46:12.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0b0004810 0x7fc0cc0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0cc1f6bf0 0x7fc0cc1f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0cc1f9a00 0x7fc0cc0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc0731b0 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc073030 con 0x7fc0cc1f6bf0 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d3800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc0cc073330 con 0x7fc0b0004810 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0cc1f9a00 0x7fc0cc0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0cc1f9a00 0x7fc0cc0cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45996/0 (socket says 172.21.15.44:45996) 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d1800640 1 -- 172.21.15.44:0/4243423222 learned_addr learned my addr 172.21.15.44:0/4243423222 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0d0e00640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0b0004810 0x7fc0cc0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.772+0000 7fc0c3e00640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0cc1f6bf0 0x7fc0cc1f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d1800640 1 -- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0b0004810 msgr2=0x7fc0cc0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d1800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0b0004810 0x7fc0cc0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d1800640 1 -- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0cc1f6bf0 msgr2=0x7fc0cc1f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d1800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0cc1f6bf0 0x7fc0cc1f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d1800640 1 -- 172.21.15.44:0/4243423222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc1fa1d0 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d1800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0cc1f9a00 0x7fc0cc0cb5d0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc072dd0 tx=0x7fc0c4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0c9600640 1 -- 172.21.15.44:0/4243423222 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4004b30 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0c9600640 1 -- 172.21.15.44:0/4243423222 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0c4004cd0 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0c9600640 1 -- 172.21.15.44:0/4243423222 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4003be0 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc1f6110 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc0b2910 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0cc1f9f40 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.776+0000 7fc0c9600640 1 -- 172.21.15.44:0/4243423222 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc0c4004030 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.780+0000 7fc0c9600640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc0a8073230 0x7fc0a8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:12.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.780+0000 7fc0c9600640 1 -- 172.21.15.44:0/4243423222 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fc0c4094ac0 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.780+0000 7fc0d0e00640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc0a8073230 0x7fc0a8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:12.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.780+0000 7fc0d0e00640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc0a8073230 0x7fc0a8075740 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000fc0 tx=0x7fc0bc006960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:12.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.784+0000 7fc0c9600640 1 -- 172.21.15.44:0/4243423222 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc0c405f2a0 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.992+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc0cc1f5f20 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0c9600640 1 -- 172.21.15.44:0/4243423222 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v106) ==== 53+0+73 (secure 0 0 0) 0x7fc0c4063cd0 con 0x7fc0cc1f9a00 2024-09-17T05:46:12.995 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:46:12.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc0a8073230 msgr2=0x7fc0a8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc0a8073230 0x7fc0a8075740 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000fc0 tx=0x7fc0bc006960 comp rx=0 tx=0).stop 2024-09-17T05:46:12.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0cc1f9a00 msgr2=0x7fc0cc0cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:12.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0cc1f9a00 0x7fc0cc0cb5d0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc072dd0 tx=0x7fc0c4011ef0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 shutdown_connections 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0cc1f9a00 0x7fc0cc0cb5d0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc0a8073230 0x7fc0a8075740 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0cc1f6bf0 0x7fc0cc1f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 --2- 172.21.15.44:0/4243423222 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc0b0004810 0x7fc0cc0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 >> 172.21.15.44:0/4243423222 conn(0x7fc0cc0ccbe0 msgr2=0x7fc0cc09af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 shutdown_connections 2024-09-17T05:46:12.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:12.996+0000 7fc0d3800640 1 -- 172.21.15.44:0/4243423222 wait complete. 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:46:13.017 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:13.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.018 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:46:13.027 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:46:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:46:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:46:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.027 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:46:13.028 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41833sec preferred_lft 41833sec 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:46:13.029 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:13.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.030 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:46:13.092 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:46:13.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.095 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:46:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:46:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:46:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:46:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:46:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:46:13.152 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:46:13.152 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:46:13.153 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:46:13.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:46:13.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:46:13.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:46:13.153 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:46:13.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:46:13.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:13.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.290 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:46:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:46:13.300 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:46:13.300 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:13.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:46:13.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:13.363 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:13.415 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:13.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:13.415 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:13.465 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:46:13.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.466 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:13.571 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:13.572 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:13.590 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:13.601 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:46:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:46:13.602 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:46:13.606 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:46:13.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.606 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:13.626 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:46:13.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:46:13.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:13.732 INFO:teuthology.orchestra.run.smithi044.stdout:client8083 2024-09-17T05:46:13.732 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:13.732 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:13.770 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:46:13.768+0000 7f06bdc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:46:13.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:13.779 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-09-17T05:46:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:./ 2024-09-17T05:46:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:./parent 2024-09-17T05:46:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed 2024-09-17T05:46:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/charlie 2024-09-17T05:46:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/alpha 2024-09-17T05:46:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/unflushed 2024-09-17T05:46:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/unflushed/jfile 2024-09-17T05:46:13.837 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:13.838 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:13.838 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:13.838 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:13.838 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-09-17T05:46:13.838 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:13.943 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:46:13.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:13.952 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:13.952 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:13.953 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:13.953 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:13.953 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-09-17T05:46:13.953 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:13.966 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:13.999 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:14.060 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-17T05:46:14.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:14.070 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:14.070 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:14.070 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:14.070 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:14.070 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-09-17T05:46:14.071 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:14.136 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-17T05:46:14.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:14.146 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:14.146 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:14.146 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:14.146 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:14.146 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-09-17T05:46:14.146 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:14.212 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628280 2024-09-17T05:46:14.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:14.221 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:14.222 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:14.222 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:14.222 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:14.222 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-09-17T05:46:14.222 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:14.328 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-17T05:46:14.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:14.337 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:14.337 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:14.337 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:14.337 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:14.337 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-09-17T05:46:14.337 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:14.448 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627779 2024-09-17T05:46:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:14.457 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:14.457 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:14.457 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:14.457 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:14.457 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-09-17T05:46:14.457 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:14.564 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627780 2024-09-17T05:46:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:14.573 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:14.574 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:14.623 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:14.623 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:14.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:46:14.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 -- 172.21.15.44:0/3816082536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 msgr2=0x7fb5dc0af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:14.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 --2- 172.21.15.44:0/3816082536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc0af3f0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009c80 tx=0x7fb5d401cce0 comp rx=0 tx=0).stop 2024-09-17T05:46:14.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 -- 172.21.15.44:0/3816082536 shutdown_connections 2024-09-17T05:46:14.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 --2- 172.21.15.44:0/3816082536 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc0af3f0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:14.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 --2- 172.21.15.44:0/3816082536 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5dc155560 0x7fb5dc0b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:14.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 -- 172.21.15.44:0/3816082536 >> 172.21.15.44:0/3816082536 conn(0x7fb5dc06d450 msgr2=0x7fb5dc0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:14.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 -- 172.21.15.44:0/3816082536 shutdown_connections 2024-09-17T05:46:14.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.876+0000 7fb5e3000640 1 -- 172.21.15.44:0/3816082536 wait complete. 2024-09-17T05:46:14.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 Processor -- start 2024-09-17T05:46:14.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 -- start start 2024-09-17T05:46:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc169880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc155560 0x7fb5dc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5dc15eb80 0x7fb5dc14f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:14.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1672b0 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc167130 con 0x7fb5dc155560 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e3000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb5dc167430 con 0x7fb5dc15eb80 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc169880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc169880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46000/0 (socket says 172.21.15.44:46000) 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5dbe00640 1 -- 172.21.15.44:0/2345646806 learned_addr learned my addr 172.21.15.44:0/2345646806 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5e1000640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5dc15eb80 0x7fb5dc14f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.880+0000 7fb5d3400640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc155560 0x7fb5dc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5dbe00640 1 -- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5dc15eb80 msgr2=0x7fb5dc14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5dbe00640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5dc15eb80 0x7fb5dc14f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5dbe00640 1 -- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc155560 msgr2=0x7fb5dc0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5dbe00640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc155560 0x7fb5dc0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:14.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5dbe00640 1 -- 172.21.15.44:0/2345646806 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc0aff30 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5dbe00640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc169880 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00e9c0 tx=0x7fb5cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5d8c00640 1 -- 172.21.15.44:0/2345646806 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc00ccc0 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5d8c00640 1 -- 172.21.15.44:0/2345646806 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5cc010430 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5d8c00640 1 -- 172.21.15.44:0/2345646806 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc010880 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc0b0210 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc09c420 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc09c680 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5d8c00640 1 -- 172.21.15.44:0/2345646806 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb5cc010a20 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5d8c00640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5b8073200 0x7fb5b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.884+0000 7fb5d8c00640 1 -- 172.21.15.44:0/2345646806 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fb5cc094f60 con 0x7fb5dc0aefe0 2024-09-17T05:46:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.888+0000 7fb5d3400640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5b8073200 0x7fb5b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:14.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.888+0000 7fb5d3400640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5b8073200 0x7fb5b8075710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0d0520 tx=0x7fb5c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:14.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:14.892+0000 7fb5d8c00640 1 -- 172.21.15.44:0/2345646806 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb5cc05fd90 con 0x7fb5dc0aefe0 2024-09-17T05:46:15.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb5dc0af3f0 con 0x7fb5dc0aefe0 2024-09-17T05:46:15.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5d8c00640 1 -- 172.21.15.44:0/2345646806 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v120) ==== 80+0+122 (secure 0 0 0) 0x7fb5cc05f690 con 0x7fb5dc0aefe0 2024-09-17T05:46:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1819525564 2024-09-18T05:46:06.760809+0000 2024-09-17T05:46:15.080 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/1819525564 2024-09-18T05:46:06.760809+0000 2024-09-17T05:46:15.081 INFO:teuthology.orchestra.run.smithi044.stderr:listed 2 entries 2024-09-17T05:46:15.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5b8073200 msgr2=0x7fb5b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5b8073200 0x7fb5b8075710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0d0520 tx=0x7fb5c4009040 comp rx=0 tx=0).stop 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 msgr2=0x7fb5dc169880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc169880 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00e9c0 tx=0x7fb5cc00ee80 comp rx=0 tx=0).stop 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 shutdown_connections 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5dc15eb80 0x7fb5dc14f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb5b8073200 0x7fb5b8075710 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc155560 0x7fb5dc0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 --2- 172.21.15.44:0/2345646806 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5dc0aefe0 0x7fb5dc169880 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 >> 172.21.15.44:0/2345646806 conn(0x7fb5dc06d450 msgr2=0x7fb5dc166390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 shutdown_connections 2024-09-17T05:46:15.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.080+0000 7fb5e3000640 1 -- 172.21.15.44:0/2345646806 wait complete. 2024-09-17T05:46:15.105 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:46:15.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:15.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:15.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:15.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:15.132 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:46:15.187 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:15.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.388+0000 7f22c0e00640 1 -- 172.21.15.44:0/2520157915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22a0003a80 msgr2=0x7f22a0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.388+0000 7f22c0e00640 1 --2- 172.21.15.44:0/2520157915 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22a0003a80 0x7f22a0003ef0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009b60 tx=0x7f22ac01d2b0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.388+0000 7f22ba800640 1 -- 172.21.15.44:0/2520157915 reap_dead start 2024-09-17T05:46:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.388+0000 7f22c0e00640 1 -- 172.21.15.44:0/2520157915 shutdown_connections 2024-09-17T05:46:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.388+0000 7f22c0e00640 1 -- 172.21.15.44:0/2520157915 >> 172.21.15.44:0/2520157915 conn(0x7f22bc0ccbe0 msgr2=0x7f22bc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.388+0000 7f22c0e00640 1 -- 172.21.15.44:0/2520157915 shutdown_connections 2024-09-17T05:46:15.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.388+0000 7f22c0e00640 1 -- 172.21.15.44:0/2520157915 wait complete. 2024-09-17T05:46:15.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 Processor -- start 2024-09-17T05:46:15.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 -- start start 2024-09-17T05:46:15.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22a0003a80 0x7f22bc0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22bc14f4a0 0x7f22bc0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc14f8b0 0x7f22bc0c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1662a0 con 0x7f22bc14f8b0 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc073980 con 0x7f22a0003a80 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22c0e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc166420 con 0x7f22bc14f4a0 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22ba800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc14f8b0 0x7f22bc0c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22ba800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc14f8b0 0x7f22bc0c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46018/0 (socket says 172.21.15.44:46018) 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22ba800640 1 -- 172.21.15.44:0/1696264993 learned_addr learned my addr 172.21.15.44:0/1696264993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22b9e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22a0003a80 0x7f22bc0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.392+0000 7f22b1400640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22bc14f4a0 0x7f22bc0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22ba800640 1 -- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22bc14f4a0 msgr2=0x7f22bc0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22ba800640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22bc14f4a0 0x7f22bc0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22ba800640 1 -- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22a0003a80 msgr2=0x7f22bc0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22ba800640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22a0003a80 0x7f22bc0c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22ba800640 1 -- 172.21.15.44:0/1696264993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc09ab20 con 0x7f22bc14f8b0 2024-09-17T05:46:15.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22ba800640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc14f8b0 0x7f22bc0c7e10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f22bc072dd0 tx=0x7f22b400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22b2a00640 1 -- 172.21.15.44:0/1696264993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4004b30 con 0x7f22bc14f8b0 2024-09-17T05:46:15.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22b2a00640 1 -- 172.21.15.44:0/1696264993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22b4004cd0 con 0x7f22bc14f8b0 2024-09-17T05:46:15.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22b2a00640 1 -- 172.21.15.44:0/1696264993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4003be0 con 0x7f22bc14f8b0 2024-09-17T05:46:15.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc09ae00 con 0x7f22bc14f8b0 2024-09-17T05:46:15.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc09b3c0 con 0x7f22bc14f8b0 2024-09-17T05:46:15.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc0700b0 con 0x7f22bc14f8b0 2024-09-17T05:46:15.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.396+0000 7f22b2a00640 1 -- 172.21.15.44:0/1696264993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f22b4004030 con 0x7f22bc14f8b0 2024-09-17T05:46:15.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.400+0000 7f22b2a00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2298073200 0x7f2298075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.400+0000 7f22b2a00640 1 -- 172.21.15.44:0/1696264993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f22b40949a0 con 0x7f22bc14f8b0 2024-09-17T05:46:15.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.400+0000 7f22b9e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2298073200 0x7f2298075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.400+0000 7f22b9e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2298073200 0x7f2298075710 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0ae000 tx=0x7f22ac01a050 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.404+0000 7f22b2a00640 1 -- 172.21.15.44:0/1696264993 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f22b405f0f0 con 0x7f22bc14f8b0 2024-09-17T05:46:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22bc09da20 con 0x7f22bc14f8b0 2024-09-17T05:46:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22b2a00640 1 -- 172.21.15.44:0/1696264993 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+5230 (secure 0 0 0) 0x7f22b4063b20 con 0x7f22bc14f8b0 2024-09-17T05:46:15.616 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:15.616 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":106,"btime":"2024-09-17T05:46:10:775218+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:10.775211+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8433":{"gid":8433,"name":"c","rank":0,"incarnation":103,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/3525601076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3525601076},{"type":"v1","addr":"172.21.15.44:6835","nonce":3525601076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8433,"qdb_cluster":[8433]},"id":8}]} 2024-09-17T05:46:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 106 2024-09-17T05:46:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2298073200 msgr2=0x7f2298075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2298073200 0x7f2298075710 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0ae000 tx=0x7f22ac01a050 comp rx=0 tx=0).stop 2024-09-17T05:46:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc14f8b0 msgr2=0x7f22bc0c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc14f8b0 0x7f22bc0c7e10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f22bc072dd0 tx=0x7f22b400f3c0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 shutdown_connections 2024-09-17T05:46:15.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc14f8b0 0x7f22bc0c7e10 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22bc14f4a0 0x7f22bc0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2298073200 0x7f2298075710 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 --2- 172.21.15.44:0/1696264993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22a0003a80 0x7f22bc0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 >> 172.21.15.44:0/1696264993 conn(0x7f22bc0ccbe0 msgr2=0x7f22bc068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:15.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 shutdown_connections 2024-09-17T05:46:15.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.616+0000 7f22c0e00640 1 -- 172.21.15.44:0/1696264993 wait complete. 2024-09-17T05:46:15.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parent mytag123 2024-09-17T05:46:15.818 INFO:teuthology.orchestra.run.smithi044.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-09-17T05:46:15.819 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-09-17T05:46:15.819 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-09-17T05:46:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 Processor -- start 2024-09-17T05:46:15.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 -- start start 2024-09-17T05:46:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe224003640 0x562ceb64c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb64c9c0 0x562ceb5a3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562ceb5a3e60 0x562ceb575810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ceb521f40 con 0x7fe224003640 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ceb52ed00 con 0x562ceb64c9c0 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe245649080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562ceb4c3a00 con 0x562ceb5a3e60 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe224003640 0x562ceb64c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe224003640 0x562ceb64c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46050/0 (socket says 172.21.15.44:46050) 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 -- 172.21.15.44:0/1740645941 learned_addr learned my addr 172.21.15.44:0/1740645941 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23d000640 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb64c9c0 0x562ceb5a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23e400640 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562ceb5a3e60 0x562ceb575810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 -- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562ceb5a3e60 msgr2=0x562ceb575810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562ceb5a3e60 0x562ceb575810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 -- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb64c9c0 msgr2=0x562ceb5a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb64c9c0 0x562ceb5a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 -- 172.21.15.44:0/1740645941 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ceb5b5900 con 0x7fe224003640 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe23da00640 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe224003640 0x562ceb64c480 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe23000d570 tx=0x7fe23000da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b86ea641ef2a372 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe237400640 1 -- 172.21.15.44:0/1740645941 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23000f4f0 con 0x7fe224003640 2024-09-17T05:46:15.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe237400640 1 -- 172.21.15.44:0/1740645941 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe230014020 con 0x7fe224003640 2024-09-17T05:46:15.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.880+0000 7fe237400640 1 -- 172.21.15.44:0/1740645941 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23000f8b0 con 0x7fe224003640 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- 172.21.15.44:0/1740645941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe224003640 msgr2=0x562ceb64c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe224003640 0x562ceb64c480 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe23000d570 tx=0x7fe23000da30 comp rx=0 tx=0).stop 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- 172.21.15.44:0/1740645941 shutdown_connections 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x562ceb5a3e60 0x562ceb575810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb64c9c0 0x562ceb5a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 --2- 172.21.15.44:0/1740645941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe224003640 0x562ceb64c480 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- 172.21.15.44:0/1740645941 >> 172.21.15.44:0/1740645941 conn(0x562ceb561d60 msgr2=0x562ceb5bf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:15.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- 172.21.15.44:0/1740645941 shutdown_connections 2024-09-17T05:46:15.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- 172.21.15.44:0/1740645941 wait complete. 2024-09-17T05:46:15.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 Processor -- start 2024-09-17T05:46:15.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- start start 2024-09-17T05:46:15.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb5a3e60 0x562ceb6e39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ceb64c9c0 0x562ceb6e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe224003640 0x562ceb59ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562ceb5b5b70 con 0x562ceb64c9c0 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ceb5baec0 con 0x562ceb5a3e60 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe245649080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x562ceb575370 con 0x7fe224003640 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe23d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ceb64c9c0 0x562ceb6e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe23d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ceb64c9c0 0x562ceb6e3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46054/0 (socket says 172.21.15.44:46054) 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe23d000640 1 -- 172.21.15.44:0/2837204889 learned_addr learned my addr 172.21.15.44:0/2837204889 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe23da00640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb5a3e60 0x562ceb6e39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.884+0000 7fe23e400640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe224003640 0x562ceb59ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe23d000640 1 -- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe224003640 msgr2=0x562ceb59ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe23d000640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe224003640 0x562ceb59ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe23d000640 1 -- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb5a3e60 msgr2=0x562ceb6e39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe23d000640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ceb5a3e60 0x562ceb6e39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe23d000640 1 -- 172.21.15.44:0/2837204889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ceb59d140 con 0x562ceb64c9c0 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe23d000640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ceb64c9c0 0x562ceb6e3360 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00f6c0 tx=0x7fe22c00fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe236000640 1 -- 172.21.15.44:0/2837204889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c00db10 con 0x562ceb64c9c0 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe236000640 1 -- 172.21.15.44:0/2837204889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe22c00dcb0 con 0x562ceb64c9c0 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe236000640 1 -- 172.21.15.44:0/2837204889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c010680 con 0x562ceb64c9c0 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ceb59e930 con 0x562ceb64c9c0 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ceb59ee70 con 0x562ceb64c9c0 2024-09-17T05:46:15.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe236000640 1 -- 172.21.15.44:0/2837204889 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe22c010820 con 0x562ceb64c9c0 2024-09-17T05:46:15.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.888+0000 7fe236000640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe220071be0 0x7fe2200740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe236000640 1 -- 172.21.15.44:0/2837204889 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fe22c093430 con 0x562ceb64c9c0 2024-09-17T05:46:15.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x562ceb576c80 0x562ceb59f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:1 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x562ceb59f850 con 0x562ceb576c80 2024-09-17T05:46:15.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe23da00640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe220071be0 0x7fe2200740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe23e400640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x562ceb576c80 0x562ceb59f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe23da00640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe220071be0 0x7fe2200740f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe230003fd0 tx=0x7fe230001130 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe23e400640 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x562ceb576c80 0x562ceb59f310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe23e400640 1 -- 172.21.15.44:0/2837204889 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7fe238002030 con 0x562ceb576c80 2024-09-17T05:46:15.893 INFO:teuthology.orchestra.run.smithi044.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x562ceb576c80 msgr2=0x562ceb59f310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x562ceb576c80 0x562ceb59f310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe220071be0 msgr2=0x7fe2200740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe220071be0 0x7fe2200740f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe230003fd0 tx=0x7fe230001130 comp rx=0 tx=0).stop 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ceb64c9c0 msgr2=0x562ceb6e3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 --2- 172.21.15.44:0/2837204889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562ceb64c9c0 0x562ceb6e3360 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00f6c0 tx=0x7fe22c00fb80 comp rx=0 tx=0).stop 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe23e400640 1 -- 172.21.15.44:0/2837204889 reap_dead start 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 shutdown_connections 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 >> 172.21.15.44:0/2837204889 conn(0x562ceb561d60 msgr2=0x562ceb5bf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 shutdown_connections 2024-09-17T05:46:15.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.892+0000 7fe245649080 1 -- 172.21.15.44:0/2837204889 wait complete. 2024-09-17T05:46:15.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:46:15.898 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-09-17T05:46:15.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 Processor -- start 2024-09-17T05:46:15.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 -- start start 2024-09-17T05:46:15.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a267716b20 0x55a2677b9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a2677ba480 0x55a2676e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a26779ee10 con 0x55a267730360 2024-09-17T05:46:15.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a267632a00 con 0x55a267716b20 2024-09-17T05:46:15.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.956+0000 7fcb9fbfc080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a26779df90 con 0x55a2677ba480 2024-09-17T05:46:15.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46084/0 (socket says 172.21.15.44:46084) 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 -- 172.21.15.44:0/1884263692 learned_addr learned my addr 172.21.15.44:0/1884263692 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb99800640 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a2677ba480 0x55a2676e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb98e00640 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a267716b20 0x55a2677b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 -- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a2677ba480 msgr2=0x55a2676e23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a2677ba480 0x55a2676e23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 -- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a267716b20 msgr2=0x55a2677b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a267716b20 0x55a2677b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 -- 172.21.15.44:0/1884263692 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a267631a20 con 0x55a267730360 2024-09-17T05:46:15.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb93e00640 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bc8d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c4e0 tx=0x7fcb8400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc58ded32bcf5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb92a00640 1 -- 172.21.15.44:0/1884263692 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400a9f0 con 0x55a267730360 2024-09-17T05:46:15.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb92a00640 1 -- 172.21.15.44:0/1884263692 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb8400ab90 con 0x55a267730360 2024-09-17T05:46:15.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb92a00640 1 -- 172.21.15.44:0/1884263692 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84008430 con 0x55a267730360 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1884263692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 msgr2=0x55a2677bc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bc8d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400c4e0 tx=0x7fcb8400c9a0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1884263692 shutdown_connections 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a2677ba480 0x55a2676e23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bc8d0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1884263692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a267716b20 0x55a2677b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1884263692 >> 172.21.15.44:0/1884263692 conn(0x55a2676d0d60 msgr2=0x55a2677baa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1884263692 shutdown_connections 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1884263692 wait complete. 2024-09-17T05:46:15.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 Processor -- start 2024-09-17T05:46:15.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.960+0000 7fcb9fbfc080 1 -- start start 2024-09-17T05:46:15.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a267716b20 0x55a2677b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a2677ba480 0x55a2677bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55a267843470 con 0x55a267730360 2024-09-17T05:46:15.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a2678431d0 con 0x55a2677ba480 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55a267843710 con 0x55a267716b20 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46092/0 (socket says 172.21.15.44:46092) 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 -- 172.21.15.44:0/1251665588 learned_addr learned my addr 172.21.15.44:0/1251665588 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb99800640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a2677ba480 0x55a2677bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 -- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a267716b20 msgr2=0x55a2677b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb98e00640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a267716b20 0x55a2677b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a267716b20 0x55a2677b6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 -- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a2677ba480 msgr2=0x55a2677bd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a2677ba480 0x55a2677bd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 -- 172.21.15.44:0/1251665588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a26760bc10 con 0x55a267730360 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb99800640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a2677ba480 0x55a2677bd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb98e00640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55a267716b20 0x55a2677b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:15.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb93e00640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bd4a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fcb840146a0 tx=0x7fcb840146d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb91600640 1 -- 172.21.15.44:0/1251665588 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb84020070 con 0x55a267730360 2024-09-17T05:46:15.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb91600640 1 -- 172.21.15.44:0/1251665588 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb84014b00 con 0x55a267730360 2024-09-17T05:46:15.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2677b6a40 con 0x55a267730360 2024-09-17T05:46:15.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb91600640 1 -- 172.21.15.44:0/1251665588 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8401c400 con 0x55a267730360 2024-09-17T05:46:15.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.964+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a267852460 con 0x55a267730360 2024-09-17T05:46:15.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb91600640 1 -- 172.21.15.44:0/1251665588 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcb84023070 con 0x55a267730360 2024-09-17T05:46:15.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb91600640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb78071be0 0x7fcb780740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb91600640 1 -- 172.21.15.44:0/1251665588 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7fcb84094ce0 con 0x55a267730360 2024-09-17T05:46:15.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb98e00640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb78071be0 0x7fcb780740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a2678535f0 0x55a267853a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:15.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:1 18.12 18:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55a267851ca0 con 0x55a2678535f0 2024-09-17T05:46:15.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb99800640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a2678535f0 0x55a267853a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb98e00640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb78071be0 0x7fcb780740f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00d760 tx=0x7fcb8c0049f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb99800640 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a2678535f0 0x55a267853a00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb99800640 1 -- 172.21.15.44:0/1251665588 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fcb940a7d70 con 0x55a2678535f0 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a2678535f0 msgr2=0x55a267853a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55a2678535f0 0x55a267853a00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb78071be0 msgr2=0x7fcb780740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fcb78071be0 0x7fcb780740f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00d760 tx=0x7fcb8c0049f0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 msgr2=0x55a2677bd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:15.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 --2- 172.21.15.44:0/1251665588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55a267730360 0x55a2677bd4a0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fcb840146a0 tx=0x7fcb840146d0 comp rx=0 tx=0).stop 2024-09-17T05:46:15.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb99800640 1 -- 172.21.15.44:0/1251665588 reap_dead start 2024-09-17T05:46:15.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 shutdown_connections 2024-09-17T05:46:15.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 >> 172.21.15.44:0/1251665588 conn(0x55a2676d0d60 msgr2=0x55a2677b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:15.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 shutdown_connections 2024-09-17T05:46:15.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:15.968+0000 7fcb9fbfc080 1 -- 172.21.15.44:0/1251665588 wait complete. 2024-09-17T05:46:15.976 INFO:teuthology.orchestra.run.smithi044.stdout:mytag123 2024-09-17T05:46:15.976 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-09-17T05:46:16.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.036+0000 7f3936ac3080 1 Processor -- start 2024-09-17T05:46:16.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.036+0000 7f3936ac3080 1 -- start start 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b63340650 0x555b633e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63358c40 0x555b6333b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b633c9890 0x555b6333bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555b632bcf40 con 0x555b63358c40 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555b632c9d00 con 0x555b63340650 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x555b6325ea00 con 0x555b633c9890 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63358c40 0x555b6333b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63358c40 0x555b6333b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46122/0 (socket says 172.21.15.44:46122) 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 -- 172.21.15.44:0/561810621 learned_addr learned my addr 172.21.15.44:0/561810621 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392fc00640 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b63340650 0x555b633e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3930600640 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b633c9890 0x555b6333bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 -- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b633c9890 msgr2=0x555b6333bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b633c9890 0x555b6333bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 -- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b63340650 msgr2=0x555b633e6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b63340650 0x555b633e6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 -- 172.21.15.44:0/561810621 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b633566b0 con 0x555b63358c40 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3930600640 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b633c9890 0x555b6333bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392f200640 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63358c40 0x555b6333b5c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f391c001e40 tx=0x7f391c00b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b6f1bd84989073 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392de00640 1 -- 172.21.15.44:0/561810621 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c012070 con 0x555b63358c40 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392de00640 1 -- 172.21.15.44:0/561810621 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f391c00e930 con 0x555b63358c40 2024-09-17T05:46:16.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f392de00640 1 -- 172.21.15.44:0/561810621 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391c00ed80 con 0x555b63358c40 2024-09-17T05:46:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- 172.21.15.44:0/561810621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63358c40 msgr2=0x555b6333b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63358c40 0x555b6333b5c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f391c001e40 tx=0x7f391c00b740 comp rx=0 tx=0).stop 2024-09-17T05:46:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- 172.21.15.44:0/561810621 shutdown_connections 2024-09-17T05:46:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b633c9890 0x555b6333bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63358c40 0x555b6333b5c0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 --2- 172.21.15.44:0/561810621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b63340650 0x555b633e6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- 172.21.15.44:0/561810621 >> 172.21.15.44:0/561810621 conn(0x555b632fcd60 msgr2=0x555b6333aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- 172.21.15.44:0/561810621 shutdown_connections 2024-09-17T05:46:16.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.040+0000 7f3936ac3080 1 -- 172.21.15.44:0/561810621 wait complete. 2024-09-17T05:46:16.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 Processor -- start 2024-09-17T05:46:16.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 -- start start 2024-09-17T05:46:16.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63340650 0x555b633c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b63358c40 0x555b633e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b633c9890 0x555b63354750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555b633c9f70 con 0x555b63340650 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555b63356450 con 0x555b633c9890 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x555b633ca210 con 0x555b63358c40 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63340650 0x555b633c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63340650 0x555b633c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46130/0 (socket says 172.21.15.44:46130) 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 -- 172.21.15.44:0/1535068966 learned_addr learned my addr 172.21.15.44:0/1535068966 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392f200640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b63358c40 0x555b633e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3930600640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b633c9890 0x555b63354750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 -- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b63358c40 msgr2=0x555b633e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x555b63358c40 0x555b633e3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 -- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b633c9890 msgr2=0x555b63354750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b633c9890 0x555b63354750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 -- 172.21.15.44:0/1535068966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b63310860 con 0x555b63340650 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392fc00640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63340650 0x555b633c8100 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f392001b770 tx=0x7f39200ab570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392ca00640 1 -- 172.21.15.44:0/1535068966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39200abb90 con 0x555b63340650 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392ca00640 1 -- 172.21.15.44:0/1535068966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39200bd070 con 0x555b63340650 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b633ea2e0 con 0x555b63340650 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f392ca00640 1 -- 172.21.15.44:0/1535068966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39200b6670 con 0x555b63340650 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.044+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b633ea820 con 0x555b63340650 2024-09-17T05:46:16.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f392ca00640 1 -- 172.21.15.44:0/1535068966 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f39200b3050 con 0x555b63340650 2024-09-17T05:46:16.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f392ca00640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3910071be0 0x7f39100740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f392ca00640 1 -- 172.21.15.44:0/1535068966 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f392012dee0 con 0x555b63340650 2024-09-17T05:46:16.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f3936ac3080 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x555b633e7e70 0x555b633e8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:1 18.19 18:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x555b633e87c0 con 0x555b633e7e70 2024-09-17T05:46:16.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f392f200640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3910071be0 0x7f39100740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f3930600640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x555b633e7e70 0x555b633e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f3930600640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x555b633e7e70 0x555b633e8280 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.048+0000 7f392f200640 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3910071be0 0x7f39100740f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f391c00c010 tx=0x7f391c019040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3930600640 1 -- 172.21.15.44:0/1535068966 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f3928003020 con 0x555b633e7e70 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x555b633e7e70 msgr2=0x555b633e8280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x555b633e7e70 0x555b633e8280 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3910071be0 msgr2=0x7f39100740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f3910071be0 0x7f39100740f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f391c00c010 tx=0x7f391c019040 comp rx=0 tx=0).stop 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63340650 msgr2=0x555b633c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 --2- 172.21.15.44:0/1535068966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555b63340650 0x555b633c8100 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f392001b770 tx=0x7f39200ab570 comp rx=0 tx=0).stop 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3930600640 1 -- 172.21.15.44:0/1535068966 reap_dead start 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 shutdown_connections 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 >> 172.21.15.44:0/1535068966 conn(0x555b632fcd60 msgr2=0x555b633581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 shutdown_connections 2024-09-17T05:46:16.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.052+0000 7f3936ac3080 1 -- 172.21.15.44:0/1535068966 wait complete. 2024-09-17T05:46:16.056 INFO:teuthology.orchestra.run.smithi044.stdout:mytag123 2024-09-17T05:46:16.056 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-09-17T05:46:16.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 Processor -- start 2024-09-17T05:46:16.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 -- start start 2024-09-17T05:46:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 0x55711a3ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a35dd30 0x55711a343c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a3d0f70 0x55711a3441b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55711a262a00 con 0x55711a35dd30 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55711a2c0f40 con 0x55711a314650 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f8263069080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55711a343300 con 0x55711a3d0f70 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a35dd30 0x55711a343c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a35dd30 0x55711a343c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46144/0 (socket says 172.21.15.44:46144) 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 -- 172.21.15.44:0/309443744 learned_addr learned my addr 172.21.15.44:0/309443744 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825c200640 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 0x55711a3ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825cc00640 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a3d0f70 0x55711a3441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 -- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a3d0f70 msgr2=0x55711a3441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a3d0f70 0x55711a3441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 -- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 msgr2=0x55711a3ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 0x55711a3ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 -- 172.21.15.44:0/309443744 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55711a23bc10 con 0x55711a35dd30 2024-09-17T05:46:16.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825b800640 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a35dd30 0x55711a343c70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f824800b610 tx=0x7f8248004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ac783c87640892 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825a400640 1 -- 172.21.15.44:0/309443744 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824800a8f0 con 0x55711a35dd30 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825a400640 1 -- 172.21.15.44:0/309443744 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f824800aa90 con 0x55711a35dd30 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.116+0000 7f825a400640 1 -- 172.21.15.44:0/309443744 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8248015460 con 0x55711a35dd30 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- 172.21.15.44:0/309443744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a35dd30 msgr2=0x55711a343c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a35dd30 0x55711a343c70 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f824800b610 tx=0x7f8248004f90 comp rx=0 tx=0).stop 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- 172.21.15.44:0/309443744 shutdown_connections 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a3d0f70 0x55711a3441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a35dd30 0x55711a343c70 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 --2- 172.21.15.44:0/309443744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 0x55711a3ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- 172.21.15.44:0/309443744 >> 172.21.15.44:0/309443744 conn(0x55711a300d60 msgr2=0x55711a3ea5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- 172.21.15.44:0/309443744 shutdown_connections 2024-09-17T05:46:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- 172.21.15.44:0/309443744 wait complete. 2024-09-17T05:46:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 Processor -- start 2024-09-17T05:46:16.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- start start 2024-09-17T05:46:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 0x55711a3caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a35dd30 0x55711a3e56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a3d0f70 0x55711a3e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55711a33e6a0 con 0x55711a3d0f70 2024-09-17T05:46:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55711a340ee0 con 0x55711a314650 2024-09-17T05:46:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f8263069080 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55711a33e940 con 0x55711a35dd30 2024-09-17T05:46:16.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a3d0f70 0x55711a3e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a3d0f70 0x55711a3e68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46156/0 (socket says 172.21.15.44:46156) 2024-09-17T05:46:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 -- 172.21.15.44:0/2380122204 learned_addr learned my addr 172.21.15.44:0/2380122204 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825c200640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 0x55711a3caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825b800640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a35dd30 0x55711a3e56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 -- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a35dd30 msgr2=0x55711a3e56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55711a35dd30 0x55711a3e56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 -- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 msgr2=0x55711a3caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55711a314650 0x55711a3caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 -- 172.21.15.44:0/2380122204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55711a3e74b0 con 0x55711a3d0f70 2024-09-17T05:46:16.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.120+0000 7f825cc00640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a3d0f70 0x55711a3e68c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f825400a550 tx=0x7f82540afb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8259000640 1 -- 172.21.15.44:0/2380122204 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82540a7b60 con 0x55711a3d0f70 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8259000640 1 -- 172.21.15.44:0/2380122204 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82540afd50 con 0x55711a3d0f70 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55711a3537a0 con 0x55711a3d0f70 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8259000640 1 -- 172.21.15.44:0/2380122204 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82540c3670 con 0x55711a3d0f70 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55711a353ce0 con 0x55711a3d0f70 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8259000640 1 -- 172.21.15.44:0/2380122204 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f82540c1020 con 0x55711a3d0f70 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8259000640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f823c071be0 0x7f823c0740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8259000640 1 -- 172.21.15.44:0/2380122204 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f8254131c00 con 0x55711a3d0f70 2024-09-17T05:46:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8263069080 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55711a481930 0x55711a354420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f825c200640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f823c071be0 0x7f823c0740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.124+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:1 18.5 18:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) -- 0x55711a354960 con 0x55711a481930 2024-09-17T05:46:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f825b800640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55711a481930 0x55711a354420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f825c200640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f823c071be0 0x7f823c0740f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f824c010500 tx=0x7f824c003820 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f825b800640 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55711a481930 0x55711a354420 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f825b800640 1 -- 172.21.15.44:0/2380122204 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f824800ab50 con 0x55711a481930 2024-09-17T05:46:16.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55711a481930 msgr2=0x55711a354420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55711a481930 0x55711a354420 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f823c071be0 msgr2=0x7f823c0740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f823c071be0 0x7f823c0740f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f824c010500 tx=0x7f824c003820 comp rx=0 tx=0).stop 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a3d0f70 msgr2=0x55711a3e68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 --2- 172.21.15.44:0/2380122204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55711a3d0f70 0x55711a3e68c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f825400a550 tx=0x7f82540afb70 comp rx=0 tx=0).stop 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f825cc00640 1 -- 172.21.15.44:0/2380122204 reap_dead start 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 shutdown_connections 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 >> 172.21.15.44:0/2380122204 conn(0x55711a300d60 msgr2=0x55711a3ea560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 shutdown_connections 2024-09-17T05:46:16.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.128+0000 7f8263069080 1 -- 172.21.15.44:0/2380122204 wait complete. 2024-09-17T05:46:16.133 INFO:teuthology.orchestra.run.smithi044.stdout:mytag123 2024-09-17T05:46:16.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-09-17T05:46:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.292+0000 7f54e3000640 1 -- 172.21.15.44:0/2706029105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc0706c0 msgr2=0x7f54dc0ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.292+0000 7f54e3000640 1 --2- 172.21.15.44:0/2706029105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc0706c0 0x7f54dc0ce740 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009900 tx=0x7f54c401c7c0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.292+0000 7f54e3000640 1 -- 172.21.15.44:0/2706029105 shutdown_connections 2024-09-17T05:46:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.292+0000 7f54e3000640 1 --2- 172.21.15.44:0/2706029105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc0706c0 0x7f54dc0ce740 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.292+0000 7f54e3000640 1 -- 172.21.15.44:0/2706029105 >> 172.21.15.44:0/2706029105 conn(0x7f54dc0ccbe0 msgr2=0x7f54dc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.292+0000 7f54e3000640 1 -- 172.21.15.44:0/2706029105 shutdown_connections 2024-09-17T05:46:16.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.292+0000 7f54e3000640 1 -- 172.21.15.44:0/2706029105 wait complete. 2024-09-17T05:46:16.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 Processor -- start 2024-09-17T05:46:16.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 -- start start 2024-09-17T05:46:16.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54dc0ca990 0x7f54dc09a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15ec20 0x7f54dc15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54dc0c4a70 0x7f54dc165a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc16a220 con 0x7f54dc15ec20 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc16a0a0 con 0x7f54dc0ca990 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e3000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc16a3a0 con 0x7f54dc0c4a70 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15ec20 0x7f54dc15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15ec20 0x7f54dc15b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46184/0 (socket says 172.21.15.44:46184) 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54d3400640 1 -- 172.21.15.44:0/3142681580 learned_addr learned my addr 172.21.15.44:0/3142681580 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54dbe00640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54dc0ca990 0x7f54dc09a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.296+0000 7f54e1000640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54dc0c4a70 0x7f54dc165a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d3400640 1 -- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54dc0c4a70 msgr2=0x7f54dc165a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d3400640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54dc0c4a70 0x7f54dc165a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d3400640 1 -- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54dc0ca990 msgr2=0x7f54dc09a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d3400640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54dc0ca990 0x7f54dc09a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d3400640 1 -- 172.21.15.44:0/3142681580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc0b10e0 con 0x7f54dc15ec20 2024-09-17T05:46:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d3400640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15ec20 0x7f54dc15b540 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009850 tx=0x7f54c40a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d8c00640 1 -- 172.21.15.44:0/3142681580 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c40b2040 con 0x7f54dc15ec20 2024-09-17T05:46:16.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d8c00640 1 -- 172.21.15.44:0/3142681580 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54c40bd070 con 0x7f54dc15ec20 2024-09-17T05:46:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc0b13c0 con 0x7f54dc15ec20 2024-09-17T05:46:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d8c00640 1 -- 172.21.15.44:0/3142681580 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4003860 con 0x7f54dc15ec20 2024-09-17T05:46:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc0b1980 con 0x7f54dc15ec20 2024-09-17T05:46:16.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d8c00640 1 -- 172.21.15.44:0/3142681580 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f54c4003a00 con 0x7f54dc15ec20 2024-09-17T05:46:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.300+0000 7f54d8c00640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f54b8073200 0x7f54b8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54d8c00640 1 -- 172.21.15.44:0/3142681580 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f54c412eba0 con 0x7f54dc15ec20 2024-09-17T05:46:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54dbe00640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f54b8073200 0x7f54b8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 Processor -- start 2024-09-17T05:46:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 -- start start 2024-09-17T05:46:16.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54dbe00640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f54b8073200 0x7f54b8075710 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f54cc007fd0 tx=0x7f54cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e91273e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e91273ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e91273f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e9125ddcd0 con 0x55e9122edaa0 2024-09-17T05:46:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e9124f3330 con 0x55e912229890 2024-09-17T05:46:16.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e912550bb0 con 0x55e9125d26d0 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e91273f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54dbe00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e91273e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e91273f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46196/0 (socket says 172.21.15.44:46196) 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 -- 172.21.15.44:0/2273599515 learned_addr learned my addr 172.21.15.44:0/2273599515 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54d3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e91273ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 -- 172.21.15.44:0/2273599515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 msgr2=0x55e91273e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 --2- 172.21.15.44:0/2273599515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e91273e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 -- 172.21.15.44:0/2273599515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 msgr2=0x55e91273ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 --2- 172.21.15.44:0/2273599515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e91273ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 -- 172.21.15.44:0/2273599515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9124f4c80 con 0x55e9122edaa0 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54e1000640 1 --2- 172.21.15.44:0/2273599515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e91273f470 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001eb0 tx=0x7f54d4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d34932838846b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54d0c00640 1 -- 172.21.15.44:0/2273599515 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d400fc40 con 0x55e9122edaa0 2024-09-17T05:46:16.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54d0c00640 1 -- 172.21.15.44:0/2273599515 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54d4018070 con 0x55e9122edaa0 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.304+0000 7f54d0c00640 1 -- 172.21.15.44:0/2273599515 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4003be0 con 0x55e9122edaa0 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- 172.21.15.44:0/2273599515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 msgr2=0x55e91273f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2273599515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e91273f470 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f54d4001eb0 tx=0x7f54d4001640 comp rx=0 tx=0).stop 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- 172.21.15.44:0/2273599515 shutdown_connections 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2273599515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e91273f470 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2273599515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e91273ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2273599515 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e91273e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- 172.21.15.44:0/2273599515 >> 172.21.15.44:0/2273599515 conn(0x55e9121fd5c0 msgr2=0x55e9126fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- 172.21.15.44:0/2273599515 shutdown_connections 2024-09-17T05:46:16.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- 172.21.15.44:0/2273599515 wait complete. 2024-09-17T05:46:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- start start 2024-09-17T05:46:16.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 Processor -- start 2024-09-17T05:46:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e912229890 0x55e9126fa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9122edaa0 0x55e9126faef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e912543df0 con 0x55e912229890 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e91253ffe0 con 0x55e9122edaa0 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e9124e54d0 con 0x55e9125d26d0 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54ea5da000 10 client.0 _ll_register_callbacks cb 0x55e9124c37f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e912229890 0x55e9126fa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e912229890 0x55e9126fa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46202/0 (socket says 172.21.15.44:46202) 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 -- 172.21.15.44:0/4273269305 learned_addr learned my addr 172.21.15.44:0/4273269305 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54d3400640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9122edaa0 0x55e9126faef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54e1000640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 -- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 msgr2=0x55e9127015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127015f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 -- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9122edaa0 msgr2=0x55e9126faef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9122edaa0 0x55e9126faef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54dbe00640 1 -- 172.21.15.44:0/4273269305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9124de210 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.308+0000 7f54e1000640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54dbe00640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e912229890 0x55e9126fa9b0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0146d0 tx=0x7f54cc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1065edd3e62a8dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 1 -- 172.21.15.44:0/4273269305 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc025020 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9124d8350 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 1 -- 172.21.15.44:0/4273269305 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f54cc021610 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 1 -- 172.21.15.44:0/4273269305 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f54cc02f050 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 10 client.8559 fetch_fsmap learned FSMap version 106 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55e9124c4fc0 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 1 -- 172.21.15.44:0/4273269305 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55e9124d8350 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 1 -- 172.21.15.44:0/4273269305 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f54cc032020 con 0x55e912229890 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 10 client.8559 fetch_fsmap finished waiting for FSMap version 106 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 10 client.8559 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T05:46:16.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 20 client.8559 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:16.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121e2930 0x55e912745e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 4 client.8559 mds_command: new command op to 8433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:46:16.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 --> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e912552b00 con 0x55e9121e2930 2024-09-17T05:46:16.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54d3400640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121e2930 0x55e912745e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54d3400640 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121e2930 0x55e912745e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b12a7753f169a6c server_cookie=4d7d89f4a3e35442 in_seq=0 out_seq=0 2024-09-17T05:46:16.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 10 client.8559 ms_handle_connect on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:16.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 1 -- 172.21.15.44:0/4273269305 <== mds.0 v2:172.21.15.44:6834/3525601076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e912552b00 con 0x55e9121e2930 2024-09-17T05:46:16.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 10 client.8559 handle_command_reply: tid=0 2024-09-17T05:46:16.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 client.8559 shutdown 2024-09-17T05:46:16.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e912229890 msgr2=0x55e9126fa9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e912229890 0x55e9126fa9b0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0146d0 tx=0x7f54cc000ee0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 shutdown_connections 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e9122edaa0 0x55e9126faef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121e2930 0x55e912745e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4273269305 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e912229890 0x55e9126fa9b0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 >> 172.21.15.44:0/4273269305 conn(0x55e9121fd5c0 msgr2=0x55e9126f3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54c9600640 0 client.8559 ms_handle_reset on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 shutdown_connections 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 1 -- 172.21.15.44:0/4273269305 wait complete. 2024-09-17T05:46:16.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.312+0000 7f54ea5da000 20 client.8559 trim_cache size 0 max 16384 2024-09-17T05:46:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.328+0000 7f54ea5da000 1 Processor -- start 2024-09-17T05:46:16.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.328+0000 7f54ea5da000 1 -- start start 2024-09-17T05:46:16.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9122edaa0 0x55e9127b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9125d26d0 0x55e9127b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e9126f9b20 con 0x55e9125d26d0 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc1621c0 con 0x55e912229890 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc161240 con 0x55e9122edaa0 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9125d26d0 0x55e9127b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9125d26d0 0x55e9127b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46218/0 (socket says 172.21.15.44:46218) 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 -- 172.21.15.44:0/4264533458 learned_addr learned my addr 172.21.15.44:0/4264533458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54dbe00640 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54d3400640 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9122edaa0 0x55e9127b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 -- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9122edaa0 msgr2=0x55e9127b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9122edaa0 0x55e9127b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 -- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 msgr2=0x55e9127b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 -- 172.21.15.44:0/4264533458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91259d680 con 0x55e9125d26d0 2024-09-17T05:46:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54e1000640 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9125d26d0 0x55e9127b0c70 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f54d4007d80 tx=0x7f54d4001410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da717fe5395f433 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54cbe00640 1 -- 172.21.15.44:0/4264533458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d40050d0 con 0x55e9125d26d0 2024-09-17T05:46:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54cbe00640 1 -- 172.21.15.44:0/4264533458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54d4018040 con 0x55e9125d26d0 2024-09-17T05:46:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54cbe00640 1 -- 172.21.15.44:0/4264533458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4005600 con 0x55e9125d26d0 2024-09-17T05:46:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- 172.21.15.44:0/4264533458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9125d26d0 msgr2=0x55e9127b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9125d26d0 0x55e9127b0c70 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f54d4007d80 tx=0x7f54d4001410 comp rx=0 tx=0).stop 2024-09-17T05:46:16.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- 172.21.15.44:0/4264533458 shutdown_connections 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9125d26d0 0x55e9127b0c70 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9122edaa0 0x55e9127b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 --2- 172.21.15.44:0/4264533458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- 172.21.15.44:0/4264533458 >> 172.21.15.44:0/4264533458 conn(0x55e9121fd5c0 msgr2=0x55e912750fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- 172.21.15.44:0/4264533458 shutdown_connections 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- 172.21.15.44:0/4264533458 wait complete. 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 -- start start 2024-09-17T05:46:16.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.332+0000 7f54ea5da000 1 Processor -- start 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e9127b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc160bf0 con 0x55e9122edaa0 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc1605a0 con 0x55e912229890 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55e912205680 con 0x55e9125d26d0 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 10 client.0 _ll_register_callbacks cb 0x7f54cc001d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e9127b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e9127b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46230/0 (socket says 172.21.15.44:46230) 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 -- 172.21.15.44:0/2645550950 learned_addr learned my addr 172.21.15.44:0/2645550950 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54dbe00640 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54e1000640 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 -- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 msgr2=0x55e9127b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 -- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 msgr2=0x55e9127b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 -- 172.21.15.44:0/2645550950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91250a0b0 con 0x55e9122edaa0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54d3400640 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e9127b4980 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f54c40f6710 tx=0x7f54c40ba040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6844ca5d57ce5d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54c9600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54c9600640 1 -- 172.21.15.44:0/2645550950 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c40f94a0 con 0x55e9122edaa0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54c9600640 1 -- 172.21.15.44:0/2645550950 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f54c4003cf0 con 0x55e9122edaa0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d4018040 con 0x55e9122edaa0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54c9600640 1 -- 172.21.15.44:0/2645550950 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) ==== 24+0+0 (secure 0 0 0) 0x7f54c40fded0 con 0x55e9122edaa0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 10 client.8565 fetch_fsmap learned FSMap version 106 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) -- 0x55e9124d6610 con 0x55e9122edaa0 2024-09-17T05:46:16.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54c9600640 1 -- 172.21.15.44:0/2645550950 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54d4018040 con 0x55e9122edaa0 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54c9600640 1 -- 172.21.15.44:0/2645550950 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 106) ==== 3502+0+0 (secure 0 0 0) 0x7f54c40f5710 con 0x55e9122edaa0 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 10 client.8565 fetch_fsmap finished waiting for FSMap version 106 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 10 client.8565 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 20 client.8565 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121d0990 0x55e9126f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 4 client.8565 mds_command: new command op to 8433 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 --> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e91254e5b0 con 0x55e9121d0990 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54dbe00640 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121d0990 0x55e9126f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54dbe00640 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121d0990 0x55e9126f5af0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0baefd13ec55020 server_cookie=d1de69847a4cb590 in_seq=0 out_seq=0 2024-09-17T05:46:16.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.336+0000 7f54c9600640 10 client.8565 ms_handle_connect on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:16.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54c9600640 1 -- 172.21.15.44:0/2645550950 <== mds.0 v2:172.21.15.44:6834/3525601076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e91254e5b0 con 0x55e9121d0990 2024-09-17T05:46:16.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54c9600640 10 client.8565 handle_command_reply: tid=0 2024-09-17T05:46:16.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 client.8565 shutdown 2024-09-17T05:46:16.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 msgr2=0x55e9127b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e9127b4980 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f54c40f6710 tx=0x7f54c40ba040 comp rx=0 tx=0).stop 2024-09-17T05:46:16.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 shutdown_connections 2024-09-17T05:46:16.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55e9125d26d0 0x55e9127b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:6834/3525601076,v1:172.21.15.44:6835/3525601076] conn(0x55e9121d0990 0x55e9126f5af0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e9122edaa0 0x55e9127b4980 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 --2- 172.21.15.44:0/2645550950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e912229890 0x55e9127b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54c9600640 0 client.8565 ms_handle_reset on v2:172.21.15.44:6834/3525601076 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 >> 172.21.15.44:0/2645550950 conn(0x55e9121fd5c0 msgr2=0x55e9127005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 shutdown_connections 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 1 -- 172.21.15.44:0/2645550950 wait complete. 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54ea5da000 20 client.8565 trim_cache size 0 max 16384 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: "message": "", 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0 2024-09-17T05:46:16.354 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f54b8073200 msgr2=0x7f54b8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f54b8073200 0x7f54b8075710 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f54cc007fd0 tx=0x7f54cc009040 comp rx=0 tx=0).stop 2024-09-17T05:46:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15ec20 msgr2=0x7f54dc15b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15ec20 0x7f54dc15b540 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009850 tx=0x7f54c40a5590 comp rx=0 tx=0).stop 2024-09-17T05:46:16.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 shutdown_connections 2024-09-17T05:46:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f54dc0c4a70 0x7f54dc165a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54dc15ec20 0x7f54dc15b540 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f54b8073200 0x7f54b8075710 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 --2- 172.21.15.44:0/3142681580 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54dc0ca990 0x7f54dc09a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 >> 172.21.15.44:0/3142681580 conn(0x7f54dc0ccbe0 msgr2=0x7f54dc0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 shutdown_connections 2024-09-17T05:46:16.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.352+0000 7f54e3000640 1 -- 172.21.15.44:0/3142681580 wait complete. 2024-09-17T05:46:16.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:46:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 -- 172.21.15.44:0/413589070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93781602f0 msgr2=0x7f937806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 --2- 172.21.15.44:0/413589070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93781602f0 0x7f937806f890 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f9370009c80 tx=0x7f937001cda0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 -- 172.21.15.44:0/413589070 shutdown_connections 2024-09-17T05:46:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 --2- 172.21.15.44:0/413589070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93781602f0 0x7f937806f890 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 --2- 172.21.15.44:0/413589070 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f937815f9a0 0x7f937815fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 -- 172.21.15.44:0/413589070 >> 172.21.15.44:0/413589070 conn(0x7f937806d450 msgr2=0x7f93780d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 -- 172.21.15.44:0/413589070 shutdown_connections 2024-09-17T05:46:16.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.532+0000 7f937f400640 1 -- 172.21.15.44:0/413589070 wait complete. 2024-09-17T05:46:16.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 Processor -- start 2024-09-17T05:46:16.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 -- start start 2024-09-17T05:46:16.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f937809df30 0x7f9378155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f937815f9a0 0x7f9378074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781602f0 0x7f9378151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9378168df0 con 0x7f937809df30 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9378168c70 con 0x7f93781602f0 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f9378168f70 con 0x7f937815f9a0 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f937809df30 0x7f9378155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f937809df30 0x7f9378155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46260/0 (socket says 172.21.15.44:46260) 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 -- 172.21.15.44:0/3588069295 learned_addr learned my addr 172.21.15.44:0/3588069295 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937d400640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781602f0 0x7f9378151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f9377e00640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f937815f9a0 0x7f9378074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 -- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f937815f9a0 msgr2=0x7f9378074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f937815f9a0 0x7f9378074830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 -- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781602f0 msgr2=0x7f9378151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781602f0 0x7f9378151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 -- 172.21.15.44:0/3588069295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9378166100 con 0x7f937809df30 2024-09-17T05:46:16.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937ca00640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f937809df30 0x7f9378155b00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b420 tx=0x7f936c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f9374c00640 1 -- 172.21.15.44:0/3588069295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c011830 con 0x7f937809df30 2024-09-17T05:46:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f9374c00640 1 -- 172.21.15.44:0/3588069295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f936c016070 con 0x7f937809df30 2024-09-17T05:46:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9378166570 con 0x7f937809df30 2024-09-17T05:46:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f9374c00640 1 -- 172.21.15.44:0/3588069295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c011d80 con 0x7f937809df30 2024-09-17T05:46:16.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.536+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9378074030 con 0x7f937809df30 2024-09-17T05:46:16.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.540+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937815fdb0 con 0x7f937809df30 2024-09-17T05:46:16.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.540+0000 7f9374c00640 1 -- 172.21.15.44:0/3588069295 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f936c01a410 con 0x7f937809df30 2024-09-17T05:46:16.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.540+0000 7f9374c00640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9358073200 0x7f9358075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.540+0000 7f9374c00640 1 -- 172.21.15.44:0/3588069295 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 6187+0+0 (secure 0 0 0) 0x7f936c093ca0 con 0x7f937809df30 2024-09-17T05:46:16.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.540+0000 7f9377e00640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9358073200 0x7f9358075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.540+0000 7f9377e00640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9358073200 0x7f9358075710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9378152530 tx=0x7f936400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.544+0000 7f9374c00640 1 -- 172.21.15.44:0/3588069295 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f936c05e400 con 0x7f937809df30 2024-09-17T05:46:16.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.752+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f937806de00 con 0x7f937809df30 2024-09-17T05:46:16.753 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:46:16.752+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:46:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.756+0000 7f9374c00640 1 -- 172.21.15.44:0/3588069295 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v107) ==== 161+0+0 (secure 0 0 0) 0x7f936c062e30 con 0x7f937809df30 2024-09-17T05:46:16.756 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9358073200 msgr2=0x7f9358075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9358073200 0x7f9358075710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9378152530 tx=0x7f936400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f937809df30 msgr2=0x7f9378155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f937809df30 0x7f9378155b00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f936c00b420 tx=0x7f936c00b8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 shutdown_connections 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9358073200 0x7f9358075710 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93781602f0 0x7f9378151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f937815f9a0 0x7f9378074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 --2- 172.21.15.44:0/3588069295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f937809df30 0x7f9378155b00 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 >> 172.21.15.44:0/3588069295 conn(0x7f937806d450 msgr2=0x7f937809adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 shutdown_connections 2024-09-17T05:46:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.760+0000 7f937f400640 1 -- 172.21.15.44:0/3588069295 wait complete. 2024-09-17T05:46:16.769 INFO:tasks.ceph.mds.c.smithi044.stderr: -1798> 2024-09-17T05:46:13.768+0000 7f06bdc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:46:16.781 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force --yes-i-really-really-mean-it 2024-09-17T05:46:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 -- start start 2024-09-17T05:46:16.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 Processor -- start 2024-09-17T05:46:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db1680 0x564915ab2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db1b00 0x564915ab2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2400 0x564915ab2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564915ab8180 con 0x564914db1680 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564915ab8300 con 0x564914db1b00 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564915ab8480 con 0x564914db2400 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1980c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db1680 0x564915ab2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1980c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db1680 0x564915ab2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46282/0 (socket says 172.21.15.44:46282) 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.844+0000 7f1980c00640 1 -- 172.21.15.44:0/3203943240 learned_addr learned my addr 172.21.15.44:0/3203943240 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1981600640 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2400 0x564915ab2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1980200640 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db1b00 0x564915ab2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1980c00640 1 -- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2400 msgr2=0x564915ab2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1980c00640 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2400 0x564915ab2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1980c00640 1 -- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db1b00 msgr2=0x564915ab2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1980c00640 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db1b00 0x564915ab2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1980c00640 1 -- 172.21.15.44:0/3203943240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564914e0c960 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1980c00640 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db1680 0x564915ab2580 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x564915b43c20 tx=0x564914de88a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7a14f77e07231e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f197da00640 1 -- 172.21.15.44:0/3203943240 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564914d05520 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f197da00640 1 -- 172.21.15.44:0/3203943240 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564914d228c0 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f197da00640 1 -- 172.21.15.44:0/3203943240 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564914d051e0 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 1 -- 172.21.15.44:0/3203943240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564914e0cd20 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 1 -- 172.21.15.44:0/3203943240 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564914e0cf00 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 4 waiting for MDS map... 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f197da00640 1 -- 172.21.15.44:0/3203943240 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x564915ab1000 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f197da00640 1 -- 172.21.15.44:0/3203943240 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 107) ==== 2893+0+0 (secure 0 0 0) 0x564914d25180 con 0x564914db1680 2024-09-17T05:46:16.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 4 Got MDS map 107 2024-09-17T05:46:16.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 10 main: JournalTool::main 2024-09-17T05:46:16.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 4 main: JournalTool: connecting to RADOS... 2024-09-17T05:46:16.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 1 Processor -- start 2024-09-17T05:46:16.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.848+0000 7f1982a4a400 1 -- start start 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0480 0x564915ab3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564915ab8600 con 0x564914db0d80 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564915ab8780 con 0x564914db0480 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564915ab8900 con 0x564914db0900 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46288/0 (socket says 172.21.15.44:46288) 2024-09-17T05:46:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 -- 172.21.15.44:0/3958113283 learned_addr learned my addr 172.21.15.44:0/3958113283 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1980200640 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0480 0x564915ab3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1980c00640 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 -- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0900 msgr2=0x564915ab3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 -- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0480 msgr2=0x564915ab3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0480 0x564915ab3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 -- 172.21.15.44:0/3958113283 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564914e0cd20 con 0x564914db0d80 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1981600640 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x564915b43230 tx=0x564915abe4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c37678421fd28cf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f197b200640 1 -- 172.21.15.44:0/3958113283 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564914d05380 con 0x564914db0d80 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f197b200640 1 -- 172.21.15.44:0/3958113283 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564914d22e00 con 0x564914db0d80 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f197b200640 1 -- 172.21.15.44:0/3958113283 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564914d05520 con 0x564914db0d80 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- 172.21.15.44:0/3958113283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 msgr2=0x564915ab3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x564915b43230 tx=0x564915abe4e0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- 172.21.15.44:0/3958113283 shutdown_connections 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0480 0x564915ab3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3958113283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- 172.21.15.44:0/3958113283 >> 172.21.15.44:0/3958113283 conn(0x564914db1200 msgr2=0x564915002000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- 172.21.15.44:0/3958113283 shutdown_connections 2024-09-17T05:46:16.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- 172.21.15.44:0/3958113283 wait complete. 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 Processor -- start 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.852+0000 7f1982a4a400 1 -- start start 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0480 0x564915ab3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564915ab9b00 con 0x564914db0d80 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564915ab9980 con 0x564914db0900 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564915ab9800 con 0x564914db0480 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1980200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1980200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46302/0 (socket says 172.21.15.44:46302) 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1980200640 1 -- 172.21.15.44:0/3142272048 learned_addr learned my addr 172.21.15.44:0/3142272048 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1980c00640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1981600640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0480 0x564915ab3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1981600640 1 -- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0900 msgr2=0x564915ab3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1981600640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1981600640 1 -- 172.21.15.44:0/3142272048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 msgr2=0x564915ab3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1981600640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1981600640 1 -- 172.21.15.44:0/3142272048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564914e0da40 con 0x564914db0480 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1980200640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1981600640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0480 0x564915ab3b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x564915acf080 tx=0x564914dbccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1979400640 1 -- 172.21.15.44:0/3142272048 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564914d051e0 con 0x564914db0480 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1979400640 1 -- 172.21.15.44:0/3142272048 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564914d22c40 con 0x564914db0480 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x564914e0dc20 con 0x564914db0480 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1979400640 1 -- 172.21.15.44:0/3142272048 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564914d04820 con 0x564914db0480 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x564914e0c1e0 con 0x564914db0480 2024-09-17T05:46:16.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.856+0000 7f1982a4a400 4 main: JournalTool: resolving pool 17 2024-09-17T05:46:16.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1979400640 1 -- 172.21.15.44:0/3142272048 <== mon.2 v2:172.21.15.86:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x564915014c00 con 0x564914db0480 2024-09-17T05:46:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1979400640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x564914db3180 0x564915ab4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1979400640 1 -- 172.21.15.44:0/3142272048 <== mon.2 v2:172.21.15.86:3301/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x56491501e400 con 0x564914db0480 2024-09-17T05:46:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1982a4a400 4 main: JournalTool: creating IoCtx.. 2024-09-17T05:46:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1982a4a400 4 main: Executing for rank 0 2024-09-17T05:46:16.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1980c00640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x564914db3180 0x564915ab4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1980c00640 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x564914db3180 0x564915ab4100 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x564915b43f20 tx=0x564914de8ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1982a4a400 1 -- start start 2024-09-17T05:46:16.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.860+0000 7f1982a4a400 1 Processor -- start 2024-09-17T05:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db2880 0x564915ab4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2d00 0x564915ab4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db3600 0x564915ab5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564915ab9500 con 0x564914db3600 2024-09-17T05:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564915ab8780 con 0x564914db2880 2024-09-17T05:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x564915ab8a80 con 0x564914db2d00 2024-09-17T05:46:16.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db3600 0x564915ab5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1981600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db2880 0x564915ab4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980c00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2d00 0x564915ab4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db3600 0x564915ab5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46316/0 (socket says 172.21.15.44:46316) 2024-09-17T05:46:16.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980200640 1 -- 172.21.15.44:0/2070710381 learned_addr learned my addr 172.21.15.44:0/2070710381 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980c00640 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db2880 msgr2=0x564915ab4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980c00640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db2880 0x564915ab4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980c00640 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db3600 msgr2=0x564915ab5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980c00640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db3600 0x564915ab5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980c00640 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491516a5a0 con 0x564914db2d00 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1981600640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db2880 0x564915ab4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980200640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db3600 0x564915ab5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1980c00640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2d00 0x564915ab4c00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x564915172060 tx=0x564914de87e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4447ba26f0ff10e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1975800640 1 -- 172.21.15.44:0/2070710381 <== mon.2 v2:172.21.15.86:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564914d05040 con 0x564914db2d00 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1975800640 1 -- 172.21.15.44:0/2070710381 <== mon.2 v2:172.21.15.86:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x564914d22fc0 con 0x564914db2d00 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({osdmap=0}) -- 0x56491516a780 con 0x564914db2d00 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_subscribe({fsmap=0}) -- 0x56491516a960 con 0x564914db2d00 2024-09-17T05:46:16.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 4 waiting for MDS map... 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1975800640 1 -- 172.21.15.44:0/2070710381 <== mon.2 v2:172.21.15.86:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x56491504da00 con 0x564914db2d00 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1975800640 1 -- 172.21.15.44:0/2070710381 <== mon.2 v2:172.21.15.86:3301/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x564915178200 con 0x564914db2d00 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1975800640 1 -- 172.21.15.44:0/2070710381 <== mon.2 v2:172.21.15.86:3301/0 5 ==== fsmap(e 107) ==== 2893+0+0 (secure 0 0 0) 0x564914d25500 con 0x564914db2d00 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 4 Got MDS map 107 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x564914db3a80 0x564915ab5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:1 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56491517b000 con 0x564914db3a80 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1981600640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x564914db3a80 0x564915ab5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.864+0000 7f1981600640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x564914db3a80 0x564915ab5700 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=e5a2ff18c9ab0444 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.868+0000 7f1981600640 1 -- 172.21.15.44:0/2070710381 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v121'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564914dd8000 con 0x564914db3a80 2024-09-17T05:46:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.868+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x564915190000 0x564915194000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.868+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:2 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56491517b400 con 0x564915190000 2024-09-17T05:46:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.868+0000 7f1980200640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x564915190000 0x564915194000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.868+0000 7f1980200640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x564915190000 0x564915194000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=eb80e1c086ca86d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1980200640 1 -- 172.21.15.44:0/2070710381 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v121'36 uv36 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564914dd8500 con 0x564915190000 2024-09-17T05:46:16.871 INFO:teuthology.orchestra.run.smithi044.stdout:writing EResetJournal entry 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:3 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56491517b800 con 0x564915190000 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x564915190480 0x564915194580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:4 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x56491517bc00 con 0x564915190480 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:5 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5649151a6000 con 0x564914db3a80 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x564915190900 0x564915194b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:6 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5649151a6400 con 0x564915190900 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x564915190d80 0x564915195080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:7 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5649151a6800 con 0x564915190d80 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:8 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5649151a6c00 con 0x564914db3a80 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1981600640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x564915190480 0x564915194580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1980c00640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x564915190900 0x564915194b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1980200640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x564915190d80 0x564915195080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1981600640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x564915190480 0x564915194580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=b6882ce17257261b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1980c00640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x564915190900 0x564915194b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=5cb9780e360d8567 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1980200640 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x564915190d80 0x564915195080 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=8e6d026e73c39d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1981600640 1 -- 172.21.15.44:0/2070710381 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(8 200.00000006 [delete] v121'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564914dd8000 con 0x564914db3a80 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1980200640 1 -- 172.21.15.44:0/2070710381 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== osd_op_reply(3 200.00000001 [delete] v121'37 uv37 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564914dd8500 con 0x564915190000 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.872+0000 7f1981600640 1 -- 172.21.15.44:0/2070710381 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(5 200.00000003 [delete] v121'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564914dd8000 con 0x564914db3a80 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1981600640 1 -- 172.21.15.44:0/2070710381 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(4 200.00000002 [delete] v121'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564914dd8000 con 0x564915190480 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1980c00640 1 -- 172.21.15.44:0/2070710381 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(6 200.00000004 [delete] v121'9 uv8 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564914dd8780 con 0x564915190900 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1973a00640 1 -- 172.21.15.44:0/2070710381 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:9 17.14 17:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x564915175c00 con 0x564915190000 2024-09-17T05:46:16.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1980200640 1 -- 172.21.15.44:0/2070710381 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(7 200.00000005 [delete] v121'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564914dd8500 con 0x564915190d80 2024-09-17T05:46:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1980200640 1 -- 172.21.15.44:0/2070710381 <== osd.5 v2:172.21.15.86:6822/2837964024 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v121'38 uv38 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564914dd8500 con 0x564915190000 2024-09-17T05:46:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 4 Successfully wrote new journal pointer and header for rank 8:0 2024-09-17T05:46:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x564915190900 msgr2=0x564915194b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x564915190900 0x564915194b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x564915190480 msgr2=0x564915194580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x564915190480 0x564915194580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x564915190d80 msgr2=0x564915195080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x564915190d80 0x564915195080 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x564915190000 msgr2=0x564915194000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x564915190000 0x564915194000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1980200640 1 -- 172.21.15.44:0/2070710381 reap_dead start 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x564914db3a80 msgr2=0x564915ab5700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x564914db3a80 0x564915ab5700 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1980200640 1 -- 172.21.15.44:0/2070710381 reap_dead start 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2d00 msgr2=0x564915ab4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2d00 0x564915ab4c00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x564915172060 tx=0x564914de87e0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 shutdown_connections 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/2070710381 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2d00 0x564915ab4c00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 >> 172.21.15.44:0/2070710381 conn(0x564914db0000 msgr2=0x564915003000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 shutdown_connections 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/2070710381 wait complete. 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x564914db3180 msgr2=0x564915ab4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x564914db3180 0x564915ab4100 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x564915b43f20 tx=0x564914de8ea0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0480 msgr2=0x564915ab3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0480 0x564915ab3b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x564915acf080 tx=0x564914dbccc0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 shutdown_connections 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db0d80 0x564915ab3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x564914db3180 0x564915ab4100 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db0900 0x564915ab3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3142272048 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db0480 0x564915ab3b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 >> 172.21.15.44:0/3142272048 conn(0x564914db1200 msgr2=0x564915002000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 shutdown_connections 2024-09-17T05:46:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3142272048 wait complete. 2024-09-17T05:46:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3203943240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db1680 msgr2=0x564915ab2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db1680 0x564915ab2580 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x564915b43c20 tx=0x564914de88a0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3203943240 shutdown_connections 2024-09-17T05:46:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x564914db2400 0x564915ab2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564914db1b00 0x564915ab2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 --2- 172.21.15.44:0/3203943240 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564914db1680 0x564915ab2580 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3203943240 >> 172.21.15.44:0/3203943240 conn(0x564914db1f80 msgr2=0x564910ccb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3203943240 shutdown_connections 2024-09-17T05:46:16.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.876+0000 7f1982a4a400 1 -- 172.21.15.44:0/3203943240 wait complete. 2024-09-17T05:46:16.884 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force', '--yes-i-really-really-mean-it'] in time 0:00:00.103108, result: writing EResetJournal entry 2024-09-17T05:46:16.884 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-09-17T05:46:16.896 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:46:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.940+0000 7f26238358c0 1 -- start start 2024-09-17T05:46:16.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.940+0000 7f26238358c0 1 Processor -- start 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162d680 0x5556c237e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162db00 0x5556c237e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162df80 0x5556c237eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5556c23a0180 con 0x5556c162d680 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5556c23a0300 con 0x5556c162db00 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5556c23a0480 con 0x5556c162df80 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162d680 0x5556c237e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162d680 0x5556c237e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46338/0 (socket says 172.21.15.44:46338) 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 -- 172.21.15.44:0/858049417 learned_addr learned my addr 172.21.15.44:0/858049417 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2621400640 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162df80 0x5556c237eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620000640 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162db00 0x5556c237e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 -- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162df80 msgr2=0x5556c237eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162df80 0x5556c237eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 -- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162db00 msgr2=0x5556c237e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162db00 0x5556c237e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 -- 172.21.15.44:0/858049417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556bd5a01e0 con 0x5556c162d680 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f2620a00640 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162d680 0x5556c237e580 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x5556c24157d0 tx=0x5556c2390480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeaa55c3a722d71 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f261d800640 1 -- 172.21.15.44:0/858049417 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5556c15e3380 con 0x5556c162d680 2024-09-17T05:46:16.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f261d800640 1 -- 172.21.15.44:0/858049417 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5556c16008c0 con 0x5556c162d680 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f261d800640 1 -- 172.21.15.44:0/858049417 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5556c15e3520 con 0x5556c162d680 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 -- 172.21.15.44:0/858049417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556bd5a12c0 con 0x5556c162d680 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 1 -- 172.21.15.44:0/858049417 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5556bd5a03c0 con 0x5556c162d680 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 4 waiting for MDS map... 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f261d800640 1 -- 172.21.15.44:0/858049417 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x5556c24e4200 con 0x5556c162d680 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f261d800640 1 -- 172.21.15.44:0/858049417 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 107) ==== 2893+0+0 (secure 0 0 0) 0x5556c1603180 con 0x5556c162d680 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 4 Got MDS map 107 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 4 datascan.main: Using metadata pool output 2024-09-17T05:46:16.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.944+0000 7f26238358c0 4 datascan.main: connecting to RADOS... 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 Processor -- start 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- start start 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 0x5556c237f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162e880 0x5556c237fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5556c23a0600 con 0x5556c162e880 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5556c23a0780 con 0x5556c162cd80 2024-09-17T05:46:16.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5556c23a0900 con 0x5556c162c900 2024-09-17T05:46:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162e880 0x5556c237fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2621400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 0x5556c237f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162e880 0x5556c237fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46342/0 (socket says 172.21.15.44:46342) 2024-09-17T05:46:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 -- 172.21.15.44:0/839875541 learned_addr learned my addr 172.21.15.44:0/839875541 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620a00640 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 -- 172.21.15.44:0/839875541 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162c900 msgr2=0x5556c237f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 -- 172.21.15.44:0/839875541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 msgr2=0x5556c237f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 0x5556c237f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 -- 172.21.15.44:0/839875541 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556bd5a01e0 con 0x5556c162e880 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f2620000640 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162e880 0x5556c237fb80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x5556c239d410 tx=0x5556c24fec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59b3e656fd4587 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f261b000640 1 -- 172.21.15.44:0/839875541 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5556c15e3380 con 0x5556c162e880 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f261b000640 1 -- 172.21.15.44:0/839875541 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5556c1600e00 con 0x5556c162e880 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f261b000640 1 -- 172.21.15.44:0/839875541 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5556c15e3520 con 0x5556c162e880 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- 172.21.15.44:0/839875541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162e880 msgr2=0x5556c237fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162e880 0x5556c237fb80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x5556c239d410 tx=0x5556c24fec00 comp rx=0 tx=0).stop 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- 172.21.15.44:0/839875541 shutdown_connections 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162e880 0x5556c237fb80 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 --2- 172.21.15.44:0/839875541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 0x5556c237f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- 172.21.15.44:0/839875541 >> 172.21.15.44:0/839875541 conn(0x5556c162d200 msgr2=0x5556c18d6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- 172.21.15.44:0/839875541 shutdown_connections 2024-09-17T05:46:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.948+0000 7f26238358c0 1 -- 172.21.15.44:0/839875541 wait complete. 2024-09-17T05:46:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 Processor -- start 2024-09-17T05:46:16.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 -- start start 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 0x5556c237f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162e880 0x5556c237fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5556c23a1c80 con 0x5556c162c900 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5556c23a1b00 con 0x5556c162cd80 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x5556c23a1980 con 0x5556c162e880 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46352/0 (socket says 172.21.15.44:46352) 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 learned_addr learned my addr 172.21.15.44:0/2587674034 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:16.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2620000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162e880 0x5556c237fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2620a00640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 0x5556c237f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162e880 msgr2=0x5556c237fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162e880 0x5556c237fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 msgr2=0x5556c237f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162cd80 0x5556c237f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556bd5a14a0 con 0x5556c162c900 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162c900 0x5556c237f600 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x5556c19060f0 tx=0x5556c24fef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2619200640 1 -- 172.21.15.44:0/2587674034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5556c15e3380 con 0x5556c162c900 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2619200640 1 -- 172.21.15.44:0/2587674034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5556c1600c40 con 0x5556c162c900 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f2619200640 1 -- 172.21.15.44:0/2587674034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5556c15e3520 con 0x5556c162c900 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556bd5a1a40 con 0x5556c162c900 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556bd5a1c20 con 0x5556c162c900 2024-09-17T05:46:16.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.952+0000 7f26238358c0 4 datascan.init: resolving metadata pool 17 2024-09-17T05:46:16.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2619200640 1 -- 172.21.15.44:0/2587674034 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x5556c18fac00 con 0x5556c162c900 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2619200640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5556c162fa80 0x5556c2380100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2619200640 1 -- 172.21.15.44:0/2587674034 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x5556c18e3800 con 0x5556c162c900 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f26238358c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f26238358c0 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f26238358c0 4 datascan.main: opening data pool 'cephfs_data' 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x5556c162ed00 0x5556c2380680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190cc00 con 0x5556c162ed00 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2620a00640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5556c162fa80 0x5556c2380100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2620000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x5556c162ed00 0x5556c2380680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2620a00640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5556c162fa80 0x5556c2380100 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5556c239c390 tx=0x5556c16c8cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2620000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x5556c162ed00 0x5556c2380680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(1 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f261a600640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5556c1a12000 0x5556c1a1a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.956+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:2 18.20 18:04000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1c00 con 0x5556c1a12000 2024-09-17T05:46:16.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5556c1a12000 0x5556c1a1a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5556c1a12000 0x5556c1a1a000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(2 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f261b000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x5556c1a12480 0x5556c1a1a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:3 18.10 18:08000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1400 con 0x5556c1a12480 2024-09-17T05:46:16.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2620a00640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x5556c1a12480 0x5556c1a1a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2620a00640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x5556c1a12480 0x5556c1a1a580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(3 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:4 18.30 18:0c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190cc00 con 0x5556c162ed00 2024-09-17T05:46:16.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(4 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f261b000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5556c1a12900 0x5556c1a1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:5 18.8 18:10000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d400 con 0x5556c1a12900 2024-09-17T05:46:16.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2620000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5556c1a12900 0x5556c1a1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.960+0000 7f2620000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5556c1a12900 0x5556c1a1ab00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(5 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261a600640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x5556c1a13200 0x5556c1a1b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:6 18.28 18:14000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1800 con 0x5556c1a13200 2024-09-17T05:46:16.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x5556c1a13200 0x5556c1a1b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x5556c1a13200 0x5556c1a1b600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(6 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13200 2024-09-17T05:46:16.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261b000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5556c1a12d80 0x5556c1a1b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:7 18.18 18:18000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d800 con 0x5556c1a12d80 2024-09-17T05:46:16.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2620a00640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5556c1a12d80 0x5556c1a1b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2620a00640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5556c1a12d80 0x5556c1a1b080 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(7 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12d80 2024-09-17T05:46:16.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:8 18.38 18:1c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190dc00 con 0x5556c1a12d80 2024-09-17T05:46:16.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== osd_op_reply(8 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12d80 2024-09-17T05:46:16.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:9 18.4 18:20000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a000 con 0x5556c162ed00 2024-09-17T05:46:16.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(9 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:10 18.24 18:24000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3ac00 con 0x5556c162ed00 2024-09-17T05:46:16.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 4 ==== osd_op_reply(10 [pgnls start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.964+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:11 18.14 18:28000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a400 con 0x5556c1a13200 2024-09-17T05:46:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== osd_op_reply(11 [pgnls start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13200 2024-09-17T05:46:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:12 18.34 18:2c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b000 con 0x5556c162ed00 2024-09-17T05:46:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 5 ==== osd_op_reply(12 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261b000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5556c1a13b00 0x5556c1a1c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:13 18.c 18:30000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a800 con 0x5556c1a13b00 2024-09-17T05:46:16.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5556c1a13b00 0x5556c1a1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620000640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5556c1a13b00 0x5556c1a1c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(13 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a13b00 2024-09-17T05:46:16.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:14 18.2c 18:34000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b400 con 0x5556c1a12900 2024-09-17T05:46:16.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== osd_op_reply(14 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:15 18.1c 18:38000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a000 con 0x5556c1a12d80 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.4 v2:172.21.15.86:6810/2781128627 3 ==== osd_op_reply(15 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12d80 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:16 18.3c 18:3c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b800 con 0x5556c1a13b00 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== osd_op_reply(16 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a13b00 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:17 18.2 18:40000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3ac00 con 0x5556c1a12480 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== osd_op_reply(17 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261a600640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5556c1a13680 0x5556c1a1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:18 18.22 18:44000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a000 con 0x5556c1a13680 2024-09-17T05:46:16.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.968+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5556c1a13680 0x5556c1a1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f2621400640 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5556c1a13680 0x5556c1a1bb80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(18 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:19 18.12 18:48000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190cc00 con 0x5556c162ed00 2024-09-17T05:46:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 6 ==== osd_op_reply(19 [pgnls start_epoch 121 out=81b] v120'22 uv22 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:20 18.12 18:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d000 con 0x5556c162ed00 2024-09-17T05:46:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 7 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f26238358c0 10 datascan.operator(): handling object 1099511627778.0 2024-09-17T05:46:16.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:21 18.12 18:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a400 con 0x5556c162ed00 2024-09-17T05:46:16.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 8 ==== osd_op_reply(21 10000000002.00000000 [call] v121'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:22 18.32 18:4c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1c00 con 0x5556c162ed00 2024-09-17T05:46:16.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 9 ==== osd_op_reply(22 [pgnls start_epoch 121 out=49b] v119'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:23 18.a 18:50000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d400 con 0x5556c1a13680 2024-09-17T05:46:16.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.972+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== osd_op_reply(23 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:24 18.2a 18:54000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d800 con 0x5556c1a13200 2024-09-17T05:46:16.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.1 v2:172.21.15.44:6816/298260573 3 ==== osd_op_reply(24 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13200 2024-09-17T05:46:16.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:25 18.1a 18:58000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190cc00 con 0x5556c1a13680 2024-09-17T05:46:16.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 3 ==== osd_op_reply(25 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:26 18.3a 18:5c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190dc00 con 0x5556c1a12900 2024-09-17T05:46:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 3 ==== osd_op_reply(26 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:27 18.6 18:60000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d000 con 0x5556c1a13b00 2024-09-17T05:46:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.2 v2:172.21.15.44:6808/1191521276 3 ==== osd_op_reply(27 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a13b00 2024-09-17T05:46:16.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:28 18.26 18:64000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f0c00 con 0x5556c1a12d80 2024-09-17T05:46:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.4 v2:172.21.15.86:6810/2781128627 4 ==== osd_op_reply(28 [pgnls start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12d80 2024-09-17T05:46:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:29 18.16 18:68000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a000 con 0x5556c1a13680 2024-09-17T05:46:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 4 ==== osd_op_reply(29 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:30 18.36 18:6c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1400 con 0x5556c1a12900 2024-09-17T05:46:16.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 4 ==== osd_op_reply(30 [pgnls start_epoch 121 out=81b] v119'33 uv17 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:31 18.36 18:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1800 con 0x5556c1a12900 2024-09-17T05:46:16.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 5 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f26238358c0 10 datascan.operator(): handling object 1099511628279.0 2024-09-17T05:46:16.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.976+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:32 18.36 18:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b800 con 0x5556c1a12900 2024-09-17T05:46:16.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 6 ==== osd_op_reply(32 100000001f7.00000000 [call] v121'34 uv34 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:33 18.e 18:70000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3bc00 con 0x5556c1a12900 2024-09-17T05:46:16.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 7 ==== osd_op_reply(33 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:34 18.2e 18:74000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b800 con 0x5556c162ed00 2024-09-17T05:46:16.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 10 ==== osd_op_reply(34 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:35 18.1e 18:78000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a400 con 0x5556c1a12000 2024-09-17T05:46:16.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(35 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:36 18.3e 18:7c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1c00 con 0x5556c1a12900 2024-09-17T05:46:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 8 ==== osd_op_reply(36 [pgnls start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.980+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:37 18.1 18:80000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a800 con 0x5556c1a12900 2024-09-17T05:46:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 9 ==== osd_op_reply(37 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:38 18.21 18:84000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1400 con 0x5556c1a12000 2024-09-17T05:46:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(38 [pgnls start_epoch 121 out=49b] v119'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:39 18.11 18:88000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3ac00 con 0x5556c1a12900 2024-09-17T05:46:16.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 10 ==== osd_op_reply(39 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:40 18.31 18:8c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c24f1800 con 0x5556c1a13200 2024-09-17T05:46:16.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.1 v2:172.21.15.44:6816/298260573 4 ==== osd_op_reply(40 [pgnls start_epoch 121 out=81b] v119'15 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13200 2024-09-17T05:46:16.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:41 18.31 18:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a000 con 0x5556c1a13200 2024-09-17T05:46:16.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.1 v2:172.21.15.44:6816/298260573 5 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13200 2024-09-17T05:46:16.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f26238358c0 10 datascan.operator(): handling object 1099511627780.1 2024-09-17T05:46:16.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:42 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a400 con 0x5556c1a13680 2024-09-17T05:46:16.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 5 ==== osd_op_reply(42 10000000004.00000000 [call] v121'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:43 18.9 18:90000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d400 con 0x5556c162ed00 2024-09-17T05:46:16.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 11 ==== osd_op_reply(43 [pgnls start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:16.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:44 18.29 18:94000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190dc00 con 0x5556c1a13200 2024-09-17T05:46:16.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.1 v2:172.21.15.44:6816/298260573 6 ==== osd_op_reply(44 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13200 2024-09-17T05:46:16.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.984+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:45 18.19 18:98000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b000 con 0x5556c1a12000 2024-09-17T05:46:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 4 ==== osd_op_reply(45 [pgnls start_epoch 121 out=81b] v120'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:46 18.19 18:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d800 con 0x5556c1a12000 2024-09-17T05:46:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 5 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f26238358c0 10 datascan.operator(): handling object 1099511628280.0 2024-09-17T05:46:16.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:47 18.19 18:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5556c190cc00 con 0x5556c1a12000 2024-09-17T05:46:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 6 ==== osd_op_reply(47 100000001f8.00000000 [call] v121'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:48 18.39 18:9c000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a000 con 0x5556c1a12900 2024-09-17T05:46:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 11 ==== osd_op_reply(48 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:49 18.5 18:a0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b400 con 0x5556c1a13680 2024-09-17T05:46:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 6 ==== osd_op_reply(49 [pgnls start_epoch 121 out=81b] v121'14 uv14 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:50 18.5 18:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a400 con 0x5556c1a13680 2024-09-17T05:46:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 7 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f26238358c0 10 datascan.operator(): handling object 1099511627780.0 2024-09-17T05:46:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.988+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:51 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b000 con 0x5556c1a13680 2024-09-17T05:46:16.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 8 ==== osd_op_reply(51 10000000004.00000000 [call] v121'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:52 18.25 18:a4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190dc00 con 0x5556c1a12480 2024-09-17T05:46:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 3 ==== osd_op_reply(52 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:53 18.15 18:a8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3bc00 con 0x5556c1a13b00 2024-09-17T05:46:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.2 v2:172.21.15.44:6808/1191521276 4 ==== osd_op_reply(53 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a13b00 2024-09-17T05:46:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:54 18.35 18:ac000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d000 con 0x5556c1a12000 2024-09-17T05:46:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 7 ==== osd_op_reply(54 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:55 18.d 18:b0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4c000 con 0x5556c1a12000 2024-09-17T05:46:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 8 ==== osd_op_reply(55 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:56 18.2d 18:b4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4c000 con 0x5556c1a12480 2024-09-17T05:46:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 4 ==== osd_op_reply(56 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:57 18.1d 18:b8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4c400 con 0x5556c1a12900 2024-09-17T05:46:16.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 12 ==== osd_op_reply(57 [pgnls start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:58 18.3d 18:bc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d800 con 0x5556c1a13680 2024-09-17T05:46:16.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 9 ==== osd_op_reply(58 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.992+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:59 18.3 18:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4c800 con 0x5556c1a12d80 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.4 v2:172.21.15.86:6810/2781128627 5 ==== osd_op_reply(59 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12d80 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:60 18.23 18:c4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190cc00 con 0x5556c1a13680 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 10 ==== osd_op_reply(60 [pgnls start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:61 18.13 18:c8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4cc00 con 0x5556c1a12480 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 5 ==== osd_op_reply(61 [pgnls start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:62 18.33 18:cc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c190d000 con 0x5556c1a12900 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.5 v2:172.21.15.86:6822/2837964024 13 ==== osd_op_reply(62 [pgnls start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a12900 2024-09-17T05:46:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:63 18.b 18:d0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4d000 con 0x5556c1a12000 2024-09-17T05:46:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 9 ==== osd_op_reply(63 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:64 18.2b 18:d4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b400 con 0x5556c1a12480 2024-09-17T05:46:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 6 ==== osd_op_reply(64 [pgnls start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:65 18.1b 18:d8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4d400 con 0x5556c1a12d80 2024-09-17T05:46:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.4 v2:172.21.15.86:6810/2781128627 6 ==== osd_op_reply(65 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12d80 2024-09-17T05:46:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:66 18.3b 18:dc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a400 con 0x5556c1a12480 2024-09-17T05:46:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 7 ==== osd_op_reply(66 [pgnls start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:67 18.7 18:e0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4d800 con 0x5556c1a13680 2024-09-17T05:46:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.7 v2:172.21.15.86:6818/3939301135 11 ==== osd_op_reply(67 [pgnls start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a13680 2024-09-17T05:46:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:68 18.27 18:e4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b000 con 0x5556c1a12000 2024-09-17T05:46:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 10 ==== osd_op_reply(68 [pgnls start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:16.996+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:69 18.17 18:e8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4dc00 con 0x5556c1a12480 2024-09-17T05:46:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 8 ==== osd_op_reply(69 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:70 18.37 18:ec000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b400 con 0x5556c1a13b00 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.2 v2:172.21.15.44:6808/1191521276 5 ==== osd_op_reply(70 [pgnls start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a13b00 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:71 18.f 18:f0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4c000 con 0x5556c1a12480 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620a00640 1 -- 172.21.15.44:0/2587674034 <== osd.0 v2:172.21.15.44:6800/3049588557 9 ==== osd_op_reply(71 [pgnls start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6780 con 0x5556c1a12480 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:72 18.2f 18:f4000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3b800 con 0x5556c162ed00 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.6 v2:172.21.15.86:6802/218299486 12 ==== osd_op_reply(72 [pgnls start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c162ed00 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f261b000640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:73 18.1f 18:f8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a4c800 con 0x5556c1a13b00 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 <== osd.2 v2:172.21.15.44:6808/1191521276 6 ==== osd_op_reply(73 [pgnls start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6000 con 0x5556c1a13b00 2024-09-17T05:46:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f261a600640 1 -- 172.21.15.44:0/2587674034 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:74 18.3f 18:fc000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x5556c1a3a800 con 0x5556c1a12000 2024-09-17T05:46:17.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2621400640 1 -- 172.21.15.44:0/2587674034 <== osd.3 v2:172.21.15.44:6824/2051542036 11 ==== osd_op_reply(74 [pgnls start_epoch 121 out=49b] v119'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5556c16b6500 con 0x5556c1a12000 2024-09-17T05:46:17.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x5556c1a12480 msgr2=0x5556c1a1a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x5556c1a12480 0x5556c1a1a580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x5556c1a13200 msgr2=0x5556c1a1b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x5556c1a13200 0x5556c1a1b600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5556c1a13b00 msgr2=0x5556c1a1c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x5556c1a13b00 0x5556c1a1c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5556c1a12000 msgr2=0x5556c1a1a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x5556c1a12000 0x5556c1a1a000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5556c1a12d80 msgr2=0x5556c1a1b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x5556c1a12d80 0x5556c1a1b080 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5556c1a12900 msgr2=0x5556c1a1ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 reap_dead start 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x5556c1a12900 0x5556c1a1ab00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x5556c162ed00 msgr2=0x5556c2380680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x5556c162ed00 0x5556c2380680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5556c1a13680 msgr2=0x5556c1a1bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x5556c1a13680 0x5556c1a1bb80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 reap_dead start 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f2620000640 1 -- 172.21.15.44:0/2587674034 reap_dead start 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5556c162fa80 msgr2=0x5556c2380100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5556c162fa80 0x5556c2380100 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x5556c239c390 tx=0x5556c16c8cc0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162c900 msgr2=0x5556c237f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162c900 0x5556c237f600 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x5556c19060f0 tx=0x5556c24fef60 comp rx=0 tx=0).stop 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 shutdown_connections 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x5556c162fa80 0x5556c2380100 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/2587674034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162c900 0x5556c237f600 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 >> 172.21.15.44:0/2587674034 conn(0x5556c162d200 msgr2=0x5556c18d6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 shutdown_connections 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/2587674034 wait complete. 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/858049417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162d680 msgr2=0x5556c237e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162d680 0x5556c237e580 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x5556c24157d0 tx=0x5556c2390480 comp rx=0 tx=0).stop 2024-09-17T05:46:17.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/858049417 shutdown_connections 2024-09-17T05:46:17.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x5556c162df80 0x5556c237eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c162db00 0x5556c237e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 --2- 172.21.15.44:0/858049417 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5556c162d680 0x5556c237e580 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/858049417 >> 172.21.15.44:0/858049417 conn(0x5556c162e400 msgr2=0x5556bd5a9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/858049417 shutdown_connections 2024-09-17T05:46:17.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.000+0000 7f26238358c0 1 -- 172.21.15.44:0/858049417 wait complete. 2024-09-17T05:46:17.007 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.122801, result: 2024-09-17T05:46:17.007 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-09-17T05:46:17.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 -- start start 2024-09-17T05:46:17.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 Processor -- start 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2b680 0x55b131a88000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2bb00 0x55b131a88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2bf80 0x55b131a88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b131a98600 con 0x55b130d2b680 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b131a98480 con 0x55b130d2bb00 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b131a98300 con 0x55b130d2bf80 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2b680 0x55b131a88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2b680 0x55b131a88000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46372/0 (socket says 172.21.15.44:46372) 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 -- 172.21.15.44:0/2084947883 learned_addr learned my addr 172.21.15.44:0/2084947883 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2bf80 0x55b131a88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2bb00 0x55b131a88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 -- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2bf80 msgr2=0x55b131a88b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2bf80 0x55b131a88b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 -- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2bb00 msgr2=0x55b131a88580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2bb00 0x55b131a88580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 -- 172.21.15.44:0/2084947883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b12cc9e1e0 con 0x55b130d2b680 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2bf80 0x55b131a88b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2bb00 0x55b131a88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c1400640 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2b680 0x55b131a88000 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x55b131b09710 tx=0x55b130e2a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192c3b186906fa0e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2be200640 1 -- 172.21.15.44:0/2084947883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b130ce1380 con 0x55b130d2b680 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2be200640 1 -- 172.21.15.44:0/2084947883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b130cfec40 con 0x55b130d2b680 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2be200640 1 -- 172.21.15.44:0/2084947883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b130ce1520 con 0x55b130d2b680 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/2084947883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b12cc9f4a0 con 0x55b130d2b680 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/2084947883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55b12cc9e3c0 con 0x55b130d2b680 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 4 waiting for MDS map... 2024-09-17T05:46:17.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2be200640 1 -- 172.21.15.44:0/2084947883 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x55b130d9a200 con 0x55b130d2b680 2024-09-17T05:46:17.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2be200640 1 -- 172.21.15.44:0/2084947883 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 107) ==== 2893+0+0 (secure 0 0 0) 0x55b130d01180 con 0x55b130d2b680 2024-09-17T05:46:17.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 4 Got MDS map 107 2024-09-17T05:46:17.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 4 datascan.main: Using metadata pool output 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.112+0000 7fa2c336f8c0 4 datascan.main: connecting to RADOS... 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 Processor -- start 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- start start 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2a900 0x55b131a89600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b131a98180 con 0x55b130d2a900 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b130d0b380 con 0x55b130d2ad80 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b130d0b800 con 0x55b130d2c880 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2a900 0x55b131a89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2a900 0x55b131a89600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46384/0 (socket says 172.21.15.44:46384) 2024-09-17T05:46:17.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 -- 172.21.15.44:0/1731500902 learned_addr learned my addr 172.21.15.44:0/1731500902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 -- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 msgr2=0x55b131a89b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 -- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2ad80 msgr2=0x55b131a89080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 -- 172.21.15.44:0/1731500902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b12cc9e1e0 con 0x55b130d2a900 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2a900 0x55b131a89600 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x55b131be4270 tx=0x55b130dc6ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fa7b8725a1dd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2bba00640 1 -- 172.21.15.44:0/1731500902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b130ce11e0 con 0x55b130d2a900 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2bba00640 1 -- 172.21.15.44:0/1731500902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b130cfe000 con 0x55b130d2a900 2024-09-17T05:46:17.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2bba00640 1 -- 172.21.15.44:0/1731500902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b130ce1040 con 0x55b130d2a900 2024-09-17T05:46:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1731500902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2a900 msgr2=0x55b131a89600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2a900 0x55b131a89600 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x55b131be4270 tx=0x55b130dc6ea0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1731500902 shutdown_connections 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2a900 0x55b131a89600 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1731500902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1731500902 >> 172.21.15.44:0/1731500902 conn(0x55b130d2b200 msgr2=0x55b12cca4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1731500902 shutdown_connections 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.116+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1731500902 wait complete. 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 Processor -- start 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 -- start start 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2a900 0x55b131a89600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b131a99380 con 0x55b130d2ad80 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b131a99200 con 0x55b130d2a900 2024-09-17T05:46:17.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55b131a99500 con 0x55b130d2c880 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46388/0 (socket says 172.21.15.44:46388) 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 learned_addr learned my addr 172.21.15.44:0/1342267709 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2a900 0x55b131a89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 msgr2=0x55b131a89b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2a900 msgr2=0x55b131a89600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2a900 0x55b131a89600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b12cc9f2c0 con 0x55b130d2ad80 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2c880 0x55b131a89b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2ad80 0x55b131a89080 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x55b131be5560 tx=0x55b131becde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2b9c00640 1 -- 172.21.15.44:0/1342267709 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b130ce11e0 con 0x55b130d2ad80 2024-09-17T05:46:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2b9c00640 1 -- 172.21.15.44:0/1342267709 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b130cffa40 con 0x55b130d2ad80 2024-09-17T05:46:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b12cc9fa40 con 0x55b130d2ad80 2024-09-17T05:46:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2b9c00640 1 -- 172.21.15.44:0/1342267709 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b130ce1040 con 0x55b130d2ad80 2024-09-17T05:46:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b12cc9fc20 con 0x55b130d2ad80 2024-09-17T05:46:17.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.120+0000 7fa2c336f8c0 4 datascan.init: resolving metadata pool 17 2024-09-17T05:46:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2b9c00640 1 -- 172.21.15.44:0/1342267709 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x55b131bcec00 con 0x55b130d2ad80 2024-09-17T05:46:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2b9c00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b130d2da80 0x55b131a8a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2b9c00640 1 -- 172.21.15.44:0/1342267709 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x55b130fd6c00 con 0x55b130d2ad80 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c336f8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c336f8c0 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c336f8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b130d2cd00 0x55b131a8a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1400 con 0x55b130d2cd00 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b130d2da80 0x55b131a8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b130d2cd00 0x55b131a8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b130d2cd00 0x55b131a8a680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b130d2da80 0x55b131a8a100 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55b130db9590 tx=0x55b1310b45a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv32 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b130d2d180 0x55b131a8ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1800 con 0x55b130d2d180 2024-09-17T05:46:17.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.124+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b130d2d180 0x55b131a8ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b130d2d180 0x55b131a8ac00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b130d2d600 0x55b131a8b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa800 con 0x55b130d2d600 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b130d2d600 0x55b131a8b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b130d2d600 0x55b131a8b180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2bb000640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b131114000 0x55b13111c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb400 con 0x55b131114000 2024-09-17T05:46:17.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b131114000 0x55b13111c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b131114000 0x55b13111c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:5 18.10 18:08000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1400 con 0x55b130d2d180 2024-09-17T05:46:17.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.128+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:6 18.30 18:0c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb400 con 0x55b130d2d600 2024-09-17T05:46:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:7 18.8 18:10000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fbc00 con 0x55b130d2cd00 2024-09-17T05:46:17.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2bb000640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b131114480 0x55b13111c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:8 18.28 18:14000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb800 con 0x55b131114480 2024-09-17T05:46:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b131114480 0x55b13111c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b131114480 0x55b13111c580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114480 2024-09-17T05:46:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2bba00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55b131114d80 0x55b13111d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:9 18.18 18:18000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa400 con 0x55b131114d80 2024-09-17T05:46:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55b131114d80 0x55b13111d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1400640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55b131114d80 0x55b13111d080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb800 con 0x55b131114d80 2024-09-17T05:46:17.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.132+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1800 con 0x55b130d2d600 2024-09-17T05:46:17.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c000 con 0x55b130d2d600 2024-09-17T05:46:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1400 con 0x55b131114480 2024-09-17T05:46:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== osd_op_reply(13 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114480 2024-09-17T05:46:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c400 con 0x55b130d2d600 2024-09-17T05:46:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bba00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b131115200 0x55b13111d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa800 con 0x55b131115200 2024-09-17T05:46:17.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b131115200 0x55b13111d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c0a00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b131115200 0x55b13111d600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(15 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c800 con 0x55b130d2cd00 2024-09-17T05:46:17.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb400 con 0x55b131114d80 2024-09-17T05:46:17.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 3 ==== osd_op_reply(17 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112cc00 con 0x55b131115200 2024-09-17T05:46:17.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== osd_op_reply(18 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa400 con 0x55b130d2d180 2024-09-17T05:46:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.136+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bb000640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55b131114900 0x55b13111cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c800 con 0x55b131114900 2024-09-17T05:46:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55b131114900 0x55b13111cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c1e00640 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55b131114900 0x55b13111cb00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(20 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls-filter start_epoch 121 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb800 con 0x55b130d2d600 2024-09-17T05:46:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 6 ==== osd_op_reply(21 [pgnls-filter start_epoch 121 out=81b] v121'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:22 18.0 18:00000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fac00 con 0x55b130d2d600 2024-09-17T05:46:17.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:23 18.20 18:04000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d000 con 0x55b131114000 2024-09-17T05:46:17.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(23 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:24 18.10 18:08000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c000 con 0x55b130d2d180 2024-09-17T05:46:17.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:25 18.30 18:0c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d400 con 0x55b130d2d600 2024-09-17T05:46:17.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 8 ==== osd_op_reply(25 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:26 18.8 18:10000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1800 con 0x55b130d2cd00 2024-09-17T05:46:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.140+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:27 18.28 18:14000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d800 con 0x55b131114480 2024-09-17T05:46:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.1 v2:172.21.15.44:6816/298260573 3 ==== osd_op_reply(27 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114480 2024-09-17T05:46:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:28 18.18 18:18000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fbc00 con 0x55b131114d80 2024-09-17T05:46:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 4 ==== osd_op_reply(28 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:29 18.38 18:1c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112dc00 con 0x55b131114d80 2024-09-17T05:46:17.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 5 ==== osd_op_reply(29 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:30 18.4 18:20000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa800 con 0x55b130d2d600 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 9 ==== osd_op_reply(30 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:31 18.24 18:24000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb400 con 0x55b130d2d600 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 10 ==== osd_op_reply(31 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:32 18.14 18:28000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c400 con 0x55b131114480 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.1 v2:172.21.15.44:6816/298260573 4 ==== osd_op_reply(32 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114480 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:33 18.34 18:2c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb800 con 0x55b130d2d600 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 11 ==== osd_op_reply(33 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:34 18.c 18:30000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d400 con 0x55b131115200 2024-09-17T05:46:17.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:35 18.2c 18:34000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fac00 con 0x55b130d2cd00 2024-09-17T05:46:17.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 5 ==== osd_op_reply(35 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:36 18.1c 18:38000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112dc00 con 0x55b131114d80 2024-09-17T05:46:17.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 6 ==== osd_op_reply(36 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:37 18.3c 18:3c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fbc00 con 0x55b131115200 2024-09-17T05:46:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 4 ==== osd_op_reply(37 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.144+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:38 18.2 18:40000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c800 con 0x55b130d2d180 2024-09-17T05:46:17.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 5 ==== osd_op_reply(38 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:39 18.22 18:44000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa400 con 0x55b131114900 2024-09-17T05:46:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== osd_op_reply(39 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:40 18.12 18:48000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c000 con 0x55b130d2d600 2024-09-17T05:46:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 12 ==== osd_op_reply(40 [pgnls-filter start_epoch 121 out=49b] v121'23 uv23 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:41 18.32 18:4c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1400 con 0x55b130d2d600 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 13 ==== osd_op_reply(41 [pgnls-filter start_epoch 121 out=49b] v119'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:42 18.a 18:50000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d800 con 0x55b131114900 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 3 ==== osd_op_reply(42 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:43 18.2a 18:54000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112cc00 con 0x55b131114480 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.1 v2:172.21.15.44:6816/298260573 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114480 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:44 18.1a 18:58000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113c000 con 0x55b131114900 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 4 ==== osd_op_reply(44 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:45 18.3a 18:5c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d000 con 0x55b130d2cd00 2024-09-17T05:46:17.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 6 ==== osd_op_reply(45 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:46 18.6 18:60000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113c400 con 0x55b131115200 2024-09-17T05:46:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 5 ==== osd_op_reply(46 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:47 18.26 18:64000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d400 con 0x55b131114d80 2024-09-17T05:46:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 7 ==== osd_op_reply(47 [pgnls-filter start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.148+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:48 18.16 18:68000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113c800 con 0x55b131114900 2024-09-17T05:46:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 5 ==== osd_op_reply(48 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:49 18.36 18:6c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1800 con 0x55b130d2cd00 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 7 ==== osd_op_reply(49 [pgnls-filter start_epoch 121 out=81b] v121'34 uv34 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 10 datascan.operator(): handling object 100000001f7.0 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:50 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fac00 con 0x55b130d2cd00 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 8 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) ==== 416+0+194 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-09-17T05:46:17.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:51 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fbc00 con 0x55b130d2cd00 2024-09-17T05:46:17.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 9 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-09-17T05:46:17.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:52 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa400 con 0x55b131114d80 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 8 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv14 ondisk = 0) ==== 164+0+524 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.get_frag_of: frag is * 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:53 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1800 con 0x55b130d2cd00 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 10 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 10 datascan.find_or_create_dirfrag: read_version = 8 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-09-17T05:46:17.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:54 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa800 con 0x55b130d2cd00 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 11 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 20 datascan.read_dentry: bravo_head not found in result 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.152+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:55 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb400 con 0x55b130d2cd00 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 12 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v121'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c336f8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-09-17T05:46:17.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:56 18.e 18:70000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb800 con 0x55b130d2cd00 2024-09-17T05:46:17.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 13 ==== osd_op_reply(56 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:57 18.2e 18:74000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113c400 con 0x55b130d2d600 2024-09-17T05:46:17.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 14 ==== osd_op_reply(57 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:58 18.1e 18:78000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113cc00 con 0x55b131114000 2024-09-17T05:46:17.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(58 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:59 18.3e 18:7c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113c000 con 0x55b130d2cd00 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 14 ==== osd_op_reply(59 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:60 18.1 18:80000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113d000 con 0x55b130d2cd00 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 15 ==== osd_op_reply(60 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:61 18.21 18:84000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fac00 con 0x55b131114000 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 4 ==== osd_op_reply(61 [pgnls-filter start_epoch 121 out=49b] v119'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:62 18.11 18:88000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113d400 con 0x55b130d2cd00 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 16 ==== osd_op_reply(62 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:63 18.31 18:8c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb000 con 0x55b131114480 2024-09-17T05:46:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.1 v2:172.21.15.44:6816/298260573 6 ==== osd_op_reply(63 [pgnls-filter start_epoch 121 out=49b] v119'15 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114480 2024-09-17T05:46:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.156+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:64 18.9 18:90000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113d800 con 0x55b130d2d600 2024-09-17T05:46:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 15 ==== osd_op_reply(64 [pgnls-filter start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:65 18.29 18:94000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fbc00 con 0x55b131114480 2024-09-17T05:46:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.1 v2:172.21.15.44:6816/298260573 7 ==== osd_op_reply(65 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114480 2024-09-17T05:46:17.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:66 18.19 18:98000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113dc00 con 0x55b131114000 2024-09-17T05:46:17.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 5 ==== osd_op_reply(66 [pgnls-filter start_epoch 121 out=49b] v121'24 uv24 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:67 18.39 18:9c000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fa800 con 0x55b130d2cd00 2024-09-17T05:46:17.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 17 ==== osd_op_reply(67 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:68 18.5 18:a0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113cc00 con 0x55b131114900 2024-09-17T05:46:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 6 ==== osd_op_reply(68 [pgnls-filter start_epoch 121 out=49b] v121'15 uv15 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:69 18.25 18:a4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb400 con 0x55b130d2d180 2024-09-17T05:46:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 6 ==== osd_op_reply(69 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:70 18.15 18:a8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113c000 con 0x55b131115200 2024-09-17T05:46:17.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 6 ==== osd_op_reply(70 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:71 18.35 18:ac000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b131bd1800 con 0x55b131114000 2024-09-17T05:46:17.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 6 ==== osd_op_reply(71 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:72 18.d 18:b0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113d000 con 0x55b131114000 2024-09-17T05:46:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 7 ==== osd_op_reply(72 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.160+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:73 18.2d 18:b4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c000 con 0x55b130d2d180 2024-09-17T05:46:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:74 18.1d 18:b8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113d400 con 0x55b130d2cd00 2024-09-17T05:46:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 18 ==== osd_op_reply(74 [pgnls-filter start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:75 18.3d 18:bc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c400 con 0x55b131114900 2024-09-17T05:46:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 7 ==== osd_op_reply(75 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:76 18.3 18:c0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13113dc00 con 0x55b131114d80 2024-09-17T05:46:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 9 ==== osd_op_reply(76 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:77 18.23 18:c4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c800 con 0x55b131114900 2024-09-17T05:46:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 8 ==== osd_op_reply(77 [pgnls-filter start_epoch 121 out=49b] v119'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:78 18.13 18:c8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb800 con 0x55b130d2d180 2024-09-17T05:46:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 8 ==== osd_op_reply(78 [pgnls-filter start_epoch 121 out=49b] v119'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:79 18.33 18:cc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112cc00 con 0x55b130d2cd00 2024-09-17T05:46:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.5 v2:172.21.15.86:6822/2837964024 19 ==== osd_op_reply(79 [pgnls-filter start_epoch 121 out=49b] v119'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b130d2cd00 2024-09-17T05:46:17.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:80 18.b 18:d0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fac00 con 0x55b131114000 2024-09-17T05:46:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 8 ==== osd_op_reply(80 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:81 18.2b 18:d4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d000 con 0x55b130d2d180 2024-09-17T05:46:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 9 ==== osd_op_reply(81 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.164+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:82 18.1b 18:d8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c000 con 0x55b131114d80 2024-09-17T05:46:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.4 v2:172.21.15.86:6810/2781128627 10 ==== osd_op_reply(82 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b131114d80 2024-09-17T05:46:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:83 18.3b 18:dc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d400 con 0x55b130d2d180 2024-09-17T05:46:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 10 ==== osd_op_reply(83 [pgnls-filter start_epoch 121 out=49b] v119'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:84 18.7 18:e0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112c400 con 0x55b131114900 2024-09-17T05:46:17.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.7 v2:172.21.15.86:6818/3939301135 9 ==== osd_op_reply(84 [pgnls-filter start_epoch 121 out=49b] v119'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b131114900 2024-09-17T05:46:17.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:85 18.27 18:e4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d800 con 0x55b131114000 2024-09-17T05:46:17.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 9 ==== osd_op_reply(85 [pgnls-filter start_epoch 121 out=49b] v119'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:86 18.17 18:e8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb000 con 0x55b130d2d180 2024-09-17T05:46:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 11 ==== osd_op_reply(86 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:87 18.37 18:ec000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112dc00 con 0x55b131115200 2024-09-17T05:46:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 7 ==== osd_op_reply(87 [pgnls-filter start_epoch 121 out=49b] v119'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:88 18.f 18:f0000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fbc00 con 0x55b130d2d180 2024-09-17T05:46:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c1e00640 1 -- 172.21.15.44:0/1342267709 <== osd.0 v2:172.21.15.44:6800/3049588557 12 ==== osd_op_reply(88 [pgnls-filter start_epoch 121 out=49b] v119'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4500 con 0x55b130d2d180 2024-09-17T05:46:17.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:89 18.2f 18:f4000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112cc00 con 0x55b130d2d600 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c1400640 1 -- 172.21.15.44:0/1342267709 <== osd.6 v2:172.21.15.86:6802/218299486 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 121 out=49b] v119'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4780 con 0x55b130d2d600 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bb000640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:90 18.1f 18:f8000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b1310fb400 con 0x55b131115200 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.2 v2:172.21.15.44:6808/1191521276 8 ==== osd_op_reply(90 [pgnls-filter start_epoch 121 out=49b] v119'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131115200 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2bba00640 1 -- 172.21.15.44:0/1342267709 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:91 18.3f 18:fc000000::::head [pgnls-filter start_epoch 121 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x55b13112d800 con 0x55b131114000 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 <== osd.3 v2:172.21.15.44:6824/2051542036 10 ==== osd_op_reply(91 [pgnls-filter start_epoch 121 out=49b] v119'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55b130db4000 con 0x55b131114000 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b130d2d180 msgr2=0x55b131a8ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x55b130d2d180 0x55b131a8ac00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b131114480 msgr2=0x55b13111c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x55b131114480 0x55b13111c580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b131115200 msgr2=0x55b13111d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x55b131115200 0x55b13111d600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b131114000 msgr2=0x55b13111c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x55b131114000 0x55b13111c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55b131114d80 msgr2=0x55b13111d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x55b131114d80 0x55b13111d080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.168+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 reap_dead start 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b130d2cd00 msgr2=0x55b131a8a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x55b130d2cd00 0x55b131a8a680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b130d2d600 msgr2=0x55b131a8b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x55b130d2d600 0x55b131a8b180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55b131114900 msgr2=0x55b13111cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x55b131114900 0x55b13111cb00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c0a00640 1 -- 172.21.15.44:0/1342267709 reap_dead start 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b130d2da80 msgr2=0x55b131a8a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b130d2da80 0x55b131a8a100 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x55b130db9590 tx=0x55b1310b45a0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2ad80 msgr2=0x55b131a89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2ad80 0x55b131a89080 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x55b131be5560 tx=0x55b131becde0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 shutdown_connections 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2ad80 0x55b131a89080 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/1342267709 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x55b130d2da80 0x55b131a8a100 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 >> 172.21.15.44:0/1342267709 conn(0x55b130d2b200 msgr2=0x55b12cca4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 shutdown_connections 2024-09-17T05:46:17.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/1342267709 wait complete. 2024-09-17T05:46:17.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/2084947883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2b680 msgr2=0x55b131a88000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2b680 0x55b131a88000 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x55b131b09710 tx=0x55b130e2a360 comp rx=0 tx=0).stop 2024-09-17T05:46:17.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/2084947883 shutdown_connections 2024-09-17T05:46:17.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55b130d2bf80 0x55b131a88b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b130d2bb00 0x55b131a88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 --2- 172.21.15.44:0/2084947883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b130d2b680 0x55b131a88000 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/2084947883 >> 172.21.15.44:0/2084947883 conn(0x55b130d2c400 msgr2=0x55b12cca5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/2084947883 shutdown_connections 2024-09-17T05:46:17.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.172+0000 7fa2c336f8c0 1 -- 172.21.15.44:0/2084947883 wait complete. 2024-09-17T05:46:17.177 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.170146, result: 2024-09-17T05:46:17.178 DEBUG:teuthology.orchestra.run.smithi044:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-09-17T05:46:17.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 -- start start 2024-09-17T05:46:17.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 Processor -- start 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df1680 0x558ffab52580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df1b00 0x558ffab52000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df1f80 0x558ffab52b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ffab6c600 con 0x558ff9df1f80 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558ffab6c480 con 0x558ff9df1680 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x558ffab6c300 con 0x558ff9df1b00 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df1f80 0x558ffab52b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df1f80 0x558ffab52b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46410/0 (socket says 172.21.15.44:46410) 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 -- 172.21.15.44:0/2338985411 learned_addr learned my addr 172.21.15.44:0/2338985411 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:17.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb656600640 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df1b00 0x558ffab52000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657000640 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df1680 0x558ffab52580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 -- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df1b00 msgr2=0x558ffab52000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df1b00 0x558ffab52000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 -- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df1680 msgr2=0x558ffab52580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df1680 0x558ffab52580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657a00640 1 -- 172.21.15.44:0/2338985411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff5d641e0 con 0x558ff9df1f80 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb656600640 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df1b00 0x558ffab52000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.232+0000 7fb657000640 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df1680 0x558ffab52580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:17.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb657a00640 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df1f80 0x558ffab52b00 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x558ff9e5e0f0 tx=0x558ff9e8c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde69c3ae69f30a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb653e00640 1 -- 172.21.15.44:0/2338985411 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ff9da7520 con 0x558ff9df1f80 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 -- 172.21.15.44:0/2338985411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff5d654a0 con 0x558ff9df1f80 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb653e00640 1 -- 172.21.15.44:0/2338985411 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558ff9dc48c0 con 0x558ff9df1f80 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 -- 172.21.15.44:0/2338985411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({fsmap=0}) -- 0x558ff5d65a40 con 0x558ff9df1f80 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 4 waiting for MDS map... 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb653e00640 1 -- 172.21.15.44:0/2338985411 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ff9da71e0 con 0x558ff9df1f80 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb653e00640 1 -- 172.21.15.44:0/2338985411 <== mon.0 v2:172.21.15.44:3300/0 4 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x558ffaca8600 con 0x558ff9df1f80 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb653e00640 1 -- 172.21.15.44:0/2338985411 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 107) ==== 2893+0+0 (secure 0 0 0) 0x558ff9dc7180 con 0x558ff9df1f80 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 4 Got MDS map 107 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 4 datascan.main: Using metadata pool output 2024-09-17T05:46:17.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 4 datascan.main: connecting to RADOS... 2024-09-17T05:46:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 Processor -- start 2024-09-17T05:46:17.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 -- start start 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 0x558ffab53080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 0x558ffab53b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ffab6c180 con 0x558ff9df0900 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558ffab6c900 con 0x558ff9df2880 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x558ff9dd1800 con 0x558ff9df0d80 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb657000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb656600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 0x558ffab53080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb657000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46412/0 (socket says 172.21.15.44:46412) 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb657000640 1 -- 172.21.15.44:0/3386424038 learned_addr learned my addr 172.21.15.44:0/3386424038 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.236+0000 7fb656600640 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 0x558ffab53b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb657000640 1 -- 172.21.15.44:0/3386424038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 msgr2=0x558ffab53080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb657000640 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 0x558ffab53080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb657000640 1 -- 172.21.15.44:0/3386424038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 msgr2=0x558ffab53b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:17.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb657000640 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 0x558ffab53b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb657000640 1 -- 172.21.15.44:0/3386424038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff5d65c20 con 0x558ff9df0900 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb657000640 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x558ff9e5f680 tx=0x558ffacbaf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963b4db9c5ed0b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb651600640 1 -- 172.21.15.44:0/3386424038 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ff9da7520 con 0x558ff9df0900 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb651600640 1 -- 172.21.15.44:0/3386424038 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558ff9dc4fc0 con 0x558ff9df0900 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb651600640 1 -- 172.21.15.44:0/3386424038 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ff9da71e0 con 0x558ff9df0900 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3386424038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 msgr2=0x558ffab53600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x558ff9e5f680 tx=0x558ffacbaf60 comp rx=0 tx=0).stop 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3386424038 shutdown_connections 2024-09-17T05:46:17.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 0x558ffab53b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3386424038 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 0x558ffab53080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3386424038 >> 172.21.15.44:0/3386424038 conn(0x558ff9df1200 msgr2=0x558ffa098000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3386424038 shutdown_connections 2024-09-17T05:46:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3386424038 wait complete. 2024-09-17T05:46:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 Processor -- start 2024-09-17T05:46:17.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- start start 2024-09-17T05:46:17.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 0x558ffab53080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 0x558ffab53b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558ffab6c180 con 0x558ff9df0900 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558ffab6c900 con 0x558ff9df2880 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.240+0000 7fb65984c8c0 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x558ffab6d500 con 0x558ff9df0d80 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46414/0 (socket says 172.21.15.44:46414) 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 learned_addr learned my addr 172.21.15.44:0/3092192207 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 0x558ffab53080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 0x558ffab53b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 msgr2=0x558ffab53080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df0d80 0x558ffab53080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 msgr2=0x558ffab53b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df2880 0x558ffab53b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ff5d641e0 con 0x558ff9df0900 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x558ffabe17a0 tx=0x558ffacbaf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb64f800640 1 -- 172.21.15.44:0/3092192207 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ff9da7380 con 0x558ff9df0900 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb64f800640 1 -- 172.21.15.44:0/3092192207 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x558ff9dc4c40 con 0x558ff9df0900 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb64f800640 1 -- 172.21.15.44:0/3092192207 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558ff9da7520 con 0x558ff9df0900 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ff5d654a0 con 0x558ff9df0900 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ff5d65e00 con 0x558ff9df0900 2024-09-17T05:46:17.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb65984c8c0 4 datascan.init: resolving metadata pool 17 2024-09-17T05:46:17.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb64f800640 1 -- 172.21.15.44:0/3092192207 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x558ffa0cac00 con 0x558ff9df0900 2024-09-17T05:46:17.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb64f800640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x558ff9df3a80 0x558ffab54100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb64f800640 1 -- 172.21.15.44:0/3092192207 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x558ffa0c4c00 con 0x558ff9df0900 2024-09-17T05:46:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb65984c8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-09-17T05:46:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.244+0000 7fb65984c8c0 4 datascan.main: resolving metadata pool 17 2024-09-17T05:46:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558ff9df2d00 0x558ffab54680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ff9df2d00 2024-09-17T05:46:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x558ff9df3a80 0x558ffab54100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558ff9df2d00 0x558ffab54680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x558ff9df3a80 0x558ffab54100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x558ff9e5f680 tx=0x558ffacbb140 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558ff9df2d00 0x558ffab54680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== osd_op_reply(1 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x558ffa1cc000 0x558ffa1d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc000 2024-09-17T05:46:17.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x558ffa1cc000 0x558ffa1d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x558ffa1cc000 0x558ffa1d0000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== osd_op_reply(2 [pgnls start_epoch 121 out=177b] v120'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ff9df2d00 2024-09-17T05:46:17.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== osd_op_reply(3 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x558ffa1cc480 0x558ffa1d0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc480 2024-09-17T05:46:17.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x558ffa1cc480 0x558ffa1d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.248+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x558ffa1cc480 0x558ffa1d0580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== osd_op_reply(4 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x558ffa1ccd80 0x558ffa1d1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1ccd80 2024-09-17T05:46:17.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x558ffa1ccd80 0x558ffa1d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x558ffa1ccd80 0x558ffa1d1080 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== osd_op_reply(5 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x558ffa1cc900 0x558ffa1d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc900 2024-09-17T05:46:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x558ffa1cc900 0x558ffa1d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x558ffa1cc900 0x558ffa1d0b00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== osd_op_reply(6 [pgnls start_epoch 121 out=149b] v121'38 uv38 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x558ffa1cd200 0x558ffa1d1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cd200 2024-09-17T05:46:17.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x558ffa1cd200 0x558ffa1d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657000640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x558ffa1cd200 0x558ffa1d1600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== osd_op_reply(7 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.252+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc900 2024-09-17T05:46:17.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== osd_op_reply(8 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x558ffa1cd680 0x558ffa1d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cd680 2024-09-17T05:46:17.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x558ffa1cd680 0x558ffa1d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x558ffa1cd680 0x558ffa1d1b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== osd_op_reply(9 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc480 2024-09-17T05:46:17.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== osd_op_reply(10 [pgnls start_epoch 121 out=81b] v120'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cd680 2024-09-17T05:46:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== osd_op_reply(11 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc000 2024-09-17T05:46:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== osd_op_reply(12 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ff9df2d00 2024-09-17T05:46:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 3 ==== osd_op_reply(13 [pgnls start_epoch 121 out=77b] v120'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x558ffa1cdf80 0x558ffa1d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cdf80 2024-09-17T05:46:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x558ffa1cdf80 0x558ffa1d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x558ffa1cdf80 0x558ffa1d2680 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== osd_op_reply(14 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cdf80 2024-09-17T05:46:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.256+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1ccd80 2024-09-17T05:46:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== osd_op_reply(15 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1ccd80 2024-09-17T05:46:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 3 ==== osd_op_reply(16 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc900 2024-09-17T05:46:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 3 ==== osd_op_reply(17 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc000 2024-09-17T05:46:17.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 3 ==== osd_op_reply(18 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc480 2024-09-17T05:46:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 3 ==== osd_op_reply(19 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cd200 2024-09-17T05:46:17.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== osd_op_reply(20 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ff9df2d00 2024-09-17T05:46:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 4 ==== osd_op_reply(21 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cd200 2024-09-17T05:46:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 3 ==== osd_op_reply(22 [pgnls start_epoch 121 out=97b] v120'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ff9df2d00 2024-09-17T05:46:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 5 ==== osd_op_reply(23 [pgnls start_epoch 121 out=74b] v118'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.260+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cd680 2024-09-17T05:46:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 3 ==== osd_op_reply(24 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ff9df2d00 2024-09-17T05:46:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 6 ==== osd_op_reply(25 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc000 2024-09-17T05:46:17.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 4 ==== osd_op_reply(26 [pgnls start_epoch 121 out=98b] v120'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1ccd80 2024-09-17T05:46:17.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 4 ==== osd_op_reply(27 [pgnls start_epoch 121 out=76b] v121'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cd200 2024-09-17T05:46:17.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 4 ==== osd_op_reply(28 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc900 2024-09-17T05:46:17.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 4 ==== osd_op_reply(29 [pgnls start_epoch 121 out=105b] v121'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cdf80 2024-09-17T05:46:17.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== osd_op_reply(30 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cdf80 2024-09-17T05:46:17.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1ccd80 2024-09-17T05:46:17.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 5 ==== osd_op_reply(31 [pgnls start_epoch 121 out=73b] v121'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ff9df2d00 2024-09-17T05:46:17.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 7 ==== osd_op_reply(32 [pgnls start_epoch 121 out=101b] v121'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3c00 con 0x558ffa1cc000 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.264+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8000 con 0x558ffa1cc000 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-09-17T05:46:17.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8400 con 0x558ffa1cc000 2024-09-17T05:46:17.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv14 ondisk = 0) ==== 164+0+1047 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-09-17T05:46:17.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8800 con 0x558ffa1cc000 2024-09-17T05:46:17.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8000 con 0x558ffa1cc000 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3c00 con 0x558ffa1cc900 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 5 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv34 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-09-17T05:46:17.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffaca7800 con 0x558ffa1cc900 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:40 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffaca7400 con 0x558ffa1cc480 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 4 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) ==== 164+0+531 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:41 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8400 con 0x558ffa1ccd80 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 6 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8c00 con 0x558ffa1cd200 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 5 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.268+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9000 con 0x558ffa1cd680 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 4 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-09-17T05:46:17.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9400 con 0x558ffa1cc000 2024-09-17T05:46:17.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 10 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-09-17T05:46:17.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-17T05:46:17.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:45 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9800 con 0x558ffa1cc900 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3c00 con 0x558ffa1cc900 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) ==== 164+0+1561 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 20 datascan.scan_links: injected ino detected 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3400 con 0x558ff9df2d00 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 8 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ff9df2d00 2024-09-17T05:46:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 9 ==== osd_op_reply(48 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc000 2024-09-17T05:46:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 11 ==== osd_op_reply(49 [pgnls start_epoch 121 out=177b] v120'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ff9df2d00 2024-09-17T05:46:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 10 ==== osd_op_reply(50 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc480 2024-09-17T05:46:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 5 ==== osd_op_reply(51 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.272+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1ccd80 2024-09-17T05:46:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 7 ==== osd_op_reply(52 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc900 2024-09-17T05:46:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 9 ==== osd_op_reply(53 [pgnls start_epoch 121 out=149b] v121'38 uv38 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cd200 2024-09-17T05:46:17.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 6 ==== osd_op_reply(54 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc900 2024-09-17T05:46:17.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 10 ==== osd_op_reply(55 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cd680 2024-09-17T05:46:17.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 5 ==== osd_op_reply(56 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc480 2024-09-17T05:46:17.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 6 ==== osd_op_reply(57 [pgnls start_epoch 121 out=81b] v120'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cd680 2024-09-17T05:46:17.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 6 ==== osd_op_reply(58 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc000 2024-09-17T05:46:17.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 12 ==== osd_op_reply(59 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ff9df2d00 2024-09-17T05:46:17.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 11 ==== osd_op_reply(60 [pgnls start_epoch 121 out=77b] v120'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cdf80 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.2 v2:172.21.15.44:6808/1191521276 3 ==== osd_op_reply(61 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cdf80 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.276+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1ccd80 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 8 ==== osd_op_reply(62 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1ccd80 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 9 ==== osd_op_reply(63 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc900 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 11 ==== osd_op_reply(64 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc000 2024-09-17T05:46:17.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 13 ==== osd_op_reply(65 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc480 2024-09-17T05:46:17.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 7 ==== osd_op_reply(66 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cd200 2024-09-17T05:46:17.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 7 ==== osd_op_reply(67 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ff9df2d00 2024-09-17T05:46:17.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 12 ==== osd_op_reply(68 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cd200 2024-09-17T05:46:17.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 8 ==== osd_op_reply(69 [pgnls start_epoch 121 out=97b] v120'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ff9df2d00 2024-09-17T05:46:17.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 13 ==== osd_op_reply(70 [pgnls start_epoch 121 out=74b] v118'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cd680 2024-09-17T05:46:17.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 7 ==== osd_op_reply(71 [pgnls start_epoch 121 out=73b] v120'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ff9df2d00 2024-09-17T05:46:17.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 14 ==== osd_op_reply(72 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.280+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc000 2024-09-17T05:46:17.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 14 ==== osd_op_reply(73 [pgnls start_epoch 121 out=98b] v120'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1ccd80 2024-09-17T05:46:17.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 10 ==== osd_op_reply(74 [pgnls start_epoch 121 out=76b] v121'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cd200 2024-09-17T05:46:17.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 9 ==== osd_op_reply(75 [pgnls start_epoch 121 out=49b] v121'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cc900 2024-09-17T05:46:17.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 12 ==== osd_op_reply(76 [pgnls start_epoch 121 out=105b] v121'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1cdf80 2024-09-17T05:46:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.2 v2:172.21.15.44:6808/1191521276 4 ==== osd_op_reply(77 [pgnls start_epoch 121 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cdf80 2024-09-17T05:46:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ffa1ccd80 2024-09-17T05:46:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 11 ==== osd_op_reply(78 [pgnls start_epoch 121 out=73b] v121'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 121 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3000 con 0x558ff9df2d00 2024-09-17T05:46:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 15 ==== osd_op_reply(79 [pgnls start_epoch 121 out=101b] v121'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-09-17T05:46:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c2c00 con 0x558ffa1cc000 2024-09-17T05:46:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 15 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-09-17T05:46:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.284+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc000 2024-09-17T05:46:17.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 16 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-09-17T05:46:17.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffaca7800 con 0x558ffa1cc000 2024-09-17T05:46:17.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 17 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv14 ondisk = 0) ==== 164+0+1047 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-09-17T05:46:17.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8800 con 0x558ffa1cc000 2024-09-17T05:46:17.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 18 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-09-17T05:46:17.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8000 con 0x558ffa1cc000 2024-09-17T05:46:17.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 19 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-09-17T05:46:17.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9400 con 0x558ffa1cc900 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 13 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv34 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9800 con 0x558ffa1cc900 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 14 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- osd_op(unknown.0.0:87 17.12 17:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8400 con 0x558ffa1cc480 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.7 v2:172.21.15.86:6818/3939301135 8 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) ==== 164+0+531 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cc480 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-09-17T05:46:17.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- osd_op(unknown.0.0:88 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9000 con 0x558ffa1ccd80 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.6 v2:172.21.15.86:6802/218299486 12 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1ccd80 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9c00 con 0x558ffa1cd200 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 <== osd.3 v2:172.21.15.44:6824/2051542036 10 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a780 con 0x558ffa1cd200 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.288+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8c00 con 0x558ffa1cd680 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.1 v2:172.21.15.44:6816/298260573 8 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a000 con 0x558ffa1cd680 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-09-17T05:46:17.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-09-17T05:46:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-09-17T05:46:17.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8400 con 0x558ffa1cc000 2024-09-17T05:46:17.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 20 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-09-17T05:46:17.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:92 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f9c00 con 0x558ffa1cc900 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 15 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:93 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffaca7400 con 0x558ffa1cc900 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 16 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) ==== 164+0+1561 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 20 datascan.scan_links: injected ino detected 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-09-17T05:46:17.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffaca7800 con 0x558ff9df2d00 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 16 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) ==== 154+0+524 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: processing 1 injected_inos 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:95 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3c00 con 0x558ffa1cc900 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 17 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 20 datascan.scan_links: first is now 2 2024-09-17T05:46:17.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.292+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- osd_op(unknown.0.0:96 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c2c00 con 0x558ffa1cc900 2024-09-17T05:46:17.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.5 v2:172.21.15.86:6822/2837964024 18 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v121'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc900 2024-09-17T05:46:17.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-09-17T05:46:17.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 10 datascan.scan_links: updating inotable 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:97 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa0c3800 con 0x558ffa1cc000 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 21 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- osd_op(unknown.0.0:98 17.13 17:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8800 con 0x558ffa1cc000 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb657a00640 1 -- 172.21.15.44:0/3092192207 <== osd.4 v2:172.21.15.86:6810/2781128627 22 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v121'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x558ff9e7a500 con 0x558ffa1cc000 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 10 datascan.scan_links: updating snaptable 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- osd_op(unknown.0.0:99 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121) -- 0x558ffa1f8000 con 0x558ff9df2d00 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb656600640 1 -- 172.21.15.44:0/3092192207 <== osd.0 v2:172.21.15.44:6800/3049588557 17 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x558ff9e7a000 con 0x558ff9df2d00 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558ff9df2d00 msgr2=0x558ffab54680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x558ff9df2d00 0x558ffab54680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x558ffa1cd680 msgr2=0x558ffa1d1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x558ffa1cd680 0x558ffa1d1b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x558ffa1cdf80 msgr2=0x558ffa1d2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x558ffa1cdf80 0x558ffa1d2680 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x558ffa1cd200 msgr2=0x558ffa1d1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x558ffa1cd200 0x558ffa1d1600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x558ffa1cc000 msgr2=0x558ffa1d0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x558ffa1cc000 0x558ffa1d0000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 reap_dead start 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x558ffa1cc900 msgr2=0x558ffa1d0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x558ffa1cc900 0x558ffa1d0b00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 reap_dead start 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x558ffa1ccd80 msgr2=0x558ffa1d1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x558ffa1ccd80 0x558ffa1d1080 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x558ffa1cc480 msgr2=0x558ffa1d0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x558ffa1cc480 0x558ffa1d0580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb657000640 1 -- 172.21.15.44:0/3092192207 reap_dead start 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x558ff9df3a80 msgr2=0x558ffab54100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x558ff9df3a80 0x558ffab54100 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x558ff9e5f680 tx=0x558ffacbb140 comp rx=0 tx=0).stop 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 msgr2=0x558ffab53600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x558ffabe17a0 tx=0x558ffacbaf00 comp rx=0 tx=0).stop 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 shutdown_connections 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x558ff9df3a80 0x558ffab54100 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/3092192207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df0900 0x558ffab53600 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 >> 172.21.15.44:0/3092192207 conn(0x558ff9df1200 msgr2=0x558ffa098000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 shutdown_connections 2024-09-17T05:46:17.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.296+0000 7fb65984c8c0 1 -- 172.21.15.44:0/3092192207 wait complete. 2024-09-17T05:46:17.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 -- 172.21.15.44:0/2338985411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df1f80 msgr2=0x558ffab52b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df1f80 0x558ffab52b00 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x558ff9e5e0f0 tx=0x558ff9e8c7e0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 -- 172.21.15.44:0/2338985411 shutdown_connections 2024-09-17T05:46:17.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558ff9df1f80 0x558ffab52b00 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x558ff9df1b00 0x558ffab52000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 --2- 172.21.15.44:0/2338985411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558ff9df1680 0x558ffab52580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 -- 172.21.15.44:0/2338985411 >> 172.21.15.44:0/2338985411 conn(0x558ff9df2400 msgr2=0x558ff5d6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 -- 172.21.15.44:0/2338985411 shutdown_connections 2024-09-17T05:46:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.300+0000 7fb65984c8c0 1 -- 172.21.15.44:0/2338985411 wait complete. 2024-09-17T05:46:17.305 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.126975, result: 2024-09-17T05:46:17.305 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:17.309 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:17.349 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-17T05:46:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-17T05:46:17.349 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:17.350 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-17T05:46:17.351 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-17T05:46:17.352 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-17T05:46:17.353 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:17.354 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:17.355 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:17.356 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:17.357 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:17.358 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2024-09-17T05:46:17.359 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = False 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-17T05:46:17.360 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-17T05:46:17.361 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.362 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-17T05:46:17.363 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.364 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:17.365 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.366 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:17.367 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: mon down mkfs grace = 300 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-17T05:46:17.368 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = "" 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2024-09-17T05:46:17.369 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = False 2024-09-17T05:46:17.371 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:17.421 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:46:17.461 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-09-17T05:46:17.461 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-09-17T05:46:17.461 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:17.462 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-09-17T05:46:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-09-17T05:46:17.464 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.465 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.466 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:17.467 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-09-17T05:46:17.468 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:17.469 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-09-17T05:46:17.470 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2024-09-17T05:46:17.471 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.472 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.473 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-17T05:46:17.474 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.44,172.21.15.86,[v2:172.21.15.86:3301,v1:172.21.15.86:6790]" 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on skipped message = False 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 416ea1ed-afce-4e18-8956-62d00ca75710 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-17T05:46:17.475 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.476 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-17T05:46:17.477 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 20 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 20 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 10 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:17.478 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-17T05:46:17.479 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.480 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: mon down mkfs grace = 300 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = "" 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.a] 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.c] 2024-09-17T05:46:17.481 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.b] 2024-09-17T05:46:17.482 INFO:teuthology.orchestra.run.smithi086.stdout:[mds.d] 2024-09-17T05:46:17.482 INFO:teuthology.orchestra.run.smithi086.stdout:[mds] 2024-09-17T05:46:17.482 INFO:teuthology.orchestra.run.smithi086.stdout: mds verify scatter = True 2024-09-17T05:46:17.482 INFO:teuthology.orchestra.run.smithi086.stdout: mds debug scatterstat = True 2024-09-17T05:46:17.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-17T05:46:17.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 -- 172.21.15.44:0/1040650193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f41602f0 msgr2=0x7f28f406f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 --2- 172.21.15.44:0/1040650193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f41602f0 0x7f28f406f890 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f28f406dda0 tx=0x7f28ec01cd80 comp rx=0 tx=0).stop 2024-09-17T05:46:17.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 -- 172.21.15.44:0/1040650193 shutdown_connections 2024-09-17T05:46:17.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 --2- 172.21.15.44:0/1040650193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f41602f0 0x7f28f406f890 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 --2- 172.21.15.44:0/1040650193 >> v2:172.21.15.86:3300/0 conn(0x7f28f415f9a0 0x7f28f415fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 -- 172.21.15.44:0/1040650193 >> 172.21.15.44:0/1040650193 conn(0x7f28f406d450 msgr2=0x7f28f40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:17.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 -- 172.21.15.44:0/1040650193 shutdown_connections 2024-09-17T05:46:17.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 -- 172.21.15.44:0/1040650193 wait complete. 2024-09-17T05:46:17.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 Processor -- start 2024-09-17T05:46:17.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.692+0000 7f28fa200640 1 -- start start 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28f409df30 0x7f28f409ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f415f9a0 0x7f28f40ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28f41602f0 0x7f28f40ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f28f4168df0 con 0x7f28f415f9a0 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f28f4168c70 con 0x7f28f409df30 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f28f4168f70 con 0x7f28f41602f0 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f415f9a0 0x7f28f40ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28f3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28f409df30 0x7f28f409ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f415f9a0 0x7f28f40ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46440/0 (socket says 172.21.15.44:46440) 2024-09-17T05:46:17.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 -- 172.21.15.44:0/1328182550 learned_addr learned my addr 172.21.15.44:0/1328182550 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:17.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28f3e00640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28f41602f0 0x7f28f40ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 -- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28f41602f0 msgr2=0x7f28f40ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28f41602f0 0x7f28f40ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 -- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28f409df30 msgr2=0x7f28f409ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28f409df30 0x7f28f409ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 -- 172.21.15.44:0/1328182550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f41f86e0 con 0x7f28f415f9a0 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28f3400640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28f409df30 0x7f28f409ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28ebe00640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f415f9a0 0x7f28f40ce1f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e7c0 tx=0x7f28dc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28eb400640 1 -- 172.21.15.44:0/1328182550 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00cc60 con 0x7f28f415f9a0 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28eb400640 1 -- 172.21.15.44:0/1328182550 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28dc00ce00 con 0x7f28f415f9a0 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f409d390 con 0x7f28f415f9a0 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28eb400640 1 -- 172.21.15.44:0/1328182550 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc005280 con 0x7f28f415f9a0 2024-09-17T05:46:17.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f41fc480 con 0x7f28f415f9a0 2024-09-17T05:46:17.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f41fbf10 con 0x7f28f415f9a0 2024-09-17T05:46:17.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.696+0000 7f28eb400640 1 -- 172.21.15.44:0/1328182550 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f28dc005420 con 0x7f28f415f9a0 2024-09-17T05:46:17.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.700+0000 7f28eb400640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28d0073230 0x7f28d0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:17.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.700+0000 7f28eb400640 1 -- 172.21.15.44:0/1328182550 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f28dc094d80 con 0x7f28f415f9a0 2024-09-17T05:46:17.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.700+0000 7f28f3400640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28d0073230 0x7f28d0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:17.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.700+0000 7f28f3400640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28d0073230 0x7f28d0075740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f28e4001b70 tx=0x7f28e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:17.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.704+0000 7f28eb400640 1 -- 172.21.15.44:0/1328182550 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f28dc05f480 con 0x7f28f415f9a0 2024-09-17T05:46:17.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:17.916+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f28f415fdb0 con 0x7f28f415f9a0 2024-09-17T05:46:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.764+0000 7f28eb400640 1 -- 172.21.15.44:0/1328182550 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v109) ==== 162+0+0 (secure 0 0 0) 0x7f28dc063eb0 con 0x7f28f415f9a0 2024-09-17T05:46:18.765 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-17T05:46:18.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28d0073230 msgr2=0x7f28d0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:18.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28d0073230 0x7f28d0075740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f28e4001b70 tx=0x7f28e4009040 comp rx=0 tx=0).stop 2024-09-17T05:46:18.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f415f9a0 msgr2=0x7f28f40ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:18.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f415f9a0 0x7f28f40ce1f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00e7c0 tx=0x7f28dc00ec80 comp rx=0 tx=0).stop 2024-09-17T05:46:18.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 shutdown_connections 2024-09-17T05:46:18.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f28f41602f0 0x7f28f40ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28f415f9a0 0x7f28f40ce1f0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f28d0073230 0x7f28d0075740 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 --2- 172.21.15.44:0/1328182550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28f409df30 0x7f28f409ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 >> 172.21.15.44:0/1328182550 conn(0x7f28f406d450 msgr2=0x7f28f40b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:18.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 shutdown_connections 2024-09-17T05:46:18.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.768+0000 7f28fa200640 1 -- 172.21.15.44:0/1328182550 wait complete. 2024-09-17T05:46:18.797 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 -- 172.21.15.44:0/1185431259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb64072040 msgr2=0x7fdb64073de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1185431259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb64072040 0x7fdb64073de0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009c80 tx=0x7fdb5c01cda0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 -- 172.21.15.44:0/1185431259 shutdown_connections 2024-09-17T05:46:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1185431259 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb64072040 0x7fdb64073de0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1185431259 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb640cd790 0x7fdb64071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 -- 172.21.15.44:0/1185431259 >> 172.21.15.44:0/1185431259 conn(0x7fdb640b2cd0 msgr2=0x7fdb640b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 -- 172.21.15.44:0/1185431259 shutdown_connections 2024-09-17T05:46:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 -- 172.21.15.44:0/1185431259 wait complete. 2024-09-17T05:46:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 Processor -- start 2024-09-17T05:46:18.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.964+0000 7fdb6c000640 1 -- start start 2024-09-17T05:46:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb64072040 0x7fdb64158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb640cd380 0x7fdb640ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb640cd790 0x7fdb640ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb64168ee0 con 0x7fdb640cd790 2024-09-17T05:46:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb64168d60 con 0x7fdb640cd380 2024-09-17T05:46:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fdb64169060 con 0x7fdb64072040 2024-09-17T05:46:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb640cd790 0x7fdb640ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb640cd790 0x7fdb640ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39236/0 (socket says 172.21.15.44:39236) 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 -- 172.21.15.44:0/1901700374 learned_addr learned my addr 172.21.15.44:0/1901700374 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb69600640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb64072040 0x7fdb64158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb68c00640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb640cd380 0x7fdb640ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 -- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb64072040 msgr2=0x7fdb64158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb64072040 0x7fdb64158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 -- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb640cd380 msgr2=0x7fdb640ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb640cd380 0x7fdb640ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 -- 172.21.15.44:0/1901700374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb64159410 con 0x7fdb640cd790 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb68c00640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb640cd380 0x7fdb640ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6a000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb640cd790 0x7fdb640ca930 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c098790 tx=0x7fdb5c005c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb61600640 1 -- 172.21.15.44:0/1901700374 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0b2040 con 0x7fdb640cd790 2024-09-17T05:46:18.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb61600640 1 -- 172.21.15.44:0/1901700374 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb5c0bb070 con 0x7fdb640cd790 2024-09-17T05:46:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb61600640 1 -- 172.21.15.44:0/1901700374 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c004240 con 0x7fdb640cd790 2024-09-17T05:46:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb641f99e0 con 0x7fdb640cd790 2024-09-17T05:46:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb641f9fa0 con 0x7fdb640cd790 2024-09-17T05:46:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb64159680 con 0x7fdb640cd790 2024-09-17T05:46:18.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.968+0000 7fdb61600640 1 -- 172.21.15.44:0/1901700374 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdb5c0043e0 con 0x7fdb640cd790 2024-09-17T05:46:18.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.972+0000 7fdb61600640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb44073230 0x7fdb44075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:18.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.972+0000 7fdb61600640 1 -- 172.21.15.44:0/1901700374 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fdb5c12ed40 con 0x7fdb640cd790 2024-09-17T05:46:18.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.972+0000 7fdb69600640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb44073230 0x7fdb44075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:18.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.972+0000 7fdb69600640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb44073230 0x7fdb44075740 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdb58007fd0 tx=0x7fdb58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:18.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:18.976+0000 7fdb61600640 1 -- 172.21.15.44:0/1901700374 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fdb5c016990 con 0x7fdb640cd790 2024-09-17T05:46:19.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb64073de0 con 0x7fdb640cd790 2024-09-17T05:46:19.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb61600640 1 -- 172.21.15.44:0/1901700374 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5223 (secure 0 0 0) 0x7fdb5c0f9a80 con 0x7fdb640cd790 2024-09-17T05:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:19.184 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":110,"btime":"2024-09-17T05:46:18:772155+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:18.772120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8592":{"gid":8592,"name":"c","rank":0,"incarnation":110,"state":"up:replay","state_seq":1,"addr":"172.21.15.44:6835/2442475753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2442475753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2442475753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-17T05:46:19.185 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 110 2024-09-17T05:46:19.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb44073230 msgr2=0x7fdb44075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb44073230 0x7fdb44075740 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdb58007fd0 tx=0x7fdb58009040 comp rx=0 tx=0).stop 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb640cd790 msgr2=0x7fdb640ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb640cd790 0x7fdb640ca930 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c098790 tx=0x7fdb5c005c20 comp rx=0 tx=0).stop 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 shutdown_connections 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb640cd790 0x7fdb640ca930 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fdb44073230 0x7fdb44075740 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb640cd380 0x7fdb640ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 --2- 172.21.15.44:0/1901700374 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fdb64072040 0x7fdb64158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 >> 172.21.15.44:0/1901700374 conn(0x7fdb640b2cd0 msgr2=0x7fdb6406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.184+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 shutdown_connections 2024-09-17T05:46:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:19.188+0000 7fdb6c000640 1 -- 172.21.15.44:0/1901700374 wait complete. 2024-09-17T05:46:19.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 110, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:54.297928+0000', 'modified': '2024-09-17T05:46:18.772120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8592': {'gid': 8592, 'name': 'c', 'rank': 0, 'incarnation': 110, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.44:6835/2442475753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2442475753}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2442475753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:46:19.609 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8592:up:replay 2024-09-17T05:46:20.610 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 -- 172.21.15.44:0/901555642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16180b24e0 msgr2=0x7f16180ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 --2- 172.21.15.44:0/901555642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16180b24e0 0x7f16180ca7b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f160c009900 tx=0x7f160c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 -- 172.21.15.44:0/901555642 shutdown_connections 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 --2- 172.21.15.44:0/901555642 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16180cacf0 0x7f16180cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 --2- 172.21.15.44:0/901555642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16180b24e0 0x7f16180ca7b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 -- 172.21.15.44:0/901555642 >> 172.21.15.44:0/901555642 conn(0x7f16180ccbe0 msgr2=0x7f16180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 -- 172.21.15.44:0/901555642 shutdown_connections 2024-09-17T05:46:20.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.780+0000 7f1620600640 1 -- 172.21.15.44:0/901555642 wait complete. 2024-09-17T05:46:20.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 Processor -- start 2024-09-17T05:46:20.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 -- start start 2024-09-17T05:46:20.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16180b24e0 0x7f16180c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:20.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16180cacf0 0x7f1618159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f161815e9b0 0x7f16181fa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1618166370 con 0x7f161815e9b0 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16181661f0 con 0x7f16180cacf0 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f1620600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f16181664f0 con 0x7f16180b24e0 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f161815e9b0 0x7f16181fa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f161815e9b0 0x7f16181fa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39248/0 (socket says 172.21.15.44:39248) 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 -- 172.21.15.44:0/3900964398 learned_addr learned my addr 172.21.15.44:0/3900964398 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161d200640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16180cacf0 0x7f1618159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161dc00640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16180b24e0 0x7f16180c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 -- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16180b24e0 msgr2=0x7f16180c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16180b24e0 0x7f16180c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 -- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16180cacf0 msgr2=0x7f1618159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:20.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16180cacf0 0x7f1618159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.784+0000 7f161e600640 1 -- 172.21.15.44:0/3900964398 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161815a090 con 0x7f161815e9b0 2024-09-17T05:46:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f161e600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f161815e9b0 0x7f16181fa390 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f161000c6b0 tx=0x7f161000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:20.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f1615600640 1 -- 172.21.15.44:0/3900964398 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610003b80 con 0x7f161815e9b0 2024-09-17T05:46:20.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f1615600640 1 -- 172.21.15.44:0/3900964398 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1610003d20 con 0x7f161815e9b0 2024-09-17T05:46:20.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f1615600640 1 -- 172.21.15.44:0/3900964398 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610005330 con 0x7f161815e9b0 2024-09-17T05:46:20.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16180c5170 con 0x7f161815e9b0 2024-09-17T05:46:20.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16180c5430 con 0x7f161815e9b0 2024-09-17T05:46:20.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16180ca7b0 con 0x7f161815e9b0 2024-09-17T05:46:20.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.788+0000 7f1615600640 1 -- 172.21.15.44:0/3900964398 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f16100054d0 con 0x7f161815e9b0 2024-09-17T05:46:20.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.792+0000 7f1615600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15f8073200 0x7f15f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:20.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.792+0000 7f1615600640 1 -- 172.21.15.44:0/3900964398 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f1610094150 con 0x7f161815e9b0 2024-09-17T05:46:20.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.792+0000 7f161dc00640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15f8073200 0x7f15f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:20.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.792+0000 7f161dc00640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15f8073200 0x7f15f8075710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f160c0af000 tx=0x7f160c01b120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:20.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:20.796+0000 7f1615600640 1 -- 172.21.15.44:0/3900964398 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f161005e8d0 con 0x7f161815e9b0 2024-09-17T05:46:21.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f161815a260 con 0x7f161815e9b0 2024-09-17T05:46:21.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1615600640 1 -- 172.21.15.44:0/3900964398 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+5223 (secure 0 0 0) 0x7f1610063300 con 0x7f161815e9b0 2024-09-17T05:46:21.004 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:21.004 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":112,"btime":"2024-09-17T05:46:20:778720+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:19.780699+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8592":{"gid":8592,"name":"c","rank":0,"incarnation":110,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.44:6835/2442475753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2442475753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2442475753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-09-17T05:46:21.005 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 112 2024-09-17T05:46:21.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15f8073200 msgr2=0x7f15f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:21.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15f8073200 0x7f15f8075710 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f160c0af000 tx=0x7f160c01b120 comp rx=0 tx=0).stop 2024-09-17T05:46:21.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f161815e9b0 msgr2=0x7f16181fa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f161815e9b0 0x7f16181fa390 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f161000c6b0 tx=0x7f161000cb70 comp rx=0 tx=0).stop 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 shutdown_connections 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f161815e9b0 0x7f16181fa390 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f15f8073200 0x7f15f8075710 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16180cacf0 0x7f1618159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 --2- 172.21.15.44:0/3900964398 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f16180b24e0 0x7f16180c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 >> 172.21.15.44:0/3900964398 conn(0x7f16180ccbe0 msgr2=0x7f16180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 shutdown_connections 2024-09-17T05:46:21.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:21.004+0000 7f1620600640 1 -- 172.21.15.44:0/3900964398 wait complete. 2024-09-17T05:46:21.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:54.297928+0000', 'modified': '2024-09-17T05:46:19.780699+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8592': {'gid': 8592, 'name': 'c', 'rank': 0, 'incarnation': 110, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.44:6835/2442475753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2442475753}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2442475753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-17T05:46:21.429 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8592:up:rejoin 2024-09-17T05:46:22.430 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:22.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 -- 172.21.15.44:0/283750926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 msgr2=0x7ff52000cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:22.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 --2- 172.21.15.44:0/283750926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff52000cae0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ff5380c6e40 tx=0x7ff53001d5d0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 -- 172.21.15.44:0/283750926 shutdown_connections 2024-09-17T05:46:22.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 --2- 172.21.15.44:0/283750926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff52000cae0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 -- 172.21.15.44:0/283750926 >> 172.21.15.44:0/283750926 conn(0x7ff5380ccbe0 msgr2=0x7ff5380ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:22.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 -- 172.21.15.44:0/283750926 shutdown_connections 2024-09-17T05:46:22.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 -- 172.21.15.44:0/283750926 wait complete. 2024-09-17T05:46:22.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 Processor -- start 2024-09-17T05:46:22.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.603+0000 7ff53f600640 1 -- start start 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff53814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5380c6780 0x7ff5380701c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff538070700 0x7ff5381568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff5380cab40 con 0x7ff520006470 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5380ca9c0 con 0x7ff538070700 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff5380cacc0 con 0x7ff5380c6780 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff53814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff53814f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39260/0 (socket says 172.21.15.44:39260) 2024-09-17T05:46:22.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 -- 172.21.15.44:0/2282605754 learned_addr learned my addr 172.21.15.44:0/2282605754 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53d600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff538070700 0x7ff5381568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff537e00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5380c6780 0x7ff5380701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 -- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5380c6780 msgr2=0x7ff5380701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5380c6780 0x7ff5380701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 -- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff538070700 msgr2=0x7ff5381568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff538070700 0x7ff5381568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 -- 172.21.15.44:0/2282605754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff538070b10 con 0x7ff520006470 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff537e00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5380c6780 0x7ff5380701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53d600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff538070700 0x7ff5381568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53cc00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff53814f2b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ff52c006450 tx=0x7ff52c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff534c00640 1 -- 172.21.15.44:0/2282605754 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c015070 con 0x7ff520006470 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff534c00640 1 -- 172.21.15.44:0/2282605754 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff52c011840 con 0x7ff520006470 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5381f5390 con 0x7ff520006470 2024-09-17T05:46:22.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff534c00640 1 -- 172.21.15.44:0/2282605754 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c011c50 con 0x7ff520006470 2024-09-17T05:46:22.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5381f5650 con 0x7ff520006470 2024-09-17T05:46:22.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.607+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5380b1f80 con 0x7ff520006470 2024-09-17T05:46:22.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.611+0000 7ff534c00640 1 -- 172.21.15.44:0/2282605754 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff52c018070 con 0x7ff520006470 2024-09-17T05:46:22.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.611+0000 7ff534c00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff5180731d0 0x7ff5180756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:22.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.611+0000 7ff534c00640 1 -- 172.21.15.44:0/2282605754 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7ff52c0951a0 con 0x7ff520006470 2024-09-17T05:46:22.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.611+0000 7ff537e00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff5180731d0 0x7ff5180756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:22.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.611+0000 7ff537e00640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff5180731d0 0x7ff5180756e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff524000c10 tx=0x7ff524006b80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:22.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.615+0000 7ff534c00640 1 -- 172.21.15.44:0/2282605754 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff538070b10 con 0x7ff520006470 2024-09-17T05:46:22.767 INFO:tasks.ceph.mds.c.smithi044.stderr:2024-09-17T05:46:22.767+0000 7f228f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:46:22.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.823+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff538072ec0 con 0x7ff520006470 2024-09-17T05:46:22.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.823+0000 7ff534c00640 1 -- 172.21.15.44:0/2282605754 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5230 (secure 0 0 0) 0x7ff52c05fee0 con 0x7ff520006470 2024-09-17T05:46:22.826 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:22.826 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"btime":"2024-09-17T05:46:21:785920+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:21.785900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8592":{"gid":8592,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/2442475753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2442475753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2442475753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8592,"qdb_cluster":[8592]},"id":8}]} 2024-09-17T05:46:22.826 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff5180731d0 msgr2=0x7ff5180756e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff5180731d0 0x7ff5180756e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff524000c10 tx=0x7ff524006b80 comp rx=0 tx=0).stop 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 msgr2=0x7ff53814f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff53814f2b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ff52c006450 tx=0x7ff52c0039d0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 shutdown_connections 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff5180731d0 0x7ff5180756e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff538070700 0x7ff5381568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff5380c6780 0x7ff5380701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 --2- 172.21.15.44:0/2282605754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff520006470 0x7ff53814f2b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 >> 172.21.15.44:0/2282605754 conn(0x7ff5380ccbe0 msgr2=0x7ff5380b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 shutdown_connections 2024-09-17T05:46:22.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:22.827+0000 7ff53f600640 1 -- 172.21.15.44:0/2282605754 wait complete. 2024-09-17T05:46:23.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 113, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:45:54.297928+0000', 'modified': '2024-09-17T05:46:21.785900+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 121, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8592': {'gid': 8592, 'name': 'c', 'rank': 0, 'incarnation': 110, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6835/2442475753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 2442475753}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 2442475753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8592, 'qdb_cluster': [8592]} 2024-09-17T05:46:23.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:46:23.251 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:46:23.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 -- 172.21.15.44:0/667349246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800ccea0 msgr2=0x7fe580073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 --2- 172.21.15.44:0/667349246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800ccea0 0x7fe580073bd0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fe5800cb000 tx=0x7fe56801c800 comp rx=0 tx=0).stop 2024-09-17T05:46:23.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 -- 172.21.15.44:0/667349246 shutdown_connections 2024-09-17T05:46:23.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 --2- 172.21.15.44:0/667349246 >> v2:172.21.15.86:3300/0 conn(0x7fe5800cb070 0x7fe5800cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 --2- 172.21.15.44:0/667349246 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800ccea0 0x7fe580073bd0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 --2- 172.21.15.44:0/667349246 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5800cca90 0x7fe580073690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 -- 172.21.15.44:0/667349246 >> 172.21.15.44:0/667349246 conn(0x7fe5800b2510 msgr2=0x7fe5800b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 -- 172.21.15.44:0/667349246 shutdown_connections 2024-09-17T05:46:23.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.411+0000 7fe585400640 1 -- 172.21.15.44:0/667349246 wait complete. 2024-09-17T05:46:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 Processor -- start 2024-09-17T05:46:23.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 -- start start 2024-09-17T05:46:23.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800cb070 0x7fe58015f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5800cca90 0x7fe5801f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5800ccea0 0x7fe5801527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800c5c30 con 0x7fe5800cb070 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800c5ab0 con 0x7fe5800ccea0 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe5800c5db0 con 0x7fe5800cca90 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800cb070 0x7fe58015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800cb070 0x7fe58015f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39284/0 (socket says 172.21.15.44:39284) 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 -- 172.21.15.44:0/1865710619 learned_addr learned my addr 172.21.15.44:0/1865710619 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe575e00640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5800cca90 0x7fe5801f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57f200640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5800ccea0 0x7fe5801527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 -- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5800cca90 msgr2=0x7fe5801f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5800cca90 0x7fe5801f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 -- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5800ccea0 msgr2=0x7fe5801527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5800ccea0 0x7fe5801527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 -- 172.21.15.44:0/1865710619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5801f7620 con 0x7fe5800cb070 2024-09-17T05:46:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57f200640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5800ccea0 0x7fe5801527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe57e800640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800cb070 0x7fe58015f080 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe5700058d0 tx=0x7fe57000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe577400640 1 -- 172.21.15.44:0/1865710619 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570017070 con 0x7fe5800cb070 2024-09-17T05:46:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe577400640 1 -- 172.21.15.44:0/1865710619 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe570009d20 con 0x7fe5800cb070 2024-09-17T05:46:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe577400640 1 -- 172.21.15.44:0/1865710619 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700106c0 con 0x7fe5800cb070 2024-09-17T05:46:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58015f920 con 0x7fe5800cb070 2024-09-17T05:46:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.415+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5801f68e0 con 0x7fe5800cb070 2024-09-17T05:46:23.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.419+0000 7fe577400640 1 -- 172.21.15.44:0/1865710619 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe57001a070 con 0x7fe5800cb070 2024-09-17T05:46:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.419+0000 7fe577400640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe55c073200 0x7fe55c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.419+0000 7fe577400640 1 -- 172.21.15.44:0/1865710619 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fe570094560 con 0x7fe5800cb070 2024-09-17T05:46:23.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.419+0000 7fe575e00640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe55c073200 0x7fe55c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.419+0000 7fe58c9a9000 1 Processor -- start 2024-09-17T05:46:23.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.419+0000 7fe58c9a9000 1 -- start start 2024-09-17T05:46:23.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe575e00640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe55c073200 0x7fe55c075710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe5680af000 tx=0x7fe5680a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb1d9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb084950 0x55cecb1da040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 0x55cecb1da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cecb0aa410 con 0x55cecac94460 2024-09-17T05:46:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cecafe7b40 con 0x55cecb084950 2024-09-17T05:46:23.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55cecafd6f70 con 0x55cecb06dca0 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb1d9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb1d9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39290/0 (socket says 172.21.15.44:39290) 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 -- 172.21.15.44:0/3249971933 learned_addr learned my addr 172.21.15.44:0/3249971933 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 -- 172.21.15.44:0/3249971933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 msgr2=0x55cecb1da580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 --2- 172.21.15.44:0/3249971933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 0x55cecb1da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 -- 172.21.15.44:0/3249971933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb084950 msgr2=0x55cecb1da040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 --2- 172.21.15.44:0/3249971933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb084950 0x55cecb1da040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 -- 172.21.15.44:0/3249971933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cecaf9e5b0 con 0x55cecac94460 2024-09-17T05:46:23.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe57e800640 1 --2- 172.21.15.44:0/3249971933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb1d9b00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fe57005ec70 tx=0x7fe57005ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fb4a19ef906d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe56f000640 1 -- 172.21.15.44:0/3249971933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570063070 con 0x55cecac94460 2024-09-17T05:46:23.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe56f000640 1 -- 172.21.15.44:0/3249971933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe57005ece0 con 0x55cecac94460 2024-09-17T05:46:23.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe56f000640 1 -- 172.21.15.44:0/3249971933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570021070 con 0x55cecac94460 2024-09-17T05:46:23.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3249971933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 msgr2=0x55cecb1d9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3249971933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb1d9b00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fe57005ec70 tx=0x7fe57005ebe0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3249971933 shutdown_connections 2024-09-17T05:46:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3249971933 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 0x55cecb1da580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3249971933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb084950 0x55cecb1da040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3249971933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb1d9b00 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3249971933 >> 172.21.15.44:0/3249971933 conn(0x55cecb15ad90 msgr2=0x55cecb18a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3249971933 shutdown_connections 2024-09-17T05:46:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.423+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3249971933 wait complete. 2024-09-17T05:46:23.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 -- start start 2024-09-17T05:46:23.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 Processor -- start 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecac94460 0x55cecb1c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 0x55cecb1c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cecaf715f0 con 0x55cecb084950 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cecafdad80 con 0x55cecac94460 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55cecaf7d520 con 0x55cecb06dca0 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 10 client.0 _ll_register_callbacks cb 0x55cecaf81830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39304/0 (socket says 172.21.15.44:39304) 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 -- 172.21.15.44:0/2186762578 learned_addr learned my addr 172.21.15.44:0/2186762578 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:23.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57e800640 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecac94460 0x55cecb1c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe575e00640 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 0x55cecb1c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 -- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 msgr2=0x55cecb1c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 0x55cecb1c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 -- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecac94460 msgr2=0x55cecb1c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecac94460 0x55cecb1c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 -- 172.21.15.44:0/2186762578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cecaf75190 con 0x55cecb084950 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe57f200640 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1c8ba0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fe578010670 tx=0x7fe578010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3871dbfa947b831b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe563400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe563400640 1 -- 172.21.15.44:0/2186762578 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57800e9f0 con 0x55cecb084950 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe563400640 1 -- 172.21.15.44:0/2186762578 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fe57800eb90 con 0x55cecb084950 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cecaf6f110 con 0x55cecb084950 2024-09-17T05:46:23.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe563400640 1 -- 172.21.15.44:0/2186762578 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fe57800ed90 con 0x55cecb084950 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 10 client.8667 fetch_fsmap learned FSMap version 113 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55cecb05bf10 con 0x55cecb084950 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe563400640 1 -- 172.21.15.44:0/2186762578 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55cecaf6f110 con 0x55cecb084950 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.427+0000 7fe563400640 1 -- 172.21.15.44:0/2186762578 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7fe57800f040 con 0x55cecb084950 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 10 client.8667 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 10 client.8667 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 20 client.8667 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac797d0 0x55cecb1c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 4 client.8667 mds_command: new command op to 8592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 --> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cecafe9a90 con 0x55cecac797d0 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe57e800640 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac797d0 0x55cecb1c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe57e800640 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac797d0 0x55cecb1c95b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f315c2aa66eb5044 server_cookie=d6449c4a8bd2b94f in_seq=0 out_seq=0 2024-09-17T05:46:23.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe563400640 10 client.8667 ms_handle_connect on v2:172.21.15.44:6834/2442475753 2024-09-17T05:46:23.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe563400640 1 -- 172.21.15.44:0/2186762578 <== mds.0 v2:172.21.15.44:6834/2442475753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cecafe9a90 con 0x55cecac797d0 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe563400640 10 client.8667 handle_command_reply: tid=0 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 client.8667 shutdown 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 msgr2=0x55cecb1c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1c8ba0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fe578010670 tx=0x7fe578010b30 comp rx=0 tx=0).stop 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 shutdown_connections 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac797d0 0x55cecb1c95b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1c8ba0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb06dca0 0x55cecb1c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe563400640 0 client.8667 ms_handle_reset on v2:172.21.15.44:6834/2442475753 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/2186762578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecac94460 0x55cecb1c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 >> 172.21.15.44:0/2186762578 conn(0x55cecb15ad90 msgr2=0x55cecb192050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 shutdown_connections 2024-09-17T05:46:23.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 1 -- 172.21.15.44:0/2186762578 wait complete. 2024-09-17T05:46:23.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.431+0000 7fe58c9a9000 20 client.8667 trim_cache size 0 max 16384 2024-09-17T05:46:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 Processor -- start 2024-09-17T05:46:23.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 -- start start 2024-09-17T05:46:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecac94460 0x55cecb197190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1f0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe580201bb0 con 0x55cecb084950 2024-09-17T05:46:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800d05a0 con 0x55cecb06dca0 2024-09-17T05:46:23.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe5800cf900 con 0x55cecac94460 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1f0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39318/0 (socket says 172.21.15.44:39318) 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 -- 172.21.15.44:0/4251269552 learned_addr learned my addr 172.21.15.44:0/4251269552 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57e800640 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecac94460 0x55cecb197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe575e00640 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 -- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecac94460 msgr2=0x55cecb197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecac94460 0x55cecb197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 -- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 msgr2=0x55cecb1976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb1976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 -- 172.21.15.44:0/4251269552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cecb032db0 con 0x55cecb084950 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57e800640 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecac94460 0x55cecb197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe575e00640 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb1976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:23.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.451+0000 7fe57f200640 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1f0110 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fe578000f90 tx=0x7fe5780126b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4488f569652cf83f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe56e600640 1 -- 172.21.15.44:0/4251269552 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780039d0 con 0x55cecb084950 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe56e600640 1 -- 172.21.15.44:0/4251269552 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe578003c60 con 0x55cecb084950 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe56e600640 1 -- 172.21.15.44:0/4251269552 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57800e900 con 0x55cecb084950 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- 172.21.15.44:0/4251269552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 msgr2=0x55cecb1f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1f0110 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fe578000f90 tx=0x7fe5780126b0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- 172.21.15.44:0/4251269552 shutdown_connections 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecb084950 0x55cecb1f0110 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb1976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/4251269552 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecac94460 0x55cecb197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- 172.21.15.44:0/4251269552 >> 172.21.15.44:0/4251269552 conn(0x55cecb15ad90 msgr2=0x55cecb196a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- 172.21.15.44:0/4251269552 shutdown_connections 2024-09-17T05:46:23.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- 172.21.15.44:0/4251269552 wait complete. 2024-09-17T05:46:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- start start 2024-09-17T05:46:23.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 Processor -- start 2024-09-17T05:46:23.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb24f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb24fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb084950 0x55cecb250150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cecafa2ee0 con 0x55cecac94460 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5800cff50 con 0x55cecb06dca0 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x55cecaf901e0 con 0x55cecb084950 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe58c9a9000 10 client.0 _ll_register_callbacks cb 0x7fe578009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe57e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb24f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe57e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb24f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39326/0 (socket says 172.21.15.44:39326) 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.455+0000 7fe57e800640 1 -- 172.21.15.44:0/3193757902 learned_addr learned my addr 172.21.15.44:0/3193757902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe575e00640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb24fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57f200640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb084950 0x55cecb250150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57e800640 1 -- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb084950 msgr2=0x55cecb250150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57e800640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb084950 0x55cecb250150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57e800640 1 -- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 msgr2=0x55cecb24fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:46:23.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57e800640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb24fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57e800640 1 -- 172.21.15.44:0/3193757902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cecaf9dab0 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe575e00640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb24fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57f200640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb084950 0x55cecb250150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe57e800640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb24f6d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe570005fd0 tx=0x7fe570092680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3623c09771e3ed20 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 1 -- 172.21.15.44:0/3193757902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570021040 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 1 -- 172.21.15.44:0/3193757902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7fe570084170 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe578003c60 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 1 -- 172.21.15.44:0/3193757902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fe570063040 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 10 client.8673 fetch_fsmap learned FSMap version 113 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55cecaf7c070 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 1 -- 172.21.15.44:0/3193757902 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe578003c60 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 1 -- 172.21.15.44:0/3193757902 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 113) ==== 3502+0+0 (secure 0 0 0) 0x7fe5700940b0 con 0x55cecac94460 2024-09-17T05:46:23.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 10 client.8673 fetch_fsmap finished waiting for FSMap version 113 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 10 client.8673 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 20 client.8673 populate_metadata read hostname 'smithi044' 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac67830 0x55cecb1ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 4 client.8673 mds_command: new command op to 8592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 --> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] -- command(tid 0: {"prefix": "status"}) -- 0x55cecafe5540 con 0x55cecac67830 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe575e00640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac67830 0x55cecb1ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe575e00640 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac67830 0x55cecb1ecaa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb09a4c8a0314e0 server_cookie=27e9560df07cb649 in_seq=0 out_seq=0 2024-09-17T05:46:23.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 10 client.8673 ms_handle_connect on v2:172.21.15.44:6834/2442475753 2024-09-17T05:46:23.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 1 -- 172.21.15.44:0/3193757902 <== mds.0 v2:172.21.15.44:6834/2442475753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x55cecafe5540 con 0x55cecac67830 2024-09-17T05:46:23.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 10 client.8673 handle_command_reply: tid=0 2024-09-17T05:46:23.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 client.8673 shutdown 2024-09-17T05:46:23.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 msgr2=0x55cecb24f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb24f6d0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fe570005fd0 tx=0x7fe570092680 comp rx=0 tx=0).stop 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 shutdown_connections 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:6834/2442475753,v1:172.21.15.44:6835/2442475753] conn(0x55cecac67830 0x55cecb1ecaa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x55cecb084950 0x55cecb250150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cecb06dca0 0x55cecb24fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe563400640 0 client.8673 ms_handle_reset on v2:172.21.15.44:6834/2442475753 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 --2- 172.21.15.44:0/3193757902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cecac94460 0x55cecb24f6d0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 >> 172.21.15.44:0/3193757902 conn(0x55cecb15ad90 msgr2=0x55cecb197440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 shutdown_connections 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 1 -- 172.21.15.44:0/3193757902 wait complete. 2024-09-17T05:46:23.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe58c9a9000 20 client.8673 trim_cache size 0 max 16384 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "416ea1ed-afce-4e18-8956-62d00ca75710", 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 8592, 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 4.6886789039999996, 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 113, 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 121, 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 121, 2024-09-17T05:46:23.466 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 6.5615023639999999 2024-09-17T05:46:23.467 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:23.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe55c073200 msgr2=0x7fe55c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe55c073200 0x7fe55c075710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe5680af000 tx=0x7fe5680a7040 comp rx=0 tx=0).stop 2024-09-17T05:46:23.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800cb070 msgr2=0x7fe58015f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800cb070 0x7fe58015f080 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe5700058d0 tx=0x7fe57000dde0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 shutdown_connections 2024-09-17T05:46:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe55c073200 0x7fe55c075710 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5800ccea0 0x7fe5801527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe5800cca90 0x7fe5801f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 --2- 172.21.15.44:0/1865710619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5800cb070 0x7fe58015f080 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 >> 172.21.15.44:0/1865710619 conn(0x7fe5800b2510 msgr2=0x7fe580157060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 shutdown_connections 2024-09-17T05:46:23.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.459+0000 7fe585400640 1 -- 172.21.15.44:0/1865710619 wait complete. 2024-09-17T05:46:23.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:46:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 -- 172.21.15.44:0/669279969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc15fb40 msgr2=0x7f42fc074b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 --2- 172.21.15.44:0/669279969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc15fb40 0x7f42fc074b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009840 tx=0x7f42ec01c840 comp rx=0 tx=0).stop 2024-09-17T05:46:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 -- 172.21.15.44:0/669279969 shutdown_connections 2024-09-17T05:46:23.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 --2- 172.21.15.44:0/669279969 >> v2:172.21.15.86:3300/0 conn(0x7f42fc071860 0x7f42fc071c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 --2- 172.21.15.44:0/669279969 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc15fb40 0x7f42fc074b50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 -- 172.21.15.44:0/669279969 >> 172.21.15.44:0/669279969 conn(0x7f42fc0d11f0 msgr2=0x7f42fc0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 -- 172.21.15.44:0/669279969 shutdown_connections 2024-09-17T05:46:23.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.639+0000 7f4301200640 1 -- 172.21.15.44:0/669279969 wait complete. 2024-09-17T05:46:23.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 Processor -- start 2024-09-17T05:46:23.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 -- start start 2024-09-17T05:46:23.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc06fdd0 0x7f42fc1fa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42fc071860 0x7f42fc14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc15fb40 0x7f42fc152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc169010 con 0x7f42fc071860 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc168e90 con 0x7f42fc15fb40 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f4301200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc169190 con 0x7f42fc06fdd0 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42fc071860 0x7f42fc14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42fc071860 0x7f42fc14afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39330/0 (socket says 172.21.15.44:39330) 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 -- 172.21.15.44:0/174579506 learned_addr learned my addr 172.21.15.44:0/174579506 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f9e00640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc06fdd0 0x7f42fc1fa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42fa800640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc15fb40 0x7f42fc152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 -- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc06fdd0 msgr2=0x7f42fc1fa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc06fdd0 0x7f42fc1fa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 -- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc15fb40 msgr2=0x7f42fc152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc15fb40 0x7f42fc152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.643+0000 7f42f3e00640 1 -- 172.21.15.44:0/174579506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc158560 con 0x7f42fc071860 2024-09-17T05:46:23.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f42f3e00640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42fc071860 0x7f42fc14afd0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009fd0 tx=0x7f42e400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f42f2000640 1 -- 172.21.15.44:0/174579506 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4004220 con 0x7f42fc071860 2024-09-17T05:46:23.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f42f2000640 1 -- 172.21.15.44:0/174579506 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e400c8b0 con 0x7f42fc071860 2024-09-17T05:46:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f42f2000640 1 -- 172.21.15.44:0/174579506 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e400cd00 con 0x7f42fc071860 2024-09-17T05:46:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc1faea0 con 0x7f42fc071860 2024-09-17T05:46:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc158d40 con 0x7f42fc071860 2024-09-17T05:46:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42fc1587d0 con 0x7f42fc071860 2024-09-17T05:46:23.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f42f2000640 1 -- 172.21.15.44:0/174579506 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f42e4003600 con 0x7f42fc071860 2024-09-17T05:46:23.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f42f2000640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d8073200 0x7f42d8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:23.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.647+0000 7f42f2000640 1 -- 172.21.15.44:0/174579506 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f42e4094aa0 con 0x7f42fc071860 2024-09-17T05:46:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.651+0000 7f42f9e00640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d8073200 0x7f42d8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:23.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.651+0000 7f42f9e00640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d8073200 0x7f42d8075710 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0af000 tx=0x7f42ec01b080 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:23.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.655+0000 7f42f2000640 1 -- 172.21.15.44:0/174579506 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f42e405f900 con 0x7f42fc071860 2024-09-17T05:46:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.867+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f42fc071c70 con 0x7f42fc071860 2024-09-17T05:46:23.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.867+0000 7f42f2000640 1 -- 172.21.15.44:0/174579506 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v113) ==== 53+0+73 (secure 0 0 0) 0x7f42e405f200 con 0x7f42fc071860 2024-09-17T05:46:23.868 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d8073200 msgr2=0x7f42d8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d8073200 0x7f42d8075710 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0af000 tx=0x7f42ec01b080 comp rx=0 tx=0).stop 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42fc071860 msgr2=0x7f42fc14afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42fc071860 0x7f42fc14afd0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009fd0 tx=0x7f42e400eb50 comp rx=0 tx=0).stop 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 shutdown_connections 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f42d8073200 0x7f42d8075710 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42fc15fb40 0x7f42fc152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42fc071860 0x7f42fc14afd0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 --2- 172.21.15.44:0/174579506 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f42fc06fdd0 0x7f42fc1fa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 >> 172.21.15.44:0/174579506 conn(0x7f42fc0d11f0 msgr2=0x7f42fc15cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 shutdown_connections 2024-09-17T05:46:23.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:23.871+0000 7f4301200640 1 -- 172.21.15.44:0/174579506 wait complete. 2024-09-17T05:46:23.891 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:46:23.891 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:46:23.891 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-09-17T05:46:23.891 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:46:23.891 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:23.891 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:46:23.892 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:46:23.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:46:23.892 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:23.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:23.892 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-09-17T05:46:23.901 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:46:23.901 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:23.902 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41822sec preferred_lft 41822sec 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 02:42:f4:75:09:50 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:46:23.903 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:46:23.904 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:46:23.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:23.905 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:46:23.960 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:46:23.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:23.962 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-09-17T05:46:24.016 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-09-17T05:46:24.016 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:46:24.016 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:46:24.016 INFO:teuthology.orchestra.run.smithi044.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:46:24.016 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:46:24.016 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:46:24.016 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:46:24.017 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-09-17T05:46:24.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:46:24.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:46:24.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:46:24.017 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-09-17T05:46:24.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:46:24.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:24.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:24.156 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:46:24.165 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:46:24.166 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:46:24.166 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:24.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:24.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-09-17T05:46:24.226 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:24.226 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:24.282 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:46:24.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:46:24.282 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:24.337 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T05:46:24.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:24.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:24.440 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:24.440 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:24.440 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:24.458 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:24.459 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:24.459 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:24.459 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:24.459 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:24.470 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T05:46:24.470 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T05:46:24.470 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-09-17T05:46:24.470 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.86:3300,172.21.15.86:3301" 2024-09-17T05:46:24.470 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T05:46:24.470 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790" 2024-09-17T05:46:24.471 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.86:6789,172.21.15.86:6790:/ 2024-09-17T05:46:24.471 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=416ea1ed-afce-4e18-8956-62d00ca75710" will pass to kernel 2024-09-17T05:46:24.474 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:46:24.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:24.474 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:24.494 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:46:24.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:46:24.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:24.595 INFO:teuthology.orchestra.run.smithi044.stdout:client7364 2024-09-17T05:46:24.595 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:24.595 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:24.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:24.604 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-09-17T05:46:24.666 INFO:teuthology.orchestra.run.smithi044.stdout:./ 2024-09-17T05:46:24.666 INFO:teuthology.orchestra.run.smithi044.stdout:./parent 2024-09-17T05:46:24.667 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed 2024-09-17T05:46:24.667 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/charlie 2024-09-17T05:46:24.667 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/alpha 2024-09-17T05:46:24.667 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/flushed/bravo 2024-09-17T05:46:24.667 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/unflushed 2024-09-17T05:46:24.667 INFO:teuthology.orchestra.run.smithi044.stdout:./parent/unflushed/jfile 2024-09-17T05:46:24.668 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:24.668 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:24.668 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:24.668 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:24.668 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-09-17T05:46:24.668 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:24.776 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-09-17T05:46:24.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:24.785 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:24.785 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:24.785 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:24.785 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:24.785 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-09-17T05:46:24.785 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:24.892 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627776 2024-09-17T05:46:24.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:24.901 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:24.901 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:24.902 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:24.902 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:24.902 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-09-17T05:46:24.902 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:25.011 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627777 2024-09-17T05:46:25.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:25.021 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:25.021 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:25.021 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:25.021 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:25.021 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-09-17T05:46:25.021 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:25.128 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628280 2024-09-17T05:46:25.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:25.141 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:25.141 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:25.141 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:25.141 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:25.141 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-09-17T05:46:25.141 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:25.244 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627778 2024-09-17T05:46:25.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:25.253 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:25.253 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:25.253 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:25.253 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:25.253 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-09-17T05:46:25.253 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:25.365 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628279 2024-09-17T05:46:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:25.375 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:25.375 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:25.375 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:25.375 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:25.375 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-09-17T05:46:25.375 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:25.483 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627779 2024-09-17T05:46:25.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:25.493 DEBUG:teuthology.orchestra.run.smithi044:> stdin-killer -- python3 -c ' 2024-09-17T05:46:25.493 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-09-17T05:46:25.493 DEBUG:teuthology.orchestra.run.smithi044:> import stat 2024-09-17T05:46:25.493 DEBUG:teuthology.orchestra.run.smithi044:> 2024-09-17T05:46:25.493 DEBUG:teuthology.orchestra.run.smithi044:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-09-17T05:46:25.493 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-09-17T05:46:25.599 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627780 2024-09-17T05:46:25.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:46:25.609 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:46:25.609 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:46:25.753 DEBUG:teuthology.orchestra.run.smithi086:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:46:25.853 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:46:25.853 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:25.853 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:25.853 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:25.862 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:25.862 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:25.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:46:26.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.115+0000 7f8295e00640 1 -- 172.21.15.44:0/3469244143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f829015b620 msgr2=0x7f8290073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.115+0000 7f8295e00640 1 --2- 172.21.15.44:0/3469244143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f829015b620 0x7f8290073600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8280009870 tx=0x7f828001c7d0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.115+0000 7f8295e00640 1 -- 172.21.15.44:0/3469244143 shutdown_connections 2024-09-17T05:46:26.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.115+0000 7f8295e00640 1 --2- 172.21.15.44:0/3469244143 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f829015b620 0x7f8290073600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.115+0000 7f8295e00640 1 -- 172.21.15.44:0/3469244143 >> 172.21.15.44:0/3469244143 conn(0x7f82900cd660 msgr2=0x7f82900cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:26.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 -- 172.21.15.44:0/3469244143 shutdown_connections 2024-09-17T05:46:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 -- 172.21.15.44:0/3469244143 wait complete. 2024-09-17T05:46:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 Processor -- start 2024-09-17T05:46:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 -- start start 2024-09-17T05:46:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82900711b0 0x7f82901f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8290073b40 0x7f8290155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f829015b620 0x7f8290159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f829016a150 con 0x7f8290073b40 2024-09-17T05:46:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8290169fd0 con 0x7f829015b620 2024-09-17T05:46:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.119+0000 7f8295e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f829016a2d0 con 0x7f82900711b0 2024-09-17T05:46:26.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8290073b40 0x7f8290155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8290073b40 0x7f8290155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39346/0 (socket says 172.21.15.44:39346) 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 -- 172.21.15.44:0/382103833 learned_addr learned my addr 172.21.15.44:0/382103833 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f828ea00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82900711b0 0x7f82901f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f828f400640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f829015b620 0x7f8290159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 -- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82900711b0 msgr2=0x7f82901f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82900711b0 0x7f82901f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 -- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f829015b620 msgr2=0x7f8290159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f829015b620 0x7f8290159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 -- 172.21.15.44:0/382103833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82901f9d70 con 0x7f8290073b40 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8286000640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8290073b40 0x7f8290155d30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f827800c3c0 tx=0x7f827800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8287e00640 1 -- 172.21.15.44:0/382103833 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278017070 con 0x7f8290073b40 2024-09-17T05:46:26.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8287e00640 1 -- 172.21.15.44:0/382103833 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82780053e0 con 0x7f8290073b40 2024-09-17T05:46:26.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8287e00640 1 -- 172.21.15.44:0/382103833 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8278003860 con 0x7f8290073b40 2024-09-17T05:46:26.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82900c5870 con 0x7f8290073b40 2024-09-17T05:46:26.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82900c8330 con 0x7f8290073b40 2024-09-17T05:46:26.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82900c80a0 con 0x7f8290073b40 2024-09-17T05:46:26.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.123+0000 7f8287e00640 1 -- 172.21.15.44:0/382103833 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f827801a070 con 0x7f8290073b40 2024-09-17T05:46:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.127+0000 7f8287e00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f826c073200 0x7f826c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.127+0000 7f8287e00640 1 -- 172.21.15.44:0/382103833 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f8278093830 con 0x7f8290073b40 2024-09-17T05:46:26.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.127+0000 7f828ea00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f826c073200 0x7f826c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.127+0000 7f828ea00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f826c073200 0x7f826c075710 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f82800af000 tx=0x7f828001b010 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:26.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.131+0000 7f8287e00640 1 -- 172.21.15.44:0/382103833 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f82901f9d70 con 0x7f8290073b40 2024-09-17T05:46:26.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.315+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f82900d0610 con 0x7f8290073b40 2024-09-17T05:46:26.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.315+0000 7f8287e00640 1 -- 172.21.15.44:0/382103833 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v121) ==== 80+0+244 (secure 0 0 0) 0x7f82900d0610 con 0x7f8290073b40 2024-09-17T05:46:26.319 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/3525601076 2024-09-18T05:46:16.757299+0000 2024-09-17T05:46:26.319 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/3525601076 2024-09-18T05:46:16.757299+0000 2024-09-17T05:46:26.319 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6835/1819525564 2024-09-18T05:46:06.760809+0000 2024-09-17T05:46:26.319 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6834/1819525564 2024-09-18T05:46:06.760809+0000 2024-09-17T05:46:26.319 INFO:teuthology.orchestra.run.smithi044.stderr:listed 4 entries 2024-09-17T05:46:26.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f826c073200 msgr2=0x7f826c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f826c073200 0x7f826c075710 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f82800af000 tx=0x7f828001b010 comp rx=0 tx=0).stop 2024-09-17T05:46:26.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8290073b40 msgr2=0x7f8290155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8290073b40 0x7f8290155d30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f827800c3c0 tx=0x7f827800c880 comp rx=0 tx=0).stop 2024-09-17T05:46:26.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 shutdown_connections 2024-09-17T05:46:26.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f826c073200 0x7f826c075710 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f829015b620 0x7f8290159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8290073b40 0x7f8290155d30 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 --2- 172.21.15.44:0/382103833 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f82900711b0 0x7f82901f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 >> 172.21.15.44:0/382103833 conn(0x7f82900cd660 msgr2=0x7f82900cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:26.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 shutdown_connections 2024-09-17T05:46:26.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.319+0000 7f8295e00640 1 -- 172.21.15.44:0/382103833 wait complete. 2024-09-17T05:46:26.340 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:46:26.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:26.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:46:26.366 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:26.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:26.367 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:46:26.419 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:26.419 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:46:26.419 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:26.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:26.428 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:26.429 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:26.429 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:26.474 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:46:26.475 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:46:26.475 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:46:26.475 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:26.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:26.484 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:26.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 -- 172.21.15.44:0/2273292986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240b48d0 msgr2=0x7f1824072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 --2- 172.21.15.44:0/2273292986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240b48d0 0x7f1824072e20 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f18240c3c60 tx=0x7f181c01cd80 comp rx=0 tx=0).stop 2024-09-17T05:46:26.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 -- 172.21.15.44:0/2273292986 shutdown_connections 2024-09-17T05:46:26.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 --2- 172.21.15.44:0/2273292986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240b48d0 0x7f1824072e20 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 --2- 172.21.15.44:0/2273292986 >> v2:172.21.15.86:3300/0 conn(0x7f182415edb0 0x7f18240700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 -- 172.21.15.44:0/2273292986 >> 172.21.15.44:0/2273292986 conn(0x7f18240ccbe0 msgr2=0x7f18240ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:26.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 -- 172.21.15.44:0/2273292986 shutdown_connections 2024-09-17T05:46:26.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 -- 172.21.15.44:0/2273292986 wait complete. 2024-09-17T05:46:26.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 Processor -- start 2024-09-17T05:46:26.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.675+0000 7f182a400640 1 -- start start 2024-09-17T05:46:26.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18240709b0 0x7f1824165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f182415edb0 0x7f1824163600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240cc0b0 0x7f18240cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1824168b60 con 0x7f18240cc0b0 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18241689e0 con 0x7f182415edb0 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1824168ce0 con 0x7f18240709b0 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240cc0b0 0x7f18240cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240cc0b0 0x7f18240cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39370/0 (socket says 172.21.15.44:39370) 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 -- 172.21.15.44:0/629707144 learned_addr learned my addr 172.21.15.44:0/629707144 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18240709b0 0x7f1824165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f181aa00640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f182415edb0 0x7f1824163600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 -- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18240709b0 msgr2=0x7f1824165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18240709b0 0x7f1824165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 -- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f182415edb0 msgr2=0x7f1824163600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f182415edb0 0x7f1824163600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 -- 172.21.15.44:0/629707144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18240b23f0 con 0x7f18240cc0b0 2024-09-17T05:46:26.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f1823e00640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240cc0b0 0x7f18240cb130 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f181c098770 tx=0x7f181c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:26.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f181be00640 1 -- 172.21.15.44:0/629707144 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c0b2040 con 0x7f18240cc0b0 2024-09-17T05:46:26.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f181be00640 1 -- 172.21.15.44:0/629707144 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f181c0bb070 con 0x7f18240cc0b0 2024-09-17T05:46:26.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18240b26d0 con 0x7f18240cc0b0 2024-09-17T05:46:26.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f181be00640 1 -- 172.21.15.44:0/629707144 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c004550 con 0x7f18240cc0b0 2024-09-17T05:46:26.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1824163e30 con 0x7f18240cc0b0 2024-09-17T05:46:26.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.679+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18240b2910 con 0x7f18240cc0b0 2024-09-17T05:46:26.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.683+0000 7f181be00640 1 -- 172.21.15.44:0/629707144 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f181c0046f0 con 0x7f18240cc0b0 2024-09-17T05:46:26.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.683+0000 7f181be00640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1800073230 0x7f1800075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:26.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.683+0000 7f181be00640 1 -- 172.21.15.44:0/629707144 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f181c12ecc0 con 0x7f18240cc0b0 2024-09-17T05:46:26.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.683+0000 7f1823400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1800073230 0x7f1800075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:26.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.683+0000 7f1823400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1800073230 0x7f1800075740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1814005fd0 tx=0x7f1814005e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:26.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.687+0000 7f181be00640 1 -- 172.21.15.44:0/629707144 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f18240b2910 con 0x7f18240cc0b0 2024-09-17T05:46:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.899+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1824072e20 con 0x7f18240cc0b0 2024-09-17T05:46:26.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f181be00640 1 -- 172.21.15.44:0/629707144 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5230 (secure 0 0 0) 0x7f181c100030 con 0x7f18240cc0b0 2024-09-17T05:46:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:26.903 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"btime":"2024-09-17T05:46:21:785920+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:21.785900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8592":{"gid":8592,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/2442475753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2442475753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2442475753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8592,"qdb_cluster":[8592]},"id":8}]} 2024-09-17T05:46:26.903 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2024-09-17T05:46:26.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1800073230 msgr2=0x7f1800075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1800073230 0x7f1800075740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f1814005fd0 tx=0x7f1814005e40 comp rx=0 tx=0).stop 2024-09-17T05:46:26.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240cc0b0 msgr2=0x7f18240cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:26.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240cc0b0 0x7f18240cb130 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f181c098770 tx=0x7f181c005c90 comp rx=0 tx=0).stop 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 shutdown_connections 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f18240cc0b0 0x7f18240cb130 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f1800073230 0x7f1800075740 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f182415edb0 0x7f1824163600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 --2- 172.21.15.44:0/629707144 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f18240709b0 0x7f1824165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 >> 172.21.15.44:0/629707144 conn(0x7f18240ccbe0 msgr2=0x7f18241540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 shutdown_connections 2024-09-17T05:46:26.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:26.903+0000 7f182a400640 1 -- 172.21.15.44:0/629707144 wait complete. 2024-09-17T05:46:26.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:27.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 -- 172.21.15.44:0/553072426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c80b48d0 msgr2=0x7f47c8072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 --2- 172.21.15.44:0/553072426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c80b48d0 0x7f47c8072e20 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f47c80c3c60 tx=0x7f47c001cd80 comp rx=0 tx=0).stop 2024-09-17T05:46:27.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 -- 172.21.15.44:0/553072426 shutdown_connections 2024-09-17T05:46:27.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 --2- 172.21.15.44:0/553072426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c80b48d0 0x7f47c8072e20 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 --2- 172.21.15.44:0/553072426 >> v2:172.21.15.86:3300/0 conn(0x7f47c815edb0 0x7f47c80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 -- 172.21.15.44:0/553072426 >> 172.21.15.44:0/553072426 conn(0x7f47c80ccbe0 msgr2=0x7f47c80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:27.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 -- 172.21.15.44:0/553072426 shutdown_connections 2024-09-17T05:46:27.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.083+0000 7f47cf000640 1 -- 172.21.15.44:0/553072426 wait complete. 2024-09-17T05:46:27.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 Processor -- start 2024-09-17T05:46:27.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 -- start start 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47c80709b0 0x7f47c814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c815edb0 0x7f47c80cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47c80b2720 0x7f47c80cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f47c8168c00 con 0x7f47c815edb0 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f47c8168a80 con 0x7f47c80b2720 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cf000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f47c8168d80 con 0x7f47c80709b0 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c815edb0 0x7f47c80cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c815edb0 0x7f47c80cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39396/0 (socket says 172.21.15.44:39396) 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 -- 172.21.15.44:0/2434619460 learned_addr learned my addr 172.21.15.44:0/2434619460 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47c7e00640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47c80709b0 0x7f47c814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47cd000640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47c80b2720 0x7f47c80cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 -- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47c80709b0 msgr2=0x7f47c814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47c80709b0 0x7f47c814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 -- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47c80b2720 msgr2=0x7f47c80cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47c80b2720 0x7f47c80cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 -- 172.21.15.44:0/2434619460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c80aff30 con 0x7f47c815edb0 2024-09-17T05:46:27.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.087+0000 7f47bfe00640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c815edb0 0x7f47c80cba80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f47b000b410 tx=0x7f47b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:27.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47c4c00640 1 -- 172.21.15.44:0/2434619460 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0015030 con 0x7f47c815edb0 2024-09-17T05:46:27.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c809ab20 con 0x7f47c815edb0 2024-09-17T05:46:27.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47c4c00640 1 -- 172.21.15.44:0/2434619460 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47b0004020 con 0x7f47c815edb0 2024-09-17T05:46:27.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47c4c00640 1 -- 172.21.15.44:0/2434619460 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00044b0 con 0x7f47c815edb0 2024-09-17T05:46:27.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c809b0e0 con 0x7f47c815edb0 2024-09-17T05:46:27.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c8072e20 con 0x7f47c815edb0 2024-09-17T05:46:27.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47c4c00640 1 -- 172.21.15.44:0/2434619460 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f47b0018070 con 0x7f47c815edb0 2024-09-17T05:46:27.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47c4c00640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f47a4073200 0x7f47a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47c4c00640 1 -- 172.21.15.44:0/2434619460 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f47b0093f20 con 0x7f47c815edb0 2024-09-17T05:46:27.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.091+0000 7f47c7e00640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f47a4073200 0x7f47a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.095+0000 7f47c7e00640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f47a4073200 0x7f47a4075710 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f47b800ab40 tx=0x7f47b800a250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:27.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.095+0000 7f47c4c00640 1 -- 172.21.15.44:0/2434619460 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f47b005e620 con 0x7f47c815edb0 2024-09-17T05:46:27.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.319+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47c809da20 con 0x7f47c815edb0 2024-09-17T05:46:27.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.319+0000 7f47c4c00640 1 -- 172.21.15.44:0/2434619460 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5230 (secure 0 0 0) 0x7f47b0063050 con 0x7f47c815edb0 2024-09-17T05:46:27.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:27.321 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"btime":"2024-09-17T05:46:21:785920+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:21.785900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8592":{"gid":8592,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/2442475753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2442475753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2442475753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8592,"qdb_cluster":[8592]},"id":8}]} 2024-09-17T05:46:27.322 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f47a4073200 msgr2=0x7f47a4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f47a4073200 0x7f47a4075710 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f47b800ab40 tx=0x7f47b800a250 comp rx=0 tx=0).stop 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c815edb0 msgr2=0x7f47c80cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c815edb0 0x7f47c80cba80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f47b000b410 tx=0x7f47b000b8d0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 shutdown_connections 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f47a4073200 0x7f47a4075710 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47c80b2720 0x7f47c80cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47c815edb0 0x7f47c80cba80 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 --2- 172.21.15.44:0/2434619460 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f47c80709b0 0x7f47c814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 >> 172.21.15.44:0/2434619460 conn(0x7f47c80ccbe0 msgr2=0x7f47c80cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:27.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 shutdown_connections 2024-09-17T05:46:27.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.323+0000 7f47cf000640 1 -- 172.21.15.44:0/2434619460 wait complete. 2024-09-17T05:46:27.345 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:27.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 -- 172.21.15.44:0/3143710958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff680b48d0 msgr2=0x7eff68072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 --2- 172.21.15.44:0/3143710958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff680b48d0 0x7eff68072e20 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7eff64009c80 tx=0x7eff6401cda0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 -- 172.21.15.44:0/3143710958 shutdown_connections 2024-09-17T05:46:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 --2- 172.21.15.44:0/3143710958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff680b48d0 0x7eff68072e20 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 --2- 172.21.15.44:0/3143710958 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff6815edb0 0x7eff680700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 -- 172.21.15.44:0/3143710958 >> 172.21.15.44:0/3143710958 conn(0x7eff680ccbe0 msgr2=0x7eff680ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 -- 172.21.15.44:0/3143710958 shutdown_connections 2024-09-17T05:46:27.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 -- 172.21.15.44:0/3143710958 wait complete. 2024-09-17T05:46:27.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 Processor -- start 2024-09-17T05:46:27.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.503+0000 7eff70800640 1 -- start start 2024-09-17T05:46:27.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff680709b0 0x7eff6814db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff6815edb0 0x7eff68155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff68155d80 0x7eff68156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff68168cf0 con 0x7eff68155d80 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7eff68168b70 con 0x7eff680709b0 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7eff68168e70 con 0x7eff6815edb0 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff68155d80 0x7eff68156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff68155d80 0x7eff68156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39418/0 (socket says 172.21.15.44:39418) 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 -- 172.21.15.44:0/2090718656 learned_addr learned my addr 172.21.15.44:0/2090718656 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6de00640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff680709b0 0x7eff6814db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6d400640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff6815edb0 0x7eff68155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 -- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff6815edb0 msgr2=0x7eff68155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff6815edb0 0x7eff68155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 -- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff680709b0 msgr2=0x7eff6814db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff680709b0 0x7eff6814db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 -- 172.21.15.44:0/2090718656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff681566d0 con 0x7eff68155d80 2024-09-17T05:46:27.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6d400640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff6815edb0 0x7eff68155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff6e800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff68155d80 0x7eff68156190 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7eff6401c810 tx=0x7eff640093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff62000640 1 -- 172.21.15.44:0/2090718656 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640bc070 con 0x7eff68155d80 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff62000640 1 -- 172.21.15.44:0/2090718656 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff640042f0 con 0x7eff68155d80 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff62000640 1 -- 172.21.15.44:0/2090718656 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff640b2040 con 0x7eff68155d80 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff680b1ff0 con 0x7eff68155d80 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff680b25b0 con 0x7eff68155d80 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.507+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6814e0c0 con 0x7eff68155d80 2024-09-17T05:46:27.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.511+0000 7eff62000640 1 -- 172.21.15.44:0/2090718656 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7eff640bf070 con 0x7eff68155d80 2024-09-17T05:46:27.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.511+0000 7eff62000640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7eff4c073200 0x7eff4c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.511+0000 7eff62000640 1 -- 172.21.15.44:0/2090718656 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7eff6412e360 con 0x7eff68155d80 2024-09-17T05:46:27.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.511+0000 7eff6de00640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7eff4c073200 0x7eff4c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.511+0000 7eff6de00640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7eff4c073200 0x7eff4c075710 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7eff5c005fd0 tx=0x7eff5c005d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:27.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.515+0000 7eff62000640 1 -- 172.21.15.44:0/2090718656 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7eff64016990 con 0x7eff68155d80 2024-09-17T05:46:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.691+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff680b1d40 con 0x7eff68155d80 2024-09-17T05:46:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff62000640 1 -- 172.21.15.44:0/2090718656 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+17227 (secure 0 0 0) 0x7eff640f91c0 con 0x7eff68155d80 2024-09-17T05:46:27.695 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:27.695 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":121,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:46:16.757330+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:52.041779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:53.267006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/3525601076":"2024-09-18T05:46:16.757299+0000","172.21.15.44:6834/3525601076":"2024-09-18T05:46:16.757299+0000","172.21.15.44:6835/1819525564":"2024-09-18T05:46:06.760809+0000","172.21.15.44:6834/1819525564":"2024-09-18T05:46:06.760809+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7eff4c073200 msgr2=0x7eff4c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7eff4c073200 0x7eff4c075710 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7eff5c005fd0 tx=0x7eff5c005d10 comp rx=0 tx=0).stop 2024-09-17T05:46:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff68155d80 msgr2=0x7eff68156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff68155d80 0x7eff68156190 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7eff6401c810 tx=0x7eff640093f0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 shutdown_connections 2024-09-17T05:46:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff68155d80 0x7eff68156190 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7eff6815edb0 0x7eff68155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7eff4c073200 0x7eff4c075710 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 --2- 172.21.15.44:0/2090718656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff680709b0 0x7eff6814db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 >> 172.21.15.44:0/2090718656 conn(0x7eff680ccbe0 msgr2=0x7eff680ad460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 shutdown_connections 2024-09-17T05:46:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.695+0000 7eff70800640 1 -- 172.21.15.44:0/2090718656 wait complete. 2024-09-17T05:46:27.718 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:46:27.718 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:27.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 -- 172.21.15.44:0/2994184056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 msgr2=0x7ff66c072e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 --2- 172.21.15.44:0/2994184056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c072e20 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7ff66c06adf0 tx=0x7ff66401cd20 comp rx=0 tx=0).stop 2024-09-17T05:46:27.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 -- 172.21.15.44:0/2994184056 shutdown_connections 2024-09-17T05:46:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 --2- 172.21.15.44:0/2994184056 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c072e20 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 --2- 172.21.15.44:0/2994184056 >> v2:172.21.15.86:3300/0 conn(0x7ff66c0709b0 0x7ff66c0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 --2- 172.21.15.44:0/2994184056 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff66c15edb0 0x7ff66c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 -- 172.21.15.44:0/2994184056 >> 172.21.15.44:0/2994184056 conn(0x7ff66c0ccbe0 msgr2=0x7ff66c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 -- 172.21.15.44:0/2994184056 shutdown_connections 2024-09-17T05:46:27.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.875+0000 7ff673000640 1 -- 172.21.15.44:0/2994184056 wait complete. 2024-09-17T05:46:27.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 Processor -- start 2024-09-17T05:46:27.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 -- start start 2024-09-17T05:46:27.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff66c0709b0 0x7ff66c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff66c15edb0 0x7ff66c15e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0b2420 con 0x7ff66c0b4700 2024-09-17T05:46:27.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0b22a0 con 0x7ff66c15edb0 2024-09-17T05:46:27.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff673000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c0b25a0 con 0x7ff66c0709b0 2024-09-17T05:46:27.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c15ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39430/0 (socket says 172.21.15.44:39430) 2024-09-17T05:46:27.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 -- 172.21.15.44:0/2315621845 learned_addr learned my addr 172.21.15.44:0/2315621845 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:27.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff66be00640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff66c0709b0 0x7ff66c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff671000640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff66c15edb0 0x7ff66c15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 -- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff66c0709b0 msgr2=0x7ff66c14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff66c0709b0 0x7ff66c14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 -- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff66c15edb0 msgr2=0x7ff66c15e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:27.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff66c15edb0 0x7ff66c15e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:27.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 -- 172.21.15.44:0/2315621845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c1f6830 con 0x7ff66c0b4700 2024-09-17T05:46:27.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff663400640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c15ddf0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff65400d640 tx=0x7ff65400db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:27.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff668c00640 1 -- 172.21.15.44:0/2315621845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654017070 con 0x7ff66c0b4700 2024-09-17T05:46:27.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff668c00640 1 -- 172.21.15.44:0/2315621845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff654004310 con 0x7ff66c0b4700 2024-09-17T05:46:27.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.879+0000 7ff668c00640 1 -- 172.21.15.44:0/2315621845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540099e0 con 0x7ff66c0b4700 2024-09-17T05:46:27.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.883+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66c1f6b10 con 0x7ff66c0b4700 2024-09-17T05:46:27.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.883+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66c14fac0 con 0x7ff66c0b4700 2024-09-17T05:46:27.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.883+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66c09d620 con 0x7ff66c0b4700 2024-09-17T05:46:27.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.883+0000 7ff668c00640 1 -- 172.21.15.44:0/2315621845 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff654009b80 con 0x7ff66c0b4700 2024-09-17T05:46:27.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.883+0000 7ff668c00640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff648073200 0x7ff648075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:27.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.883+0000 7ff668c00640 1 -- 172.21.15.44:0/2315621845 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7ff654094440 con 0x7ff66c0b4700 2024-09-17T05:46:27.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.883+0000 7ff66be00640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff648073200 0x7ff648075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:27.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.887+0000 7ff66be00640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff648073200 0x7ff648075710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff65c004630 tx=0x7ff65c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:27.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:27.887+0000 7ff668c00640 1 -- 172.21.15.44:0/2315621845 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7ff65405eb40 con 0x7ff66c0b4700 2024-09-17T05:46:28.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff66c072e20 con 0x7ff66c0b4700 2024-09-17T05:46:28.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff668c00640 1 -- 172.21.15.44:0/2315621845 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5230 (secure 0 0 0) 0x7ff654063570 con 0x7ff66c0b4700 2024-09-17T05:46:28.100 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:28.100 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"btime":"2024-09-17T05:46:21:785920+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:21.785900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8592":{"gid":8592,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/2442475753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2442475753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2442475753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8592,"qdb_cluster":[8592]},"id":8}]} 2024-09-17T05:46:28.100 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff648073200 msgr2=0x7ff648075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff648073200 0x7ff648075710 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff65c004630 tx=0x7ff65c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 msgr2=0x7ff66c15ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c15ddf0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7ff65400d640 tx=0x7ff65400db00 comp rx=0 tx=0).stop 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 shutdown_connections 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7ff648073200 0x7ff648075710 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff66c15edb0 0x7ff66c15e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66c0b4700 0x7ff66c15ddf0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 --2- 172.21.15.44:0/2315621845 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7ff66c0709b0 0x7ff66c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 >> 172.21.15.44:0/2315621845 conn(0x7ff66c0ccbe0 msgr2=0x7ff66c0b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 shutdown_connections 2024-09-17T05:46:28.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.099+0000 7ff673000640 1 -- 172.21.15.44:0/2315621845 wait complete. 2024-09-17T05:46:28.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:28.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 -- 172.21.15.44:0/769811270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc0709b0 msgr2=0x7f5dcc0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 --2- 172.21.15.44:0/769811270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc0709b0 0x7f5dcc0b41c0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc0c3c60 tx=0x7f5db401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 -- 172.21.15.44:0/769811270 shutdown_connections 2024-09-17T05:46:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 --2- 172.21.15.44:0/769811270 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5dcc0b4700 0x7f5dcc072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 --2- 172.21.15.44:0/769811270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc0709b0 0x7f5dcc0b41c0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 --2- 172.21.15.44:0/769811270 >> v2:172.21.15.86:3300/0 conn(0x7f5dcc15edb0 0x7f5dcc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 -- 172.21.15.44:0/769811270 >> 172.21.15.44:0/769811270 conn(0x7f5dcc0ccbe0 msgr2=0x7f5dcc0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 -- 172.21.15.44:0/769811270 shutdown_connections 2024-09-17T05:46:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.279+0000 7f5dd2600640 1 -- 172.21.15.44:0/769811270 wait complete. 2024-09-17T05:46:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 Processor -- start 2024-09-17T05:46:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 -- start start 2024-09-17T05:46:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5dcc0709b0 0x7f5dcc0c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dcc0b4700 0x7f5dcc14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc15edb0 0x7f5dcc14b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0b2320 con 0x7f5dcc15edb0 2024-09-17T05:46:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0b21a0 con 0x7f5dcc0b4700 2024-09-17T05:46:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0b24a0 con 0x7f5dcc0709b0 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc15edb0 0x7f5dcc14b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc15edb0 0x7f5dcc14b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39450/0 (socket says 172.21.15.44:39450) 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 -- 172.21.15.44:0/4026206570 learned_addr learned my addr 172.21.15.44:0/4026206570 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dc2a00640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dcc0b4700 0x7f5dcc14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcb400640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5dcc0709b0 0x7f5dcc0c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 -- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5dcc0709b0 msgr2=0x7f5dcc0c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5dcc0709b0 0x7f5dcc0c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 -- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dcc0b4700 msgr2=0x7f5dcc14aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dcc0b4700 0x7f5dcc14aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 -- 172.21.15.44:0/4026206570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc0c98e0 con 0x7f5dcc15edb0 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dcbe00640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc15edb0 0x7f5dcc14b530 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400e990 tx=0x7f5dc400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dc3e00640 1 -- 172.21.15.44:0/4026206570 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4004d30 con 0x7f5dcc15edb0 2024-09-17T05:46:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dc3e00640 1 -- 172.21.15.44:0/4026206570 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dc400caa0 con 0x7f5dcc15edb0 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dc3e00640 1 -- 172.21.15.44:0/4026206570 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4005020 con 0x7f5dcc15edb0 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc0c9bc0 con 0x7f5dcc15edb0 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.283+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc15a660 con 0x7f5dcc15edb0 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.287+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc072e20 con 0x7f5dcc15edb0 2024-09-17T05:46:28.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.287+0000 7f5dc3e00640 1 -- 172.21.15.44:0/4026206570 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5dc40051c0 con 0x7f5dcc15edb0 2024-09-17T05:46:28.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.287+0000 7f5dc3e00640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5da8073230 0x7f5da8075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.287+0000 7f5dc3e00640 1 -- 172.21.15.44:0/4026206570 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f5dc4094cf0 con 0x7f5dcc15edb0 2024-09-17T05:46:28.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.287+0000 7f5dcb400640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5da8073230 0x7f5da8075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.291+0000 7f5dcb400640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5da8073230 0x7f5da8075740 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc005fd0 tx=0x7f5dbc005e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.291+0000 7f5dc3e00640 1 -- 172.21.15.44:0/4026206570 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f5dc4016030 con 0x7f5dcc15edb0 2024-09-17T05:46:28.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.503+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dcc0c9670 con 0x7f5dcc15edb0 2024-09-17T05:46:28.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.503+0000 7f5dc3e00640 1 -- 172.21.15.44:0/4026206570 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5230 (secure 0 0 0) 0x7f5dc405f3e0 con 0x7f5dcc15edb0 2024-09-17T05:46:28.505 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:28.506 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":113,"btime":"2024-09-17T05:46:21:785920+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:45:54.297928+0000","modified":"2024-09-17T05:46:21.785900+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":121,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8592":{"gid":8592,"name":"c","rank":0,"incarnation":110,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/2442475753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2442475753},{"type":"v1","addr":"172.21.15.44:6835","nonce":2442475753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8592,"qdb_cluster":[8592]},"id":8}]} 2024-09-17T05:46:28.506 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 113 2024-09-17T05:46:28.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5da8073230 msgr2=0x7f5da8075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5da8073230 0x7f5da8075740 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc005fd0 tx=0x7f5dbc005e40 comp rx=0 tx=0).stop 2024-09-17T05:46:28.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc15edb0 msgr2=0x7f5dcc14b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc15edb0 0x7f5dcc14b530 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400e990 tx=0x7f5dc400ee50 comp rx=0 tx=0).stop 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 shutdown_connections 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5dcc15edb0 0x7f5dcc14b530 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5da8073230 0x7f5da8075740 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dcc0b4700 0x7f5dcc14aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 --2- 172.21.15.44:0/4026206570 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5dcc0709b0 0x7f5dcc0c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 >> 172.21.15.44:0/4026206570 conn(0x7f5dcc0ccbe0 msgr2=0x7f5dcc0af070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 shutdown_connections 2024-09-17T05:46:28.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.507+0000 7f5dd2600640 1 -- 172.21.15.44:0/4026206570 wait complete. 2024-09-17T05:46:28.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 -- 172.21.15.44:0/377013516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b4170 msgr2=0x7f231c0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 --2- 172.21.15.44:0/377013516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b4170 0x7f231c0b1be0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f230c009900 tx=0x7f230c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 -- 172.21.15.44:0/377013516 shutdown_connections 2024-09-17T05:46:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 --2- 172.21.15.44:0/377013516 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231c0cc4e0 0x7f231c0b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 --2- 172.21.15.44:0/377013516 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b4170 0x7f231c0b1be0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 -- 172.21.15.44:0/377013516 >> 172.21.15.44:0/377013516 conn(0x7f231c0ccbe0 msgr2=0x7f231c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 -- 172.21.15.44:0/377013516 shutdown_connections 2024-09-17T05:46:28.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 -- 172.21.15.44:0/377013516 wait complete. 2024-09-17T05:46:28.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 Processor -- start 2024-09-17T05:46:28.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.687+0000 7f2323200640 1 -- start start 2024-09-17T05:46:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b2fb0 0x7f231c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f231c0b4170 0x7f231c166790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231c0cc4e0 0x7f231c166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f231c166150 con 0x7f231c0b2fb0 2024-09-17T05:46:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f231c165fd0 con 0x7f231c0b4170 2024-09-17T05:46:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f231c1662d0 con 0x7f231c0cc4e0 2024-09-17T05:46:28.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b2fb0 0x7f231c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b2fb0 0x7f231c153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39476/0 (socket says 172.21.15.44:39476) 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 -- 172.21.15.44:0/1541574736 learned_addr learned my addr 172.21.15.44:0/1541574736 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 -- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231c0cc4e0 msgr2=0x7f231c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2321200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231c0cc4e0 0x7f231c166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231b400640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f231c0b4170 0x7f231c166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231c0cc4e0 0x7f231c166cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 -- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f231c0b4170 msgr2=0x7f231c166790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f231c0b4170 0x7f231c166790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 -- 172.21.15.44:0/1541574736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231c1f9d50 con 0x7f231c0b2fb0 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2321200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231c0cc4e0 0x7f231c166cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231b400640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f231c0b4170 0x7f231c166790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f231be00640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b2fb0 0x7f231c153c70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f230c0b0040 tx=0x7f230c0a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2313e00640 1 -- 172.21.15.44:0/1541574736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c0b2040 con 0x7f231c0b2fb0 2024-09-17T05:46:28.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2313e00640 1 -- 172.21.15.44:0/1541574736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f230c0041b0 con 0x7f231c0b2fb0 2024-09-17T05:46:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231c0c3fe0 con 0x7f231c0b2fb0 2024-09-17T05:46:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2313e00640 1 -- 172.21.15.44:0/1541574736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c003600 con 0x7f231c0b2fb0 2024-09-17T05:46:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231c1fc550 con 0x7f231c0b2fb0 2024-09-17T05:46:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f231c0b33c0 con 0x7f231c0b2fb0 2024-09-17T05:46:28.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.691+0000 7f2313e00640 1 -- 172.21.15.44:0/1541574736 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f230c0bf020 con 0x7f231c0b2fb0 2024-09-17T05:46:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.695+0000 7f2313e00640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22fc073200 0x7f22fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.695+0000 7f2313e00640 1 -- 172.21.15.44:0/1541574736 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f230c12e480 con 0x7f231c0b2fb0 2024-09-17T05:46:28.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.695+0000 7f231b400640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22fc073200 0x7f22fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:28.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.695+0000 7f231b400640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22fc073200 0x7f22fc075710 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f23080058d0 tx=0x7f2308005cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:28.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.699+0000 7f2313e00640 1 -- 172.21.15.44:0/1541574736 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f230c0164d0 con 0x7f231c0b2fb0 2024-09-17T05:46:28.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f231c074170 con 0x7f231c0b2fb0 2024-09-17T05:46:28.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2313e00640 1 -- 172.21.15.44:0/1541574736 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+17227 (secure 0 0 0) 0x7f230c0f9380 con 0x7f231c0b2fb0 2024-09-17T05:46:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:28.876 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":121,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:46:16.757330+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:45:52.041779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-17T05:45:53.267006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/3525601076":"2024-09-18T05:46:16.757299+0000","172.21.15.44:6834/3525601076":"2024-09-18T05:46:16.757299+0000","172.21.15.44:6835/1819525564":"2024-09-18T05:46:06.760809+0000","172.21.15.44:6834/1819525564":"2024-09-18T05:46:06.760809+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22fc073200 msgr2=0x7f22fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22fc073200 0x7f22fc075710 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f23080058d0 tx=0x7f2308005cc0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b2fb0 msgr2=0x7f231c153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b2fb0 0x7f231c153c70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f230c0b0040 tx=0x7f230c0a56b0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 shutdown_connections 2024-09-17T05:46:28.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f231c0cc4e0 0x7f231c166cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f22fc073200 0x7f22fc075710 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f231c0b4170 0x7f231c166790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 --2- 172.21.15.44:0/1541574736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f231c0b2fb0 0x7f231c153c70 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 >> 172.21.15.44:0/1541574736 conn(0x7f231c0ccbe0 msgr2=0x7f231c0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 shutdown_connections 2024-09-17T05:46:28.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:28.875+0000 7f2323200640 1 -- 172.21.15.44:0/1541574736 wait complete. 2024-09-17T05:46:28.898 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:46:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.055+0000 7f4188a00640 1 -- 172.21.15.44:0/1184491792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 msgr2=0x7f4168003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.055+0000 7f4188a00640 1 --2- 172.21.15.44:0/1184491792 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 0x7f4168003ef0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f4174009b40 tx=0x7f417401d1b0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.055+0000 7f4182800640 1 -- 172.21.15.44:0/1184491792 reap_dead start 2024-09-17T05:46:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.055+0000 7f4188a00640 1 -- 172.21.15.44:0/1184491792 shutdown_connections 2024-09-17T05:46:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.055+0000 7f4188a00640 1 -- 172.21.15.44:0/1184491792 >> 172.21.15.44:0/1184491792 conn(0x7f41840b2510 msgr2=0x7f41840b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.055+0000 7f4188a00640 1 -- 172.21.15.44:0/1184491792 shutdown_connections 2024-09-17T05:46:29.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.055+0000 7f4188a00640 1 -- 172.21.15.44:0/1184491792 wait complete. 2024-09-17T05:46:29.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 Processor -- start 2024-09-17T05:46:29.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 -- start start 2024-09-17T05:46:29.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 0x7f4184153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840cf020 0x7f41840cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41841fc820 0x7f41841fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f41840ce770 con 0x7f4168003a80 2024-09-17T05:46:29.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f41840ce5f0 con 0x7f41840cf020 2024-09-17T05:46:29.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4188a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f418406f6c0 con 0x7f41841fc820 2024-09-17T05:46:29.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4181e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 0x7f4184153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4181e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 0x7f4184153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55552/0 (socket says 172.21.15.44:55552) 2024-09-17T05:46:29.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4181e00640 1 -- 172.21.15.44:0/2075166347 learned_addr learned my addr 172.21.15.44:0/2075166347 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f417be00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840cf020 0x7f41840cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.059+0000 7f4182800640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41841fc820 0x7f41841fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4181e00640 1 -- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41841fc820 msgr2=0x7f41841fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4181e00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41841fc820 0x7f41841fcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4181e00640 1 -- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840cf020 msgr2=0x7f41840cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4181e00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840cf020 0x7f41840cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4181e00640 1 -- 172.21.15.44:0/2075166347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41840ae4f0 con 0x7f4168003a80 2024-09-17T05:46:29.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4181e00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 0x7f4184153ac0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f4174009b40 tx=0x7f4174005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:29.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f417a000640 1 -- 172.21.15.44:0/2075166347 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174004950 con 0x7f4168003a80 2024-09-17T05:46:29.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f417a000640 1 -- 172.21.15.44:0/2075166347 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41740bf070 con 0x7f4168003a80 2024-09-17T05:46:29.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41841f91f0 con 0x7f4168003a80 2024-09-17T05:46:29.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f417a000640 1 -- 172.21.15.44:0/2075166347 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174004e60 con 0x7f4168003a80 2024-09-17T05:46:29.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41841f9790 con 0x7f4168003a80 2024-09-17T05:46:29.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418406b130 con 0x7f4168003a80 2024-09-17T05:46:29.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.063+0000 7f417a000640 1 -- 172.21.15.44:0/2075166347 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f41740c4460 con 0x7f4168003a80 2024-09-17T05:46:29.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.067+0000 7f417a000640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4160073200 0x7f4160075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.067+0000 7f417a000640 1 -- 172.21.15.44:0/2075166347 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 6273+0+0 (secure 0 0 0) 0x7f417412f8a0 con 0x7f4168003a80 2024-09-17T05:46:29.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.067+0000 7f417be00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4160073200 0x7f4160075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.067+0000 7f417be00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4160073200 0x7f4160075710 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f418415c3c0 tx=0x7f416c0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:29.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.071+0000 7f417a000640 1 -- 172.21.15.44:0/2075166347 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4174016ec0 con 0x7f4168003a80 2024-09-17T05:46:29.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.283+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f41840ada80 con 0x7f4168003a80 2024-09-17T05:46:29.283 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-09-17T05:46:29.283+0000 7f2ed5e00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:46:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f417a000640 1 -- 172.21.15.44:0/2075166347 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v114) ==== 161+0+0 (secure 0 0 0) 0x7f41740fa700 con 0x7f4168003a80 2024-09-17T05:46:29.287 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4160073200 msgr2=0x7f4160075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4160073200 0x7f4160075710 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f418415c3c0 tx=0x7f416c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 msgr2=0x7f4184153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 0x7f4184153ac0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f4174009b40 tx=0x7f4174005020 comp rx=0 tx=0).stop 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 shutdown_connections 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f41841fc820 0x7f41841fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4160073200 0x7f4160075710 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41840cf020 0x7f41840cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 --2- 172.21.15.44:0/2075166347 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4168003a80 0x7f4184153ac0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 >> 172.21.15.44:0/2075166347 conn(0x7f41840b2510 msgr2=0x7f41840b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 shutdown_connections 2024-09-17T05:46:29.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.287+0000 7f4188a00640 1 -- 172.21.15.44:0/2075166347 wait complete. 2024-09-17T05:46:29.295 INFO:tasks.ceph.mds.c.smithi044.stderr: -1212> 2024-09-17T05:46:22.767+0000 7f228f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:46:29.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:46:29.419 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-09-17T05:46:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 -- 172.21.15.44:0/3775898410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 msgr2=0x7f5284073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 --2- 172.21.15.44:0/3775898410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 0x7f5284073680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f526c009900 tx=0x7f526c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 -- 172.21.15.44:0/3775898410 shutdown_connections 2024-09-17T05:46:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 --2- 172.21.15.44:0/3775898410 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 0x7f5284073680 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 --2- 172.21.15.44:0/3775898410 >> v2:172.21.15.86:3300/0 conn(0x7f52840b5470 0x7f528415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 -- 172.21.15.44:0/3775898410 >> 172.21.15.44:0/3775898410 conn(0x7f528406f860 msgr2=0x7f528406fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 -- 172.21.15.44:0/3775898410 shutdown_connections 2024-09-17T05:46:29.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.475+0000 7f5289a00640 1 -- 172.21.15.44:0/3775898410 wait complete. 2024-09-17T05:46:29.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 Processor -- start 2024-09-17T05:46:29.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 -- start start 2024-09-17T05:46:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 0x7f52841fac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52840b5470 0x7f5284152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f528415f1c0 0x7f5284153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5284169620 con 0x7f52840b5470 2024-09-17T05:46:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f52841694a0 con 0x7f528415f1c0 2024-09-17T05:46:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f52841697a0 con 0x7f5284073270 2024-09-17T05:46:29.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52840b5470 0x7f5284152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52840b5470 0x7f5284152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55576/0 (socket says 172.21.15.44:55576) 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 -- 172.21.15.44:0/821550742 learned_addr learned my addr 172.21.15.44:0/821550742 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5282a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 0x7f52841fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5283400640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f528415f1c0 0x7f5284153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 -- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 msgr2=0x7f52841fac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 0x7f52841fac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 -- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f528415f1c0 msgr2=0x7f5284153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f528415f1c0 0x7f5284153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 -- 172.21.15.44:0/821550742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528414ed80 con 0x7f52840b5470 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5282a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 0x7f52841fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5283400640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f528415f1c0 0x7f5284153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527be00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52840b5470 0x7f5284152a10 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f526c0b0040 tx=0x7f526c0a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:29.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527aa00640 1 -- 172.21.15.44:0/821550742 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0b2040 con 0x7f52840b5470 2024-09-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527aa00640 1 -- 172.21.15.44:0/821550742 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f526c0043b0 con 0x7f52840b5470 2024-09-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5284152f50 con 0x7f52840b5470 2024-09-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f527aa00640 1 -- 172.21.15.44:0/821550742 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c005290 con 0x7f52840b5470 2024-09-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.479+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52841fb790 con 0x7f52840b5470 2024-09-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.483+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5284073680 con 0x7f52840b5470 2024-09-17T05:46:29.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.483+0000 7f527aa00640 1 -- 172.21.15.44:0/821550742 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f526c0be060 con 0x7f52840b5470 2024-09-17T05:46:29.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.483+0000 7f527aa00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5260073230 0x7f5260075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:29.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.483+0000 7f527aa00640 1 -- 172.21.15.44:0/821550742 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6359+0+0 (secure 0 0 0) 0x7f526c12d8f0 con 0x7f52840b5470 2024-09-17T05:46:29.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.483+0000 7f5282a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5260073230 0x7f5260075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:29.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.483+0000 7f5282a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5260073230 0x7f5260075740 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5274009b90 tx=0x7f52740091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:29.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.487+0000 7f527aa00640 1 -- 172.21.15.44:0/821550742 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f526c0164d0 con 0x7f52840b5470 2024-09-17T05:46:29.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:29.699+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f52841fb240 con 0x7f52840b5470 2024-09-17T05:46:30.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.287+0000 7f527aa00640 1 -- 172.21.15.44:0/821550742 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v115) ==== 104+0+0 (secure 0 0 0) 0x7f526c0f8680 con 0x7f52840b5470 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5260073230 msgr2=0x7f5260075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5260073230 0x7f5260075740 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5274009b90 tx=0x7f52740091e0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52840b5470 msgr2=0x7f5284152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52840b5470 0x7f5284152a10 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f526c0b0040 tx=0x7f526c0a5730 comp rx=0 tx=0).stop 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 shutdown_connections 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f5260073230 0x7f5260075740 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f528415f1c0 0x7f5284153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52840b5470 0x7f5284152a10 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 --2- 172.21.15.44:0/821550742 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f5284073270 0x7f52841fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 >> 172.21.15.44:0/821550742 conn(0x7f528406f860 msgr2=0x7f528415dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 shutdown_connections 2024-09-17T05:46:30.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.291+0000 7f5289a00640 1 -- 172.21.15.44:0/821550742 wait complete. 2024-09-17T05:46:30.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:46:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.487+0000 7f736e400640 1 -- 172.21.15.44:0/3781319814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 msgr2=0x7f734c0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.487+0000 7f736e400640 1 --2- 172.21.15.44:0/3781319814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 0x7f734c0051a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f73680c71f0 tx=0x7f736001c800 comp rx=0 tx=0).stop 2024-09-17T05:46:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.487+0000 7f7367e00640 1 -- 172.21.15.44:0/3781319814 reap_dead start 2024-09-17T05:46:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.487+0000 7f736e400640 1 -- 172.21.15.44:0/3781319814 shutdown_connections 2024-09-17T05:46:30.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.487+0000 7f736e400640 1 -- 172.21.15.44:0/3781319814 >> 172.21.15.44:0/3781319814 conn(0x7f73680d0170 msgr2=0x7f73680d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:30.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.487+0000 7f736e400640 1 -- 172.21.15.44:0/3781319814 shutdown_connections 2024-09-17T05:46:30.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.487+0000 7f736e400640 1 -- 172.21.15.44:0/3781319814 wait complete. 2024-09-17T05:46:30.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 Processor -- start 2024-09-17T05:46:30.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 -- start start 2024-09-17T05:46:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 0x7f73680c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73681581a0 0x7f73681f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73680b3ff0 0x7f736815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f736815cbe0 con 0x7f734c004d50 2024-09-17T05:46:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f736815ca60 con 0x7f73681581a0 2024-09-17T05:46:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7368073730 con 0x7f73680b3ff0 2024-09-17T05:46:30.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 0x7f73680c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 0x7f73680c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55594/0 (socket says 172.21.15.44:55594) 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 -- 172.21.15.44:0/1769268610 learned_addr learned my addr 172.21.15.44:0/1769268610 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367e00640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73680b3ff0 0x7f736815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f735ea00640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73681581a0 0x7f73681f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 -- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73680b3ff0 msgr2=0x7f736815f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73680b3ff0 0x7f736815f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 -- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73681581a0 msgr2=0x7f73681f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73681581a0 0x7f73681f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 -- 172.21.15.44:0/1769268610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73680c6ab0 con 0x7f734c004d50 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f7367400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 0x7f73680c6570 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7358011d10 tx=0x7f735800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f735fe00640 1 -- 172.21.15.44:0/1769268610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358003b90 con 0x7f734c004d50 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f735fe00640 1 -- 172.21.15.44:0/1769268610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7358003d30 con 0x7f734c004d50 2024-09-17T05:46:30.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f735fe00640 1 -- 172.21.15.44:0/1769268610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73580042b0 con 0x7f734c004d50 2024-09-17T05:46:30.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73681f6e30 con 0x7f734c004d50 2024-09-17T05:46:30.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.491+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73680c5d70 con 0x7f734c004d50 2024-09-17T05:46:30.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.495+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73680cc080 con 0x7f734c004d50 2024-09-17T05:46:30.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.495+0000 7f735fe00640 1 -- 172.21.15.44:0/1769268610 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7358004450 con 0x7f734c004d50 2024-09-17T05:46:30.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.495+0000 7f735fe00640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:30.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.495+0000 7f735fe00640 1 -- 172.21.15.44:0/1769268610 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 6359+0+0 (secure 0 0 0) 0x7f73580959d0 con 0x7f734c004d50 2024-09-17T05:46:30.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.495+0000 7f735ea00640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:30.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.499+0000 7f735ea00640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7350006fd0 tx=0x7f7350006900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:30.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.499+0000 7f735fe00640 1 -- 172.21.15.44:0/1769268610 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7358060750 con 0x7f734c004d50 2024-09-17T05:46:30.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:30.675+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f736809aa90 con 0x7f734c004d50 2024-09-17T05:46:31.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.295+0000 7f735fe00640 1 -- 172.21.15.44:0/1769268610 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v123) ==== 181+0+0 (secure 0 0 0) 0x7f7358067e20 con 0x7f734c004d50 2024-09-17T05:46:31.298 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:46:31.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 msgr2=0x7f7344075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:31.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7350006fd0 tx=0x7f7350006900 comp rx=0 tx=0).stop 2024-09-17T05:46:31.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 msgr2=0x7f73680c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:31.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 0x7f73680c6570 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f7358011d10 tx=0x7f735800f790 comp rx=0 tx=0).stop 2024-09-17T05:46:31.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 shutdown_connections 2024-09-17T05:46:31.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73680b3ff0 0x7f736815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7344073200 0x7f7344075710 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73681581a0 0x7f73681f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 --2- 172.21.15.44:0/1769268610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f734c004d50 0x7f73680c6570 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.303+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 >> 172.21.15.44:0/1769268610 conn(0x7f73680d0170 msgr2=0x7f736806ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:31.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.307+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 shutdown_connections 2024-09-17T05:46:31.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.307+0000 7f736e400640 1 -- 172.21.15.44:0/1769268610 wait complete. 2024-09-17T05:46:31.333 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:46:31.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 -- 172.21.15.44:0/2941569579 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c1594c0 msgr2=0x7f764c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 --2- 172.21.15.44:0/2941569579 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c1594c0 0x7f764c0aee20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7634009900 tx=0x7f763401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 -- 172.21.15.44:0/2941569579 shutdown_connections 2024-09-17T05:46:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 --2- 172.21.15.44:0/2941569579 >> v2:172.21.15.86:3300/0 conn(0x7f764c0af360 0x7f764c15f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 --2- 172.21.15.44:0/2941569579 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c1594c0 0x7f764c0aee20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 -- 172.21.15.44:0/2941569579 >> 172.21.15.44:0/2941569579 conn(0x7f764c0d0170 msgr2=0x7f764c0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 -- 172.21.15.44:0/2941569579 shutdown_connections 2024-09-17T05:46:31.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.499+0000 7f7652200640 1 -- 172.21.15.44:0/2941569579 wait complete. 2024-09-17T05:46:31.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 Processor -- start 2024-09-17T05:46:31.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 -- start start 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c06ec70 0x7f764c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f764c0af360 0x7f764c09b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c15b480 0x7f764c09bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f764c15c460 con 0x7f764c15b480 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f764c15c2e0 con 0x7f764c0af360 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7652200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f764c15c5e0 con 0x7f764c06ec70 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c15b480 0x7f764c09bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c15b480 0x7f764c09bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55606/0 (socket says 172.21.15.44:55606) 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 -- 172.21.15.44:0/2025828756 learned_addr learned my addr 172.21.15.44:0/2025828756 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:31.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764b400640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c06ec70 0x7f764c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7643e00640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f764c0af360 0x7f764c09b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 -- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c06ec70 msgr2=0x7f764c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c06ec70 0x7f764c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 -- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f764c0af360 msgr2=0x7f764c09b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f764c0af360 0x7f764c09b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f764be00640 1 -- 172.21.15.44:0/2025828756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c1555b0 con 0x7f764c15b480 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.503+0000 7f7643e00640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f764c0af360 0x7f764c09b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f764be00640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c15b480 0x7f764c09bc70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f764400ecd0 tx=0x7f764400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7643400640 1 -- 172.21.15.44:0/2025828756 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644003b80 con 0x7f764c15b480 2024-09-17T05:46:31.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7643400640 1 -- 172.21.15.44:0/2025828756 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7644003d20 con 0x7f764c15b480 2024-09-17T05:46:31.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c09d8b0 con 0x7f764c15b480 2024-09-17T05:46:31.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7643400640 1 -- 172.21.15.44:0/2025828756 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644004280 con 0x7f764c15b480 2024-09-17T05:46:31.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c09de70 con 0x7f764c15b480 2024-09-17T05:46:31.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c15cb00 con 0x7f764c15b480 2024-09-17T05:46:31.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7643400640 1 -- 172.21.15.44:0/2025828756 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7644004b30 con 0x7f764c15b480 2024-09-17T05:46:31.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7643400640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7628073230 0x7f7628075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:31.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.507+0000 7f7643400640 1 -- 172.21.15.44:0/2025828756 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5921+0+0 (secure 0 0 0) 0x7f7644095220 con 0x7f764c15b480 2024-09-17T05:46:31.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.511+0000 7f764b400640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7628073230 0x7f7628075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:31.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.511+0000 7f764b400640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7628073230 0x7f7628075740 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f763c007fd0 tx=0x7f763c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.511+0000 7f7643400640 1 -- 172.21.15.44:0/2025828756 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7644060260 con 0x7f764c15b480 2024-09-17T05:46:31.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:31.691+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f764c0cc460 con 0x7f764c15b480 2024-09-17T05:46:32.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.299+0000 7f7643400640 1 -- 172.21.15.44:0/2025828756 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v124) ==== 169+0+0 (secure 0 0 0) 0x7f764405fb60 con 0x7f764c15b480 2024-09-17T05:46:32.300 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-09-17T05:46:32.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7628073230 msgr2=0x7f7628075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7628073230 0x7f7628075740 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f763c007fd0 tx=0x7f763c009040 comp rx=0 tx=0).stop 2024-09-17T05:46:32.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c15b480 msgr2=0x7f764c09bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c15b480 0x7f764c09bc70 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f764400ecd0 tx=0x7f764400c6a0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 shutdown_connections 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f764c15b480 0x7f764c09bc70 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7628073230 0x7f7628075740 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f764c0af360 0x7f764c09b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 --2- 172.21.15.44:0/2025828756 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f764c06ec70 0x7f764c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 >> 172.21.15.44:0/2025828756 conn(0x7f764c0d0170 msgr2=0x7f764c158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 shutdown_connections 2024-09-17T05:46:32.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.303+0000 7f7652200640 1 -- 172.21.15.44:0/2025828756 wait complete. 2024-09-17T05:46:32.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T05:46:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.491+0000 7fa9ab600640 1 -- 172.21.15.44:0/193360705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa98c004240 msgr2=0x7fa98c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.491+0000 7fa9ab600640 1 --2- 172.21.15.44:0/193360705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa98c004240 0x7fa98c004810 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fa990001830 tx=0x7fa99001f010 comp rx=0 tx=0).stop 2024-09-17T05:46:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.491+0000 7fa9a9600640 1 -- 172.21.15.44:0/193360705 reap_dead start 2024-09-17T05:46:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.491+0000 7fa9ab600640 1 -- 172.21.15.44:0/193360705 shutdown_connections 2024-09-17T05:46:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.491+0000 7fa9ab600640 1 -- 172.21.15.44:0/193360705 >> 172.21.15.44:0/193360705 conn(0x7fa9a406d450 msgr2=0x7fa9a40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.491+0000 7fa9ab600640 1 -- 172.21.15.44:0/193360705 shutdown_connections 2024-09-17T05:46:32.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.491+0000 7fa9ab600640 1 -- 172.21.15.44:0/193360705 wait complete. 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 Processor -- start 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 -- start start 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa98c004240 0x7fa9a4154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9a41555b0 0x7fa9a40c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a40c98f0 0x7fa9a41e4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40b33d0 con 0x7fa9a41555b0 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a40cefd0 con 0x7fa9a40c98f0 2024-09-17T05:46:32.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a40b3550 con 0x7fa98c004240 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9a41555b0 0x7fa9a40c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9a41555b0 0x7fa9a40c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55624/0 (socket says 172.21.15.44:55624) 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 -- 172.21.15.44:0/2674326999 learned_addr learned my addr 172.21.15.44:0/2674326999 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 -- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa98c004240 msgr2=0x7fa9a4154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a8c00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa98c004240 0x7fa9a4154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a9600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a40c98f0 0x7fa9a41e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa98c004240 0x7fa9a4154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 -- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a40c98f0 msgr2=0x7fa9a41e4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a40c98f0 0x7fa9a41e4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 -- 172.21.15.44:0/2674326999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a40c9d00 con 0x7fa9a41555b0 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a8c00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa98c004240 0x7fa9a4154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a9600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a40c98f0 0x7fa9a41e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a3e00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9a41555b0 0x7fa9a40c93b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fa990005040 tx=0x7fa990001480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:32.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a0c00640 1 -- 172.21.15.44:0/2674326999 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990003600 con 0x7fa9a41555b0 2024-09-17T05:46:32.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a0c00640 1 -- 172.21.15.44:0/2674326999 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9900b7070 con 0x7fa9a41555b0 2024-09-17T05:46:32.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9a0c00640 1 -- 172.21.15.44:0/2674326999 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990003af0 con 0x7fa9a41555b0 2024-09-17T05:46:32.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a40b2900 con 0x7fa9a41555b0 2024-09-17T05:46:32.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.495+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a41f9ac0 con 0x7fa9a41555b0 2024-09-17T05:46:32.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.499+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a40b2670 con 0x7fa9a41555b0 2024-09-17T05:46:32.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.499+0000 7fa9a0c00640 1 -- 172.21.15.44:0/2674326999 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa990003c90 con 0x7fa9a41555b0 2024-09-17T05:46:32.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.499+0000 7fa9a0c00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa984073230 0x7fa984075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.499+0000 7fa9a0c00640 1 -- 172.21.15.44:0/2674326999 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fa990131cb0 con 0x7fa9a41555b0 2024-09-17T05:46:32.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.499+0000 7fa9a8c00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa984073230 0x7fa984075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.499+0000 7fa9a8c00640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa984073230 0x7fa984075740 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa998005fd0 tx=0x7fa998005f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:32.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.503+0000 7fa9a0c00640 1 -- 172.21.15.44:0/2674326999 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fa9a40c9d00 con 0x7fa9a41555b0 2024-09-17T05:46:32.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.679+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fa9a40ce1f0 con 0x7fa9a41555b0 2024-09-17T05:46:32.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9a0c00640 1 -- 172.21.15.44:0/2674326999 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v45) ==== 71+0+0 (secure 0 0 0) 0x7fa990018dc0 con 0x7fa9a41555b0 2024-09-17T05:46:32.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa984073230 msgr2=0x7fa984075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa984073230 0x7fa984075740 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa998005fd0 tx=0x7fa998005f40 comp rx=0 tx=0).stop 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9a41555b0 msgr2=0x7fa9a40c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9a41555b0 0x7fa9a40c93b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fa990005040 tx=0x7fa990001480 comp rx=0 tx=0).stop 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 shutdown_connections 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa984073230 0x7fa984075740 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9a40c98f0 0x7fa9a41e4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9a41555b0 0x7fa9a40c93b0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 --2- 172.21.15.44:0/2674326999 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa98c004240 0x7fa9a4154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 >> 172.21.15.44:0/2674326999 conn(0x7fa9a406d450 msgr2=0x7fa9a40acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 shutdown_connections 2024-09-17T05:46:32.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.683+0000 7fa9ab600640 1 -- 172.21.15.44:0/2674326999 wait complete. 2024-09-17T05:46:32.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-09-17T05:46:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 -- 172.21.15.44:0/4174088127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e80709b0 msgr2=0x7f75e80b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 --2- 172.21.15.44:0/4174088127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e80709b0 0x7f75e80b41c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009900 tx=0x7f75d401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 -- 172.21.15.44:0/4174088127 shutdown_connections 2024-09-17T05:46:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 --2- 172.21.15.44:0/4174088127 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e80709b0 0x7f75e80b41c0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 --2- 172.21.15.44:0/4174088127 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75e815edb0 0x7f75e80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 -- 172.21.15.44:0/4174088127 >> 172.21.15.44:0/4174088127 conn(0x7f75e80ccbe0 msgr2=0x7f75e80ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:32.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 -- 172.21.15.44:0/4174088127 shutdown_connections 2024-09-17T05:46:32.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.863+0000 7f75f0000640 1 -- 172.21.15.44:0/4174088127 wait complete. 2024-09-17T05:46:32.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 Processor -- start 2024-09-17T05:46:32.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 -- start start 2024-09-17T05:46:32.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75e80709b0 0x7f75e80b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75e80b4700 0x7f75e8155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e815edb0 0x7f75e81fa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f75e81690c0 con 0x7f75e815edb0 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f75e8168f40 con 0x7f75e80709b0 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f75e8169240 con 0x7f75e80b4700 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e815edb0 0x7f75e81fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e815edb0 0x7f75e81fa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55642/0 (socket says 172.21.15.44:55642) 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 -- 172.21.15.44:0/1681609665 learned_addr learned my addr 172.21.15.44:0/1681609665 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ecc00640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75e80b4700 0x7f75e8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ed600640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75e80709b0 0x7f75e80b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 -- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75e80b4700 msgr2=0x7f75e8155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75e80b4700 0x7f75e8155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 -- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75e80709b0 msgr2=0x7f75e80b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75e80709b0 0x7f75e80b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 -- 172.21.15.44:0/1681609665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e809c470 con 0x7f75e815edb0 2024-09-17T05:46:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75ee000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e815edb0 0x7f75e81fa510 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c680 tx=0x7f75e000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75e5600640 1 -- 172.21.15.44:0/1681609665 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e0017070 con 0x7f75e815edb0 2024-09-17T05:46:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75e5600640 1 -- 172.21.15.44:0/1681609665 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75e0003c70 con 0x7f75e815edb0 2024-09-17T05:46:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e809c750 con 0x7f75e815edb0 2024-09-17T05:46:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.867+0000 7f75e5600640 1 -- 172.21.15.44:0/1681609665 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e00052d0 con 0x7f75e815edb0 2024-09-17T05:46:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.871+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e815a120 con 0x7f75e815edb0 2024-09-17T05:46:32.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.871+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e80b41c0 con 0x7f75e815edb0 2024-09-17T05:46:32.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.871+0000 7f75e5600640 1 -- 172.21.15.44:0/1681609665 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f75e001a070 con 0x7f75e815edb0 2024-09-17T05:46:32.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.871+0000 7f75e5600640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f75c8073200 0x7f75c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:32.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.871+0000 7f75e5600640 1 -- 172.21.15.44:0/1681609665 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f75e0093730 con 0x7f75e815edb0 2024-09-17T05:46:32.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.871+0000 7f75ed600640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f75c8073200 0x7f75c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:32.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.875+0000 7f75ed600640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f75c8073200 0x7f75c8075710 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00bb50 tx=0x7f75dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:32.875+0000 7f75e5600640 1 -- 172.21.15.44:0/1681609665 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f75e80b4b10 con 0x7f75e815edb0 2024-09-17T05:46:33.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.111+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7f75e809c200 con 0x7f75e815edb0 2024-09-17T05:46:33.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.307+0000 7f75e5600640 1 -- 172.21.15.44:0/1681609665 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v484) ==== 144+0+0 (secure 0 0 0) 0x7f75e005e160 con 0x7f75e815edb0 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.307+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f75c8073200 msgr2=0x7f75c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.307+0000 7f75f0000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f75c8073200 0x7f75c8075710 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00bb50 tx=0x7f75dc00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.307+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e815edb0 msgr2=0x7f75e81fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.307+0000 7f75f0000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e815edb0 0x7f75e81fa510 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f75e000c680 tx=0x7f75e000cb40 comp rx=0 tx=0).stop 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 shutdown_connections 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75e815edb0 0x7f75e81fa510 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f75e80b4700 0x7f75e8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f75c8073200 0x7f75c8075710 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 --2- 172.21.15.44:0/1681609665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75e80709b0 0x7f75e80b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:33.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 >> 172.21.15.44:0/1681609665 conn(0x7f75e80ccbe0 msgr2=0x7f75e81595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:33.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 shutdown_connections 2024-09-17T05:46:33.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:33.311+0000 7f75f0000640 1 -- 172.21.15.44:0/1681609665 wait complete. 2024-09-17T05:46:33.331 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-09-17T05:46:33.331 INFO:tasks.cephfs_test_runner: 2024-09-17T05:46:33.331 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T05:46:33.331 INFO:tasks.cephfs_test_runner:Ran 7 tests in 583.260s 2024-09-17T05:46:33.332 INFO:tasks.cephfs_test_runner: 2024-09-17T05:46:33.332 INFO:tasks.cephfs_test_runner:OK 2024-09-17T05:46:33.332 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T05:46:33.342 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T05:46:33.376 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T05:46:33.376 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:33.376 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:33.385 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:46:33.385 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-09-17T05:46:33.385 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:33.434 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353340k,nr_inodes=4088335,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6223 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:46:33.435 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:46:33.435 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:33.444 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:33.444 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-17T05:46:33.444 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:46:33.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6552 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:46:33.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:33.498 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:46:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:46:33.507 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:46:33.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:33.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:46:33.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:33.572 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:46:34.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:34.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-09-17T05:46:34.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:34.137 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-09-17T05:46:34.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:34.147 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-09-17T05:46:34.639 INFO:teuthology.orchestra.run.smithi044.stderr:Cannot find device "ceph-brx" 2024-09-17T05:46:34.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:46:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:34.641 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-17T05:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:46:34.652 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:46:34.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:34.652 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:46:34.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:34.720 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:46:35.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:35.153 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-17T05:46:35.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:35.317 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-09-17T05:46:35.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:46:35.327 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-09-17T05:46:35.759 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2024-09-17T05:46:35.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:46:35.761 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T05:46:35.770 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:46:35.770 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 -- 172.21.15.44:0/2706684064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7510003ab0 msgr2=0x7f7510003f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 --2- 172.21.15.44:0/2706684064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7510003ab0 0x7f7510003f20 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f751c0016f0 tx=0x7f751c01c7b0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f752be00640 1 -- 172.21.15.44:0/2706684064 reap_dead start 2024-09-17T05:46:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 -- 172.21.15.44:0/2706684064 shutdown_connections 2024-09-17T05:46:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 -- 172.21.15.44:0/2706684064 >> 172.21.15.44:0/2706684064 conn(0x7f752c0ccbe0 msgr2=0x7f752c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 -- 172.21.15.44:0/2706684064 shutdown_connections 2024-09-17T05:46:35.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 -- 172.21.15.44:0/2706684064 wait complete. 2024-09-17T05:46:35.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 Processor -- start 2024-09-17T05:46:35.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.943+0000 7f7532000640 1 -- start start 2024-09-17T05:46:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7510003ab0 0x7f752c09c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f752c09a9f0 0x7f752c1f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c156070 0x7f752c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f752c166a30 con 0x7f752c156070 2024-09-17T05:46:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f752c1668b0 con 0x7f7510003ab0 2024-09-17T05:46:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f752c166bb0 con 0x7f752c09a9f0 2024-09-17T05:46:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c156070 0x7f752c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c156070 0x7f752c156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55664/0 (socket says 172.21.15.44:55664) 2024-09-17T05:46:35.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 -- 172.21.15.44:0/4133481051 learned_addr learned my addr 172.21.15.44:0/4133481051 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752b400640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7510003ab0 0x7f752c09c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7523e00640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f752c09a9f0 0x7f752c1f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 -- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f752c09a9f0 msgr2=0x7f752c1f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f752c09a9f0 0x7f752c1f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 -- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7510003ab0 msgr2=0x7f752c09c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7510003ab0 0x7f752c09c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:35.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 -- 172.21.15.44:0/4133481051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c1569c0 con 0x7f752c156070 2024-09-17T05:46:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f752be00640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c156070 0x7f752c156480 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f752c0ce810 tx=0x7f752400d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7523400640 1 -- 172.21.15.44:0/4133481051 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524003980 con 0x7f752c156070 2024-09-17T05:46:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7523400640 1 -- 172.21.15.44:0/4133481051 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7524003b20 con 0x7f752c156070 2024-09-17T05:46:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7523400640 1 -- 172.21.15.44:0/4133481051 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524004020 con 0x7f752c156070 2024-09-17T05:46:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752c09b160 con 0x7f752c156070 2024-09-17T05:46:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752c09b720 con 0x7f752c156070 2024-09-17T05:46:35.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.947+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f752c0cb430 con 0x7f752c156070 2024-09-17T05:46:35.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.951+0000 7f7523400640 1 -- 172.21.15.44:0/4133481051 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f75240041c0 con 0x7f752c156070 2024-09-17T05:46:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.951+0000 7f7523400640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7508073200 0x7f7508075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.951+0000 7f7523400640 1 -- 172.21.15.44:0/4133481051 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f7524094b60 con 0x7f752c156070 2024-09-17T05:46:35.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.951+0000 7f752b400640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7508073200 0x7f7508075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:35.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.951+0000 7f752b400640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7508073200 0x7f7508075710 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f751c0016c0 tx=0x7f751c0a8040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:35.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:35.955+0000 7f7523400640 1 -- 172.21.15.44:0/4133481051 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f752c1569c0 con 0x7f752c156070 2024-09-17T05:46:36.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.127+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f752c0acf10 con 0x7f7508073200 2024-09-17T05:46:36.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.127+0000 7f7523400640 1 -- 172.21.15.44:0/4133481051 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13482 (secure 0 0 0) 0x7f752c0acf10 con 0x7f7508073200 2024-09-17T05:46:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:36.130 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:46:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7508073200 msgr2=0x7f7508075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7508073200 0x7f7508075710 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f751c0016c0 tx=0x7f751c0a8040 comp rx=0 tx=0).stop 2024-09-17T05:46:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c156070 msgr2=0x7f752c156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c156070 0x7f752c156480 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f752c0ce810 tx=0x7f752400d7b0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 shutdown_connections 2024-09-17T05:46:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c156070 0x7f752c156480 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f752c09a9f0 0x7f752c1f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7508073200 0x7f7508075710 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 --2- 172.21.15.44:0/4133481051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7510003ab0 0x7f752c09c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 >> 172.21.15.44:0/4133481051 conn(0x7f752c0ccbe0 msgr2=0x7f752c1543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 shutdown_connections 2024-09-17T05:46:36.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.131+0000 7f7532000640 1 -- 172.21.15.44:0/4133481051 wait complete. 2024-09-17T05:46:36.153 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":433,"stamp":"2024-09-17T05:46:34.435958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":278968,"kb_used_data":29460,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754695752,"statfs":{"total":773094113280,"available":772808450048,"internally_reserved":0,"allocated":30167040,"data_stored":23630158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390402,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-266,"num_write":-169,"num_write_kb":-8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001478"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":306,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-17T05:46:29.295662+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:46:29.295662+0000","last_peered":"2024-09-17T05:46:29.295662+0000","last_clean":"2024-09-17T05:46:29.295662+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:46:29.295662+0000","last_undegraded":"2024-09-17T05:46:29.295662+0000","last_fullsized":"2024-09-17T05:46:29.295662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509569,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":5572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":5705728,"data_stored":4901263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509568,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33260,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338580,"statfs":{"total":96636764160,"available":96602705920,"internally_reserved":0,"allocated":2121728,"data_stored":1298452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509567,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":707015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509568,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1519616,"data_stored":707056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509567,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":5596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":5730304,"data_stored":4902977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509569,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37348,"kb_used_data":6160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334492,"statfs":{"total":96636764160,"available":96598519808,"internally_reserved":0,"allocated":6307840,"data_stored":5491791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509569,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36772,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335068,"statfs":{"total":96636764160,"available":96599109632,"internally_reserved":0,"allocated":5718016,"data_stored":4901949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:46:36.154 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:36.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 -- 172.21.15.44:0/4240586309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f211815edb0 msgr2=0x7f21180700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 --2- 172.21.15.44:0/4240586309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f211815edb0 0x7f21180700b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f210c009900 tx=0x7f210c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 -- 172.21.15.44:0/4240586309 shutdown_connections 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 --2- 172.21.15.44:0/4240586309 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f21180b48d0 0x7f2118072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 --2- 172.21.15.44:0/4240586309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f211815edb0 0x7f21180700b0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 -- 172.21.15.44:0/4240586309 >> 172.21.15.44:0/4240586309 conn(0x7f21180ccbe0 msgr2=0x7f21180ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 -- 172.21.15.44:0/4240586309 shutdown_connections 2024-09-17T05:46:36.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.311+0000 7f2120600640 1 -- 172.21.15.44:0/4240586309 wait complete. 2024-09-17T05:46:36.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 Processor -- start 2024-09-17T05:46:36.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 -- start start 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21180709b0 0x7f211815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211815edb0 0x7f21180c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f211815c540 0x7f21180c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2118168b60 con 0x7f21180709b0 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f21181689e0 con 0x7f211815edb0 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2120600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f2118168ce0 con 0x7f211815c540 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21180709b0 0x7f211815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21180709b0 0x7f211815bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55688/0 (socket says 172.21.15.44:55688) 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 -- 172.21.15.44:0/39845442 learned_addr learned my addr 172.21.15.44:0/39845442 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211d200640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211815edb0 0x7f21180c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211e600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f211815c540 0x7f21180c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 -- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f211815c540 msgr2=0x7f21180c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f211815c540 0x7f21180c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 -- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211815edb0 msgr2=0x7f21180c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211815edb0 0x7f21180c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 -- 172.21.15.44:0/39845442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21181fc8d0 con 0x7f21180709b0 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f211dc00640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21180709b0 0x7f211815bdd0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f210c009850 tx=0x7f210c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.315+0000 7f2115600640 1 -- 172.21.15.44:0/39845442 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c0b2040 con 0x7f21180709b0 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2115600640 1 -- 172.21.15.44:0/39845442 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f210c0bd070 con 0x7f21180709b0 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211815c310 con 0x7f21180709b0 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2115600640 1 -- 172.21.15.44:0/39845442 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c004370 con 0x7f21180709b0 2024-09-17T05:46:36.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21181fbdf0 con 0x7f21180709b0 2024-09-17T05:46:36.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2118072e20 con 0x7f21180709b0 2024-09-17T05:46:36.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2115600640 1 -- 172.21.15.44:0/39845442 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f210c003600 con 0x7f21180709b0 2024-09-17T05:46:36.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2115600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20f8073200 0x7f20f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.319+0000 7f2115600640 1 -- 172.21.15.44:0/39845442 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f210c12f5e0 con 0x7f21180709b0 2024-09-17T05:46:36.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.323+0000 7f211d200640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20f8073200 0x7f20f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.323+0000 7f211d200640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20f8073200 0x7f20f8075710 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f21180c9670 tx=0x7f2104009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.323+0000 7f2115600640 1 -- 172.21.15.44:0/39845442 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f210c0164d0 con 0x7f21180709b0 2024-09-17T05:46:36.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.495+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21180703d0 con 0x7f20f8073200 2024-09-17T05:46:36.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.495+0000 7f2115600640 1 -- 172.21.15.44:0/39845442 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13498 (secure 0 0 0) 0x7f21180703d0 con 0x7f20f8073200 2024-09-17T05:46:36.497 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:36.498 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:46:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20f8073200 msgr2=0x7f20f8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20f8073200 0x7f20f8075710 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f21180c9670 tx=0x7f2104009040 comp rx=0 tx=0).stop 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21180709b0 msgr2=0x7f211815bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21180709b0 0x7f211815bdd0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f210c009850 tx=0x7f210c005780 comp rx=0 tx=0).stop 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 shutdown_connections 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f211815c540 0x7f21180c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20f8073200 0x7f20f8075710 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f211815edb0 0x7f21180c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 --2- 172.21.15.44:0/39845442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21180709b0 0x7f211815bdd0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 >> 172.21.15.44:0/39845442 conn(0x7f21180ccbe0 msgr2=0x7f2118165610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 shutdown_connections 2024-09-17T05:46:36.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.499+0000 7f2120600640 1 -- 172.21.15.44:0/39845442 wait complete. 2024-09-17T05:46:36.520 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":434,"stamp":"2024-09-17T05:46:36.436531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262752,"kb_used_data":13224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711968,"statfs":{"total":773094113280,"available":772825055232,"internally_reserved":0,"allocated":13541376,"data_stored":6937976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390402,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-266,"num_write":-169,"num_write_kb":-8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.144392"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":310,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-17T05:46:32.305950+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:46:32.305950+0000","last_peered":"2024-09-17T05:46:32.305950+0000","last_clean":"2024-09-17T05:46:32.305950+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:46:32.305950+0000","last_undegraded":"2024-09-17T05:46:32.305950+0000","last_fullsized":"2024-09-17T05:46:32.305950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509569,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2138112,"data_stored":1310023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509568,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509568,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509570,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2138112,"data_stored":1310023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:46:36.520 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:46:36.520 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 -- 172.21.15.44:0/166272085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec15edb0 msgr2=0x7f57ec0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 --2- 172.21.15.44:0/166272085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec15edb0 0x7f57ec0700b0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009900 tx=0x7f57e001c880 comp rx=0 tx=0).stop 2024-09-17T05:46:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 -- 172.21.15.44:0/166272085 shutdown_connections 2024-09-17T05:46:36.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 --2- 172.21.15.44:0/166272085 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ec0709b0 0x7f57ec0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 --2- 172.21.15.44:0/166272085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec15edb0 0x7f57ec0700b0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 -- 172.21.15.44:0/166272085 >> 172.21.15.44:0/166272085 conn(0x7f57ec0ccbe0 msgr2=0x7f57ec0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 -- 172.21.15.44:0/166272085 shutdown_connections 2024-09-17T05:46:36.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 -- 172.21.15.44:0/166272085 wait complete. 2024-09-17T05:46:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 Processor -- start 2024-09-17T05:46:36.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.679+0000 7f57f4800640 1 -- start start 2024-09-17T05:46:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec0709b0 0x7f57ec156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ec0b4700 0x7f57ec0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec15edb0 0x7f57ec0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec169060 con 0x7f57ec0709b0 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec168ee0 con 0x7f57ec15edb0 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f57ec1691e0 con 0x7f57ec0b4700 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec0709b0 0x7f57ec156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec0709b0 0x7f57ec156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55712/0 (socket says 172.21.15.44:55712) 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 -- 172.21.15.44:0/2259503419 learned_addr learned my addr 172.21.15.44:0/2259503419 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 -- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ec0b4700 msgr2=0x7f57ec0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ec0b4700 0x7f57ec0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 -- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec15edb0 msgr2=0x7f57ec0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec15edb0 0x7f57ec0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 -- 172.21.15.44:0/2259503419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec157660 con 0x7f57ec0709b0 2024-09-17T05:46:36.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f1e00640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec0709b0 0x7f57ec156e10 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009850 tx=0x7f57e00a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57e6000640 1 -- 172.21.15.44:0/2259503419 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e00b2040 con 0x7f57ec0709b0 2024-09-17T05:46:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57e6000640 1 -- 172.21.15.44:0/2259503419 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57e0004430 con 0x7f57ec0709b0 2024-09-17T05:46:36.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57e6000640 1 -- 172.21.15.44:0/2259503419 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0003860 con 0x7f57ec0709b0 2024-09-17T05:46:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ec157940 con 0x7f57ec0709b0 2024-09-17T05:46:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ec09aa90 con 0x7f57ec0709b0 2024-09-17T05:46:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.683+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ec0b41c0 con 0x7f57ec0709b0 2024-09-17T05:46:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.687+0000 7f57e6000640 1 -- 172.21.15.44:0/2259503419 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f57e0003a00 con 0x7f57ec0709b0 2024-09-17T05:46:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.687+0000 7f57e6000640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f57d0073200 0x7f57d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.687+0000 7f57e6000640 1 -- 172.21.15.44:0/2259503419 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f57e012e510 con 0x7f57ec0709b0 2024-09-17T05:46:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.687+0000 7f57f1400640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f57d0073200 0x7f57d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.687+0000 7f57f1400640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f57d0073200 0x7f57d0075710 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f57ec09c760 tx=0x7f57dc005be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.691+0000 7f57e6000640 1 -- 172.21.15.44:0/2259503419 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f57e00164d0 con 0x7f57ec0709b0 2024-09-17T05:46:36.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.863+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57ec0ce520 con 0x7f57d0073200 2024-09-17T05:46:36.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.863+0000 7f57e6000640 1 -- 172.21.15.44:0/2259503419 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13498 (secure 0 0 0) 0x7f57ec0ce520 con 0x7f57d0073200 2024-09-17T05:46:36.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:36.866 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f57d0073200 msgr2=0x7f57d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f57d0073200 0x7f57d0075710 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f57ec09c760 tx=0x7f57dc005be0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec0709b0 msgr2=0x7f57ec156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec0709b0 0x7f57ec156e10 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009850 tx=0x7f57e00a5650 comp rx=0 tx=0).stop 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 shutdown_connections 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f57d0073200 0x7f57d0075710 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec15edb0 0x7f57ec0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f57ec0b4700 0x7f57ec0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 --2- 172.21.15.44:0/2259503419 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57ec0709b0 0x7f57ec156e10 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 >> 172.21.15.44:0/2259503419 conn(0x7f57ec0ccbe0 msgr2=0x7f57ec15de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 shutdown_connections 2024-09-17T05:46:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:36.867+0000 7f57f4800640 1 -- 172.21.15.44:0/2259503419 wait complete. 2024-09-17T05:46:36.889 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":434,"stamp":"2024-09-17T05:46:36.436531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262752,"kb_used_data":13224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711968,"statfs":{"total":773094113280,"available":772825055232,"internally_reserved":0,"allocated":13541376,"data_stored":6937976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390402,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-266,"num_write":-169,"num_write_kb":-8293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.144392"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":310,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-17T05:46:32.305950+0000","last_change":"2024-09-17T05:36:08.081312+0000","last_active":"2024-09-17T05:46:32.305950+0000","last_peered":"2024-09-17T05:46:32.305950+0000","last_clean":"2024-09-17T05:46:32.305950+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:46:32.305950+0000","last_undegraded":"2024-09-17T05:46:32.305950+0000","last_fullsized":"2024-09-17T05:46:32.305950+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:06.945233+0000","last_clean_scrub_stamp":"2024-09-17T05:36:06.945233+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:39.053805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509569,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2138112,"data_stored":1310023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509568,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509568,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509570,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2138112,"data_stored":1310023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:46:36.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:46:37.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 -- 172.21.15.44:0/3789399983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 msgr2=0x7fc7880b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3789399983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 0x7fc7880b41c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc770009900 tx=0x7fc77001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 -- 172.21.15.44:0/3789399983 shutdown_connections 2024-09-17T05:46:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3789399983 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7880b4700 0x7fc788072e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3789399983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 0x7fc7880b41c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 -- 172.21.15.44:0/3789399983 >> 172.21.15.44:0/3789399983 conn(0x7fc7880ccbe0 msgr2=0x7fc7880ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 -- 172.21.15.44:0/3789399983 shutdown_connections 2024-09-17T05:46:37.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 -- 172.21.15.44:0/3789399983 wait complete. 2024-09-17T05:46:37.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.047+0000 7fc78ea00640 1 Processor -- start 2024-09-17T05:46:37.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 -- start start 2024-09-17T05:46:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 0x7fc788155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7880b4700 0x7fc7880c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc78815edb0 0x7fc7880b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc788168c40 con 0x7fc78815edb0 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc788168ac0 con 0x7fc7880709b0 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fc788168dc0 con 0x7fc7880b4700 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc78815edb0 0x7fc7880b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc78815edb0 0x7fc7880b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55728/0 (socket says 172.21.15.44:55728) 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 -- 172.21.15.44:0/3750555718 learned_addr learned my addr 172.21.15.44:0/3750555718 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc787e00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 0x7fc788155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc77fe00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7880b4700 0x7fc7880c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 -- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7880b4700 msgr2=0x7fc7880c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7880b4700 0x7fc7880c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 -- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 msgr2=0x7fc788155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 0x7fc788155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 -- 172.21.15.44:0/3750555718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7880c4170 con 0x7fc78815edb0 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ca00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc78815edb0 0x7fc7880b3650 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fc78000eae0 tx=0x7fc780009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc784c00640 1 -- 172.21.15.44:0/3750555718 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78000cde0 con 0x7fc78815edb0 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc784c00640 1 -- 172.21.15.44:0/3750555718 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc780004c20 con 0x7fc78815edb0 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7880c4450 con 0x7fc78815edb0 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc784c00640 1 -- 172.21.15.44:0/3750555718 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780005020 con 0x7fc78815edb0 2024-09-17T05:46:37.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7880c4a10 con 0x7fc78815edb0 2024-09-17T05:46:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.051+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7880b41c0 con 0x7fc78815edb0 2024-09-17T05:46:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.055+0000 7fc784c00640 1 -- 172.21.15.44:0/3750555718 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc7800051c0 con 0x7fc78815edb0 2024-09-17T05:46:37.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.055+0000 7fc784c00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc764073200 0x7fc764075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.055+0000 7fc784c00640 1 -- 172.21.15.44:0/3750555718 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fc780094ff0 con 0x7fc78815edb0 2024-09-17T05:46:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.055+0000 7fc787e00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc764073200 0x7fc764075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:37.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.055+0000 7fc787e00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc764073200 0x7fc764075710 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f70 tx=0x7fc778009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.059+0000 7fc784c00640 1 -- 172.21.15.44:0/3750555718 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fc780060070 con 0x7fc78815edb0 2024-09-17T05:46:37.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.235+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7881557c0 con 0x7fc78815edb0 2024-09-17T05:46:37.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.235+0000 7fc784c00640 1 -- 172.21.15.44:0/3750555718 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+13527 (secure 0 0 0) 0x7fc78005f970 con 0x7fc78815edb0 2024-09-17T05:46:37.238 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:37.238 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":124,"fsid":"416ea1ed-afce-4e18-8956-62d00ca75710","created":"2024-09-17T05:35:50.942952+0000","modified":"2024-09-17T05:46:32.301646+0000","last_up_change":"2024-09-17T05:36:05.942687+0000","last_in_change":"2024-09-17T05:35:55.294984+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:36:06.284181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1a54c4a7-e50f-40b6-bd16-d382f349afe1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6801","nonce":3049588557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6803","nonce":3049588557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6807","nonce":3049588557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":3049588557},{"type":"v1","addr":"172.21.15.44:6805","nonce":3049588557}]},"public_addr":"172.21.15.44:6801/3049588557","cluster_addr":"172.21.15.44:6803/3049588557","heartbeat_back_addr":"172.21.15.44:6807/3049588557","heartbeat_front_addr":"172.21.15.44:6805/3049588557","state":["exists","up"]},{"osd":1,"uuid":"611ed68f-3dbd-4357-a544-abeab82adcc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6817","nonce":298260573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6819","nonce":298260573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6823","nonce":298260573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":298260573},{"type":"v1","addr":"172.21.15.44:6821","nonce":298260573}]},"public_addr":"172.21.15.44:6817/298260573","cluster_addr":"172.21.15.44:6819/298260573","heartbeat_back_addr":"172.21.15.44:6823/298260573","heartbeat_front_addr":"172.21.15.44:6821/298260573","state":["exists","up"]},{"osd":2,"uuid":"cceafb1a-8d0e-469f-81a6-33930e8c3821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6809","nonce":1191521276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6811","nonce":1191521276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6815","nonce":1191521276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":1191521276},{"type":"v1","addr":"172.21.15.44:6813","nonce":1191521276}]},"public_addr":"172.21.15.44:6809/1191521276","cluster_addr":"172.21.15.44:6811/1191521276","heartbeat_back_addr":"172.21.15.44:6815/1191521276","heartbeat_front_addr":"172.21.15.44:6813/1191521276","state":["exists","up"]},{"osd":3,"uuid":"661f651d-86da-4c54-9d7c-7fd7257752f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6825","nonce":2051542036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6827","nonce":2051542036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6831","nonce":2051542036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":2051542036},{"type":"v1","addr":"172.21.15.44:6829","nonce":2051542036}]},"public_addr":"172.21.15.44:6825/2051542036","cluster_addr":"172.21.15.44:6827/2051542036","heartbeat_back_addr":"172.21.15.44:6831/2051542036","heartbeat_front_addr":"172.21.15.44:6829/2051542036","state":["exists","up"]},{"osd":4,"uuid":"2abc9322-dfe6-4b1f-993d-1985a2ce29ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6811","nonce":2781128627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6813","nonce":2781128627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6817","nonce":2781128627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2781128627},{"type":"v1","addr":"172.21.15.86:6815","nonce":2781128627}]},"public_addr":"172.21.15.86:6811/2781128627","cluster_addr":"172.21.15.86:6813/2781128627","heartbeat_back_addr":"172.21.15.86:6817/2781128627","heartbeat_front_addr":"172.21.15.86:6815/2781128627","state":["exists","up"]},{"osd":5,"uuid":"104f1a4a-b33b-4831-b0b6-f3d3a6000c58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6824","nonce":2837964024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6829","nonce":2837964024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6833","nonce":2837964024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":2837964024},{"type":"v1","addr":"172.21.15.86:6831","nonce":2837964024}]},"public_addr":"172.21.15.86:6824/2837964024","cluster_addr":"172.21.15.86:6829/2837964024","heartbeat_back_addr":"172.21.15.86:6833/2837964024","heartbeat_front_addr":"172.21.15.86:6831/2837964024","state":["exists","up"]},{"osd":6,"uuid":"00906172-03c2-4813-bb35-1d75cf3974a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6803","nonce":218299486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6805","nonce":218299486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6809","nonce":218299486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":218299486},{"type":"v1","addr":"172.21.15.86:6807","nonce":218299486}]},"public_addr":"172.21.15.86:6803/218299486","cluster_addr":"172.21.15.86:6805/218299486","heartbeat_back_addr":"172.21.15.86:6809/218299486","heartbeat_front_addr":"172.21.15.86:6807/218299486","state":["exists","up"]},{"osd":7,"uuid":"7a44b405-f09b-4844-b45f-11eba59767d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6819","nonce":3939301135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6821","nonce":3939301135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6827","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6828","nonce":3939301135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6823","nonce":3939301135},{"type":"v1","addr":"172.21.15.86:6825","nonce":3939301135}]},"public_addr":"172.21.15.86:6819/3939301135","cluster_addr":"172.21.15.86:6821/3939301135","heartbeat_back_addr":"172.21.15.86:6828/3939301135","heartbeat_front_addr":"172.21.15.86:6825/3939301135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.267661+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.509393+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.375137+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.665398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.328941+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.551265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:01.943296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:36:02.402538+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/2442475753":"2024-09-18T05:46:29.287435+0000","172.21.15.44:6834/2442475753":"2024-09-18T05:46:29.287435+0000","172.21.15.44:6835/3525601076":"2024-09-18T05:46:16.757299+0000","172.21.15.44:6834/3525601076":"2024-09-18T05:46:16.757299+0000","172.21.15.44:6835/1819525564":"2024-09-18T05:46:06.760809+0000","172.21.15.44:6834/1819525564":"2024-09-18T05:46:06.760809+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:46:37.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc764073200 msgr2=0x7fc764075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc764073200 0x7fc764075710 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f70 tx=0x7fc778009040 comp rx=0 tx=0).stop 2024-09-17T05:46:37.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc78815edb0 msgr2=0x7fc7880b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:37.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc78815edb0 0x7fc7880b3650 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fc78000eae0 tx=0x7fc780009f70 comp rx=0 tx=0).stop 2024-09-17T05:46:37.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 shutdown_connections 2024-09-17T05:46:37.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc78815edb0 0x7fc7880b3650 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fc7880b4700 0x7fc7880c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fc764073200 0x7fc764075710 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 --2- 172.21.15.44:0/3750555718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7880709b0 0x7fc788155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:37.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 >> 172.21.15.44:0/3750555718 conn(0x7fc7880ccbe0 msgr2=0x7fc7880cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:37.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 shutdown_connections 2024-09-17T05:46:37.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:37.239+0000 7fc78ea00640 1 -- 172.21.15.44:0/3750555718 wait complete. 2024-09-17T05:46:38.261 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T05:46:38.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 -- 172.21.15.44:0/417355293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 msgr2=0x7fe6340b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 --2- 172.21.15.44:0/417355293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 0x7fe6340b41e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fe6340cf410 tx=0x7fe61c01c800 comp rx=0 tx=0).stop 2024-09-17T05:46:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 -- 172.21.15.44:0/417355293 shutdown_connections 2024-09-17T05:46:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 --2- 172.21.15.44:0/417355293 >> v2:172.21.15.86:3300/0 conn(0x7fe6340b51a0 0x7fe6340b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 --2- 172.21.15.44:0/417355293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 0x7fe6340b41e0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 -- 172.21.15.44:0/417355293 >> 172.21.15.44:0/417355293 conn(0x7fe63406d220 msgr2=0x7fe63406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 -- 172.21.15.44:0/417355293 shutdown_connections 2024-09-17T05:46:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.435+0000 7fe639000640 1 -- 172.21.15.44:0/417355293 wait complete. 2024-09-17T05:46:38.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 Processor -- start 2024-09-17T05:46:38.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 -- start start 2024-09-17T05:46:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 0x7fe6340b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6340b51a0 0x7fe6340aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6340b7b50 0x7fe6341fc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe634169bf0 con 0x7fe6340b3dd0 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe634169a70 con 0x7fe6340b7b50 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fe634169d70 con 0x7fe6340b51a0 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 0x7fe6340b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 0x7fe6340b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55758/0 (socket says 172.21.15.44:55758) 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 -- 172.21.15.44:0/3599292788 learned_addr learned my addr 172.21.15.44:0/3599292788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 -- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6340b51a0 msgr2=0x7fe6340aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fe6340b51a0 0x7fe6340aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe632800640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6340b7b50 0x7fe6341fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 -- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6340b7b50 msgr2=0x7fe6341fc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6340b7b50 0x7fe6341fc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 -- 172.21.15.44:0/3599292788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6340adbc0 con 0x7fe6340b3dd0 2024-09-17T05:46:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe632800640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6340b7b50 0x7fe6341fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe631e00640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 0x7fe6340b0170 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe624001ec0 tx=0x7fe62400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624017070 con 0x7fe6340b3dd0 2024-09-17T05:46:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe624003600 con 0x7fe6340b3dd0 2024-09-17T05:46:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624003a50 con 0x7fe6340b3dd0 2024-09-17T05:46:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.439+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6340adea0 con 0x7fe6340b3dd0 2024-09-17T05:46:38.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6340ae460 con 0x7fe6340b3dd0 2024-09-17T05:46:38.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6340b41e0 con 0x7fe6340b3dd0 2024-09-17T05:46:38.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe62401a070 con 0x7fe6340b3dd0 2024-09-17T05:46:38.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe62aa00640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe610073200 0x7fe610075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fe624093b80 con 0x7fe6340b3dd0 2024-09-17T05:46:38.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe62aa00640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7fe610079830 0x7fe61007bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe629400640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe610073200 0x7fe610075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe61007c390 con 0x7fe610079830 2024-09-17T05:46:38.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fe624093f30 con 0x7fe6340b3dd0 2024-09-17T05:46:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.443+0000 7fe632800640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7fe610079830 0x7fe61007bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.447+0000 7fe632800640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7fe610079830 0x7fe61007bcc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.447+0000 7fe629400640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe610073200 0x7fe610075710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0af000 tx=0x7fe61c0195a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.447+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== osd.0 v2:172.21.15.44:6800/3049588557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe61007c390 con 0x7fe610079830 2024-09-17T05:46:38.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 --> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe6340b6ff0 con 0x7fe610079830 2024-09-17T05:46:38.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe62aa00640 1 -- 172.21.15.44:0/3599292788 <== osd.0 v2:172.21.15.44:6800/3049588557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe6340b6ff0 con 0x7fe610079830 2024-09-17T05:46:38.462 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:38.462 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:38.462 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7fe610079830 msgr2=0x7fe61007bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:6800/3049588557,v1:172.21.15.44:6801/3049588557] conn(0x7fe610079830 0x7fe61007bcc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe610073200 msgr2=0x7fe610075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fe610073200 0x7fe610075710 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe61c0af000 tx=0x7fe61c0195a0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 msgr2=0x7fe6340b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 --2- 172.21.15.44:0/3599292788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6340b3dd0 0x7fe6340b0170 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fe624001ec0 tx=0x7fe62400c890 comp rx=0 tx=0).stop 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe632800640 1 -- 172.21.15.44:0/3599292788 reap_dead start 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 shutdown_connections 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 >> 172.21.15.44:0/3599292788 conn(0x7fe63406d220 msgr2=0x7fe6340cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 shutdown_connections 2024-09-17T05:46:38.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.459+0000 7fe639000640 1 -- 172.21.15.44:0/3599292788 wait complete. 2024-09-17T05:46:38.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T05:46:38.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 -- 172.21.15.44:0/1872366790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 msgr2=0x7f27a806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 --2- 172.21.15.44:0/1872366790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a806f890 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009c80 tx=0x7f27a001cda0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 -- 172.21.15.44:0/1872366790 shutdown_connections 2024-09-17T05:46:38.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 --2- 172.21.15.44:0/1872366790 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a806f890 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 --2- 172.21.15.44:0/1872366790 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27a809df30 0x7f27a80b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 -- 172.21.15.44:0/1872366790 >> 172.21.15.44:0/1872366790 conn(0x7f27a806d450 msgr2=0x7f27a80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 -- 172.21.15.44:0/1872366790 shutdown_connections 2024-09-17T05:46:38.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 -- 172.21.15.44:0/1872366790 wait complete. 2024-09-17T05:46:38.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 Processor -- start 2024-09-17T05:46:38.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.643+0000 7f27b0200640 1 -- start start 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27a809df30 0x7f27a80c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27a80b3910 0x7f27a81fce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8169000 con 0x7f27a80ce900 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27a8168e80 con 0x7f27a809df30 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f27a8169180 con 0x7f27a80b3910 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a815a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55776/0 (socket says 172.21.15.44:55776) 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 -- 172.21.15.44:0/3009098179 learned_addr learned my addr 172.21.15.44:0/3009098179 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ad800640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27a809df30 0x7f27a80c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ace00640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27a80b3910 0x7f27a81fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 -- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27a80b3910 msgr2=0x7f27a81fce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27a80b3910 0x7f27a81fce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 -- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27a809df30 msgr2=0x7f27a80c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27a809df30 0x7f27a80c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 -- 172.21.15.44:0/3009098179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a8073230 con 0x7f27a80ce900 2024-09-17T05:46:38.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27ae200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a815a8e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f27a001b450 tx=0x7f27a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27a5600640 1 -- 172.21.15.44:0/3009098179 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a00b2040 con 0x7f27a80ce900 2024-09-17T05:46:38.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27a5600640 1 -- 172.21.15.44:0/3009098179 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27a0004460 con 0x7f27a80ce900 2024-09-17T05:46:38.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a80c3d40 con 0x7f27a80ce900 2024-09-17T05:46:38.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27a5600640 1 -- 172.21.15.44:0/3009098179 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a00ad440 con 0x7f27a80ce900 2024-09-17T05:46:38.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a815ae20 con 0x7f27a80ce900 2024-09-17T05:46:38.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.647+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a80b33d0 con 0x7f27a80ce900 2024-09-17T05:46:38.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.651+0000 7f27a5600640 1 -- 172.21.15.44:0/3009098179 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f27a00ad5e0 con 0x7f27a80ce900 2024-09-17T05:46:38.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.651+0000 7f27a5600640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2788073200 0x7f2788075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:38.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.651+0000 7f27a5600640 1 -- 172.21.15.44:0/3009098179 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f27a012ead0 con 0x7f27a80ce900 2024-09-17T05:46:38.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.651+0000 7f27ad800640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2788073200 0x7f2788075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:38.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.651+0000 7f27ad800640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2788073200 0x7f2788075710 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f279c005fd0 tx=0x7f279c00a250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:38.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.655+0000 7f27a5600640 1 -- 172.21.15.44:0/3009098179 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f27a0016990 con 0x7f27a80ce900 2024-09-17T05:46:38.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.827+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f27a809ad30 con 0x7f2788073200 2024-09-17T05:46:38.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.827+0000 7f27a5600640 1 -- 172.21.15.44:0/3009098179 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f27a809ad30 con 0x7f2788073200 2024-09-17T05:46:38.830 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2788073200 msgr2=0x7f2788075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2788073200 0x7f2788075710 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f279c005fd0 tx=0x7f279c00a250 comp rx=0 tx=0).stop 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 msgr2=0x7f27a815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a815a8e0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f27a001b450 tx=0x7f27a0004270 comp rx=0 tx=0).stop 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 shutdown_connections 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f27a80ce900 0x7f27a815a8e0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f27a80b3910 0x7f27a81fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2788073200 0x7f2788075710 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 --2- 172.21.15.44:0/3009098179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27a809df30 0x7f27a80c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:38.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 >> 172.21.15.44:0/3009098179 conn(0x7f27a806d450 msgr2=0x7f27a80cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:38.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 shutdown_connections 2024-09-17T05:46:38.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:38.831+0000 7f27b0200640 1 -- 172.21.15.44:0/3009098179 wait complete. 2024-09-17T05:46:38.853 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T05:46:38.853 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:39.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 -- 172.21.15.44:0/3951495322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a101594c0 msgr2=0x7f1a100aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 --2- 172.21.15.44:0/3951495322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a101594c0 0x7f1a100aee20 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f1a10075250 tx=0x7f19f801c800 comp rx=0 tx=0).stop 2024-09-17T05:46:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 -- 172.21.15.44:0/3951495322 shutdown_connections 2024-09-17T05:46:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 --2- 172.21.15.44:0/3951495322 >> v2:172.21.15.86:3300/0 conn(0x7f1a100af360 0x7f1a1015f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 --2- 172.21.15.44:0/3951495322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a101594c0 0x7f1a100aee20 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 -- 172.21.15.44:0/3951495322 >> 172.21.15.44:0/3951495322 conn(0x7f1a100d0170 msgr2=0x7f1a100d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 -- 172.21.15.44:0/3951495322 shutdown_connections 2024-09-17T05:46:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 -- 172.21.15.44:0/3951495322 wait complete. 2024-09-17T05:46:39.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 Processor -- start 2024-09-17T05:46:39.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.015+0000 7f1a15600640 1 -- start start 2024-09-17T05:46:39.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a1006ec70 0x7f1a1009d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a100af360 0x7f1a10157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a101582b0 0x7f1a101f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1015c3e0 con 0x7f1a100af360 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1015c260 con 0x7f1a1006ec70 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1015c560 con 0x7f1a101582b0 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a100af360 0x7f1a10157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a100af360 0x7f1a10157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36676/0 (socket says 172.21.15.44:36676) 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 -- 172.21.15.44:0/1380272170 learned_addr learned my addr 172.21.15.44:0/1380272170 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a0ea00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a1006ec70 0x7f1a1009d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a0f400640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a101582b0 0x7f1a101f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 -- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a101582b0 msgr2=0x7f1a101f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a101582b0 0x7f1a101f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 -- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a1006ec70 msgr2=0x7f1a1009d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a1006ec70 0x7f1a1009d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 -- 172.21.15.44:0/1380272170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a10051040 con 0x7f1a100af360 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a0f400640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f1a101582b0 0x7f1a101f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a07e00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a100af360 0x7f1a10157b30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f19f801aeb0 tx=0x7f19f80a66c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80be020 con 0x7f1a100af360 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19f80041b0 con 0x7f1a100af360 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1009de20 con 0x7f1a100af360 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8005020 con 0x7f1a100af360 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1009c840 con 0x7f1a100af360 2024-09-17T05:46:39.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.019+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a1015cac0 con 0x7f1a100af360 2024-09-17T05:46:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f19f80051c0 con 0x7f1a100af360 2024-09-17T05:46:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a06a00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19ec073200 0x7f19ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f19f812ed40 con 0x7f1a100af360 2024-09-17T05:46:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a06a00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7f19ec079830 0x7f19ec07bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19ec07c390 con 0x7f19ec079830 2024-09-17T05:46:39.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f19f812f0f0 con 0x7f1a100af360 2024-09-17T05:46:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a0f400640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7f19ec079830 0x7f19ec07bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a0ea00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19ec073200 0x7f19ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a0f400640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7f19ec079830 0x7f19ec07bcc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a0ea00640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19ec073200 0x7f19ec075710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007fd0 tx=0x7f1a00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.023+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== osd.1 v2:172.21.15.44:6816/298260573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19ec07c390 con 0x7f19ec079830 2024-09-17T05:46:39.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 --> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1a1009c5b0 con 0x7f19ec079830 2024-09-17T05:46:39.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a06a00640 1 -- 172.21.15.44:0/1380272170 <== osd.1 v2:172.21.15.44:6816/298260573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1a1009c5b0 con 0x7f19ec079830 2024-09-17T05:46:39.039 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:39.040 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:39.040 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:39.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7f19ec079830 msgr2=0x7f19ec07bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:6816/298260573,v1:172.21.15.44:6817/298260573] conn(0x7f19ec079830 0x7f19ec07bcc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19ec073200 msgr2=0x7f19ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f19ec073200 0x7f19ec075710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1a00007fd0 tx=0x7f1a00009040 comp rx=0 tx=0).stop 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a100af360 msgr2=0x7f1a10157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 --2- 172.21.15.44:0/1380272170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a100af360 0x7f1a10157b30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f19f801aeb0 tx=0x7f19f80a66c0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a0f400640 1 -- 172.21.15.44:0/1380272170 reap_dead start 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 shutdown_connections 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 >> 172.21.15.44:0/1380272170 conn(0x7f1a100d0170 msgr2=0x7f1a100b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 shutdown_connections 2024-09-17T05:46:39.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.039+0000 7f1a15600640 1 -- 172.21.15.44:0/1380272170 wait complete. 2024-09-17T05:46:39.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T05:46:39.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 -- 172.21.15.44:0/2261516227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40cc960 msgr2=0x7f20f415ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 --2- 172.21.15.44:0/2261516227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40cc960 0x7f20f415ee70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f20e40098f0 tx=0x7f20e401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 -- 172.21.15.44:0/2261516227 shutdown_connections 2024-09-17T05:46:39.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 --2- 172.21.15.44:0/2261516227 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20f40b3140 0x7f20f40b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 --2- 172.21.15.44:0/2261516227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40cc960 0x7f20f415ee70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 -- 172.21.15.44:0/2261516227 >> 172.21.15.44:0/2261516227 conn(0x7f20f406d450 msgr2=0x7f20f40d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 -- 172.21.15.44:0/2261516227 shutdown_connections 2024-09-17T05:46:39.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 -- 172.21.15.44:0/2261516227 wait complete. 2024-09-17T05:46:39.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 Processor -- start 2024-09-17T05:46:39.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.219+0000 7f20f9800640 1 -- start start 2024-09-17T05:46:39.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20f406f890 0x7f20f415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40b3140 0x7f20f415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20f40cc960 0x7f20f415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4169150 con 0x7f20f406f890 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4168fd0 con 0x7f20f40b3140 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f20f41692d0 con 0x7f20f40cc960 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20f406f890 0x7f20f415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20f406f890 0x7f20f415a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36692/0 (socket says 172.21.15.44:36692) 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 -- 172.21.15.44:0/3855973717 learned_addr learned my addr 172.21.15.44:0/3855973717 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20ebe00640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40b3140 0x7f20f415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f3400640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20f40cc960 0x7f20f415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 -- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20f40cc960 msgr2=0x7f20f415c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20f40cc960 0x7f20f415c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 -- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40b3140 msgr2=0x7f20f415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40b3140 0x7f20f415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 -- 172.21.15.44:0/3855973717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f409bb00 con 0x7f20f406f890 2024-09-17T05:46:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f2a00640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20f406f890 0x7f20f415a520 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f20e401af90 tx=0x7f20e4005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20eaa00640 1 -- 172.21.15.44:0/3855973717 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e40bb070 con 0x7f20f406f890 2024-09-17T05:46:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20eaa00640 1 -- 172.21.15.44:0/3855973717 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20e4004130 con 0x7f20f406f890 2024-09-17T05:46:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f40b21e0 con 0x7f20f406f890 2024-09-17T05:46:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20eaa00640 1 -- 172.21.15.44:0/3855973717 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e40b2040 con 0x7f20f406f890 2024-09-17T05:46:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f40b27a0 con 0x7f20f406f890 2024-09-17T05:46:39.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.223+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f40b1f40 con 0x7f20f406f890 2024-09-17T05:46:39.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.227+0000 7f20eaa00640 1 -- 172.21.15.44:0/3855973717 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f20e4003600 con 0x7f20f406f890 2024-09-17T05:46:39.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.227+0000 7f20eaa00640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20d0073200 0x7f20d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.227+0000 7f20eaa00640 1 -- 172.21.15.44:0/3855973717 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f20e412daf0 con 0x7f20f406f890 2024-09-17T05:46:39.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.227+0000 7f20ebe00640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20d0073200 0x7f20d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.227+0000 7f20ebe00640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20d0073200 0x7f20d0075710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f20f40c7270 tx=0x7f20dc0091e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.231+0000 7f20eaa00640 1 -- 172.21.15.44:0/3855973717 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f20e40164d0 con 0x7f20f406f890 2024-09-17T05:46:39.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.407+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f20f40b3550 con 0x7f20d0073200 2024-09-17T05:46:39.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.407+0000 7f20eaa00640 1 -- 172.21.15.44:0/3855973717 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f20f40b3550 con 0x7f20d0073200 2024-09-17T05:46:39.408 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T05:46:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20d0073200 msgr2=0x7f20d0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20d0073200 0x7f20d0075710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f20f40c7270 tx=0x7f20dc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20f406f890 msgr2=0x7f20f415a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20f406f890 0x7f20f415a520 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f20e401af90 tx=0x7f20e4005760 comp rx=0 tx=0).stop 2024-09-17T05:46:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 shutdown_connections 2024-09-17T05:46:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f20f40cc960 0x7f20f415c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f20d0073200 0x7f20d0075710 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f40b3140 0x7f20f415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 --2- 172.21.15.44:0/3855973717 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20f406f890 0x7f20f415a520 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 >> 172.21.15.44:0/3855973717 conn(0x7f20f406d450 msgr2=0x7f20f406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 shutdown_connections 2024-09-17T05:46:39.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.411+0000 7f20f9800640 1 -- 172.21.15.44:0/3855973717 wait complete. 2024-09-17T05:46:39.431 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T05:46:39.431 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 -- 172.21.15.44:0/4217283081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b7b50 msgr2=0x7fbb540d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 --2- 172.21.15.44:0/4217283081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b7b50 0x7fbb540d25d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbb48009840 tx=0x7fbb4801c740 comp rx=0 tx=0).stop 2024-09-17T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 -- 172.21.15.44:0/4217283081 shutdown_connections 2024-09-17T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 --2- 172.21.15.44:0/4217283081 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb540b3dd0 0x7fbb540b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 --2- 172.21.15.44:0/4217283081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b7b50 0x7fbb540d25d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 -- 172.21.15.44:0/4217283081 >> 172.21.15.44:0/4217283081 conn(0x7fbb5406d220 msgr2=0x7fbb5406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 -- 172.21.15.44:0/4217283081 shutdown_connections 2024-09-17T05:46:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 -- 172.21.15.44:0/4217283081 wait complete. 2024-09-17T05:46:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 Processor -- start 2024-09-17T05:46:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.595+0000 7fbb5c600640 1 -- start start 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b3dd0 0x7fbb54158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb540b51a0 0x7fbb540c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb540b7b50 0x7fbb541662d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54169c40 con 0x7fbb540b7b50 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54169ac0 con 0x7fbb540b3dd0 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fbb54169dc0 con 0x7fbb540b51a0 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb540b7b50 0x7fbb541662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb540b7b50 0x7fbb541662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36702/0 (socket says 172.21.15.44:36702) 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 -- 172.21.15.44:0/402252859 learned_addr learned my addr 172.21.15.44:0/402252859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb59c00640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b3dd0 0x7fbb54158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb59200640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb540b51a0 0x7fbb540c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 -- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb540b51a0 msgr2=0x7fbb540c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb540b51a0 0x7fbb540c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 -- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b3dd0 msgr2=0x7fbb54158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b3dd0 0x7fbb54158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 -- 172.21.15.44:0/402252859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb541f8b30 con 0x7fbb540b7b50 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb59c00640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb540b3dd0 0x7fbb54158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb59200640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fbb540b51a0 0x7fbb540c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5a600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb540b7b50 0x7fbb541662d0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00cbc0 tx=0x7fbb4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c016020 con 0x7fbb540b7b50 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb4c00ab60 con 0x7fbb540b7b50 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c012420 con 0x7fbb540b7b50 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb541f8e10 con 0x7fbb540b7b50 2024-09-17T05:46:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb541f93d0 con 0x7fbb540b7b50 2024-09-17T05:46:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.599+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb540b41e0 con 0x7fbb540b7b50 2024-09-17T05:46:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fbb4c019020 con 0x7fbb540b7b50 2024-09-17T05:46:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb51600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb34073200 0x7fbb34075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fbb4c094c10 con 0x7fbb540b7b50 2024-09-17T05:46:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb51600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7fbb34079830 0x7fbb3407bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb3407c390 con 0x7fbb34079830 2024-09-17T05:46:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fbb4c094fc0 con 0x7fbb540b7b50 2024-09-17T05:46:39.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb59200640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7fbb34079830 0x7fbb3407bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb59c00640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb34073200 0x7fbb34075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb59200640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7fbb34079830 0x7fbb3407bcc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb59c00640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb34073200 0x7fbb34075710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb480af000 tx=0x7fbb4801af80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.603+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== osd.2 v2:172.21.15.44:6808/1191521276 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb3407c390 con 0x7fbb34079830 2024-09-17T05:46:39.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 --> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb541f8870 con 0x7fbb34079830 2024-09-17T05:46:39.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb51600640 1 -- 172.21.15.44:0/402252859 <== osd.2 v2:172.21.15.44:6808/1191521276 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb541f8870 con 0x7fbb34079830 2024-09-17T05:46:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:39.620 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:39.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7fbb34079830 msgr2=0x7fbb3407bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:6808/1191521276,v1:172.21.15.44:6809/1191521276] conn(0x7fbb34079830 0x7fbb3407bcc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb34073200 msgr2=0x7fbb34075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fbb34073200 0x7fbb34075710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbb480af000 tx=0x7fbb4801af80 comp rx=0 tx=0).stop 2024-09-17T05:46:39.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb540b7b50 msgr2=0x7fbb541662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 --2- 172.21.15.44:0/402252859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbb540b7b50 0x7fbb541662d0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00cbc0 tx=0x7fbb4c00ccb0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5a600640 1 -- 172.21.15.44:0/402252859 reap_dead start 2024-09-17T05:46:39.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 shutdown_connections 2024-09-17T05:46:39.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 >> 172.21.15.44:0/402252859 conn(0x7fbb5406d220 msgr2=0x7fbb5406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 shutdown_connections 2024-09-17T05:46:39.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.619+0000 7fbb5c600640 1 -- 172.21.15.44:0/402252859 wait complete. 2024-09-17T05:46:39.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T05:46:39.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.795+0000 7f7307a00640 1 -- 172.21.15.44:0/2507662023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730006d500 msgr2=0x7f73000704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.795+0000 7f7307a00640 1 --2- 172.21.15.44:0/2507662023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730006d500 0x7f73000704c0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009840 tx=0x7f72ec01c820 comp rx=0 tx=0).stop 2024-09-17T05:46:39.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- 172.21.15.44:0/2507662023 shutdown_connections 2024-09-17T05:46:39.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 --2- 172.21.15.44:0/2507662023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730006d500 0x7f73000704c0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- 172.21.15.44:0/2507662023 >> 172.21.15.44:0/2507662023 conn(0x7f73000cdd10 msgr2=0x7f73000ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- 172.21.15.44:0/2507662023 shutdown_connections 2024-09-17T05:46:39.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- 172.21.15.44:0/2507662023 wait complete. 2024-09-17T05:46:39.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 Processor -- start 2024-09-17T05:46:39.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- start start 2024-09-17T05:46:39.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73000b04a0 0x7f73000d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73000b08b0 0x7f7300154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7300154fd0 0x7f73000c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f730016dda0 con 0x7f7300154fd0 2024-09-17T05:46:39.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f730016dc20 con 0x7f73000b08b0 2024-09-17T05:46:39.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.799+0000 7f7307a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f730016df20 con 0x7f73000b04a0 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7300154fd0 0x7f73000c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7300154fd0 0x7f73000c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36726/0 (socket says 172.21.15.44:36726) 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 -- 172.21.15.44:0/2720194587 learned_addr learned my addr 172.21.15.44:0/2720194587 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305000640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73000b04a0 0x7f73000d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f72ffe00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73000b08b0 0x7f7300154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 -- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73000b04a0 msgr2=0x7f73000d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73000b04a0 0x7f73000d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 -- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73000b08b0 msgr2=0x7f7300154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73000b08b0 0x7f7300154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 -- 172.21.15.44:0/2720194587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73000d0ef0 con 0x7f7300154fd0 2024-09-17T05:46:39.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7305a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7300154fd0 0x7f73000c5c70 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c760 tx=0x7f72f800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f72fcc00640 1 -- 172.21.15.44:0/2720194587 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003db0 con 0x7f7300154fd0 2024-09-17T05:46:39.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f72fcc00640 1 -- 172.21.15.44:0/2720194587 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72f800ce10 con 0x7f7300154fd0 2024-09-17T05:46:39.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f72fcc00640 1 -- 172.21.15.44:0/2720194587 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80052d0 con 0x7f7300154fd0 2024-09-17T05:46:39.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73000d11d0 con 0x7f7300154fd0 2024-09-17T05:46:39.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73000d1790 con 0x7f7300154fd0 2024-09-17T05:46:39.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73000d0c60 con 0x7f7300154fd0 2024-09-17T05:46:39.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.803+0000 7f72fcc00640 1 -- 172.21.15.44:0/2720194587 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f72f8005470 con 0x7f7300154fd0 2024-09-17T05:46:39.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.807+0000 7f72fcc00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72e0073200 0x7f72e0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:39.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.807+0000 7f72fcc00640 1 -- 172.21.15.44:0/2720194587 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f72f8093dc0 con 0x7f7300154fd0 2024-09-17T05:46:39.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.807+0000 7f7305000640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72e0073200 0x7f72e0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:39.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.807+0000 7f7305000640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72e0073200 0x7f72e0075710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000fc0 tx=0x7f72f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:39.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.811+0000 7f72fcc00640 1 -- 172.21.15.44:0/2720194587 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f72f805e840 con 0x7f7300154fd0 2024-09-17T05:46:39.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.983+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f73000704c0 con 0x7f72e0073200 2024-09-17T05:46:39.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.983+0000 7f72fcc00640 1 -- 172.21.15.44:0/2720194587 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f73000704c0 con 0x7f72e0073200 2024-09-17T05:46:39.986 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T05:46:39.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72e0073200 msgr2=0x7f72e0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72e0073200 0x7f72e0075710 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f72f4000fc0 tx=0x7f72f4009040 comp rx=0 tx=0).stop 2024-09-17T05:46:39.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7300154fd0 msgr2=0x7f73000c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:39.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7300154fd0 0x7f73000c5c70 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c760 tx=0x7f72f800cc20 comp rx=0 tx=0).stop 2024-09-17T05:46:39.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 shutdown_connections 2024-09-17T05:46:39.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7300154fd0 0x7f73000c5c70 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f72e0073200 0x7f72e0075710 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73000b08b0 0x7f7300154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 --2- 172.21.15.44:0/2720194587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f73000b04a0 0x7f73000d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:39.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 >> 172.21.15.44:0/2720194587 conn(0x7f73000cdd10 msgr2=0x7f730015cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:39.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 shutdown_connections 2024-09-17T05:46:39.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:39.987+0000 7f7307a00640 1 -- 172.21.15.44:0/2720194587 wait complete. 2024-09-17T05:46:40.008 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T05:46:40.008 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 -- 172.21.15.44:0/2166385834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 msgr2=0x7f8f4c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 --2- 172.21.15.44:0/2166385834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 0x7f8f4c074aa0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0b3110 tx=0x7f8f3401c800 comp rx=0 tx=0).stop 2024-09-17T05:46:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 -- 172.21.15.44:0/2166385834 shutdown_connections 2024-09-17T05:46:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 --2- 172.21.15.44:0/2166385834 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 0x7f8f4c074aa0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 --2- 172.21.15.44:0/2166385834 >> v2:172.21.15.86:3300/0 conn(0x7f8f4c0b2b30 0x7f8f4c074560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 -- 172.21.15.44:0/2166385834 >> 172.21.15.44:0/2166385834 conn(0x7f8f4c0b2010 msgr2=0x7f8f4c0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 -- 172.21.15.44:0/2166385834 shutdown_connections 2024-09-17T05:46:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 -- 172.21.15.44:0/2166385834 wait complete. 2024-09-17T05:46:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 Processor -- start 2024-09-17T05:46:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.171+0000 7f8f51e00640 1 -- start start 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 0x7f8f4c1f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c0b2b30 0x7f8f4c15d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8f4c160300 0x7f8f4c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c16a740 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c16a5c0 con 0x7f8f4c0b2b30 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4c16a8c0 con 0x7f8f4c160300 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 0x7f8f4c1f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 0x7f8f4c1f9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36746/0 (socket says 172.21.15.44:36746) 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 -- 172.21.15.44:0/2056279287 learned_addr learned my addr 172.21.15.44:0/2056279287 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f42000640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c0b2b30 0x7f8f4c15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4b400640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8f4c160300 0x7f8f4c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 -- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8f4c160300 msgr2=0x7f8f4c1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f8f4c160300 0x7f8f4c1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 -- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c0b2b30 msgr2=0x7f8f4c15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c0b2b30 0x7f8f4c15d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 -- 172.21.15.44:0/2056279287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c15cf40 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f42000640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c0b2b30 0x7f8f4c15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f4aa00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 0x7f8f4c1f9020 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00dac0 tx=0x7f8f3c00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c017070 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f3c010460 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c09de90 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0108b0 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c15bee0 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.175+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f4c15c2c0 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8f3c01a070 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f43e00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8f28073230 0x7f8f28075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f8f3c094bb0 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f43e00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f8f28079860 0x7f8f2807bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f2807c3c0 con 0x7f8f28079860 2024-09-17T05:46:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7f8f3c094f60 con 0x7f8f4c0b1b00 2024-09-17T05:46:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f4b400640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f8f28079860 0x7f8f2807bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f42000640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8f28073230 0x7f8f28075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f4b400640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f8f28079860 0x7f8f2807bcf0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.179+0000 7f8f42000640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8f28073230 0x7f8f28075740 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f340af000 tx=0x7f8f3401b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.183+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== osd.3 v2:172.21.15.44:6824/2051542036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f2807c3c0 con 0x7f8f28079860 2024-09-17T05:46:40.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 --> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f4c160710 con 0x7f8f28079860 2024-09-17T05:46:40.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f43e00640 1 -- 172.21.15.44:0/2056279287 <== osd.3 v2:172.21.15.44:6824/2051542036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f4c160710 con 0x7f8f28079860 2024-09-17T05:46:40.196 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:40.197 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f8f28079860 msgr2=0x7f8f2807bcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:6824/2051542036,v1:172.21.15.44:6825/2051542036] conn(0x7f8f28079860 0x7f8f2807bcf0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8f28073230 msgr2=0x7f8f28075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f8f28073230 0x7f8f28075740 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f340af000 tx=0x7f8f3401b040 comp rx=0 tx=0).stop 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 msgr2=0x7f8f4c1f9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 --2- 172.21.15.44:0/2056279287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8f4c0b1b00 0x7f8f4c1f9020 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00dac0 tx=0x7f8f3c00df80 comp rx=0 tx=0).stop 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f4b400640 1 -- 172.21.15.44:0/2056279287 reap_dead start 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 shutdown_connections 2024-09-17T05:46:40.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 >> 172.21.15.44:0/2056279287 conn(0x7f8f4c0b2010 msgr2=0x7f8f4c1580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 shutdown_connections 2024-09-17T05:46:40.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.195+0000 7f8f51e00640 1 -- 172.21.15.44:0/2056279287 wait complete. 2024-09-17T05:46:40.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T05:46:40.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 -- 172.21.15.44:0/3165757363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd4073f30 msgr2=0x7f4cd4074340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 --2- 172.21.15.44:0/3165757363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd4073f30 0x7f4cd4074340 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009c80 tx=0x7f4ccc01ccc0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 -- 172.21.15.44:0/3165757363 shutdown_connections 2024-09-17T05:46:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 --2- 172.21.15.44:0/3165757363 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd4073f30 0x7f4cd4074340 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 --2- 172.21.15.44:0/3165757363 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd40b0570 0x7f4cd415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 -- 172.21.15.44:0/3165757363 >> 172.21.15.44:0/3165757363 conn(0x7f4cd40cdd10 msgr2=0x7f4cd40ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 -- 172.21.15.44:0/3165757363 shutdown_connections 2024-09-17T05:46:40.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.371+0000 7f4cd9800640 1 -- 172.21.15.44:0/3165757363 wait complete. 2024-09-17T05:46:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 Processor -- start 2024-09-17T05:46:40.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 -- start start 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd406cdf0 0x7f4cd40c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd4073f30 0x7f4cd41fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd40b0570 0x7f4cd41fc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4169a60 con 0x7f4cd406cdf0 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd41698e0 con 0x7f4cd40b0570 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd9800640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd4169be0 con 0x7f4cd4073f30 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd406cdf0 0x7f4cd40c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd406cdf0 0x7f4cd40c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36758/0 (socket says 172.21.15.44:36758) 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.375+0000 7f4cd2a00640 1 -- 172.21.15.44:0/1513676488 learned_addr learned my addr 172.21.15.44:0/1513676488 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd2a00640 1 -- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd4073f30 msgr2=0x7f4cd41fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd2a00640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd4073f30 0x7f4cd41fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd2a00640 1 -- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd40b0570 msgr2=0x7f4cd41fc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd2a00640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd40b0570 0x7f4cd41fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd2a00640 1 -- 172.21.15.44:0/1513676488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd40b2ee0 con 0x7f4cd406cdf0 2024-09-17T05:46:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd2a00640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd406cdf0 0x7f4cd40c7390 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400e9f0 tx=0x7f4cc400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4ccaa00640 1 -- 172.21.15.44:0/1513676488 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc400cc60 con 0x7f4cd406cdf0 2024-09-17T05:46:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4ccaa00640 1 -- 172.21.15.44:0/1513676488 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cc4010430 con 0x7f4cd406cdf0 2024-09-17T05:46:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4ccaa00640 1 -- 172.21.15.44:0/1513676488 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4010880 con 0x7f4cd406cdf0 2024-09-17T05:46:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd40b31c0 con 0x7f4cd406cdf0 2024-09-17T05:46:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd40b3780 con 0x7f4cd406cdf0 2024-09-17T05:46:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd40b3b60 con 0x7f4cd406cdf0 2024-09-17T05:46:40.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.379+0000 7f4ccaa00640 1 -- 172.21.15.44:0/1513676488 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4cc4010a20 con 0x7f4cd406cdf0 2024-09-17T05:46:40.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.383+0000 7f4ccaa00640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cb0073230 0x7f4cb0075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.383+0000 7f4ccaa00640 1 -- 172.21.15.44:0/1513676488 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f4cc4094ca0 con 0x7f4cd406cdf0 2024-09-17T05:46:40.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.383+0000 7f4ccbe00640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cb0073230 0x7f4cb0075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.383+0000 7f4ccbe00640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cb0073230 0x7f4cb0075740 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc007fd0 tx=0x7f4cbc007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.387+0000 7f4ccaa00640 1 -- 172.21.15.44:0/1513676488 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f4cd40b3b60 con 0x7f4cd406cdf0 2024-09-17T05:46:40.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.559+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4cd4074340 con 0x7f4cb0073230 2024-09-17T05:46:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.559+0000 7f4ccaa00640 1 -- 172.21.15.44:0/1513676488 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4cd4074340 con 0x7f4cb0073230 2024-09-17T05:46:40.561 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T05:46:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cb0073230 msgr2=0x7f4cb0075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cb0073230 0x7f4cb0075740 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc007fd0 tx=0x7f4cbc007960 comp rx=0 tx=0).stop 2024-09-17T05:46:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd406cdf0 msgr2=0x7f4cd40c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd406cdf0 0x7f4cd40c7390 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400e9f0 tx=0x7f4cc400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 shutdown_connections 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f4cb0073230 0x7f4cb0075740 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cd40b0570 0x7f4cd41fc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f4cd4073f30 0x7f4cd41fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 --2- 172.21.15.44:0/1513676488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4cd406cdf0 0x7f4cd40c7390 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 >> 172.21.15.44:0/1513676488 conn(0x7f4cd40cdd10 msgr2=0x7f4cd40aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 shutdown_connections 2024-09-17T05:46:40.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.563+0000 7f4cd9800640 1 -- 172.21.15.44:0/1513676488 wait complete. 2024-09-17T05:46:40.583 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T05:46:40.583 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 -- 172.21.15.44:0/3261716409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c06d500 msgr2=0x7fa32c15c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 --2- 172.21.15.44:0/3261716409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c06d500 0x7fa32c15c8c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fa314009900 tx=0x7fa31401c850 comp rx=0 tx=0).stop 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 -- 172.21.15.44:0/3261716409 shutdown_connections 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 --2- 172.21.15.44:0/3261716409 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa32c160d50 0x7fa32c0707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 --2- 172.21.15.44:0/3261716409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c06d500 0x7fa32c15c8c0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 -- 172.21.15.44:0/3261716409 >> 172.21.15.44:0/3261716409 conn(0x7fa32c0d0c50 msgr2=0x7fa32c0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 -- 172.21.15.44:0/3261716409 shutdown_connections 2024-09-17T05:46:40.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.743+0000 7fa332000640 1 -- 172.21.15.44:0/3261716409 wait complete. 2024-09-17T05:46:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 Processor -- start 2024-09-17T05:46:40.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 -- start start 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0b38d0 0x7fa32c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa32c160d50 0x7fa32c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32c0b22c0 0x7fa32c0b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c169d90 con 0x7fa32c0b38d0 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c169c10 con 0x7fa32c0b22c0 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa332000640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c169f10 con 0x7fa32c160d50 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa32b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0b38d0 0x7fa32c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa32b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0b38d0 0x7fa32c0c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36778/0 (socket says 172.21.15.44:36778) 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa32b400640 1 -- 172.21.15.44:0/1235272440 learned_addr learned my addr 172.21.15.44:0/1235272440 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa323e00640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa32c160d50 0x7fa32c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.747+0000 7fa32be00640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32c0b22c0 0x7fa32c0b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa32b400640 1 -- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa32c160d50 msgr2=0x7fa32c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa32b400640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fa32c160d50 0x7fa32c153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa32b400640 1 -- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32c0b22c0 msgr2=0x7fa32c0b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa32b400640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa32c0b22c0 0x7fa32c0b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa32b400640 1 -- 172.21.15.44:0/1235272440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c0b2c10 con 0x7fa32c0b38d0 2024-09-17T05:46:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa32b400640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0b38d0 0x7fa32c0c4ea0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c3c0 tx=0x7fa31c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c017070 con 0x7fa32c0b38d0 2024-09-17T05:46:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa31c0053c0 con 0x7fa32c0b38d0 2024-09-17T05:46:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c003860 con 0x7fa32c0b38d0 2024-09-17T05:46:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c154af0 con 0x7fa32c0b38d0 2024-09-17T05:46:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c15cd20 con 0x7fa32c0b38d0 2024-09-17T05:46:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa32c155480 con 0x7fa32c0b38d0 2024-09-17T05:46:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.751+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa31c01a070 con 0x7fa32c0b38d0 2024-09-17T05:46:40.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323400640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa308073230 0x7fa308075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fa31c093850 con 0x7fa32c0b38d0 2024-09-17T05:46:40.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323400640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fa308079860 0x7fa30807bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa31c015e70 con 0x7fa308079860 2024-09-17T05:46:40.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fa31c093c00 con 0x7fa32c0b38d0 2024-09-17T05:46:40.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323e00640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa308073230 0x7fa308075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa32be00640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fa308079860 0x7fa30807bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323e00640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa308073230 0x7fa308075740 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa3140af000 tx=0x7fa31401b090 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa32be00640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fa308079860 0x7fa30807bcf0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.755+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== osd.4 v2:172.21.15.86:6810/2781128627 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa31c015e70 con 0x7fa308079860 2024-09-17T05:46:40.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.767+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 --> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa32c0cb520 con 0x7fa308079860 2024-09-17T05:46:40.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa323400640 1 -- 172.21.15.44:0/1235272440 <== osd.4 v2:172.21.15.86:6810/2781128627 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa32c0cb520 con 0x7fa308079860 2024-09-17T05:46:40.771 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:40.771 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:40.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fa308079860 msgr2=0x7fa30807bcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6810/2781128627,v1:172.21.15.86:6811/2781128627] conn(0x7fa308079860 0x7fa30807bcf0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa308073230 msgr2=0x7fa308075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fa308073230 0x7fa308075740 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa3140af000 tx=0x7fa31401b090 comp rx=0 tx=0).stop 2024-09-17T05:46:40.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0b38d0 msgr2=0x7fa32c0c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 --2- 172.21.15.44:0/1235272440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa32c0b38d0 0x7fa32c0c4ea0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c3c0 tx=0x7fa31c00c880 comp rx=0 tx=0).stop 2024-09-17T05:46:40.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa32be00640 1 -- 172.21.15.44:0/1235272440 reap_dead start 2024-09-17T05:46:40.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 shutdown_connections 2024-09-17T05:46:40.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 >> 172.21.15.44:0/1235272440 conn(0x7fa32c0d0c50 msgr2=0x7fa32c0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 shutdown_connections 2024-09-17T05:46:40.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.771+0000 7fa332000640 1 -- 172.21.15.44:0/1235272440 wait complete. 2024-09-17T05:46:40.790 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T05:46:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.947+0000 7f24ecc00640 1 -- 172.21.15.44:0/4088351906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e809df30 msgr2=0x7f24e80b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.947+0000 7f24ecc00640 1 --2- 172.21.15.44:0/4088351906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e809df30 0x7f24e80b33d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f24d8005fd0 tx=0x7f24d801c820 comp rx=0 tx=0).stop 2024-09-17T05:46:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.947+0000 7f24ecc00640 1 -- 172.21.15.44:0/4088351906 shutdown_connections 2024-09-17T05:46:40.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.947+0000 7f24ecc00640 1 --2- 172.21.15.44:0/4088351906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e809df30 0x7f24e80b33d0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.947+0000 7f24ecc00640 1 -- 172.21.15.44:0/4088351906 >> 172.21.15.44:0/4088351906 conn(0x7f24e806d450 msgr2=0x7f24e80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:40.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.947+0000 7f24ecc00640 1 -- 172.21.15.44:0/4088351906 shutdown_connections 2024-09-17T05:46:40.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.947+0000 7f24ecc00640 1 -- 172.21.15.44:0/4088351906 wait complete. 2024-09-17T05:46:40.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 Processor -- start 2024-09-17T05:46:40.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 -- start start 2024-09-17T05:46:40.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24e809df30 0x7f24e80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24e80b3910 0x7f24e8158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e80ce900 0x7f24e81f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f24e816a4e0 con 0x7f24e80ce900 2024-09-17T05:46:40.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f24e816a360 con 0x7f24e80b3910 2024-09-17T05:46:40.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f24e816a660 con 0x7f24e809df30 2024-09-17T05:46:40.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e80ce900 0x7f24e81f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e80ce900 0x7f24e81f9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36806/0 (socket says 172.21.15.44:36806) 2024-09-17T05:46:40.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 -- 172.21.15.44:0/2341021422 learned_addr learned my addr 172.21.15.44:0/2341021422 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e5e00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24e809df30 0x7f24e80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24dfe00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24e80b3910 0x7f24e8158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 -- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24e809df30 msgr2=0x7f24e80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24e809df30 0x7f24e80c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 -- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24e80b3910 msgr2=0x7f24e8158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24e80b3910 0x7f24e8158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 -- 172.21.15.44:0/2341021422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e81f9530 con 0x7f24e80ce900 2024-09-17T05:46:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24e6800640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e80ce900 0x7f24e81f9d00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f24e000cb10 tx=0x7f24e000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24de000640 1 -- 172.21.15.44:0/2341021422 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0016020 con 0x7f24e80ce900 2024-09-17T05:46:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24de000640 1 -- 172.21.15.44:0/2341021422 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f24e000ce50 con 0x7f24e80ce900 2024-09-17T05:46:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24de000640 1 -- 172.21.15.44:0/2341021422 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e000ada0 con 0x7f24e80ce900 2024-09-17T05:46:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e81fd330 con 0x7f24e80ce900 2024-09-17T05:46:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e81fd8f0 con 0x7f24e80ce900 2024-09-17T05:46:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.951+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e81fd0a0 con 0x7f24e80ce900 2024-09-17T05:46:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.955+0000 7f24de000640 1 -- 172.21.15.44:0/2341021422 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f24e0019020 con 0x7f24e80ce900 2024-09-17T05:46:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.955+0000 7f24de000640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24c4073200 0x7f24c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:40.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.955+0000 7f24de000640 1 -- 172.21.15.44:0/2341021422 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f24e0094110 con 0x7f24e80ce900 2024-09-17T05:46:40.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.955+0000 7f24e5e00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24c4073200 0x7f24c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:40.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.955+0000 7f24e5e00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24c4073200 0x7f24c4075710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f24d80ae000 tx=0x7f24d801b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:40.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:40.959+0000 7f24de000640 1 -- 172.21.15.44:0/2341021422 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f24e0020030 con 0x7f24e80ce900 2024-09-17T05:46:41.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f24e809afb0 con 0x7f24c4073200 2024-09-17T05:46:41.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24de000640 1 -- 172.21.15.44:0/2341021422 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f24e809afb0 con 0x7f24c4073200 2024-09-17T05:46:41.135 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24c4073200 msgr2=0x7f24c4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24c4073200 0x7f24c4075710 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f24d80ae000 tx=0x7f24d801b060 comp rx=0 tx=0).stop 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e80ce900 msgr2=0x7f24e81f9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e80ce900 0x7f24e81f9d00 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f24e000cb10 tx=0x7f24e000cc00 comp rx=0 tx=0).stop 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 shutdown_connections 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24e80ce900 0x7f24e81f9d00 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f24c4073200 0x7f24c4075710 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24e80b3910 0x7f24e8158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 --2- 172.21.15.44:0/2341021422 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f24e809df30 0x7f24e80c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 >> 172.21.15.44:0/2341021422 conn(0x7f24e806d450 msgr2=0x7f24e8073e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:41.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 shutdown_connections 2024-09-17T05:46:41.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.135+0000 7f24ecc00640 1 -- 172.21.15.44:0/2341021422 wait complete. 2024-09-17T05:46:41.158 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T05:46:41.158 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:41.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 -- 172.21.15.44:0/2985521768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b00b38d0 msgr2=0x7fd6b015c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 --2- 172.21.15.44:0/2985521768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b00b38d0 0x7fd6b015c8c0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009840 tx=0x7fd6a001c790 comp rx=0 tx=0).stop 2024-09-17T05:46:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 -- 172.21.15.44:0/2985521768 shutdown_connections 2024-09-17T05:46:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 --2- 172.21.15.44:0/2985521768 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b006d500 0x7fd6b00707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 --2- 172.21.15.44:0/2985521768 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b00b38d0 0x7fd6b015c8c0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 -- 172.21.15.44:0/2985521768 >> 172.21.15.44:0/2985521768 conn(0x7fd6b00d0c50 msgr2=0x7fd6b00d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 -- 172.21.15.44:0/2985521768 shutdown_connections 2024-09-17T05:46:41.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.319+0000 7fd6b6600640 1 -- 172.21.15.44:0/2985521768 wait complete. 2024-09-17T05:46:41.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 Processor -- start 2024-09-17T05:46:41.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 -- start start 2024-09-17T05:46:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b00b38d0 0x7fd6b0155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b0160d50 0x7fd6b01fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6b0155ff0 0x7fd6b01fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b0169d90 con 0x7fd6b0160d50 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b0169c10 con 0x7fd6b0155ff0 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b0169f10 con 0x7fd6b00b38d0 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b0160d50 0x7fd6b01fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b0160d50 0x7fd6b01fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36818/0 (socket says 172.21.15.44:36818) 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 -- 172.21.15.44:0/3673948507 learned_addr learned my addr 172.21.15.44:0/3673948507 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6afe00640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6b0155ff0 0x7fd6b01fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6af400640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b00b38d0 0x7fd6b0155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 -- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b00b38d0 msgr2=0x7fd6b0155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b00b38d0 0x7fd6b0155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 -- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6b0155ff0 msgr2=0x7fd6b01fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6b0155ff0 0x7fd6b01fbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 -- 172.21.15.44:0/3673948507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b01fc600 con 0x7fd6b0160d50 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7e00640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b0160d50 0x7fd6b01fb930 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fd698001ec0 tx=0x7fd69800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698017070 con 0x7fd6b0160d50 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd698003600 con 0x7fd6b0160d50 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.323+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b00c84e0 con 0x7fd6b0160d50 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698003a50 con 0x7fd6b0160d50 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b0165900 con 0x7fd6b0160d50 2024-09-17T05:46:41.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6b00b60d0 con 0x7fd6b0160d50 2024-09-17T05:46:41.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd69801a070 con 0x7fd6b0160d50 2024-09-17T05:46:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6a7400640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd68c073200 0x7fd68c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fd698093b50 con 0x7fd6b0160d50 2024-09-17T05:46:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6a7400640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7fd68c079830 0x7fd68c07bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd68c07c390 con 0x7fd68c079830 2024-09-17T05:46:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fd698093f00 con 0x7fd6b0160d50 2024-09-17T05:46:41.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6af400640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd68c073200 0x7fd68c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.327+0000 7fd6afe00640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7fd68c079830 0x7fd68c07bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.331+0000 7fd6af400640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd68c073200 0x7fd68c075710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00af000 tx=0x7fd6a001afd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:41.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.331+0000 7fd6afe00640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7fd68c079830 0x7fd68c07bcc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:41.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.331+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== osd.5 v2:172.21.15.86:6822/2837964024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd68c07c390 con 0x7fd68c079830 2024-09-17T05:46:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.343+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 --> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6b01fc3b0 con 0x7fd68c079830 2024-09-17T05:46:41.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.343+0000 7fd6a7400640 1 -- 172.21.15.44:0/3673948507 <== osd.5 v2:172.21.15.86:6822/2837964024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6b01fc3b0 con 0x7fd68c079830 2024-09-17T05:46:41.346 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:41.346 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.343+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7fd68c079830 msgr2=0x7fd68c07bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.343+0000 7fd6b6600640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6822/2837964024,v1:172.21.15.86:6824/2837964024] conn(0x7fd68c079830 0x7fd68c07bcc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd68c073200 msgr2=0x7fd68c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd68c073200 0x7fd68c075710 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00af000 tx=0x7fd6a001afd0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b0160d50 msgr2=0x7fd6b01fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 --2- 172.21.15.44:0/3673948507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b0160d50 0x7fd6b01fb930 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fd698001ec0 tx=0x7fd69800c890 comp rx=0 tx=0).stop 2024-09-17T05:46:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6afe00640 1 -- 172.21.15.44:0/3673948507 reap_dead start 2024-09-17T05:46:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 shutdown_connections 2024-09-17T05:46:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 >> 172.21.15.44:0/3673948507 conn(0x7fd6b00d0c50 msgr2=0x7fd6b0158160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 shutdown_connections 2024-09-17T05:46:41.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.347+0000 7fd6b6600640 1 -- 172.21.15.44:0/3673948507 wait complete. 2024-09-17T05:46:41.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T05:46:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 -- 172.21.15.44:0/1658267105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8073da0 msgr2=0x7f92b80c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 --2- 172.21.15.44:0/1658267105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8073da0 0x7f92b80c4ed0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009900 tx=0x7f92a001c820 comp rx=0 tx=0).stop 2024-09-17T05:46:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 -- 172.21.15.44:0/1658267105 shutdown_connections 2024-09-17T05:46:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 --2- 172.21.15.44:0/1658267105 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b80ccea0 0x7f92b80c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 --2- 172.21.15.44:0/1658267105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8073da0 0x7f92b80c4ed0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 -- 172.21.15.44:0/1658267105 >> 172.21.15.44:0/1658267105 conn(0x7f92b80b2510 msgr2=0x7f92b80b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 -- 172.21.15.44:0/1658267105 shutdown_connections 2024-09-17T05:46:41.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.523+0000 7f92bd200640 1 -- 172.21.15.44:0/1658267105 wait complete. 2024-09-17T05:46:41.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 Processor -- start 2024-09-17T05:46:41.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 -- start start 2024-09-17T05:46:41.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b80cca90 0x7f92b8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92b80ccea0 0x7f92b81fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8166f80 0x7f92b81fc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f92b8169c30 con 0x7f92b8166f80 2024-09-17T05:46:41.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f92b8169ab0 con 0x7f92b80ccea0 2024-09-17T05:46:41.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f92b8169db0 con 0x7f92b80cca90 2024-09-17T05:46:41.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8166f80 0x7f92b81fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8166f80 0x7f92b81fc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36846/0 (socket says 172.21.15.44:36846) 2024-09-17T05:46:41.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 -- 172.21.15.44:0/3213390299 learned_addr learned my addr 172.21.15.44:0/3213390299 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:41.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b5e00640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b80cca90 0x7f92b8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92afe00640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92b80ccea0 0x7f92b81fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 -- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b80cca90 msgr2=0x7f92b8153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b80cca90 0x7f92b8153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 -- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92b80ccea0 msgr2=0x7f92b81fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:41.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92b80ccea0 0x7f92b81fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 -- 172.21.15.44:0/3213390299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b81536a0 con 0x7f92b8166f80 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92afe00640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92b80ccea0 0x7f92b81fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92b6800640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8166f80 0x7f92b81fc450 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f92b000eab0 tx=0x7f92b000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92ae000640 1 -- 172.21.15.44:0/3213390299 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000ce40 con 0x7f92b8166f80 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92ae000640 1 -- 172.21.15.44:0/3213390299 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92b0010430 con 0x7f92b8166f80 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92ae000640 1 -- 172.21.15.44:0/3213390299 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0010860 con 0x7f92b8166f80 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b80b5bd0 con 0x7f92b8166f80 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.527+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b80b6190 con 0x7f92b8166f80 2024-09-17T05:46:41.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.531+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b80c4ed0 con 0x7f92b8166f80 2024-09-17T05:46:41.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.531+0000 7f92ae000640 1 -- 172.21.15.44:0/3213390299 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f92b0010a00 con 0x7f92b8166f80 2024-09-17T05:46:41.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.531+0000 7f92ae000640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9294073200 0x7f9294075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:41.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.531+0000 7f92ae000640 1 -- 172.21.15.44:0/3213390299 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f92b00950b0 con 0x7f92b8166f80 2024-09-17T05:46:41.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.531+0000 7f92b5e00640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9294073200 0x7f9294075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:41.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.535+0000 7f92b5e00640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9294073200 0x7f9294075710 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007fd0 tx=0x7f92a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:41.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.535+0000 7f92ae000640 1 -- 172.21.15.44:0/3213390299 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f92b00600f0 con 0x7f92b8166f80 2024-09-17T05:46:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.711+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f92b80b2920 con 0x7f9294073200 2024-09-17T05:46:42.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92ae000640 1 -- 172.21.15.44:0/3213390299 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f92b80b2920 con 0x7f9294073200 2024-09-17T05:46:42.031 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T05:46:42.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9294073200 msgr2=0x7f9294075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9294073200 0x7f9294075710 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007fd0 tx=0x7f92a8009040 comp rx=0 tx=0).stop 2024-09-17T05:46:42.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8166f80 msgr2=0x7f92b81fc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8166f80 0x7f92b81fc450 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f92b000eab0 tx=0x7f92b000ef70 comp rx=0 tx=0).stop 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 shutdown_connections 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f92b8166f80 0x7f92b81fc450 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f9294073200 0x7f9294075710 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92b80ccea0 0x7f92b81fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 --2- 172.21.15.44:0/3213390299 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f92b80cca90 0x7f92b8153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 >> 172.21.15.44:0/3213390299 conn(0x7f92b80b2510 msgr2=0x7f92b80c7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 shutdown_connections 2024-09-17T05:46:42.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:41.715+0000 7f92bd200640 1 -- 172.21.15.44:0/3213390299 wait complete. 2024-09-17T05:46:42.032 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T05:46:42.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.195+0000 7fb5bca00640 1 -- 172.21.15.44:0/3466210145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b815eee0 msgr2=0x7fb5b815f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.195+0000 7fb5bca00640 1 --2- 172.21.15.44:0/3466210145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b815eee0 0x7fb5b815f2f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009840 tx=0x7fb5a401c820 comp rx=0 tx=0).stop 2024-09-17T05:46:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.195+0000 7fb5bca00640 1 -- 172.21.15.44:0/3466210145 shutdown_connections 2024-09-17T05:46:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.195+0000 7fb5bca00640 1 --2- 172.21.15.44:0/3466210145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b815eee0 0x7fb5b815f2f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.195+0000 7fb5bca00640 1 -- 172.21.15.44:0/3466210145 >> 172.21.15.44:0/3466210145 conn(0x7fb5b80cfea0 msgr2=0x7fb5b80d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.195+0000 7fb5bca00640 1 -- 172.21.15.44:0/3466210145 shutdown_connections 2024-09-17T05:46:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.195+0000 7fb5bca00640 1 -- 172.21.15.44:0/3466210145 wait complete. 2024-09-17T05:46:42.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 Processor -- start 2024-09-17T05:46:42.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 -- start start 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b80cbf90 0x7fb5b81fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b8151a70 0x7fb5b80af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5b815eee0 0x7fb5b80afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b8169e30 con 0x7fb5b80cbf90 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b8169cb0 con 0x7fb5b8151a70 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5bca00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb5b8169fb0 con 0x7fb5b815eee0 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5b6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b80cbf90 0x7fb5b81fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5b6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b80cbf90 0x7fb5b81fb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36862/0 (socket says 172.21.15.44:36862) 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.199+0000 7fb5b6800640 1 -- 172.21.15.44:0/1830439087 learned_addr learned my addr 172.21.15.44:0/1830439087 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b5e00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b8151a70 0x7fb5b80af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b7200640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5b815eee0 0x7fb5b80afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b6800640 1 -- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5b815eee0 msgr2=0x7fb5b80afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b6800640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb5b815eee0 0x7fb5b80afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b6800640 1 -- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b8151a70 msgr2=0x7fb5b80af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b6800640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b8151a70 0x7fb5b80af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b6800640 1 -- 172.21.15.44:0/1830439087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b8076880 con 0x7fb5b80cbf90 2024-09-17T05:46:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b5e00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5b8151a70 0x7fb5b80af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:46:42.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5b6800640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b80cbf90 0x7fb5b81fb720 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800c450 tx=0x7fb5a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8017070 con 0x7fb5b80cbf90 2024-09-17T05:46:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5a80053c0 con 0x7fb5b80cbf90 2024-09-17T05:46:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8003860 con 0x7fb5b80cbf90 2024-09-17T05:46:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b81fbc60 con 0x7fb5b80cbf90 2024-09-17T05:46:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b80b0990 con 0x7fb5b80cbf90 2024-09-17T05:46:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5b80b1330 con 0x7fb5b80cbf90 2024-09-17T05:46:42.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.203+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb5a801a070 con 0x7fb5b80cbf90 2024-09-17T05:46:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5aea00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb598073230 0x7fb598075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fb5a80939b0 con 0x7fb5b80cbf90 2024-09-17T05:46:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5aea00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fb598079860 0x7fb59807bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb59807c3c0 con 0x7fb598079860 2024-09-17T05:46:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fb5a8093d60 con 0x7fb5b80cbf90 2024-09-17T05:46:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5b5e00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb598073230 0x7fb598075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5b7200640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fb598079860 0x7fb59807bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5b5e00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb598073230 0x7fb598075740 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40af000 tx=0x7fb5a401b060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5b7200640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fb598079860 0x7fb59807bcf0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.207+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== osd.6 v2:172.21.15.86:6802/218299486 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb59807c3c0 con 0x7fb598079860 2024-09-17T05:46:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.219+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 --> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb5b815f2f0 con 0x7fb598079860 2024-09-17T05:46:42.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5aea00640 1 -- 172.21.15.44:0/1830439087 <== osd.6 v2:172.21.15.86:6802/218299486 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb5b815f2f0 con 0x7fb598079860 2024-09-17T05:46:42.224 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:42.224 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:42.224 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fb598079860 msgr2=0x7fb59807bcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6802/218299486,v1:172.21.15.86:6803/218299486] conn(0x7fb598079860 0x7fb59807bcf0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb598073230 msgr2=0x7fb598075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb598073230 0x7fb598075740 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40af000 tx=0x7fb5a401b060 comp rx=0 tx=0).stop 2024-09-17T05:46:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b80cbf90 msgr2=0x7fb5b81fb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 --2- 172.21.15.44:0/1830439087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b80cbf90 0x7fb5b81fb720 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800c450 tx=0x7fb5a800c910 comp rx=0 tx=0).stop 2024-09-17T05:46:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5b7200640 1 -- 172.21.15.44:0/1830439087 reap_dead start 2024-09-17T05:46:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 shutdown_connections 2024-09-17T05:46:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 >> 172.21.15.44:0/1830439087 conn(0x7fb5b80cfea0 msgr2=0x7fb5b815ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 shutdown_connections 2024-09-17T05:46:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.223+0000 7fb5bca00640 1 -- 172.21.15.44:0/1830439087 wait complete. 2024-09-17T05:46:42.243 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T05:46:42.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 -- 172.21.15.44:0/2000130608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c0b3820 msgr2=0x7fb51c162600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 --2- 172.21.15.44:0/2000130608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c0b3820 0x7fb51c162600 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5100098f0 tx=0x7fb51001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 -- 172.21.15.44:0/2000130608 shutdown_connections 2024-09-17T05:46:42.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 --2- 172.21.15.44:0/2000130608 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb51c06d500 0x7fb51c0cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 --2- 172.21.15.44:0/2000130608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c0b3820 0x7fb51c162600 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 -- 172.21.15.44:0/2000130608 >> 172.21.15.44:0/2000130608 conn(0x7fb51c0cdd10 msgr2=0x7fb51c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 -- 172.21.15.44:0/2000130608 shutdown_connections 2024-09-17T05:46:42.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.399+0000 7fb523a00640 1 -- 172.21.15.44:0/2000130608 wait complete. 2024-09-17T05:46:42.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 Processor -- start 2024-09-17T05:46:42.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 -- start start 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb51c074ca0 0x7fb51c1f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb51c0b3820 0x7fb51c0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c1591e0 0x7fb51c15f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c16c9a0 con 0x7fb51c074ca0 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c16c820 con 0x7fb51c1591e0 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb523a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c16cb20 con 0x7fb51c0b3820 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb521000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb51c074ca0 0x7fb51c1f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb521000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb51c074ca0 0x7fb51c1f9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36870/0 (socket says 172.21.15.44:36870) 2024-09-17T05:46:42.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb521000640 1 -- 172.21.15.44:0/1346993575 learned_addr learned my addr 172.21.15.44:0/1346993575 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:42.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb51be00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb51c0b3820 0x7fb51c0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.403+0000 7fb521a00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c1591e0 0x7fb51c15f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb521000640 1 -- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb51c0b3820 msgr2=0x7fb51c0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb521000640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb51c0b3820 0x7fb51c0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb521000640 1 -- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c1591e0 msgr2=0x7fb51c15f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb521000640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c1591e0 0x7fb51c15f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb521000640 1 -- 172.21.15.44:0/1346993575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c1f9bd0 con 0x7fb51c074ca0 2024-09-17T05:46:42.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb521000640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb51c074ca0 0x7fb51c1f9260 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c10 tx=0x7fb5100a5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb518c00640 1 -- 172.21.15.44:0/1346993575 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5100b2040 con 0x7fb51c074ca0 2024-09-17T05:46:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb518c00640 1 -- 172.21.15.44:0/1346993575 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb510004040 con 0x7fb51c074ca0 2024-09-17T05:46:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb518c00640 1 -- 172.21.15.44:0/1346993575 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510004410 con 0x7fb51c074ca0 2024-09-17T05:46:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c1f9eb0 con 0x7fb51c074ca0 2024-09-17T05:46:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c155a90 con 0x7fb51c074ca0 2024-09-17T05:46:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c0cfae0 con 0x7fb51c074ca0 2024-09-17T05:46:42.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb518c00640 1 -- 172.21.15.44:0/1346993575 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb5100bd030 con 0x7fb51c074ca0 2024-09-17T05:46:42.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.407+0000 7fb518c00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4fc073230 0x7fb4fc075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.411+0000 7fb518c00640 1 -- 172.21.15.44:0/1346993575 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fb51012daa0 con 0x7fb51c074ca0 2024-09-17T05:46:42.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.411+0000 7fb51be00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4fc073230 0x7fb4fc075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.411+0000 7fb51be00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4fc073230 0x7fb4fc075740 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb51c1f6dc0 tx=0x7fb508009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.415+0000 7fb518c00640 1 -- 172.21.15.44:0/1346993575 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb5100c4060 con 0x7fb51c074ca0 2024-09-17T05:46:42.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.587+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb51c069000 con 0x7fb4fc073230 2024-09-17T05:46:42.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb518c00640 1 -- 172.21.15.44:0/1346993575 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb51c069000 con 0x7fb4fc073230 2024-09-17T05:46:42.591 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4fc073230 msgr2=0x7fb4fc075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4fc073230 0x7fb4fc075740 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb51c1f6dc0 tx=0x7fb508009040 comp rx=0 tx=0).stop 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb51c074ca0 msgr2=0x7fb51c1f9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb51c074ca0 0x7fb51c1f9260 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c10 tx=0x7fb5100a5f90 comp rx=0 tx=0).stop 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 shutdown_connections 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb4fc073230 0x7fb4fc075740 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb51c1591e0 0x7fb51c15f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb51c0b3820 0x7fb51c0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 --2- 172.21.15.44:0/1346993575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb51c074ca0 0x7fb51c1f9260 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 >> 172.21.15.44:0/1346993575 conn(0x7fb51c0cdd10 msgr2=0x7fb51c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 shutdown_connections 2024-09-17T05:46:42.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.591+0000 7fb523a00640 1 -- 172.21.15.44:0/1346993575 wait complete. 2024-09-17T05:46:42.613 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T05:46:42.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 -- 172.21.15.44:0/4015051641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b40af530 msgr2=0x7fd6b415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 --2- 172.21.15.44:0/4015051641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b40af530 0x7fd6b415f480 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4072880 tx=0x7fd6ac01cd80 comp rx=0 tx=0).stop 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 -- 172.21.15.44:0/4015051641 shutdown_connections 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 --2- 172.21.15.44:0/4015051641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b40af530 0x7fd6b415f480 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 --2- 172.21.15.44:0/4015051641 >> v2:172.21.15.86:3300/0 conn(0x7fd6b406ec70 0x7fd6b4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 -- 172.21.15.44:0/4015051641 >> 172.21.15.44:0/4015051641 conn(0x7fd6b40d0170 msgr2=0x7fd6b40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 -- 172.21.15.44:0/4015051641 shutdown_connections 2024-09-17T05:46:42.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.775+0000 7fd6b9400640 1 -- 172.21.15.44:0/4015051641 wait complete. 2024-09-17T05:46:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 Processor -- start 2024-09-17T05:46:42.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 -- start start 2024-09-17T05:46:42.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b406ec70 0x7fd6b4165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b40af530 0x7fd6b409d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6b41592f0 0x7fd6b415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b415c550 con 0x7fd6b406ec70 2024-09-17T05:46:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b415c3d0 con 0x7fd6b41592f0 2024-09-17T05:46:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b415c6d0 con 0x7fd6b40af530 2024-09-17T05:46:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b406ec70 0x7fd6b4165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b406ec70 0x7fd6b4165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36898/0 (socket says 172.21.15.44:36898) 2024-09-17T05:46:42.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 -- 172.21.15.44:0/1059615785 learned_addr learned my addr 172.21.15.44:0/1059615785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 -- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b40af530 msgr2=0x7fd6b409d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fd6b40af530 0x7fd6b409d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 -- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6b41592f0 msgr2=0x7fd6b415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6b41592f0 0x7fd6b415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 -- 172.21.15.44:0/1059615785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b41659e0 con 0x7fd6b406ec70 2024-09-17T05:46:42.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b2800640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b406ec70 0x7fd6b4165120 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400d750 tx=0x7fd6a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4017070 con 0x7fd6b406ec70 2024-09-17T05:46:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6a4004310 con 0x7fd6b406ec70 2024-09-17T05:46:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b4165cc0 con 0x7fd6b406ec70 2024-09-17T05:46:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400de60 con 0x7fd6b406ec70 2024-09-17T05:46:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b4166280 con 0x7fd6b406ec70 2024-09-17T05:46:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.779+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6b4158db0 con 0x7fd6b406ec70 2024-09-17T05:46:42.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd6a4009c30 con 0x7fd6b406ec70 2024-09-17T05:46:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6aaa00640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd690073200 0x7fd690075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fd6a40948e0 con 0x7fd6b406ec70 2024-09-17T05:46:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6aaa00640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7fd690079830 0x7fd69007bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd69007c390 con 0x7fd690079830 2024-09-17T05:46:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=124) ==== 24+0+0 (secure 0 0 0) 0x7fd6a4094c90 con 0x7fd6b406ec70 2024-09-17T05:46:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6abe00640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd690073200 0x7fd690075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6b3200640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7fd690079830 0x7fd69007bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6abe00640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd690073200 0x7fd690075710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40cb6d0 tx=0x7fd69c006bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.783+0000 7fd6b3200640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7fd690079830 0x7fd69007bcc0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.787+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== osd.7 v2:172.21.15.86:6818/3939301135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd69007c390 con 0x7fd690079830 2024-09-17T05:46:42.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 --> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6b40ace00 con 0x7fd690079830 2024-09-17T05:46:42.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6aaa00640 1 -- 172.21.15.44:0/1059615785 <== osd.7 v2:172.21.15.86:6818/3939301135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6b40ace00 con 0x7fd690079830 2024-09-17T05:46:42.801 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-09-17T05:46:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:46:42.801 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-09-17T05:46:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7fd690079830 msgr2=0x7fd69007bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6818/3939301135,v1:172.21.15.86:6819/3939301135] conn(0x7fd690079830 0x7fd69007bcc0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd690073200 msgr2=0x7fd690075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fd690073200 0x7fd690075710 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40cb6d0 tx=0x7fd69c006bd0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b406ec70 msgr2=0x7fd6b4165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 --2- 172.21.15.44:0/1059615785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6b406ec70 0x7fd6b4165120 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400d750 tx=0x7fd6a400dc10 comp rx=0 tx=0).stop 2024-09-17T05:46:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b3200640 1 -- 172.21.15.44:0/1059615785 reap_dead start 2024-09-17T05:46:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 shutdown_connections 2024-09-17T05:46:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 >> 172.21.15.44:0/1059615785 conn(0x7fd6b40d0170 msgr2=0x7fd6b40d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 shutdown_connections 2024-09-17T05:46:42.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.799+0000 7fd6b9400640 1 -- 172.21.15.44:0/1059615785 wait complete. 2024-09-17T05:46:42.821 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T05:46:42.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 -- 172.21.15.44:0/1814771198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780b3910 msgr2=0x7f7b780ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/1814771198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780b3910 0x7f7b780ce1f0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f7b780ca850 tx=0x7f7b6001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 -- 172.21.15.44:0/1814771198 shutdown_connections 2024-09-17T05:46:42.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/1814771198 >> v2:172.21.15.86:3300/0 conn(0x7f7b780ce730 0x7f7b780ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/1814771198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b780b3910 0x7f7b780ce1f0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/1814771198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b7809df30 0x7f7b780b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 -- 172.21.15.44:0/1814771198 >> 172.21.15.44:0/1814771198 conn(0x7f7b7806d450 msgr2=0x7f7b780d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:42.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 -- 172.21.15.44:0/1814771198 shutdown_connections 2024-09-17T05:46:42.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.979+0000 7f7b7fc00640 1 -- 172.21.15.44:0/1814771198 wait complete. 2024-09-17T05:46:42.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 Processor -- start 2024-09-17T05:46:42.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 -- start start 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7809df30 0x7f7b780b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b780b3910 0x7f7b78073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b780ce730 0x7f7b78167f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b780ccef0 con 0x7f7b7809df30 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b780ccd70 con 0x7f7b780ce730 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f7b780cd070 con 0x7f7b780b3910 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7809df30 0x7f7b780b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7809df30 0x7f7b780b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36914/0 (socket says 172.21.15.44:36914) 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 -- 172.21.15.44:0/2933377587 learned_addr learned my addr 172.21.15.44:0/2933377587 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b6fe00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b780b3910 0x7f7b78073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7dc00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b780ce730 0x7f7b78167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 -- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b780b3910 msgr2=0x7f7b78073ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b780b3910 0x7f7b78073ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 -- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b780ce730 msgr2=0x7f7b78167f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b780ce730 0x7f7b78167f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 -- 172.21.15.44:0/2933377587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b780b1830 con 0x7f7b7809df30 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7d200640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7809df30 0x7f7b780b28d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800d6a0 tx=0x7f7b6800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b75600640 1 -- 172.21.15.44:0/2933377587 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b68017070 con 0x7f7b7809df30 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b75600640 1 -- 172.21.15.44:0/2933377587 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b68004310 con 0x7f7b7809df30 2024-09-17T05:46:42.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b75600640 1 -- 172.21.15.44:0/2933377587 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b68009a80 con 0x7f7b7809df30 2024-09-17T05:46:42.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b780b1b10 con 0x7f7b7809df30 2024-09-17T05:46:42.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.983+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b780b20d0 con 0x7f7b7809df30 2024-09-17T05:46:42.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.987+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b780ce1f0 con 0x7f7b7809df30 2024-09-17T05:46:42.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.987+0000 7f7b75600640 1 -- 172.21.15.44:0/2933377587 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7b68009c20 con 0x7f7b7809df30 2024-09-17T05:46:42.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.987+0000 7f7b75600640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7b54073200 0x7f7b54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:42.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.987+0000 7f7b75600640 1 -- 172.21.15.44:0/2933377587 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f7b68094140 con 0x7f7b7809df30 2024-09-17T05:46:42.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.987+0000 7f7b6fe00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7b54073200 0x7f7b54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:42.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.987+0000 7f7b6fe00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7b54073200 0x7f7b54075710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7b600af000 tx=0x7f7b6001b100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:42.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:42.991+0000 7f7b75600640 1 -- 172.21.15.44:0/2933377587 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f7b6805ebc0 con 0x7f7b7809df30 2024-09-17T05:46:43.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.163+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f7b780ae8e0 con 0x7f7b54073200 2024-09-17T05:46:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b75600640 1 -- 172.21.15.44:0/2933377587 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7b780ae8e0 con 0x7f7b54073200 2024-09-17T05:46:43.167 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T05:46:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7b54073200 msgr2=0x7f7b54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7b54073200 0x7f7b54075710 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7b600af000 tx=0x7f7b6001b100 comp rx=0 tx=0).stop 2024-09-17T05:46:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7809df30 msgr2=0x7f7b780b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7809df30 0x7f7b780b28d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800d6a0 tx=0x7f7b6800db60 comp rx=0 tx=0).stop 2024-09-17T05:46:43.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 shutdown_connections 2024-09-17T05:46:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f7b54073200 0x7f7b54075710 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b780ce730 0x7f7b78167f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f7b780b3910 0x7f7b78073ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 --2- 172.21.15.44:0/2933377587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b7809df30 0x7f7b780b28d0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 >> 172.21.15.44:0/2933377587 conn(0x7f7b7806d450 msgr2=0x7f7b780acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 shutdown_connections 2024-09-17T05:46:43.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.167+0000 7f7b7fc00640 1 -- 172.21.15.44:0/2933377587 wait complete. 2024-09-17T05:46:43.189 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:46:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 -- 172.21.15.44:0/2749181429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f225415cbd0 msgr2=0x7f2254070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 --2- 172.21.15.44:0/2749181429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f225415cbd0 0x7f2254070310 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2248009900 tx=0x7f224801c870 comp rx=0 tx=0).stop 2024-09-17T05:46:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 -- 172.21.15.44:0/2749181429 shutdown_connections 2024-09-17T05:46:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 --2- 172.21.15.44:0/2749181429 >> v2:172.21.15.86:3300/0 conn(0x7f22540b2120 0x7f22540cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 --2- 172.21.15.44:0/2749181429 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f2254070850 0x7f22540b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 --2- 172.21.15.44:0/2749181429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f225415cbd0 0x7f2254070310 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 -- 172.21.15.44:0/2749181429 >> 172.21.15.44:0/2749181429 conn(0x7f22540ccbe0 msgr2=0x7f22540ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 -- 172.21.15.44:0/2749181429 shutdown_connections 2024-09-17T05:46:43.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 -- 172.21.15.44:0/2749181429 wait complete. 2024-09-17T05:46:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 Processor -- start 2024-09-17T05:46:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.347+0000 7f225c400640 1 -- start start 2024-09-17T05:46:43.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2254070850 0x7f22541485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22540b2120 0x7f225415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225415cbd0 0x7f225409c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f225406fa80 con 0x7f2254070850 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f225406f900 con 0x7f225415cbd0 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7f22540b2fb0 con 0x7f22540b2120 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2254070850 0x7f22541485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2254070850 0x7f22541485e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36932/0 (socket says 172.21.15.44:36932) 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 -- 172.21.15.44:0/4028880432 learned_addr learned my addr 172.21.15.44:0/4028880432 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 -- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22540b2120 msgr2=0x7f225415b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22540b2120 0x7f225415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 -- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225415cbd0 msgr2=0x7f225409c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225415cbd0 0x7f225409c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 -- 172.21.15.44:0/4028880432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225415bf00 con 0x7f2254070850 2024-09-17T05:46:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2259a00640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2254070850 0x7f22541485e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f22480b0040 tx=0x7f22480a57e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2251600640 1 -- 172.21.15.44:0/4028880432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22480b2040 con 0x7f2254070850 2024-09-17T05:46:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2251600640 1 -- 172.21.15.44:0/4028880432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2248004340 con 0x7f2254070850 2024-09-17T05:46:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2254157bd0 con 0x7f2254070850 2024-09-17T05:46:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f2251600640 1 -- 172.21.15.44:0/4028880432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22480044f0 con 0x7f2254070850 2024-09-17T05:46:43.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225415a250 con 0x7f2254070850 2024-09-17T05:46:43.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.351+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225415c130 con 0x7f2254070850 2024-09-17T05:46:43.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.355+0000 7f2251600640 1 -- 172.21.15.44:0/4028880432 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2248005260 con 0x7f2254070850 2024-09-17T05:46:43.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.355+0000 7f2251600640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2234073230 0x7f2234075740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.355+0000 7f2251600640 1 -- 172.21.15.44:0/4028880432 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7f224812e3f0 con 0x7f2254070850 2024-09-17T05:46:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.355+0000 7f2259000640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2234073230 0x7f2234075740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.355+0000 7f2259000640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2234073230 0x7f2234075740 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f225415c520 tx=0x7f2240005ad0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.359+0000 7f2251600640 1 -- 172.21.15.44:0/4028880432 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7f2248016490 con 0x7f2254070850 2024-09-17T05:46:43.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.531+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 --> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2254157eb0 con 0x7f2234073230 2024-09-17T05:46:43.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.531+0000 7f2251600640 1 -- 172.21.15.44:0/4028880432 <== mgr.4103 v2:172.21.15.86:6800/2120607983 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7f2254157eb0 con 0x7f2234073230 2024-09-17T05:46:43.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:43.535 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2234073230 msgr2=0x7f2234075740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2234073230 0x7f2234075740 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f225415c520 tx=0x7f2240005ad0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2254070850 msgr2=0x7f22541485e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2254070850 0x7f22541485e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f22480b0040 tx=0x7f22480a57e0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 shutdown_connections 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7f2234073230 0x7f2234075740 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f225415cbd0 0x7f225409c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7f22540b2120 0x7f225415b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 --2- 172.21.15.44:0/4028880432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2254070850 0x7f22541485e0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 >> 172.21.15.44:0/4028880432 conn(0x7f22540ccbe0 msgr2=0x7f22541591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 shutdown_connections 2024-09-17T05:46:43.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.535+0000 7f225c400640 1 -- 172.21.15.44:0/4028880432 wait complete. 2024-09-17T05:46:43.558 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2024-09-17T05:46:42.437698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262736,"kb_used_data":13224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711984,"statfs":{"total":773094113280,"available":772825071616,"internally_reserved":0,"allocated":13541376,"data_stored":6937976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.130842"},"pg_stats":[{"pgid":"1.0","version":"124'74","reported_seq":320,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-09-17T05:46:40.116338+0000","last_change":"2024-09-17T05:46:40.116338+0000","last_active":"2024-09-17T05:46:40.116338+0000","last_peered":"2024-09-17T05:46:40.116338+0000","last_clean":"2024-09-17T05:46:40.116338+0000","last_became_active":"2024-09-17T05:36:08.080135+0000","last_became_peered":"2024-09-17T05:36:08.080135+0000","last_unstale":"2024-09-17T05:46:40.116338+0000","last_undegraded":"2024-09-17T05:46:40.116338+0000","last_fullsized":"2024-09-17T05:46:40.116338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'74","last_scrub_stamp":"2024-09-17T05:46:40.116250+0000","last_deep_scrub":"124'74","last_deep_scrub_stamp":"2024-09-17T05:46:40.116250+0000","last_clean_scrub_stamp":"2024-09-17T05:46:40.116250+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:09.115217+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509570,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2138112,"data_stored":1310023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509570,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509569,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509571,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2138112,"data_stored":1310023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509571,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32700,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1544192,"data_stored":719655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:46:43.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 -- 172.21.15.44:0/2322730198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40cca90 msgr2=0x7fabf4073690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 --2- 172.21.15.44:0/2322730198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40cca90 0x7fabf4073690 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fabf406b3b0 tx=0x7fabe401c800 comp rx=0 tx=0).stop 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 -- 172.21.15.44:0/2322730198 shutdown_connections 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 --2- 172.21.15.44:0/2322730198 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabf40cb070 0x7fabf40cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 --2- 172.21.15.44:0/2322730198 >> v2:172.21.15.86:3300/0 conn(0x7fabf40ccea0 0x7fabf4073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 --2- 172.21.15.44:0/2322730198 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40cca90 0x7fabf4073690 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 -- 172.21.15.44:0/2322730198 >> 172.21.15.44:0/2322730198 conn(0x7fabf40b2510 msgr2=0x7fabf40b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 -- 172.21.15.44:0/2322730198 shutdown_connections 2024-09-17T05:46:43.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.715+0000 7fabfa200640 1 -- 172.21.15.44:0/2322730198 wait complete. 2024-09-17T05:46:43.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 Processor -- start 2024-09-17T05:46:43.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 -- start start 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabf40cb070 0x7fabf415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabf40cca90 0x7fabf4148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40ccea0 0x7fabf41fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fabf40c5c00 con 0x7fabf40ccea0 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fabf40c5a80 con 0x7fabf40cb070 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabfa200640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fabf40c5d80 con 0x7fabf40cca90 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40ccea0 0x7fabf41fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40ccea0 0x7fabf41fa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36956/0 (socket says 172.21.15.44:36956) 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3400640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabf40cb070 0x7fabf415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 -- 172.21.15.44:0/2262264103 learned_addr learned my addr 172.21.15.44:0/2262264103 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:43.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabebe00640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabf40cca90 0x7fabf4148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 -- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabf40cca90 msgr2=0x7fabf4148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabf40cca90 0x7fabf4148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 -- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabf40cb070 msgr2=0x7fabf415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabf40cb070 0x7fabf415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 -- 172.21.15.44:0/2262264103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf41600c0 con 0x7fabf40ccea0 2024-09-17T05:46:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.719+0000 7fabf3e00640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40ccea0 0x7fabf41fa1f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e8e0 tx=0x7fabec00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec016070 con 0x7fabf40ccea0 2024-09-17T05:46:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabec00c850 con 0x7fabf40ccea0 2024-09-17T05:46:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf41491f0 con 0x7fabf40ccea0 2024-09-17T05:46:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec00cc80 con 0x7fabf40ccea0 2024-09-17T05:46:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf41584f0 con 0x7fabf40ccea0 2024-09-17T05:46:43.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf40cb480 con 0x7fabf40ccea0 2024-09-17T05:46:43.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fabec019070 con 0x7fabf40ccea0 2024-09-17T05:46:43.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabeb400640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fabd0073200 0x7fabd0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:43.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fabec0948f0 con 0x7fabf40ccea0 2024-09-17T05:46:43.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.723+0000 7fabf3400640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fabd0073200 0x7fabd0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:43.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.727+0000 7fabf3400640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fabd0073200 0x7fabd0075710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fabe40af000 tx=0x7fabe40a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:43.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.727+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fabec00ce20 con 0x7fabf40ccea0 2024-09-17T05:46:43.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.903+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fabf40c7020 con 0x7fabf40ccea0 2024-09-17T05:46:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.907+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v46)=0 v46) ==== 123+0+0 (secure 0 0 0) 0x7fabec05f2f0 con 0x7fabf40ccea0 2024-09-17T05:46:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.907+0000 7fabeb400640 1 -- 172.21.15.44:0/2262264103 <== mon.0 v2:172.21.15.44:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fabec09a080 con 0x7fabf40ccea0 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fabd0073200 msgr2=0x7fabd0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fabd0073200 0x7fabd0075710 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fabe40af000 tx=0x7fabe40a7040 comp rx=0 tx=0).stop 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40ccea0 msgr2=0x7fabf41fa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40ccea0 0x7fabf41fa1f0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fabec00e8e0 tx=0x7fabec00eda0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 shutdown_connections 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fabf40ccea0 0x7fabf41fa1f0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fabf40cca90 0x7fabf4148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fabd0073200 0x7fabd0075710 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 --2- 172.21.15.44:0/2262264103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabf40cb070 0x7fabf415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 >> 172.21.15.44:0/2262264103 conn(0x7fabf40b2510 msgr2=0x7fabf40c6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 shutdown_connections 2024-09-17T05:46:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:43.911+0000 7fabfa200640 1 -- 172.21.15.44:0/2262264103 wait complete. 2024-09-17T05:46:43.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:46:43.932 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:46:44.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:44.085 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 -- 172.21.15.44:0/2202265176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15d500 msgr2=0x7fb10c0b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 --2- 172.21.15.44:0/2202265176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15d500 0x7fb10c0b3cf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009900 tx=0x7fb0f801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 -- 172.21.15.44:0/2202265176 shutdown_connections 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 --2- 172.21.15.44:0/2202265176 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb10c15d910 0x7fb10c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 --2- 172.21.15.44:0/2202265176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15d500 0x7fb10c0b3cf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 -- 172.21.15.44:0/2202265176 >> 172.21.15.44:0/2202265176 conn(0x7fb10c06d530 msgr2=0x7fb10c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 -- 172.21.15.44:0/2202265176 shutdown_connections 2024-09-17T05:46:44.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.087+0000 7fb112a00640 1 -- 172.21.15.44:0/2202265176 wait complete. 2024-09-17T05:46:44.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 Processor -- start 2024-09-17T05:46:44.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 -- start start 2024-09-17T05:46:44.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15a330 0x7fb10c166d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb10c15d500 0x7fb10c1f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10c15d910 0x7fb10c1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c16a660 con 0x7fb10c15d910 2024-09-17T05:46:44.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb10c16a4e0 con 0x7fb10c15a330 2024-09-17T05:46:44.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb112a00640 1 -- --> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] -- mon_getmap magic: 0 -- 0x7fb10c16a7e0 con 0x7fb10c15d500 2024-09-17T05:46:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb110a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10c15d910 0x7fb10c1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb10b400640 1 --2- >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb10c15d500 0x7fb10c1f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb110a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10c15d910 0x7fb10c1511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36962/0 (socket says 172.21.15.44:36962) 2024-09-17T05:46:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb110a00640 1 -- 172.21.15.44:0/3395481538 learned_addr learned my addr 172.21.15.44:0/3395481538 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-09-17T05:46:44.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.091+0000 7fb10be00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15a330 0x7fb10c166d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb110a00640 1 -- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb10c15d500 msgr2=0x7fb10c1f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb110a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb10c15d500 0x7fb10c1f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb110a00640 1 -- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15a330 msgr2=0x7fb10c166d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb110a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15a330 0x7fb10c166d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb110a00640 1 -- 172.21.15.44:0/3395481538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10c1f9700 con 0x7fb10c15d910 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb10b400640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb10c15d500 0x7fb10c1f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb110a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10c15d910 0x7fb10c1511b0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb10400ea80 tx=0x7fb10400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb103e00640 1 -- 172.21.15.44:0/3395481538 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10400ce40 con 0x7fb10c15d910 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb103e00640 1 -- 172.21.15.44:0/3395481538 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fb104004c40 con 0x7fb10c15d910 2024-09-17T05:46:44.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb103e00640 1 -- 172.21.15.44:0/3395481538 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104005280 con 0x7fb10c15d910 2024-09-17T05:46:44.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10c1fcfc0 con 0x7fb10c15d910 2024-09-17T05:46:44.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb10c1fd580 con 0x7fb10c15d910 2024-09-17T05:46:44.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10c160280 con 0x7fb10c15d910 2024-09-17T05:46:44.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.095+0000 7fb103e00640 1 -- 172.21.15.44:0/3395481538 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb104005420 con 0x7fb10c15d910 2024-09-17T05:46:44.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.099+0000 7fb103e00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:46:44.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.099+0000 7fb103e00640 1 -- 172.21.15.44:0/3395481538 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5507+0+0 (secure 0 0 0) 0x7fb104094dd0 con 0x7fb10c15d910 2024-09-17T05:46:44.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.099+0000 7fb10be00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:46:44.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.099+0000 7fb10be00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:46:44.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.103+0000 7fb103e00640 1 -- 172.21.15.44:0/3395481538 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187803 (secure 0 0 0) 0x7fb10c1f9700 con 0x7fb10c15d910 2024-09-17T05:46:44.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.311+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb10c15a940 con 0x7fb10c15d910 2024-09-17T05:46:44.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.311+0000 7fb103e00640 1 -- 172.21.15.44:0/3395481538 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+3913 (secure 0 0 0) 0x7fb10405f850 con 0x7fb10c15d910 2024-09-17T05:46:44.313 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-09-17T05:46:44.313 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":115,"btime":"2024-09-17T05:46:30:290973+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7064,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/3847132619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":3847132619},{"type":"v1","addr":"172.21.15.86:6835","nonce":3847132619}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7070,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/1656994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1656994777},{"type":"v1","addr":"172.21.15.44:6833","nonce":1656994777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/2398382268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":2398382268},{"type":"v1","addr":"172.21.15.86:6837","nonce":2398382268}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/3639490159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":3639490159},{"type":"v1","addr":"172.21.15.44:6835","nonce":3639490159}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[]} 2024-09-17T05:46:44.314 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 115 2024-09-17T05:46:44.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 msgr2=0x7fb0ec075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc009040 comp rx=0 tx=0).stop 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10c15d910 msgr2=0x7fb10c1511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10c15d910 0x7fb10c1511b0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb10400ea80 tx=0x7fb10400ef40 comp rx=0 tx=0).stop 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 shutdown_connections 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb10c15d910 0x7fb10c1511b0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3301/0,v1:172.21.15.86:6790/0] conn(0x7fb10c15d500 0x7fb10c1f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:6800/2120607983,v1:172.21.15.86:6801/2120607983] conn(0x7fb0ec073200 0x7fb0ec075710 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 --2- 172.21.15.44:0/3395481538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb10c15a330 0x7fb10c166d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 >> 172.21.15.44:0/3395481538 conn(0x7fb10c06d530 msgr2=0x7fb10c15b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 shutdown_connections 2024-09-17T05:46:44.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-09-17T05:46:44.315+0000 7fb112a00640 1 -- 172.21.15.44:0/3395481538 wait complete. 2024-09-17T05:46:44.335 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T05:46:44.335 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T05:46:44.335 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:46:44.335 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.348 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:46:44.349 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:46:44.349 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.413 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:46:44.413 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:46:44.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.427 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:46:44.427 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:46:44.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.484 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:46:44.484 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T05:46:44.484 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T05:46:44.484 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.574 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T05:46:44.574 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T05:46:44.574 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.659 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T05:46:44.660 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T05:46:44.660 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.743 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T05:46:44.744 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T05:46:44.744 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.819 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T05:46:44.820 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T05:46:44.820 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.883 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T05:46:44.883 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T05:46:44.883 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:44.959 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T05:46:44.959 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T05:46:44.959 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:46.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-17T05:46:51.061 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T05:46:51.061 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T05:46:51.061 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:51.120 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T05:46:51.120 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T05:46:51.121 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T05:46:51.121 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:51.183 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T05:46:51.184 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T05:46:51.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:51.247 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T05:46:51.247 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T05:46:51.247 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T05:46:51.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:51.268 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T05:46:51.268 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T05:46:51.268 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:51.286 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T05:46:51.286 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T05:46:51.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:46:51.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-17T05:46:51.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-17T05:46:51.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-17T05:46:51.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-17T05:46:51.347 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T05:46:51.347 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T05:46:51.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | egrep -v 'object missing on disk' | egrep -v 'Invalid tag char' | head -n 1 2024-09-17T05:46:51.391 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:51.391 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T05:46:51.654 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:51.654 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T05:46:51.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:51.842 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T05:46:52.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:52.136 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T05:46:52.293 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:46:52.293 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T05:46:52.672 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:46:52.672 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T05:46:52.843 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:46:52.843 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T05:46:53.018 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:46:53.019 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T05:46:53.207 INFO:tasks.ceph:Archiving mon data... 2024-09-17T05:46:53.208 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/data/mon.a.tgz 2024-09-17T05:46:53.209 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-09-17T05:46:53.218 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.PjTtR6T8R6 2024-09-17T05:46:53.218 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PjTtR6T8R6 2024-09-17T05:46:53.367 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.PjTtR6T8R6 2024-09-17T05:46:53.442 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.PjTtR6T8R6 is 409KB 2024-09-17T05:46:53.505 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.PjTtR6T8R6 2024-09-17T05:46:53.513 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/data/mon.b.tgz 2024-09-17T05:46:53.514 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-17T05:46:53.522 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.wYng575Es8 2024-09-17T05:46:53.522 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wYng575Es8 2024-09-17T05:46:53.666 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.wYng575Es8 2024-09-17T05:46:53.741 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.wYng575Es8 is 414KB 2024-09-17T05:46:53.804 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.wYng575Es8 2024-09-17T05:46:53.812 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/data/mon.c.tgz 2024-09-17T05:46:53.812 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-17T05:46:53.861 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.l5YmG8Erky 2024-09-17T05:46:53.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.l5YmG8Erky 2024-09-17T05:46:54.000 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.l5YmG8Erky 2024-09-17T05:46:54.073 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.l5YmG8Erky is 414KB 2024-09-17T05:46:54.136 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.l5YmG8Erky 2024-09-17T05:46:54.145 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T05:46:54.145 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:46:54.148 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:46:54.218 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:46:54.257 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:46:54.257 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T05:46:54.258 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/remote/smithi044/crash 2024-09-17T05:46:54.259 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:46:54.283 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/remote/smithi086/crash 2024-09-17T05:46:54.284 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:46:54.318 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T05:46:54.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:54.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:54.416 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:54.438 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:46:54.457 INFO:tasks.ceph:Compressing logs... 2024-09-17T05:46:54.457 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:46:54.485 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:46:54.510 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41753.log 2024-09-17T05:46:54.510 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42813.log 2024-09-17T05:46:54.512 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42434.log 2024-09-17T05:46:54.512 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41753.log.gz 2024-09-17T05:46:54.512 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46159.log 2024-09-17T05:46:54.512 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42813.log.gz 2024-09-17T05:46:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51275.log 2024-09-17T05:46:54.513 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42434.log.gz 2024-09-17T05:46:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-09-17T05:46:54.514 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37851.log 2024-09-17T05:46:54.515 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51275.log.gz 2024-09-17T05:46:54.516 INFO:teuthology.orchestra.run.smithi044.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.46159.log.gz 2024-09-17T05:46:54.516 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47595.log 2024-09-17T05:46:54.516 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-09-17T05:46:54.516 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44371.log 2024-09-17T05:46:54.517 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37851.log.gz 2024-09-17T05:46:54.517 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41720.log 2024-09-17T05:46:54.517 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 2024-09-17T05:46:54.518 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47029.log 2024-09-17T05:46:54.518 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44371.log.gz 2024-09-17T05:46:54.519 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50946.log 2024-09-17T05:46:54.519 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41720.log.gz 2024-09-17T05:46:54.520 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40062.log 2024-09-17T05:46:54.520 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47029.log.gz 2024-09-17T05:46:54.520 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51814.log 2024-09-17T05:46:54.521 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40062.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50946.log.gz 2024-09-17T05:46:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51119.log 2024-09-17T05:46:54.522 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40062.log.gz 2024-09-17T05:46:54.522 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36334.log 2024-09-17T05:46:54.523 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51814.log.gz 2024-09-17T05:46:54.523 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51043.log 2024-09-17T05:46:54.523 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51119.log.gz 2024-09-17T05:46:54.524 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48853.log 2024-09-17T05:46:54.524 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36334.log.gz 2024-09-17T05:46:54.526 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.51043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35841.log 2024-09-17T05:46:54.526 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51043.log.gz 2024-09-17T05:46:54.526 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43212.log 2024-09-17T05:46:54.527 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48853.log.gz 2024-09-17T05:46:54.528 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29103.log 2024-09-17T05:46:54.558 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T05:46:54.558 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.29103.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T05:46:54.558 INFO:teuthology.orchestra.run.smithi086.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29103.log.gz 2024-09-17T05:46:54.558 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29128.log 2024-09-17T05:46:54.559 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T05:46:54.559 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.29128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28952.log 2024-09-17T05:46:54.559 INFO:teuthology.orchestra.run.smithi086.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29128.log.gz 2024-09-17T05:46:54.559 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34607.log 2024-09-17T05:46:54.559 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.28952.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T05:46:54.559 INFO:teuthology.orchestra.run.smithi086.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28952.log.gz 2024-09-17T05:46:54.560 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.1.34607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34607.log.gz 2024-09-17T05:46:54.560 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:46:54.560 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28976.log 2024-09-17T05:46:54.560 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T05:46:54.560 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.28976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29000.log 2024-09-17T05:46:54.561 INFO:teuthology.orchestra.run.smithi086.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28976.log.gz 2024-09-17T05:46:54.561 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.29000.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:46:54.561 INFO:teuthology.orchestra.run.smithi086.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29000.log.gz 2024-09-17T05:46:54.561 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34625.log 2024-09-17T05:46:54.561 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29079.log 2024-09-17T05:46:54.561 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.1.34625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34625.log.gz 2024-09-17T05:46:54.562 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:46:54.562 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.29079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34709.log 2024-09-17T05:46:54.562 INFO:teuthology.orchestra.run.smithi086.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29079.log.gz 2024-09-17T05:46:54.562 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.3.34709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34709.log.gz 2024-09-17T05:46:54.562 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29055.log 2024-09-17T05:46:54.562 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T05:46:54.562 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.29055.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29055.log.gz 2024-09-17T05:46:54.563 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.d.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:46:54.563 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29031.log 2024-09-17T05:46:54.563 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34714.log 2024-09-17T05:46:54.563 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.29031.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29031.log.gz 2024-09-17T05:46:54.563 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.3.34714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34714.log.gz 2024-09-17T05:46:54.563 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T05:46:54.564 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T05:46:54.568 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T05:46:54.568 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.4.log: 93.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T05:46:54.591 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-09-17T05:46:54.591 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35841.log.gz 2024-09-17T05:46:54.591 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35839.log 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43212.log.gz 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38541.log 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38035.log 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35839.log.gz 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29491.log 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38541.log.gz 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48282.log 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38035.log.gz 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41542.log 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29491.log.gz 2024-09-17T05:46:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37957.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48282.log.gz 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40831.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41542.log.gz 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37957.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37957.log.gz 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51710.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40831.log.gz 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44040.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39204.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51710.log.gz 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39087.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41390.log 2024-09-17T05:46:54.593 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39204.log.gz 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37137.log 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39087.log.gz 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49168.log 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41390.log.gz 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42143.log 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37137.log.gz 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35606.log 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49168.log.gz 2024-09-17T05:46:54.594 INFO:teuthology.orchestra.run.smithi044.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43700.log 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42143.log.gz 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28991.log 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35606.log.gz 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52046.log 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43700.log.gz 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28991.log.gz 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52046.log: /var/log/ceph/ceph-client.admin.28824.log 2024-09-17T05:46:54.596 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52046.log.gz 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37879.log 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46880.log 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28824.log.gz 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50078.log 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37879.log.gz 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46880.log.gz 2024-09-17T05:46:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50078.log: /var/log/ceph/ceph-client.admin.44988.log 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50078.log.gz 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44988.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44988.log.gz 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39663.log 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38664.log 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45978.log 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39663.log.gz 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35788.log 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38664.log.gz 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51301.log 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35788.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45978.log.gz 2024-09-17T05:46:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28971.log 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35788.log.gz 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45723.log 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51301.log.gz 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28733.log 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28971.log.gz 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40753.log 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45723.log.gz 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35830.log 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.28733.log.gz 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48177.log 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40753.log.gz 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48749.log 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35830.log.gz 2024-09-17T05:46:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48177.log.gz 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48749.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48749.log.gz 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41212.log 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39540.log 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47647.log 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41212.log.gz 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43335.log 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39540.log.gz 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47647.log.gz 2024-09-17T05:46:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.43335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43335.log.gz 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38567.log 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43156.log 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36360.log 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38567.log.gz 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47827.log 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43156.log.gz 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43909.log 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36360.log.gz 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.47827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47827.log.gz 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47487.log 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48984.log 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43909.log.gz 2024-09-17T05:46:54.601 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39059.log 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47487.log.gz 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48984.log.gz 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39059.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.39059.log.gz 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48002.log 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39866.log 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.48002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48002.log.gz 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49784.log 2024-09-17T05:46:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41786.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36042.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41786.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49784.log.gz 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40343.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41786.log.gz 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42967.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36042.log.gz 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48070.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40343.log.gz 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.42967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42967.log.gz 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36724.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28800.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48070.log.gz 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.2.36724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38794.log 2024-09-17T05:46:54.603 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36724.log.gz 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39762.log 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.28800.log.gz 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35842.log 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38794.log.gz 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51197.log 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39762.log.gz 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36308.log 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35842.log.gz 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40935.log 2024-09-17T05:46:54.604 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51197.log.gz 2024-09-17T05:46:54.605 INFO:teuthology.orchestra.run.smithi086.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T05:46:54.612 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-09-17T05:46:54.612 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36308.log.gz 2024-09-17T05:46:54.612 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44686.log 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40935.log.gz 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.33989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37983.log 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40140.log 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44686.log.gz 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37111.log 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37983.log.gz 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39926.log 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40140.log.gz 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51372.log 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37111.log.gz 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35157.log 2024-09-17T05:46:54.613 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39926.log.gz 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51372.log.gz 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35157.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35157.log.gz 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36805.log 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41942.log 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36805.log.gz 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35105.log 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41942.log: gzip 87.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.41942.log.gz -- 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr: /var/log/ceph/ceph-client.admin.28910.log 2024-09-17T05:46:54.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41968.log 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35105.log.gz 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45248.log 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28910.log.gz 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38515.log 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41968.log.gz 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51476.log 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38515.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.45248.log.gz 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40265.log 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38515.log.gz 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37931.log 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51476.log.gz 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51171.log 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40265.log.gz 2024-09-17T05:46:54.615 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51918.log 2024-09-17T05:46:54.616 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37931.log.gz 2024-09-17T05:46:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40010.log 2024-09-17T05:46:54.616 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51171.log.gz 2024-09-17T05:46:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2024-09-17T05:46:54.616 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51918.log.gz 2024-09-17T05:46:54.616 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46186.log 2024-09-17T05:46:54.618 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40010.log.gz 2024-09-17T05:46:54.618 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42039.log 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50417.log 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48827.log 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42039.log.gz 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.46186.log.gz 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.50417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35472.log 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50417.log.gz 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48576.log 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48827.log.gz 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46749.log 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35472.log.gz 2024-09-17T05:46:54.619 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2024-09-17T05:46:54.620 INFO:teuthology.orchestra.run.smithi044.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.48576.log.gz 2024-09-17T05:46:54.620 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36256.log 2024-09-17T05:46:54.620 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46749.log.gz 2024-09-17T05:46:54.621 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50996.log 2024-09-17T05:46:54.621 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2024-09-17T05:46:54.621 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2024-09-17T05:46:54.621 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36256.log.gz 2024-09-17T05:46:54.622 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39691.log 2024-09-17T05:46:54.622 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50996.log.gz 2024-09-17T05:46:54.623 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36412.log 2024-09-17T05:46:54.624 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz 2024-09-17T05:46:54.624 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2024-09-17T05:46:54.624 INFO:teuthology.orchestra.run.smithi044.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.39691.log.gz 2024-09-17T05:46:54.624 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36412.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T05:46:54.625 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36412.log.gz 2024-09-17T05:46:54.625 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42169.log 2024-09-17T05:46:54.626 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 2024-09-17T05:46:54.626 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50482.log 2024-09-17T05:46:54.627 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28812.log 2024-09-17T05:46:54.627 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42169.log.gz 2024-09-17T05:46:54.628 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46504.log 2024-09-17T05:46:54.628 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50482.log.gz 2024-09-17T05:46:54.629 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28812.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.28812.log.gz 2024-09-17T05:46:54.629 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38638.log 2024-09-17T05:46:54.630 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37652.log 2024-09-17T05:46:54.630 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46504.log.gz 2024-09-17T05:46:54.631 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42091.log 2024-09-17T05:46:54.631 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38638.log.gz 2024-09-17T05:46:54.632 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47621.log 2024-09-17T05:46:54.632 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37652.log.gz 2024-09-17T05:46:54.633 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2024-09-17T05:46:54.633 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42091.log.gz 2024-09-17T05:46:54.634 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34919.log 2024-09-17T05:46:54.634 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47621.log.gz 2024-09-17T05:46:54.635 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38335.log 2024-09-17T05:46:54.635 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2024-09-17T05:46:54.636 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2024-09-17T05:46:54.636 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34919.log.gz 2024-09-17T05:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49572.log 2024-09-17T05:46:54.637 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38335.log.gz 2024-09-17T05:46:54.638 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49886.log 2024-09-17T05:46:54.638 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2024-09-17T05:46:54.639 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28776.log 2024-09-17T05:46:54.639 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49572.log.gz 2024-09-17T05:46:54.639 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.49886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49886.log.gz 2024-09-17T05:46:54.640 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35183.log 2024-09-17T05:46:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28776.log: 75.1% -- replaced with /var/log/ceph/ceph-client.admin.28776.log.gz 2024-09-17T05:46:54.641 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51840.log 2024-09-17T05:46:54.642 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43976.log 2024-09-17T05:46:54.642 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35183.log.gz 2024-09-17T05:46:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41838.log 2024-09-17T05:46:54.643 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51840.log.gz 2024-09-17T05:46:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36043.log 2024-09-17T05:46:54.644 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43976.log.gz 2024-09-17T05:46:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40779.log 2024-09-17T05:46:54.645 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41838.log.gz 2024-09-17T05:46:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51970.log 2024-09-17T05:46:54.646 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36043.log.gz 2024-09-17T05:46:54.647 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40779.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40779.log.gz 2024-09-17T05:46:54.647 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-09-17T05:46:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2024-09-17T05:46:54.648 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51970.log.gz 2024-09-17T05:46:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49628.log 2024-09-17T05:46:54.649 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-09-17T05:46:54.649 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37345.log 2024-09-17T05:46:54.649 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2024-09-17T05:46:54.650 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-09-17T05:46:54.651 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49628.log.gz 2024-09-17T05:46:54.651 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-09-17T05:46:54.651 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37345.log.gz 2024-09-17T05:46:54.652 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45521.log 2024-09-17T05:46:54.653 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-09-17T05:46:54.653 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29401.log 2024-09-17T05:46:54.653 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-09-17T05:46:54.654 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.45521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52020.log 2024-09-17T05:46:54.654 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45521.log.gz 2024-09-17T05:46:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29401.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29401.log.gz 2024-09-17T05:46:54.655 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47775.log 2024-09-17T05:46:54.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52020.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T05:46:54.656 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52020.log.gz 2024-09-17T05:46:54.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2024-09-17T05:46:54.657 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47775.log.gz 2024-09-17T05:46:54.658 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42013.log 2024-09-17T05:46:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41013.log 2024-09-17T05:46:54.659 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2024-09-17T05:46:54.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38163.log 2024-09-17T05:46:54.661 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42013.log.gz 2024-09-17T05:46:54.661 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.41013.log: --verbose -- /var/log/ceph/ceph-client.admin.44858.log 2024-09-17T05:46:54.662 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41013.log.gz 2024-09-17T05:46:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.38163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38163.log.gz 2024-09-17T05:46:54.662 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49602.log 2024-09-17T05:46:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37626.log 2024-09-17T05:46:54.664 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44858.log.gz 2024-09-17T05:46:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46828.log 2024-09-17T05:46:54.665 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49602.log.gz 2024-09-17T05:46:54.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43443.log 2024-09-17T05:46:54.666 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37626.log.gz 2024-09-17T05:46:54.667 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35580.log 2024-09-17T05:46:54.667 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46828.log.gz 2024-09-17T05:46:54.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34973.log 2024-09-17T05:46:54.668 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43443.log.gz 2024-09-17T05:46:54.669 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44423.log 2024-09-17T05:46:54.669 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35580.log.gz 2024-09-17T05:46:54.670 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34738.log 2024-09-17T05:46:54.670 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34973.log.gz 2024-09-17T05:46:54.671 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41594.log 2024-09-17T05:46:54.671 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44423.log.gz 2024-09-17T05:46:54.672 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.34738.log: --verbose -- /var/log/ceph/ceph-client.admin.36033.log 2024-09-17T05:46:54.673 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34738.log.gz 2024-09-17T05:46:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28949.log 2024-09-17T05:46:54.674 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41594.log.gz 2024-09-17T05:46:54.675 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39893.log 2024-09-17T05:46:54.675 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36033.log.gz 2024-09-17T05:46:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39308.log 2024-09-17T05:46:54.676 INFO:teuthology.orchestra.run.smithi044.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28949.log.gz 2024-09-17T05:46:54.677 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51762.log 2024-09-17T05:46:54.677 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39893.log.gz 2024-09-17T05:46:54.677 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47847.log 2024-09-17T05:46:54.678 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39308.log.gz 2024-09-17T05:46:54.679 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51762.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51762.log.gz 2024-09-17T05:46:54.679 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42683.log 2024-09-17T05:46:54.680 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37429.log 2024-09-17T05:46:54.680 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47847.log.gz 2024-09-17T05:46:54.681 INFO:teuthology.orchestra.run.smithi086.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T05:46:54.681 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50920.log 2024-09-17T05:46:54.682 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42683.log.gz 2024-09-17T05:46:54.682 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5/var/log/ceph/ceph-client.admin.37429.log: --verbose -- /var/log/ceph/ceph-client.admin.38742.log 2024-09-17T05:46:54.683 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50920.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37429.log.gz 2024-09-17T05:46:54.683 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50920.log.gz 2024-09-17T05:46:54.683 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49520.log 2024-09-17T05:46:54.685 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36032.log 2024-09-17T05:46:54.685 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38742.log.gz 2024-09-17T05:46:54.686 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2024-09-17T05:46:54.686 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49520.log.gz 2024-09-17T05:46:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2024-09-17T05:46:54.687 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36032.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36032.log.gz 2024-09-17T05:46:54.688 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51424.log 2024-09-17T05:46:54.688 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-09-17T05:46:54.689 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48040.log 2024-09-17T05:46:54.690 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2024-09-17T05:46:54.690 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51788.log 2024-09-17T05:46:54.690 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51424.log.gz 2024-09-17T05:46:54.691 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34947.log 2024-09-17T05:46:54.691 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48040.log.gz 2024-09-17T05:46:54.692 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46684.log 2024-09-17T05:46:54.692 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51788.log.gz 2024-09-17T05:46:54.693 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50706.log 2024-09-17T05:46:54.693 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34947.log.gz 2024-09-17T05:46:54.694 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45526.log 2024-09-17T05:46:54.694 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46684.log.gz 2024-09-17T05:46:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38846.log 2024-09-17T05:46:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.45526.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.50706.log.gz 2024-09-17T05:46:54.696 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45526.log.gz 2024-09-17T05:46:54.696 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45064.log 2024-09-17T05:46:54.697 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2024-09-17T05:46:54.697 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38846.log.gz 2024-09-17T05:46:54.698 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51223.log 2024-09-17T05:46:54.699 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45064.log.gz 2024-09-17T05:46:54.699 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50864.log 2024-09-17T05:46:54.700 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2024-09-17T05:46:54.700 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42288.log 2024-09-17T05:46:54.701 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51223.log.gz 2024-09-17T05:46:54.701 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42865.log 2024-09-17T05:46:54.702 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50864.log.gz 2024-09-17T05:46:54.702 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-09-17T05:46:54.703 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42288.log.gz 2024-09-17T05:46:54.703 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44832.log 2024-09-17T05:46:54.704 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42865.log.gz 2024-09-17T05:46:54.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41416.log 2024-09-17T05:46:54.705 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-09-17T05:46:54.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51866.log 2024-09-17T05:46:54.706 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44832.log.gz 2024-09-17T05:46:54.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46854.log 2024-09-17T05:46:54.707 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41416.log.gz 2024-09-17T05:46:54.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41890.log 2024-09-17T05:46:54.708 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51866.log.gz 2024-09-17T05:46:54.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46558.log 2024-09-17T05:46:54.709 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46854.log.gz 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39030.log 2024-09-17T05:46:54.710 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41890.log.gz 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28980.log 2024-09-17T05:46:54.711 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46558.log.gz 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36909.log 2024-09-17T05:46:54.712 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39030.log.gz 2024-09-17T05:46:54.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2024-09-17T05:46:54.713 INFO:teuthology.orchestra.run.smithi044.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28980.log.gz 2024-09-17T05:46:54.714 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36909.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36909.log.gz 2024-09-17T05:46:54.714 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36883.log 2024-09-17T05:46:54.715 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45398.log 2024-09-17T05:46:54.716 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44606.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz 2024-09-17T05:46:54.716 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48906.log 2024-09-17T05:46:54.716 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36883.log.gz 2024-09-17T05:46:54.717 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2024-09-17T05:46:54.717 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45398.log.gz 2024-09-17T05:46:54.718 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.48906.log: -- /var/log/ceph/ceph-client.admin.41644.log 2024-09-17T05:46:54.719 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2024-09-17T05:46:54.719 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35632.log 2024-09-17T05:46:54.719 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2024-09-17T05:46:54.720 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51346.log 2024-09-17T05:46:54.721 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41644.log.gz 2024-09-17T05:46:54.722 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.35632.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50000.log 2024-09-17T05:46:54.722 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35632.log.gz 2024-09-17T05:46:54.722 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39174.log 2024-09-17T05:46:54.723 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51346.log.gz 2024-09-17T05:46:54.724 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44801.log 2024-09-17T05:46:54.724 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50000.log.gz 2024-09-17T05:46:54.724 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28774.log 2024-09-17T05:46:54.725 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39174.log.gz 2024-09-17T05:46:54.726 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39613.log 2024-09-17T05:46:54.726 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2024-09-17T05:46:54.727 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28774.log: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.28774.log.gz 2024-09-17T05:46:54.727 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42761.log 2024-09-17T05:46:54.727 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39613.log: -- /var/log/ceph/ceph-client.admin.40909.log 2024-09-17T05:46:54.728 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39613.log.gz 2024-09-17T05:46:54.729 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38978.log 2024-09-17T05:46:54.729 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42761.log.gz 2024-09-17T05:46:54.730 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51736.log 2024-09-17T05:46:54.730 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40909.log.gz 2024-09-17T05:46:54.731 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38978.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T05:46:54.731 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38978.log.gz 2024-09-17T05:46:54.732 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2024-09-17T05:46:54.732 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51736.log.gz 2024-09-17T05:46:54.733 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40395.log 2024-09-17T05:46:54.735 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-09-17T05:46:54.735 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2024-09-17T05:46:54.736 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2024-09-17T05:46:54.736 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40395.log.gz 2024-09-17T05:46:54.737 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34999.log 2024-09-17T05:46:54.737 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-09-17T05:46:54.738 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51528.log 2024-09-17T05:46:54.738 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz 2024-09-17T05:46:54.739 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41039.log 2024-09-17T05:46:54.739 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34999.log.gz 2024-09-17T05:46:54.741 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40552.log 2024-09-17T05:46:54.741 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51528.log.gz 2024-09-17T05:46:54.741 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37760.log 2024-09-17T05:46:54.742 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41039.log.gz 2024-09-17T05:46:54.742 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-09-17T05:46:54.742 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40552.log.gz 2024-09-17T05:46:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51398.log 2024-09-17T05:46:54.744 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37760.log.gz 2024-09-17T05:46:54.744 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49038.log 2024-09-17T05:46:54.745 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-09-17T05:46:54.746 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39490.log 2024-09-17T05:46:54.746 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51398.log.gz 2024-09-17T05:46:54.747 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49142.log 2024-09-17T05:46:54.747 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49038.log.gz 2024-09-17T05:46:54.747 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40723.log 2024-09-17T05:46:54.749 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49142.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39490.log.gz 2024-09-17T05:46:54.749 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51580.log 2024-09-17T05:46:54.749 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49142.log.gz 2024-09-17T05:46:54.750 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2024-09-17T05:46:54.750 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40723.log.gz 2024-09-17T05:46:54.751 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45593.log 2024-09-17T05:46:54.752 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51580.log.gz 2024-09-17T05:46:54.753 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37574.log 2024-09-17T05:46:54.753 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2024-09-17T05:46:54.754 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42735.log 2024-09-17T05:46:54.754 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37574.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45593.log.gz 2024-09-17T05:46:54.755 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48880.log 2024-09-17T05:46:54.755 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37574.log.gz 2024-09-17T05:46:54.756 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48332.log 2024-09-17T05:46:54.756 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42735.log.gz 2024-09-17T05:46:54.757 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48402.log 2024-09-17T05:46:54.757 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48880.log.gz 2024-09-17T05:46:54.758 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49546.log 2024-09-17T05:46:54.759 INFO:teuthology.orchestra.run.smithi044.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.48332.log.gz 2024-09-17T05:46:54.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51502.log 2024-09-17T05:46:54.759 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48402.log.gz 2024-09-17T05:46:54.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47426.log 2024-09-17T05:46:54.761 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49546.log.gz 2024-09-17T05:46:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-09-17T05:46:54.762 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51502.log.gz 2024-09-17T05:46:54.763 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43052.log 2024-09-17T05:46:54.763 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47426.log.gz 2024-09-17T05:46:54.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44319.log 2024-09-17T05:46:54.764 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-09-17T05:46:54.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41670.log 2024-09-17T05:46:54.765 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43052.log.gz 2024-09-17T05:46:54.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2024-09-17T05:46:54.766 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44319.log.gz 2024-09-17T05:46:54.767 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37371.log 2024-09-17T05:46:54.768 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41670.log.gz 2024-09-17T05:46:54.768 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45697.log 2024-09-17T05:46:54.768 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2024-09-17T05:46:54.769 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46438.log 2024-09-17T05:46:54.769 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37371.log.gz 2024-09-17T05:46:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37905.log 2024-09-17T05:46:54.771 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45697.log.gz 2024-09-17T05:46:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.46438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46438.log.gz 2024-09-17T05:46:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44170.log 2024-09-17T05:46:54.773 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2024-09-17T05:46:54.773 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37905.log.gz 2024-09-17T05:46:54.774 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45143.log 2024-09-17T05:46:54.774 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44170.log.gz 2024-09-17T05:46:54.776 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44658.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2024-09-17T05:46:54.776 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46114.log 2024-09-17T05:46:54.776 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45143.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.45143.log.gz -5 2024-09-17T05:46:54.776 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2024-09-17T05:46:54.777 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37704.log 2024-09-17T05:46:54.779 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47252.log 2024-09-17T05:46:54.779 INFO:teuthology.orchestra.run.smithi044.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.46114.log.gz 2024-09-17T05:46:54.779 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz 2024-09-17T05:46:54.780 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37704.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37704.log.gz 2024-09-17T05:46:54.780 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40428.log 2024-09-17T05:46:54.781 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47252.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47252.log.gz 2024-09-17T05:46:54.781 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44540.log 2024-09-17T05:46:54.783 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48229.log 2024-09-17T05:46:54.783 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40428.log.gz 2024-09-17T05:46:54.783 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49220.log 2024-09-17T05:46:54.784 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44540.log.gz 2024-09-17T05:46:54.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39984.log 2024-09-17T05:46:54.785 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48229.log.gz 2024-09-17T05:46:54.786 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45111.log 2024-09-17T05:46:54.786 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49220.log.gz 2024-09-17T05:46:54.787 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39984.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T05:46:54.787 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39984.log.gz 2024-09-17T05:46:54.788 INFO:teuthology.orchestra.run.smithi086.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T05:46:54.788 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.45111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37052.log 2024-09-17T05:46:54.788 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45111.log.gz 2024-09-17T05:46:54.789 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39464.log 2024-09-17T05:46:54.790 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45849.log 2024-09-17T05:46:54.790 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37052.log.gz 2024-09-17T05:46:54.791 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50826.log 2024-09-17T05:46:54.792 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39464.log.gz 2024-09-17T05:46:54.793 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45849.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45849.log.gz 2024-09-17T05:46:54.794 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48440.log 2024-09-17T05:46:54.794 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50826.log.gz 2024-09-17T05:46:54.795 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39256.log 2024-09-17T05:46:54.796 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51658.log 2024-09-17T05:46:54.797 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48440.log.gz 2024-09-17T05:46:54.797 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39256.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39256.log.gz 2024-09-17T05:46:54.798 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45424.log 2024-09-17T05:46:54.798 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51658.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51658.log.gz 2024-09-17T05:46:54.799 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2024-09-17T05:46:54.800 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43961.log 2024-09-17T05:46:54.801 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1%/var/log/ceph/ceph-client.admin.47316.log: -- replaced with /var/log/ceph/ceph-client.admin.45424.log.gz 2024-09-17T05:46:54.801 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2024-09-17T05:46:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.43961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43961.log.gz 2024-09-17T05:46:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40239.log 2024-09-17T05:46:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42962.log 2024-09-17T05:46:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50195.log 2024-09-17T05:46:54.805 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40239.log.gz 2024-09-17T05:46:54.806 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.42962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43288.log 0.0% 2024-09-17T05:46:54.806 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.0.42962.log.gz 2024-09-17T05:46:54.807 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-09-17T05:46:54.807 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50195.log.gz 2024-09-17T05:46:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41162.log 2024-09-17T05:46:54.808 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43288.log.gz 2024-09-17T05:46:54.809 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37547.log 2024-09-17T05:46:54.810 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2024-09-17T05:46:54.811 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41162.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41162.log.gz 2024-09-17T05:46:54.811 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35445.log 2024-09-17T05:46:54.812 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37547.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37547.log.gz 2024-09-17T05:46:54.812 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-09-17T05:46:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40961.log 2024-09-17T05:46:54.813 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35445.log.gz 2024-09-17T05:46:54.815 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2024-09-17T05:46:54.815 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-09-17T05:46:54.816 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43572.log 2024-09-17T05:46:54.816 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40961.log.gz 2024-09-17T05:46:54.818 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43393.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2024-09-17T05:46:54.818 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34839.log 2024-09-17T05:46:54.819 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43572.log.gz 2024-09-17T05:46:54.819 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40088.log 2024-09-17T05:46:54.820 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44475.log 2024-09-17T05:46:54.820 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34839.log.gz 2024-09-17T05:46:54.822 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40088.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40088.log.gz 2024-09-17T05:46:54.822 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38820.log 2024-09-17T05:46:54.823 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44475.log.gz 2024-09-17T05:46:54.823 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50111.log 2024-09-17T05:46:54.825 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46254.log 2024-09-17T05:46:54.825 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38820.log.gz 2024-09-17T05:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42839.log 2024-09-17T05:46:54.826 INFO:teuthology.orchestra.run.smithi044.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50111.log.gz 2024-09-17T05:46:54.827 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46254.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46254.log.gz 2024-09-17T05:46:54.827 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46634.log 2024-09-17T05:46:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42839.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42839.log.gz 2024-09-17T05:46:54.828 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47081.log 2024-09-17T05:46:54.829 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51632.log 2024-09-17T05:46:54.831 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47081.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2024-09-17T05:46:54.831 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47081.log.gz 2024-09-17T05:46:54.831 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-09-17T05:46:54.832 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43956.log 2024-09-17T05:46:54.832 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51632.log.gz 2024-09-17T05:46:54.833 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44009.log 2024-09-17T05:46:54.833 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz 2024-09-17T05:46:54.834 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.43956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43956.log.gz 2024-09-17T05:46:54.835 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37189.log 2024-09-17T05:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38716.log 2024-09-17T05:46:54.836 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44009.log.gz 2024-09-17T05:46:54.837 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47930.log 2024-09-17T05:46:54.837 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37189.log.gz 2024-09-17T05:46:54.838 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47185.log 2024-09-17T05:46:54.839 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38716.log.gz 2024-09-17T05:46:54.840 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38291.log 2024-09-17T05:46:54.840 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47930.log.gz 2024-09-17T05:46:54.841 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39438.log 2024-09-17T05:46:54.841 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47185.log.gz 2024-09-17T05:46:54.842 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50170.log 2024-09-17T05:46:54.842 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38291.log.gz 2024-09-17T05:46:54.843 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2024-09-17T05:46:54.843 INFO:teuthology.orchestra.run.smithi044.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39438.log.gz 2024-09-17T05:46:54.845 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40462.log 2024-09-17T05:46:54.845 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50170.log.gz 2024-09-17T05:46:54.845 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51249.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz 2024-09-17T05:46:54.846 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35079.log 2024-09-17T05:46:54.847 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40462.log.gz 2024-09-17T05:46:54.847 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47822.log 2024-09-17T05:46:54.848 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35027.log 2024-09-17T05:46:54.848 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35079.log.gz 2024-09-17T05:46:54.850 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.47822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47822.log.gz 2024-09-17T05:46:54.850 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36729.log 2024-09-17T05:46:54.852 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35027.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35027.log.gz 2024-09-17T05:46:54.852 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37241.log 2024-09-17T05:46:54.853 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.2.36729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36961.log 2024-09-17T05:46:54.853 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36729.log.gz 2024-09-17T05:46:54.854 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37241.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37241.log.gz 2024-09-17T05:46:54.855 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36961.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36961.log.gz 2024-09-17T05:46:54.856 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50531.log 2024-09-17T05:46:54.857 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-09-17T05:46:54.858 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50259.log 2024-09-17T05:46:54.859 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2024-09-17T05:46:54.859 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35826.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-09-17T05:46:54.860 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35833.log 2024-09-17T05:46:54.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50259.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50259.log.gz 2024-09-17T05:46:54.861 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51996.log 2024-09-17T05:46:54.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39690.log 2024-09-17T05:46:54.862 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35833.log.gz 2024-09-17T05:46:54.863 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51996.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:46:54.864 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51996.log.gz 2024-09-17T05:46:54.865 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37021.log 2024-09-17T05:46:54.865 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.39690.log.gz 2024-09-17T05:46:54.867 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37021.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37021.log.gz 2024-09-17T05:46:54.867 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44508.log 2024-09-17T05:46:54.868 INFO:teuthology.orchestra.run.smithi044.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:46:54.869 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43650.log 2024-09-17T05:46:54.870 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2024-09-17T05:46:54.870 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44508.log.gz 2024-09-17T05:46:54.872 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43650.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43650.log.gz 2024-09-17T05:46:54.872 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40526.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2024-09-17T05:46:54.872 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51606.log 2024-09-17T05:46:54.874 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41189.log 2024-09-17T05:46:54.875 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38463.log 2024-09-17T05:46:54.875 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51606.log.gz 2024-09-17T05:46:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41189.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41189.log.gz 2024-09-17T05:46:54.877 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38463.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38463.log.gz 2024-09-17T05:46:54.878 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35838.log 2024-09-17T05:46:54.879 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42523.log 2024-09-17T05:46:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-09-17T05:46:54.881 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35838.log.gz 2024-09-17T05:46:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50553.log 2024-09-17T05:46:54.881 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42523.log.gz 2024-09-17T05:46:54.883 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42549.log 2024-09-17T05:46:54.883 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-09-17T05:46:54.884 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50553.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50553.log.gz 2024-09-17T05:46:54.884 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42117.log 2024-09-17T05:46:54.885 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42549.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42549.log.gz 2024-09-17T05:46:54.885 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42462.log 2024-09-17T05:46:54.887 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35502.log 2024-09-17T05:46:54.887 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42117.log.gz 2024-09-17T05:46:54.888 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42462.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42462.log.gz 2024-09-17T05:46:54.888 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50048.log 2024-09-17T05:46:54.889 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35502.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35502.log.gz 2024-09-17T05:46:54.889 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42631.log 2024-09-17T05:46:54.890 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.50048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50048.log.gz 2024-09-17T05:46:54.890 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2024-09-17T05:46:54.892 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36831.log 2024-09-17T05:46:54.892 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42631.log.gz 2024-09-17T05:46:54.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45116.log 2024-09-17T05:46:54.893 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2024-09-17T05:46:54.894 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36831.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36831.log.gz 2024-09-17T05:46:54.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.45116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45116.log.gz 2024-09-17T05:46:54.895 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38061.log 2024-09-17T05:46:54.897 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48772.log 2024-09-17T05:46:54.899 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42256.log 2024-09-17T05:46:54.899 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2%/var/log/ceph/ceph-client.admin.48772.log: -- replaced with /var/log/ceph/ceph-client.admin.38061.log.gz 2024-09-17T05:46:54.899 INFO:teuthology.orchestra.run.smithi044.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.48772.log.gz 2024-09-17T05:46:54.900 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42256.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42256.log.gz 2024-09-17T05:46:54.901 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38690.log 2024-09-17T05:46:54.902 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-09-17T05:46:54.903 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44397.log 2024-09-17T05:46:54.903 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38690.log.gz 2024-09-17T05:46:54.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49485.log 2024-09-17T05:46:54.904 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-09-17T05:46:54.905 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34891.log 2024-09-17T05:46:54.905 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44397.log.gz 2024-09-17T05:46:54.907 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49485.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49485.log.gz 2024-09-17T05:46:54.907 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48699.log 2024-09-17T05:46:54.908 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34891.log.gz 2024-09-17T05:46:54.908 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51554.log 2024-09-17T05:46:54.909 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49090.log 2024-09-17T05:46:54.910 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48699.log.gz/var/log/ceph/ceph-client.admin.51554.log: 2024-09-17T05:46:54.911 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2024-09-17T05:46:54.911 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51554.log.gz 2024-09-17T05:46:54.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2024-09-17T05:46:54.912 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2024-09-17T05:46:54.913 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48467.log 2024-09-17T05:46:54.913 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2024-09-17T05:46:54.914 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45952.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2024-09-17T05:46:54.916 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48467.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48467.log.gz 2024-09-17T05:46:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39412.log 2024-09-17T05:46:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-17T05:46:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35131.log 2024-09-17T05:46:54.919 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39412.log.gz 2024-09-17T05:46:54.919 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28986.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-17T05:46:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35131.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35131.log.gz 2024-09-17T05:46:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-09-17T05:46:54.922 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47055.log 2024-09-17T05:46:54.924 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-09-17T05:46:54.924 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-09-17T05:46:54.925 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2024-09-17T05:46:54.925 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47055.log.gz 2024-09-17T05:46:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46310.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2024-09-17T05:46:54.926 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49920.log 2024-09-17T05:46:54.927 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49064.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2024-09-17T05:46:54.928 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37215.log 2024-09-17T05:46:54.929 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49920.log.gz 2024-09-17T05:46:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37494.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-09-17T05:46:54.930 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39282.log 2024-09-17T05:46:54.931 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37215.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37215.log.gz 2024-09-17T05:46:54.933 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39282.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39282.log.gz 2024-09-17T05:46:54.933 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-09-17T05:46:54.934 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48932.log 2024-09-17T05:46:54.936 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40608.log 2024-09-17T05:46:54.936 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-09-17T05:46:54.937 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44962.log 2024-09-17T05:46:54.937 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48932.log.gz 2024-09-17T05:46:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40608.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40608.log.gz 2024-09-17T05:46:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28941.log 2024-09-17T05:46:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44962.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44962.log.gz 2024-09-17T05:46:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35053.log 2024-09-17T05:46:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-09-17T05:46:54.941 INFO:teuthology.orchestra.run.smithi044.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28941.log.gz 2024-09-17T05:46:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47461.log 2024-09-17T05:46:54.942 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35053.log.gz 2024-09-17T05:46:54.943 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46386.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-09-17T05:46:54.943 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37825.log 2024-09-17T05:46:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47461.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47461.log.gz 2024-09-17T05:46:54.945 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28963.log 2024-09-17T05:46:54.946 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37825.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37825.log.gz 2024-09-17T05:46:54.946 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42065.log 2024-09-17T05:46:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-09-17T05:46:54.949 INFO:teuthology.orchestra.run.smithi044.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28963.log.gz 2024-09-17T05:46:54.949 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42065.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42065.log.gz 2024-09-17T05:46:54.950 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47368.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-09-17T05:46:54.950 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38204.log 2024-09-17T05:46:54.951 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41466.log 2024-09-17T05:46:54.953 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38879.log 2024-09-17T05:46:54.953 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38204.log.gz 2024-09-17T05:46:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41466.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41466.log.gz 2024-09-17T05:46:54.954 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50412.log 2024-09-17T05:46:54.955 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38879.log.gz 2024-09-17T05:46:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44749.log 2024-09-17T05:46:54.957 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.50412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38437.log 2024-09-17T05:46:54.957 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50412.log.gz 2024-09-17T05:46:54.958 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41864.log 2024-09-17T05:46:54.958 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44749.log.gz 2024-09-17T05:46:54.960 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38437.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38437.log.gz 2024-09-17T05:46:54.960 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50575.log 2024-09-17T05:46:54.960 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41864.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41864.log.gz 2024-09-17T05:46:54.961 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40114.log 2024-09-17T05:46:54.962 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46336.log 2024-09-17T05:46:54.963 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50575.log.gz 2024-09-17T05:46:54.963 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40114.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.40114.log.gz 2024-09-17T05:46:54.963 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50600.log 2024-09-17T05:46:54.964 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41492.log 2024-09-17T05:46:54.965 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9%/var/log/ceph/ceph-client.admin.50600.log: -- replaced with /var/log/ceph/ceph-client.admin.46336.log.gz 2024-09-17T05:46:54.967 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50600.log.gz 2024-09-17T05:46:54.967 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45647.log 2024-09-17T05:46:54.968 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41492.log.gz 2024-09-17T05:46:54.968 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43100.log 2024-09-17T05:46:54.969 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51048.log 2024-09-17T05:46:54.970 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43100.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45647.log.gz 2024-09-17T05:46:54.971 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43100.log.gz 2024-09-17T05:46:54.971 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39360.log 2024-09-17T05:46:54.971 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.51048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51048.log.gz 2024-09-17T05:46:54.972 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-09-17T05:46:54.973 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38158.log 2024-09-17T05:46:54.973 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39360.log.gz 2024-09-17T05:46:54.974 INFO:teuthology.orchestra.run.smithi086.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T05:46:54.975 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40671.log 2024-09-17T05:46:54.975 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-09-17T05:46:54.975 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.38158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38158.log.gz 2024-09-17T05:46:54.976 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47569.log 2024-09-17T05:46:54.977 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40671.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40671.log.gz 2024-09-17T05:46:54.977 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50289.log 2024-09-17T05:46:54.978 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2024-09-17T05:46:54.978 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47569.log.gz 2024-09-17T05:46:54.980 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50289.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50289.log.gz 2024-09-17T05:46:54.981 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38357.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2024-09-17T05:46:54.981 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39148.log 2024-09-17T05:46:54.982 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50778.log 2024-09-17T05:46:54.983 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47003.log 2024-09-17T05:46:54.984 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39148.log.gz 2024-09-17T05:46:54.986 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50778.log: /var/log/ceph/ceph-client.admin.47003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-09-17T05:46:54.986 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47003.log.gz 2024-09-17T05:46:54.986 INFO:teuthology.orchestra.run.smithi044.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.50778.log.gz 2024-09-17T05:46:54.986 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37521.log 2024-09-17T05:46:54.988 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39592.log 2024-09-17T05:46:54.988 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-09-17T05:46:54.989 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36779.log 2024-09-17T05:46:54.989 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37521.log.gz 2024-09-17T05:46:54.990 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.39592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39592.log.gz 2024-09-17T05:46:54.990 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46280.log 2024-09-17T05:46:54.992 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46932.log 2024-09-17T05:46:54.992 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36779.log.gz 2024-09-17T05:46:54.993 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42405.log 2024-09-17T05:46:54.993 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46280.log.gz 2024-09-17T05:46:54.994 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48523.log 2024-09-17T05:46:54.995 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46932.log.gz 2024-09-17T05:46:54.995 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40317.log 2024-09-17T05:46:54.995 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42405.log.gz 2024-09-17T05:46:54.998 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48523.log: /var/log/ceph/ceph-client.admin.40317.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48523.log.gz 2024-09-17T05:46:54.998 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49457.log 2024-09-17T05:46:54.998 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40317.log.gz 2024-09-17T05:46:54.998 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37267.log 2024-09-17T05:46:55.000 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47398.log 2024-09-17T05:46:55.000 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49457.log.gz 2024-09-17T05:46:55.001 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37267.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37267.log.gz 2024-09-17T05:46:55.002 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37081.log 2024-09-17T05:46:55.002 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47398.log.gz 2024-09-17T05:46:55.003 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:46:55.005 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50751.log 2024-09-17T05:46:55.005 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37081.log.gz 2024-09-17T05:46:55.009 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35762.log 2024-09-17T05:46:55.009 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50751.log: /var/log/ceph/ceph-client.admin.35762.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.50751.log.gz 2024-09-17T05:46:55.009 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35762.log.gz 2024-09-17T05:46:55.009 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46608.log 2024-09-17T05:46:55.009 INFO:teuthology.orchestra.run.smithi044.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:46:55.010 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T05:46:55.011 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39958.log 2024-09-17T05:46:55.011 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46608.log.gz 2024-09-17T05:46:55.012 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40883.log 2024-09-17T05:46:55.014 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39958.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39958.log.gz 2024-09-17T05:46:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40883.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40883.log.gz 2024-09-17T05:46:55.015 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39386.log 2024-09-17T05:46:55.016 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35259.log 2024-09-17T05:46:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39386.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39386.log.gz 2024-09-17T05:46:55.018 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T05:46:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35259.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35259.log.gz 2024-09-17T05:46:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39122.log 2024-09-17T05:46:55.022 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.39122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44884.log 2024-09-17T05:46:55.023 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39122.log.gz 2024-09-17T05:46:55.025 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51088.log 2024-09-17T05:46:55.027 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44884.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44884.log.gz 2024-09-17T05:46:55.029 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51088.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51088.log.gz 2024-09-17T05:46:55.029 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51145.log 2024-09-17T05:46:55.031 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36857.log 2024-09-17T05:46:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51145.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51145.log.gz 2024-09-17T05:46:55.035 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36857.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36857.log.gz 2024-09-17T05:46:55.035 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44196.log 2024-09-17T05:46:55.038 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44196.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44196.log.gz 2024-09-17T05:46:55.038 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36987.log 2024-09-17T05:46:55.043 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43496.log 2024-09-17T05:46:55.043 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36987.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36987.log.gz 2024-09-17T05:46:55.043 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49706.log/var/log/ceph/ceph-client.admin.43496.log: 2024-09-17T05:46:55.043 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43496.log.gz 2024-09-17T05:46:55.045 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41916.log 2024-09-17T05:46:55.047 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35827.log 2024-09-17T05:46:55.048 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41916.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41916.log.gz 2024-09-17T05:46:55.049 INFO:teuthology.orchestra.run.smithi044.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49706.log.gz 2024-09-17T05:46:55.052 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35827.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35827.log.gz 2024-09-17T05:46:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-09-17T05:46:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45799.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-09-17T05:46:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36282.log 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36282.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36282.log.gz 2024-09-17T05:46:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28891.log 2024-09-17T05:46:55.062 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28891.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28891.log.gz 2024-09-17T05:46:55.062 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44936.log 2024-09-17T05:46:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47699.log 2024-09-17T05:46:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44936.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44936.log.gz 2024-09-17T05:46:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47699.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47699.log.gz 2024-09-17T05:46:55.069 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35684.log 2024-09-17T05:46:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35684.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35684.log.gz 2024-09-17T05:46:55.071 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49311.log 2024-09-17T05:46:55.074 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49311.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49311.log.gz 2024-09-17T05:46:55.074 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41237.log 2024-09-17T05:46:55.077 INFO:teuthology.orchestra.run.smithi044.stderr:gzip/var/log/ceph/ceph-client.admin.41237.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41237.log.gz 2024-09-17T05:46:55.078 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2024-09-17T05:46:55.080 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42497.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2024-09-17T05:46:55.080 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43238.log 2024-09-17T05:46:55.084 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43238.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43238.log.gz 2024-09-17T05:46:55.084 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37397.log 2024-09-17T05:46:55.087 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37397.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37397.log.gz 2024-09-17T05:46:55.087 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43340.log 2024-09-17T05:46:55.089 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.43340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43340.log.gz 2024-09-17T05:46:55.089 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39587.log 2024-09-17T05:46:55.092 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2024-09-17T05:46:55.092 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.39587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39587.log.gz 2024-09-17T05:46:55.095 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40636.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2024-09-17T05:46:55.095 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36049.log 2024-09-17T05:46:55.098 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36049.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36049.log.gz 2024-09-17T05:46:55.098 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42787.log 2024-09-17T05:46:55.100 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42787.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42787.log.gz 2024-09-17T05:46:55.101 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28983.log 2024-09-17T05:46:55.103 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49279.log 2024-09-17T05:46:55.104 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28983.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28983.log.gz 2024-09-17T05:46:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49279.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49279.log.gz 2024-09-17T05:46:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46091.log 2024-09-17T05:46:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46091.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46091.log.gz 2024-09-17T05:46:55.111 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36050.log 2024-09-17T05:46:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37732.log 2024-09-17T05:46:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36050.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36050.log.gz 2024-09-17T05:46:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37732.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37732.log.gz 2024-09-17T05:46:55.116 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48647.log 2024-09-17T05:46:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48647.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48647.log.gz 2024-09-17T05:46:55.120 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42657.log 2024-09-17T05:46:55.121 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2024-09-17T05:46:55.123 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42657.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42657.log.gz 2024-09-17T05:46:55.123 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38264.log 2024-09-17T05:46:55.126 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43022.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2024-09-17T05:46:55.126 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38264.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38264.log.gz 2024-09-17T05:46:55.127 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40036.log 2024-09-17T05:46:55.130 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40036.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40036.log.gz 2024-09-17T05:46:55.130 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37163.log 2024-09-17T05:46:55.132 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37163.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37163.log.gz 2024-09-17T05:46:55.132 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 2024-09-17T05:46:55.136 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47725.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz 2024-09-17T05:46:55.136 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40857.log 2024-09-17T05:46:55.139 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40857.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40857.log.gz 2024-09-17T05:46:55.139 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43807.log 2024-09-17T05:46:55.142 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38911.log 2024-09-17T05:46:55.142 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43807.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43807.log.gz 2024-09-17T05:46:55.145 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38911.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38911.log.gz 2024-09-17T05:46:55.145 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50890.log 2024-09-17T05:46:55.148 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50890.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50890.log.gz 2024-09-17T05:46:55.148 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2024-09-17T05:46:55.151 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49732.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2024-09-17T05:46:55.151 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28988.log 2024-09-17T05:46:55.154 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40185.log 2024-09-17T05:46:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28988.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28988.log.gz 2024-09-17T05:46:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46801.log 2024-09-17T05:46:55.155 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40185.log.gz 2024-09-17T05:46:55.158 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46801.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46801.log.gz 2024-09-17T05:46:55.158 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37293.log 2024-09-17T05:46:55.161 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37293.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37293.log.gz 2024-09-17T05:46:55.161 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43622.log 2024-09-17T05:46:55.165 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48106.log 2024-09-17T05:46:55.165 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43622.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43622.log.gz 2024-09-17T05:46:55.165 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47107.log 85.4% -- replaced with /var/log/ceph/ceph-client.admin.48106.log.gz 2024-09-17T05:46:55.165 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-17T05:46:55.167 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47107.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47107.log.gz 2024-09-17T05:46:55.168 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41812.log 2024-09-17T05:46:55.170 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41812.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41812.log.gz 2024-09-17T05:46:55.170 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46061.log 2024-09-17T05:46:55.173 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46061.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46061.log.gz 2024-09-17T05:46:55.173 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40369.log 2024-09-17T05:46:55.174 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48105.log 2024-09-17T05:46:55.178 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40369.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40369.log.gz 2024-09-17T05:46:55.178 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36478.log 2024-09-17T05:46:55.180 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48105.log.gz 2024-09-17T05:46:55.181 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23909.log 2024-09-17T05:46:55.183 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49116.log 2024-09-17T05:46:55.184 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36478.log: /var/log/ceph/ceph.tmp-client.admin.23909.log: 0.0% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36478.log.gz 2024-09-17T05:46:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28990.log 2024-09-17T05:46:55.187 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49116.log.gz 2024-09-17T05:46:55.189 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42379.log 2024-09-17T05:46:55.190 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.23909.log.gz 2024-09-17T05:46:55.191 INFO:teuthology.orchestra.run.smithi044.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28990.log.gz 2024-09-17T05:46:55.192 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36596.log 2024-09-17T05:46:55.193 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42379.log.gz 2024-09-17T05:46:55.194 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42992.log 2024-09-17T05:46:55.196 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.36596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36596.log.gz 2024-09-17T05:46:55.198 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42579.log 2024-09-17T05:46:55.200 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42992.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42992.log.gz 2024-09-17T05:46:55.201 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50509.log 2024-09-17T05:46:55.206 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42579.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42579.log.gz 2024-09-17T05:46:55.206 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50509.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50509.log.gz 2024-09-17T05:46:55.206 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43075.log 2024-09-17T05:46:55.212 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43075.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43075.log.gz 2024-09-17T05:46:55.212 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2024-09-17T05:46:55.213 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49680.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2024-09-17T05:46:55.213 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38111.log 2024-09-17T05:46:55.214 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49950.log 2024-09-17T05:46:55.218 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38111.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38111.log.gz 2024-09-17T05:46:55.218 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49950.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49950.log.gz 2024-09-17T05:46:55.219 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2024-09-17T05:46:55.221 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47955.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2024-09-17T05:46:55.221 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41136.log 2024-09-17T05:46:55.222 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38234.log 2024-09-17T05:46:55.224 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.41136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41136.log.gz 2024-09-17T05:46:55.227 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36614.log 2024-09-17T05:46:55.227 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38234.log.gz 2024-09-17T05:46:55.229 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29348.log 2024-09-17T05:46:55.233 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29348.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29348.log.gz 2024-09-17T05:46:55.233 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.36614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36614.log.gz 2024-09-17T05:46:55.233 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29324.log 2024-09-17T05:46:55.236 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.29324.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29324.log.gz 2024-09-17T05:46:55.236 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48377.log 2024-09-17T05:46:55.239 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48377.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48377.log.gz 2024-09-17T05:46:55.239 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47673.log 2024-09-17T05:46:55.242 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49427.log 2024-09-17T05:46:55.242 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47673.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47673.log.gz 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49427.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49427.log.gz 2024-09-17T05:46:55.245 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48007.log 2024-09-17T05:46:55.248 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.48007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48007.log.gz 2024-09-17T05:46:55.248 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40805.log 2024-09-17T05:46:55.251 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40805.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40805.log.gz 2024-09-17T05:46:55.251 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28925.log 2024-09-17T05:46:55.253 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28925.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28925.log.gz 2024-09-17T05:46:55.254 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44910.log 2024-09-17T05:46:55.258 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39816.log 2024-09-17T05:46:55.258 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44910.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44910.log.gz 2024-09-17T05:46:55.259 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34865.log 2024-09-17T05:46:55.259 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39816.log.gz 2024-09-17T05:46:55.261 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.34865.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34865.log.gz 2024-09-17T05:46:55.262 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2024-09-17T05:46:55.265 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42353.log 2024-09-17T05:46:55.265 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2024-09-17T05:46:55.267 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28786.log 2024-09-17T05:46:55.269 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42353.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42353.log.gz 2024-09-17T05:46:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39334.log 2024-09-17T05:46:55.271 INFO:teuthology.orchestra.run.smithi044.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T05:46:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39334.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39334.log.gz 2024-09-17T05:46:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.28786.log.gz 2024-09-17T05:46:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40578.log 2024-09-17T05:46:55.276 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38593.log 2024-09-17T05:46:55.277 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40578.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40578.log.gz 2024-09-17T05:46:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38593.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38593.log.gz 2024-09-17T05:46:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48305.log 2024-09-17T05:46:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36935.log 2024-09-17T05:46:55.282 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48305.log: 90.1%/var/log/ceph/ceph-client.admin.36935.log: -- replaced with /var/log/ceph/ceph-client.admin.48305.log.gz 2024-09-17T05:46:55.282 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36935.log.gz 2024-09-17T05:46:55.282 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47218.log 2024-09-17T05:46:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50233.log 2024-09-17T05:46:55.285 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47218.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47218.log.gz 2024-09-17T05:46:55.286 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50233.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50233.log.gz 2024-09-17T05:46:55.286 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36753.log 2024-09-17T05:46:55.288 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47342.log 2024-09-17T05:46:55.289 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36753.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36753.log.gz 2024-09-17T05:46:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47342.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47342.log.gz 2024-09-17T05:46:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46030.log 2024-09-17T05:46:55.292 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49834.log 2024-09-17T05:46:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46030.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46030.log.gz 2024-09-17T05:46:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49834.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49834.log.gz 2024-09-17T05:46:55.294 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51892.log 2024-09-17T05:46:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49881.log 2024-09-17T05:46:55.297 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51892.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51892.log.gz 2024-09-17T05:46:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.49881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49881.log.gz 2024-09-17T05:46:55.298 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46433.log 2024-09-17T05:46:55.299 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2024-09-17T05:46:55.301 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.46433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46433.log.gz 2024-09-17T05:46:55.302 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48575.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2024-09-17T05:46:55.303 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40211.log 2024-09-17T05:46:55.304 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49654.log 2024-09-17T05:46:55.306 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40211.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40211.log.gz 2024-09-17T05:46:55.307 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49654.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49654.log.gz 2024-09-17T05:46:55.308 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49194.log 2024-09-17T05:46:55.308 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40697.log 2024-09-17T05:46:55.310 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49194.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49194.log.gz 2024-09-17T05:46:55.311 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40697.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40697.log.gz 2024-09-17T05:46:55.311 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41141.log 2024-09-17T05:46:55.313 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35554.log 2024-09-17T05:46:55.315 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.41141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41141.log.gz 2024-09-17T05:46:55.315 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35554.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35554.log.gz 2024-09-17T05:46:55.315 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2024-09-17T05:46:55.316 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2024-09-17T05:46:55.319 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51944.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2024-09-17T05:46:55.319 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.40987.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2024-09-17T05:46:55.319 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-09-17T05:46:55.320 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49401.log 2024-09-17T05:46:55.322 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45302.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-09-17T05:46:55.322 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49401.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49401.log.gz 2024-09-17T05:46:55.323 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35658.log 2024-09-17T05:46:55.324 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2024-09-17T05:46:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35658.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35658.log.gz 2024-09-17T05:46:55.327 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38009.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2024-09-17T05:46:55.327 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43546.log 2024-09-17T05:46:55.328 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50315.log 2024-09-17T05:46:55.330 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43546.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43546.log.gz 2024-09-17T05:46:55.331 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50315.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50315.log.gz 2024-09-17T05:46:55.332 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35387.log 2024-09-17T05:46:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39230.log 2024-09-17T05:46:55.334 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41340.log 2024-09-17T05:46:55.337 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39230.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39230.log.gz 2024-09-17T05:46:55.337 INFO:teuthology.orchestra.run.smithi044.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.35387.log.gz 2024-09-17T05:46:55.339 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41340.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41340.log.gz 2024-09-17T05:46:55.339 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44632.log 2024-09-17T05:46:55.341 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35736.log 2024-09-17T05:46:55.342 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44632.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44632.log.gz 2024-09-17T05:46:55.343 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35736.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35736.log.gz 2024-09-17T05:46:55.343 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36045.log 2024-09-17T05:46:55.345 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38489.log 2024-09-17T05:46:55.346 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36045.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36045.log.gz 2024-09-17T05:46:55.347 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38489.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38489.log.gz 2024-09-17T05:46:55.348 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35209.log 2024-09-17T05:46:55.349 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35710.log 2024-09-17T05:46:55.351 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35209.log: 91.2%/var/log/ceph/ceph-client.admin.35710.log: -- replaced with /var/log/ceph/ceph-client.admin.35209.log.gz 2024-09-17T05:46:55.352 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35710.log.gz 2024-09-17T05:46:55.352 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38411.log 2024-09-17T05:46:55.353 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41287.log 2024-09-17T05:46:55.355 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38411.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38411.log.gz 2024-09-17T05:46:55.356 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41287.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41287.log.gz 2024-09-17T05:46:55.356 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47159.log 2024-09-17T05:46:55.358 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28982.log 2024-09-17T05:46:55.359 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47159.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47159.log.gz 2024-09-17T05:46:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28982.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28982.log.gz 2024-09-17T05:46:55.361 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50452.log 2024-09-17T05:46:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 2024-09-17T05:46:55.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50452.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50452.log.gz 2024-09-17T05:46:55.364 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.35528.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-09-17T05:46:55.365 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2024-09-17T05:46:55.366 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28960.log 2024-09-17T05:46:55.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44222.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2024-09-17T05:46:55.368 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.28960.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28960.log.gz 2024-09-17T05:46:55.369 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2024-09-17T05:46:55.370 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50673.log 2024-09-17T05:46:55.372 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48958.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-09-17T05:46:55.373 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50673.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50673.log.gz 2024-09-17T05:46:55.373 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36638.log 2024-09-17T05:46:55.375 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45203.log 2024-09-17T05:46:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.36638.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36638.log.gz 2024-09-17T05:46:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45203.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45203.log.gz 2024-09-17T05:46:55.378 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46977.log 2024-09-17T05:46:55.379 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43883.log 2024-09-17T05:46:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46977.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46977.log.gz 2024-09-17T05:46:55.381 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43883.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43883.log.gz 2024-09-17T05:46:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2024-09-17T05:46:55.383 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45902.log 2024-09-17T05:46:55.386 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45543.log: /var/log/ceph/ceph-client.admin.45902.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2024-09-17T05:46:55.386 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2024-09-17T05:46:55.387 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45902.log.gz 2024-09-17T05:46:55.388 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44345.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2024-09-17T05:46:55.388 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38768.log 2024-09-17T05:46:55.390 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2024-09-17T05:46:55.390 INFO:teuthology.orchestra.run.smithi044.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T05:46:55.391 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.38768.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38768.log.gz 2024-09-17T05:46:55.392 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43833.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2024-09-17T05:46:55.393 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2024-09-17T05:46:55.394 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49246.log 2024-09-17T05:46:55.396 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50053.log 2024-09-17T05:46:55.396 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2024-09-17T05:46:55.396 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49246.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49246.log.gz 2024-09-17T05:46:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.50053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50053.log.gz 2024-09-17T05:46:55.398 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42709.log 2024-09-17T05:46:55.399 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-09-17T05:46:55.401 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39004.log 2024-09-17T05:46:55.401 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42709.log.gz 2024-09-17T05:46:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46906.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2024-09-17T05:46:55.402 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.39004.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39004.log.gz 2024-09-17T05:46:55.403 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42223.log 2024-09-17T05:46:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2024-09-17T05:46:55.406 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47543.log 2024-09-17T05:46:55.406 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42223.log.gz 2024-09-17T05:46:55.407 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43757.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-09-17T05:46:55.407 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47543.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47543.log.gz 2024-09-17T05:46:55.563 INFO:teuthology.orchestra.run.smithi044.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T05:46:55.810 INFO:teuthology.orchestra.run.smithi086.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T05:46:55.913 INFO:teuthology.orchestra.run.smithi086.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T05:46:56.010 INFO:teuthology.orchestra.run.smithi086.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T05:46:56.036 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T05:46:56.084 INFO:teuthology.orchestra.run.smithi086.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T05:46:56.086 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-17T05:46:56.087 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m1.579s 2024-09-17T05:46:56.087 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m6.018s 2024-09-17T05:46:56.087 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m0.549s 2024-09-17T05:46:56.177 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T05:46:56.271 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T05:46:56.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-17T05:46:56.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-17T05:46:56.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-17T05:46:56.412 INFO:teuthology.orchestra.run.smithi044.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T05:46:56.414 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-09-17T05:46:56.414 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m1.926s 2024-09-17T05:46:56.414 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m7.888s 2024-09-17T05:46:56.415 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m1.500s 2024-09-17T05:46:56.415 INFO:tasks.ceph:Archiving logs... 2024-09-17T05:46:56.416 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/remote/smithi044/log 2024-09-17T05:46:56.416 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:46:58.450 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/remote/smithi086/log 2024-09-17T05:46:58.451 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:46:59.167 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T05:46:59.176 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T05:46:59.176 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:46:59.180 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:46:59.261 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T05:46:59.270 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T05:46:59.271 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:46:59.274 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:46:59.287 INFO:teuthology.orchestra.run.smithi044.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:46:59.287 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================== 2024-09-17T05:46:59.287 INFO:teuthology.orchestra.run.smithi044.stdout:+hv01.front.sepi 67.205.162.81 3 u 20 64 377 0.083 -4.344 0.562 2024-09-17T05:46:59.287 INFO:teuthology.orchestra.run.smithi044.stdout:+hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.086 -2.232 1.204 2024-09-17T05:46:59.287 INFO:teuthology.orchestra.run.smithi044.stdout:*hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.114 -1.943 0.692 2024-09-17T05:46:59.287 INFO:teuthology.orchestra.run.smithi044.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-17T05:46:59.289 INFO:teuthology.orchestra.run.smithi086.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:46:59.289 INFO:teuthology.orchestra.run.smithi086.stdout:============================================================================== 2024-09-17T05:46:59.289 INFO:teuthology.orchestra.run.smithi086.stdout:+hv01.front.sepi 67.205.162.81 3 u 26 64 377 0.102 -1.945 1.380 2024-09-17T05:46:59.289 INFO:teuthology.orchestra.run.smithi086.stdout:*hv02.front.sepi 63.231.80.2 3 u 20 64 377 0.086 -2.891 1.222 2024-09-17T05:46:59.289 INFO:teuthology.orchestra.run.smithi086.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.080 -2.178 1.881 2024-09-17T05:46:59.289 INFO:teuthology.orchestra.run.smithi086.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-17T05:46:59.290 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T05:46:59.313 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T05:46:59.314 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T05:46:59.380 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T05:46:59.464 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T05:46:59.540 INFO:teuthology.task.internal:Duration was 1379.951709 seconds 2024-09-17T05:46:59.540 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T05:46:59.622 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T05:46:59.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:46:59.626 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:46:59.736 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T05:46:59.737 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-09-17T05:46:59.737 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:46:59.758 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-17T05:46:59.758 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:46:59.779 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T05:46:59.779 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:46:59.805 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:46:59.860 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T05:46:59.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:46:59.893 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:46:59.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T05:46:59.993 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T05:46:59.993 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:47:00.014 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:47:00.035 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T05:47:00.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:47:00.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:47:00.075 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-09-17T05:47:00.094 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-17T05:47:00.112 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:47:00.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:47:00.145 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:47:00.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:47:00.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T05:47:00.171 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T05:47:00.171 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/remote/smithi044 2024-09-17T05:47:00.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:47:00.213 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908621/remote/smithi086 2024-09-17T05:47:00.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:47:00.239 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T05:47:00.239 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:47:00.257 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:47:00.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T05:47:00.298 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T05:47:00.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T05:47:00.340 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T05:47:00.340 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:47:00.343 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:47:00.349 INFO:teuthology.orchestra.run.smithi044.stdout: 655464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:47 /home/ubuntu/cephtest 2024-09-17T05:47:00.352 INFO:teuthology.orchestra.run.smithi086.stdout: 658143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:47 /home/ubuntu/cephtest 2024-09-17T05:47:00.353 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T05:47:00.416 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T05:47:00.585 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/forward-scrub} duration: 1379.9517085552216 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T05:47:00.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:47:00.688 INFO:teuthology.run:pass